The concept for the building was originally commissioned as a memorial to Prince Albert and intended to contain room for lectures, museum, picture gallery and a reference library for students by British Association for the Advancement of Science. The building was designed by George Gilbert Scott, who intended to buil a large tower alongside. However, when construction began in 1865, the ground proved too unstable to support the larger tower that he envisaged. The building was opened as the Albert Institute in 1867. Two further sections, which extended the building by four art galleries and four museum galleries, were added by 1889. The central section was designed to Scott's intention by David MacKenzie, with the Eastern Galleries by William Alexander.