The original house was built by B. F. Hastings in 1853. Judge Edwin B. Crocker bought it in 1868. The gallery next to it was designed by Seth Babson, planned in 1871 and completed in 1874, to show the art the Crockers collected.
In 1885, Margaret Crocker gave the gallery and the collection to the City of Sacramento and the California Museum Association. The museum is described as the oldest art museum in the western United States.
A big expansion designed by Gwathmey Siegel & Associates opened on October 10, 2010, adding the modern wing you see beside the old mansion.

