Six generations of George Bakers form the basis of the lineage of this family, established at Crook Hall, near Lanchester, Co. Durham and then Elemore Hall, Pittington, Co. Durham. Sir George Baker (d. 1667) purchased Crook Hall around 1635, and was succeeded by his son George Baker (d. 1677). Of his sons, Thomas Baker (1656-1737) was a noted antiquary, and George Baker (d. 1697) inherited Crook.
George Baker (d. 1723), the fourth of the sequence and son of the third, married Elizabeth, daughter of Thomas Conyers, through whom the family inherited Elemore Hall and the Boulby Alum Works in North Yorkshire, and was an MP for Durham City. At his death his two children, George Baker (d. 1774) and his sister Margaret were still minors. George studied at Eton, and Cambridge, and married Judith, daughter of Cuthbert Routh (d. 1752) of Dinsdale in 1749. While she proved to have a fine understanding and control of business, his affairs show a more extravagent attitude to life.
The last George Baker (d. 1837) had a daughter, Isabella, who married his sister Elizabeth's son Henry Tower (George Baker's sister having married Christopher Tower). Their son Henry John Baker Tower changed his name in accordance with the will of the last George Baker, to Henry John Baker in 1844. His son Ferdinand (1858-1909) made over Elemore Hall to his sisters Isabel (d. 1911) and Eva (d. 1931), from whom Henry Conyers Baker Baker, eldest son of their youngest brother, inherited in 1931.
From the guide to the Baker Baker Papers, 1492-1973; predominantly 18th and 19th century, (Durham University Library, Archives and Special Collections)