There is known to have been a lord of Rockley from the 12th century (Hunter 1831, 282). The manor transferred to the Everinghams, of Stainborough, in the 14th century and later transferred between a number of different families (ibid, 284). There would have been a manor house in the area from the medieval period. The current building was rebuilt in stone in the 16th or 17th century but was probably an alteration of an earlier building. This may have occurred when the hall was bought by William Walker in 1573 (Hey 1981, 147). Hey (1981, 147) indicates there are traces of the medieval building within the current structure so legibility of the earlier building is fragmentary. There may have been a moat around the Hall in the past (see SMR file for PIN 349).