Standing high on Windmill Hill above The Rocks, Fort Phillip was built to defend the colony from threats coming from the ocean to the east, and the hinterland to the west. Though the guns remained there until the 1820s, the fort was never finished, and was more useful as a signal and telegraph station by 1840, when it was partly demolished.