People lived on Robben Island many thousands of years ago, when the sea channel between the Island and the Cape mainland was not covered with water. Since the Dutch settled at the Cape in the mid-1600s, Robben Island has been used primarily as a prison.