These ten buildings, designed by Harrison, Fouilhoux & Abramovitz, were built during World War II as housing for Navy personnel at the nearby Brooklyn Navy Yard. The north complex housed enlisted men, while the south was primarily for officers. Several of the large mansions on Clinton Avenue were torn down during construction of the towers. After the war, the buildings became a private development.

The availability of affordable housing in the Clinton Hill Coops, and later the St. James Towers, as well as the solidifying presence of large institutions like Pratt and St. Joseph's University, are the reason Clinton Hill was able to stave off much of the urban blight that plagued other Brooklyn neighborhoods in the 60s, 70s and 80s.

In 2017, residents of the St. James Towers voted to remain in the Mitchell-Lama program.