65 Prince Street, ca. 1897.

The twin Federal-style houses built at 63 and 65 Prince Street were constructed by Samuel L. Gouverneur in 1825 and 1826. Gouverneur, by marriage to Maria Hester Monroe was the son-in-law and nephew of former President James Monroe. Despite James Monroe’s impressive military and political career—two terms as President, Minister to France and to England, Envoy to Spain, Secretary of State, and author of the Monroe Doctrine— he was overwhelmed with financial difficulties following his departure from office. Monroe came to live in the corner house in 1830, where he died on the Fourth of July just one year later.

Following Monroe's death in 1831, the house changed owners many times. Eventually, John H. Contoit purchased the home for $32,500 in 1873, at a time when the neighborhood had succumbed to commerce. As wealthy families moved northwards, many mansions and homes in Lower Manhattan, including this one, were taken over by business. Contoit, who was the proprietor of the pleasure garden known both as the New York Garden and Contoit’s Garden, converted the house into a small factory and the home of G. Rosenberg's Vienna and Hungarian Café and Restaurant.

The advertisement for the play, The Last Stroke, on the side wall depicts the decline of this house in which a former present ended his days. In 1905, the New York Times admitted: “The old Colonial house, 63 Prince Street, where Monroe died, is falling to decay." Despite restoration and preservation efforts, the house was sold on November 12, 1919, to an unknown speculator.