Although it is often forgotten, Chelsea played a significant role in New York's African American community and its history, particularly in the second half of the 19th Century. As early as the 1840’s Pierre Toussaint a freed Haitian slave, now in the process of canonization, played a significant role in establishing St Vincent DePauls Roman Catholic on W 23 St for French speaking New Yorkers. This Church started an early school for African Americans in the city. On Lamartine Place, the block of West 29th St between 8th and 9th Aves, the Hopper-Gibbons a Quaker family that played a crucial role in Abolitionism and many progressive and charitable causes, used their house as a stop in the Underground Railroad. The house, still stands is to date the only verifiable Underground Railroad safe House in Manhattan. Particularly from the 1880s to 1900's (and lingering onto WWI), New York's African American community having been displaced from southern Greenwich Village settled in the West 20s and 30s. Thus the areas “Negro Tenderloin” was to the citys largest African-American settlement by the 1890s until once again the community was forced to move because of a brutal race riot in 1900 and displacement due to the demolition of a core area to build Penn Station. Faced with the prospects of bad living conditions, a violent and dangerous environment and displacement, St. Philips Episcopal Church, the city's oldest African American congregation which at the time was located on West 25th St played a central role in fomenting the move to Harlem by a significant portion of the cities African population. Several other of the cities older and most prominent black churches and institutions were in the neighborhood in the latter 19th Century including Bethel AME Church on W25 St and Mt Oliver and Shiloh on West 26th Street and the Colored Mission and the Sons of New York Club on West 30th St.

(c. 1854, Amnon Macvey, Superintendent of School Buildings) The New York City Board of Education was established in 1842, and in 1853 it merged with the older Public School Society to create Manhattan’s first true municipal public school system. Under it, schools were overseen by the local ward trustees who had considerable oversight over the construction and operation of school buildings. This building was completed during the long tenure of Macvey, who served from the 1830’s (under the Public School Society) through the 1870’s. One of the three oldest public school buildings in Manhattan, its Italianate design is characteristic of the period, with a symmetrical facade featuring a slightly projecting central section with shallow pediment.

In 1750, British naval officer Thomas Clarke bought a Dutch farm to create his retirement estate, named “Chelsea” after the Royal Hospital Chelsea in London. His property extended from approximately Eighth Avenue to the Hudson—its shore ran roughly along today’s Tenth Avenue—between 20th and 28th Streets. The estate was subdivided in 1813 between two grandsons; Clement Clarke Moore received the southern half below 24th Street while his cousin, Thomas B. Clarke, inherited the northern section. The two halves developed distinctly different characters due to the split. Today, Chelsea contains a variety of historic architecture, including some of the city’s most intact nineteenth-century residential blocks, significant commercial buildings, and industrial complexes near the Hudson River.