The Decker Building was the site of Andy Warhol's Factory from 1968 and 1973.

Fittingly, the building was designed by a radical anarchist architect, John H. Engelmann when he worked for Alfred Zucker in 1892. Engelmann had been expelled from the Socialist Labor Party and immediately formed the American Social League. Its name comes from the piano company that commissioned it: Decker.

Andy Warhol moved his Factory to the Decker Building in 1968 after the original Factory's building on East 47th Street was slated for demolition. Warhol used a large portion of the sales of his work to fund his "Factory." It was at this factory where a bulk of Warhol's screenprints were produced by an assembly-line of workers. Conveniently, the Decker was in close proximity to Max's Kansas City, a nightclub he and his entourage would frequent. Warhol's sixth-floor unit was both a workspace and hangout frequently crowded with socialites, intellectuals, artists, adult film stars, drag queens, drug users, musicians, and many other characters on the fringes of society. These friends of Warhols became his "art-workers," producing his paintings, starring in his films, and generating the atmosphere the Factory became known for.

It was here on a fateful afternoon in June (the 3rd) of 1968 that Warhol would be shot by Valerie Solanas. Solanas was a radical feminist and author who asked Warhol to produce her play titled "Up Your Ass," which she later accused Warhol of stealing. Solanas followed Warhol and Paul Morrisey into the elevator to the 6th-floor Factory where she shot Warhol three times and art critic Mario Amaya once. Warhol and Amaya recovered from their injuries and Solanas turned herself in.

The Factory remained at this location until 1973.