In the early 1920's, Harry Cohen moved from the Bronx with his family to Ellenville, NY, and opened Cohen's Quality Bakery. The bakery was not located at its present site, but started out on Canal Street in Ellenville, then another location on Center Street, and finally ended up in the red brick building at 89 Center Street. Upon Harry's passing, his son, Willie, along with his youngest brother, Ruby, took over the operation and management of their father's legacy. In 1966 Willie suddenly passed away, leaving the business to Ruby, who was the sole proprietor of the bakery. For more than 45 years, Ruby upheld the level of excellence established by his father so many years ago.

In 2003, due to Ruby's failing health, Bill Tochterman and Fouad Kerendian purchased the "Cohen's Bakery" name, business, and the time-honored Cohen recipes. For the first time in almost 90 years, the bakery is no longer owned by the Cohen's family, yet the breads and baked goods are as wonderful as ever.