The earliest record of a Jewish community n Kaharlyk was in 1847. By 1897, the Jewish population had reached 1,414. The community was severely affected by pogroms during the civil war in 1919. The last known burial at the site occurred in 1991.
The cemetery is located about 2km from the centre of Kaharlyk on Pervomayskaya street.behind in what were originally bushes behind an oil depot. ESJF surveyors in spring 2015 found no signage, wall, fence, or gate surrounding the site. Only a few gravestones were visible with some toppled or broken Some tombstones have portraits on stones in the Soviet style, and/or metal fences around the graves. The cemetery contains no known mass graves. The cemetery was vandalised during World War II.