The temple of Goddess Kali there is visited by devotees year round, especially during the Navratras. This holy shrine is one of 108 Shakti Peethas in India as per Srimad Devi Bhagwat. The upper part of Kali is worshipped in Dhari Devi. The remaining part in Kalimath religious tradition is that Kalimath is where Kali killed the demon Raktavija and went under the earth. Kalimath is the only place where the goddess Kali is worshiped along with her sisters Laxmi and Saraswati.
No idol is worshiped in the temple. Instead the Sri Yantra is the object of devotion. On one day each year the goddess is taken out and Puja is performed at midnight, with only the chief priest present. Near the temple are other ancient temples to Laxmi, Saraswati, Gauri Shankar and many antique Shivlings, idols of Nandi and Ganesh, etc.
An eternal holy flame always burns in the temple of Laxmi. Bhairava Mandir is located nearby.