Legends say that the Pandava brothers, with their mother Kunti Devi came to Muthukulam area when they were living in exile. Kunti Devi instructed Bhimasena to look for a place to build a temple for their daily prayers. Bhima went to the house of a pot maker and informed him of his mission. The pot maker spoke scornfully and asked him to take enough space to keep one pot. On hearing this Bhimasena pulled out the pot that was kept at the bottom of a stack of pots and decided to build the temple there. Kunti Devi is believed to have made an idol more using the mud in the field near the place and conscecated it there while meditating on Goddess Durga. This original idol is believed to have been strengthened and protected by covering it with panchaloha. As Kunti Devi used the thetti flowers and offered the banana that grew there in plenty, these are still used for the pujas here.