In ancient times when Tamil Royal Dynasties ruled Kerala, a school, Kalari, to train the soldiers in martial arts was functioning at Velloor. There Goddess Bhadrakali was worshipped as the Goddess of the Kalari. The consecration was a sword on a stool. Once when the soldiers had to leave the place during an attack by another troop they forgot to take the sword and stool that represented the Goddess, with them. For some time, the local people used to light a lamp there. Later the Brahmins established it in their traditional way and built a temple. The fierce form of the Goddess then became manifest as
more Saraswathy, Lakshmy and Durga and changed into Balabhadra. When in the fierce form the Goddess was consecrated facing the north, the milder Balabhadra faces the river on the western side. That is how the name Patinjattukavu came for the temple. A Brahmin worshipped the Goddess in great earnestness and attained powers. But when he acted against the norm he was reduced to a Rakshass. The temple deteriorated under the influence of this Rakshass. Lord Ayyappa was consecrated here to avoid the Rakshass during the astrological consultation. Ayyappa Seva Sangham then took over the temple.