The Shivalinga is milky white in colour and is believed to be the tallest. In the temple mandapam there are 72 pillars made of black stone. Inside the Garbha Gruha (Sanctum), and Gokarneswara and Vigneshwara shrines are situated at the left and Kshiralingam is at the center. Subramanya Swamy and Janardhana Swamy shrines are located at the right, with Nandi at the centre.
River Gosthani flows through Palakollu town and it meets with River Godavari place near Narsapur. From there, the river merges with the sea at Antarvedi. It is said that once this place was a thick forest with full of natural greenery.
The peculiarity of the temple is that the Shiva Linga (Moola Virat) can be seen from all the four sides through the windows of the Garbha Gruha. Other deities in the temple include the Sun God, Kashi Vishweshwara, Brahma, Swamy Goddess parvathi, Goddess Lakshmi, Kanaka Durga, Saraswathi, Mahishasura Mardhini, Nagareshwara Lingam, Dundi Vigneshwara, Veera Bhadra, Sapta Matruka, Kartikeya, Naga sarpa, Nataraja, Dattatreya, Kala Bhairava, Nageshwara, Shaneeshwara, Shankara, and Radha Krishna.
It is believed that the Shiva lingam in this temple was installed by Lord Vishnu. It is also believed that staying one day in Ksheerarama is equivalent to staying one year in Varanasi.