Legend says that Panduraja, considered as a direct descendent of Goutam Buddha, was a powerful ruler in a Hindu dominated kingdom of Pundooah. In 1340, Panduraja) was defeated by Shah Suffiuddin, the sultan of Delhi. It is said that Pandua minar was built by Shah Sufiuddin after the battle as a mark of victory. However, historically, there is no evidence of the existence of king Pandu, but there were many minor Hindu kings in the Saptagram-Pandua area.  The minar later on served as the Ajan Minar for the Bais Darwaza Masjid (Bari Masjid). But a handful of historians differ over this issue and they believe that the minar was actually the highest part of the Bishnu Mandir of Panduraja, which was demolished by the Muslim invaders leaving only the tower as a symbol of triump.