1.get the list of package postgresql installed
dpkg -l | grep postgres
This will give you all the package
2. Now you will remove all package
sudo apt-get --purge remove postgresql
sudo apt-get --purge remove postgresql-9.1
You will remove all of them like shown above
3.your done enjoy
