The victim was at a phone shop looking at the mobile phones when he put his bag on the floor.
He did not realised his bag was stolen until he was about to leave.
The MP called the police as his pistol of which he is a licenced holder was inside the bag.
Police were called and a search was conducted.
A member of the public then called the police after finding a pistol in a bag thrown near a rubbish bin at Limbangan walkway, Jalan Clinik.
Police conducted the search and found everything intact.
Police said the thief may be an amateur and after seeing the pistol panic and threw the bag away.