Legend has it that the castle is haunted. Some website visitors have claimed to discover ghostly figures during the windows or other places throughout the property, making this an Ipoh should do for any person keen on spooky lore. For everyone else, the castle remains an Ipoh pleasant area to go to.