As promised in my previous post, I had done some REALLY hard work to come up with a map and hope it helps.
To go to Chemur is easy (actually my famous Tokong is located in Chemur also, but I kept mistaken it was Sg Siput). After exit from Ipoh Selatan toll of PLUS highway, take the road towards Tasek and Tanjung Rambutan (you will see Makro near the junction). If you follow the road all the way before reaching Sg Siput, there is a small town Chemur along the road.
Along the main road, there are 2 rows of old shop houses (right and left). The restaurant Hong Wan is at the back row of the shops, which is at your left hand side (if you are from the direction of Ipoh).