I stayed in a small place (the minority cafe with a great cook but it may have changed hands by now) on Guihua road opposite a traditional medicine shop. It's cheaper and quieter than West Street (only minutes away) with a really great cake shop on the corner.
If walking up West Street towards the river turn left, over a bridge and it should be somewhere around there.