Underneath Waterloo Bridge on Southbank, directly in front of the NFT, there is a daily sale of second-hand books, at great prices.
The selection is infinitely varied, and it's very easy to find some little gems in amongst the randomness. Be prepared to search though, there's no genre (etc) organisation!
Tube: Waterloo