A disclaimer is in order here: the record shops below have been known to exist, but they might not anymore. For the Netherlands I'm able to keep up with the changes, but this does not hold for other countries.
To enhance the service, inform me about the second hand music shops in your neighbourhood.
Here is somebody keeping a list of vendors on the net including pointers to their respective shops if any.