Undead Burg, not too far from the Bonfire. It is located near the entrance from the aqueduct, but below. There is a ladder nearby that leads to a Humanity pick-up.
Undead Burg, Looking over the rooftops towards the Hellkite Dragon bridge. This screenshot was taken close to where Rubbish is located.
credit: From Software