remove unallocated space from a partition image

view story

http://unix.stackexchange.com – I have just created an image of an sd card using dd and the image is compressing down less than expected. I suspect this is because the card had not been zeroed out before I started to make the image. Is there a way to clear out "junk" stored on an image without having to start from scratch? (HowTos)