I used to cycle past it every day to go to school across the river. For all the suggestions about how bad it is the current flats on the site are, remarkably, much more ugly. Somewhere I have photographs of the site where I walked around it and the nearby disused industrial surroundings of Battersea power station, just after this was demolished.
The houses of parliament (aka big ben) are visible too, if that makes the place more appealing. You can hear the chimes if it's quiet (and the bell is not silenced as at the moment).
Some of the more recently built stuff around there also is not particularly nice looking either, including an (apparently mostly empty) tower block for the superrich that as won several awards for being ugly.