Hello Martin,
it's also my state of knowledge, that building=entrance is the only exception. Also this key/value should be used on nodes only.
There may be a "danger" for the future, if special tags grow for 3D-tagging as building=window or whatever. But I think, if there is a closed way with building=* you can be nearly shure thats an outline of a building.
Good luck
Michael
Edit: Maybe a deeper look here helps a bit: http://taginfo.openstreetmap.org/keys/?key=building#values. Its filtered on ways and it seems to be a "less than 4%-problem".
It looks like you're new here. If you want to get involved, click one of these buttons!