Using ctrl+LMB to collapse all panels except of the clicked one resulted in an empty area if done from a view that is scrolled down to some degree. Resetting the view makes this much better, although it still doesn't work that well if the area is really small, but I don't think it's worth over-complicating things here. "Feature-Request" by @maxon ;)