Instead of showing the transform handles for all selections, move this functionality into a tool as done for the 3D view.