Similar to many apps:
- Use left click and drag to box select
- Hold modifiers like Ctrl and Shift to remove or expand selections
- Use MMB-drag to use the tool outside of the gizmo area
In the future it would be nice if the transform tools would have this increased flexibility built-in so you could configure it more easily, but this setup seems to at least make it do the most commonly useful thing by default.