This is due to the click_drag event assigned for primitives. Event types that are not "PRESS" are forwarded to drag_queue then waits until `WM_event_drag_test_with_delta/WM_event_drag_test` is true i.e. mouse threshold value. Pull Request: https://projects.blender.org/blender/blender/pulls/134480