In this case we can calculate an offset without worrying about perspective correction. Unfortunately if looking from a camera we still have depth issues here. There's no really general case that can fix this so I'm leaving this as is.