The game engine had depth testing enabled when blurring the shadows which caused the blurring to not work properly.