The White House is owned by the Federal Government. Theoretically that means it’s owned by the taxpayers, in practice you would be charged with trespassing on government property if you weren’t specifically allowed on the grounds (if not just straight up terrorism or whatever other charges they feel like throwing at you).