They were Hitler's scapegoat, like the Communists. He blamed them for all of Germany's problems and he had past issues with them as well, they turned him down when he went looking for jobs as a younger man.