The Israeli army on Wednesday stood by its choice for the next military chief rabbi, after a public outcry over his response to a question on the rape of non-Jewish women in war.