Numbers 31:2-6

“Take vengeance on the Midianites for the sons of Israel; afterward you will be gathered to your people.”

So Moses spoke to the people, saying, “Arm men from among you for the war, so that they may go against Midian to execute the Lord’s vengeance on Midian.

You shall send a thousand from each tribe of all the tribes of Israel to the war.”

So there were selected from the thousands of Israel, a thousand from each tribe, twelve thousand armed for war.

And Moses sent them, a thousand from each tribe, to the war, and Phinehas the son of Eleazar the priest, to the war with them, and the holy implements and the trumpets for the alarm in his hand.