Islamic law does give different rulings here, and it should not be denied or softened. The strongest answer is that the distinction is not based on the lesser worth of women, but on how marriage, religious authority, and the faith of children are understood in the Quranic legal framework.
Why the criticism feels forceful
The critic's point is straightforward: if marrying outside Islam risks faith, family unity, or children's religious identity, why allow it for men at all? And if a Jewish or Christian woman can live in a Muslim household, why can a Muslim woman not marry a Jewish or Christian man? Seen through a modern lens of identical individual choice, the rule looks like a male privilege and a restriction placed only on women.
That is the strongest form of the objection. It is not silly, and Muslims should not answer it with slogans.
What the Quran actually permits and forbids
The Quran explicitly permits Muslim men to marry chaste women from the People of the Book:
"This day all good things have been made lawful for you... and chaste women from among the believers and chaste women from among those who were given the Scripture before you, when you have given them their bridal due, desiring chastity, not unlawful sexual intercourse or taking them as secret lovers."
Quran 5:5
The Quran also forbids Muslim women from marrying unbelieving men, and forbids marriage with idolaters:
"Do not marry polytheistic women until they believe... And do not marry polytheistic men to your women until they believe. A believing slave is better than a polytheist, even though he may please you."
Quran 2:221
Classical jurists agreed that a Muslim woman may not marry a non-Muslim man, whether he is an idolater or from the People of the Book. This was not a marginal opinion; it became the settled ruling of the schools.
The principle behind the asymmetry
The reason is not that a man's faith matters and a woman's faith does not. Rather, Islamic law treats the husband as carrying legal authority and public responsibility within the household. That authority is not absolute, and it does not allow oppression, but it is real. Marriage is not viewed as two isolated private individuals; it creates a family order, duties, inheritance, guardianship, children's identity, and religious formation.
A Muslim man who marries a Jewish or Christian woman is required to believe in the original revelation sent to her prophets. He believes in Moses and Jesus, peace be upon them, and he is not allowed to mock her scripture or prevent her basic religious practice. The marriage is still regulated by Islam, and the children are to be raised as Muslims.
A Jewish or Christian husband, however, is not required by his faith to recognize Prophet Muhammad (PBUH), the Quran, or Islam as true. In the classical legal setting, he would also normally have authority over the household. That creates a direct risk that the Muslim wife would be placed under a marital authority that does not acknowledge the religious obligations by which she lives.
So the law is asymmetric because the legal positions inside marriage are asymmetric. One may accept or reject that framework, but the ruling is not random.
What this proves - and what it does not
This ruling does establish that Islamic law is not built on the modern idea that every marital option must be identical for men and women. It also establishes that Islam gives religious preservation priority over unrestricted romantic choice.
But it does not establish that women are inferior, that their consent is irrelevant, or that Muslim men are encouraged to marry outside the faith. Many scholars disliked or discouraged such marriages when they feared harm to religion, children, or community stability. The permission in Quran 5:5 is a permission with conditions, not a recommendation to seek interfaith marriage.
The fair summary is this: Islam allows a limited exception for Muslim men with chaste women of the People of the Book, while it closes the door for Muslim women marrying non-Muslim men because of the husband's religious authority in the family structure. A critic may still dislike that structure, but the rule has a coherent principle within Islamic law.