Is it wrong for anti-feminists to not care about women getting rights just not want them to infringe in men's?

Nope, as a male anti-feminist, you have every right to what you believe, as a female anti-feminist I'm against the unfair ways my gender is going about things, then turning around and having to hear them say things, such as, "It's because of feminism blah blah blah."