Hate speech (including genocidal speech such as declaring that there need to be fewer trans people) isn't free speech. This is something fascist bigots like Elon Musk overlook.

Transphobes like to project their own behavior onto their scapegoats. Claiming that a trand lobby exists is an example of projecting. As the podcast The Anti-Trans Hate Machine points out, wealthy and powerful organizations push the anti-trans agenda.