What right does a photographer have to shoot and photograph freely?

Photographers have the right to shoot, as long as they don't peek into other people's private lives, it is legal to take pictures in public.

As for you taking pictures of others, he said that you violated the right to portrait, which is also wrong.

Because it's not illegal before you use his portrait right to gain property benefits.