I signed up for a tour group, so can I get on the bus directly and get off with them to stay?

This should be negotiated with the travel agency. If the travel agency allows it, it will generally be stated in the contract that you will not join the group, and you will take full responsibility for any problems during your stay.

It is suggested not to stay outside secretly without telling the travel agency. If something goes wrong, you will handle it even worse.