Can I just drink the water from the hotel tap?

Tap water in regular hotels can be drunk directly or not.

Drink tap water. The hotel has a hint. But I don't know which hotel you mean, or what kind of hotel. Many hotels are irresponsible to customers and drink unqualified tap water directly without treatment. Whether they can drink directly depends on the hotel.