Thanos and cross-az traffic

[mohanisch]

Hello,

Is there a best practice when it comes to horizontal scaling? My concern is that I sometimes have quite high cross-az costs in our productive system. Logically, we have several queriers and stores, which are distributed across the AZ.

The only solution I can see to get to grips with this is to deploy all components in just one AZ. That's ok, but in my opinion it breaks the high availability a bit. An alternative would of course be to deploy the setup three times in each AZ without any dependencies on each other. But does that make sense?

How do you solve the problem?