The Brokers are the compute layer. The Servers are the storage later.

Note that this is separate from the fact that the Servers can also be in a tiered storage configuration.

https://docs.pinot.apache.org/basics/architecture