Feature Request: {Produce,Fetch}RequestRateDistributionGoal

[mgrubent]

Background

Currently, cruise-control provides (among others) the following goals:

• LeaderBytesInDistributionGoal
• NetworkInboundUtilDistributionGoal
• LeaderReplicaDistributionGoal

The load on individual kafka brokers can be highly dependent on the rate of produce and fetch requests sent from clients.

Unfortunately, the client produce and fetch rate are only indirectly modeled in any cruise-control goal (the three goals above appear to be the functionally-closest).

Issue

cruise-control does not currently provide goals for balancing the produce and fetch requests.

Proposal

In order to allow for balancing produce and fetch requests among individual brokers in the kafka cluster, cruise-control should allow for the following goals:

• ProduceRequestRateDistributionGoal
• FetchRequestRateDistributionGoal