Hello all,
I’d like to submit a feature request (let me know if there is a better place to submit this!) for best-effort request affinity. Please let me know if this is already a way to do this, and I have just overlooked it.
Our use case is that several of our gRPC services keep a per-user in-memory cache. We’d like to be able to create a load balancing rule, so that all requests with the same UserId are sent to the same pod, in order to maximize cache hit rate (on a best effort basis). I did some research and it appears that Istio supports this via a loadBalancer.consistentHash policy, which provides soft affinity based on configured headers.
Please let me know if I can provide any more detail about our use case for this request.