Hi, We recently upgraded some of our environments from Linkerd 2.14.1 to 2.14.2. After that we are experiencing issues where meshed pods cannot connect to unmeshed smtp/redis pods. The connection just hangs until the client side timeout. This is typically connections to smtp or redis statefulsets. …

The fix has been merged and was included in last week’s edge release for testing and validation. We plan to include the fix in the stable 2.14.3 this week.

Hi @Jan , This is a little surprising! Thanks for letting us know about this. In order for us to identify how the behavior regressed, perhaps you can help us fill in some details: The target workload is a statefulset. How do clients connect to these pods? Do clients resolve a DNS name in the form…

No rollouts of the statefulsets when things are not working. Restarting statefulset and/or client pods does not help In the Redis case the client use a config like this: name: mymaster sentinels: host: redis-revelation-node-0.redis-revelation-headless port: 26379 host: redis-revelation-node-1.…

Thanks for narrowing this down to headless, unmeshed services. We can start to work on a repro. Do you happen to have the proxy logs showing which IPs the client was trying to connect to when it timed out? And how that compared to the status of these headless services (and underlying pods) in the Ku…

I have some logs. But not sure how useful they are. 10.241.28.203 is the IP address of one of the redis pods. I did the rollback of the Linkerd control plane to 2.14.1 around 07:52. At that time the client pods connected immediately. When looking for the logs I also looked at one of the Linkerd des…

Do you have what you need to reproduce? Is there a GitHub issue registered for this that I can also follow?

Thank you @Jan - that was enough to help us find the offending change and reproduce it. We are working on the fix now and plan to get a 2.14.3 out asap. Issue is being tracked at: Destination Controller Having Errors When Destination Is Unmeshed Pod using Opaque Ports · Issue #11555 · linkerd/linker…

Any ETA on a fix? It is blocking us from upgrading Linkerd

2.14.3 is now released, thanks for helping us resolve this @Jan ! If you could confirm that 2.14.3 resolves your issue that would be really helpful.

Meshed pods fail to connect to unmeshed smtp/redis pods with Linkerd 2.14.2

Linkerd General Discussion

Jan November 9, 2023, 10:20am 11

I can confirm that this solved the issue we had with requests to unmeshed pods.

Thanks for the support

/Jan

2 Likes

Topic		Replies	Views
Linkerd proxy is causing Redis to fail on upgrade to latest Redis version Linkerd General Discussion proxy	13	507	December 4, 2024
Services cannot talk to mirrored services Linkerd General Discussion configuration	4	80	July 15, 2025
Linkerd Destination Scaling Issues Linkerd General Discussion	2	789	February 14, 2024
Meshing a pod with tailscale tsnet Linkerd General Discussion	1	575	May 21, 2023
Outbound calls failure Linkerd General Discussion proxy , configuration	2	31	February 28, 2026

Meshed pods fail to connect to unmeshed smtp/redis pods with Linkerd 2.14.2

Related topics