[alibaba/nacos]客户端UDP Recv-Q 接收队列一直堆积,导致客户端内存一直在上升

2025-11-10 941 views
4

Nacos Server 2.1.2(k8s环境) Nacos Client 1.4.2(k8s环境) 目前只有一个服务反馈这个问题,并且是必现

回答

9

6

查看具体的数据包内容,为 tcpdump -i eth0 udp port 58591 -w ./udp.cap 18:21 �wH������{"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-private-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.120.209#10446#DEFAULT#DEFAULT_GROUP@@inner-private-test\",\"ip\":\"10.254.120.209\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@inner-private-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1676628731473,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":20919898387946935}S�cJ;���zkZ�a

8
是否有极大规模的变更,导致udp推送任务一直增加? 是否udp不通?导致udp推送一直失败,任务堆积?

udp是1.x版本客户端推送服务数据的弱依赖体系,如果网络通畅的话应该很快会结束,不会积压在Recv-Q或send-Q里。

8
是否有极大规模的变更,导致udp推送任务一直增加? 是否udp不通?导致udp推送一直失败,任务堆积?

udp是1.x版本客户端推送服务数据的弱依赖体系,如果网络通畅的话应该很快会结束,不会积压在Recv-Q或send-Q里。

没有,该服务下只有一台IP实例,到那时客户端的,naming.log文件中一直在打印这个日志,客户端每隔几秒就接收到推送,并且每行日志都一样

9

2023-03-02 16:34:32.777 INFO [com.alibaba.nacos.naming.push.receiver:client.naming] received push data: {"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-public-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.113.232#10446#DEFAULT#DEFAULT_GROUP@@inner-public-test\",\"ip\":\"10.254.113.232\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@inner-public-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1677746072776,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":22037490884870609} from /10.254.121.218 2023-03-02 16:34:44.039 INFO [com.alibaba.nacos.naming.push.receiver:client.naming] received push data: {"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-public-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.113.232#10446#DEFAULT#DEFAULT_GROUP@@inner-public-test\",\"ip\":\"10.254.113.232\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@inner-public-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1677746084037,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":22037250952463393} from /10.254.108.56 2023-03-02 16:38:02.897 INFO [com.alibaba.nacos.naming.push.receiver:client.naming] received push data: {"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-public-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.113.232#10446#DEFAULT#DEFAULT_GROUP@@ex-pushv5-inner-public-test\",\"ip\":\"10.254.113.232\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@einner-public-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1677746282896,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":22037449810780615} from /10.254.108.56 2023-03-02 16:38:13.333 INFO [com.alibaba.nacos.naming.push.receiver:client.naming] received push data: {"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-public-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.113.232#10446#DEFAULT#DEFAULT_GROUP@@inner-public-test\",\"ip\":\"10.254.113.232\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@inner-public-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1677746293332,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":22037711440869003} from /10.254.121.218 2023-03-02 16:38:22.888 INFO [com.alibaba.nacos.naming.push.receiver:client.naming] received push data: {"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-public-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.113.232#10446#DEFAULT#DEFAULT_GROUP@@inner-public-test\",\"ip\":\"10.254.113.232\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@inner-public-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1677746302886,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":4405637625665756} from /10.254.114.88 2023-03-02 16:38:53.293 INFO [com.alibaba.nacos.naming.push.receiver:client.naming] received push data: {"type":"dom","data":"{\"name\":\"DEFAULT_GROUP@@inner-public-test\",\"clusters\":\"\",\"cacheMillis\":10000,\"hosts\":[{\"instanceId\":\"10.254.113.232#10446#DEFAULT#DEFAULT_GROUP@@inner-public-test\",\"ip\":\"10.254.113.232\",\"port\":10446,\"weight\":1.0,\"healthy\":true,\"enabled\":true,\"ephemeral\":true,\"clusterName\":\"DEFAULT\",\"serviceName\":\"DEFAULT_GROUP@@inner-public-test\",\"metadata\":{\"sync.manage.skip\":\"true\"},\"instanceHeartBeatInterval\":5000,\"instanceHeartBeatTimeOut\":15000,\"ipDeleteTimeout\":30000}],\"lastRefTime\":1677746333291,\"checksum\":\"\",\"allIPs\":false,\"reachProtectionThreshold\":false,\"valid\":true}","lastRefTime":22037500206015319} from /10.254.108.56

5

看下服务端的naming-server.log

8

naming-server.log.zip

1

No more response from author, and current information is not enough to find problem.

看下服务端的naming-server.log

不好意思,上周在忙其他事情,给遗忘了,Issues还能打开么