社区首页 >问答首页 >从Wildfly 20升级到23.0.1后，在infinispan缓存中记录超时消息并重试storm

问从Wildfly 20升级到23.0.1后，在infinispan缓存中记录超时消息并重试storm
EN

Stack Overflow用户

提问于 2021-05-07 05:08:54

回答 1查看 125关注 0票数 0

我们刚刚从wildfly 20升级到23，现在看到了infinispan出错的问题，以及进入日志和重试循环的问题。问题在启动后每秒发生100次，只有在关闭群集的一个节点时才会停止。

我们得到了下面的错误，它无限期地退役，使用服务器之间大约30Mbs的带宽，而通常是~10-30Kbs。错误中令人困惑的部分是节点1，它从节点2收到一个错误，而节点2的错误是来自节点1的超时。我尝试从udp堆栈移动到tcp堆栈，但仍然看到相同的问题(这是一个2节点群集)。

我将远程超时从默认的10秒增加到30秒，几乎立即看到了相同的错误。

在wildfly 23中有没有需要一个新的设置，或者我这边的一些其他缺失，或者我遇到了一个新的bug？

下面是jgroups的配置：

                <stack name="udp" statistics-enabled="true">
                    <transport type="UDP" shared="false" socket-binding="jgroups-udp" statistics-enabled="true">
                        <property name="log_discard_msgs">
                            false
                        </property>
                        <property name="port_range">
                            50
                        </property>
                    </transport>
                    <protocol type="PING" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="MERGE3" module="org.jgroups" statistics-enabled="true"/>
                    <socket-protocol type="FD_SOCK" module="org.jgroups" socket-binding="jgroups-udp-fd" statistics-enabled="true"/>
                    <protocol type="FD_ALL" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="VERIFY_SUSPECT" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="pbcast.NAKACK2" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="UNICAST3" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="pbcast.STABLE" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="pbcast.GMS" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="UFC" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="MFC" module="org.jgroups" statistics-enabled="true"/>
                    <protocol type="FRAG3"/>
                </stack>

和infinispan.

<cache-container name="localsite-cachecontainer" default-cache="epi-localsite-default" statistics-enabled="true">
                <transport lock-timeout="60000" channel="localsite-appCache"/>
<replicated-cache name="bServiceCache" statistics-enabled="true">
                    <locking isolation="NONE"/>
                    <transaction mode="NONE"/>
                    <expiration lifespan="1800000"/>
                </replicated-cache>

22:47:52,823 WARN  [org.infinispan.CLUSTER] (thread-223,application-localsite,node1) ISPN000071: Caught exception when handling command SingleRpcCommand{cacheName='application-bServiceCache', 
command=PutKeyValueCommand{key=SimpleKey [XXXX,2021-05-06,1412.0,75.0,null], value=[YYYY[pp=4 Pay,PaymentDue=2021-05-28], ppAvaliablity[firstPaymentDue=2021-05-28], ppAvaliablity[firstPaymentDue=2021-05-28]], flags=[], commandInvocationId=CommandInvocation:node2:537,
 putIfAbsent=true, valueMatcher=MATCH_ALWAYS, metadata=EmbeddedExpirableMetadata{version=null, lifespan=1800000, maxIdle=-1}, successful=true, topologyId=18}}: org.infinispan.remoting.RemoteException: ISPN000217: Received exception from node2, see cause for remote stack trace
        at org.infinispan.remoting.transport.ResponseCollectors.wrapRemoteException(ResponseCollectors.java:25)
        at org.infinispan.remoting.transport.impl.MapResponseCollector.addException(MapResponseCollector.java:64)
        at org.infinispan.remoting.transport.impl.MapResponseCollector$IgnoreLeavers.addException(MapResponseCollector.java:102)
        at org.infinispan.remoting.transport.ValidResponseCollector.addResponse(ValidResponseCollector.java:29)
        at org.infinispan.remoting.transport.impl.MultiTargetRequest.onResponse(MultiTargetRequest.java:93)
        at org.infinispan.remoting.transport.impl.RequestRepository.addResponse(RequestRepository.java:52)
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport.processResponse(JGroupsTransport.java:1402)
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport.processMessage(JGroupsTransport.java:1305)
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport.access$300(JGroupsTransport.java:131)
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport$ChannelCallbacks.up(JGroupsTransport.java:1445)
        at org.jgroups.JChannel.up(JChannel.java:784)
        at org.jgroups.fork.ForkProtocolStack.up(ForkProtocolStack.java:135)
        at org.jgroups.stack.Protocol.up(Protocol.java:309)
        at org.jgroups.protocols.FORK.up(FORK.java:142)
        at org.jgroups.protocols.FRAG3.up(FRAG3.java:165)
        at org.jgroups.protocols.FlowControl.up(FlowControl.java:343)
        at org.jgroups.protocols.pbcast.GMS.up(GMS.java:876)
        at org.jgroups.protocols.pbcast.STABLE.up(STABLE.java:243)
        at org.jgroups.protocols.UNICAST3.deliverMessage(UNICAST3.java:1049)
        at org.jgroups.protocols.UNICAST3.addMessage(UNICAST3.java:772)
        at org.jgroups.protocols.UNICAST3.handleDataReceived(UNICAST3.java:753)
        at org.jgroups.protocols.UNICAST3.up(UNICAST3.java:405)
        at org.jgroups.protocols.pbcast.NAKACK2.up(NAKACK2.java:592)
        at org.jgroups.protocols.VERIFY_SUSPECT.up(VERIFY_SUSPECT.java:132)
        at org.jgroups.protocols.FD.up(FD.java:227)
        at org.jgroups.protocols.FD_SOCK.up(FD_SOCK.java:254)
        at org.jgroups.protocols.MERGE3.up(MERGE3.java:281)
        at org.jgroups.protocols.Discovery.up(Discovery.java:300)
        at org.jgroups.protocols.TP.passMessageUp(TP.java:1396)
        at org.jgroups.util.SubmitToThreadPool$SingleMessageHandler.run(SubmitToThreadPool.java:87)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at org.jboss.as.clustering.context.ContextReferenceExecutor.execute(ContextReferenceExecutor.java:49)
        at org.jboss.as.clustering.context.ContextualExecutor$1.run(ContextualExecutor.java:70)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.infinispan.util.concurrent.TimeoutException: ISPN000476: Timed out waiting for responses for request 4485 from node1
        at sun.reflect.GeneratedConstructorAccessor551.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at org.infinispan.marshall.exts.ThrowableExternalizer.readGenericThrowable(ThrowableExternalizer.java:282)
        at org.infinispan.marshall.exts.ThrowableExternalizer.readObject(ThrowableExternalizer.java:259)
        at org.infinispan.marshall.exts.ThrowableExternalizer.readObject(ThrowableExternalizer.java:42)
        at org.infinispan.marshall.core.GlobalMarshaller.readWithExternalizer(GlobalMarshaller.java:728)
        at org.infinispan.marshall.core.GlobalMarshaller.readNonNullableObject(GlobalMarshaller.java:709)
        at org.infinispan.marshall.core.GlobalMarshaller.readNullableObject(GlobalMarshaller.java:358)
        at org.infinispan.marshall.core.BytesObjectInput.readObject(BytesObjectInput.java:32)
        at org.infinispan.remoting.responses.ExceptionResponse$Externalizer.readObject(ExceptionResponse.java:49)
        at org.infinispan.remoting.responses.ExceptionResponse$Externalizer.readObject(ExceptionResponse.java:41)
        at org.infinispan.marshall.core.GlobalMarshaller.readWithExternalizer(GlobalMarshaller.java:728)
        at org.infinispan.marshall.core.GlobalMarshaller.readNonNullableObject(GlobalMarshaller.java:709)
        at org.infinispan.marshall.core.GlobalMarshaller.readNullableObject(GlobalMarshaller.java:358)
        at org.infinispan.marshall.core.GlobalMarshaller.objectFromObjectInput(GlobalMarshaller.java:192)
        at org.infinispan.marshall.core.GlobalMarshaller.objectFromByteBuffer(GlobalMarshaller.java:221)
        at org.infinispan.remoting.transport.jgroups.JGroupsTransport.processResponse(JGroupsTransport.java:1394)
        ... 28 more