Openfire crashing every couple days

similar to Openfire continually crashing after upgrade to 3.10 (org.jivesoftware.openfire.nio.NIOConnection)

we upgraded to 3.10.1 a couple months ago from 3.9.3 because of issues with the roster cache constantly needing to be flushed. We had crashing issues and reverted within 24 hours to 3.9.3.

upgraded over the weekend to 3.10.2 and now we’re getting complete crash after 36-48 hours. We have a pretty vanilla install, we do use Active directory to populate users and a couple groups.

error.log logs show:

2015.08.04 11:03:29 org.jivesoftware.openfire.nio.NIOConnection - Failed to deliver packet:

2015.08.04 11:03:29 org.jivesoftware.openfire.session.LocalSession - Internal server error

java.lang.IllegalStateException: Connection closed

at org.jivesoftware.openfire.nio.NIOConnection.deliver(NIOConnection.java:316)

at org.jivesoftware.openfire.session.LocalClientSession.deliver(LocalClientSession .java:857)

at org.jivesoftware.openfire.session.LocalSession.process(LocalSession.java:289)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routeToLocalDomain(RoutingTableI mpl.java:354)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routePacket(RoutingTableImpl.jav a:239)

at org.jivesoftware.openfire.roster.Roster.broadcastPresence(Roster.java:609)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.broadcastUpdate(Presenc eUpdateHandler.java:308)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:162)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:137)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:201)

at org.jivesoftware.openfire.PresenceRouter.handle(PresenceRouter.java:148)

at org.jivesoftware.openfire.PresenceRouter.route(PresenceRouter.java:84)

at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:84)

at org.jivesoftware.openfire.SessionManager$ClientSessionListener.onConnectionClos e(SessionManager.java:1242)

at org.jivesoftware.openfire.nio.NIOConnection.notifyCloseListeners(NIOConnection. java:292)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:275)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliverRawText(NIOConnection.java:3 96)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:246)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliver(NIOConnection.java:353)

at org.jivesoftware.openfire.session.LocalClientSession.deliver(LocalClientSession .java:857)

at org.jivesoftware.openfire.session.LocalSession.process(LocalSession.java:289)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routeToLocalDomain(RoutingTableI mpl.java:354)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routePacket(RoutingTableImpl.jav a:239)

at org.jivesoftware.openfire.roster.Roster.broadcastPresence(Roster.java:609)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.broadcastUpdate(Presenc eUpdateHandler.java:308)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:162)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:137)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:201)

at org.jivesoftware.openfire.PresenceRouter.handle(PresenceRouter.java:148)

at org.jivesoftware.openfire.PresenceRouter.route(PresenceRouter.java:84)

at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:84)

at org.jivesoftware.openfire.SessionManager$ClientSessionListener.onConnectionClos e(SessionManager.java:1242)

at org.jivesoftware.openfire.nio.NIOConnection.notifyCloseListeners(NIOConnection. java:292)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:275)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliverRawText(NIOConnection.java:3 96)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:246)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliver(NIOConnection.java:353)

at org.jivesoftware.openfire.session.LocalClientSession.deliver(LocalClientSession .java:857)

at org.jivesoftware.openfire.session.LocalSession.process(LocalSession.java:289)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routeToLocalDomain(RoutingTableI mpl.java:354)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routePacket(RoutingTableImpl.jav a:239)

at org.jivesoftware.openfire.roster.Roster.broadcastPresence(Roster.java:609)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.broadcastUpdate(Presenc eUpdateHandler.java:308)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:162)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:137)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:201)

at org.jivesoftware.openfire.PresenceRouter.handle(PresenceRouter.java:148)

at org.jivesoftware.openfire.PresenceRouter.route(PresenceRouter.java:84)

at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:84)

at org.jivesoftware.openfire.SessionManager$ClientSessionListener.onConnectionClos e(SessionManager.java:1242)

at org.jivesoftware.openfire.nio.NIOConnection.notifyCloseListeners(NIOConnection. java:292)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:275)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliverRawText(NIOConnection.java:3 96)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:246)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliver(NIOConnection.java:353)

at org.jivesoftware.openfire.session.LocalClientSession.deliver(LocalClientSession .java:857)

at org.jivesoftware.openfire.session.LocalSession.process(LocalSession.java:289)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routeToLocalDomain(RoutingTableI mpl.java:354)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routePacket(RoutingTableImpl.jav a:239)

at org.jivesoftware.openfire.roster.Roster.broadcastPresence(Roster.java:609)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.broadcastUpdate(Presenc eUpdateHandler.java:308)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:162)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:137)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:201)

at org.jivesoftware.openfire.PresenceRouter.handle(PresenceRouter.java:148)

at org.jivesoftware.openfire.PresenceRouter.route(PresenceRouter.java:84)

at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:84)

at org.jivesoftware.openfire.SessionManager$ClientSessionListener.onConnectionClos e(SessionManager.java:1242)

at org.jivesoftware.openfire.nio.NIOConnection.notifyCloseListeners(NIOConnection. java:292)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:275)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliverRawText(NIOConnection.java:3 96)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:246)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliver(NIOConnection.java:353)

at org.jivesoftware.openfire.session.LocalClientSession.deliver(LocalClientSession .java:857)

at org.jivesoftware.openfire.session.LocalSession.process(LocalSession.java:289)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routeToLocalDomain(RoutingTableI mpl.java:354)

at org.jivesoftware.openfire.spi.RoutingTableImpl.routePacket(RoutingTableImpl.jav a:239)

at org.jivesoftware.openfire.roster.Roster.broadcastPresence(Roster.java:609)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.broadcastUpdate(Presenc eUpdateHandler.java:308)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:162)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:137)

at org.jivesoftware.openfire.handler.PresenceUpdateHandler.process(PresenceUpdateH andler.java:201)

at org.jivesoftware.openfire.PresenceRouter.handle(PresenceRouter.java:148)

at org.jivesoftware.openfire.PresenceRouter.route(PresenceRouter.java:84)

at org.jivesoftware.openfire.spi.PacketRouterImpl.route(PacketRouterImpl.java:84)

at org.jivesoftware.openfire.SessionManager$ClientSessionListener.onConnectionClos e(SessionManager.java:1242)

at org.jivesoftware.openfire.nio.NIOConnection.notifyCloseListeners(NIOConnection. java:292)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:275)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliverRawText(NIOConnection.java:3 96)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:246)

at org.jivesoftware.openfire.nio.NIOConnection.close(NIOConnection.java:224)

at org.jivesoftware.openfire.nio.NIOConnection.deliver(NIOConnection.java:353)

do you have any plugins? specifically the asterisk-im one?

I do have plugins installed, but not the asterisk-im plugin. Here is what I have installed:

  • Broadcast
  • Client Control
  • Content Filter
  • Jitsi Video Bridge
  • Just Married
  • Load Statistic
  • Monitoring Service
  • MotD
  • Search
  • Subscription
  • User Creation

I don’t know if there are any reported issues with those plugins, but it might be worth disabling all of them (if you can) to see if that stops the problem.

Upgraded to 3.10.2 and also got the org.jivesoftware.openfire.nio.NIOConnection - Failed to deliver packet. In a number of cases this results in people being marked as offline or idle in the buddy list when they are in fact online and active. Some times it appears messages are being dropped.

I finally (after a number of other problems unrelated to this message) downgraded to 3.9.3. So far I’m not seeing the original error.

For java I’m using:

java version “1.7.0_79”

OpenJDK Runtime Environment (IcedTea 2.5.6) (7u79-2.5.6-0ubuntu1.14.04.1)

OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode)

(I was using the ubuntu build for oracle but the openfire dpkg installer wouldn’t recognize it for some odd reason so the upgrade from 3.9.x to 3.10.x would always fail)