Thread Starvation Error

Sponge Sponge Support
1

Not sure what’s causing this:

19.03 10:01:37 [Server] Server thread/ERROR [Sponge]: Could not pass DisplaceEntityEvent$Move$TargetPlayer$Impl to org.spongepowered.mod.plugin.SpongeModPluginContainer@5f1ef15
19.03 10:01:37 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:01:56 [Server] Server thread/FATAL Error executing task
19.03 10:01:56 [Server] INFO java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:01:56 [Server] INFO at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:1.8.0_72]
19.03 10:01:56 [Server] INFO at java.util.concurrent.FutureTask.get(FutureTask.java:192) ~[?:1.8.0_72]
19.03 10:01:56 [Server] INFO at net.minecraft.util.Util.func_181617_a(SourceFile:45) [g.class:?]
19.03 10:01:56 [Server] INFO at net.minecraft.server.MinecraftServer.func_71190_q(MinecraftServer.java:660) [MinecraftServer.class:?]
19.03 10:01:56 [Server] INFO at net.minecraft.server.dedicated.DedicatedServer.func_71190_q(DedicatedServer.java:344) [ko.class:?]
19.03 10:01:56 [Server] INFO at net.minecraft.server.MinecraftServer.func_71217_p(MinecraftServer.java:605) [MinecraftServer.class:?]
19.03 10:01:56 [Server] INFO at net.minecraft.server.MinecraftServer.run(MinecraftServer.java:481) [MinecraftServer.class:?]
19.03 10:01:56 [Server] INFO at java.lang.Thread.run(Thread.java:745) [?:1.8.0_72]
19.03 10:01:56 [Server] INFO Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:02:16 [Server] INFO Exception in thread “MVStore background writer nio:/world/FSS/foxguard/regions/spawn.mv.db” [10:02:16] [MVStore background writer nio:/world/FSS/foxguard/regions/spawn.mv.db/INFO] [STDERR]: [java.lang.ThreadGroup:uncaughtException:1052]: java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:02:32 [Server] Netty Epoll Server IO #20/WARN [io.netty.channel.epoll.EpollEventLoop]: Unexpected exception in the selector loop.
19.03 10:02:32 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:03:07 [Server] INFO Exception in thread “MVStore background writer nio:/world/Katora/foxguard/foxguard.mv.db” [10:03:04] [MVStore background writer nio:/world/Katora/foxguard/foxguard.mv.db/INFO] [STDERR]: [java.lang.ThreadGroup:uncaughtException:1052]: java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:03:10 [Server] HikariPool-6 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 51s91ms93μs970ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-6).
19.03 10:03:41 [Server] HikariPool-7 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 51s91ms26μs577ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-7).
19.03 10:04:07 [Server] HikariPool-21 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 1m5s301ms558μs27ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-21).
19.03 10:04:10 [Server] HikariPool-15 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 1m28s512ms960μs398ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-15).
19.03 10:04:16 [Server] HikariPool-4 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 45s135ms790μs881ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-4).
19.03 10:04:43 [Server] HikariPool-17 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 45s135ms782μs479ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-17).
19.03 10:05:21 [Server] Netty Epoll Server IO #2/WARN [io.netty.channel.epoll.EpollEventLoop]: Unexpected exception in the selector loop.
19.03 10:05:21 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:05:24 [Server] HikariPool-9 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 1m35s96ms946μs510ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-9).
19.03 10:05:42 [Server] Netty Epoll Server IO #8/WARN [io.netty.channel.epoll.EpollEventLoop]: Unexpected exception in the selector loop.
19.03 10:05:42 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:06:08 [Server] pool-2-thread-386/ERROR [Sponge]: The Scheduler tried to run the task minecraftmarket-A-3 owned by org.spongepowered.mod.plugin.SpongeModPluginContainer@4ce54a13, but an error occured.
19.03 10:06:08 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:06:08 [Server] Netty Epoll Server IO #12/WARN [io.netty.channel.epoll.EpollEventLoop]: Unexpected exception in the selector loop.
19.03 10:06:08 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:07:04 [Server] Server thread/ERROR [Sponge]: Could not pass DisplaceEntityEvent$Move$TargetPlayer$Impl to org.spongepowered.mod.plugin.SpongeModPluginContainer@5f1ef15
19.03 10:07:04 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:07:09 [Server] HikariPool-23 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 4m34s886ms745μs772ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-23).
19.03 10:07:29 [Server] HikariPool-11 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 4m21s129ms158μs364ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-11).
19.03 10:07:46 [Multicraft] Auto-saving world…
19.03 10:08:59 [Server] HikariPool-16 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 5m16s731ms213μs941ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-16).
19.03 10:09:37 [Server] HikariPool-5 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 5m23s289ms474μs342ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-5).
19.03 10:10:11 [Server] HikariPool-19 housekeeper/WARN [com.zaxxer.hikari.pool.HikariPool]: 7m5s993ms414μs606ns - Thread starvation or clock leap detected (housekeeper delta=HikariPool-19).
19.03 10:12:01 [Server] Netty Epoll Server IO #15/WARN [io.netty.channel.epoll.EpollEventLoop]: Unexpected exception in the selector loop.
19.03 10:12:01 [Server] INFO java.lang.OutOfMemoryError: GC overhead limit exceeded
19.03 10:12:29 [Server] Netty Epoll Server IO #18/WARN [io.netty.channel.epoll.EpollEventLoop]: Unexpected exception in the selector loop.

Sponge: spongeforge-1.8.9-1763-4.1.0-BETA-1207
Forge: forge-1.8.9-11.15.1.1763

2

You need more memory allocated

3

It has about 6GB with around >10 players, I think this is a memory leak because it runs fine for the first few hours.

4

Need some more stats, start up script, system info from the JVM etc. For all I know, your system can have 6GB of memory but the JVM may be allocated a default of 512MB. Before claiming a memory leak, provide evidence of a memory leak.

5

I can’t get much info since its a Shared Host and i’m not sure how to reproduce this but it happend before.

6

the full fml-server-latest.log would be useful

7

Since the server restarded multiple times after this, would that log still be relevant to when the error happend? If not where can I get the previous FML logs since they aren’t stored inside the previous log file zips.

8

Only the last few fml logs are kept (you may see fml-server-2.log etc) it would be good to get the log for when it actually happens but if not then the latest may still be useful. Also there’s a crash-reports directory that might contain useful information

9

The times don’t match up but:

FML (had to split in parts):

http://pastebin.com/GxKhp732

10

Also not sure if related but I get this error frequently when some users are online

20.03 19:35:51 [Server] Netty Epoll Server IO #13/WARN [io.netty.channel.DefaultChannelPipeline]: An exception was thrown by a user handler’s exceptionCaught() method while handling the following exception:
20.03 19:35:51 [Server] INFO java.io.IOException: Error while writev(…): Connection reset by peer
20.03 19:35:51 [Server] INFO at io.netty.channel.epoll.Native.writevAddresses(Native Method) ~[Native.class:4.0.23.Final]
20.03 19:35:51 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.writeBytesMultiple(EpollSocketChannel.java:184) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 19:35:51 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.doWriteMultiple(EpollSocketChannel.java:364) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 19:35:51 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.doWrite(EpollSocketChannel.java:317) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 19:35:51 [Server] INFO at io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:707) [AbstractChannel$AbstractUnsafe.class:4.0.23.Final]
20.03 19:35:51 [Server] INFO at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:248) [AbstractEpollChannel$AbstractEpollUnsafe.class:4.0.23.Final]
20.03 19:35:51 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel$EpollSocketUnsafe.epollOutReady(EpollSocketChannel.java:623) [EpollSocketChannel$EpollSocketUnsafe.class:4.0.23.Final]

And when a user logs out:

20.03 20:05:33 [Server] Netty Epoll Server IO #3/WARN [io.netty.channel.DefaultChannelPipeline]: An exception was thrown by a user handler’s exceptionCaught() method while handling the following exception:
20.03 20:05:33 [Server] INFO java.io.IOException: Error while writev(…): Broken pipe
20.03 20:05:33 [Server] INFO at io.netty.channel.epoll.Native.writevAddresses(Native Method) ~[Native.class:4.0.23.Final]
20.03 20:05:33 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.writeBytesMultiple(EpollSocketChannel.java:184) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 20:05:33 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.doWriteMultiple(EpollSocketChannel.java:364) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 20:05:33 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.doWrite(EpollSocketChannel.java:317) ~[EpollSocketChannel.class:4.0.23.Final]

20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.Native.writevAddresses(Native Method) ~[Native.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.writeBytesMultiple(EpollSocketChannel.java:184) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.doWriteMultiple(EpollSocketChannel.java:364) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel.doWrite(EpollSocketChannel.java:317) ~[EpollSocketChannel.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.AbstractChannel$AbstractUnsafe.flush0(AbstractChannel.java:707) [AbstractChannel$AbstractUnsafe.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:248) [AbstractEpollChannel$AbstractEpollUnsafe.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.EpollSocketChannel$EpollSocketUnsafe.epollOutReady(EpollSocketChannel.java:623) [EpollSocketChannel$EpollSocketUnsafe.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:322) [EpollEventLoop.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:264) [EpollEventLoop.class:4.0.23.Final]
20.03 20:05:34 [Server] INFO at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) [SingleThreadEventExecutor$2.class:4.0.23.Final]
The server starts to experience extreme lag and eventually crash.

Startup arguements:
-XX:+UseG1GC -Dfml.queryResult=confirm -Djline.terminal=jline.UnsupportedTerminal -Xss2M -jar

11

Are you still having problems?

I notice that you have Pixelmon which is known to cause issues with SpongeForge.

12

I believe not, I updated Sponge many times after this including plugins and Pixelmon