Server shutdown can hang

[jamoore]

Using "kill pid" rather than "bin/omero admin stop" lead to blitz hanging:

"SIGTERM handler" daemon prio=9 tid=0x275a9e50 nid=0x198dc00 in Object.wait() [0xb0d8b000..0xb0d8bd10]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0d90aa90> (a IceInternal.ObjectAdapterFactory)
        at java.lang.Object.wait(Object.java:474)
        at IceInternal.ObjectAdapterFactory.waitForShutdown(ObjectAdapterFactory.java:80)
        - locked <0x0d90aa90> (a IceInternal.ObjectAdapterFactory)
        at IceInternal.ObjectAdapterFactory.destroy(ObjectAdapterFactory.java:125)
        at IceInternal.Instance.destroy(Instance.java:864)
        at Ice.CommunicatorI.destroy(CommunicatorI.java:17)
        at ome.services.blitz.util.BlitzConfiguration.destroy(BlitzConfiguration.java:361)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:585)
        at org.springframework.beans.factory.support.DisposableBeanAdapter.invokeCustomDestroyMethod(DisposableBeanAdapter.java:208)
        at org.springframework.beans.factory.support.DisposableBeanAdapter.destroy(DisposableBeanAdapter.java:165)
        at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroyBean(DefaultSingletonBeanRegistry.java:456)
        at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingleton(DefaultSingletonBeanRegistry.java:434)
        at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.destroySingletons(DefaultSingletonBeanRegistry.java:407)
        - locked <0x0d871060> (a java.util.LinkedHashMap)
        at org.springframework.context.support.AbstractApplicationContext.destroyBeans(AbstractApplicationContext.java:854)
        at org.springframework.context.support.AbstractApplicationContext.doClose(AbstractApplicationContext.java:832)
        at org.springframework.context.support.AbstractApplicationContext.close(AbstractApplicationContext.java:795)
        - locked <0x0d8682f8> (a java.lang.Object)
        at ome.system.OmeroContext.closeAll(OmeroContext.java:315)
        at ome.services.blitz.Entry.shutdown(Entry.java:250)
        at ome.services.blitz.Entry$1.handle(Entry.java:105)
        at sun.misc.Signal$1.run(Signal.java:195)
        at java.lang.Thread.run(Thread.java:613)

icegridnode would eventually send "kill -9".

[jmoore]

Also of interest:

"main" prio=5 tid=0x00501810 nid=0x1803800 in Object.wait() [0xb07ff000..0xb0800138]
        at java.lang.Object.wait(Native Method)
        - waiting on <0x0d8f8fb0> (a Ice.ConnectionI)
        at java.lang.Object.wait(Object.java:474)
        at Ice.ConnectionI.waitUntilFinished(ConnectionI.java:243)
        - locked <0x0d8f8fb0> (a Ice.ConnectionI)
        at IceInternal.IncomingConnectionFactory.waitUntilFinished(IncomingConnectionFactory.java:115)
        at Ice.ObjectAdapterI.waitForDeactivate(ObjectAdapterI.java:281)
        at IceInternal.ObjectAdapterFactory.waitForShutdown(ObjectAdapterFactory.java:99)
        at Ice.CommunicatorI.waitForShutdown(CommunicatorI.java:29)
        at ome.services.blitz.Entry.start(Entry.java:206)
        at ome.services.blitz.Entry.main(Entry.java:120)

[jmoore]

Don't have time to investigate further.