Service is not being closed OverUsageException

[atarkowska]

Traceback (most recent call last):

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/django/core/handlers/base.py", line 114, in get_response
response = wrapped_callback(request, *callback_args, **callback_kwargs)

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omeroweb/decorators.py", line 454, in wrapped
ctx.on_logged_in(request, conn)

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omeroweb/webclient/decorators.py", line 64, in on_logged_in
conn.getEventContext().groupId)

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omero/gateway/__init__.py", line 2054, in getEventContext
self._ctx = self._proxies['admin'].getEventContext()

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omero/gateway/__init__.py", line 4364, in __getattr__
obj = self._obj or self._getObj()

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omero/gateway/__init__.py", line 4295, in _getObj
self._obj = self._create_func()

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omero/gateway/__init__.py", line 4274, in cf
return getattr(self._sf, self._func_str)()

File "/home/omero/OMERO.server-5.1.3-ice35-b52/lib/python/omero_API_ice.py", line 568, in getAdminService
return _M_omero.api.ServiceFactory._op_getAdminService.invoke(self, ((), _ctx))

OverUsageException: exception ::omero::OverUsageException
{
serverStackTrace = ome.conditions.OverUsageException: servantsPerSession reached for 075b5766-3e35-41dc-9bd0-dada0acd1c36: 10000
at omero.util.ServantHolder.put(ServantHolder.java:173)
at omero.cmd.SessionI.registerServant(SessionI.java:598)
at ome.services.blitz.impl.ServiceFactoryI.getByName(ServiceFactoryI.java:457)
at ome.services.blitz.impl.ServiceFactoryI.getAdminService(ServiceFactoryI.java:280)
at omero.api._ServiceFactoryTie.getAdminService(_ServiceFactoryTie.java:137)
at omero.api._ServiceFactoryDisp.___getAdminService(_ServiceFactoryDisp.java:508)
at omero.api._ServiceFactoryDisp.__dispatch(_ServiceFactoryDisp.java:1267)
at IceInternal.Incoming.invoke(Incoming.java:222)
at Ice.ConnectionI.invokeAll(ConnectionI.java:2482)
at Ice.ConnectionI.dispatch(ConnectionI.java:1258)
at Ice.ConnectionI.message(ConnectionI.java:1213)
at IceInternal.ThreadPool.run(ThreadPool.java:321)
at IceInternal.ThreadPool.access$300(ThreadPool.java:12)
at IceInternal.ThreadPool$EventHandlerThread.run(ThreadPool.java:693)
at java.lang.Thread.run(Thread.java:745)

serverExceptionClass = ome.conditions.OverUsageException
message = servantsPerSession reached for 075b5766-3e35-41dc-9bd0-dada0acd1c36: 10000
}

[atarkowska]

Hi Matt, thanks you for reporting the issue. Could you let us know more details what exactly you were doing on the server before this error occurred? Did you run any scripts, import large dataset, or something else?

[dlindner]

Additional information see:
​https://www.openmicroscopy.org/qa2/qa/feedback/11404/
​https://www.openmicroscopy.org/qa2/qa/feedback/11405/

[jamoore]

Sent email asking for specifics of what " I was uploading a batch of 280 jpeg files, the total size of the files was approx 7 Mb with most of the jpegs being between 12kb and 30kb in size" entailed.

[jamoore]

I've not heard anything back. I'm pushing this to 5.2.1

[jamoore]

See also: ​https://www.openmicroscopy.org/qa2/qa/feedback/16859

We'll need to take a look at either throttling insight, or possibly just more proactively closing services.

[jburel]

Milestone OMERO-5.2.1 deleted

[jburel]

Milestone OMERO-5.2.2 deleted

[dlindner]

I wonder why this ticket is about Insight, but all stacktraces are from web. However here's an Insight one: ​https://www.openmicroscopy.org/qa2/qa/feedback/17139/

[jamoore]

​https://www.openmicroscopy.org/qa2/qa/feedback/17274/ (5.1.2) -- others are 5.1.3 or 5.2.1