General Error on Almost Every Page Load

[Nat Katin-Borland]

Here's the traceback:

<!--
          Traceback (most recent call last):
  File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/tweens.py", line 17, in excview_tween
    response = handler(request)
  File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 107, in tm_tween
    return response
  File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 75, in __exit__
    return self._retry_or_raise(t, v, tb)
  File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 60, in _retry_or_raise
    reraise(t, v, tb) # otherwise reraise the exception
  File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 100, in tm_tween
    response = handler(request)
  File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/router.py", line 153, in handle_request
    response = view_callable(context, request)
  File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/config/views.py", line 186, in _secured_view
    return view(context, request)
  File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/config/views.py", line 292, in rendered_view
    result = view(context, request)
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/community.py", line 136, in show_community_view
    recent_items_batch = get_recent_items_batch(context, request)
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/community.py", line 81, in get_recent_items_batch
    allowed={'query': effective_principals(request), 'operator': 'or'},
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/batch.py", line 144, in get_catalog_batch_grid
    batch = get_catalog_batch(context, request, **kw)
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/batch.py", line 51, in get_catalog_batch
    total, docids, resolver = searcher(**kw)
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/models/adapters.py", line 77, in __call__
    num, docids = self.catalog.search(**kw)
  File "/srv/osfkarl/production/42/eggs/perfmetrics-2.0-py2.6.egg/perfmetrics/__init__.py", line 222, in call_with_mod
    return f(*args, **kw)
  File "/srv/osfkarl/production/42/eggs/perfmetrics-2.0-py2.6.egg/perfmetrics/__init__.py", line 151, in call_with_metric
    return f(*args, **kw)
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/models/catalog.py", line 101, in search
    num, docids = self._search(*arg, **kw)
  File "/srv/osfkarl/production/42/eggs/perfmetrics-2.0-py2.6.egg/perfmetrics/__init__.py", line 151, in call_with_metric
    return f(*args, **kw)
  File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/models/catalog.py", line 122, in _search
    res = super(CachingCatalog, self).search(*arg, **kw)
  File "/srv/osfkarl/production/42/eggs/repoze.catalog-0.7.3-py2.6.egg/repoze/catalog/catalog.py", line 84, in search
    r = index.apply(index_query)
  File "/srv/osfkarl/production/42/eggs/zope.index-3.6.4-py2.6-linux-i686.egg/zope/index/keyword/index.py", line 190, in apply
    return self.search(query, operator=operator)
  File "/srv/osfkarl/production/42/eggs/zope.index-3.6.4-py2.6-linux-i686.egg/zope/index/keyword/index.py", line 165, in search
    rs = self.family.IF.multiunion(sets) MemoryError

[Paul Everitt (paul-agendaless)]

I just talked to Tres. He's going to make some adjustments on osfkarl10 (one of the app servers) and restart.

I think it is only happening on requests that go to osfkarl10.

--Paul

On Apr 28, 2014, at 9:42 AM, Nat Katin-Borland <email address hidden> wrote:

> Public bug reported:
>
> Here's the traceback:
>
> <!--
> Traceback (most recent call last):
> File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/tweens.py", line 17, in excview_tween
> response = handler(request)
> File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 107, in tm_tween
> return response
> File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 75, in __exit__
> return self._retry_or_raise(t, v, tb)
> File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 60, in _retry_or_raise
> reraise(t, v, tb) # otherwise reraise the exception
> File "/srv/osfkarl/production/42/eggs/pyramid_tm-0.5-py2.6.egg/pyramid_tm/__init__.py", line 100, in tm_tween
> response = handler(request)
> File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/router.py", line 153, in handle_request
> response = view_callable(context, request)
> File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/config/views.py", line 186, in _secured_view
> return view(context, request)
> File "/srv/osfkarl/production/42/eggs/pyramid-1.2.1-py2.6.egg/pyramid/config/views.py", line 292, in rendered_view
> result = view(context, request)
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/community.py", line 136, in show_community_view
> recent_items_batch = get_recent_items_batch(context, request)
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/community.py", line 81, in get_recent_items_batch
> allowed={'query': effective_principals(request), 'operator': 'or'},
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/batch.py", line 144, in get_catalog_batch_grid
> batch = get_catalog_batch(context, request, **kw)
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/views/batch.py", line 51, in get_catalog_batch
> total, docids, resolver = searcher(**kw)
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/models/adapters.py", line 77, in __call__
> num, docids = self.catalog.search(**kw)
> File "/srv/osfkarl/production/42/eggs/perfmetrics-2.0-py2.6.egg/perfmetrics/__init__.py", line 222, in call_with_mod
> return f(*args, **kw)
> File "/srv/osfkarl/production/42/eggs/perfmetrics-2.0-py2.6.egg/perfmetrics/__init__.py", line 151, in call_with_metric
> return f(*args, **kw)
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/models/catalog.py", line 101, in search
> num, docids = self._search(*arg, **kw)
> File "/srv/osfkarl/production/42/eggs/perfmetrics-2.0-py2.6.egg/perfmetrics/__init__.py", line 151, in call_with_metric
> return f(*args, **kw)
> File "/srv/osfkarl/production/42/eggs/karl-3.121-py2.6.egg/karl/models/catalog.py", line 122, in _search...

[Nat Katin-Borland (nborland)]

Got it, that must be why it was intermittent.

[Tres Seaver (tseaver)]

I've restarted all the appservers, after lowering the cache size / memmon threshhold for osfkarl10,

I will be monitoring this week as the cache populates.