Hi,
So, the minutely job updates the fulltext index, which uses a Python based indexing library called Whoosh. Whoosh is good for testing but doesn't work well for prod environments at scale.
There is a need to update the docs, but it would be great to move to a better indexing engine like Xapian or ElasticSearch (which we have been using on this list for a while).
As a short-term fix, you can move the minutely cron job to run every 15minutes or even 1 hour. The only delay you will see is that it will take new emails upto 1hour to be indexed via search, which I don't think is a big deal.
I tried to switch to Xapian, but hyperkitty's update of the index fails now: ERROR 2020-02-10 22:35:24,787 25592 hyperkitty.lib.utils Failed to update the fulltext index: update() got an unexpected keyword argument 'commit' Traceback (most recent call last): File "/usr/lib/python3/dist-packages/hyperkitty/lib/utils.py", line 179, in run_with_lock fn(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/search_indexes.py", line 115, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/lib/python3/dist-packages/haystack/management/commands/update_index.py", line 276, in update_backend last_max_pk=max_pk) File "/usr/lib/python3/dist-packages/haystack/management/commands/update_index.py", line 97, in do_update backend.update(index, current_qs, commit=commit) TypeError: update() got an unexpected keyword argument 'commit'
I didn't find any further relevant configuration options in https://github.com/notanumber/xapian-haystack/tree/master
Kind Regards Bjoern