Hyperkitty: Error when rebuilding Index
Dear list members,
if there is any Hyperkitty expert here, I have issues in Hyperkitty (just updated Maxkings Docker images) when rebuilding the Index.
Unfortunately, there are more than 25,000 mails and I do not know which one is/might be broken. Does the error mean that the rebuilding process is incomplete or does it simply skip the erroneous message?
Thank you in advance
- M4tze
Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/haystack/management/commands/update_index.py", line 297, in handle self.update_backend(label, using) File "/usr/lib/python3.8/site-packages/haystack/management/commands/update_index.py", line 342, in update_backend max_pk = do_update( File "/usr/lib/python3.8/site-packages/haystack/management/commands/update_index.py", line 100, in do_update current_qs = list(current_qs) File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 269, in __len__ self._fetch_all() File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 1308, in _fetch_all self._result_cache = list(self._iterable_class(self)) File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 53, in __iter__ results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size) File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1156, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 66, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute return self.cursor.execute(query, args) File "/usr/lib/python3.8/site-packages/MySQLdb/cursors.py", line 209, in execute res = self._query(query) File "/usr/lib/python3.8/site-packages/MySQLdb/cursors.py", line 317, in _query self._post_get_result() File "/usr/lib/python3.8/site-packages/MySQLdb/cursors.py", line 352, in _post_get_result self._rows = self._fetch_row(0) File "/usr/lib/python3.8/site-packages/MySQLdb/cursors.py", line 325, in _fetch_row return self._result.fetch_row(size, self._fetch_type) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xed in position 3209: invalid continuation byte
On 11/26/21 4:35 AM, M4tze wrote:
Dear list members,
if there is any Hyperkitty expert here, I have issues in Hyperkitty (just updated Maxkings Docker images) when rebuilding the Index.
Unfortunately, there are more than 25,000 mails and I do not know which one is/might be broken. Does the error mean that the rebuilding process is incomplete or does it simply skip the erroneous message?
It means the process is incomplete.
Traceback (most recent call last): ... return self._result.fetch_row(size, self._fetch_type) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xed in position 3209: invalid continuation byte
I'm not sure what's going on here. I suspect the issue is withe the
content of some message in the hyperkitty_email table in the database.
You could try a database query like
SELECT * FROM hyperkitty_email WHERE LEN(content) >= 3209;
If you're lucky, that may just return a few messages and enable you to find the problem one.
Otherwise, you could try first running mailman-web clear_index and
then run mailman-web update_index with --start and --end options to
specify a date range and zero in on the offending message.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
participants (2)
-
M4tze -
Mark Sapiro