On 5/6/23 11:27, Dave Hall via Mailman-users wrote:
Hello.
When running hyperkitty_import to import Mailman 2.1 archives, I frequently get errors like
django.db.utils.OperationalError: (1366, "Incorrect string value: '\\xE1\\x90\\xA7\\x0A\\x0AO...' for column
mailman3web.hyperkitty_email.contentat row 1")Is there a known cause for this? Is it fixed in some release more recent than 0+20180916?
I'm not sure what's going on here. My first thought is the database is MySQL or MariaDB and this is a 4-byte UTF-8 encoding and the database column charset definition is utf8 and not utf8mb4, but '\\xE1\\x90\\xA7\\x0A\\x0A' is the 3-byte UTF-8 encoding for CANADIAN SYLLABICS FINAL MIDDLE DOT ('\\xE1\\x90\\xA7') followed by two newlines. so I'm not sure what the issue is.
When you encounter this error, there should also be a message like "Message <Message-ID> failed to import, skipping" or perhaps "Failed adding message <Message-ID>: <error message>".
Using that Message-ID value, you should be able to find the original message in the input mbox. I would like to see that mbox message. You can remove any personal info. I only really need the message body and any Content-*: headers.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan