- Mailman-users - lists.mailman3.org

Errors while importing mm2 list archives
by Odhiambo Washington 23 Dec '22

23 Dec '22

MM3-3.3.7, Hyperkitty-1.3.6 While importing, I encountered several of this error: <CUT> MySQLdb.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\x8A, ...' for column 'content' at row 1") The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 232, in from_mbox add_to_list(self.list_address, message) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/lib/incoming.py", line 153, in add_to_list email.save() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 812, in save self.save_base( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 863, in save_base updated = self._save_table( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 1006, in _save_table results = self._do_insert( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 1047, in _do_insert return manager._insert( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/query.py", line 1791, in _insert return query.get_compiler(using=using).execute_sql(returning_fields) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1660, in execute_sql cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers return executor(sql, params, many, context) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/utils.py", line 91, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/mysql/base.py", line 75, in execute return self.cursor.execute(query, args) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/cursors.py", line 206, in execute res = self._query(query) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/cursors.py", line 319, in _query db.query(q) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/connections.py", line 254, in query _mysql.connection.query(self, query) django.db.utils.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\x8A, ...' for column 'content' at row 1") </CUT> That occurred several times, but the import process went all the way, to 99% then came to the point below. Message 253d9d44-cc3e-fed1-144b-34da88c52b39(a)emailplus.org failed to import, skipping Computing thread structure Synchronizing properties with Mailman 904 emails left to refresh, checked 0 764 emails left to refresh, checked 0 Warming up cache Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 440, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 402, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 448, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 411, in handle call_command("hyperkitty_warm_up_cache", list_address) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 198, in call_command return command.execute(*args, **defaults) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 448, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_warm_up_cache.py", line 53, in handle self.warm_up_mlist(mlist, options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_warm_up_cache.py", line 61, in warm_up_mlist for thread in mlist.recent_threads: File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 162, in recent_threads return self.cached_values["recent_threads"]() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/common.py", line 58, in __call__ return self.get_or_set(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 317, in get_or_set return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 317, in <listcomp> return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/query.py", line 650, in get raise self.model.DoesNotExist( hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. (venv) [mailman@gw ~/mm]$ Should I take it that the import was successful, or what should I do next? PS: This is the 1st run after installing MM3 on this server and the MM3 list hasn't gone live. So if anything, I am okay with doing what needs to be done and rerun the import. TIA -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

3 12

No Archives
by Odhiambo Washington 22 Dec '22

22 Dec '22

I am working on a migration from MM2 to MM3. My MM2 lists are domiciled at https://lists.kictanet.or.ke/ To work on the web UI for MM3, I created a subdomain - mm3-lists.kictanet.or.ke. I have mostly done everything, including importing the archives. However, when I access https://mm3-lists.kictanet.or.ke/archives/, it's all empty. However, when I visit https://mm3-lists.kictanet.or.ke/mailman3/lists/, I can see my list. In Postorius, the site name is lists.kictanet.or.ke (same with mail domain). I have SITE_ID = 3 in both settings*.py and have restarted both Apache and Gunicorn. Could this be due to the fact that I am accessing the site using a domain name different than what the actual site is? Or there is something minor I am missing? PS: I am wondering also why SITE_ID=3 when I only added one site, besides the default example.com. If need be, I am willing to blow away the whole virtualenv and start afresh. It's a good step towards mastering the installation of MM3 :-) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 2

message awaits moderator approval´
by Eggert Ehmke 21 Dec '22

21 Dec '22

When I send a mail to a list that exceeds the max size, I get the above answer. However, the moderator of that list does not get a message, and there is no entry in the list of hold back messages. This should be a configuration problem, on another list on the same server this works fine. I cannot find any differences in the settings.

2 4

Emergency moderation and clearing out a lot of held messages
by bob B 21 Dec '22

21 Dec '22

We had an issue where a program went rogue and sent out 30k email alerts to one of our lists, so now I have a few questions. When the issue happened I turned on emergency moderation and we have resolved the issue so.. 1. How do I easily delete 30k of held messages? It looks like the GUI only allows me to do 200 at a time? is there a way to flush all held messages easily? 2. When I enabled Emergency moderation, I expected it to stop notifying the admin on every held message, but it appears that is not the case? Also, does it reply to the sender of every held message when Emergency moderation is on? it seems like the steps are: turn on "Emergency moderation" turn OFF "Notify users of held messages" turn OFF "Admin immed notify"

6 28

SMTPNotSupportedError when requesting new password
by Eggert Ehmke 21 Dec '22

21 Dec '22

I get this error when a user tries to use the "forgot password" function in hyperkitty. Obviously the exception is thrown when the send_mail function is called in /opt/mailman/venv/lib/python3.9/site-packages/allauth/account/adapter.py In settings.py I have: EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'localhost' EMAIL_PORT = 25 EMAIL_HOST_USER = 'valid email' EMAIL_HOST_PASSWORD = 'valid password' What can I do to debug further?

2 2

MM3 List Templates
by Odhiambo Washington 21 Dec '22

21 Dec '22

I am reading https://wiki.list.org/DOC/Mailman%203%20installation%20experience regarding templates and I am confused about whether to treat the path /opt/mailman/mm/var/templates/*site*/en/ literally or even if that information is still relevant. I created the exact path and put those templates in there, but they do not show up on Postorius. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

1 1

Where do I find the bounced messages?
by Sörös Zoltán 20 Dec '22

20 Dec '22

Greetings, I am running several lists under mailman3. I am getting notifications about users being put on nomail because of their bounces - but I can find no way to actually see the bounced messages. Do mailman3 store the received bounces? Where? Is there any setting to forward these bounces to the list owner? Thanks in advance -- Sörös Zoltán E-mail: beer(a)filmjus.hu http://www.filmjus.hu/~beer/

2 1

Can "Pre Verified" set to yes by default?
by Alan So 20 Dec '22

20 Dec '22

We are a university with many departments & colleges owning their own mailing lists and they manage their members lists by themselves. The current (ours is 1.3.6) Postorius have a default of "Pre Verified" as "No" when doing mass subscription by the list admin. It sounds sensible if most people subscribe to the lists by themselves normally. But in our case, our departmental staff normally maintain their list of members and do not want their members need to do anything before they can be reachable from lists. However, some of our departmental staff sometimes forget to check the box "Pre Verified" when they refresh (actually delete all and subscribe all) list of members during term's start. This often lead to issue especially if the list they maintained have thousands of members. Our normal way to help them is to remove the list and create the list again so that the departmental staff do not need to discard the pending members one by one. This is already the best scenario if they know that it is the root cause. Since subscribing thousands of members normally will not have the normal UI page coming back (due to timeout), they often do not know that it is the cause of issue. If they repeat the steps to subscribe the members again, they will just not be able to get the job done but also make the system busier and they never know that it's already in the pending list. Is this possible to add default setting of Pre Verified during mass-subscription (for example settings.py) such that we can help them a bit? Thanks.

3 9

Broken web UI after upgrade
by Odhiambo Washington 17 Dec '22

17 Dec '22

After upgrading MM3 and running all the post-update tasks and even re-indexing all the posts, I have ended up with a somehow "broken" hyperkitty. The archives display on a browser six, to say the least. The site is public, so I can share the link: https://list.rc.org/archives/ What should I do in order to fix this? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

6 19

Slow and out-of-sequence delivery
by Gregg Roberts 17 Dec '22

17 Dec '22

Dear Mailman Supporters, I participate in a professional forum run on Mailman. It serves a small nonprofit mutual benefit organization with possibly fewer than 50 members. Messages that I post to the forum have been taking as long as 48 hours to come back to me. The issue is not new and AFAIK no one has been messing with the settings. But the issue seems to have been becoming more and more severe in recent weeks. Perhaps because of such delays, I also sometimes see responses to other posts before I see the original post. It takes extra time to understand the context when that happens. People's time gets wasted answering questions that have already been answered without their knowledge. It's just frustrating all around. The email address from which messages are sent is not in the list of email addresses maintained in the hosting account cPanel. There seems to be one by the name "relay" that is being used by Mailman. I actually don't know which version of Mailman is installed. I'm hoping it's the more recent of the two options so I optimistically joined this particular list. The hosting service tech support can't help because they can't see the forum email address or its logs. At least that's what they say. Tech-support also tells me that they routinely do load-balancing and the server should not be excessively busy. It should certainly not take 48 hours to send an email message to 50 recipients. It shouldn't even take more than an hour, because the system is set to send messages at least once per hour -- maybe even every 10 minutes -- and the whole queue should be able to be handled in one sending cycle ... right? A contract tech support guy has suggested that it might solve a problem if we started spending $100-$150 per month on a dedicated server. I think that is a wrongheaded suggestion. If the organization had thousands of members, it would make more sense. But throwing money at the problem if something is simply not set up right, or some critical file is corrupted, is not the right solution. Set the broken bone correctly first, THEN inject stimulants and send the player back out onto the field. :-) Thanks in advance for any help! Gregg Roberts http://legalsupport-sc.com Legal Support Services of Southern California 43430 E. Florida Ave #F-293 Hemet CA 92544 951-330-4450 The information contained in this e-mail message is privileged and confidential information, intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution of copy of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by telephone at 951-330-4450 or reply by e-mail and delete or discard this message.

2 2