- Mailman-users - lists.mailman3.org

Memory issues on a small server with 2 GB RAM - Question: Has anyone a similar server up and running with mailman3 ?
by Wikinaut Oct. 20, 2023

Oct. 20, 2023

I see that about every 15 minutes (or later), tasks are killed by the systems OOM-Killer (out-of-memory). Is there something wrong with the current Tom Sawyer version, or is this specific server's memory size too low? Remark: I already reduced the mariadb innodb-buffer pool to ~100 MB (because mariadb got killed now and then before this change). Now it is our lovely mailman3 which got killed as the program with the largest memory footprint... Any idea?

1 1

Mailman Core 3.3.9 Release
by Abhilash Raj Oct. 20, 2023

Oct. 20, 2023

Hello Everyone, Mailman 3.3.9 is now published to PyPI! Thanks to everyone who helped make this release possible. Minimum supported Python version for this release is 3.9, we had to drop support for 3.7 & 3.8 due to incompatibilities with importlib-resources package. Maximum Python version supported right now is 3.11, we haven't yet added 3.12 to CI, so un-sure if there are any errors there. The full change log for the release can be found in the docs as usual: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS.… You can download the release via PyPI or via Gitlab Release: https://gitlab.com/mailman/mailman/-/releases/v3.3.9 For those of you who need to verify signatures for packages, PyPI doesn't allow publishing signatures anymore so I pushed them to Gitlab Releases along with a copy of the same tarball uploaded to PyPI. I'll be working on the release for the web components tomorrow. -- thanks, Abhilash Raj (maxking)

1 0

[Older bug, but still unsolved] When deleting one or more threads in an archive, django send error mails (based upon "Thread matching query does not exist")
by Wikinaut Oct. 20, 2023

Oct. 20, 2023

I installed the venv version to scrutizine whether this old bug is still present (yes it is). How to reproduce: Delete one thread in via the archive - thread - view page. Remark: Thread is deleted as wanted. However, django complains via several (here: two) error mails: 1st mail: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/list/test(a)example.com/top-threads Internal Server Error: /archives/list/test(a)example.com/top-threads DoesNotExist at /archives/list/test(a)example.com/top-threads Thread matching query does not exist. ... 2nd mail: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/list/test(a)example.com/posted-to Internal Server Error: /archives/list/test(a)example.com/posted-to DoesNotExist at /archives/list/test(a)example.com/posted-to Thread matching query does not exist. ... I wish to fix this problem, how can I help, what can I do? Do you need the full error stack?

1 0

Mailman3 Development Related List?
by Thomas Ward Oct. 20, 2023

Oct. 20, 2023

I have some technical questions around custom plugins for Mailman3, related to DB access, etc. within a specific custom plugin. Is there a dedicated list for that, or is this list proper for such questions? Namely, I'm searching for more information regarding existing interfaces, etc. that're exposed from different mailman.* python components and whether we can utilize those without having to implement extra psycopg2 instances/connectivity, etc. but don't want to bombard the users list with technical chatter unless it's intended to be used that way. Thomas

2 1

mailman3 and bookworm
by Servizio Informatico U.I.C.I. Sezione territoriale di Brescia Oct. 19, 2023

Oct. 19, 2023

Hello, Have you experience in installation of mailman3-full on bookworm? I tried to install it but it returns many errors of python. Thank you -- Roberto Burceni Servizio informatico sezionale Tel. 0302209417 (lunedì e giovedì mattina dalle 9:00 alle 13:00, martedì emercoledì pomeriggio dalle 14:00 alle 18:00 E-mail: servizioinformatico(a)uicibrescia.it Sito web: https://www.uicibresci

3 2

Moving mm3 -> mm3 to different host
by Axel Rau Oct. 19, 2023

Oct. 19, 2023

Hi all, There are lots of threads for mm2 -> mm3 moves, but only one thread mm3 -> mm3. Some time ago, I found a post from Mark, explaining the steps, but I can't find it again. I have created a working mm3 installation on the new host with both mailman and mail-web dbs imported. hyperkitty archive seems to in the db. What are the next steps to complete the transfer? - rsyncing messages, lists and templates to new host - Setting up DNS CNAMES to the new server - Adapting exim to accept mails to the aliased domain - Can I keep the old listname, with the old domain name? -What else has to be done ? Thanks, Axel -- --- PGP-Key: CDE74120 ☀ mobile: +49 160 7568212 computing @ chaos claudius

2 1

Unusual behavior: Standard discussion lists with prefix are sometimes having prefix *dropped*
by Thomas Ward Oct. 19, 2023

Oct. 19, 2023

I noticed some unusual behavior in Mailman3 stable release on PyPI and such. Namely, there are instances where replies are being processed and the prefix tags are simply being **lost** and dropped by Mailman3, instead of being properly prepended where they're supposed to go. Is this a known bug or does it need its own bug in the gitlab tracker? Thomas

2 2

Thread IDs on messages incrementing per reply?
by Thomas Ward Oct. 19, 2023

Oct. 19, 2023

Trying to use the thread prefix component to *tag* thread IDs in a system, but not increment per message. It looks like replies are being received and then thread prefixes are getting incremented. "[Test-%07d]" is the prefix I"m using on a given test list, but we want it to increment by thread ID and *not* per message. (6 messages for instance have been sent, two were replies to [Test-0000004] and though the system properly archived it in the same conversation, it still incremented the digit counter). Is there a way to achieve this in Mailman3 without me having to write some kind of custom code for this? Thomas

2 5

Rootkit issues
by Kyriakos Terzopoulos Oct. 18, 2023

Oct. 18, 2023

Hi, After installing mailman and using it for a few days, I got several complaints from my hosting company for abuse. After checking the server, it seems that there is a rootkit (Blitz) running with the mailman process. Has anyone come across this issue? Are there any specific steps to secure the mailman user? Thank you *Kyriakos Terzopoulos *Web developer / e-learning expert *Tel:*+30 211 213 9858 *Mobile:* +30 694 526 4512 * E-mail: *kyriakos.terzopoulos(a)gmail.com * Skype:* kyriakos.terzopoulos Find me on Facebook <http://www.facebook.com/cirrus3d> Follow me on Twitter <http://twitter.com/#%21/cirrus3d>

6 9

Simple ubi8/mailman3 container image
by Jered Floyd Oct. 17, 2023

Oct. 17, 2023

Abhilash maintains a very complete and well-documented container deployment for Mailman 3, but when I was setting up my environment a few months ago I wanted to build on top of RHEL 8 as well as use a database instance shared across multiple applications. So I ended up creating a bare-bones container image that suited my needs and was closer to just doing a simple local install, but keeping the isolation, reproducibility, and rollback benefits of running as a container. I've been meaning to polish it up and share in case it is useful to others, but finally recognizing that I likely won't get to that soon I've just put it on GitHub here: [ https://github.com/jeredfloyd/mailman-container | https://github.com/jeredfloyd/mailman-container ] Doing a "podman build" of this should result in a container image that is very much like the result of doing a venv install. This uses the Red Hat Universal Base Image (UBI), which can be freely redistributed, gets upstream security updates, and is eligible for support on a paid RHEL subscription. --Jered

1 0

ATT00001.txt file in Outlook users
by pau.baiges＠csuc.cat Oct. 17, 2023

Oct. 17, 2023

Hello, Users who have Outlook receive an attached txt file with the name ATT00001.txt when they receive an email from a mailman3 list. Is there a way to stop it from sending this file? Thank you so much

2 1

Post installation issues (recipients refused) with Exim4 in a virtual host environment
by Kyriakos Terzopoulos Oct. 17, 2023

Oct. 17, 2023

Hi, I have set up (I believe successfully) and configured the following in a Virtualhost environment (with HestiaCP): - A record for lists.mydomain.com - Venv - Mailman core - Mailman web (run migrate, collectstatic, compress, compilemessages) Postorius - gunicorn, hyperkitty - Nginx - SMTP exim4 conf I can see Posrorius and I have logged in and created my first mailing list: [image: Screenshot 2023-10-11 at 10.57.31 AM.png] My issue is that even though I have subscribed to my list as you can see above, I am not receiving the confirmation email. I get a "recipients refused" error. The smtp log for mailman is as follows: Oct 11 10:41:20 2023 (1533666) <169701007904.1534165.14569329382406660776@localhost> recipients refused: {' kyriakos.terzopoulos(a)gmail.com': (550, b'Verification failed for <testlist-bounces+kyriakos.terzopoulos=gmail.com(a)myproject.eu>\nUnrouteable address\nSender verify failed')} Oct 11 10:41:20 2023 (1533666) <169701007904.1534165.14569329382406660776@localhost> smtp to testlist(a)myproject.eu for 1 recips, completed in 0.26796579360961914 seconds Oct 11 10:41:20 2023 (1533666) <169701007904.1534165.14569329382406660776@localhost> post to testlist(a)myproject.eu from testlist-confirm+c9b20c5290bec43147a7e96a6b8cd825daf913d7(a)myproject.eu, 1667 bytes, 1 failures Oct 11 10:41:20 2023 (1533666) <169701007904.1534165.14569329382406660776@localhost> delivery to kyriakos.terzopoulos(a)gmail.com failed with code 550, b'Verification failed for <testlist-bounces+kyriakos.terzopoulos=gmail.com(a)myproject.eu>\nUnrouteable address\nSender verify failed' I have used the configuration for exim that is here <https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h…> and I have also tested with the alternative approach that is documented in there. ------ Debug info follows: First, here is my installation directory: [image: image.png] The following are the services that are running successfully (albeit with some warnings): ------ *Mailman:* ● mailman3.service - GNU Mailing List Manager Loaded: loaded (/etc/systemd/system/mailman3.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2023-10-05 12:32:08 EEST; 28min ago Process: 1563357 ExecStart=/opt/mailman/venv/bin/mailman start (code=exited, status=0/SUCCESS) Main PID: 1563364 (python3) Tasks: 18 (limit: 9255) Memory: 929.7M CPU: 22.818s CGroup: /system.slice/mailman3.service ├─1563364 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/master -C /etc/mailman3/mailman.cfg ├─1563370 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=archive:0:1 ├─1563371 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=bounces:0:1 ├─1563372 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=command:0:1 ├─1563373 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=in:0:1 ├─1563374 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=lmtp:0:1 ├─1563375 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=nntp:0:1 ├─1563376 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=out:0:1 ├─1563377 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=pipeline:0:1 ├─1563378 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=rest:0:1 ├─1563379 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=retry:0:1 ├─1563380 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=task:0:1 ├─1563381 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=virgin:0:1 ├─1563382 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=digest:0:1 ├─1563420 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=rest:0:1 └─1563421 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/runner -C /etc/mailman3/mailman.cfg --runner=rest:0:1 Oct 05 12:32:07 hestia. mydomain.eu systemd[1]: Starting GNU Mailing List Manager... Oct 05 12:32:08 hestia. mydomain.eu mailman[1563357]: Starting Mailman's master runner Oct 05 12:32:08 hestia. mydomain.eu mailman[1563357]: Generating MTA alias maps Oct 05 12:32:08 hestia. mydomain.eu systemd[1]: *mailman3.service: Can't open PID file /opt/mailman/venv/master.pid (yet?) after start: Ope*> Oct 05 12:32:08 hestia. mydomain.eu systemd[1]: Started GNU Mailing List Manager. *Note the above warning for the master.pid file. However the file exists and is writeable* ------ *Mailman web service* ● mailmanweb.service - GNU Mailman Web UI Loaded: loaded (/etc/systemd/system/mailmanweb.service; disabled; vendor preset: enabled) Active: active (running) since Thu 2023-10-05 12:51:46 EEST; 9min ago Main PID: 1578503 (gunicorn) Tasks: 2 (limit: 9255) Memory: 67.2M CPU: 753ms CGroup: /system.slice/mailmanweb.service ├─1578503 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/gunicorn -c /etc/mailman3/gunicorn.conf mailman_web.wsgi:application └─1578505 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/gunicorn -c /etc/mailman3/gunicorn.conf mailman_web.wsgi:application Oct 05 12:51:46 hestia.mydomain.eu systemd[1]: Started GNU Mailman Web UI. Oct 05 12:51:46 hestia. mydomain.eu gunicorn[1578503]: !!! Oct 05 12:51:46 hestia. mydomain.eu gunicorn[1578503]: !!! *WARNING: configuration file should have a valid Python extension*. Oct 05 12:51:46 hestia. mydomain.eu gunicorn[1578503]: !!! *Another warning above, however the service is starting normally.* ------ *Django Qcluster* ● qcluster.service - HyperKitty async tasks runner Loaded: loaded (/etc/systemd/system/qcluster.service; disabled; vendor preset: enabled) Active: active (running) since Thu 2023-10-05 12:51:40 EEST; 10min ago Main PID: 1578463 (mailman-web) Tasks: 8 (limit: 9255) Memory: 101.2M CPU: 30.915s CGroup: /system.slice/qcluster.service ├─1578463 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings ├─1578465 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings ├─1578466 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings ├─1578467 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings ├─1578468 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings ├─1578469 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings ├─1578470 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings └─1578471 /opt/mailman/venv/bin/python3 /opt/mailman/venv/bin/mailman-web qcluster --pythonpath /etc/mailman3 --settings settings Oct 05 12:51:40 hestia. mydomain.eu systemd[1]: Started HyperKitty async tasks runner. Oct 05 12:51:40 hestia. mydomain.eu mailman-web[1578463]: 09:51:40 [Q] INFO Q Cluster washington-solar-muppet-alanine starting. Oct 05 12:51:40 hestia. mydomain.eu mailman-web[1578466]: 09:51:40 [Q] INFO Process-1:1 ready for work at 1578466 Oct 05 12:51:40 hestia. mydomain.eu mailman-web[1578467]: 09:51:40 [Q] INFO Process-1:2 ready for work at 1578467 Oct 05 12:51:40 hestia. mydomain.eu mailman-web[1578468]: 09:51:40 [Q] INFO Process-1:3 ready for work at 1578468 Oct 05 12:51:40 hestia. mydomain.eu mailman-web[1578469]: 09:51:40 [Q] INFO Process-1:4 ready for work at 1578469 Oct 05 12:51:41 hestia. mydomain.eu mailman-web[1578470]: 09:51:41 [Q] INFO Process-1:5 monitoring at 1578470 Oct 05 12:51:41 hestia. mydomain.eu mailman-web[1578465]: 09:51:41 [Q] INFO Process-1 guarding cluster washington-solar-muppet-alanine Oct 05 12:51:41 hestia. mydomain.eu mailman-web[1578465]: 09:51:41 [Q] INFO Q Cluster washington-solar-muppet-alanine running. Oct 05 12:51:41 hestia.mydomain.eu mailman-web[1578471]: 09:51:41 [Q] INFO Process-1:6 pushing tasks at 1578471 ------ Nginx (hestia CP virtual hosts) server { listen 1.2.3.4:80; server_name lists.mydomain <http://lists.mydomain.com>.eu; location /static/ { alias /opt/mailman/venv/web/static/; } location / { proxy_pass http://127.0.0.1:8000; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } } ------ Happy to share my other mailman or EXIM4 configuration files if needed. Thanks in advance. Kyriakos ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Content-Type: image/png Name: image.png Content-Type: image/png Name: =?UTF-8?B?U2NyZWVuc2hvdCAyMDIzLTEwLTExIGF0IDEwLjU3LjMx4oCvQU0ucG5n?= Replaced multipart/alternative part with first alternative.

3 8

Setting up on ubuntu server 22.04
by Kyriakos Terzopoulos Oct. 15, 2023

Oct. 15, 2023

Hi guys, I have an Ubuntu 22.04 server running on a Hetzner machine, with HestiaCP (Exim4) on it. I cannot for the life of me start the service of mailman3 core. Following the installation tutorial I have tried with the venv approach and I am having the following issues: 1) It is not clear to me whether the mailman configuration should be outside venv (and outside the mailman shell). 2) For the above reason I have created a config file: /etc/mailman3/mailman.cfg and the mailman3 service outside venv. When starting the service I get the following: ImportError: cannot import name 'path' from 'importlib_resources' (/opt/mailman/venv/lib/python3.10/site-packages/importlib_resources/__init__.py) I've set up the database, the mailman user and the virtual environment. I know I am missing something here (e.g. Python version? other dependencies?). In general would it be better or/and easier to set this up on a new machine in my Hetzner cloud e.g. on Debian which seems to have packages of mailman available? Thanks in advance for all your help. Kyriakos

5 12

Memory usage cgroup and free -m
by golden_rock＠hotmail.com Oct. 12, 2023

Oct. 12, 2023

Hi, Currently the mailman3 cgroup slice uses up to 875MB: Control Group Tasks %CPU Memory Input/s Output/s system.slice/mailman3.service 16 0.1 875.3M - - Is 875MB a normal expected amount, or more than expected? To confirm that this is truly used and not "cached", I use the new Available column from the "free -m" output, which is the pre-computed available memory for a new process, added in recent years. The output of free -m under the Available column when mailman3 is running is : 161 MB When I stop the mailman service, the output of free -m Available column goes up to: 1071 MB Showing that the 875MB previously were not available for release for new processes. If I start mailman service again, the output of free -m Available column goes back to : 325MB and will be reducing gradually over time. I looked around on posts, documentation and others, but didn't find guides related to reducing RAM usage, is that a possibility or is this memory usage expected?

2 1

Archive search failing on one list
by Mark Oct. 12, 2023

Oct. 12, 2023

Hi, I have several lists all happily running with private archives. They all use the one domain name. A new list was added recently and although mail delivery and archiving are fine, this new list's search function is failing. For example, on searching for the word "Derbyshire" (which is mentioned in one of the archived messages) the results page displays: "Sorry no email could be found for this query." The logs show: +++++++++++++++++++++++++++++++++++++ /var/log/mailman3/web/mailman-web.log +++++++++++++++++++++++++++++++++++++ [pid: 1156|app: 0|req: 55/55] 2001:8004:5310:2405:ce66:5ff:41fc:60db () {76 vars in 1537 bytes} [Sat Sep 23 23:57:43 2023] GET /mailman3/hyperkitty/search?mlist=LISTNAME-1%40DOMAIN.COM&q=Derbyshire => generated 13752 bytes in 3188 msecs (HTTP/1.1 200) 5 headers in 164 bytes (1 switches on core 0) 23:57:51 [Q] INFO Process-1:1 processing [rebuild_mailinglist_cache_for_month] 23:57:51 [Q] INFO Process-1:2 processing [rebuild_mailinglist_cache_recent] 23:57:51 [Q] ERROR Failed [rebuild_mailinglist_cache_for_month] - MailingList matching query does not exist. : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 79, in _rebuild_mailinglist_cache_for_month mlist = MailingList.objects.get(name=mlist_name) File "/usr/lib/python3/dist-packages/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 406, in get raise self.model.DoesNotExist( hyperkitty.models.mailinglist.MailingList.DoesNotExist: MailingList matching query does not exist. +++++++++++++++++++++++++++++++++++++ On all the other lists, which all have successful search results, the logs shows examples like so (searching for "Farnborough") ... ************************************* [pid: 1156|app: 0|req: 486/486] 2001:8004:5310:2405:ce66:5ff:41fc:60db () {76 vars in 1531 bytes} [Sun Sep 24 00:38:24 2023] GET /mailman3/hyperkitty/search?mlist=LISTNAME-2%40DOMAIN.COM&q=Farnborough => generated 141638 bytes in 11039 msecs (HTTP/1.1 200) 6 headers in 333 bytes (1 switches on core 0) ************************************* ... which seems to be pretty much the same but with out the "MailingList.DoesNotExist" error. Any clues on where I should be looking to fix this would be gratefully received. Thanks, Mar

3 9

impossible to administrate *.com emails
by testeur Oct. 10, 2023

Oct. 10, 2023

Hi, I don't understand why this problem ! In the web interface, i can't administrate email finishing with ".com" (ex : gmail.com, hotmail.com, etc) I obtain : "Forbidden You don't have permission to access this resource." did i miss something in the web configuration ? Regards, PG testeur

2 2

Alias for a list name
by Lars Bjørndal Oct. 8, 2023

Oct. 8, 2023

I've migrated a list from mm 21 to mm 3 sucessfully. The mm 21 runs on domains managed by Postfix as virtual alias domains. That way it was possible to alias a shorter name for a list to the list name. To run mm 3 through Postfix, I use local_recipient_maps and transport_maps. What I want to achieve, is alias medlem(a)list.saf-org.no to saf-medlem(a)list.saf-org.no I tried to put medlem(a)list.saf-org.no: saf-medlem(a)list.saf-org.no and get the following error when running newaliases: postalias: warning: /etc/aliases, line 231: name must be local Is it possible to do this aliasing in a simple way? Thanks, Lars

2 6

OIDC (was: username)
by Jörg Schulz Oct. 7, 2023

Oct. 7, 2023

The most recent version of Django-allauth has some nice changes, it's now straightforward to include oidc. Just include SOCIALACCOUNT_EMAIL_AUTHENTICATION=True ## This allows existing users to login MAILMAN_WEB_SOCIAL_AUTH = [ "allauth.socialaccount.providers.openid_connect"] in settings.py and use the Django admin to configure the socialauth.... While it is _possible_ to add things like ---- SOCIALACCOUNT_PROVIDERS = { "openid_connect": { "APPS": [ { "provider_id": "mm3", "name": "TheNameThat shows up in the button", "client_id": "configuredID", "secret": "yourOIDCproviderGivesItToYou", "settings": { "server_url": "https://keycloak.wherever.com/realms/yourRealm/.well-known/openid-configura…", "token_auth_method": "client_secret_basic", }, } ] } } ---- I think it's preferable to do that within the Django Admin Gui. Does anybody dare to include this info in the documentation, or are we afraid the next django_allauth breaks things again (this time: Keycloak has been replaced by openid_connect)? -------- Weitergeleitete Nachricht -------- Betreff: Re: [MM3-users] Re: username Datum: Wed, 13 Sep 2023 07:34:35 +0000 Von: info(a)joergschulz.de An: Stephen J. Turnbull <turnbull.stephen.fw(a)u.tsukuba.ac.jp> Hi, probably you are looking for https://django-allauth.readthedocs.io/en/latest/index.html and https://github.com/lokeish/django-all-auth-and-keycloak-integration but https://github.com/pennersr/django-allauth/commit/ab704687f438c06fd23e72bce… will be helpful once implemented. Am 12. September 2023 um 05:54 schrieb "Stephen J. Turnbull" <turnbull.stephen.fw(a)u.tsukuba.ac.jp <mailto:turnbull.stephen.fw@u.tsukuba.ac.jp?to=%22Stephen%20J.%20Turnbull%22%20%3Cturnbull.stephen.fw%40u.tsukuba.ac.jp%3E>>: bryan.kartzman(a)yu.edu writes: > Just to let you know, there is a maintained SAML2 plugin available > on github (https://github.com/grafana/django-saml2-auth) that I was > able to install and get to work with AZURE SSO. There are multiple ways to solve this problem. My employer wanted a host-wide solution so they chose Shibboleth. Some day I'll go out and collect the ones I can find and document them (in summary form: source site, recency of stable version, recency of maintenance, etc). Steve

1 0

username
by bryan.kartzman＠yu.edu Oct. 6, 2023

Oct. 6, 2023

Where is the username that a user uses to login on the postorius web page stored? I checked the postgres table public.user and while the display name is there, the username is not. I can't find it anywhere in the database.

3 9

Mailman issues after re-boot
by Paul Rubin Oct. 6, 2023

Oct. 6, 2023

*<< I sent this to the mailman3 issues on gitlab and Mark replied but asked me to move to this list, so I copied everything and inserted responses. I hope this makes sense and someone can help me.>>* After a lengthy power failure I had to reboot a machine that has been running for several years. the WEB-UI does not seem to be able to see mailman-core. I have looked for log entries that might explain what the issue is and I am stumped to even find logs that will update when I get an error on the browser. Mailman is definitely running, postgres is running and mailman web is running. if I go to the lists page I see lists, if I try to access a specific list I get Server error: An error occurred while processing your request. I looked in /var/logs/mailman /opt/mailman/web/mailmanweb All I can find is: django.urls.exceptions.NoReverseMatch: Reverse for 'list_unsubscription_requests' not found. 'list_unsubscription_requests' is not a valid view function or pattern name.16688 ERROR 2023-09-12 13:56:58,430 1760 django.request Internal Server Error: /mailman3/lists/goodstein.goodstein.org/ File "/opt/mailman/venv/lib64/python3.8/site-packages/haystack/admin.py", line 8, in <module> from django.utils.translation import ungettextImportError: cannot import name 'ungettext' from 'django.utils.translation' (/opt/mailman/venv/lib64/python3.8/site-packages/django/utils/translation/__init__.py) Also I have to run mailman from "mailman start" because the systemctl returns this: ● mailman3.service - GNU Mailing List Manager Loaded: loaded (/etc/systemd/system/mailman3.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Tue 2023-09-12 10:06:31 EDT; 13s ago Process: 31159 ExecStart=/opt/mailman/venv/bin/mailman start (code=exited, status=1/FAILURE) CPU: 806msSep 12 10:06:31 mail mailman[31159]: Error in atexit._run_exitfuncs:Sep 12 10:06:31 mail mailman[31159]: Traceback (most recent call last):Sep 12 10:06:31 mail mailman[31159]: File "/usr/lib64/python3.8/logging/__init__.py", line 2126, in shutdownSep 12 10:06:31 mail mailman[31159]: h.flush()Sep 12 10:06:31 mail mailman[31159]: File "/opt/mailman/venv/lib64/python3.8/site-packages/mailman/core/logging.py", line 67, in flushSep 12 10:06:31 mail mailman[31159]: if self._stream:Sep 12 10:06:31 mail mailman[31159]: AttributeError: 'ReopenableFileHandler' object has no attribute '_stream'Sep 12 10:06:31 mail systemd[1]: mailman3.service: Control process exited, code=exited, status=1/FAILURESep 12 10:06:31 mail systemd[1]: mailman3.service: Failed with result 'exit-code'.Sep 12 10:06:31 mail systemd[1]: Failed to start GNU Mailing List Manager. Please tell me where to start looking or adjusting. Reply from Mark Sapiro,* Edited to include responses:* Mark Sapiro <https://gitlab.com/msapiro>@msapiro <https://gitlab.com/msapiro>· 1 day ago <https://gitlab.com/mailman/mailman-web/-/issues/23#note_1557601916> Owner Add reaction More actions The mailman-users(a)mailman3.org list is probably a more appropriate place for issues like this. django.urls.exceptions.NoReverseMatch: Reverse for 'list_unsubscription_requests' not found. 'list_unsubscription_requests' is not a valid view function or pattern name. 16688 ERROR 2023-09-12 13:56:58,430 1760 django.request Internal Server Error: /mailman3/lists/ goodstein.goodstein.org/ /opt/mailman/venv/lib64/python3.8/site-packages/postorius/urls.py should contain re_path( r'^unsubscription_requests$', list_views.list_unsubscription_requests, name='list_unsubscription_requests', ), Y *Yes this exists* and /opt/mailman/venv/lib64/python3.8/site-packages/postorius/views/list.py should define list_unsubscription_requests. *Yes there is a method by this name defined* File "/opt/mailman/venv/lib64/python3.8/site-packages/haystack/admin.py", line 8, in from django.utils.translation import ungettext ImportError: cannot import name 'ungettext' from 'django.utils.translation' (/opt/mailman/venv/lib64/python3.8/site-packages/django/utils/translation/ *init*.py) See https://docs.djangoproject.com/en/4.2/internals/deprecation/#deprecation-re… - ungettext() is removed from django>=4.0 Sep 12 10:06:31 mail mailman[31159]: AttributeError: 'ReopenableFileHandler' object has no attribute '_stream' I don't understand this one offhand, but what is the content of /etc/systemd/system/mailman3.service, in particular the settings for User, Group and ExecStart? *The service looks right:* 1 [Unit] 2 Description=GNU Mailing List Manager 3 After=syslog.target network.target postgresql.service 4 5 [Service] 6 Type=forking 7 PIDFile=/opt/mailman/mm/var/master.pid 8 User=mailman 9 Group=mailman 10 ExecStart=/opt/mailman/venv/bin/mailman start 11 ExecReload=/opt/mailman/venv/bin/mailman restart 12 ExecStop=/opt/mailman/venv/bin/mailman stop 13 14 [Install] 15 WantedBy=multi-user.target *It seems I may have two versions of the mailman script:* mail:/opt/mailman # which mailman /usr/bin/mailman mail:/opt/mailman # ls -al /usr/bin/mailman -rwxr-xr-x 1 root root 382 May 10 2021 /usr/bin/mailman mail:/opt/mailman # ls -al /opt/mailman/venv/bin/mailman -rwxr-xr-x 1 mailman mailman 231 Sep 12 10:02 /opt/mailman/venv/bin/mailman Somehow, your installation is corrupted. I don't know how *I need to know what to remove, how to correctly update, etc., That said the two scripts appear to be very similar:* mail:/opt/mailman # head /usr/bin/mailman #!/usr/bin/python3 # EASY-INSTALL-ENTRY-SCRIPT: 'mailman==3.3.4','console_scripts','mailman' __requires__ = 'mailman==3.3.4' import re import sys from pkg_resources import load_entry_point if __name__ == '__main__': sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$', '', sys.argv[0]) sys.exit( mail:/opt/mailman # head /opt/mailman/venv/bin/mailman #!/opt/mailman/venv/bin/python3 # -*- coding: utf-8 -*- import re import sys from mailman.bin.mailman import main if __name__ == '__main__': sys.argv[0] = re.sub(r'(-script\.pyw|\.exe)?$', '', sys.argv[0]) sys.exit(main()) mail:/opt/mailman # *Given the two years since the last reboot I also tried following * https://docs.mailman3.org/en/latest/upgrade-guide.html *to make sure I was running the latest* pip install -U mailman postorius django-mailman3 hyperkitty mailman-web

6 31

Missing Base64 encoding from control message reply
by lists-mailman3＠janaberger.de Oct. 6, 2023

Oct. 6, 2023

Dear all, I have a setup with GNU Mailman 3.3.8 where a user tried to subscribe. When replying to the "confirm" message, the user received a completely garbled response, like so: N�z˥��ʋ�zf��&��j��u�[zZ0:��v��,j�z֢��k�e�0 4Dҹ��r�^b��r�ߊ��*'��yם��{ax�L�X��0:��v��,j�z֢��k�d�m�-��zz�rn��l]y+��-E�( �^N��'��M��tۯ��Mz��^i��׮��}�o�\ӷ��6sN�zf��ݮ��r��z˥��b�{h��݉��f�r�ne== (The line above contains numerous unprintable characters, etc.) The user then forwarded the .eml file to me, which clearly shows the contents of the mail as plain text while being announced as base64 (Content-Transfer-Encoding: base64): START OF EML Return-Path: <LISTNAME-bounces(a)lists.DOMAIN.COM> Received: from DOMAIN.COM ([144.76.173.241]) by mx-ha.USERDOMAIN.NET (mx06 [IP]) with ESMTPS (Nemesis) id 1M27WV-1qhRFk39Sr-00AQcR for <USER(a)USERDOMAIN.NET>; Thu, 21 Sep 2023 19:10:37 +0200 Received: from localhost (localhost.localdomain [127.0.0.1]) by DOMAIN.COM (Postfix) with ESMTP id 4058B3BD5EEF for <USER(a)USERDOMAIN.NET>; Thu, 21 Sep 2023 19:10:37 +0200 (CEST) Received: from DOMAIN.COM ([127.0.0.1]) by localhost (DOMAIN.COM [127.0.0.1]) (amavis, port 10024) with ESMTP id x0ngnlRnGraH for <USER(a)USERDOMAIN.NET>; Thu, 21 Sep 2023 19:10:37 +0200 (CEST) Received: from [IP] (unknown [IP]) by DOMAIN.COM (Postfix) with ESMTP id DC8603BD5EEE for <USER(a)USERDOMAIN.NET>; Thu, 21 Sep 2023 19:10:36 +0200 (CEST) Subject: =?utf-8?q?The_results_of_your_email_commands?= From: LISTNAME-bounces(a)lists.DOMAIN.COM To: USER(a)USERDOMAIN.NET Content-Transfer-Encoding: base64 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Message-ID: <169531623416.29.5762261018677554285@mailman-core> Date: Thu, 21 Sep 2023 17:10:34 +0000 Precedence: bulk X-Mailman-Version: 3.3.8 List-Id: <LISTNAME.lists.DOMAIN.COM> List-Help: <mailto:LISTNAME-request@lists.DOMAIN.COM?subject=help> List-Owner: <mailto:LISTNAME-owner@lists.DOMAIN.COM> List-Subscribe: <mailto:LISTNAME-join@lists.DOMAIN.COM> List-Unsubscribe: <mailto:LISTNAME-leave@lists.DOMAIN.COM> Envelope-To: <USER(a)USERDOMAIN.NET> X-Spam-Flag: NO The results of your email command are provided below. - Original message details: From: USER <USER(a)USERDOMAIN.NET> Subject: Re: Your confirmation is needed to join the LISTNAME(a)lists.DOMAIN.COM mailing list. Date: Thu, 21 Sep 2023 19:10:26 +0200 Message-ID: <3c1eaaf8-1677-432f-b9dc-07f18902c06c(a)email.android.com> - Results: Confirmation token did not match - Done. END OF EML Is this possibly a bug in Mailman? Any ideas on what else could be causing this?

4 12

Hyperkitty href url to css cache files is not correct
by Alexander Maier Oct. 5, 2023

Oct. 5, 2023

Hello guys i just created my first mailing list on uberspace. Everything works fine at the moment but I have a problem with the stylesheets of hyperkitty. I recognized that hyperkitty creates for each new access to its website a css CACHE file which is stored at '/static/CACHE/css/'. The url in the HTML file sets the href to /static/CACHE/css/ but the files are only accessible with '/hyperkitty/static/CACHE/css/'. I tried out some probably solutions but nothing works... Could you guys help me?

2 3

Template variables in list:user:notice:post
by Jörg Michael Schulz Oct. 5, 2023

Oct. 5, 2023

when I add $hyperkitty_url in the postorius template list:user:notice:post, this variable is not expanded, but rests in clear text, like: Das Archiv befindet sich hier: $hyperkitty_url Moreover, when I use $listname. (the dot after the variable name!), no confirmation arrives. Leaving a space between the variable name and the ‚.' helps.

3 2

400 error on held messages
by Dan Caballero Oct. 5, 2023

Oct. 5, 2023

I've got a couple of lists throwing this error when attempting to view "Held Messages" HTTP Error 400: invalid literal for int() with base 10: 'oAAAANSUhEUgAACfYAAAiVBORw0KGgoAAAANSUhEUgAACfYAAAYKCAIAAAAQvT9CAAAACXBIWXMAAC4jAAAuIwF4pT92AAAg\r\n' Any ideas on what could be causing this? Database corruption of some kind? Dan Caballero Caltech

2 4

Mailman 3 Privacy Policies, GDPR, etc and social logins
by Jered Floyd Oct. 5, 2023

Oct. 5, 2023

Greetings, I host a variety of lists for social, community, and software projects, and updated my infrastructure from Mailman 2 to Mailman 3 last year. As part of this, I enabled Django allauth modules to simplify login and management for subscribers. Recently, Facebook notified me that they would be disabling the "application" because it failed to provide a sufficient Privacy Policy. Previously I had linked the app to [ https://www.gnu.org/software/mailman/privacy.html, | https://www.gnu.org/software/mailman/privacy.html, ] but they have said: Platform Terms 4.b: Your privacy policy must comply with applicable law and regulations and must accurately and clearly explain what data you are Processing, how you are Processing it, the purposes for which you are Processing it, and how Users may request deletion of that data. During testing, we found that your privacy policy doesn’t explain how users can request data deletion. Update your privacy policy to include this information before you submit an appeal. This is a bit of a headache. Do we have a draft of a community Privacy Policy for a vanilla Mailman 3 install that meets Facebook's requirements? Is this going to be a constantly unraveling thread of future GDPR and Right to Be Forgotten troubles, since there doesn't seem to be an easy way to scrub a subscriber from Hyperkitty archives if they request so? How have others addressed this situation? Regards, --Jered

2 2

All list messages shunted due to mailman core database lock
by Ryan Curtin Oct. 4, 2023

Oct. 4, 2023

Hi there, I have been trying to debug a git commit development list for a project I maintain: http://lists.mlpack.org/mailman3/hyperkitty/list/mlpack-git@lists.mlpack.or… The list is run on mailman3 as provided by Debian. Messages are successfully received---you can see all the test messages in the archives I just linked to if you want to click on it. However, no messages are actually relayed to subscribers. I spent a while digging into logs and found that every message sent to the list results in an error like this in /var/log/mailman3/mailman.log: ``` Oct 02 17:01:26 2023 (2957556) Uncaught runner exception: (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if this flush is occurring prematurely) (sqlite3.OperationalError) database is locked [SQL: UPDATE mailinglist SET last_post_at=?, post_id=? WHERE mailinglist.id = ?] [parameters: ('2023-10-02 21:01:21.702224', 99565, 2)] (Background on this error at: http://sqlalche.me/e/13/e3q8) Oct 02 17:01:26 2023 (2957556) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 609, in do_execute cursor.execute(statement, parameters) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/runners/pipeline.py", line 37, in _dispose process(mlist, msg, msgdata, pipeline) File "/usr/lib/python3/dist-packages/mailman/core/pipelines.py", line 50, in process handler.process(mlist, msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/handlers/acknowledge.py", line 46, in process member = mlist.members.get_member(sender) File "/usr/lib/python3/dist-packages/mailman/model/roster.py", line 120, in get_member memberships = self._get_all_memberships(email) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/roster.py", line 116, in _get_all_memberships return members_a.union(members_u).all() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/query.py", line 3373, in all return list(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/query.py", line 3534, in __iter__ self.session._autoflush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 1633, in _autoflush util.raise_(e, with_traceback=sys.exc_info()[2]) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 1622, in _autoflush self.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2540, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2682, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__ compat.raise_( File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2642, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 586, in execute persistence.save_obj( File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 230, in save_obj _emit_update_statements( File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 994, in _emit_update_statements c = cached_connections[connection].execute( File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1011, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1124, in _execute_clauseelement ret = self._execute_context( File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1316, in _execute_context self._handle_dbapi_exception( File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1510, in _handle_dbapi_exception util.raise_( File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1276, in _execute_context self.dialect.do_execute( File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 609, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if this flush is occurring prematurely) (sqlite3.OperationalError) database is locked [SQL: UPDATE mailinglist SET last_post_at=?, post_id=? WHERE mailinglist.id = ?] [parameters: ('2023-10-02 21:01:21.702224', 99565, 2)] (Background on this error at: http://sqlalche.me/e/13/e3q8) Oct 02 17:01:26 2023 (2957556) SHUNTING: 1696280486.719109+114cb2cc738a61874a5eed7e3f66a3ac111f5b90 ``` I have tried a handful of things: * Restart mailman3 and mailman3-web systemd services. * Ensure that there are no stale locks in /var/lib/mailman3/locks/ when mailman3 core is stopped. * Move the database in /var/lib/mailman3/data/mailman.db out of the way and replace it with a copy, in case some process is holding it open. * Unshunt all the messages with `sudo /usr/bin/mailman3 unshunt` (didn't realize this would drop all the shunted messages, but not a big deal). Most threads I have read appear to be related to the Django interface encountering a locked database, but this looks different---it seems mailman core is having the problem, not anything having to do with mailman3-web or Django. Does anyone have any thoughts on things I can do to fix this error? I am not a mailman3 expert (and to be perfectly honest I don't want to be one, I just want to post things to the list :)). One extra caveat: rebooting the machine I am using is not a realistic option. Thanks in advance for any help. Ryan -- Ryan Curtin | "Not like this... not like this." ryan(a)ratml.org | - Switch

2 2

parallel processing of out queue messages
by Dan Caballero Oct. 4, 2023

Oct. 4, 2023

Hello, I have tried increasing the number of runners to alleviate a backlog of messages in the "out" queue. I increased the out runners to from 32 to 64. However, I'm not seeing a significant increase in the processing of "out" messages. I've seen at most 12 ".bak" files in the out queue after increasing the runner instances. Is there another configuration needed beyond the number of runner instances to get more messages processed at once? Thanks as always for your help! -- Dan

3 5

Postorius is not working (throws "Error 500" suddenly after changing POSTORIUS_TEMPLATE_BASE_URL and changing back)
by Wikinaut Oct. 2, 2023

Oct. 2, 2023

After having changed and re-changed "only" the line in /etc/mailman3/mailman-web.py (which looks to be only a "blinder" and the real problem could be a different one) POSTORIUS_TEMPLATE_BASE_URL = 'http://localhost/mailman3/' the web access via Postorius is not working any more and throws "Error 500" My logfile /var/log/mailman3/web/mailman-web.log shows now File "/usr/share/mailman3-web/manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/local/lib/python3.9/dist-packages/django/core/management/__init__.py", line 446, in execute_from_command_line utility.execute() File "/usr/local/lib/python3.9/dist-packages/django/core/management/__init__.py", line 420, in execute django.setup() File "/usr/local/lib/python3.9/dist-packages/django/__init__.py", line 24, in setup apps.populate(settings.INSTALLED_APPS) File "/usr/local/lib/python3.9/dist-packages/django/apps/registry.py", line 116, in populate app_config.import_models() File "/usr/local/lib/python3.9/dist-packages/django/apps/config.py", line 269, in import_models self.models_module = import_module(models_module_name) File "/usr/lib/python3.9/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1030, in _gcd_import File "<frozen importlib._bootstrap>", line 1007, in _find_and_load File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 680, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 790, in exec_module File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed File "/usr/lib/python3/dist-packages/django_q/models.py", line 12, in <module> from django_q.signing import SignedPackage File "/usr/lib/python3/dist-packages/django_q/signing.py", line 7, in <module> from django_q import core_signing as signing File "/usr/lib/python3/dist-packages/django_q/core_signing.py", line 9, in <module> from django.utils.encoding import force_bytes, force_str, force_text ImportError: cannot import name 'force_text' from 'django.utils.encoding' (/usr/local/lib/python3.9/dist-packages/django/utils/encoding.py) I already run pip install -U postorius to update that (looks okay to me): Requirement already satisfied: postorius in /usr/local/lib/python3.9/dist-packages (1.3.8) Collecting postorius Using cached postorius-1.3.8-py3-none-any.whl Downloading postorius-1.3.7.tar.gz (3.2 MB) Requirement already satisfied: django-mailman3>=1.3.8 in /usr/local/lib/python3.9/dist-packages (from postorius) (1.3.9) Requirement already satisfied: readme-renderer[md] in /usr/lib/python3/dist-packages (from postorius) (24.0) Requirement already satisfied: django<4.2,>=3.2 in /usr/local/lib/python3.9/dist-packages (from postorius) (4.1.9) Requirement already satisfied: mailmanclient>=3.3.3 in /usr/local/lib/python3.9/dist-packages (from postorius) (3.3.5) Requirement already satisfied: sqlparse>=0.2.2 in /usr/lib/python3/dist-packages (from django<4.2,>=3.2->postorius) (0.4.1) Requirement already satisfied: asgiref<4,>=3.5.2 in /usr/local/lib/python3.9/dist-packages (from django<4.2,>=3.2->postorius) (3.7.2) Requirement already satisfied: typing-extensions>=4 in /usr/local/lib/python3.9/dist-packages (from asgiref<4,>=3.5.2->django<4.2,>=3.2->postorius) (4.6.3) Requirement already satisfied: django-allauth in /usr/lib/python3/dist-packages (from django-mailman3>=1.3.8->postorius) (0.44.0) Requirement already satisfied: pytz in /usr/lib/python3/dist-packages (from django-mailman3>=1.3.8->postorius) (2021.1) Requirement already satisfied: django-gravatar2>=1.0.6 in /usr/lib/python3/dist-packages (from django-mailman3>=1.3.8->postorius) (1.4.4) Requirement already satisfied: requests in /usr/lib/python3/dist-packages (from mailmanclient>=3.3.3->postorius) (2.25.1) Requirement already satisfied: cmarkgfm>=0.2.0 in /usr/lib/python3/dist-packages (from readme-renderer[md]->postorius) (0.4.2) dpkg -l | grep django ii python3-django 2:2.2.28-1~deb11u2 all High-level Python web development framework ii python3-django-allauth 0.44.0+ds-1+deb11u1 all Django app for local and social authentication (Python 3 version) ii python3-django-appconf 1.0.3-1 all helper class handling configuration defaults of apps - Python 3.x ii python3-django-compressor 2.4-2 all Compresses linked, inline JS or CSS into single cached files - Python 3.x ii python3-django-extensions 3.0.3-3 all Useful extensions for Django projects (Python 3 version) ii python3-django-filters 2.4.0-1 all filter Django QuerySets based on user selections ii python3-django-gravatar2 1.4.4-2 all Python3 library that provides essential Gravatar support ii python3-django-guardian 2.0.0-2 all per object permissions of django for Python3 ii python3-django-haystack 3.0-1 all modular search for Django (Python version) ii python3-django-hyperkitty 1.3.4-4 all Web user interface to access GNU Mailman3 archives ii python3-django-mailman3 1.3.5-2 all Django library to help interaction with Mailman3 (Python 3 version) ii python3-django-picklefield 3.0.1-1 all Pickled object field for Django (Python3 version) ii python3-django-postorius 1.3.4-2+deb11u1 all Web user interface to access GNU Mailman3 ii python3-django-q 1.2.1-1 all Django multiprocessing distributed task queue (Python 3 version) ii python3-djangorestframework 3.12.1-1 all Web APIs for Django, made easy for Python3 debian 11 (bullseye) Looks to be a problem between django 4 and /usr/local/lib/python3.9/dist-packages/django/utils/encoding.py ? Please can anybody help?

4 8

Templates via Webinterface are i) not set, and ii) set templates (files) are not shown in the Webinterface
by Wikinaut Sept. 30, 2023

Sept. 30, 2023

I use mailman3 since a while, for some of my lists I have been using - list:member:digest:footer.txt - list:member:regular:footer.txt When I go to "Vorlagen" (LC: DE) (templates) in the web interface, I do _not_ see these two templates! When I got o my newest mailing list and when I setup templates via the Webinterfaces, these are shown there, but are neither working nor seen as files. What's wrong here? Is that a problem of the localisation language (DE)? Bug, feature or misunderstanding of myself?

2 2

Is there a way of recording bounce messages?
by Andrew Hodgson Sept. 28, 2023

Sept. 28, 2023

Hi. I recently had an incident of all gmail.com members being bounced off one email list (around 180 subscribers). The messages recording the bounce don't include the original DSN. Is there a way of getting the DSN recorded? I'm sure it will give me some nonsense Gmail refusal message but I would like to identify if messages are bouncing for specific users, or if I am harming my reputation by sending to disabled accounts etc. Thanks. Andrew.

5 17

Mailing list name with capital letters?
by mrl＠psfc.mit.edu Sept. 26, 2023

Sept. 26, 2023

How can I create a mailing list with capital letters? Right now, only the first letter can be capitalized. Some of my mailing list names in mailman 2 had capital letters. When I migrated them to mailman 3, the capital letters remained. So it should be possible to create new ones? Thanks. - Mark

3 3

Mailman 3 - Header Filter
by Thomas Lehker Sept. 25, 2023

Sept. 25, 2023

I am a Mailman neophyte and need help with filtering posts based on the subject field. We have a few list owners that want 'Out of Office' replies discarded. When using the below syntax in Postorius/Header filter the post is not discarded but ends up in 'Held Messages'. Is there any syntax I am missing or a setting in the lists that needs to be disabled/enabled to get these posts dropped? Any help is much appreciated. Header: ^subject: subject: subject Pattern: Automatic Reply 'Automatic Reply' "Automatic Reply" Action: Discard DISCLAIMER: The information contained in this message is privileged and confidential. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please reply to the message and delete/destroy any copy of this message. Information in this message that does not relate to the official business of the firm shall be understood as neither given nor endorsed by it.

4 4

Issues with @gmail.com addresses
by Mohsen Masoudfar Sept. 25, 2023

Sept. 25, 2023

Hi, since 8/1/2023 I get complains from users with @gmail.com addresses, that they are not getting any emails. I checked the logs and I see that the emails are going out: to=<xxxx(a)gmail.com>, relay=email-smtp.us-east-1.amazonaws.com[35.169.171.20]:587, delay=0.46, delays=0.03/0.06/0.13/0.24, dsn=2.0.0, status=sent (250 Ok xxx ) But it seems the users are getting email delivered to them. I’ve advised them to check their spam, promotions, and social folders and to add the list address to their email safe-senders lists, but still no success. Is there any way to help this list members? Thanks

8 21

Strange password problem
by Eggert Ehmke Sept. 25, 2023

Sept. 25, 2023

This happened several times recently with Postorius Version 1.3.8: -I try to log in as admin -rejected because of wrong password (password is stored in browser) -used forgotten password function -reset password to the stored value from browser -login works now. Works also when logged out/in again -however, the next day this behaviour repeats. Any hints?

6 22

how to administrate mailman3 in CLI ?
by testeur Sept. 23, 2023

Sept. 23, 2023

Hello, I have installed mailman3 and i want to administrate it with rest api, i ve read https://mailman-cli.readthedocs.io/en/latest/src/mailmanclient/cli/docs/usi… and https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… and https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/commands/d… i tryied with mailman command, but it don't do some actions (eg. delete held messages...). i tryied mailman shell... i tryied with curl to manage it, i can see if there is a pending message with : curl --user restadmin:restpass http://localhost:8001/3.1/lists/ml@domain.tld/held/count|| python3 -m json.tool| but how to delete all held messages ? is it possible in one time ? And how to select a specific message to discard /accept / defer ? do i have to use a POST ? Regards, PatG

3 4

Message getting held due to max number of recipients and maximum message size
by Wong, Wesley Sept. 22, 2023

Sept. 22, 2023

Hi all, I am running into an issue with messages getting held for a list with the following reasons: The message is being held because: Message has more than 10 recipients The message is larger than the 40 KB maximum size Either the message will get posted to the list, or you will receive notification of the moderator's decision. Currently, the settings are set to 0 for both settings on the list so I am not sure where mailman is getting the default settings. Is this default hard coded somewhere in the Mailman core? The version of Mailman running is 3.3.6. Any help for this issue is greatly appreciate. wesley Wesley Wong Senior Systems Engineer Anderson Computing & Information Services | ACIS 310-206-2571 [ucla-logo---new_smaller] ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Content-Type: image/png Name: image001.png Replaced multipart/alternative part with first alternative.

2 3

Hyperkitty
by Massimiliano Paragnani Sept. 21, 2023

Sept. 21, 2023

I set up the mailman3 services and lists, and we can send mail to the list successfully. However in the Archive section I couldn't see anything. My configuration: ubuntu, milman core 3.2.2, postresql, postorius 1.2.4, hyperkitty 1.3.2 This is my mailman conf result: [antispam] header_checks: [antispam] jump_chain: hold [archiver.mail_archive] class: mailman.archiving.mailarchive.MailArchive [archiver.mail_archive] clobber_date: maybe [archiver.mail_archive] clobber_skew: 1d [archiver.mail_archive] configuration: python:mailman.config.mail_archive [archiver.mail_archive] enable: no [archiver.mhonarc] class: mailman.archiving.mhonarc.MHonArc [archiver.mhonarc] clobber_date: maybe [archiver.mhonarc] clobber_skew: 1d [archiver.mhonarc] configuration: python:mailman.config.mhonarc [archiver.mhonarc] enable: no [archiver.prototype] class: mailman.archiving.prototype.Prototype [archiver.prototype] clobber_date: maybe [archiver.prototype] clobber_skew: 1d [archiver.prototype] configuration: changeme [archiver.prototype] enable: no [bounces] register_bounces_every: 15m [database] class: mailman.database.postgresql.PostgreSQLDatabase [database] debug: no [database] url: postgres://mailman3:--------------@localhost/mailman3 [devmode] enabled: no [devmode] recipient: [devmode] testing: no [devmode] wait: 60s [digests] mime_digest_keep_headers: Date From To Cc Subject Message-ID Keywords In-Reply-To References Content-Type MIME-Version Content-Transfer-Encoding Precedence Reply-To Message List-Post [digests] plain_digest_keep_headers: Message Date From Subject To Cc Message-ID Keywords Content-Type [dmarc] cache_lifetime: 7d [dmarc] org_domain_data_url: https://publicsuffix.org/list/public_suffix_list.dat [dmarc] resolver_lifetime: 5s [dmarc] resolver_timeout: 3s [language.ar] charset: utf-8 [language.ar] description: Arabic [language.ar] enabled: yes [language.ast] charset: iso-8859-1 [language.ast] description: Asturian [language.ast] enabled: yes [language.ca] charset: utf-8 [language.ca] description: Catalan [language.ca] enabled: yes [language.cs] charset: iso-8859-2 [language.cs] description: Czech [language.cs] enabled: yes [language.da] charset: iso-8859-1 [language.da] description: Danish [language.da] enabled: yes [language.de] charset: utf-8 [language.de] description: German [language.de] enabled: yes [language.el] charset: iso-8859-7 [language.el] description: Greek [language.el] enabled: yes [language.es] charset: iso-8859-1 [language.es] description: Spanish [language.es] enabled: yes [language.et] charset: iso-8859-15 [language.et] description: Estonian [language.et] enabled: yes [language.eu] charset: iso-8859-15 [language.eu] description: Euskara [language.eu] enabled: yes [language.fi] charset: iso-8859-1 [language.fi] description: Finnish [language.fi] enabled: yes [language.fr] charset: iso-8859-1 [language.fr] description: French [language.fr] enabled: yes [language.gl] charset: utf-8 [language.gl] description: Galician [language.gl] enabled: yes [language.he] charset: utf-8 [language.he] description: Hebrew [language.he] enabled: yes [language.hr] charset: iso-8859-2 [language.hr] description: Croatian [language.hr] enabled: yes [language.hu] charset: iso-8859-2 [language.hu] description: Hungarian [language.hu] enabled: yes [language.ia] charset: iso-8859-15 [language.ia] description: Interlingua [language.ia] enabled: yes [language.it] charset: iso-8859-1 [language.it] description: Italian [language.it] enabled: yes [language.ja] charset: euc-jp [language.ja] description: Japanese [language.ja] enabled: yes [language.ko] charset: euc-kr [language.ko] description: Korean [language.ko] enabled: yes [language.lt] charset: iso-8859-13 [language.lt] description: Lithuanian [language.lt] enabled: yes [language.nl] charset: iso-8859-1 [language.nl] description: Dutch [language.nl] enabled: yes [language.no] charset: iso-8859-1 [language.no] description: Norwegian [language.no] enabled: yes [language.pl] charset: iso-8859-2 [language.pl] description: Polish [language.pl] enabled: yes [language.pt] charset: iso-8859-1 [language.pt] description: Protuguese [language.pt] enabled: yes [language.pt_BR] charset: iso-8859-1 [language.pt_BR] description: Protuguese (Brazil) [language.pt_BR] enabled: yes [language.ro] charset: iso-8859-2 [language.ro] description: Romanian [language.ro] enabled: yes [language.ru] charset: koi8-r [language.ru] description: Russian [language.ru] enabled: yes [language.sk] charset: utf-8 [language.sk] description: Slovak [language.sk] enabled: yes [language.sl] charset: iso-8859-2 [language.sl] description: Slovenian [language.sl] enabled: yes [language.sr] charset: utf-8 [language.sr] description: Serbian [language.sr] enabled: yes [language.sv] charset: iso-8859-1 [language.sv] description: Swedish [language.sv] enabled: yes [language.tr] charset: iso-8859-9 [language.tr] description: Turkish [language.tr] enabled: yes [language.uk] charset: utf-8 [language.uk] description: Ukrainian [language.uk] enabled: yes [language.vi] charset: utf-8 [language.vi] description: Vietnamese [language.vi] enabled: yes [language.zh_CN] charset: utf-8 [language.zh_CN] description: Chinese [language.zh_CN] enabled: yes [language.zh_TW] charset: utf-8 [language.zh_TW] description: Chinese (Taiwan) [language.zh_TW] enabled: yes [logging.archiver] datefmt: %b %d %H:%M:%S %Y [logging.archiver] format: %(asctime)s (%(process)d) %(message)s [logging.archiver] level: info [logging.archiver] path: mailman.log [logging.archiver] propagate: no [logging.bounce] datefmt: %b %d %H:%M:%S %Y [logging.bounce] format: %(asctime)s (%(process)d) %(message)s [logging.bounce] level: info [logging.bounce] path: bounce.log [logging.bounce] propagate: no [logging.config] datefmt: %b %d %H:%M:%S %Y [logging.config] format: %(asctime)s (%(process)d) %(message)s [logging.config] level: info [logging.config] path: mailman.log [logging.config] propagate: no [logging.database] datefmt: %b %d %H:%M:%S %Y [logging.database] format: %(asctime)s (%(process)d) %(message)s [logging.database] level: warn [logging.database] path: mailman.log [logging.database] propagate: no [logging.debug] datefmt: %b %d %H:%M:%S %Y [logging.debug] format: %(asctime)s (%(process)d) %(message)s [logging.debug] level: info [logging.debug] path: debug.log [logging.debug] propagate: no [logging.error] datefmt: %b %d %H:%M:%S %Y [logging.error] format: %(asctime)s (%(process)d) %(message)s [logging.error] level: info [logging.error] path: mailman.log [logging.error] propagate: no [logging.fromusenet] datefmt: %b %d %H:%M:%S %Y [logging.fromusenet] format: %(asctime)s (%(process)d) %(message)s [logging.fromusenet] level: info [logging.fromusenet] path: mailman.log [logging.fromusenet] propagate: no [logging.http] datefmt: %b %d %H:%M:%S %Y [logging.http] format: %(asctime)s (%(process)d) %(message)s [logging.http] level: info [logging.http] path: mailman.log [logging.http] propagate: no [logging.locks] datefmt: %b %d %H:%M:%S %Y [logging.locks] format: %(asctime)s (%(process)d) %(message)s [logging.locks] level: info [logging.locks] path: mailman.log [logging.locks] propagate: no [logging.mischief] datefmt: %b %d %H:%M:%S %Y [logging.mischief] format: %(asctime)s (%(process)d) %(message)s [logging.mischief] level: info [logging.mischief] path: mailman.log [logging.mischief] propagate: no [logging.plugins] datefmt: %b %d %H:%M:%S %Y [logging.plugins] format: %(asctime)s (%(process)d) %(message)s [logging.plugins] level: info [logging.plugins] path: plugins.log [logging.plugins] propagate: no [logging.root] datefmt: %b %d %H:%M:%S %Y [logging.root] format: %(asctime)s (%(process)d) %(message)s [logging.root] level: info [logging.root] path: mailman.log [logging.root] propagate: no [logging.runner] datefmt: %b %d %H:%M:%S %Y [logging.runner] format: %(asctime)s (%(process)d) %(message)s [logging.runner] level: info [logging.runner] path: mailman.log [logging.runner] propagate: no [logging.smtp] datefmt: %b %d %H:%M:%S %Y [logging.smtp] every: $msgid smtp to $listname for $recip recips, completed in $time seconds [logging.smtp] failure: $msgid delivery to $recip failed with code $smtpcode, $smtpmsg [logging.smtp] format: %(asctime)s (%(process)d) %(message)s [logging.smtp] level: info [logging.smtp] path: smtp.log [logging.smtp] propagate: no [logging.smtp] refused: $msgid post to $listname from $sender, $size bytes, $refused failures [logging.smtp] success: $msgid post to $listname from $sender, $size bytes [logging.subscribe] datefmt: %b %d %H:%M:%S %Y [logging.subscribe] format: %(asctime)s (%(process)d) %(message)s [logging.subscribe] level: info [logging.subscribe] path: mailman.log [logging.subscribe] propagate: no [logging.vette] datefmt: %b %d %H:%M:%S %Y [logging.vette] format: %(asctime)s (%(process)d) %(message)s [logging.vette] level: info [logging.vette] path: mailman.log [logging.vette] propagate: no [mailman] cache_life: 7d [mailman] default_language: en [mailman] email_commands_max_lines: 10 [mailman] filtered_messages_are_preservable: no [mailman] html_to_plain_text_command: /usr/bin/lynx -dump $filename [mailman] layout: debian [mailman] listname_chars: [-_.0-9a-z] [mailman] noreply_address: noreply [mailman] pending_request_life: 3d [mailman] post_hook: [mailman] pre_hook: [mailman] sender_headers: from from_ reply-to sender [mailman] site_owner: max.paragnani(a)gmail.com [mta] configuration: python:mailman.config.postfix [mta] delivery_retry_period: 5d [mta] incoming: mailman.mta.postfix.LMTP [mta] lmtp_host: 127.0.0.1 [mta] lmtp_port: 8024 [mta] max_autoresponses_per_day: 10 [mta] max_delivery_threads: 0 [mta] max_recipients: 500 [mta] max_sessions_per_connection: 0 [mta] outgoing: mailman.mta.deliver.deliver [mta] remove_dkim_headers: no [mta] smtp_host: localhost [mta] smtp_pass: [mta] smtp_port: 25 [mta] smtp_user: [mta] verp_confirm_format: $address+$cookie [mta] verp_confirm_regexp: ^(.*<)?(?P<addr>[^+]+?)\+(?P<cookie>[^@]+)@.*$ [mta] verp_confirmations: no [mta] verp_delimiter: + [mta] verp_delivery_interval: 0 [mta] verp_format: ${bounces}+${local}=${domain} [mta] verp_personalized_deliveries: no [mta] verp_probe_format: $bounces+$token@$domain [mta] verp_probe_regexp: ^(?P<bounces>[^+]+?)\+(?P<token>[^@]+)@.*$ [mta] verp_probes: no [mta] verp_regexp: ^(?P<bounces>[^+]+?)\+(?P<local>[^=]+)=(?P<domain>[^@]+)@.*$ [nntp] host: [nntp] password: [nntp] port: [nntp] remove_headers: nntp-posting-host nntp-posting-date x-trace x-complaints-to xref date-received posted posting-version relay-version received [nntp] rewrite_duplicate_headers: To X-Original-To CC X-Original-CC Content-Transfer-Encoding X-Original-Content-Transfer-Encoding MIME-Version X-MIME-Version [nntp] user: [passwords] configuration: python:mailman.config.passlib [passwords] password_length: 8 [plugin.master] class: [plugin.master] component_package: [plugin.master] configuration: [plugin.master] enabled: no [shell] banner: Welcome to the GNU Mailman shell [shell] history_file: [shell] prompt: >>> [shell] use_ipython: no [styles] default: legacy-default [webservice] admin_pass: --------------------------------- [webservice] admin_user: restadmin [webservice] api_version: 3.1 [webservice] hostname: localhost [webservice] port: 8001 [webservice] show_tracebacks: yes [webservice] use_https: no

7 20

Re: Importing mbox files into archive defect with lines with From
by Alex Schuilenburg Sept. 21, 2023

Sept. 21, 2023

Hi Stephen On 19/09/2023 19:59, Stephen J. Turnbull wrote: > Did you intend to send this to me only? Nope, apologies. I'm happy to add the list back in - I thought I hit reply-to-list. > Alex Schuilenburg writes: > > > Yes, I retested with from the git head as well. Same result. It > > sees the line > > > > From 1st April 2019, our turnover has exceeded the threshold for > > > > as the start of a new message and reports no anomolies although > > there is clearly one. > > If there is an empty line preceding that one, and the "F" is in the > first column (no marginal whitespace), that is considered correct > behavior for processing an mbox file. As an email separator agreed, provided the body has all "First " (preceded by a blank line and nothing preceding on the same line) suitably escaped. > If you don't like it, don't use the mbox format. The maildir > message-per-file format is widely supported, and if you want a > folder-per-file rather than message-per-file format, MMDF is fairly > widely supported, and does not suffer from the ambiguities of mbox. > All three (with variations) are supported by recent Python 3. Understood. My issue is the lists were imported from MM2.1 in 2020 into MM3.2.1 onto hyperkitty+mariadb/mysql. So the current installation has no mbox files - archives are stored in a mysql database. > > The old MM3 installation I am migrating away from is obviously > > broken in that its mbox archive when downloaded is not escaped, > > That's interesting. I presume that's because HyperKitty saves > messages in a database rather than as mbox files, and the old mbox > exporter just flattened and concatenated the messages. Or perhaps > that also uses mailbox.mbox and old enough versions of that didn't > From-stuff. Spot on. I have to move the lists onto a new Debian 12 server using the native mailman 3.3.8 & mailman-web 0+20200530-2 packages. I tried dropping in the old mailman3 database under the new software but that did not work. Instead I manually imported the old mailman3 data directly into the new mailman3 database as, after inspections, there were no new tables and only a couple of additional fields which have suitable defaults. So dumped the mailman3 data with mysqldump --no-create-info --no-create-db --disable-keys --complete-insert --ignore-table=mailman3.alembic_version mailman3 and simply imported the dump into the new schema. OK so far. The lists showed up in postorius, obviously without archives in hyperkitty. > The normal way to upgrade a HyperKitty archive is to do nothing, just > upgrade the software. I guess you moved to a new host and deleted the > database? The preferred way is to dump the database to SQL, and then > load it in to the new database directly rather than downloading the > mbox files and importing. No ambiguity and much faster. Thats what I thought initially, but that failed as per https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…. As my old installation appears to have the django_migrations table inconsistent with the state of the database, and Debian have been unresponsive so far. Unfortunately the same mailman3-style manual import of mailman3web from old mailman3web db into the new db was not possible. There were additional tables and fields that needed values rather than defaults. Instead I opted to download the mbox exports from the old installation via the web interface and import them into the new installation for expediency.This is where I was when I posted the message. However, the old installation's mbox archive export (from the database) was problematic (e.g. 5min timeout) but after getting around those issues I ended up with some broken mbox files (e.g. the "From 1st April ..." line within a message, resulting in hyperkitty_import failures). > > although I tested downloading this thread archive and it is clearly > > escaped. Unfortunately I cannot tell if hyperkitty_import works > > using the git head since I am restricted to using the version > > provided with Debian 12. > > In July it worked for me on a site with 5300 archived lists. I assume > some of them had From-stuffed lines. Can't be sure, most of the posts > are machine-generated, but lines beginning with "From " are pretty > common in natural English. I'd be surprised if there were not any. I have 2003 lists and several occurrences. > > > There are indeed two versions though of mailbox.py on the VM: > > > > /usr/lib/python3/dist-packages/mailman/utilities/mailbox.py: from > > mailman3 (3.3.8-2~deb12u1) > > /usr/lib/python3.11/mailbox.py from libpython3.11-stdlib (3.11.2-6) > > The first applies one small change to the second (a so-called > "monkey-patch") for use by Mailman core. It should only be visible > to Python by the name "mailman.utilities.mailbox". The HyperKitty > utilities import the name "mailbox". If overwriting the first with > the second changes HyperKitty's behavior, something is wrong with > sys.path. Then I guess that is the case in Debian 12. > > > the latter of which appears far more substantial , so I dropped > > that module over the former and reran hyperkitty_import over the > > '>' escaped mbox, and while it did import without error, it did > > leave the escape in place (i.e. the 'From ...' was quoted when > > viewed). > > This is considered correct behavior. It is not possible to determine > whether the escape was in the original, or added by a receiving MTA. > Better to leave it. I thought that ">From " would be escaped to ">>From ", and so on, so the escape could easily be reversed when imported. I tested exports from the mailman-users lists and lines beginning "From " (preceded by a blank line) are escaped to ">From ", so incorrectly figured this would be unescaped by hyperkitty_import. After all, I would expect that an export of the archive to mbox, followed by a delete of the archive, followed by a hyperkitty_import of the archive, should leave you at the same place. Not with ">From " escapes in the new archives. In fact I also had a number of messages with "Message-ID: <>" and worse: all messages with attachments had the text/plain content empty. So mbox exports from MM 3.2.1 on Debian 10 (using hyperkitty+mysql) are broken. > > > The unescaped mbox import died in the same way. > > As expected. > > > Anyhow, thanks for your suggestion. For now I can stick with a > > manual repair and spaced escape of From_. > > If the old database is still available, I recommend dumping that and > loading it into a fresh version of the DBMS. > ... Thanks for the pointer. As I had already done the same with mailman3, so repeated the excercise. The following dump and import worked. oldhost> mysqldump --no-create-info --no-create-db --disable-keys --complete-insert mailman3web > mailman3web.sql newhost> mysql MariaDB [(none]> use mailman3web MariaDB [mailman3web]> source mailman3web.sql Thanks again -- Alex

2 3

Can't send emails to list users
by Rob Passalacqua Sept. 19, 2023

Sept. 19, 2023

I've looked on the forums and haven't found someone with the exact same issue as me. It appears that my mailman 3 server is either only sending to the first3 recipients on the list or only sending out mail to users that are members in Django because only 3 recipients are getting the emails. Here is my /var/log/mailman3/smtp.log: Sep 01 08:00:04 2023 (1405) <169357680279.2857929.16011221517221650936(a)lists.mydomain.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.028921127319335938 seconds Sep 01 08:00:04 2023 (1405) <169357680279.2857929.16011221517221650936(a)lists.mydomain.com> post to graduates(a)lists.mydomain.com from systemadmins(a)mydomain.com, 1107 bytes Sep 01 08:00:04 2023 (1405) <169357680284.2857929.17642987556878027498(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.00876307487487793 seconds Sep 01 08:00:04 2023 (1405) <169357680284.2857929.17642987556878027498(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from systemadmins(a)mydomain.com, 1384 bytes Sep 01 08:02:03 2023 (1405) <BY5PR04MB6787FC43405D111FDBF24BBBD2E5A(a)BY5PR04MB6787.namprd04.prod.outlook.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.08111977577209473 seconds Sep 01 08:02:03 2023 (1405) <BY5PR04MB6787FC43405D111FDBF24BBBD2E5A(a)BY5PR04MB6787.namprd04.prod.outlook.com> post to graduates(a)lists.mydomain.com from itroost(a)mydomain.com, 22320 bytes Sep 01 08:08:21 2023 (1405) <BY5PR04MB6787FC43405D111FDBF24BBBD2E5A(a)BY5PR04MB6787.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.08126330375671387 seconds Sep 01 08:08:21 2023 (1405) <BY5PR04MB6787FC43405D111FDBF24BBBD2E5A(a)BY5PR04MB6787.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from itroost(a)mydomain.com, 22320 bytes Sep 01 08:08:33 2023 (1405) <SJ0PR04MB7469F9DA4C471D4CF0AA8329C8E5A(a)SJ0PR04MB7469.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.19033193588256836 seconds Sep 01 08:08:33 2023 (1405) <SJ0PR04MB7469F9DA4C471D4CF0AA8329C8E5A(a)SJ0PR04MB7469.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from marcomm(a)mydomain.com, 627057 bytes Sep 08 13:16:05 2023 (1402) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 08 13:16:05 2023 (1402) Peer: ('127.0.0.1', 39988) Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) handling connection Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) Data: b'LHLO lists.mydomain.com' Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) Data: b'MAIL FROM:<radiga(a)mydomain.com>' Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) sender: radiga(a)mydomain.com Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) Data: b'RCPT TO:<undergraduates(a)lists.mydomain.com>' Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) recip: undergraduates(a)lists.mydomain.com Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) Data: b'DATA' Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) Data: b'QUIT' Sep 08 13:16:05 2023 (1402) ('127.0.0.1', 39988) connection lost Sep 08 13:16:05 2023 (1402) Connection lost during _handle_client() Sep 08 13:16:07 2023 (1405) <169420056594.1401.9589247638462690499(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 1 recips, completed in 0.005960226058959961 seconds Sep 08 13:16:07 2023 (1405) <169420056594.1401.9589247638462690499(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from undergraduates-bounces(a)lists.mydomain.com, 1151 bytes Sep 08 14:26:48 2023 (1405) <CYYPR04MB90325509F556F72D6E562F1CA2EDA(a)CYYPR04MB9032.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.11815094947814941 seconds Sep 08 14:26:48 2023 (1405) <CYYPR04MB90325509F556F72D6E562F1CA2EDA(a)CYYPR04MB9032.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from radiga(a)mydomain.com, 19719 bytes Sep 11 16:28:09 2023 (1402) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 11 16:28:09 2023 (1402) Peer: ('127.0.0.1', 54070) Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) handling connection Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) Data: b'LHLO lists.mydomain.com' Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) Data: b'MAIL FROM:<mbutterworth(a)mydomain.com>' Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) sender: mbutterworth(a)mydomain.com Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) Data: b'RCPT TO:<graduates(a)lists.mydomain.com>' Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) recip: graduates(a)lists.mydomain.com Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) Data: b'RCPT TO:<undergraduates(a)lists.mydomain.com>' Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) recip: undergraduates(a)lists.mydomain.com Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) Data: b'DATA' Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) Data: b'QUIT' Sep 11 16:28:09 2023 (1402) ('127.0.0.1', 54070) connection lost Sep 11 16:28:09 2023 (1402) Connection lost during _handle_client() Sep 11 16:28:12 2023 (1405) <169447129087.1401.7570255973486097010(a)lists.mydomain.com> smtp to graduates(a)lists.mydomain.com for 1 recips, completed in 0.0067327022552490234 seconds Sep 11 16:28:12 2023 (1405) <169447129087.1401.7570255973486097010(a)lists.mydomain.com> post to graduates(a)lists.mydomain.com from graduates-bounces(a)lists.mydomain.com, 1125 bytes Sep 11 16:28:12 2023 (1405) <169447129099.1401.13948217098256502621(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 1 recips, completed in 0.005612611770629883 seconds Sep 11 16:28:12 2023 (1405) <169447129099.1401.13948217098256502621(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from undergraduates-bounces(a)lists.mydomain.com, 1225 bytes Sep 12 08:00:04 2023 (1405) <169452720292.3537648.2620214486815282831(a)lists.mydomain.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.027950286865234375 seconds Sep 12 08:00:04 2023 (1405) <169452720292.3537648.2620214486815282831(a)lists.mydomain.com> post to graduates(a)lists.mydomain.com from systemadmins(a)mydomain.com, 1054 bytes Sep 12 08:00:04 2023 (1405) <169452720295.3537648.16444246393071130094(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.0057718753814697266 seconds Sep 12 08:00:04 2023 (1405) <169452720295.3537648.16444246393071130094(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from systemadmins(a)mydomain.com, 1151 bytes Sep 12 08:33:17 2023 (1405) <BYAPR04MB4438A507A16AE14A6CFF7E33A1F2A(a)BYAPR04MB4438.namprd04.prod.outlook.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.08274292945861816 seconds Sep 12 08:33:17 2023 (1405) <BYAPR04MB4438A507A16AE14A6CFF7E33A1F2A(a)BYAPR04MB4438.namprd04.prod.outlook.com> post to graduates(a)lists.mydomain.com from mbutterworth(a)mydomain.com, 53024 bytes Sep 12 08:33:26 2023 (1405) <BYAPR04MB4438A507A16AE14A6CFF7E33A1F2A(a)BYAPR04MB4438.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.061426639556884766 seconds Sep 12 08:33:26 2023 (1405) <BYAPR04MB4438A507A16AE14A6CFF7E33A1F2A(a)BYAPR04MB4438.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from mbutterworth(a)mydomain.com, 53024 bytes Sep 12 13:19:19 2023 (1402) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 12 13:19:19 2023 (1402) Peer: ('127.0.0.1', 54328) Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) handling connection Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) Data: b'LHLO lists.mydomain.com' Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) Data: b'MAIL FROM:<oanderson(a)mydomain.com>' Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) sender: oanderson(a)mydomain.com Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) Data: b'RCPT TO:<graduates(a)lists.mydomain.com>' Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) recip: graduates(a)lists.mydomain.com Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) Data: b'RCPT TO:<undergraduates(a)lists.mydomain.com>' Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) recip: undergraduates(a)lists.mydomain.com Sep 12 13:19:19 2023 (1402) ('127.0.0.1', 54328) Data: b'DATA' Sep 12 13:19:20 2023 (1402) ('127.0.0.1', 54328) Data: b'QUIT' Sep 12 13:19:20 2023 (1402) ('127.0.0.1', 54328) connection lost Sep 12 13:19:20 2023 (1402) Connection lost during _handle_client() Sep 12 13:19:22 2023 (1405) <169454636036.1401.8937840345817588576(a)lists.mydomain.com> smtp to graduates(a)lists.mydomain.com for 1 recips, completed in 0.0059452056884765625 seconds Sep 12 13:19:22 2023 (1405) <169454636036.1401.8937840345817588576(a)lists.mydomain.com> post to graduates(a)lists.mydomain.com from graduates-bounces(a)lists.mydomain.com, 1152 bytes Sep 12 13:19:22 2023 (1405) <169454636048.1401.2318933518942482920(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 1 recips, completed in 0.005008220672607422 seconds Sep 12 13:19:22 2023 (1405) <169454636048.1401.2318933518942482920(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from undergraduates-bounces(a)lists.mydomain.com, 1251 bytes Sep 12 15:25:29 2023 (1402) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 12 15:25:29 2023 (1402) Peer: ('127.0.0.1', 44946) Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) handling connection Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) Data: b'LHLO lists.mydomain.com' Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) Data: b'MAIL FROM:<oanderson(a)mydomain.com>' Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) sender: oanderson(a)mydomain.com Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) Data: b'RCPT TO:<undergraduates(a)lists.mydomain.com>' Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) recip: undergraduates(a)lists.mydomain.com Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) Data: b'DATA' Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) Data: b'QUIT' Sep 12 15:25:29 2023 (1402) ('127.0.0.1', 44946) connection lost Sep 12 15:25:29 2023 (1402) Connection lost during _handle_client() Sep 12 15:25:30 2023 (1405) <169455392982.1401.10957221749647131956(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 1 recips, completed in 0.006732940673828125 seconds Sep 12 15:25:30 2023 (1405) <169455392982.1401.10957221749647131956(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from undergraduates-bounces(a)lists.mydomain.com, 1237 bytes Sep 13 08:00:04 2023 (1405) <169461360294.3599633.12410089636004689205(a)lists.mydomain.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.027216196060180664 seconds Sep 13 08:00:04 2023 (1405) <169461360294.3599633.12410089636004689205(a)lists.mydomain.com> post to graduates(a)lists.mydomain.com from systemadmins(a)mydomain.com, 1079 bytes Sep 13 08:00:04 2023 (1405) <169461360298.3599633.9616667478508973418(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.00615382194519043 seconds Sep 13 08:00:04 2023 (1405) <169461360298.3599633.9616667478508973418(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from systemadmins(a)mydomain.com, 1377 bytes Sep 13 08:37:09 2023 (1405) <BYAPR04MB5813FE78DC3323A0822D9FE4DBF1A(a)BYAPR04MB5813.namprd04.prod.outlook.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.438995361328125 seconds Sep 13 08:37:09 2023 (1405) <BYAPR04MB5813FE78DC3323A0822D9FE4DBF1A(a)BYAPR04MB5813.namprd04.prod.outlook.com> post to graduates(a)lists.mydomain.com from oanderson(a)mydomain.com, 1787833 bytes Sep 13 08:37:37 2023 (1405) <BYAPR04MB5813FE78DC3323A0822D9FE4DBF1A(a)BYAPR04MB5813.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.41765809059143066 seconds Sep 13 08:37:37 2023 (1405) <BYAPR04MB5813FE78DC3323A0822D9FE4DBF1A(a)BYAPR04MB5813.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from oanderson(a)mydomain.com, 1787833 bytes Sep 13 08:37:37 2023 (1405) <BYAPR04MB581366BC29E904B4A7E7EFCCDBF1A(a)BYAPR04MB5813.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.05196428298950195 seconds Sep 13 08:37:37 2023 (1405) <BYAPR04MB581366BC29E904B4A7E7EFCCDBF1A(a)BYAPR04MB5813.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from oanderson(a)mydomain.com, 22280 bytes Sep 14 11:13:14 2023 (1402) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 14 11:13:14 2023 (1402) Peer: ('127.0.0.1', 46146) Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) handling connection Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) Data: b'LHLO lists.mydomain.com' Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) Data: b'MAIL FROM:<informationservices(a)mydomain.com>' Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) sender: informationservices(a)mydomain.com Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) Data: b'RCPT TO:<undergraduates(a)lists.mydomain.com>' Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) recip: undergraduates(a)lists.mydomain.com Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) Data: b'DATA' Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) Data: b'QUIT' Sep 14 11:13:14 2023 (1402) ('127.0.0.1', 46146) connection lost Sep 14 11:13:14 2023 (1402) Connection lost during _handle_client() Sep 14 11:13:16 2023 (1405) <169471159483.1401.16856017446433914677(a)lists.mydomain.com> smtp to undergraduates(a)lists.mydomain.com for 1 recips, completed in 0.005692005157470703 seconds Sep 14 11:13:16 2023 (1405) <169471159483.1401.16856017446433914677(a)lists.mydomain.com> post to undergraduates(a)lists.mydomain.com from undergraduates-bounces(a)lists.mydomain.com, 1210 bytes Sep 14 11:15:53 2023 (1405) <SJ0PR04MB85671FB097F25CF9F4874740BFF7A(a)SJ0PR04MB8567.namprd04.prod.outlook.com> smtp to undergraduates(a)lists.mydomain.com for 4 recips, completed in 0.08924412727355957 seconds Sep 14 11:15:53 2023 (1405) <SJ0PR04MB85671FB097F25CF9F4874740BFF7A(a)SJ0PR04MB8567.namprd04.prod.outlook.com> post to undergraduates(a)lists.mydomain.com from informationservices(a)mydomain.com, 22049 bytes Sep 14 14:34:11 2023 (1402) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 14 14:34:11 2023 (1402) Peer: ('127.0.0.1', 60848) Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) handling connection Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) Data: b'LHLO lists.mydomain.com' Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) Data: b'MAIL FROM:<informationservices(a)mydomain.com>' Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) sender: informationservices(a)mydomain.com Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) Data: b'RCPT TO:<ug(a)lists.mydomain.com>' Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) recip: ug(a)lists.mydomain.com Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) Data: b'DATA' Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) Data: b'QUIT' Sep 14 14:34:11 2023 (1402) ('127.0.0.1', 60848) connection lost Sep 14 14:34:11 2023 (1402) Connection lost during _handle_client() Sep 14 14:34:14 2023 (1405) <169472365226.1401.465743651937418379(a)lists.mydomain.com> smtp to ug(a)lists.mydomain.com for 1 recips, completed in 0.00711822509765625 seconds Sep 14 14:34:14 2023 (1405) <169472365226.1401.465743651937418379(a)lists.mydomain.com> post to ug(a)lists.mydomain.com from ug-bounces(a)lists.mydomain.com, 1153 bytes Sep 14 14:34:33 2023 (1405) <SJ0PR04MB856797E91A59977ABCF9BAB7BFF7A(a)SJ0PR04MB8567.namprd04.prod.outlook.com> smtp to ug(a)lists.mydomain.com for 4 recips, completed in 0.054645538330078125 seconds Sep 14 14:34:33 2023 (1405) <SJ0PR04MB856797E91A59977ABCF9BAB7BFF7A(a)SJ0PR04MB8567.namprd04.prod.outlook.com> post to ug(a)lists.mydomain.com from informationservices(a)mydomain.com, 21976 bytes Sep 14 16:36:56 2023 (1305) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 14 16:36:56 2023 (1305) Peer: ('127.0.0.1', 54478) Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) handling connection Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) Data: b'LHLO lists.mydomain.com' Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) sender: rpassalacqua(a)mydomain.com Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) recip: test(a)lists.mydomain.com Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) Data: b'DATA' Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) Data: b'QUIT' Sep 14 16:36:56 2023 (1305) ('127.0.0.1', 54478) connection lost Sep 14 16:36:56 2023 (1305) Connection lost during _handle_client() Sep 14 16:36:58 2023 (1307) <169473101747.1304.15129450588472089900(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.0060198307037353516 seconds Sep 14 16:36:58 2023 (1307) <169473101747.1304.15129450588472089900(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1067 bytes Sep 14 16:38:48 2023 (1307) <BY5PR04MB71216AD8880847E842960CB6B3F7A(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.05848550796508789 seconds Sep 14 16:38:48 2023 (1307) <BY5PR04MB71216AD8880847E842960CB6B3F7A(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 8680 bytes Sep 14 17:39:38 2023 (4281) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 14 17:39:38 2023 (4281) Peer: ('127.0.0.1', 38814) Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) handling connection Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) Data: b'LHLO lists.mydomain.com' Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) sender: rpassalacqua(a)mydomain.com Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) recip: test(a)lists.mydomain.com Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) Data: b'DATA' Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) Data: b'QUIT' Sep 14 17:39:38 2023 (4281) ('127.0.0.1', 38814) connection lost Sep 14 17:39:38 2023 (4281) Connection lost during _handle_client() Sep 14 17:39:40 2023 (4283) <169473477870.4280.4174702240504737654(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.005831241607666016 seconds Sep 14 17:39:40 2023 (4283) <169473477870.4280.4174702240504737654(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1085 bytes Sep 14 17:42:59 2023 (4283) <BY5PR04MB71215FF54B65F1D74C4567C0B3F7A(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.06569862365722656 seconds Sep 14 17:42:59 2023 (4283) <BY5PR04MB71215FF54B65F1D74C4567C0B3F7A(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 32685 bytes Sep 14 18:03:41 2023 (4281) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 14 18:03:41 2023 (4281) Peer: ('127.0.0.1', 42054) Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) handling connection Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) Data: b'LHLO lists.mydomain.com' Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) sender: rpassalacqua(a)mydomain.com Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) recip: test(a)lists.mydomain.com Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) Data: b'DATA' Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) Data: b'QUIT' Sep 14 18:03:41 2023 (4281) ('127.0.0.1', 42054) connection lost Sep 14 18:03:41 2023 (4281) Connection lost during _handle_client() Sep 14 18:03:42 2023 (4283) <169473622130.4280.7069249432915457814(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.006022214889526367 seconds Sep 14 18:03:42 2023 (4283) <169473622130.4280.7069249432915457814(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1065 bytes Sep 14 18:07:57 2023 (4281) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 14 18:07:57 2023 (4281) Peer: ('127.0.0.1', 50610) Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) handling connection Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) Data: b'LHLO lists.mydomain.com' Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) sender: rpassalacqua(a)mydomain.com Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) recip: test(a)lists.mydomain.com Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) Data: b'DATA' Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) Data: b'QUIT' Sep 14 18:07:57 2023 (4281) ('127.0.0.1', 50610) connection lost Sep 14 18:07:57 2023 (4281) Connection lost during _handle_client() Sep 14 18:07:58 2023 (4283) <169473647867.4280.14938940229014329856(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.0055654048919677734 seconds Sep 14 18:07:58 2023 (4283) <169473647867.4280.14938940229014329856(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1098 bytes Sep 14 18:10:17 2023 (4283) <BY5PR04MB71217ABD906F6FE7AFD2B4B9B3F7A(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.06551766395568848 seconds Sep 14 18:10:17 2023 (4283) <BY5PR04MB71217ABD906F6FE7AFD2B4B9B3F7A(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 8688 bytes Sep 14 18:10:20 2023 (4283) <BY5PR04MB7121FAB23617A4597304E327B3F6A(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.03918266296386719 seconds Sep 14 18:10:20 2023 (4283) <BY5PR04MB7121FAB23617A4597304E327B3F6A(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 8880 bytes Sep 15 09:16:03 2023 (4281) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 15 09:16:03 2023 (4281) Peer: ('127.0.0.1', 38006) Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) handling connection Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) Data: b'LHLO lists.mydomain.com' Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) sender: rpassalacqua(a)mydomain.com Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) recip: test(a)lists.mydomain.com Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) Data: b'DATA' Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) Data: b'QUIT' Sep 15 09:16:03 2023 (4281) ('127.0.0.1', 38006) connection lost Sep 15 09:16:03 2023 (4281) Connection lost during _handle_client() Sep 15 09:16:05 2023 (4283) <169479096385.4280.8198285364938859931(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.005726337432861328 seconds Sep 15 09:16:05 2023 (4283) <169479096385.4280.8198285364938859931(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1069 bytes Sep 15 09:16:54 2023 (4283) <BY5PR04MB71219485E3D6DBF7FFEF45E5B3F6A(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.04341244697570801 seconds Sep 15 09:16:54 2023 (4283) <BY5PR04MB71219485E3D6DBF7FFEF45E5B3F6A(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 9719 bytes Sep 15 11:12:26 2023 (4281) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 15 11:12:26 2023 (4281) Peer: ('127.0.0.1', 59844) Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) handling connection Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) Data: b'LHLO lists.mydomain.com' Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) sender: rpassalacqua(a)mydomain.com Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) recip: test(a)lists.mydomain.com Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) Data: b'DATA' Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) Data: b'QUIT' Sep 15 11:12:26 2023 (4281) ('127.0.0.1', 59844) connection lost Sep 15 11:12:26 2023 (4281) Connection lost during _handle_client() Sep 15 11:12:28 2023 (4283) <169479794718.4280.8209850830279553803(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.005163669586181641 seconds Sep 15 11:12:28 2023 (4283) <169479794718.4280.8209850830279553803(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1098 bytes Sep 15 11:12:49 2023 (4283) <BY5PR04MB71214E309721B3CC9F3072F9B3F6A(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.0408024787902832 seconds Sep 15 11:12:49 2023 (4283) <BY5PR04MB71214E309721B3CC9F3072F9B3F6A(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 8817 bytes Sep 18 16:51:02 2023 (1286) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 18 16:51:02 2023 (1286) Peer: ('127.0.0.1', 56034) Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) handling connection Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) Data: b'LHLO lists.mydomain.com' Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) sender: rpassalacqua(a)mydomain.com Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) recip: test(a)lists.mydomain.com Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) Data: b'DATA' Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) Data: b'QUIT' Sep 18 16:51:02 2023 (1286) ('127.0.0.1', 56034) connection lost Sep 18 16:51:02 2023 (1286) Connection lost during _handle_client() Sep 18 16:51:03 2023 (1288) <169507746274.1285.2209553928985210953(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.005767107009887695 seconds Sep 18 16:51:03 2023 (1288) <169507746274.1285.2209553928985210953(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1075 bytes Sep 18 16:58:09 2023 (1288) <BY5PR04MB7121D7152C07846F0FCFB100B3FBA(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.07815432548522949 seconds Sep 18 16:58:09 2023 (1288) <BY5PR04MB7121D7152C07846F0FCFB100B3FBA(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 8756 bytes Sep 19 08:49:33 2023 (1286) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Sep 19 08:49:33 2023 (1286) Peer: ('127.0.0.1', 59616) Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) handling connection Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) Data: b'LHLO lists.mydomain.com' Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) Data: b'MAIL FROM:<rpassalacqua(a)mydomain.com>' Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) sender: rpassalacqua(a)mydomain.com Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) Data: b'RCPT TO:<test(a)lists.mydomain.com>' Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) recip: test(a)lists.mydomain.com Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) Data: b'DATA' Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) Data: b'QUIT' Sep 19 08:49:33 2023 (1286) ('127.0.0.1', 59616) connection lost Sep 19 08:49:33 2023 (1286) Connection lost during _handle_client() Sep 19 08:49:36 2023 (1288) <169513497462.1285.8696625500767060363(a)lists.mydomain.com> smtp to test(a)lists.mydomain.com for 1 recips, completed in 0.007772684097290039 seconds Sep 19 08:49:36 2023 (1288) <169513497462.1285.8696625500767060363(a)lists.mydomain.com> post to test(a)lists.mydomain.com from test-bounces(a)lists.mydomain.com, 1076 bytes Sep 19 08:50:23 2023 (1288) <BY5PR04MB7121991E697D92F88D586AFFB3FAA(a)BY5PR04MB7121.namprd04.prod.outlook.com> smtp to test(a)lists.mydomain.com for 3 recips, completed in 0.04478025436401367 seconds Sep 19 08:50:23 2023 (1288) <BY5PR04MB7121991E697D92F88D586AFFB3FAA(a)BY5PR04MB7121.namprd04.prod.outlook.com> post to test(a)lists.mydomain.com from rpassalacqua(a)mydomain.com, 8828 bytes

3 4

Importing mbox files into archive defect with lines with From
by andrew.bernard＠gmail.com Sept. 19, 2023

Sept. 19, 2023

A curious problem, but seems to be well defined. I am importing mbox format files with 25 years worth of archives in 250 files from a Listserv list into hyperkitty. All is going swimmingly, except I get lots of partial emails with sender of None put into the current month, with text that has clearly been truncated. As I look at each one, I see that the line in the imported text is immediately after a line starting with 'From'. Clearly, 'From:' is an RCS-82 header, but 'From ' is not, and yet there is much evidence here that this is messing up the import. Is this a known bug? If not, how do I report it?

8 15

Modify approval email
by pau.baiges＠csuc.cat Sept. 19, 2023

Sept. 19, 2023

Good morning, Is there a way to modify the email that is sent by default to list owners when a non-list member sends email to the list? Basically the default email that is sent is this: ________________________________________________________ As list administrator, your authorization is requested for the following mailing list posting: List: lis1(a)llistes.csuc.cat From: jim(a)csuc.cat Subject: test The message is being held because: El missatge no és d'un membre de la llista At your convenience, visit your dashboard to approve or deny the request. _____________________________________________________________________ We would like to add the link to the page to accept the email from the list itself. I think I remember that in the old mailman it could be done Thanks!

4 4

I'm seeing a lot of database locked errors
by bryan.kartzman＠yu.edu Sept. 19, 2023

Sept. 19, 2023

We switched the mailman database from sqlite to postgresql a while back to minimize any database locking but I'm seeing a lot of errors for the django sqlite database. Is it possible to move that to postgres as well? 16:18:39 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked 16:18:39 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked 16:18:39 [Q] INFO Process-1:4 processing [compute_thread_positions] 16:18:39 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked 16:18:39 [Q] INFO Processed [compute_thread_positions] 16:18:44 [Q] INFO Process-1:2 processing [compute_thread_positions] 16:18:44 [Q] INFO Processed [compute_thread_positions] 16:18:44 [Q] INFO Process-1:1 processing [compute_thread_positions] 16:18:44 [Q] INFO Processed [compute_thread_positions] 16:18:44 [Q] INFO Process-1:3 processing [compute_thread_positions] 16:18:44 [Q] INFO Process-1:4 processing [compute_thread_positions] 16:18:44 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked 16:18:44 [Q] INFO Processed [compute_thread_positions] 16:18:49 [Q] INFO Process-1:2 processing [compute_thread_positions] 16:18:49 [Q] INFO Process-1:1 processing [compute_thread_positions] 16:18:49 [Q] INFO Process-1:3 processing [compute_thread_positions] 16:18:49 [Q] INFO Process-1:4 processing [compute_thread_positions] 16:18:49 [Q] INFO Process-1:2 processing [compute_thread_positions] 16:18:49 [Q] INFO Process-1:1 processing [compute_thread_positions] 16:18:49 [Q] INFO Processed [compute_thread_positions] 16:18:49 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked 16:18:49 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked 16:18:49 [Q] INFO Processed [compute_thread_positions] 16:18:49 [Q] INFO Processed [compute_thread_positions] 16:18:49 [Q] INFO Processed [compute_thread_positions] 16:19:39 [Q] INFO Process-1:4 processing [compute_thread_positions] 16:19:39 [Q] INFO Process-1:3 processing [compute_thread_positions] 16:19:39 [Q] INFO Process-1:1 processing [compute_thread_positions] 16:19:39 [Q] ERROR Failed [compute_thread_positions] - database is locked : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: database is locked The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 421, in worker res = f(*task["args"], **task["kwargs"]) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 127, in _compute_thread_positions compute_thread_order_and_depth(thread) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 55, in compute_thread_order_and_depth walk_successors(thread.starting_email.id) File "/usr/lib/python3/dist-packages/hyperkitty/lib/analysis.py", line 40, in walk_successors obj.save(update_fields=["thread_depth", "thread_order"]) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 743, in save self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 780, in save_base updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 853, in _save_table updated = self._do_update(base_qs, using, pk_val, values, update_fields, File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 903, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 760, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: database is locked

2 14

LDAP user email verification
by Tony Deshields Sept. 15, 2023

Sept. 15, 2023

I'm running the docker-mailman setup with LDAP integrated. My users that authenticate against LDAP are still required to verify their email address however, I do not want this functionality. I was looking for guidance on possibly configuring it so my LDAP users do not have to verify their email address.

3 3

Restore/export existing Mailman lists + hyperkitty archives on a new server
by Kimmo L Sept. 14, 2023

Sept. 14, 2023

Hello! My plan is to install fresh Mailman3 host, which means that i need to migrate/transfer my existing mailman mailing lists + hyperkitty archives to new host. Unfortunately i didnt find any good documentation about this. I tried myself to export and import mailmanweb/mailman databases (from old PostgreSQL to new PostgreSQL) and recreate indexes(mailman-web update_index). Now i can see and search hyperkitty archives, but if try to open one of the mailing list, i get error - HTTP Error 500: {"title": "500 Internal Server Error"} So im pretty sure, that I'm gonna have to transport some more stuff over, which I have no idea. Maybe existing users and user rights. If its not a big trouble, can someone kindly share, what exactly should i need to export/import and what would be the right steps/commands/moves. Br, Kimmo

4 52

Strange issue with bounce processing
by Brian Carpenter Sept. 13, 2023

Sept. 13, 2023

Dear List, First of all Merry Christmas to those of you that are observing it. I have an issue on one of my Mailman 3 servers. The bounce runner is not running, even after restarting mailman core. All the other runners are working fine. Here is the problem, after restarting it, a number of messages show up in queue/bounces from a single list. However the bounce runner is still not running. So I remove these messages from queue/bounces folder and restart mailman core. The same messages show up from the same single list again in queue/bounces. In the var/logs/bounce.log file, addresses from this list are being logged as being removed after starting mailman core. They correlate with the messages showing up in queue/bounces. I assume these "cached" bounces are what is interfering with the running of the bounce runner. I don't see anything in the mailman or mailmansuite log that would explain this behavior. How can I fix this? Thank you for any assistance. -- Brian Carpenter Harmonylists.com Emwd.com

3 6

Question about "envelope-from" header
by Stephen Daniel Sept. 13, 2023

Sept. 13, 2023

Mailman Gurus -- I run a small mailman3 implementation in a VM inside Google's cloud. The same VM runs both mailman3 and postfix. Because outbound SMTP is blocked by Google, my postfix relays outbound mail through smtp-relay.gmail.com, using credentials from my google workspace account. Works pretty well. For reasons unrelated to my mailing lists, I'd like to have the same VM provide a couple of mail aliases. Mail that comes in to " alias1(a)mydomain.com" should be relayed to "random1(a)somedomain.com". I am trying to do this by setting up virtual aliases in postfix, as per http://www.postfix.org/virtual.5.html. This works except that smtp-relay.gmail.com rejects the forwarded message because of "invalid credentials". I believe that email going out through smtp-relay.gmail.com can only come from a small set of previously authorized domains, and a random person who sends to "alias1(a)mydomain.com" is unlikely to be on that list. I think I could fix this by having postfix edit the "envelope-from" header as it relays the mail, so that the "envelope-from" header contains something like "admin(a)mydomain.com". Not sure, but I think so. My question is this: If I edit the envelope-from header in my outbound emails to say "admin(a)mydomain.com" am I going to break my email lists? Will bounce processing still work? Will replies to the list still work? Thanks! -- Stephen Daniel

3 2

Mailman messages are getting a TAG in some email clients.....how????
by bob B Sept. 13, 2023

Sept. 13, 2023

So I know about the setting "Anonymous list" but regardless of that setting some email clients put the list name in [] when it displays messages in your inbox. Does anyone know how email clients are doing this? I have users who email clients do not do this, and was wondering if it is a setting in their client or just not possible. Here is a link to an image showing the tag for a list called TEST6 https://imgur.com/a/7VyJtsD

3 3

How to let mailman log every single email that it sends out?
by Mohsen Masoudfar Sept. 10, 2023

Sept. 10, 2023

I'm curious about the configuration required to have Mailman record logs for every individual email it sends. I see that it sends to the entire list, but I'm interested in obtaining log entries for each email sent to every individual subscriber on the list. How can I access this information? Is it a postfix setting, or a Mailman3 setting? I have checked /var/log/mail.log and all the logs under /var/log/Mailman3/* Mailman is running on Ubuntu 18.3 Thank you! Mohsen

4 5

Issue with Docker Postfix and Mailman3 Configuration
by recida8902＠picvw.com Sept. 9, 2023

Sept. 9, 2023

Dear Support Team, I am writing to seek assistance with an issue I am facing while configuring Docker Postfix with Docker Mailman3. I have successfully set up the configuration, and I can send emails without any problems. However, I am encountering an issue where incoming emails are not being received by the Mailman application. When I send an email from my configured email address, it is successfully delivered to the intended recipients. However, when someone else sends an email to the same address, it does not reach the Mailman application, and no error messages are generated. I have already tried the following troubleshooting steps: 1. Checked the Mailman container logs: I reviewed the logs using the docker logs command, but I did not find any error messages or warnings related to the incoming email issue. 2. Verified the Mailman installation: I ensured that Mailman is correctly installed and configured according to the provided documentation. All dependencies are met, and the outgoing email functionality is working as expected. 3. Checked the Mailman configuration: I reviewed the configuration files of Mailman and ensured that all necessary settings are properly configured. However, I couldn't identify any specific variables or options related to incoming email handling. Despite these efforts, I am still unable to receive incoming emails in the Mailman application. I would greatly appreciate any guidance or assistance you can provide to help resolve this issue. Please let me know if there is any additional information or logs that would be helpful for troubleshooting. Thank you in advance for your time and support.

2 1

social login added, but can't connect new login to existing users
by Jörg Schulz Sept. 6, 2023

Sept. 6, 2023

after lots of research in this list, we managed to add a keycloak login to mailman3. MAILMAN_WEB_SOCIAL_AUTH = ["allauth.socialaccount.providers.keycloak"] # OIDC_CREATE_USER = False SOCIALACCOUNT_PROVIDERS = { 'keycloak': { 'KEYCLOAK_URL': 'https://keycloak.my.domain', 'KEYCLOAK_REALM': 'nct' # 'SCOPE': ['profile', 'email', 'preferred_username'], } } and some entries in https://mailman.my.domain/admin/socialaccount/socialapp This works perfectly for non-existing users/emails. They are created and they are able to subscribe to lists. But, when a user already exists, this does not work; the user gets a password reset email like "...an account using that email address already exists. In case you have forgotten about this, please use the password forgotten procedure to recover your account:..." Which kind of setting/tweak is needed to associate social login accounts to existing mail addresses?

4 4