- Mailman-users - lists.mailman3.org

Which folder should I share between pods with kubernetees persistentVolumeClaim ?
by antoine.depoisier＠ikmail.com Feb. 7, 2025

Feb. 7, 2025

I use mailman with kubernetees, and I have four pods. I currently use persistentVolumeClaim for two folders in the mailman configuration "cache" and "messages". I share these folders, as mailman needs to be consistent for these two folders, but I'm wondering if I should share other folders as well, like locks and such. There are all the folders in mailman archives cache data etc lists locks logs master.pid messages queue templates I ask this question because I often have a problem when creating a mailing list. I think I have a problem with the locks, but I'm not sure if the problem is due to the fact that the locks folder is not shared. If you want more details, here's the trace I sometimes get, when someone tries to create a mailing list: File "falcon/app.py", line 365, in falcon.app.App.__call__ File "/usr/lib/python3.12/site-packages/mailman/rest/lists.py", line 322, in on_post mlist = create_list(**validator(request)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/site-packages/mailman/app/lifecycle.py", line 102, in create_list call_name(config.mta.incoming).create(mlist) File "/usr/lib/python3.12/site-packages/mailman/mta/postfix.py", line 96, in create self.regenerate() File "/usr/lib/python3.12/site-packages/mailman/mta/postfix.py", line 106, in regenerate with Lock(lock_file): ^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/site-packages/flufl/lock/_lockfile.py", line 467, in __exit__ self.unlock() File "/usr/lib/python3.12/site-packages/flufl/lock/_lockfile.py", line 417, in unlock raise NotLockedError('Already unlocked') flufl.lock._lockfile.NotLockedError: Already unlocked When I check the lock folder, I have these two files, and I'm wondering if I should delete these two files : -rw-rw---- 2 mailman nogroup 97 Feb 6 2025 master.lck -rw-rw---- 2 mailman nogroup 97 Feb 6 2025 master.lck|mailman-core-deployment-5f59557b66-bkkf4|16|4268829230172994873 Do you have any answer for me ?

3 4

Configuring ARC with multiple domains in Mailman3
by Lance A. Brown Feb. 6, 2025

Feb. 6, 2025

I'm working on setting up MailMan 3 on an Ubuntu 24.04 LTS server. I've got everything running and working with docker-mailman. Now I'm looking at configuring ARC and am a bit lost. How is ARC configured in a mailman3 with multiple domains? Do I set it up to use the hostname of the server Mailman is running on? Thanks for any assistance, --[Lance]

2 4

Moderation action "None" is misleading
by Markus Grandpré Feb. 5, 2025

Feb. 5, 2025

Dear List, I find the use of the term 'None' (or 'Kein' in the German translation; see attachments) in the 'Moderation action' column of the member list misleading, as the term suggests that no moderation action is applied to the respective member. However, this is not necessarily the case. If you check a member’s "Administration options / Moderation" setting, a moderation action, such as "Moderation" or "List default", may be in effect. I suggest that the 'Moderation action' column should display the currently set value of the 'Administration options / Moderation' setting for each member. Since some of our mailing lists frequently add and remove thousands of members, manually adjusting this setting for each member would not be practical. Best regards, Markus Grandpré -- Markus Ludwig Grandpré Universität Konstanz Kommunikations-, Informations-, Medienzentrum (KIM) Abteilung IT-Dienste Forschung und Lehre, B803, Tel: ++49 7531 88 4342 ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Content-Type: image/png Name: mm3_memberlist_de.png Content-Type: image/png Name: mm3_memberlist_en.png

3 4

Mailman shutting down Hyperkitty: Request too large
by Arte Chambers Feb. 2, 2025

Feb. 2, 2025

Hello I need help troubleshooting a problem with MM. The service is stopping and throwing this error in the mailman log "Exception in the HyperKitty archiver: 413 Request Entity Too Large" I'm not sure what my next steps should be to troubleshoot this issue. System CTL has this message and i'm not sure if it's relevant to the issue. ``` >sudo systemctl status mailman3.service systemd[1]: mailman3.service: Can't open PID file /opt/mailman/mm/var/master.pid (yet?) after start: No such file or directory ``` The MM Service will run for a while then shuts down. /mailman.log ``` Jan 30 05:22:20 2025 (1547) HyperKitty failure on https://list.louisvillecommunitygrocery.com/archives/api/mailman/archive: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx/1.24.0 (Ubuntu)</center> </body> </html> (413) Jan 30 05:22:20 2025 (1547) Could not archive the message with id < CAPesOD3EWaFzfVZAbUzFm3Vk3Xnqcf9KodVic6agaT27Kmhy0w(a)mail.gmail.com> Jan 30 05:22:20 2025 (1547) archiving failed, re-queuing (mailing-list lcg-board-private.list.louisvillecommunitygrocery.com, message < CAPesOD3EWaFzfVZAbUzFm3Vk3Xnqcf9KodVic6agaT27Kmhy0w(a)mail.gmail.com>) Jan 30 05:22:20 2025 (1547) Exception in the HyperKitty archiver: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx/1.24.0 (Ubuntu)</center> </body> </html> Jan 30 05:22:20 2025 (1547) Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/mailman_hyperkitty/__init__.py", line 158, in _archive_message url = self._send_message(mlist, msg) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman_hyperkitty/__init__.py", line 228, in _send_message raise ValueError(result.text) ValueError: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx/1.24.0 (Ubuntu)</center> </body> </html> Jan 30 05:22:21 2025 (1547) HyperKitty archived message <CAPesOD25frujqYsAXU3kk8MUOY=h3ZV4cgzUXSi9L0c3K2W0NQ(a)mail.gmail.com> to https://list.louisvillecommunitygrocery.com/archives/list/testing@list.loui… [30/Jan/2025:05:22:43 +0000] "GET /3.1/users/lcgcoop(a)gmail.com HTTP/1.1" 200 428 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:43 +0000] "GET /3.1/users/a6af988d603c49c9ac61a3a41562d132/addresses HTTP/1.1" 200 927 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:43 +0000] "POST /3.1/members/find HTTP/1.1" 200 3407 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:43 +0000] "POST /3.1/members/find HTTP/1.1" 200 4705 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:43 +0000] "GET /3.1/addresses/lcgcoop(a)gmail.com HTTP/1.1" 200 401 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:43 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:43 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com/roster/owner HTTP/1.1" 200 763 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:22:44 +0000] "GET /3.1/addresses/lcgcoop(a)gmail.com HTTP/1.1" 200 401 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:23:53 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:23:53 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:23:53 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:23:53 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [30/Jan/2025:05:24:15 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" Jan 30 05:42:54 2025 (1550) ACCEPT: <008401db72ce$cb6d50d0$6247f270$@ iglou.com> Jan 30 05:42:55 2025 (1547) HyperKitty failure on https://list.louisvillecommunitygrocery.com/archives/api/mailman/archive: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx/1.24.0 (Ubuntu)</center> </body> </html> (413) Jan 30 05:42:55 2025 (1547) Could not archive the message with id < CAPesOD3EWaFzfVZAbUzFm3Vk3Xnqcf9KodVic6agaT27Kmhy0w(a)mail.gmail.com> Jan 30 05:42:55 2025 (1547) archiving failed, re-queuing (mailing-list lcg-board-private.list.louisvillecommunitygrocery.com, message < CAPesOD3EWaFzfVZAbUzFm3Vk3Xnqcf9KodVic6agaT27Kmhy0w(a)mail.gmail.com>) Jan 30 05:42:55 2025 (1547) Exception in the HyperKitty archiver: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx/1.24.0 (Ubuntu)</center> </body> </html> Jan 30 05:42:55 2025 (1547) Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/mailman_hyperkitty/__init__.py", line 158, in _archive_message url = self._send_message(mlist, msg) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman_hyperkitty/__init__.py", line 228, in _send_message raise ValueError(result.text) ValueError: <html> <head><title>413 Request Entity Too Large</title></head> <body> <center><h1>413 Request Entity Too Large</h1></center> <hr><center>nginx/1.24.0 (Ubuntu)</center> </body> </html> Jan 30 05:42:57 2025 (1547) HyperKitty archived message <008401db72ce$cb6d50d0$6247f270$(a)iglou.com> to https://list.louisvillecommunitygrocery.com/archives/list/lcg-board-private… [2025-01-30 05:46:02 +0000] [1554] [ERROR] Worker (pid:1586) was sent SIGKILL! Perhaps out of memory? [2025-01-30 05:46:02 +0000] [2227] [INFO] Booting worker with pid: 2227 Jan 30 05:46:09 2025 (1553) pipeline runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1553) pipeline runner exiting. Jan 30 05:46:09 2025 (1551) lmtp runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1551) lmtp runner exiting. Jan 30 05:46:09 2025 (1558) digest runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1558) digest runner exiting. Jan 30 05:46:09 2025 (1557) virgin runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1557) virgin runner exiting. Jan 30 05:46:09 2025 (1556) task runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1556) task runner exiting. Jan 30 05:46:09 2025 (1541) Master watcher caught SIGTERM. Exiting. Jan 30 05:46:09 2025 (1555) retry runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1555) retry runner exiting. Jan 30 05:46:09 2025 (1552) out runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1552) out runner exiting. Jan 30 05:46:09 2025 (1549) command runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1549) command runner exiting. Jan 30 05:46:09 2025 (1548) bounces runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1548) bounces runner exiting. Jan 30 05:46:09 2025 (1547) archive runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1547) archive runner exiting. Jan 30 05:46:09 2025 (1550) in runner caught SIGTERM. Stopping. Jan 30 05:46:09 2025 (1550) in runner exiting. [2025-01-30 05:46:09 +0000] [1554] [INFO] Handling signal: term [2025-01-30 05:46:09 +0000] [2227] [INFO] Worker exiting (pid: 2227) [2025-01-30 05:46:09 +0000] [1585] [INFO] Worker exiting (pid: 1585) Jan 30 05:46:10 2025 (1541) Master watcher caught SIGTERM. Exiting. [2025-01-30 05:46:10 +0000] [1554] [ERROR] Worker (pid:1585) was sent SIGKILL! Perhaps out of memory? [2025-01-30 05:46:10 +0000] [1554] [ERROR] Worker (pid:2227) was sent SIGTERM! [2025-01-30 05:46:10 +0000] [1554] [INFO] Shutting down: Master Jan 30 05:46:11 2025 (1541) Master stopped ``` Thank you, Paul 'Arte Chambers' Robey 502-408-6922

3 13

The paradox of VERP probe messages
by Jeremy Stanley Feb. 2, 2025

Feb. 2, 2025

tl;dr: Is there a way to have VERP probe messages not include copies of the bounce message that triggered them? Longer form... Some months ago I turned on bounce processing for a fairly large list with a long history, because I could see from the MTA logs that there were easily hundreds of old subscribers whose addresses had become defunct and this seemed like a great way to clean that up and make the server more conscientious at not repeatedly trying to deliver messages to sites that were just going to reject them. This worked really well. Until legitimate subscribers also started to get removed, that is, due primarily to false positives from overzealous spam filters. I had previously read about MM3's VERP probe message feature, which seemed to solve the main reason I had kept bounce processing disabled in the MM2 days, and thought it was on by default but clearly it wasn't. So I found the necessary config option and switched that on. This worked really well. Until legitimate subscribers started to get removed again, that is, due primarily to false positives from overzealous spam filters. See, I realized that the VERP probes were helpfully including copies of the most recent bounce for that user, and those NDRs quite often helpfully included their own copies of the messages which had been bounced. So if a subscriber's MTA was rejecting a message because the content looked like spam, then there was a good chance it would also reject the VERP probe message because it included the same content which had caused the earlier rejection. The VERP probe feature was essentially defeating its own purpose as a neutral confirmation that the subscriber hadn't been rejecting messages due to their content. This behavior raises a more significant concern as well. The MTA on the Mailman server in this case (Exim if it matters) wants to perform batch deliveries when there are multiple subscribers who all share the same remote MTAs. If multiples of those reject a list post, then the NDR back to Mailman aggregates those multiple rejections into a single message. If that incident triggers a VERP probe, the bulk NDR enumerating the addresses of all the subscribers who were rejected gets forwarded along as part of the VERP probe, disclosing a potentially sensitive litany of random subscriber addresses to other subscribers within that batch. I don't know whether this is a misconfiguration, or an unintended consequence of the intersection of Mailman and MTA features. While I understand that the inclusion of a bounce sample within a VERP probe may be a way to take some workload off list admins in that users can possibly see a message/rejection to explain the reason for the probe, the downsides of that choice make the feature unfortunately unusable for some lists that could otherwise have benefited from it. Am I possibly missing an existing switch that could make VERP probe messages *not* include copies of the bounces that triggered them? This is in some ways similar to the problems I've noticed with message hold notifications to moderators including copies of the held messages, since these are (at least in the case of the lists I manage) often spam, so has a tendency to cause the mail providers for the list moderators to start considering the mailing list server a spam source. If there were a switch to make message hold notifications to moderators *not* include copies of the messages themselves, I'd start allowing moderator notifications again. Suggestions welcome! Also willing to try to submit patches to enable some of these solutions if they don't already exist. And thanks to anyone who read this far! -- Jeremy Stanley

2 4

Outgoing runner lockup? + "slice inspector" tool
by Stephen J. Turnbull Feb. 1, 2025

Feb. 1, 2025

Hi, I'm advising a user on a system which experiences occasional lockups in an outgoing runner. The runner contacts a remote smarthost, and occasionally locks up with the smtp connection still open according to "lsof -i :25". This state seems to be permanent: the backlog for that slice starts to grow without bound, for at least an hour. When this was happening once a month, they would just restart Mailman core, and the backlog would clear in minutes. But recently it's been happening daily which is distracting their staff, and worries me. Another thing that is strange about this site is that it should be possible to hit that runner with a SIGUSR1 and restart it. This works for me, but on that system the stuck runner exits, but does not restart. Since normally it only happens to one runner of several, I wanted to identify the runner and process. I attach the tool I developed, for anyone who might have configured multiple runners and is interested to see the distribution across runners. Has anybody seen an outgoing runner lock up with an open smtp session? Any ideas on why? My analysis so far: - Because a restart works every time, I'm pretty sure it doesn't have anything to do with message content. - I believe both the Mailman host and the outgoing smarthost are Linodes, in the same datacenter. The problematic Mailman system is Mailman 3.3.6, Python 3.10 on Ubuntu 16.xx LTS. I believe the smarthost is a more recent Ubuntu LTS, probably running Postfix 3.7 as the MTA. (Yes, they have sufficiently paranoid security and QA teams. ;-) - We're using smtplib, which as far as I can tell basically has a 60s timeout for each command. Thus you'd think it would time out. I guess it could be inflooping on timeout, retry, timeout, retry, but I don't know how to check that. Maybe ss(8) will serve? - My system where SIGUSR1 works as documented is Python 3.11.2 on a Digital Ocean droplet with Debian 12.9, Linux 6.1.0. - I haven't tried to reproduce the Python 3.10 + Mailman 3.3.6 configuration and test SIGUSR1 in that configuration yet. Seems unlikely, waiting for the proverbial "round tuit". - It has occurred to us to use the local Postfix as the relay MTA. I'm waiting on a report whether that alleviates the problem. Even if so, I want to fix the underlying defect if possible. Any ideas would be welcome, including general debugging advice. Here's the promised slice_inspector tool. (Patches and suggestions welcome, though I don't promise to implement any time soon.) The tool imports some files from Mailman core, click, and psutil (not psutils!) I believe the latter modules are required by Mailman, so you should be able to run it as is under the 'mailman' user (or perhaps 'list' on Debian) in the environment Mailman itself uses. It defaults to assuming that mailman.cfg is /etc/mailman3/mailman.cfg. You'll probably need to fix the shebang if you want to chmod +x. The '--help' should be pretty self-explanatory. Steve

2 1

messages with attachments, without text discarded silently
by Schulz Feb. 1, 2025

Feb. 1, 2025

Using the current mailman version, I can reproduce the following: - send a text-formatted email with attachment but without text body to a list. - the msg will be received by mailman - the msg shows up in shunt, the log shows: ile "/usr/lib/python3.12/email/message.py", line 343, in set_payload payload = payload.encode(charset.output_charset, 'surrogateescape') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ UnicodeEncodeError: 'ascii' codec can't encode characters in position 10-17: ordinal not in range(128) an attempt to unpickle the file leads to the same error. I know it's uncommon to send emails without txt but with attachments - but it may happen; at least we would welcome an error message.

2 3

Occasionally "The content of this message was lost."
by Frank Richter Jan. 30, 2025

Jan. 30, 2025

Hello, occasionally we face the problem "The content of this message was lost." when handling a message on hold. We use the mailman3 packages on Debian 12: 3.3.8-2~deb12u2 GNU Mailman 3.3.8 (Tom Sawyer) Python 3.11.2 (main, Nov 30 2024, 21:22:50) [GCC 12.2.0] with postgresql, exim and Apache httpd on the same machine. To get closer to this problem we made 2 changes: /usr/lib/python3/dist-packages/mailman/app/moderator.py def _lost_message(mlist, subject, sender, message_id): # Create a substitute for a message not found in the message store. text = _("""\ The content of this message was lost. It was probably cross-posted to multiple lists and previously handled on another list. """) + # Don’t send an empty message to all members in case this event occurs. + # raise an exception instead: + raise Exception("_lost_message",subject, sender, message_id) /usr/lib/python3/dist-packages/mailman/runners/task.py def _evict_pendings(self): … messages = getUtility(IMessageStore) for msg in messages.messages: # msg can be None if file is already removed. if msg is not None: mid = msg.get('message-id') if mid not in mids: messages.delete_message(mid) # 2024-12-11 fri: Debug inserted + tlog.debug('Task runner deleted message %s', mid) count += 1 tlog.info('Task runner deleted %d orphaned messages', count) So let’s see what happens: A message sent to one list is set on hold: exim mainlog: 2025-01-28 14:10:23 1tclMF-00H6cW-1s <= user(a)s2024.tu-chemnitz.de H=vittal.hrz.tu-chemnitz.de (mail.tu-chemnitz.de) [2001:638:911:b01:134:109:133:32] P=esmtps X=TLS1.3:ECDHE_SECP256R1__RSA_PSS_RSAE_SHA256__AES_256_GCM:256 CV=no K S=9058 id=2f972b-6798d700-9f-5b841500@14907502 2025-01-28 14:10:23 1tclMF-00H6cW-1s => fsr-hsw(a)lists.tu-chemnitz.de R=lists_mailman T=mailman3_transport H=localhost [::1] C="250 Ok" 2025-01-28 14:10:23 1tclMF-00H6cW-1s Completed vette.log Jan 28 14:10:24 2025 (2602) HOLD: fsr-hsw(a)lists.tu-chemnitz.de post from user(a)s2024.tu-chemnitz.de held, message-id=<2f972b-6798d700-9f-5b841500@14907502>: The message is not from a list member A task runner deleted the message 5 seconds later: task.log Jan 28 14:10:29 2025 (2609) Task runner deleted message <2f972b-6798d700-9f-5b841500@14907502> Jan 28 14:10:29 2025 (2609) Task runner deleted 1 orphaned messages Later an owner/moderator want to do a moderation action: mailman.log: 2025-01-28 17:40:54 [FALCON] [ERROR] POST /3.1/lists/fsr-hsw(a)lists.tu-chemnitz.de/held/7544 => Traceback (most recent call last): File "falcon/app.py", line 365, in falcon.app.App.__call__ File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 155, in on_post handle_message(self._mlist, request_id, **arguments) File "/usr/lib/python3/dist-packages/mailman/app/moderator.py", line 144, in handle_message msg = _lost_message(mlist, subject, sender, message_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/app/moderator.py", line 104, in _lost_message raise Exception("_lost_message",subject, sender, message_id) Exception: ('_lost_message', 'Re: [Fsr-hsw] ...', 'user(a)s2024.tu-chemnitz.de', '<2f972b-6798d700-9f-5b841500@14907502>') Do you have any suggestions what we can do to find the reason, why the task runner deletes the message? Or any other hints … Thanks and kind regards Frank -- Frank Richter, Chemnitz University of Technology, Germany

2 1

No recent activity discussions and activity overview shown. Only a spinning wheel.
by Freerk Bosscha Jan. 30, 2025

Jan. 30, 2025

I have tried to find an equal issue, but could not find it. If so, sorry for the doubling... I have recently setup a fresh mailman3 installation on my debian12 box. It works fine. The only thing which is not working is in the archive overview I see a spinning wheel. The participants and number of discussions is increasing and the archive files are getting the archived messages. mailman -info shows: GNU Mailman 3.3.8 (Tom Sawyer) Python 3.11.2 (main, Nov 30 2024, 21:22:50) [GCC 12.2.0] config file: /etc/mailman3/mailman.cfg db url: mysql+pymysql://.....:....@localhost/mailman3?charset=utf8mb4&use_unicode=1 devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:....... mailman-web qinfo shows: -- Default 1.3.9 on ORM default -- Clusters 0 Workers 0 Restarts 0 Queued 0 Successes 100 Failures 0 Schedules 0 Tasks/day 14.00 Avg time 0.1756 Webserver: apache2/2.4.64 It looks like a AJAX problem, but not sure about that. Any help would be appriciated. Freerk What is missing

4 7

Adding Mass Subscribe custom template error
by Arte Chambers Jan. 29, 2025

Jan. 29, 2025

I am trying to test some different templates however after adding a new template I get an error when adding new list members. The member is added to the list however the welcome message isn't sent to the user. I'm getting the following error when using mass subscription on a testing list with a custom template loaded for [list:user:notice:welcome] ``` HTTP Error 400: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) ``` The template has the text "Testing Template" I'm not sure why it's timing out but when I remove the custom template it works as expected. The user is added to the list however doesn't get the custom welcome message. mailman.log: ``` [28/Jan/2025:20:22:47 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" Jan 28 20:22:52 2025 (1977989) deque: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connection.py", line 507, in getresponse httplib_response = super().getresponse() ^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 1428, in getresponse response.begin() File "/usr/lib/python3.12/http/client.py", line 331, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 292, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/socket.py", line 707, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: timed out The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 667, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 843, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment raise reraise(type(error), error, _stacktrace) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise raise value File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 789, in urlopen response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 538, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 369, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() ^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/subscriptions.py", line 362, in _step_do_subscription self.member = self.mlist.subscribe( ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/mailinglist.py", line 540, in subscribe notify(SubscriptionEvent( File "/opt/mailman/venv/lib/python3.12/site-packages/zope/event/__init__.py", line 33, in notify subscriber(event) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/membership.py", line 183, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/notifications.py", line 77, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 192, in get contents = getUtility(ITemplateManager).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 114, in get contents = protocols.get(actual_uri, **auth) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/utilities/protocols.py", line 39, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 73, in get return request("get", url, params=params, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 59, in request return session.request(method=method, url=url, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 713, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) Jan 28 20:22:52 2025 (1977989) HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connection.py", line 507, in getresponse httplib_response = super().getresponse() ^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 1428, in getresponse response.begin() File "/usr/lib/python3.12/http/client.py", line 331, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 292, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/socket.py", line 707, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: timed out The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 667, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 843, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment raise reraise(type(error), error, _stacktrace) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise raise value File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 789, in urlopen response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 538, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 369, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/rest/members.py", line 385, in on_post token, token_owner, member = registrar.register( ^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/subscriptions.py", line 584, in register list(workflow) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() ^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/subscriptions.py", line 362, in _step_do_subscription self.member = self.mlist.subscribe( ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/mailinglist.py", line 540, in subscribe notify(SubscriptionEvent( File "/opt/mailman/venv/lib/python3.12/site-packages/zope/event/__init__.py", line 33, in notify subscriber(event) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/membership.py", line 183, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/notifications.py", line 77, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 192, in get contents = getUtility(ITemplateManager).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 114, in get contents = protocols.get(actual_uri, **auth) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/utilities/protocols.py", line 39, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 73, in get return request("get", url, params=params, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 59, in request return session.request(method=method, url=url, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 713, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) [28/Jan/2025:20:22:52 +0000] "POST /3.1/members HTTP/1.1" 400 128 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:22:52 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:22:52 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" ``` Thank you, Paul 'Arte Chambers' Robey 502-408-6922

3 9

mailman3-web postorious error "invalid request block size: 14056 (max 4096)...skip"
by Frederik Jan. 28, 2025

Jan. 28, 2025

Until about one month ago, I had mailman3 and mailman3-web successfully running on Debian 12. However, when I access any page such as https://example.com/mailman3/postorius/lists/ now, I just get a 500 server error. /var/log/mailman3/web/mailman-web.log logs this at every request: invalid request block size: 14056 (max 4096)...skip I read somewhere that adding buffer-size = 65536 to uwsgi.ini might help. It indeed makes a difference, but unfortunately I just get another error instead: [pid: 4067215|app: -1|req: -1/1] () {256 vars in 14055 bytes} [Tue Jan 28 18:06:30 2025] => generated 0 bytes in 0 msecs ( 500) 0 headers in 0 bytes (1 switches on core 0) There are no other errors in the logs. I proxy mailman in Apache like this: Alias /mailman3/favicon.ico /var/lib/mailman3/web/static/postorius/img/favicon.ico Alias /mailman3/static /var/lib/mailman3/web/static <Directory "/var/lib/mailman3/web/static"> Require all granted </Directory> <IfModule mod_proxy_uwsgi.c> ProxyPass /mailman3/favicon.ico ! ProxyPass /mailman3/static ! ProxyPass /mailman3 unix:/run/mailman3-web/uwsgi.sock|uwsgi://localhost-mailman3/ </IfModule> and mailman3's uwsgi.ini looks like this: [uwsgi] uwsgi-socket = /run/mailman3-web/uwsgi.sock enable-threads = true chdir = /usr/share/mailman3-web wsgi-file = wsgi.py master = true process = 2 threads = 2 uid = www-data gid = www-data env = HOME=/tmp plugins = python3 attach-daemon = python3 manage.py qcluster logto = /var/log/mailman3/web/mailman-web.log buffer-size = 65536 Any idea what could be wrong or how to debug this further? I'm using mailman3-full 3.3.8-2~deb12u2 and mailman3-web 0+20240312-1 packages.

2 1

Filter response from Mailman3 held messages queue.
by Andy Matthews Jan. 28, 2025

Jan. 28, 2025

I'm working on an update to a portion of my team's application. It retrieves the held messages from Mailman and returns them to the client so that our admins can approve/reject them. At the moment it works as intended, but displays far too much information because Mailman is returning the entire email, with headers (see below). I've found some libraries which can parse the message property and extract the relevant bits, but I'd rather pass some sort of flag or filter to the initial Mailman 3 API call and get back less information. I've looked through the documentation but I'm not finding anything of the sort. Would this be useful? ``` { "request_id": "1", "original_size": 855, "sender": "dev(a)email.org", "subject": "Testing one two three", "hold_date": new Date(), "msg": "Received: from [127.0.0.1] (localhost [127.0.0.1])\n\t(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)\n\t key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)\n\t(No client certificate requested)\n\t(Authenticated sender: dev(a)email.org)\n\tby mailman.default.svc.cluster.local (Postfix) with ESMTPSA id A48A33E9849\n\tfor <abc-announce(a)email.org>; Thu, 23 Jan 2025 21:24:11 +0000 (UTC)\nMessage-ID: <3ecbaccf-f65a-4ce5-bdfa-e08b5659dc32(a)email.org>\nDate: Thu, 23 Jan 2025 15:24:11 -0600\nMIME-Version: 1.0\nUser-Agent: Mozilla Thunderbird\nContent-Language: en-US\nTo: abc-announce(a)email.org\nFrom: Dev Tester <dev(a)email.org>\nSubject: Testing one two three\nContent-Type: text/plain; charset=UTF-8; format=flowed\nContent-Transfer-Encoding: 7bit\nX-MailFrom: dev(a)email.org\nX-Mailman-Rule-Hits: nonmember-moderation\nX-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation\nMessage-ID-Hash: XM4OS47LU7DRYIO74WB5K4W345NPZ37O\nX-Message-ID-Hash: XM4OS47LU7DRYIO74WB5K4W345NPZ37O\n\nThis is a single line message body.\n\n" } ```

2 2

Mailman3 breaking DKIM signatures
by Jef Driesen Jan. 24, 2025

Jan. 24, 2025

Hi, I have configured a mailman3 mailinglist to not modify the headers and body (e.g. no footer, no subject prefix, etc) to avoid breaking DKIM signatures. This worked well, until I encountered an email where the DKIM signature was still broken. After some debugging, the problem is caused by an attachment, where the mime header is changed by mailman3. The original mail contains this: --------------nYYjj8vJ8CNKuoHJZKVOQh20 Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="filename.xlsx" Content-Disposition: attachment; filename="filename.xlsx" Content-Transfer-Encoding: base64 Mailman3 modified these into this: --------------nYYjj8vJ8CNKuoHJZKVOQh20 Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="filename.xlsx" Content-Disposition: attachment; filename="filename.xlsx" Content-Transfer-Encoding: base64 The Content-Type header is modified (word-wrapped), and this breaks the DKIM signature. How can I prevent this from happening and configure mailman to not modify the email? Jef

5 6

Python 3.13 compatibility
by peter＠chubb.wattle.id.au Jan. 24, 2025

Jan. 24, 2025

Hi Folks, I'm running the Debian-packaged mailman3 (version 3.8) which is a little behind the current 3.9 release ... Debian is now shipping Python 3.13 in 'sid'. https://docs.python.org/3/whatsnew/3.13.html#id4 says: Remove the ability to use Path objects as context managers. This functionality was deprecated and has had no effect since Python 3.9. (Contributed by Barney Gale in gh-83863.) As a result, I'm hitting tracebacks from many operations where pathlib.Path objects are used as context managers, like this one: path, fp = find(default_uri, mlist, code) ~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/utilities/i18n.py", line 157, in find for search_path in raw_search_order: ^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/utilities/i18n.py", line 117, in search templates_dir = str(resources.enter_context( ~~~~~~~~~~~~~~~~~~~~~~~^ files('mailman').joinpath('templates'))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 528, in enter_context raise TypeError(f"'{cls.__module__}.{cls.__qualname__}' object does " f"not support the context manager protocol") from None TypeError: 'pathlib._local.PosixPath' object does not support the context manager protocol Given that the python3.13 change is only to move a noop to an exception, it may be that this is a bug for python 3.9 and up as well. Peter C

2 1

m3 database sizing
by Alexander Inzinger-Zrock Jan. 23, 2025

Jan. 23, 2025

Ahoi, has anyone A) spent thoughts (and is willing to share them) about database sizing for an mailman3-production-system? like: space per user + other data + estimated growth = warning to give to my database-admin or B) has some empirical values and would like to share? greetings aiz P.S. this post is related to another about database contents

3 3

m3 database contents
by Alexander Inzinger-Zrock Jan. 22, 2025

Jan. 22, 2025

Ahoi, except for [1] i was not able to find anything about what kind of data will be stored in the database(s) of a mailman3-system. could somebody kindly point me to some documentation i perhaps missed out? or share some insights? greetings aiz P.S. this post is related to another about database sizing [1] https://docs.mailman3.org/en/latest/architecture.html#understanding-user-an…

2 1

Hyperkitty not receaving messages / empty archive [Django] ERROR (EXTERNAL IP): Internal Server Error: /hyperkitty/api/mailman/urls
by Helge Baumgart Jan. 22, 2025

Jan. 22, 2025

Hello Everybody, i have set up a fresh mailman3 installation with maxkings Docker compose image (https://github.com/maxking/docker-mailman) I've got it working except i get a very strange hyperkitty error: Each time i'm sending a post to the list, it gets distributed to the emailadresses of the list, and at the same time i'm geting a bunch of error Mails. And: There are no Mails visible in the Archive. The directory under core/var/archive/hyperkitty/spool/ listst the mails....though... Hyperkitty-Api-Key in the docker-compose.yml is set via .env Variabel, so it should be identical. That ist the error Mail i receive: Can annybody hint me where to search further, what is wrong? If searched insesivly but found nothing as of jet.... :-( Thank you in advance! Helge Internal Server Error: /hyperkitty/api/mailman/urls TypeError at /hyperkitty/api/mailman/urls unsupported operand types(s) or combination of types: 'str' and 'NoneType' Request Method: GET Request URL:http://mailman-web:8000/hyperkitty/api/mailman/urls?mlist=test%40lists.mydomain.net&msgid=2291673b-c760-4651-8025-ae170429d587%40web.de Django Version: 4.1.12 Python Executable: /usr/bin/uwsgi Python Version: 3.11.6 Python Path: ['.', '', '/usr/lib/python311.zip', '/usr/lib/python3.11', '/usr/lib/python3.11/lib-dynload', '/usr/lib/python3.11/site-packages'] Server time: Tue, 21 Jan 2025 13:12:13 +0000 Installed Applications: ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora', 'allauth.socialaccount.providers.openid', 'allauth.socialaccount.providers.github', 'allauth.socialaccount.providers.gitlab', 'allauth.socialaccount.providers.google'] Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'allauth.account.middleware.AccountMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback (most recent call last): File "/usr/lib/python3.11/site-packages/django/core/handlers/exception.py", line 56, in inner response = get_response(request) File "/usr/lib/python3.11/site-packages/django/core/handlers/base.py", line 197, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3.11/site-packages/hyperkitty/views/mailman.py", line 109, in _decorator not hmac.compare_digest( Exception Type: TypeError at /hyperkitty/api/mailman/urls Exception Value: unsupported operand types(s) or combination of types: 'str' and 'NoneType' Raised during: hyperkitty.views.mailman.urls Request information: USER: AnonymousUser GET: mlist = 'test(a)lists.mydomain.net' msgid = '2291673b-c760-4651-8025-ae170429d587(a)web.de' POST: No POST data FILES: No FILES data COOKIES: No cookie data META: HTTP_ACCEPT = '*/*' HTTP_ACCEPT_ENCODING = 'gzip, deflate' HTTP_AUTHORIZATION = 'Token 3ezHkyhUqlD0qB2LiLb4xORyuVFCwimlVZidlOk7XJqjy9QBaNM6O0w4aSR162bN2tIFMdWFKOpfQ1Zq5QYrrVE4IsNFGvkLfGwbf58uENJmUD2yvA0pGXTlvLc3KFD1' HTTP_CONNECTION = 'keep-alive' HTTP_HOST = 'mailman-web:8000' HTTP_USER_AGENT = 'python-requests/2.31.0' PATH_INFO = '/hyperkitty/api/mailman/urls' QUERY_STRING = 'mlist=test%40lists.mydomain.net&msgid=2291673b-c760-4651-8025-ae170429d587%40web.de' REMOTE_ADDR = '172.26.0.2' REQUEST_METHOD = 'GET' REQUEST_URI = '/hyperkitty/api/mailman/urls?mlist=test%40lists.mydomain.net&msgid=2291673b-c760-4651-8025-ae170429d587%40web.de' SCRIPT_NAME = '' SERVER_NAME = 'mailman-web' SERVER_PORT = '8000' SERVER_PROTOCOL = 'HTTP/1.1' uwsgi.core = 1 uwsgi.node = b'mailman-web' uwsgi.version = b'2.0.22' wsgi.errors = <_io.TextIOWrapper name=2 mode='w' encoding='UTF-8'> wsgi.file_wrapper = <built-in function uwsgi_sendfile> wsgi.input = <uwsgi._Input object at 0x790fb0ef82b0> wsgi.multiprocess = True wsgi.multithread = True wsgi.run_once = False wsgi.url_scheme = 'http' wsgi.version = '(1, 0)' Settings: Using settings module settings ABSOLUTE_URL_OVERRIDES = {} ACCOUNT_AUTHENTICATION_METHOD = 'username_email' ACCOUNT_DEFAULT_HTTP_PROTOCOL = 'https' ACCOUNT_EMAIL_REQUIRED = True ACCOUNT_EMAIL_VERIFICATION = 'mandatory' ACCOUNT_UNIQUE_EMAIL = True ADMINS = "(('Mailman Suite Admin', 'it(a)mydomain.net'),)" ALLOWED_HOSTS = ['localhost', 'mailman-web', '172.26.0.3', 'lists.mydomain.net', 'lists.mydomain.net'] APPEND_SLASH = True AUTHENTICATION_BACKENDS = "('django.contrib.auth.backends.ModelBackend', 'allauth.account.auth_backends.AuthenticationBackend')" AUTH_PASSWORD_VALIDATORS = '********************' AUTH_USER_MODEL = 'auth.User' BASE_DIR = '/opt/mailman-web' CACHES = {'default': {'BACKEND': 'diskcache.DjangoCache', 'LOCATION': '/opt/mailman-web-data/diskcache', 'OPTIONS': {'size_limit': 1073741824}}} CACHE_MIDDLEWARE_ALIAS = 'default' CACHE_MIDDLEWARE_KEY_PREFIX = '********************' CACHE_MIDDLEWARE_SECONDS = 600 COMPRESSORS = {'css': 'compressor.css.CssCompressor', 'js': 'compressor.js.JsCompressor'} COMPRESS_CACHEABLE_PRECOMPILERS = '()' COMPRESS_CACHE_BACKEND = 'default' COMPRESS_CACHE_KEY_FUNCTION = '********************' COMPRESS_CLEAN_CSS_ARGUMENTS = '' COMPRESS_CLEAN_CSS_BINARY = 'cleancss' COMPRESS_CLOSURE_COMPILER_ARGUMENTS = '' COMPRESS_CLOSURE_COMPILER_BINARY = 'java -jar compiler.jar' COMPRESS_CSS_HASHING_METHOD = 'mtime' COMPRESS_DATA_URI_MAX_SIZE = 1024 COMPRESS_DEBUG_TOGGLE = None COMPRESS_ENABLED = True COMPRESS_FILTERS = {'css': ['compressor.filters.css_default.CssAbsoluteFilter', 'compressor.filters.cssmin.rCSSMinFilter'], 'js': ['compressor.filters.jsmin.rJSMinFilter']} COMPRESS_JINJA2_GET_ENVIRONMENT = <function CompressorConf.JINJA2_GET_ENVIRONMENT at 0x790fb2323420> COMPRESS_MINT_DELAY = 30 COMPRESS_MTIME_DELAY = 10 COMPRESS_OFFLINE = False COMPRESS_OFFLINE_CONTEXT = {'STATIC_URL': '/static/'} COMPRESS_OFFLINE_MANIFEST = 'manifest.json' COMPRESS_OFFLINE_MANIFEST_STORAGE = 'compressor.storage.OfflineManifestFileStorage' COMPRESS_OFFLINE_TIMEOUT = 31536000 COMPRESS_OUTPUT_DIR = 'CACHE' COMPRESS_PARSER = 'compressor.parser.AutoSelectParser' COMPRESS_PRECOMPILERS = "(('text/less', 'lessc {infile} {outfile}'), ('text/x-scss', 'sassc -t compressed {infile} {outfile}'), ('text/x-sass', 'sassc -t compressed {infile} {outfile}'))" COMPRESS_REBUILD_TIMEOUT = 2592000 COMPRESS_ROOT = '/opt/mailman-web-data/static' COMPRESS_STORAGE = 'compressor.storage.CompressorFileStorage' COMPRESS_TEMPLATE_FILTER_CONTEXT = {'STATIC_URL': '/static/'} COMPRESS_URL = '/static/' COMPRESS_URL_PLACEHOLDER = '/__compressor_url_placeholder__/' COMPRESS_VERBOSE = False COMPRESS_YUGLIFY_BINARY = 'yuglify' COMPRESS_YUGLIFY_CSS_ARGUMENTS = '--terminal' COMPRESS_YUGLIFY_JS_ARGUMENTS = '--terminal' COMPRESS_YUI_BINARY = 'java -jar yuicompressor.jar' COMPRESS_YUI_CSS_ARGUMENTS = '' COMPRESS_YUI_JS_ARGUMENTS = '' CSRF_COOKIE_AGE = 31449600 CSRF_COOKIE_DOMAIN = None CSRF_COOKIE_HTTPONLY = False CSRF_COOKIE_MASKED = False CSRF_COOKIE_NAME = 'csrftoken' CSRF_COOKIE_PATH = '/' CSRF_COOKIE_SAMESITE = 'Lax' CSRF_COOKIE_SECURE = False CSRF_FAILURE_VIEW = 'django.views.csrf.csrf_failure' CSRF_HEADER_NAME = 'HTTP_X_CSRFTOKEN' CSRF_TRUSTED_ORIGINS = [] CSRF_USE_SESSIONS = False DATABASES = {'default': {'NAME': 'mailmandb', 'USER': 'mailman', 'PASSWORD': '********************', 'HOST': 'database', 'PORT': '', 'CONN_MAX_AGE': 600, 'CONN_HEALTH_CHECKS': False, 'ENGINE': 'django.db.backends.postgresql', 'ATOMIC_REQUESTS': False, 'AUTOCOMMIT': True, 'OPTIONS': {}, 'TIME_ZONE': None, 'TEST': {'CHARSET': None, 'COLLATION': None, 'MIGRATE': True, 'MIRROR': None, 'NAME': None}}} DATABASE_ROUTERS = [] DATA_UPLOAD_MAX_MEMORY_SIZE = 2621440 DATA_UPLOAD_MAX_NUMBER_FIELDS = 1000 DATA_UPLOAD_MAX_NUMBER_FILES = 100 DATETIME_FORMAT = 'N j, Y, P' DATETIME_INPUT_FORMATS = ['%Y-%m-%d %H:%M:%S', '%Y-%m-%d %H:%M:%S.%f', '%Y-%m-%d %H:%M', '%m/%d/%Y %H:%M:%S', '%m/%d/%Y %H:%M:%S.%f', '%m/%d/%Y %H:%M', '%m/%d/%y %H:%M:%S', '%m/%d/%y %H:%M:%S.%f', '%m/%d/%y %H:%M'] DATE_FORMAT = 'N j, Y' DATE_INPUT_FORMATS = ['%Y-%m-%d', '%m/%d/%Y', '%m/%d/%y', '%b %d %Y', '%b %d, %Y', '%d %b %Y', '%d %b, %Y', '%B %d %Y', '%B %d, %Y', '%d %B %Y', '%d %B, %Y'] DEBUG = False DEBUG_PROPAGATE_EXCEPTIONS = False DECIMAL_SEPARATOR = '.' DEFAULT_APPS = ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount'] DEFAULT_AUTO_FIELD = 'django.db.models.AutoField' DEFAULT_CHARSET = 'utf-8' DEFAULT_EXCEPTION_REPORTER = 'django.views.debug.ExceptionReporter' DEFAULT_EXCEPTION_REPORTER_FILTER = 'django.views.debug.SafeExceptionReporterFilter' DEFAULT_FILE_STORAGE = 'django.core.files.storage.FileSystemStorage' DEFAULT_FROM_EMAIL = 'lists(a)mydomain.net' DEFAULT_INDEX_TABLESPACE = '' DEFAULT_TABLESPACE = '' DISALLOWED_USER_AGENTS = [] DISKCACHE_PATH = '/opt/mailman-web-data/diskcache' DISKCACHE_SIZE = 1073741824 EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = '172.26.0.5' EMAIL_HOST_PASSWORD = '********************' EMAIL_HOST_USER = '' EMAIL_PORT = 25 EMAIL_SSL_CERTFILE = None EMAIL_SSL_KEYFILE = '********************' EMAIL_SUBJECT_PREFIX = '[Django] ' EMAIL_TIMEOUT = None EMAIL_USE_LOCALTIME = False EMAIL_USE_SSL = False EMAIL_USE_TLS = False FILE_UPLOAD_DIRECTORY_PERMISSIONS = None FILE_UPLOAD_HANDLERS = ['django.core.files.uploadhandler.MemoryFileUploadHandler', 'django.core.files.uploadhandler.TemporaryFileUploadHandler'] FILE_UPLOAD_MAX_MEMORY_SIZE = 2621440 FILE_UPLOAD_PERMISSIONS = 420 FILE_UPLOAD_TEMP_DIR = None FILTER_VHOST = False FIRST_DAY_OF_WEEK = 0 FIXTURE_DIRS = [] FORCE_SCRIPT_NAME = None FORMAT_MODULE_PATH = None FORM_RENDERER = 'django.forms.renderers.DjangoTemplates' HAYSTACK_CONNECTIONS = {'default': {'ENGINE': 'haystack.backends.whoosh_backend.WhooshEngine', 'PATH': '/opt/mailman-web-data/fulltext_index'}} IGNORABLE_404_URLS = [] INSTALLED_APPS = ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora', 'allauth.socialaccount.providers.openid', 'allauth.socialaccount.providers.github', 'allauth.socialaccount.providers.gitlab', 'allauth.socialaccount.providers.google'] INTERNAL_IPS = [] LANGUAGES = [('af', 'Afrikaans'), ('ar', 'Arabic'), ('ar-dz', 'Algerian Arabic'), ('ast', 'Asturian'), ('az', 'Azerbaijani'), ('bg', 'Bulgarian'), ('be', 'Belarusian'), ('bn', 'Bengali'), ('br', 'Breton'), ('bs', 'Bosnian'), ('ca', 'Catalan'), ('cs', 'Czech'), ('cy', 'Welsh'), ('da', 'Danish'), ('de', 'German'), ('dsb', 'Lower Sorbian'), ('el', 'Greek'), ('en', 'English'), ('en-au', 'Australian English'), ('en-gb', 'British English'), ('eo', 'Esperanto'), ('es', 'Spanish'), ('es-ar', 'Argentinian Spanish'), ('es-co', 'Colombian Spanish'), ('es-mx', 'Mexican Spanish'), ('es-ni', 'Nicaraguan Spanish'), ('es-ve', 'Venezuelan Spanish'), ('et', 'Estonian'), ('eu', 'Basque'), ('fa', 'Persian'), ('fi', 'Finnish'), ('fr', 'French'), ('fy', 'Frisian'), ('ga', 'Irish'), ('gd', 'Scottish Gaelic'), ('gl', 'Galician'), ('he', 'Hebrew'), ('hi', 'Hindi'), ('hr', 'Croatian'), ('hsb', 'Upper Sorbian'), ('hu', 'Hungarian'), ('hy', 'Armenian'), ('ia', 'Interlingua'), ('id', 'Indonesian'), ('ig', 'Igbo'), ('io', 'Ido'), ('is', 'Icelandic'), ('it', 'Italian'), ('ja', 'Japanese'), ('ka', 'Georgian'), ('kab', 'Kabyle'), ('kk', 'Kazakh'), ('km', 'Khmer'), ('kn', 'Kannada'), ('ko', 'Korean'), ('ky', 'Kyrgyz'), ('lb', 'Luxembourgish'), ('lt', 'Lithuanian'), ('lv', 'Latvian'), ('mk', 'Macedonian'), ('ml', 'Malayalam'), ('mn', 'Mongolian'), ('mr', 'Marathi'), ('ms', 'Malay'), ('my', 'Burmese'), ('nb', 'Norwegian Bokmål'), ('ne', 'Nepali'), ('nl', 'Dutch'), ('nn', 'Norwegian Nynorsk'), ('os', 'Ossetic'), ('pa', 'Punjabi'), ('pl', 'Polish'), ('pt', 'Portuguese'), ('pt-br', 'Brazilian Portuguese'), ('ro', 'Romanian'), ('ru', 'Russian'), ('sk', 'Slovak'), ('sl', 'Slovenian'), ('sq', 'Albanian'), ('sr', 'Serbian'), ('sr-latn', 'Serbian Latin'), ('sv', 'Swedish'), ('sw', 'Swahili'), ('ta', 'Tamil'), ('te', 'Telugu'), ('tg', 'Tajik'), ('th', 'Thai'), ('tk', 'Turkmen'), ('tr', 'Turkish'), ('tt', 'Tatar'), ('udm', 'Udmurt'), ('uk', 'Ukrainian'), ('ur', 'Urdu'), ('uz', 'Uzbek'), ('vi', 'Vietnamese'), ('zh-hans', 'Simplified Chinese'), ('zh-hant', 'Traditional Chinese')] LANGUAGES_BIDI = ['he', 'ar', 'ar-dz', 'fa', 'ur'] LANGUAGE_CODE = 'en-us' LANGUAGE_COOKIE_AGE = None LANGUAGE_COOKIE_DOMAIN = None LANGUAGE_COOKIE_HTTPONLY = False LANGUAGE_COOKIE_NAME = 'django_language' LANGUAGE_COOKIE_PATH = '/' LANGUAGE_COOKIE_SAMESITE = None LANGUAGE_COOKIE_SECURE = False LOCALE_PATHS = [] LOGGING = {'version': 1, 'disable_existing_loggers': False, 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'}}, 'handlers': {'mail_admins': {'level': 'ERROR', 'filters': ['require_debug_false'], 'class': 'django.utils.log.AdminEmailHandler'}, 'file': {'level': 'INFO', 'class': 'logging.handlers.RotatingFileHandler', 'filename': '/opt/mailman-web-data/logs/mailmanweb.log', 'formatter': 'verbose'}, 'console': {'class': 'logging.StreamHandler', 'formatter': 'simple', 'level': 'INFO', 'stream': <_io.TextIOWrapper name=2 mode='w' encoding='UTF-8'>}}, 'loggers': {'django.request': {'handlers': ['mail_admins', 'file'], 'level': 'INFO', 'propagate': True}, 'django': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}, 'hyperkitty': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}, 'postorius': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}}, 'formatters': {'verbose': {'format': '%(levelname)s %(asctime)s %(process)d %(name)s %(message)s'}, 'simple': {'format': '%(levelname)s %(message)s'}}} LOGGING_CONFIG = 'logging.config.dictConfig' LOGIN_REDIRECT_URL = 'list_index' LOGIN_URL = 'account_login' LOGOUT_REDIRECT_URL = None LOGOUT_URL = 'account_logout' MAILMAN_ARCHIVER_FROM = "('172.26.0.2',)" MAILMAN_ARCHIVER_KEY = '********************' MAILMAN_REST_API_PASS = '********************' MAILMAN_REST_API_URL = '********************' MAILMAN_REST_API_USER = '********************' MAILMAN_WEB_SOCIAL_AUTH = ['django_mailman3.lib.auth.fedora', 'allauth.socialaccount.providers.openid', 'allauth.socialaccount.providers.github', 'allauth.socialaccount.providers.gitlab', 'allauth.socialaccount.providers.google'] MANAGERS = [] MEDIA_ROOT = '' MEDIA_URL = '/' MESSAGE_STORAGE = 'django.contrib.messages.storage.fallback.FallbackStorage' MESSAGE_TAGS = {40: 'danger'} MIDDLEWARE = "('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'allauth.account.middleware.AccountMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware')" MIGRATION_MODULES = {} MONTH_DAY_FORMAT = 'F j' NUMBER_GROUPING = 0 PASSWORD_HASHERS = '********************' PASSWORD_RESET_TIMEOUT = '********************' POSTORIUS_TEMPLATE_BASE_URL = 'http://mailman-web:8000' PREPEND_WWW = False Q_CLUSTER = {'timeout': 300, 'retry': 300, 'save_limit': 100, 'orm': 'default'} ROOT_URLCONF = 'urls' SECRET_KEY = '********************' SECRET_KEY_FALLBACKS = '********************' SECURE_CONTENT_TYPE_NOSNIFF = True SECURE_CROSS_ORIGIN_OPENER_POLICY = 'same-origin' SECURE_HSTS_INCLUDE_SUBDOMAINS = False SECURE_HSTS_PRELOAD = False SECURE_HSTS_SECONDS = 0 SECURE_PROXY_SSL_HEADER = None SECURE_REDIRECT_EXEMPT = [] SECURE_REFERRER_POLICY = 'same-origin' SECURE_SSL_HOST = None SECURE_SSL_REDIRECT = False SERVER_EMAIL = 'lists(a)mydomain.net' SESSION_CACHE_ALIAS = 'default' SESSION_COOKIE_AGE = 1209600 SESSION_COOKIE_DOMAIN = None SESSION_COOKIE_HTTPONLY = True SESSION_COOKIE_NAME = 'sessionid' SESSION_COOKIE_PATH = '/' SESSION_COOKIE_SAMESITE = 'Lax' SESSION_COOKIE_SECURE = False SESSION_ENGINE = 'django.contrib.sessions.backends.db' SESSION_EXPIRE_AT_BROWSER_CLOSE = False SESSION_FILE_PATH = None SESSION_SAVE_EVERY_REQUEST = False SESSION_SERIALIZER = 'django.contrib.sessions.serializers.PickleSerializer' SETTINGS_MODULE = 'settings' SHORT_DATETIME_FORMAT = 'm/d/Y P' SHORT_DATE_FORMAT = 'm/d/Y' SIGNING_BACKEND = 'django.core.signing.TimestampSigner' SILENCED_SYSTEM_CHECKS = [] SITE_ID = 1 SOCIALACCOUNT_PROVIDERS = {'openid': {'SERVERS': [{'id': 'yahoo', 'name': 'Yahoo', 'openid_url': 'http://me.yahoo.com'}]}, 'google': {'SCOPE': ['profile', 'email'], 'AUTH_PARAMS': {'access_type': 'online'}}, 'facebook': {'METHOD': 'oauth2', 'SCOPE': ['email'], 'FIELDS': ['email', 'name', 'first_name', 'last_name', 'locale', 'timezone'], 'VERSION': 'v2.4'}} STATICFILES_DIRS = [] STATICFILES_FINDERS = "('django.contrib.staticfiles.finders.FileSystemFinder', 'django.contrib.staticfiles.finders.AppDirectoriesFinder', 'compressor.finders.CompressorFinder')" STATICFILES_STORAGE = 'django.contrib.staticfiles.storage.StaticFilesStorage' STATIC_ROOT = '/opt/mailman-web-data/static' STATIC_URL = '/static/' TEMPLATES = [{'BACKEND': 'django.template.backends.django.DjangoTemplates', 'DIRS': [], 'APP_DIRS': True, 'OPTIONS': {'context_processors': ['django.template.context_processors.debug', 'django.template.context_processors.i18n', 'django.template.context_processors.media', 'django.template.context_processors.static', 'django.template.context_processors.tz', 'django.template.context_processors.csrf', 'django.template.context_processors.request', 'django.contrib.auth.context_processors.auth', 'django.contrib.messages.context_processors.messages', 'django_mailman3.context_processors.common', 'hyperkitty.context_processors.common', 'postorius.context_processors.postorius']}}] TEST_NON_SERIALIZED_APPS = [] TEST_RUNNER = 'django.test.runner.DiscoverRunner' THOUSAND_SEPARATOR = ',' TIME_FORMAT = 'P' TIME_INPUT_FORMATS = ['%H:%M:%S', '%H:%M:%S.%f', '%H:%M'] TIME_ZONE = 'UTC' USE_DEPRECATED_PYTZ = False USE_I18N = True USE_L10N = True USE_SSL = False USE_THOUSAND_SEPARATOR = False USE_TZ = True USE_X_FORWARDED_HOST = True USE_X_FORWARDED_PORT = False WSGI_APPLICATION = 'wsgi.application' X_FRAME_OPTIONS = 'DENY' YEAR_MONTH_FORMAT = 'F Y' That is my docker-compose.yml: services: postfix: image: boky/postfix #mailu/postfix restart: unless-stopped container_name: postfix #_incomming volumes: - ./data/postfix/etc:/etc/postfix/ #main.cf.d - ./data/core:/opt/mailman ports: - "${MM3_INTERNAL_POSTFIX_SMTP_PORT}:25" - "${MM3_INTERNAL_POSTFIX_SUBM_PORT}:587" environment: - HOSTNAME=${MM3_HOSTNAME} - RELAYHOST=${MM3_RELAYHOST} #- RELAYHOST_USERNAME=${MM3_RELAYHOST_USERNAME} # = An (optional) username for the relay server #- RELAYHOST_PASSWORD=${MM3_RELAYHOST_PASSWORD} # = An (optional) login password for the relay server - POSTFIX_mynetworks=${MM3_POSTFIX_mynetworks} #=127.0.0.0/24,10.8.0.0/24,172.26.0.0/24,192.168.1.0/24 ) #- ALLOWED_SENDER_DOMAINS=${MM3_ALLOWED_SENDER_DOMAINS} # - ALLOW_EMPTY_SENDER_DOMAINS=${MM3_ALLOW_EMPTY_SENDER_DOMAINS} #="true" #'), MM3_ALLOWED_SENDER_DOMAINS can be unset #- MASQUERADED_DOMAINS=${MM3_MASQUERADED_DOMAINS} # = domains where you want to masquerade internal hosts networks: mailman: ipv4_address: ${MM3_IP_INTERNAL_POSTFIX} #172.26.0.5 #services: mailman-core: image: maxking/mailman-core:0.4 # Use a specific version tag (tag latest is not published) container_name: mailman-core hostname: mailman-core restart: unless-stopped volumes: - ./data/core:/opt/mailman/ stop_grace_period: 30s links: - database:database depends_on: database: condition: service_healthy environment: - DATABASE_URL=postgresql://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=postgres - DATABASE_CLASS=mailman.database.postgresql.PostgreSQLDatabase - HYPERKITTY_API_KEY=${MM3_HYPERKITTY_API_KEY} #someapikey_longAndTrustworty - TIMEZONE=${MM3_TIMEZONE} #Europe/Berlin - MTA=postfix - SMTP_HOST=172.26.0.5 #postfix # outgoing smtp Sererv - SMTP_PORT=25 #${MM3_INTERNAL_POSTFIX_SMTP_PORT} # Outgoing SMTPS Server Port ports: - "8001:8001" # API removed 127.0.0.1 - "8024:8024" # LMTP - incoming emails #extra_hosts: # - ${MM3_HOSTNAME}:${MM3_IP_INTERNAL_POSTFIX} networks: mailman: ipv4_address: ${MM3_IP_INTERNAL_CORE} #172.26.0.2 mailman-web: image: maxking/mailman-web:0.4 # Use a specific version tag (tag latest is not published) container_name: mailman-web hostname: mailman-web restart: unless-stopped depends_on: database: condition: service_healthy links: - mailman-core:mailman-core - database:database volumes: - ./data/web:/opt/mailman-web-data environment: - DATABASE_TYPE=postgres - DATABASE_URL=postgresql://mailman:mailmanpass@database/mailmandb - HAYPERKITTY_API_KEY=${MM3_HYPERKITTY_API_KEY} #someapikey_longAndTrustworty - UWSGI_STATIC_MAP=/static=/opt/mailman-web-data/static - SECRET_KEY=${MM3_SECRET_KEY} #blah-blah-secret_undgehie - SERVE_FROM_DOMAIN=${MM3_SERVE_FROM_DOMAIN} #lists.mydomain.net - MAILMAN_ADMIN_USER=${MM3_MAILMAN_ADMIN_USER} #it - MAILMAN_ADMIN_EMAIL=${MM3_MAILMAN_ADMIN_EMAIL} #it(a)mydomain.net - DJANGO_ALLOWED_HOSTS=${MM3_DJANGO_ALLOWED_HOSTS} #lists.mydomain.net - SMTP_HOST=172.26.0.5 #postfix - SMTP_PORT=25 #${MM3_INTERNAL_POSTFIX_SMTP_PORT} - TIMEZONE=${MM3_TIMEZONE} #Europe/Berlin ports: - "8000:8000" # HTTP removed 127.0.0.1 - "8080:8080" # uwsgi # extra_hosts: # - ${MM3_HOSTNAME}:${MM3_IP_INTERNAL_POSTFIX} networks: mailman: ipv4_address: ${MM3_IP_INTERNAL_WEB} #172.26.0.3 database: environment: - POSTGRES_DB=mailmandb - POSTGRES_USER=mailman - POSTGRES_PASSWORD=mailmanpass - TIMEZONE=${MM3_TIMEZONE} #Europe/Berlin image: postgres:12-alpine volumes: - ./data/database:/var/lib/postgresql/data healthcheck: test: ["CMD-SHELL", "pg_isready --dbname mailmandb --username mailman"] interval: 10s timeout: 5s retries: 5 networks: mailman: ipv4_address: ${MM3_IP_INTERNAL_DB} #172.26.0.4 networks: mailman: driver: bridge ipam: driver: default config: - subnet: ${MM3_SUBNET} #172.26.0.0/24 Mailman-extra.cfg: [mailman] site_owner:mailman@mydomain.de max_recipients=1 SMTP_MAX_RCPTS = 1 run_tasks_every: 1h VERP_CONFIRMATIONS = Yes VERP_PASSWORD_REMINDERS = Yes VERP_PERSONALIZED_DELIVERIES = Yes VERP_DELIVERY_INTERVAL = 1 VERP_PROBES: Yes [devmode] enabled: no recipient:it@mydomain.de # # extra local settings for mailmen [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 172.26.0.2 lmtp_port: 8024 smtp_host: 172.26.0.5 smtp_port: 25 #configuration: /etc/postfix-mailman.cfg # # # [logging.smtp] level: warn [language.en] charset: utf-8 [language.de] charset: utf-8 and my settings_locale.py from mailman-web: EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = '172.26.0.5' EMAIL_PORT = 25 USE_SSL = False DEFAULT_FROM_EMAIL ="lists(a)mydomain.net" SERVER_EMAIL ="lists(a)mydomain.net" #DEBUG = True #: Default list of admins who receive the emails from error logging. ADMINS = ( ('Mailman Suite Admin', 'it(a)mydomain.net'), )

3 3

API web hook for subscribe and remove user
by Tibor Molnar Jan. 22, 2025

Jan. 22, 2025

Hi there, I'm looking to find out if there is any way of deleting a user over API and what config needs to be done. Also if I can subscribe user/ users over API to lists. I'm aware that I can remove users in cli mailman shell, so I want to do the same thing over the web. I'm also aware that mailman3 is already query API on localhost and that's how it's generating the output for system information but if I was going to configure it for remote where else other than mailman.cfg do I need to configure this? My current version is: Mailman Core Version GNU Mailman 3.3.8 (Tom Sawyer) Mailman Core API Version 3.1 Related conf in mailman.cfg: [webservice] hostname: localhost port: 8001 use_https: no admin_user: restadmin admin_pass: Thank you for your help

2 2

Mailing list welcome message won't update
by frances.du＠uq.edu.au Jan. 22, 2025

Jan. 22, 2025

Hi there, I have updated the welcome message for a mailing list by directly updating the file at: file:///var/lib/mailman3/templates/lists/[redacted].lists.[redacted].org.au/en/list:user:notice:welcome I then restarted theses services: mailman3, mailman3-web and nginx. But when I test subsribe to the mailing list, the welcome message does not update. GNU Mailman 3.1.1 (Between The Wheels) Postorius Version 1.1.2 Thank you for your help in advance. Frances

3 14

MHonArc archiver setup/config?
by Bryan Fields Jan. 21, 2025

Jan. 21, 2025

I've had a request to setup this for a mm3 list. It looks like it's supported from the config files, but I'm at a loss for exactly how to go about this. Has anyone setup this with mm3 and can provide an overview? Thanks, -- Bryan Fields 727-409-1194 - Voice http://bryanfields.net

2 2

sync_members via email
by kbaumann＠chicagoiww.org Jan. 21, 2025

Jan. 21, 2025

I can use email to get a list of members: To: mylist-request(a)lists.theserver.org Subject: who (password) Any chance that a sync_members could be accomplished in a similar fashion? Looks like it's only available from the console, but I'm asking anyway to be sure. Thanks.

2 1

Fix, kind of, of 'Internal Server Error'
by Alain D D Williams Jan. 20, 2025

Jan. 20, 2025

I was getting several thousand error messages a day complaining about this. I would also find that the web interface would time-out/die - going away to make a cup of tea was the only things to do -- ie just wait. I am getting far fewer of these today after I tweaked by robots.txt. The problem was search engines (and maybe AI monsters) crawling the site and over loading it. The machine has 1.5GB of RAM & plenty of fast (SSD) swap. It copes well enough except when the crawlers come in. So, 2 fixes: Crawl-delay: 10 Do not visit more frequently than every 10 seconds. Google ignores this as it expects you to waste time on their search console. Disallow: /mailman3/ Do not visit at all. However if you do this then archives will not be indexed. All that I can say is: works for me, I have 1% of the errors that I had previously. -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 https://www.phcomp.co.uk/ Parliament Hill Computers. Registration Information: https://www.phcomp.co.uk/Contact.html #include <std_disclaimer.h>

1 0

Postorius: Search field in lists overview
by Andreas Vetter Jan. 15, 2025

Jan. 15, 2025

Hi, is there a way to search lists in Postorius' Lists overview https://lists.example.com/mailman3/lists/?all-lists Well, one can change "results on page" to 200 and then use the search function of the browser, but that is some more clicks. -- Mit freundlichen Gruessen, Andreas Vetter

2 1

Random lmtp Timeout and Long Message Processing times
by Taber, Douglas R Jan. 9, 2025

Jan. 9, 2025

Hello- We’re seeing a seemingly random issue with message acceptance on our mailman instance where some messages sent from postfix to the lmtp listener timeout. It’s not consistent to any specific list or time of day, and messages are accepted on the next attempt by postfix to deliver the message to the lmtp. Additionally, there seems to be a similarly random delay in accepting and processing messages before they are sent to the list moderators or list members. The mailman smtp log snippet shows it stop receiving data prior to the DATA portion of the message after a 15min timeout: Jan 02 07:56:36 2025 (3601529) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Jan 02 07:56:36 2025 (3601529) Peer: ('127.0.0.1', 45574) Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) handling connection Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) << b'220 lists.renci.org GNU Mailman LMTP runner 2.0' Jan 02 07:56:36 2025 (3601529) _handle_client readline: b'LHLO lists.renci.org\r\n' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) >> b'LHLO lists.renci.org' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) << b'250-lists.renci.org' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) << b'250-SIZE 33554432' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) << b'250-8BITMIME' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) << b'250 HELP' Jan 02 07:56:36 2025 (3601529) _handle_client readline: b'MAIL FROM:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws<mailto:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws> SIZE=20254\r\n' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) >> b'MAIL FROM:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws<mailto:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws> SIZE=20254' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) sender: 010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000(a)mail.verify.signin.aws<mailto:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws> Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) << b'250 OK' Jan 02 07:56:36 2025 (3601529) _handle_client readline: b'RCPT TO:adcircaws@lists.RENCI.org<mailto:adcircaws@lists.RENCI.org>\r\n' Jan 02 07:56:36 2025 (3601529) ('127.0.0.1', 45574) >> b'RCPT TO:adcircaws@lists.RENCI.org<mailto:adcircaws@lists.RENCI.org>' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 45574) recip: adcircaws(a)lists.RENCI.org<mailto:adcircaws@lists.RENCI.org> Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 45574) << b'250 Ok' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 45574) EOF received Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 45574) connection timeout Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 45574) Connection lost during _handle_client() Jan 02 08:12:26 2025 (3601529) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 45574) connection lost Jan 02 08:12:26 2025 (3601529) Peer: ('127.0.0.1', 33138) Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) handling connection Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'220 lists.renci.org GNU Mailman LMTP runner 2.0' Jan 02 08:12:26 2025 (3601529) _handle_client readline: b'LHLO lists.renci.org\r\n' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) >> b'LHLO lists.renci.org' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'250-lists.renci.org' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'250-SIZE 33554432' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'250-8BITMIME' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'250 HELP' Jan 02 08:12:26 2025 (3601529) _handle_client readline: b'MAIL FROM:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws<mailto:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws> SIZE=20254\r\n' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) >> b'MAIL FROM:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws<mailto:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws> SIZE=20254' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) sender: 010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000(a)mail.verify.signin.aws<mailto:010001942716aa05-637d21f8-9794-473f-9e8b-06ca08025ef1-000000@mail.verify.signin.aws> Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'250 OK' Jan 02 08:12:26 2025 (3601529) _handle_client readline: b'RCPT TO:adcircaws@lists.RENCI.org<mailto:adcircaws@lists.RENCI.org>\r\n' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) >> b'RCPT TO:adcircaws@lists.RENCI.org<mailto:adcircaws@lists.RENCI.org>' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) recip: adcircaws(a)lists.RENCI.org<mailto:adcircaws@lists.RENCI.org> Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'250 Ok' Jan 02 08:12:26 2025 (3601529) _handle_client readline: b'DATA\r\n' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) >> b'DATA' Jan 02 08:12:26 2025 (3601529) ('127.0.0.1', 33138) << b'354 End data with <CR><LF>.<CR><LF>' Anyone have any thoughts on next troubleshooting steps on this one? Thanks

2 2

Feature request, hyperkitty, low volume lists
by Alain D D Williams Jan. 9, 2025

Jan. 9, 2025

I host several low volume mail lists. Typically these are announcement lists where low volume is deliberate -- too many emails and people might unsubscribe. These lists are archived but most months there are not any postings. Browsing the archives can mean much clicking to find content, this is done better with mailman2. My request is to make finding content easier. Possibilities: • On the summary (left hand side) put the number of posts after the month name • Only show months (left hand side) where there are any posts For an example see: https://fridayfolk.phcomp.co.uk/mailman3/hyperkitty/list/announce@fridayfol… (There is one post in November) Regards -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 https://www.phcomp.co.uk/ Parliament Hill Computers. Registration Information: https://www.phcomp.co.uk/Contact.html #include <std_disclaimer.h>

3 5

Moderation via email?
by Arte Chambers Jan. 8, 2025

Jan. 8, 2025

Is it possible to approve or deny message and subscription requests from email? Thank you, Paul 'Arte Chambers' Robey

1 0

Mailman3 Docker persmission denied
by Commander456 Jan. 6, 2025

Jan. 6, 2025

Hello everyone, I recently installed the mailman-core Docker image (Version 0.5) and tried to create a list using the mailman commands inside the container. I used the --notify argument but doesn't receive any mail (I'm the list owner), However, inside the mailman.log I get the following error: Jan 06 20:54:25 2025 (156) Uncaught runner exception: [Errno 13] Permission denied: '/opt/mailman/var/queue/virgin/1736196864.6488764+2c5d24f89f86715d3deb3d0032735050cb9e29f8.pck' Jan 06 20:54:25 2025 (156) Traceback (most recent call last): File "/usr/lib/python3.12/site-packages/mailman/core/runner.py", line 164, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/site-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp: ^^^^^^^^^^^^^^^^^^^^ PermissionError: [Errno 13] Permission denied: '/opt/mailman/var/queue/virgin/1736196864.6488764+2c5d24f89f86715d3deb3d0032735050cb9e29f8.pck' Jan 06 20:54:25 2025 (156) Skipping and preserving unparseable message: 1736196864.6488764+2c5d24f89f86715d3deb3d0032735050cb9e29f8 These are my file permissions: mailman-core:/opt/mailman/var/queue# ls -l total 48 drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 archive drwxrwx--- 2 mailman nogroup 4096 Jan 6 20:54 bad drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 bounces drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 command drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 digest drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 in drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 nntp drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 out drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 pipeline drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 retry drwxrwx--- 2 mailman nogroup 4096 Jan 6 17:11 shunt drwxrwx--- 2 mailman nogroup 4096 Jan 6 20:54 virgin mailman-core:/opt/mailman/var/queue/virgin# ls -l total 0 Do you have any idea what I'm doing wrong? Thank you

2 2

How to remove Held Unsubscriptions
by Mark Jan. 6, 2025

Jan. 6, 2025

Hi As a moderator I receive an email each day for "Held Unsubscriptions" for a subscriber that was unsubscribed by the Owner sometime ago (using "Mass operations"). +++++++++++++++++++++++++++++++ The listname(a)domain.com list has 1 moderation requests waiting. Held Unsubscriptions: User: bart(a)example.com Please attend to this at your earliest convenience. +++++++++++++++++++++++++++++++ There is nothing showing under "Subscription requests > Pending approval". Could anyone tell me how I can stop these email notifications? I have access to the mailman shell and the databases. Thanks, Mark

4 7

possible backscatter attack using Mailman3 servers
by David Newman Jan. 5, 2025

Jan. 5, 2025

Greetings. On a system running Mailman 3.3.9 and Postfix, I'm seeing about 20-30 entries per day in the Postfix queue where it appears a Gmail user signs up for a mailing list that requires confirmation, and Gmail responds that the user is too busy to handle requests. There are no publicly advertised email lists on this server, and I don't ever see anything in the Mailman logs indicating the user ever tried signing up. I've pasted the mail.log transaction below, with only slight obfuscation: - "mail10.example1.com" is this server's canonical hostname - lists are hosted on "lists.example2.com" and "mail.example3.com" - "someuser9413(a)gmail.com" is the user supposedly signing up Thanks in advance for clues on determining where these requests are coming from, and how I might block them. I have a strong interest in having my server not amplifying backscatter traffic like this. Alternatively, if this is a Postfix problem, please let me know that too. dn Jan 3 10:29:22 mail10 postfix/postscreen[4052406]: CONNECT from [::1]:55274 to [::1]:25 Jan 3 10:29:22 mail10 postfix/postscreen[4052406]: WHITELISTED [::1]:55274 Jan 3 10:29:22 mail10 postfix/postscreen[4052406]: using backwards-compatible default setting respectful_logging=no for client [::1]:55274 Jan 3 10:29:22 mail10 postfix/smtpd[4052407]: connect from localhost[::1] Jan 3 10:29:22 mail10 postfix/smtpd[4052407]: discarding EHLO keywords: CHUNKING Jan 3 10:29:22 mail10 postfix/smtpd[4052407]: 4YPsYG1X2xzHQfw: client=localhost[::1] Jan 3 10:29:22 mail10 postfix/cleanup[4052628]: 4YPsYG1X2xzHQfw: message-id=<173592896219.2314.15515568084960961396(a)mail10.example1.com> Jan 3 10:29:22 mail10 postfix/smtpd[4052407]: disconnect from localhost[::1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 Jan 3 10:29:22 mail10 postfix/qmgr[3635053]: 4YPsYG1X2xzHQfw: from=<postmaster(a)example2.com>, size=901, nrcpt=1 (queue active) Jan 3 10:29:22 mail10 postfix/10025/smtpd[4052639]: connect from localhost[127.0.0.1] Jan 3 10:29:22 mail10 postfix/10025/smtpd[4052639]: discarding EHLO keywords: CHUNKING Jan 3 10:29:22 mail10 postfix/10025/smtpd[4052639]: 4YPsYG33SkzHSdN: client=localhost[127.0.0.1] Jan 3 10:29:22 mail10 postfix/cleanup[4052628]: 4YPsYG33SkzHSdN: message-id=<173592896219.2314.15515568084960961396(a)mail10.example1.com> Jan 3 10:29:22 mail10 postfix/10025/smtpd[4052639]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 Jan 3 10:29:22 mail10 postfix/qmgr[3635053]: 4YPsYG33SkzHSdN: from=<postmaster(a)example2.com>, size=1939, nrcpt=1 (queue active) Jan 3 10:29:22 mail10 amavis[4017234]: (4017234-09) Passed CLEAN {RelayedInternal}, MYNETS/MYUSERS LOCAL [::1]:55274 ESMTP/ESMTP <postmaster(a)example2.com> -> <someuser9413(a)gmail.com>, (), Queue-ID: 4YPsYG1X2xzHQfw, Message-ID: <173592896219.2314.15515568084960961396(a)mail10.example1.com>, mail_id: P9P7GnranpAW, b: Zp0DirpBL, Hits: -, size: 900, queued_as: 4YPsYG33SkzHSdN, Subject: "[mail.example3.com] Please Confirm Your Email Address", From: <postmaster(a)example2.com>, helo=mail10.example1.com, dkim_new=dkim:example1.com, 217 ms Jan 3 10:29:22 mail10 postfix/amavis/smtp[4052633]: 4YPsYG1X2xzHQfw: to=<someuser9413(a)gmail.com>, relay=127.0.0.1[127.0.0.1]:10024, delay=0.24, delays=0.02/0/0.01/0.21, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 4YPsYG33SkzHSdN) Jan 3 10:29:22 mail10 postfix/qmgr[3635053]: 4YPsYG1X2xzHQfw: removed Jan 3 10:29:22 mail10 postfix/smtp[4052642]: Trusted TLS connection established to gmail-smtp-in.l.google.com[2607:f8b0:4023:c0d::1b]:25: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256 Jan 3 10:29:22 mail10 postfix/smtp[4052642]: 4YPsYG33SkzHSdN: host gmail-smtp-in.l.google.com[2607:f8b0:4023:c0d::1b] said: 450-4.2.1 The user you are trying to contact is receiving mail at a rate that 450-4.2.1 prevents additional messages from being delivered. Please resend your 450-4.2.1 message at a later time. If the user is able to receive mail at that 450-4.2.1 time, your message will be delivered. For more information, go to 450 4.2.1 https://support.google.com/mail/?p=ReceivingRate 98e67ed59e1d1-2f2ed632fdfsi39876934a91.55 - gsmtp (in reply to RCPT TO command) Jan 3 10:29:22 mail10 postfix/smtp[4052642]: Trusted TLS connection established to gmail-smtp-in.l.google.com[142.251.2.27]:25: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256 Jan 3 10:29:22 mail10 postfix/smtp[4052642]: 4YPsYG33SkzHSdN: to=<someuser9413(a)gmail.com>, relay=gmail-smtp-in.l.google.com[142.251.2.27]:25, delay=0.46, delays=0.01/0/0.4/0.04, dsn=4.2.1, status=deferred (host gmail-smtp-in.l.google.com[142.251.2.27] said: 450-4.2.1 The user you are trying to contact is receiving mail at a rate that 450-4.2.1 prevents additional messages from being delivered. Please resend your 450-4.2.1 message at a later time. If the user is able to receive mail at that 450-4.2.1 time, your message will be delivered. For more information, go to 450 4.2.1 https://support.google.com/mail/?p=ReceivingRate d2e1a72fcca58-72aad8fd529si37008995b3a.196 - gsmtp (in reply to RCPT TO command))

3 4

mailman transfer from 2to3
by Daniel Germer Dec. 28, 2024

Dec. 28, 2024

Hello all, I am new to mailman3, once upon a time I had mailman installed on my server, but had trouble with many things, especially virtual hosts not possible in mailman2... However on https://docs.mailman3.org/en/latest/pre-installation-guide.html#what-do-i-n… are no system requirements for the installation. I assume, that I cannot just install mailman3 on a regular webhoster, but there is no section: You need to have root access to a Linux system with at least 8/16/31/64GB RAM and at least 1/2/5/7 GB of free diskspace (ssl or hard-disk?) You need so and so much for 100/1000 Lists with 10/100/1000 Users each and 5/50/500 Mailings per day... where do I find that information? what is the smallest possible machine to run mailman3 on? Can I run it on a raspberry pi? regards, Daniel

1 0

Clean-up of non-members
by Torge Riedel Dec. 26, 2024

Dec. 26, 2024

Dears, I am currently cleaning up a huge list of non-members. In contrast to the members list where I can select multiple entries and delete them at once, this is not possible in the list of non-members? Can this be enabled in a future release? Thank you and kind regards Torge

3 14

MTA setup
by Arte Chambers Dec. 24, 2024

Dec. 24, 2024

I've got a new installation of Mailman 3 setup, however I am having some issues I'm not sure how to troubleshoot. Mailman is successfully sending invite emails however user messages sent to the list are not being sent to subscribers. Also in Hyperkitty none of my test messages to the list are showing up in the archive. I am using Postfix with an SMTP relay hosted at Brevo.com (formally sendinblue). Brevo's logs show the message getting rejected Log from brevo.com (SMPT Relay) Sent on 17-11-2024 21:49:16 From listmember(a)gmail.com To listmember(a)gmail.com Message ID<CAPesOD1y0fEaG=GFodz=Lgs1m_hqRErPnQcpXCNtKsBbJ= BJ7Q(a)mail.gmail.com> 17-11-2024 21:49:16 Sending has been rejected because the sender you used listmember(a)gmail.com is not valid. Validate your sender or authenticate your domain >>>Postfix main.cf # See /usr/share/postfix/main.cf.dist for a commented, more complete version # Debian specific: Specifying a file name will cause the first # line of that file to be used as the name. The Debian default # is /etc/mailname. #myorigin = /etc/mailname smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu) biff = no # appending .domain is the MUA's job. append_dot_mydomain = no # Uncomment the next line to generate "delayed mail" warnings #delay_warning_time = 4h readme_directory = no # See http://www.postfix.org/COMPATIBILITY_README.html -- default to 3.6 on # fresh installs. compatibility_level = 3.6 # TLS parameters smtpd_tls_cert_file=/etc/ssl/certs/ssl-cert-snakeoil.pem smtpd_tls_key_file=/etc/ssl/private/ssl-cert-snakeoil.key smtpd_tls_security_level=may smtp_tls_CApath=/etc/ssl/certs smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_relay_restrictions = permit_mynetworks permit_sasl_authenticated defer_unauth_destination myhostname = list.louisvillecommunitygrocery.com alias_maps = hash:/etc/aliases alias_database = hash:/etc/aliases myorigin = $myhostname mydestination = $myhostname, list.louisvillecommunitygrocery.com, localhost.louisvillecommunitygrocery.com, , localhost mynetworks = 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128 mailbox_size_limit = 0 recipient_delimiter = + inet_interfaces = all inet_protocols = all # Mailman3 configs # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no transport_maps = hash:/opt/mailman/mm/var/data/postfix_lmtp local_recipient_maps = hash:/opt/mailman/mm/var/data/postfix_lmtp relay_domains = hash:/opt/mailman/mm/var/data/postfix_domains #SMPT Relay Brevo relayhost = [smtp-relay.sendinblue.com]:587 smtp_sasl_auth_enable = yes smtp_sasl_security_options = noanonymous smtp_sasl_password_maps = hash:/etc/postfix/sasl_passwd smtp_tls_security_level = encrypt smtp_tls_CAfile = /etc/ssl/certs/ca-certificates.crt *In closing*, can anyone point me in the right direction for further troubleshooting on this issue? Thank you, Paul 'Arte Chambers' Robey

2 12

Suggestion on Mailing Lists page
by Alain D D Williams Dec. 24, 2024

Dec. 24, 2024

This is the page that lists the mailing lists that I have. It would be really useful if there was an indication next to each list if that list required attention, eg an email awaiting moderation. Have a good Xmas everyone. -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 https://www.phcomp.co.uk/ Parliament Hill Computers. Registration Information: https://www.phcomp.co.uk/Contact.html #include <std_disclaimer.h>

2 1

MM2 to MM3 Archives Loading
by Joshua Bushe Dec. 22, 2024

Dec. 22, 2024

Hi everyone, I’ve successfully converted a list from Mailman 2 to Mailman 3, and most things are working smoothly. However, I’m encountering an issue with the archives in the GUI: Problem: The archives don’t load on the overview page. Odd Behavior: If I use the search function, the archives appear as expected, but they remain invisible on the main overview. Has anyone encountered this issue or have suggestions for troubleshooting? Thanks in advance for your help!

5 15

Flooded non-members with "prvs=<number>=<mail>"
by Torge Riedel Dec. 22, 2024

Dec. 22, 2024

Dears, I checked the non-members list of all my mailman3 lists and found a lot entries like "prvs=<number>=<mail>", the <mail> is always an address from @freenet.de A quick research mentions something related to bouncing and that such mails should be blocked/filtered. But no further details. Can you give a hint where I need to change what to block such mails and avoid that such entries floods the non-members list? Thank you and kind regards Torge

2 1

Poor rendering of disabled registration page
by Torge Riedel Dec. 22, 2024

Dec. 22, 2024

Dears, I have set ACCOUNT_ADAPTER = 'django_mailman3.views.user_adapter.DisableSignupAdapter' in my settings.py, so clicking on the "Registration+" button shows a page that registration is disabled: 1. The page has a poor rendering, as far as I can see not css is referenced 2. A would prefer that I am able to hide the registration button Is either of this possible to be fixed in the future? Thank you and kind regards Torge

2 1

Cache mailman3
by pau.baiges＠csuc.cat Dec. 22, 2024

Dec. 22, 2024

Is there a way to delete the mailman3 cache? It's because it gives us this error and we think it's because of the cache. Internal Server Error: /mailman3/accounts/login/ TemplateDoesNotExist at /accounts/login/ django_saml2_auth/error.html Request Method: GET Request URL: http://llistes.csuc.cat/mailman3/accounts/login/?next=/mailman3/postorius/l… Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.10 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: dv., 15 Març 2024 10:33:00 +0100 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Template loader postmortem Django tried loading these templates, in this order: Using engine django: This engine did not provide a list of tried templates. Traceback: File "/usr/local/lib/python3.8/dist-packages/django_saml2_auth/utils.py" in wrapper 179. result = function(request) File "/usr/local/lib/python3.8/dist-packages/django_saml2_auth/views.py" in signin 271. saml_client = get_saml_client(get_assertion_url(request), acs) File "/usr/local/lib/python3.8/dist-packages/django_saml2_auth/saml.py" in get_saml_client 169. metadata = get_metadata(user_id) File "/usr/local/lib/python3.8/dist-packages/django_saml2_auth/saml.py" in get_metadata 131. raise SAMLAuthError("Invalid metadata URL.", extra={ During handling of the above exception (Invalid metadata URL.), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/local/lib/python3.8/dist-packages/django_saml2_auth/utils.py" in wrapper 181. result = handle_exception(exc, request) File "/usr/local/lib/python3.8/dist-packages/django_saml2_auth/utils.py" in handle_exception 162. return render(request, File "/usr/lib/python3/dist-packages/django/shortcuts.py" in render 36. content = loader.render_to_string(template_name, context, request, using=using) File "/usr/lib/python3/dist-packages/django/template/loader.py" in render_to_string 61. template = get_template(template_name, using=using) File "/usr/lib/python3/dist-packages/django/template/loader.py" in get_template 19. raise TemplateDoesNotExist(template_name, chain=chain) Exception Type: TemplateDoesNotExist at /accounts/login/ Exception Value: django_saml2_auth/error.html Request information: USER: AnonymousUser

3 2

Error: Module "django.contrib.sessions.serializers" does not define a "PickleSerializer" attribute/class
by Torge Riedel Dec. 22, 2024

Dec. 22, 2024

Dears, I just upgraded my Server from Ubuntu 22.04 to 24.04 and I get the following error when accessing the web page. Django is 5.0.10 Postorius is 1.3.13 Any help is welcome. Thank you and kind regards Torge Internal Server Error:/mailman3/lists/ ImportError at/mailman3/lists/ Module "django.contrib.sessions.serializers" does not define a "PickleSerializer" attribute/class Request Method: GET Request URL:https://lists.lsv-pinneberg.de/mailman3/lists/ Django Version: 5.0.10 Python Executable: /usr/bin/uwsgi-core Python Version: 3.12.3 Python Path: ['.', '', '/usr/lib/python312.zip', '/usr/lib/python3.12', '/usr/lib/python3.12/lib-dynload', '/opt/mailman/web/venv/lib/python3.12/site-packages'] Server time: Sun, 22 Dec 2024 11:05:00 +0100 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware', 'allauth.account.middleware.AccountMiddleware') Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/utils/module_loading.py", line 30, in import_string return cached_import(module_path, class_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/utils/module_loading.py", line 16, in cached_import return getattr(module, class_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ The above exception (module 'django.contrib.sessions.serializers' has no attribute 'PickleSerializer') was the direct cause of the following exception: File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/core/handlers/exception.py", line 55, in inner response = get_response(request) ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/utils/deprecation.py", line 133, in __call__ response = self.process_request(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/contrib/sessions/middleware.py", line 20, in process_request request.session = self.SessionStore(session_key) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/contrib/sessions/backends/db.py", line 16, in __init__ super().__init__(session_key) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/contrib/sessions/backends/base.py", line 47, in __init__ self.serializer = import_string(settings.SESSION_SERIALIZER) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/web/venv/lib/python3.12/site-packages/django/utils/module_loading.py", line 32, in import_string raise ImportError( ^^^^^^^^^^ Exception Type: ImportError at/mailman3/lists/ Exception Value: Module "django.contrib.sessions.serializers" does not define a "PickleSerializer" attribute/class Raised during: postorius.views.list.list_index

1 1

Subscription requires confirmation when list is set as Open
by Mark Dec. 21, 2024

Dec. 21, 2024

Hi All, I have a list set with the following ... List Settings > Member Policy # Subscription Policy = "Open" When I subscribe with an email address that has been used (subscribed/unsubscribed) on any other list (on that server), the address is subscribed automatically. However, if I subscribe with an address that has never been used before, I receive an email that requires me to confirm the subscription. The subscription is also held in the administrator's "Subscription requests: Pending confirmation". This happens when subscribing by both email and the web UI. Ideally, as the Policy is set as "Open", the subscription of any new email address should be added automatically. Have I missed a configuration setting somewhere? Any advice really appreciated. Regards, Mark $ mailman info GNU Mailman 3.3.9 (Tom Sawyer) Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0] Venv installation on Debian

3 7

Re: mail stuck in "out" queue
by Dmitry Makovey Dec. 18, 2024

Dec. 18, 2024

So our mailman got stuck again, but I did follow your advise. Here's what I've found: On 3/29/19 2:58 PM, Mark Sapiro wrote: > On 3/29/19 2:28 PM, Dmitry Makovey wrote: >> I've had encountered this situation now twice: mail is being stuck in >> "out" queue and nothing in the logs indicates the issue. Is there a way >> to ask mailman-core politely to attempt delivery (perhaps with increased >> debugging in the logs) *without* restarting the core (which does solve >> *this* problem but creates other problems, like availability of the >> mailman as a whole) > > > Is the "out" runner running? yes: # docker top mailman-core | grep -F out: 100 21681 13215 0 Mar28 ? 01:14:16 /usr/local/bin/python /usr/local/bin/runner --runner=out:0:1 -C /etc/mailman.cfg > ps -fwwA |grep runner=out > > If not, you should be able to start it as the Mailman user with a > command like > > /path/to/python3 /path/to/mailman/bin/runner -C /path/to/mailman.cfg > --runner=out:0:1 > > See 'ps -fwwA|grep runner' for examples > > If the out runner is running, is there a file named *.bak along with all > the *.pck files in queue/out/ there is one, yes: # ls -l /srv/mail/mailman/core/var/queue/out/*.bak -rw-rw---- 1 100 65533 21512 Apr 14 19:45 /srv/mail/mailman/core/var/queue/out/1555296331.8386078+2c905825b82708e5a682b872b0aff320c9dd0b2e.bak what does it indicate and what should my steps be to resolve this (other than restarting queues)? > And if it's not, is there anything in Mailman's logs to indicate why it > died? > > Also, 'mailman restart' should only take a matter of seconds, but if the > out runner is running but not processing its queue, I think sending it a > SIGINT should restart it. SIGINT killed the process allright, but it didn't auto-respawn. I ended up spawning it with: /usr/local/bin/python /usr/local/bin/runner --runner=out:0:1 -C /etc/mailman.cfg but soon realized it doesn't go to background nicely so I've nohup'ed it in the end. but it did solve my problem. -- Sr System and DevOps Engineer SoM IRT

6 17

MM2 to MM3 on different server. Process to move everything at once.
by jkoral＠luc.edu Dec. 12, 2024

Dec. 12, 2024

Is there a way to move everything from an MM2 server to a new MM3 server (on separate servers)? I have been migrating individual lists, which seems to work OK, but there are so many lists that it would have to be done over a longer period of time. I was hoping I can just migrate a database or something and have it all done in an hour or so. Thoughts?

3 2

Blocking / throttling unwanted signup attempts
by David Newman Dec. 12, 2024

Dec. 12, 2024

Greetings. On a server running Postfix and Mailman 3.3.9, the Postfix queue shows 20-30 entries/day like this mildly obfuscated example: 4Y8M1n5v5VzHSpQ 2023 Thu Dec 12 10:48:45 postmaster(a)example.com (host gmail-smtp-in.l.google.com[142.250.101.26] said: 450-4.2.1 The user you are trying to contact is receiving mail at a rate that 450-4.2.1 prevents additional messages from being delivered. Please resend your 450-4.2.1 message at a later time. If the user is able to receive mail at that 450-4.2.1 time, your message will be delivered. For more information, go to 450 4.2.1 https://support.google.com/mail/?p=ReceivingRate 41be03b00d2f7-7fd409820c4si13081249a12.439 - gsmtp (in reply to RCPT TO command)) baduser2000(a)gmail.com From the Mailman logs it appears these are responses to signup attempts to a publicly advertised list hosted on this server. The signups come from many different Gmail addresses. I'm concerned about being part of a botnet. Other than taking the list private, is there some other means I can use to block/throttle these signup attempts? Thanks dn

1 0

hyperkitty threads by month list UI?
by Bryan Fields Dec. 11, 2024

Dec. 11, 2024

Does anyone have a better way to display the threads by month in hyperkitty? I'm thinking like a selector that could show year and then you click on year and it gives months. As of now it expands the months out and there's over 300 lines to scroll down on for threads. Example: https://keekles.org/~bryan/longlisthyperkitty.png Thanks, -- Bryan Fields 727-409-1194 - Voice http://bryanfields.net

1 0

Enable delivery
by Hirayama, Pat Dec. 10, 2024

Dec. 10, 2024

Greetings, I'm finding something a bit odd with our listserv. Some of the members of some of the lists are reporting that they aren't receiving messages sent to the list. When I review the member options for the person in question, I see that Delivery Status shows nothing selected (i.e. neither radio button is selected for Enabled or Disabled). If I select Enabled and Save, then delivery starts working for that user. There are other members of the list that have neither Enabled or Disabled selected, but they are working. Which also seems to mean that when I run: mailman members --nomail any listname@listserv Nothing is returned. If anyone has any ideas about why this might be the case, or how I might proactively identify other members who aren't receiving mail, that would be appreciated. Alternately, any thoughts on how I might force all members to Delivery Status Enabled, that would also be great. Thanks! -p Pat Hirayama Pronouns: he/him/his Systems Engineer IT | Systems Engineering - Infrastructure Fred Hutch Cancer Center O 206.667.4856 phirayam(a)fredhutch.org<mailto:phirayam@fredhutch.org>

2 4

How to Increase outgoing mail volume for Mailman 3
by Brian Carpenter Dec. 9, 2024

Dec. 9, 2024

Hello everyone, We had a new client come on board that brought a list that had the largest out-going mail volume that I have ever dealt with. So I did what any sane server administrator would do that is running Mailman 3: I ran to Mark Sapiro for help! Here is what the Sage of all things Mailman counseled me to do: 1. Disabled VERP delivery. VERP can help improve mail delivery by delivering 1 message per SMTP transaction (I think I got that right). Using VERP is counter-productive as it can seriously delay outgoing mail delivery for a high-volume list. So you can use something like the following in the MTA section of your mailman.cfg: [mta] verp_confirmations: no verp_personalized_deliveries: no verp_delivery_interval: 0 2. I configured Mailman 3 to run 4 outgoing runners. The default is 1. This action was the game changer. It allows Mailman to handle 4 incoming messages at a time instead of 1. My client's incoming list volume was high enough where it was overwhelming the single outgoing runner. Here is what I added to the mailman.cfg file: [runner.out] instances: 4 Doing this step immediately solved the backlog in var/queue/out. 3. If you start up with a new server for a list that is high volume then keep an eye out for Proofpoint and Vade Security as they will block your new IP address quicker than Mark Sapiro can say "This is a bug. See <some Gitlab.com url>" Mark, thank you! -- Brian Carpenter Harmonylists.com Emwd.com

5 10

Hyperkitty search on Message-ID?
by Bryan Fields Dec. 6, 2024

Dec. 6, 2024

I've been working with a rather large import and am finding that I can't seem to get the search on a Message-ID: to return anything. I can do this via the DB, and then look at the message, but this is less than ideal, and requires DB access. > mailmanweb=> select message_id_hash from hyperkitty_email where message_id = '19991231211903.C2870(a)abq-mail-01.ihighway.net'; > message_id_hash > ---------------------------------- > IWKEJSPTJODEHARQ2VI6BEFQKNEJYM22 Any ideas how to get it indexing the ID so a layperson can search on it? -- Bryan Fields 727-409-1194 - Voice http://bryanfields.net

2 3

Aborted connection message in log in every 5 minutes
by zoltan＠circle-interactive.co.uk Dec. 3, 2024

Dec. 3, 2024

Hi Everyone, we have mailman 3.3.8 venv test installation which in general works fine however our mysql error log is filled up with messages below because they are so frequent. 2023-02-24 0:31:30 199567 [Warning] Aborted connection 199567 to db: 'mailman' user: 'mailman' host: 'localhost' (Got an error reading communication packets) 2023-02-24 0:36:30 201063 [Warning] Aborted connection 201063 to db: 'mailman' user: 'mailman' host: 'localhost' (Got an error reading communication packets) 2023-02-24 0:41:31 202559 [Warning] Aborted connection 202559 to db: 'mailman' user: 'mailman' host: 'localhost' (Got an error reading communication packets) 2023-02-24 0:46:31 204056 [Warning] Aborted connection 204056 to db: 'mailman' user: 'mailman' host: 'localhost' (Got an error reading communication packets) As suggested here https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… I tried to correlate with error logs and /opt/mailman/web/logs/mailmanweb.log shows some hyperkitty.lib.utils Failed to update the fulltext index: (2002, "Can't connect to local MySQL server through socket '/run/mysqld/mysqld.sock' (111)" /opt/mailman/web/logs/uwsgi-error.log Message: OperationalError(2013, "Lost connection to MySQL server at 'handshake: reading initial communication packet', sy stem error: 104") but they have not such frequency so unsure if they are related. Thanks for the suggestions

6 16

Recaptcha for subscription requests?
by Jered Floyd Dec. 3, 2024

Dec. 3, 2024

Hello Mailman3 users, I've seen a massive uptick in bogus subscription requests with real addresses, either being used to DDoS outside mailboxes or just for intrusion/scanning. (It looks like a lot of fake random strings for name and then valid addresses like scanning/scamming tools like Acunetix generate.) When these hit thousands of gmail addresses they get classified as spam and hurt our overall deliverability. Has anyone yet built a CAPTCHA integration for the Subscription/Sign Up path? Regards, --Jered

3 2

Deleting moderation requests in database
by Joachim Schrod Dec. 3, 2024

Dec. 3, 2024

OK; so I have an old mailman instance where I can't confirm unsubscribe moderation requests. mailman3 core is still sending me daily notices about that moderation requests; I want to get rid of them. (By now, I unsubscribed this test subscriber, so these messages are garbage anyhow.) First: I assume that all information about moderation is in the database mailman3. If that's not the case, please tell me. Second: I tried to determine what DB records are involved in a moderation, so I can delete them. I found the following records: -- workflowstate: records about pending confirmations; with a token as primary key. -- pended: records that references that key, with an id. -- pendedkeyvalue: records with additional information about the request, referenced by the id of table record `pended'. In addition, there is a record in table `member' for that mailing list, with an UUID in `_member_id' that isn't stored in any other record in the database elsewhere. (This is a test mailing list that currently has *no* members; thus this record might be relevant.) Where is this `_member_id' UUID used? My question is: Which records do I have to delete to get rid of the daily pending unsubscribe moderation notices? Cheers, Joachim -- =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Joachim Schrod Email: joachim(a)schrod.org Roedermark, Germany ``How do we persuade new users that spreading fonts across the page like peanut butter across hot toast is not necessarily the route to typographic excellence?'' -- Peter Flynn

2 2

Problem with importing lists
by Alain D D Williams Dec. 1, 2024

Dec. 1, 2024

This is a problem that I had before. Creating a new email list, adding members - all goes well the members can send email to the list and it is sent out. Create an email list and import configuration data from mailman 2.1.20 *sometimes* has problems - mail is received, archived but not sent out. This is only sometimes. One list that I had the problem with I eventually got it to send out email, but I cannot remember exactly what I did. The lists that get stuck go into an infinite look trying to deal with a file in /var/lib/mailman3/queue/shunt/ -- the files being worked on in /var/lib/mailman3/queue/out/ where they appear temporarily. # mailman --run-as-root import21 arm-netbook(a)lists.phcomp.co.uk /home/tmp/lists/arm-netbook/config.pck Importing members [####################################] 100% Importing owners [####################################] 100%addw(a)phcomp.co.uk is already imported with role MemberRole.owner Importing moderators [####################################] 100% Importing defers [####################################] 100% Importing holds [####################################] 100% Importing rejects [####################################] 100% Importing discards [####################################] 100% The archive with a message from me at 6.18pm can be seen here (with one at 5.28 from when it was on the old machine) https://mm-test.phcomp.co.uk/mailman3/hyperkitty/list/arm-netbook@lists.phc… The file in /var/lib/mailman3/queue/shunt/ has been decoded below with "mailman --run-as-root qfile" -- some 305 email addresses have been redacted for privacy: [----- start pickle -----] <----- start object 1 -----> Received: from freshmint.phcomp.co.uk ([2001:4d48:ad51:2f00::2:2] helo=mint.phcomp.co.uk) by bf2024.phcomp.co.uk with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from <addw(a)phcomp.co.uk>) id 1tHoWI-006ljH-04 for arm-netbook(a)lists.phcomp.co.uk; Sun, 01 Dec 2024 18:18:10 +0000 Received: from addw by mint.phcomp.co.uk with local (Exim 4.96) (envelope-from <addw(a)phcomp.co.uk>) id 1tHoWC-00CAqy-27 for arm-netbook(a)lists.phcomp.co.uk; Sun, 01 Dec 2024 18:18:04 +0000 Date: Sun, 1 Dec 2024 18:18:04 +0000 From: Alain D D Williams <addw(a)phcomp.co.uk> To: Eco-Conscious Computing <arm-netbook(a)lists.phcomp.co.uk> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: base64 Organization: Parliament Hill Computers Ltd X-Spam-Score: 0.0 (/) Message-ID: <Z0yoXLgAmLN2FkGg(a)phcomp.co.uk> Message-ID-Hash: XJ5VNDGSXYMG2XZRY2ATQUBWF555ERTT X-Message-ID-Hash: XJ5VNDGSXYMG2XZRY2ATQUBWF555ERTT X-MailFrom: addw(a)phcomp.co.uk X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.8 Precedence: list Reply-To: Eco-Conscious Computing <arm-netbook(a)lists.phcomp.co.uk> Subject: [Arm-netbook] Potential trouble on this mail list - did this work ? List-Id: Eco-Conscious Computing <arm-netbook.lists.phcomp.co.uk> Archived-At: <https://lists.phcomp.co.uk/mailman3/hyperkitty/list/arm-netbook@lists.phcom…> List-Archive: <https://lists.phcomp.co.uk/mailman3/hyperkitty/list/arm-netbook@lists.phcom…> List-Help: <mailto:arm-netbook-request@lists.phcomp.co.uk?subject=help> List-Owner: <mailto:arm-netbook-owner@lists.phcomp.co.uk> List-Post: <mailto:arm-netbook@lists.phcomp.co.uk> List-Subscribe: <mailto:arm-netbook-join@lists.phcomp.co.uk> List-Unsubscribe: <mailto:arm-netbook-leave@lists.phcomp.co.uk> SSBoYXZlIG5vdyBtb3ZlZCBpdCBvdmVyLiBQb3RlbnRpYWwgaXNzdWVzOg0KDQrigKIgVGhlIG5l dyBJUCBhZGRyZXNzZXMgYXJlIDg1LjExOS44Mi4xMTQgMmEwYToxMTAwOjEwMTI6OjExNA0KICBZ b3UgbWlnaHQgc2VlIHRoZSBvbGQgb25lcyBmb3IgdGhlIG5leHQgwr0gaG91ci4NCg0K4oCiIFlv dSBtaWdodCBub3Qgc2VlIHRoaXMgZW1haWwgYXQgYWxsLg0KICBUaGlzIGlzIG9uZSBwcm9ibGVt IEkgaGF2ZSBoYWQgb24gY29udmVyc2lvbiAtLSBzb21ldGltZXMuDQoNClJlZ2FyZHMNCg0KLS0g DQpBbGFpbiBXaWxsaWFtcw0KTGludXgvR05VIENvbnN1bHRhbnQgLSBNYWlsIHN5c3RlbXMsIFdl YiBzaXRlcywgTmV0d29ya2luZywgUHJvZ3JhbW1lciwgSVQgTGVjdHVyZXIuDQorNDQgKDApIDc4 NyA2NjggMDI1NiAgaHR0cHM6Ly93d3cucGhjb21wLmNvLnVrLw0KUGFybGlhbWVudCBIaWxsIENv bXB1dGVycy4gUmVnaXN0cmF0aW9uIEluZm9ybWF0aW9uOiBodHRwczovL3d3dy5waGNvbXAuY28u dWsvQ29udGFjdC5odG1sDQojaW5jbHVkZSA8c3RkX2Rpc2NsYWltZXIuaD4NCg== <----- start object 2 -----> { '_parsemsg': False, 'envsender': 'noreply(a)lists.phcomp.co.uk', 'lang': 'en', 'listid': 'arm-netbook.lists.phcomp.co.uk', 'original_sender': 'addw(a)phcomp.co.uk', 'original_size': 1529, 'original_subject': 'Potential trouble on this mail list - did this work ?', 'received_time': datetime.datetime(2024, 12, 1, 18, 18, 10, 551642), 'recipients': { --- 305 lines removed here 'SOME-USER(a)gmail.com'}, 'rule_hits': [], 'rule_misses': [ 'dmarc-mitigation', 'no-senders', 'approved', 'emergency', 'loop', 'banned-address', 'member-moderation', 'nonmember-moderation', 'administrivia', 'implicit-dest', 'max-recipients', 'max-size', 'news-moderation', 'no-subject', 'digests', 'suspicious-header'], 'stripped_subject': 'Potential trouble on this mail list - did this work ?', 'to_list': True, 'verp': False, 'version': 3, 'whichq': 'out'} [----- end pickle -----] -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 https://www.phcomp.co.uk/ Parliament Hill Computers. Registration Information: https://www.phcomp.co.uk/Contact.html #include <std_disclaimer.h>

2 2