- Mailman-users - lists.mailman3.org

Outgoing runner lockup? + "slice inspector" tool
by Stephen J. Turnbull Feb. 1, 2025

Feb. 1, 2025

Hi, I'm advising a user on a system which experiences occasional lockups in an outgoing runner. The runner contacts a remote smarthost, and occasionally locks up with the smtp connection still open according to "lsof -i :25". This state seems to be permanent: the backlog for that slice starts to grow without bound, for at least an hour. When this was happening once a month, they would just restart Mailman core, and the backlog would clear in minutes. But recently it's been happening daily which is distracting their staff, and worries me. Another thing that is strange about this site is that it should be possible to hit that runner with a SIGUSR1 and restart it. This works for me, but on that system the stuck runner exits, but does not restart. Since normally it only happens to one runner of several, I wanted to identify the runner and process. I attach the tool I developed, for anyone who might have configured multiple runners and is interested to see the distribution across runners. Has anybody seen an outgoing runner lock up with an open smtp session? Any ideas on why? My analysis so far: - Because a restart works every time, I'm pretty sure it doesn't have anything to do with message content. - I believe both the Mailman host and the outgoing smarthost are Linodes, in the same datacenter. The problematic Mailman system is Mailman 3.3.6, Python 3.10 on Ubuntu 16.xx LTS. I believe the smarthost is a more recent Ubuntu LTS, probably running Postfix 3.7 as the MTA. (Yes, they have sufficiently paranoid security and QA teams. ;-) - We're using smtplib, which as far as I can tell basically has a 60s timeout for each command. Thus you'd think it would time out. I guess it could be inflooping on timeout, retry, timeout, retry, but I don't know how to check that. Maybe ss(8) will serve? - My system where SIGUSR1 works as documented is Python 3.11.2 on a Digital Ocean droplet with Debian 12.9, Linux 6.1.0. - I haven't tried to reproduce the Python 3.10 + Mailman 3.3.6 configuration and test SIGUSR1 in that configuration yet. Seems unlikely, waiting for the proverbial "round tuit". - It has occurred to us to use the local Postfix as the relay MTA. I'm waiting on a report whether that alleviates the problem. Even if so, I want to fix the underlying defect if possible. Any ideas would be welcome, including general debugging advice. Here's the promised slice_inspector tool. (Patches and suggestions welcome, though I don't promise to implement any time soon.) The tool imports some files from Mailman core, click, and psutil (not psutils!) I believe the latter modules are required by Mailman, so you should be able to run it as is under the 'mailman' user (or perhaps 'list' on Debian) in the environment Mailman itself uses. It defaults to assuming that mailman.cfg is /etc/mailman3/mailman.cfg. You'll probably need to fix the shebang if you want to chmod +x. The '--help' should be pretty self-explanatory. Steve

2 1

messages with attachments, without text discarded silently
by Schulz Feb. 1, 2025

Feb. 1, 2025

Using the current mailman version, I can reproduce the following: - send a text-formatted email with attachment but without text body to a list. - the msg will be received by mailman - the msg shows up in shunt, the log shows: ile "/usr/lib/python3.12/email/message.py", line 343, in set_payload payload = payload.encode(charset.output_charset, 'surrogateescape') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ UnicodeEncodeError: 'ascii' codec can't encode characters in position 10-17: ordinal not in range(128) an attempt to unpickle the file leads to the same error. I know it's uncommon to send emails without txt but with attachments - but it may happen; at least we would welcome an error message.

2 3

Occasionally "The content of this message was lost."
by Frank Richter Jan. 30, 2025

Jan. 30, 2025

Hello, occasionally we face the problem "The content of this message was lost." when handling a message on hold. We use the mailman3 packages on Debian 12: 3.3.8-2~deb12u2 GNU Mailman 3.3.8 (Tom Sawyer) Python 3.11.2 (main, Nov 30 2024, 21:22:50) [GCC 12.2.0] with postgresql, exim and Apache httpd on the same machine. To get closer to this problem we made 2 changes: /usr/lib/python3/dist-packages/mailman/app/moderator.py def _lost_message(mlist, subject, sender, message_id): # Create a substitute for a message not found in the message store. text = _("""\ The content of this message was lost. It was probably cross-posted to multiple lists and previously handled on another list. """) + # Don’t send an empty message to all members in case this event occurs. + # raise an exception instead: + raise Exception("_lost_message",subject, sender, message_id) /usr/lib/python3/dist-packages/mailman/runners/task.py def _evict_pendings(self): … messages = getUtility(IMessageStore) for msg in messages.messages: # msg can be None if file is already removed. if msg is not None: mid = msg.get('message-id') if mid not in mids: messages.delete_message(mid) # 2024-12-11 fri: Debug inserted + tlog.debug('Task runner deleted message %s', mid) count += 1 tlog.info('Task runner deleted %d orphaned messages', count) So let’s see what happens: A message sent to one list is set on hold: exim mainlog: 2025-01-28 14:10:23 1tclMF-00H6cW-1s <= user(a)s2024.tu-chemnitz.de H=vittal.hrz.tu-chemnitz.de (mail.tu-chemnitz.de) [2001:638:911:b01:134:109:133:32] P=esmtps X=TLS1.3:ECDHE_SECP256R1__RSA_PSS_RSAE_SHA256__AES_256_GCM:256 CV=no K S=9058 id=2f972b-6798d700-9f-5b841500@14907502 2025-01-28 14:10:23 1tclMF-00H6cW-1s => fsr-hsw(a)lists.tu-chemnitz.de R=lists_mailman T=mailman3_transport H=localhost [::1] C="250 Ok" 2025-01-28 14:10:23 1tclMF-00H6cW-1s Completed vette.log Jan 28 14:10:24 2025 (2602) HOLD: fsr-hsw(a)lists.tu-chemnitz.de post from user(a)s2024.tu-chemnitz.de held, message-id=<2f972b-6798d700-9f-5b841500@14907502>: The message is not from a list member A task runner deleted the message 5 seconds later: task.log Jan 28 14:10:29 2025 (2609) Task runner deleted message <2f972b-6798d700-9f-5b841500@14907502> Jan 28 14:10:29 2025 (2609) Task runner deleted 1 orphaned messages Later an owner/moderator want to do a moderation action: mailman.log: 2025-01-28 17:40:54 [FALCON] [ERROR] POST /3.1/lists/fsr-hsw(a)lists.tu-chemnitz.de/held/7544 => Traceback (most recent call last): File "falcon/app.py", line 365, in falcon.app.App.__call__ File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 155, in on_post handle_message(self._mlist, request_id, **arguments) File "/usr/lib/python3/dist-packages/mailman/app/moderator.py", line 144, in handle_message msg = _lost_message(mlist, subject, sender, message_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/app/moderator.py", line 104, in _lost_message raise Exception("_lost_message",subject, sender, message_id) Exception: ('_lost_message', 'Re: [Fsr-hsw] ...', 'user(a)s2024.tu-chemnitz.de', '<2f972b-6798d700-9f-5b841500@14907502>') Do you have any suggestions what we can do to find the reason, why the task runner deletes the message? Or any other hints … Thanks and kind regards Frank -- Frank Richter, Chemnitz University of Technology, Germany

2 1

No recent activity discussions and activity overview shown. Only a spinning wheel.
by Freerk Bosscha Jan. 30, 2025

Jan. 30, 2025

I have tried to find an equal issue, but could not find it. If so, sorry for the doubling... I have recently setup a fresh mailman3 installation on my debian12 box. It works fine. The only thing which is not working is in the archive overview I see a spinning wheel. The participants and number of discussions is increasing and the archive files are getting the archived messages. mailman -info shows: GNU Mailman 3.3.8 (Tom Sawyer) Python 3.11.2 (main, Nov 30 2024, 21:22:50) [GCC 12.2.0] config file: /etc/mailman3/mailman.cfg db url: mysql+pymysql://.....:....@localhost/mailman3?charset=utf8mb4&use_unicode=1 devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:....... mailman-web qinfo shows: -- Default 1.3.9 on ORM default -- Clusters 0 Workers 0 Restarts 0 Queued 0 Successes 100 Failures 0 Schedules 0 Tasks/day 14.00 Avg time 0.1756 Webserver: apache2/2.4.64 It looks like a AJAX problem, but not sure about that. Any help would be appriciated. Freerk What is missing

4 7

Adding Mass Subscribe custom template error
by Arte Chambers Jan. 29, 2025

Jan. 29, 2025

I am trying to test some different templates however after adding a new template I get an error when adding new list members. The member is added to the list however the welcome message isn't sent to the user. I'm getting the following error when using mass subscription on a testing list with a custom template loaded for [list:user:notice:welcome] ``` HTTP Error 400: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) ``` The template has the text "Testing Template" I'm not sure why it's timing out but when I remove the custom template it works as expected. The user is added to the list however doesn't get the custom welcome message. mailman.log: ``` [28/Jan/2025:20:22:47 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" Jan 28 20:22:52 2025 (1977989) deque: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connection.py", line 507, in getresponse httplib_response = super().getresponse() ^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 1428, in getresponse response.begin() File "/usr/lib/python3.12/http/client.py", line 331, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 292, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/socket.py", line 707, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: timed out The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 667, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 843, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment raise reraise(type(error), error, _stacktrace) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise raise value File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 789, in urlopen response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 538, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 369, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() ^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/subscriptions.py", line 362, in _step_do_subscription self.member = self.mlist.subscribe( ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/mailinglist.py", line 540, in subscribe notify(SubscriptionEvent( File "/opt/mailman/venv/lib/python3.12/site-packages/zope/event/__init__.py", line 33, in notify subscriber(event) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/membership.py", line 183, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/notifications.py", line 77, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 192, in get contents = getUtility(ITemplateManager).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 114, in get contents = protocols.get(actual_uri, **auth) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/utilities/protocols.py", line 39, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 73, in get return request("get", url, params=params, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 59, in request return session.request(method=method, url=url, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 713, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) Jan 28 20:22:52 2025 (1977989) HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 536, in _make_request response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connection.py", line 507, in getresponse httplib_response = super().getresponse() ^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 1428, in getresponse response.begin() File "/usr/lib/python3.12/http/client.py", line 331, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 292, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/socket.py", line 707, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ TimeoutError: timed out The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 667, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 843, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/retry.py", line 474, in increment raise reraise(type(error), error, _stacktrace) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/util/util.py", line 39, in reraise raise value File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 789, in urlopen response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 538, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/opt/mailman/venv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 369, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/rest/members.py", line 385, in on_post token, token_owner, member = registrar.register( ^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/subscriptions.py", line 584, in register list(workflow) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() ^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/subscriptions.py", line 362, in _step_do_subscription self.member = self.mlist.subscribe( ^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/mailinglist.py", line 540, in subscribe notify(SubscriptionEvent( File "/opt/mailman/venv/lib/python3.12/site-packages/zope/event/__init__.py", line 33, in notify subscriber(event) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/membership.py", line 183, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/app/notifications.py", line 77, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 192, in get contents = getUtility(ITemplateManager).get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/database/transaction.py", line 106, in wrapper return function(args[0], config.db.store, *args[1:], **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/model/template.py", line 114, in get contents = protocols.get(actual_uri, **auth) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/mailman/utilities/protocols.py", line 39, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 73, in get return request("get", url, params=params, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/api.py", line 59, in request return session.request(method=method, url=url, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/mailman/venv/lib/python3.12/site-packages/requests/adapters.py", line 713, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='localhost', port=8000): Read timed out. (read timeout=5) [28/Jan/2025:20:22:52 +0000] "POST /3.1/members HTTP/1.1" 400 128 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:22:52 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:22:52 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:15 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing.list.louisvillecommunitygrocery.com HTTP/1.1" 200 482 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing@list.louisvillecommunitygrocery.com/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" [28/Jan/2025:20:26:39 +0000] "GET /3.1/lists/ testing(a)list.louisvillecommunitygrocery.com/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.5" ``` Thank you, Paul 'Arte Chambers' Robey 502-408-6922

3 9

mailman3-web postorious error "invalid request block size: 14056 (max 4096)...skip"
by Frederik Jan. 28, 2025

Jan. 28, 2025

Until about one month ago, I had mailman3 and mailman3-web successfully running on Debian 12. However, when I access any page such as https://example.com/mailman3/postorius/lists/ now, I just get a 500 server error. /var/log/mailman3/web/mailman-web.log logs this at every request: invalid request block size: 14056 (max 4096)...skip I read somewhere that adding buffer-size = 65536 to uwsgi.ini might help. It indeed makes a difference, but unfortunately I just get another error instead: [pid: 4067215|app: -1|req: -1/1] () {256 vars in 14055 bytes} [Tue Jan 28 18:06:30 2025] => generated 0 bytes in 0 msecs ( 500) 0 headers in 0 bytes (1 switches on core 0) There are no other errors in the logs. I proxy mailman in Apache like this: Alias /mailman3/favicon.ico /var/lib/mailman3/web/static/postorius/img/favicon.ico Alias /mailman3/static /var/lib/mailman3/web/static <Directory "/var/lib/mailman3/web/static"> Require all granted </Directory> <IfModule mod_proxy_uwsgi.c> ProxyPass /mailman3/favicon.ico ! ProxyPass /mailman3/static ! ProxyPass /mailman3 unix:/run/mailman3-web/uwsgi.sock|uwsgi://localhost-mailman3/ </IfModule> and mailman3's uwsgi.ini looks like this: [uwsgi] uwsgi-socket = /run/mailman3-web/uwsgi.sock enable-threads = true chdir = /usr/share/mailman3-web wsgi-file = wsgi.py master = true process = 2 threads = 2 uid = www-data gid = www-data env = HOME=/tmp plugins = python3 attach-daemon = python3 manage.py qcluster logto = /var/log/mailman3/web/mailman-web.log buffer-size = 65536 Any idea what could be wrong or how to debug this further? I'm using mailman3-full 3.3.8-2~deb12u2 and mailman3-web 0+20240312-1 packages.

2 1

Filter response from Mailman3 held messages queue.
by Andy Matthews Jan. 28, 2025

Jan. 28, 2025

I'm working on an update to a portion of my team's application. It retrieves the held messages from Mailman and returns them to the client so that our admins can approve/reject them. At the moment it works as intended, but displays far too much information because Mailman is returning the entire email, with headers (see below). I've found some libraries which can parse the message property and extract the relevant bits, but I'd rather pass some sort of flag or filter to the initial Mailman 3 API call and get back less information. I've looked through the documentation but I'm not finding anything of the sort. Would this be useful? ``` { "request_id": "1", "original_size": 855, "sender": "dev(a)email.org", "subject": "Testing one two three", "hold_date": new Date(), "msg": "Received: from [127.0.0.1] (localhost [127.0.0.1])\n\t(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)\n\t key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256)\n\t(No client certificate requested)\n\t(Authenticated sender: dev(a)email.org)\n\tby mailman.default.svc.cluster.local (Postfix) with ESMTPSA id A48A33E9849\n\tfor <abc-announce(a)email.org>; Thu, 23 Jan 2025 21:24:11 +0000 (UTC)\nMessage-ID: <3ecbaccf-f65a-4ce5-bdfa-e08b5659dc32(a)email.org>\nDate: Thu, 23 Jan 2025 15:24:11 -0600\nMIME-Version: 1.0\nUser-Agent: Mozilla Thunderbird\nContent-Language: en-US\nTo: abc-announce(a)email.org\nFrom: Dev Tester <dev(a)email.org>\nSubject: Testing one two three\nContent-Type: text/plain; charset=UTF-8; format=flowed\nContent-Transfer-Encoding: 7bit\nX-MailFrom: dev(a)email.org\nX-Mailman-Rule-Hits: nonmember-moderation\nX-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation\nMessage-ID-Hash: XM4OS47LU7DRYIO74WB5K4W345NPZ37O\nX-Message-ID-Hash: XM4OS47LU7DRYIO74WB5K4W345NPZ37O\n\nThis is a single line message body.\n\n" } ```

2 2

Mailman3 breaking DKIM signatures
by Jef Driesen Jan. 24, 2025

Jan. 24, 2025

Hi, I have configured a mailman3 mailinglist to not modify the headers and body (e.g. no footer, no subject prefix, etc) to avoid breaking DKIM signatures. This worked well, until I encountered an email where the DKIM signature was still broken. After some debugging, the problem is caused by an attachment, where the mime header is changed by mailman3. The original mail contains this: --------------nYYjj8vJ8CNKuoHJZKVOQh20 Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="filename.xlsx" Content-Disposition: attachment; filename="filename.xlsx" Content-Transfer-Encoding: base64 Mailman3 modified these into this: --------------nYYjj8vJ8CNKuoHJZKVOQh20 Content-Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; name="filename.xlsx" Content-Disposition: attachment; filename="filename.xlsx" Content-Transfer-Encoding: base64 The Content-Type header is modified (word-wrapped), and this breaks the DKIM signature. How can I prevent this from happening and configure mailman to not modify the email? Jef

5 6

Python 3.13 compatibility
by peter＠chubb.wattle.id.au Jan. 24, 2025

Jan. 24, 2025

Hi Folks, I'm running the Debian-packaged mailman3 (version 3.8) which is a little behind the current 3.9 release ... Debian is now shipping Python 3.13 in 'sid'. https://docs.python.org/3/whatsnew/3.13.html#id4 says: Remove the ability to use Path objects as context managers. This functionality was deprecated and has had no effect since Python 3.9. (Contributed by Barney Gale in gh-83863.) As a result, I'm hitting tracebacks from many operations where pathlib.Path objects are used as context managers, like this one: path, fp = find(default_uri, mlist, code) ~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/utilities/i18n.py", line 157, in find for search_path in raw_search_order: ^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/utilities/i18n.py", line 117, in search templates_dir = str(resources.enter_context( ~~~~~~~~~~~~~~~~~~~~~~~^ files('mailman').joinpath('templates'))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 528, in enter_context raise TypeError(f"'{cls.__module__}.{cls.__qualname__}' object does " f"not support the context manager protocol") from None TypeError: 'pathlib._local.PosixPath' object does not support the context manager protocol Given that the python3.13 change is only to move a noop to an exception, it may be that this is a bug for python 3.9 and up as well. Peter C

2 1

m3 database sizing
by Alexander Inzinger-Zrock Jan. 23, 2025

Jan. 23, 2025

Ahoi, has anyone A) spent thoughts (and is willing to share them) about database sizing for an mailman3-production-system? like: space per user + other data + estimated growth = warning to give to my database-admin or B) has some empirical values and would like to share? greetings aiz P.S. this post is related to another about database contents

3 3