- Mailman-users - lists.mailman3.org

Archive date/time vs elapsed time
by Mark 28 Jun '23

28 Jun '23

Hi In the archive's "Recent", "Most active" etc displays, the date and time of each post is shown. However, when viewing by "Thread" listing, each post shows the elapsed time since it was posted ie. the number of days, hours since it was posted (eg. 1 day, 2 hours). Is it possible to set Hyperkitty to display the "Thread" listing with the date/time in place of that elapsed time? Thanks Mark

2 4

Postorius claims 2 messages held when there are none - out of sync
by Ken Alker 27 Jun '23

27 Jun '23

When I view a list via Postorius the "Held Messages" menu item has an inverse-red-"2" next to it, as if there are two held messages. There are, in fact, no messages in "/opt/mailman/mm/var/queue/*" (assuming the held messages should be in "pipeline" subdirectory). When I click on "Held Messages" I get "Something went wrong" followed by "HTTP Error 500: {"title": "500 Internal Server Error"}". How do I fix this?

3 8

Message is received but is not sent out. Another, similar message, is processed fine.
by Allan Hansen 27 Jun '23

27 Jun '23

Hi all, One of my subscribers is trying to send a message to a list, but it is not being posted. The smtp.log shows that her first message was posted, but a second message (with 2 retries) was not: mailman@list:~/logs$ grep herName smtp.log Jun 18 11:22:05 2023 (1243316) ('127.0.0.1', 56686) >> b'MAIL FROM:<herName(a)hotmail.com> SIZE=40109' Jun 18 11:22:05 2023 (1243316) ('127.0.0.1', 56686) sender: herName(a)hotmail.com Jun 18 11:25:01 2023 (1243318) <CH3PR12MB82593510B90D8F05177C606BBE5EA(a)CH3PR12MB8259.namprd12.prod.outlook.com> post to theList(a)domain.tlc from herName(a)hotmail.com, 40061 bytes Jun 18 11:52:42 2023 (1243316) ('127.0.0.1', 48448) >> b'MAIL FROM:<herName(a)hotmail.com> SIZE=18343' Jun 18 11:52:42 2023 (1243316) ('127.0.0.1', 48448) sender: herName(a)hotmail.com Jun 18 19:01:04 2023 (1243316) ('127.0.0.1', 59550) >> b'MAIL FROM:<herName(a)hotmail.com> SIZE=19123' Jun 18 19:01:04 2023 (1243316) ('127.0.0.1', 59550) sender: herName(a)hotmail.com Jun 26 17:18:11 2023 (1243316) ('127.0.0.1', 44732) >> b'MAIL FROM:<herName(a)hotmail.com> SIZE=18930' Jun 26 17:18:11 2023 (1243316) ('127.0.0.1', 44732) sender: herName(a)hotmail.com At the second retry she copied me and I saw nothing untowards in her message. She's not getting any error return messages and her subscription is OK. Both messages were multipart/alternative and both contained Hebrew text. I told her I'd look at this, but I'm at a loss. Yours, Allan

3 6

Problems after upgrading from bullseye to bookworm
by Eggert Ehmke 27 Jun '23

27 Jun '23

I upgrade my server to bookworm. In the process python was upgraded from 3.7 to 3.9 . I reinstalled the virtualenv and the mailman packages. When I now start mailman-web, I get this in web/logs/uwsgi-error.log: pkg_resources.DistributionNotFound: The 'flufl.lock>=4.0' distribution was not found and is required by hyperkitty What did I miss? ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Replaced multipart/alternative part with first alternative.

5 5

attachment.html
by Sam Darwin 27 Jun '23

27 Jun '23

Hi, Using a typical modern email client such as Gmail, the messages are usually html formatted. Then, Hyperkitty displays attachment.html on every message. Can that be removed? I was searching for the topic "attachment.html" in the archives and there wasn't much information. What finally cracked the code was Mark's comment: If in Postorius on the list's Settings -> Alter Messages page, Filter Content and Convert html to plaintext are both Yes, the HTML should be converted to plain text and that should appear in HyperKitty. It turns out "Filter content" affects many settings. It's easy to skip over that. I wonder if the UI might call attention somehow, with a graphic element, or with text: "Settings on this page will not take effect. Because 'Filter content' has not been enabled". It is right that "Filter content" must be set in order to remove attachment.html ? And now, a search will have more results. :-)

2 3

clicking on a username when viewing a thread results in "Page not found"
by Ken Alker 27 Jun '23

27 Jun '23

If I click on a username when viewing a thread, it returns "Page not found" then "This page either doesn't exist, or it moved somewhere else.". Any idea why this may be happening? Also, why is it that some usernames are not clickable (ie. black text with no hyperlink)? Thanks! Ken

3 4

old usernames appearing in mailman.log
by Ken Alker 27 Jun '23

27 Jun '23

I have just migrated from a mailman 3.2.2 Debian package installation to a mailman 3.3.8 source install (in a Python virtual environment as mailman user) on an Ubuntu 20.04.6 LTS system. Several months ago, the system had been upgraded from mailman V2 to mailman V3.2.2. The server has been active for over 20 years. I've just taken on the project so I'm new to all of this, and one thing I noticed that caught my eye, and has left me curious, is that for the first a couple of seconds starting just after midnight every night (just after log rotation) mailman.log would have many (dozens, or hundreds) of lines entered in it just like this one: Jun 19 00:00:04 2023 (2266) 127.0.0.1 - - "GET /3.0/users/old-user(a)domain.tld HTTP/1.1" 404 58 where "old-user(a)domain.tld" is the email address of a user who either had unsubscribed or changed their email address (I don't know which, I just know they are no longer a member/subscriber to the list). Each successive entry in the log would have a different "old username" in it. I don't understand why these entries would be in the log and what they mean. Can someone shed some light on this for me? This is merely a question of curiosity, and not one of import. (Since migrating from 3.2.2 to 3.3.8 this behavior has stopped, be that GOOD or BAD.) Ken

2 8

Global ban using regex
by Henrik Rasmussen 27 Jun '23

27 Jun '23

Using some regex testers and generators like https://regex101.com and https://www.site24x7.com/tools/regex-parser.html, the regex (.*)(a)inker\.azerbaijan\.su seems to match EVERYTHING(a)inker.azerbaijan.su (EVERYTHING is constantly changing in current spam mails). However, entering the regex to the Global Ban Add ban /postorius/bans/ result in: `An error occurred: Invalid Parameter "email": Expected a valid email address or regular expression, got (.*)(a)inker\.azerbaijan\.su.'` Same result when using [Ban list] in postorius/lists/[LISTNAME]/bans/. Entering a none regex addresses like eknejfj(a)inker.azerbaijan.su works fine. Does Mailman use a different regex syntax I am using GNU Mailman 3.3.4 (Tom Sawyer) and Mailman Core Python Version 3.8.10 (default, May 6 2021, 06:30:44) [GCC 9.3.0] (maxking/mailman-core:0.3 and maxking/mailman-web:0.3)

2 1

starting gunicorn per mailman.log yet gunicorn not installed
by Ken Alker 27 Jun '23

27 Jun '23

I see the below in my mailman.log, yet I installed uwsgi and NOT gunicorn. My mainmanweb.service file includes "ExecStart=/opt/mailman/venv/bin/uwsgi --ini /etc/mailman3/uwsgi.ini" and not the gunicorn equivalent. Does this log entry make sense in my case? [2023-06-22 12:44:36 -0700] [411132] [INFO] Starting gunicorn 20.1.0

4 7

messages stuck in the bad queue
by Ken Alker 26 Jun '23

26 Jun '23

I am working on a mail server that was migrated from mailman V2 to mailman V3 in February. I just noticed that there are over 1000 messages in the bad queue. All of the messages in the bad queue are dated 2/2/23 and all have a timestamp within a one-hour window of each other. I used mailman qfile to inspect five random emails in the bad queue and so far they are all "successfully subscribed" emails, but I presume there are no guarantees there aren't others mixed in there that might be legitimate emails (ie. I just unshunted 140 emails in the shunt queue and they were all good emails and all got processed). I figure that the easiest way to inspect these 1000 emails is just to have them re-delivered. I tried moving one from the bad queue to the shunt queue and I ran "mailman unshunt" but nothing happened. Is there a way to reprocess the bad queue? Also, what exactly is the bad queue? Thank you, Ken KA6KEN (happy field day weekend)

2 4

re-injecting emails that were not archived
by Ken Alker 25 Jun '23

25 Jun '23

I have just migrated from a mailman 3.2.2 Debian package installation to a mailman 3.3.8 source install (in a Python virtual environment as mailman user) on an Ubuntu 20.04.6 LTS system. Several months ago, the system had been upgraded from mailman V2 to mailman V3.2.2. I noticed when I came onto the project last week that there were 140 messages stuck in the "shunt" queue for the two lists hosted by this server (I have no idea why and the old logs were not available and I don't recall the results of "mailman qfile", assuming that had shed some light on the reason why they were shunted). In any event, I unshunted these messages and they flowed out to the subscriber's email addresses successfully. What I was not expecting is that the system did not inject any of these emails into the archive. AFAICT, the messages are no longer anywhere on the system (but I could be mistaken). Here are my questions: 1) Why would these emails not have been injected into the archive? 2) Is there some way for me to re-inject these messages into the two lists? The only place I (THINK I) have them is in my own personal IMAP box since I'm a subscriber to the lists. 3) Can this be done without the emails being re-delivered to subscribers? Thank you, Ken

2 1

Re: migratng from 3.2.2 Debian packages to 3.3.8 source install - web server question
by Ken Alker 25 Jun '23

25 Jun '23

As an aside, for anyone else who is trying to do the same (and to give some background into my procedures so far), I have been following these references: <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…> <https://docs.mailman3.org/en/latest/install/virtualenv.html#setup-virtualenv> My goal is to create the least change to file locations and configuration files as possible (I may move things into more "source-installed centric" locations once I have things working again), thus, many files are still in the original Debian package-allocated directories. That said, I was forced to move mailman3web.db to /opt/mailman/web as sqlite (and, hence, mailman-web) simply could not open the database as user mailman from my virtual environment (even with mailman3web.db file permissions set to 777 and owner.group set to mailman.mailman). So far I've gotten mailman running properly and handling the mailing lists, however, I have not gotten the web interface working again.

2 6

Importing MBOX from custom listserv to MM3?
by Thomas Ward 25 Jun '23

25 Jun '23

We are looking at moving from a home grown listserv system at a client to potentially MailMan3 for the lists platform instead. We have historic thread data from the homegrown systems in mbox form. Is there a way to import that into MM3 for indexing in the archiver there so we dont need to keep the (literally massive) MBOX file? Sent from my Galaxy

2 2

Importing mbox file into MM3
by Mark 23 Jun '23

23 Jun '23

Hi All I'm trying to import a large mbox file from a MM2 list into a new list on MM3. The new MM3 list has 3 test emails in its archive. # cd /usr/share/mailman3-web/ # python3 manage.py hyperkitty_import -l LISTNAME@DOMAIN /home/mark/tmp/LISTNAME.mbox Importing from mbox file /home/mark/tmp/LISTNAME.mbox to LISTNAME@DOMAIN Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the Django admin command with arguments 'update_index_one_list LISTNAME@DOMAIN'. That all seems pretty good. Then I attempt to rebuild the archive. # python3 manage.py update_index_one_list LISTNAME@DOMAIN Indexing 3 emails The import or rebuild has failed as it's just rebuilding the existing archive of the 3 test messages. What am I doing wrong? Thanks Mark

2 2

Where in database are subject prefix sequences stored?
by Thomas Ward 22 Jun '23

22 Jun '23

I am using numeric prefixes for a list, such that it's `[ListName-000012]`. Where would that sequence indicator be stored in the database? Postorious' database? Hyperkitty's database? I ask because I'm rebuilding a home-grown listserv solution using Mailman3 and the main requirement is the thread IDs being *properly sequential* with the current implementation, so I have to set the "next ID in sequence" to a start value. I don't see this clearly in the DB where the sequence value would be stored, so if anyone knows that'd be great to know so I can get this working. Thomas

2 2

Help needed to create filters that were working in Mailman 2.
by mrl＠psfc.mit.edu 22 Jun '23

22 Jun '23

How do I make a filter that if it matches, it accepts the message and doesn't check the remaining filters? I could do this using the anti-spam filters in mailman 2, as there was a Accept option. But there is no Accept option in Mailman 3 (that I can find). I tried using "Default antispam action", but that didn't stop the rest of the filters from being applied. Thanks for any suggestions. - Mark

3 4

toward improving correctness when running on single core system ...
by Nelson Strother 21 Jun '23

21 Jun '23

I recognize that most real computer systems now are equipped with multiple CPUs, usually with each CPU having multiple cores or hardware threads. But when one obtains a computer system from a service provider with a small expected load, it is likely that a virtual computer system will provide only a single core. Yes, one can obtain a multi-core virtual system, maybe for only twice the cost; but it would seem wasteful to make that choice solely to support starting and stopping the Mailman3 program when the system load at all other times is satisfied by a single core system. From my observations, mailman 3.3.8 is unreliable when running on a single core system. When `mailman start` is issued, there is a moderately high probability that one or more of the thirteen runner processes will not survive this startup phase. Depending upon the current usage of the mailman installation, one may or may not notice this fact. In either case, `mailman status` provides the same information, with no hint of missing or damaged capabilities when one or more of the runner processes are stillborn. [1] One potential improvement would be to increase the lifetime of the locks used by each of the runner processes during `mailman start`. [2] Based on a small sample of runs of `mailman start`, this change may provide correctness (i.e. I have yet to see a runner process go MIA). But it still seems unsatisfactory for availability / performance, as the elapsed wall clock time for the system to settle down and be functional and responsive is approximately 13 minutes. While this is an improvement from the 20 minute or greater delays observed before making this change, it still differs greatly from the nearly instantaneous startup time experienced on multicore / multiprocessor systems. The best "performance" I have yet obtained on this single core system is WITHOUT the change in [2] below, but by crossing abstraction boundaries and reducing the amount of time this single CPU spends futilely busy waiting for itself when it has not provided an opportunity for another process (maybe even the process currently holding the desired lock) to make any progress. [3] With this change, "only" 9 minutes elapsed wall clock time is wasted (with maybe only the middle 4 minutes at 100% CPU utilization) before the system settles down and is functional and responsive. However, ample room for improvement remains. [4] Please suggest better ideas or corrections. Nelson [1] For a few examples of these failures, see: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… [2] Here is a diff from the original mailman/database/factory.py (or .../mailman/.local/lib/python3.9/site-packages/mailman/database/factory.py if you wish to apply this to an installed system): > 25a26 > > from datetime import timedelta > 53c54,55 > < with Lock(os.path.join(config.LOCK_DIR, 'dbcreate.lck')): > --- > > with Lock(os.path.join(config.LOCK_DIR, 'dbcreate.lck'), > > timedelta(seconds=30)): which increases the delay from the default of 15 seconds to 30 seconds before another process will be empowered to break the lock being held by one of mailman's runner processes, which leads to the death of a process. [3] Here is a diff from the original .../mailman/.local/lib/python3.9/site-packages/flufl/lock/_lockfile.py : > 7a8 > > import subprocess > 338a340,344 > > if sys.platform.startswith('linux') and \ > > (len(subprocess.check_output(["lscpu", "-p"]).splitlines()) == 5): > > # there is only one processor [four lines of comments, and only one line for one CPU] > > # let another process run before joining the traffic jam for this lock > > os.system('sleep 20s') For possible similar benefits on other platforms, one should also include variations on this theme using something like e.g.: > > if sys.platform.startswith('win32') and \ > > subprocess.check_output('wmic path win32_Processor get NumberOfLogicalProcessors').strip().endswith(b'1'): I seriously doubt all (or even any?) other users of the flufl.lock package would benefit from this exact change ... but many may benefit from sleeping for e.g. a half-second when on a single core? In the case of Mailman3, sleeping for a fixed duration shorter than 20 seconds retains the original problem of broken locks and runner process death, while sleeping for a fixed duration longer than 20 seconds leads to an increase in both the wall clock delay time as well as the CPU time consumed during `mailman start`. I have not experimented with random or staggered delays, which may further reduce the number of simultaneously blocked waiters for this lock. [4] I have seen `mailman start`complete in less than 1 second wall clock time on a multicore / multiprocessor system. All of these observations made with mailman 3.3.8 as installed via pip.

5 8

How to tell who moderated a post?
by bryan.kartzman＠yu.edu 21 Jun '23

21 Jun '23

Is there any way to tell which moderator of a list approved a particular post to that list?

2 3

Re: mailman3 auto-disabling of subscriptions
by Mark Sapiro 19 Jun '23

19 Jun '23

On 6/17/23 17:02, Mike Wertheim wrote: > I set `remove_dkim_headers: yes` in the [mta] section of mailman.cfg. > > I'm seeing a bunch of these errors in the logs: > 2023-06-17 18:57:11 1qAbMA-005Y7W-HP ** mike.wertheim(a)gmail.com > <mailto:mike.wertheim@gmail.com> R=dnslookup_single_domain > T=remote_smtp_single_domain H=alt2.gmail-smtp-in.l.google.com > <http://alt2.gmail-smtp-in.l.google.com> [172.253.62.26]: SMTP error > from remote mail server after end of data: 550-5.7.26 Unauthenticated > email from gmail.com <http://gmail.com> is not accepted due to > domain's\n550-5.7.26 DMARC policy. Please contact the administrator of > gmail.com <http://gmail.com> domain\n550-5.7.26 if this was a legitimate > mail. Please visit\n550-5.7.26 > https://support.google.com/mail/answer/2451690 > <https://support.google.com/mail/answer/2451690> to learn about the\n550 > 5.7.26 DMARC initiative. > w13-20020a05622a190d00b003fde5babbf5si1170418qtc.14 - gsmtp Your issue is mail From: the gmail.com domain to the list and sent to gmail users is being bounced because it fails DMARC. I.e. Gmail applies a DMARC policy of p=reject to mail From: gmail.com even though it's published DMARC policy is p=none. You need to apply DMARC mitigations to this mail. Unfortunately, this requires setting DMARC Mitigate unconditionally to Yes. Mailman 2.1 has a feature to apply DMARC mitigation to messages From: specific domains regardless of any domain specific DMARC Policy. Unfortunately this hasn't been implemented in Mailman 3 yet. I just filed https://gitlab.com/mailman/mailman/-/issues/1084 for that. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 1

Where does sender postorius@ come from?
by Jens Günther 19 Jun '23

19 Jun '23

I just realized, that mails for registering an account and/or resetting ones password are obviously sent from postorius@SERVE_FROM_DOMAIN. Why are they not sent from MAILMAN_ADMIN_EMAIL? The problem is: - an account is trying to register with a mailaddress from a HostEurope-server - HostEurope-Servers are doing Sender-Callouts (bad practise :-D) to verify that a mailaccount exists - mail is then bouncing, b/c those are not answered (shoud I?): status=bounced (host [80.237.138.5] said: 550-Sender verification is required but failed. - bounce then can't be processed, since mailaccount does not exist :-D status=bounced (mail for SERVE_FROM_DOMAIN loops back to myself) Am I missing something are shouldn't it be better to send those mails from MAILMAN_ADMIN_EMAIL? (I don't want to mess with these sender callouts or change anything, HostEurope has been a little bit of a pain in the ... with mailinglists and not much help at all). Thanks in advance, Jens.

3 8

Proxy error.
by Mark London 18 Jun '23

18 Jun '23

My server has several aliases. And Chrome's cookies sometimes get messed up because of it. Several users get a proxy error when trying to connect to the mailman website. One person just fixed it by clearling cookies, although this is not a great solution. Error log says "You may need to add 'psfcmail2.psfc.mit.edu' to ALLOWED_HOSTS". But it is already there in /etc/mailman/settings.py Or should it go elsewhere? Thanks. - Mark Chrome: Proxy Error The proxy server received an invalid response from an upstream server. The proxy server could not handle the request Reason: Error reading from remote server Apache/2.4.52 (Ubuntu) Server at lists.psfc.mit.edu Port 443Error log: ERROR 2023-06-18 19:11:11,568 2114 django.security.DisallowedHost Invalid HTTP_HOST header: 'psfcmail2.psfc.mit.edu'. You may need to add 'psfcmail2.psfc.mit.edu' to ALLOWED_HOSTS. Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/handlers/exception.py", line 56, in inner response = get_response(request) File "/opt/mailman/venv/lib/python3.10/site-packages/django/utils/deprecation.py", line 135, in __call__ response = self.process_request(request) File "/opt/mailman/venv/lib/python3.10/site-packages/django/middleware/common.py", line 48, in process_request host = request.get_host() File "/opt/mailman/venv/lib/python3.10/site-packages/django/http/request.py", line 152, in get_host raise DisallowedHost(msg) django.core.exceptions.DisallowedHost: Invalid HTTP_HOST header: 'psfcmail2.psfc.mit.edu'. You may need to add 'psfcmail2.psfc.mit.edu' to ALLOWED_HOSTS

1 1

mailman3 auto-disabling of subscriptions
by Mike Wertheim 17 Jun '23

17 Jun '23

I'm running an email list on mailman3. My users are getting inundated by messages saying that their subscriptions have been disabled due to their bounce score exceeding the mailing list's bounce_score_threshold. But there is nothing wrong with these users' email accounts. They are all perfectly fine. Apparently the issue is somehow related to spam. Whenever I (as admin) get these emails, I just unsubscribe the user and then re-subscribe them. But also, the user gets confused and emails me about it, which unnecessarily takes up their time and mine. The relevant list settings are currently... bounce score threshold: 5 bounce info stale after: 7d bounce disabled warning interval: 7d bounce disable warnings: 5 What's the best way to fix this? I'm considering reducing "bounce info stale after" to "2d" and/or increasing "bounce disabled warning interval" to "90d".

3 5

Postorius -owner messages
by ssehi＠nebraska.edu 16 Jun '23

16 Jun '23

I manage a number of lists for non-technical users that are considered owners of their own lists. Some of them have expressed that they would like to emulate some other mailing list services' "Quiet" owners for people that need to be able to access the list settings for administrative reconciliation as well as a fallback, but want to leave subscription requests or approval of messages to others that are more involved in the day-to-day management. They'd like to disable owner delivery for themselves, and I'd like to not make the change for them using the shell every time I get one of their requests. We have a Postorius front end set up and working, but it doesn't appear that disabling delivery using the List-based preferences in the Postorius interface stops those Owner communications. Is there a way to allow users to disable that natively in Postorius? Thanks, Sam

2 2

Apache proxy error messages.
by Mark London 15 Jun '23

15 Jun '23

I have two users who are getting a proxy error message when they try to connect her our mailman server: Proxy Error The proxy server received an invalid response from an upstream server. The proxy server could not handle the request Reason: Error reading from remote server Apache/2.4.52 (Ubuntu) Server at lists.psfc.mit.edu Has anybody else in an errorlike this before? One person manage to get around this by going in incognito mode on the browser. Does that make any sense?

2 1

unrequested unsubscription
by Mike Wertheim 15 Jun '23

15 Jun '23

I have a Mailman 3 email list, running on Mailman 3.3.3 on Debian 11. A few of the list members are reporting that they received Email Address Unsubscription Confirmation emails, but claim that they never requested to be unsubscribed. (All are Gmail users. but they might be coincidental, since most list members are Gmail users.) Has anyone seen this behavior before? Any ideas on what might be happening?

3 3

SSO
by bryan.kartzman＠yu.edu 15 Jun '23

15 Jun '23

Is it possible to set up SSO so that once users (owners,moderators) set up an account in Postorius on the mailman3 server we have created , they can authenticate against Azure to login instead of the password for the local account Postorius created?

2 1

How to remove a message with an invalid Message-Id?
by McGuire, Tommy M. (MSFC-IS61)[EAST2] 14 Jun '23

14 Jun '23

I have a fun problem: apparently a message sent to a mailing list has an invalid Message-Id (I think), which is causing the message parse to fail while attempting to archive the message. Unfortunately, the message seems to be trapped somewhere and resulting in error logging every few minutes. Is there any way to find and remove the message? Literally, the only thing I've been able to find out about it is that the Message-Id contains the text "[83c48dddbea7492e873224a5ae1c04be-JFBVALKQOJXWILKNK4YVA7CBPJ2XEZKEMV3E64DTPRCW2YLJNR6EK6DPKNWXI4A=(a)microsoft.com]>". The actual errors in the mailmanweb.log are: ERROR 2023-06-14 21:49:40,692 3165793 django.request Internal Server Error: /archives/api/mailman/archive Traceback (most recent call last): File "/usr/local/lib/python3.8/email/_header_value_parser.py", line 2069, in get_msg_id token, value = get_dot_atom_text(value) File "/usr/local/lib/python3.8/email/_header_value_parser.py", line 1334, in get_dot_atom_text raise errors.HeaderParseError("expected atom at a start of " email.errors.HeaderParseError: expected atom at a start of dot-atom-text but found '[83c48dddbea7492e873224a5ae1c04be-JFBVALKQOJXWILKNK4YVA7CBPJ2XEZKEMV3E64DTPRCW2YLJNR6EK6DPKNWXI4A=(a)microsoft.com]>' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/app/mailman/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/app/mailman/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 115, in _get_response response = self.process_exception_by_middleware(e, request) File "/app/mailman/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/app/mailman/venv/lib/python3.8/site-packages/django/views/decorators/http.py", line 40, in inner return func(request, *args, **kwargs) File "/app/mailman/venv/lib/python3.8/site-packages/hyperkitty/views/mailman.py", line 118, in _decorator return func(request, *args, **kwargs) File "/app/mailman/venv/lib/python3.8/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view return view_func(*args, **kwargs) File "/app/mailman/venv/lib/python3.8/site-packages/hyperkitty/views/mailman.py", line 164, in archive add_to_list(mlist_fqdn, msg) File "/app/mailman/venv/lib/python3.8/site-packages/hyperkitty/lib/incoming.py", line 65, in add_to_list msg_id = get_message_id(message) File "/app/mailman/venv/lib/python3.8/site-packages/hyperkitty/lib/utils.py", line 60, in get_message_id msg_id = email.utils.unquote(re.sub(r'\s', '', message['Message-Id'])) File "/usr/local/lib/python3.8/email/message.py", line 391, in __getitem__ return self.get(name) File "/usr/local/lib/python3.8/email/message.py", line 471, in get return self.policy.header_fetch_parse(k, v) File "/usr/local/lib/python3.8/email/policy.py", line 163, in header_fetch_parse return self.header_factory(name, value) File "/usr/local/lib/python3.8/email/headerregistry.py", line 607, in __call__ return self[name](name, value) File "/usr/local/lib/python3.8/email/headerregistry.py", line 202, in __new__ cls.parse(value, kwds) File "/usr/local/lib/python3.8/email/headerregistry.py", line 535, in parse kwds['parse_tree'] = parse_tree = cls.value_parser(value) File "/usr/local/lib/python3.8/email/_header_value_parser.py", line 2126, in parse_message_id token, value = get_msg_id(value) File "/usr/local/lib/python3.8/email/_header_value_parser.py", line 2073, in get_msg_id token, value = get_obs_local_part(value) File "/usr/local/lib/python3.8/email/_header_value_parser.py", line 1516, in get_obs_local_part if (obs_local_part[0].token_type == 'dot' or IndexError: list index out of range The errors in the mailman.log are even less useful; they're basically copies of the HTML error page. Jun 14 17:05:02 2023 (3165816) HyperKitty failure on https://lists.nasa.gov/archives/api/mailman/archive: ... <div class="alert alert-danger">An error occurred while processing your request.</div> ... Jun 14 17:05:02 2023 (3165816) Exception in the HyperKitty archiver: ... Jun 14 17:05:02 2023 (3165816) Traceback (most recent call last): File "/app/mailman/venv/lib/python3.8/site-packages/mailman_hyperkitty/__init__.py", line 151, in _archive_message url = self._send_message(mlist, msg) File "/app/mailman/venv/lib/python3.8/site-packages/mailman_hyperkitty/__init__.py", line 207, in _send_message raise ValueError(result.text) ValueError: ... <div class="alert alert-danger">An error occurred while processing your request.</div> ... Any help would be appreciated! Tommy M. McGuire Tommy.M.McGuire(a)nasa.gov

2 1

Is there a simple way to remove the footer without having to add a customized template?
by Mark London 14 Jun '23

14 Jun '23

I simply want to have no footer for a mailing list. Can I do that without having to create a customized template? Thanks.

3 2

Re: Why is a mailing list not sending the moderator subscribe or post notifications?
by Mark London 14 Jun '23

14 Jun '23

Argh, that is it! Thanks!!!! Admin immed notify YesNo Should the list moderators get immediate notice of new requests, as well as daily notices about collected ones? List moderators (and list administrators) are sent daily reminders of requests pending approval, like subscriptions to a moderated list, or postings that are being held for one reason or another. Setting this option causes notices to be sent immediately on the arrival of new requests as well. On 6/14/2023 4:36 AM, Odhiambo Washington wrote: > *action to take when _a post is held for moderation_*

1 0

Why is a mailing list not sending the moderator subscribe or post notifications?
by Mark London 14 Jun '23

14 Jun '23

Hi - I migrated from mailman 2 to mailman 3. All but one list is working correctly. That list is not sending the moderator any emails. It appears to configured exactly like the other lists. I.e. subscription requests and moderated users posts don't generate any emails to the moderator (me). I tried changing moderator email addresses, and everything else I could think of, but nothing worked. What can I do to debug this problem? This list is much larger than any of my other lists. And has a huge archive. I doubt that is a factor, but I’ll mention it anyway. Also, how do I run the command to remind me of awaiting moderation requests, so that I can run it hourly? In case this can’t be fixed quickly. As an aside, I had some mailman 2 lists that had no moderators. I could swear that for them, that the owners would get moderated requests. Am I hallucinating? I can't check the old server any longer. Thanks. – Mark

2 1

Setting moderation_action when approving a message from a non-member fails
by Tom Smyth 13 Jun '23

13 Jun '23

Hello! When a message is held due to it being from a non-member, I notice that Mailman creates a non-member record for the sender automatically. This is great! But if I try to set their moderation action while approving the message in Postorius, I get: Failed to set moderation action: xxx(a)gmail.com is not a member address of xxx(a)xxx.org Is this expected? I would like to be able to set the moderation action for the non-member that has already been created. I am on Postorius v1.3.2. Thanks! -- Tom Smyth (he/him)

3 2

Read-Mostly list?
by Stephen Daniel 10 Jun '23

10 Jun '23

I wish to have a list that anyone can read. A few designated people can post without moderation, and all other users are moderated. Is this possible? I don't see a way in the list settings to create users who are not moderated when the default action is to moderate. Thanks! -- Steve

2 2

Mailman sends Welcome emails, but does not send [List] postings emails
by justfixit＠marilynstrother.com 10 Jun '23

10 Jun '23

Having recently installed this same version of mailman (GNU Mailman 3.3.8 (Tom Sawyer)) a few times successfully, I have a puzzle with a current new installation. Via the command line I can create lists and add members, and the new members receive their Welcome message from mailman. But when a member sends an email to post to a list (e.g. hc(a)cs.org as shown here), the mailserver delivers it to mailman: May 29 16:36:58 localhost postfix/lmtp[44386]: E762E427CB: to=<hc(a)cs.org>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.84, delays=0.8/0/0.01/0.03, dsn=2.0.0, status=sent (250 Ok) but no copy is sent to the members / subscribers. After the posts are received by mailman (as recorded in /var/tmp/mailman/logs/smtp.log), nothing more is added in any of the log files in /var/tmp/mailman/logs/... An attempt to imitate a technique seen elsewhere for [logging.smtp] for leaving some breadcrumbs by adding into mailman.cfg: - - - [logging.subscribe] level: debug path: mailman.log - - - and restarting mailman led to no detectable change. Expecting no change, I even changed for one UNmoderated list: >>> dump_json('http://localhost:8001/3.1/lists/hc.cs.org' ... '/config/default_member_action', ... dict(default_member_action='accept'), 'PATCH', ... username='...', password='...') date: Mon, 29 May 2023 16:31:31 GMT server: gunicorn status: 204 the default_member_action from 'defer' to 'accept' to rule out some moderation process delay. How can I enable some kind of trace or gather more information to learn where this configuration is in error? Cheers, Nelson

5 17

Migration failure (2.1.29 to 3.3.8 on Debian testing)
by {16/7} 08 Jun '23

08 Jun '23

Hello, I have both the mailman and mailman3-full packages installed on my machine and I'm following the migration guide located here: https://docs.mailman3.org/en/latest/migration.html Running the command { mailman import21 mylist(a)mysite.com /var/lib/mailman/lists/mylist/config.pck } completes once I create the list but states that it cannot convert the msg_footer and digest_footer mailing list attributes. (I might also point out that the { mailman create mylist(a)mysite.com } command isn't actually documented on that webpage.) I can't seem to find the manage.py script in my $PATH and after searching, I find it as part of the mailman3-web package. When I run { sudo -H -u list python manage.py hyperkitty_import mylist(a)mysite.com /var/lib/mailman/archives/private/mylist.mbox/mylist.mbox }, it fails with "ImportError: No module named django.core.management". If I run the script directly as { sudo -H -u list /usr/share/mailman3-web/manage.py ... }, I get "PermissionError: [Errno 13] Permission denied: '/usr/share/mailman3-web/settings_local.py'". By default, settings_local.py's group is www-data, and not knowing where to go next, I decided to try changing that file's group to list. When I re-ran the command (as user list), I got a Python traceback that gives "PermissionError: [Errno 13] Permission denied: '/var/log/mailman3/web/mailman-web.log'". Next, I changed the file's group back to list and decided to try running the manage.py script as the www-data user. This results in "/usr/lib/python3/dist-packages/django_q/conf.py:139: UserWarning: Retry and timeout are misconfigured." and "System check identified some issues:" followed by a list of "Auto-created primary key used when not defining a primary key type, by default 'django.db.models.AutoField'" warnings for a number of Django tables. At the end of this list is "CommandError: The list address must be given on the command-line". But it *was* given. My questions are: 1. How do I undo any damage (if any) my efforts may have caused? 2. What's the correct way to run manage.py?

3 4

Subscribe to a list on a Mailman3 server without account registration
by c.buhtz＠posteo.jp 06 Jun '23

06 Jun '23

Hello, I might miss something here but I'm confused about a difference between Mailman2 and 3. On MM2 I just subscribed a mailinglist via my EMail address. I didn't need to create an account on the MM2 server first. But it seems on MM3 it is otherwise. For example I use MM3 on python.org. It seems I have to register first before subscribing to a mailing list. https://mail.python.org/mailman3/lists/twisted-web.python.org/ Is this observation correct? Kind Christian

2 1

mailman break DKIM signature by modifying body
by Peter Münster 06 Jun '23

06 Jun '23

Hi, I'm using mailman 3.3.8. Some messages with attachments from Google users get rejected by spam filters because of invalid DKIM signatures. It seems, that mailman alters some lines in the body. Here an example: Original message: --8<---------------cut here---------------start------------->8--- Lines: 2031 --000000000000f846c505fc494b7a-- --000000000000f846c705fc494b7c Content-Type: application/pdf; [...] Content-Disposition: attachment; [...] --8<---------------cut here---------------end--------------->8--- Altered message: --8<---------------cut here---------------start------------->8--- Lines: 2032 --000000000000f846c505fc494b7a-- --000000000000f846c705fc494b7c Content-Type: application/pdf; [...] Content-Disposition: attachment; [...] --8<---------------cut here---------------end--------------->8--- An empty line is added, and the spaces after the semicolons are removed. Perhaps related to https://gitlab.com/mailman/mailman/-/issues/1079. What could I do please, to prevent such modifications of the body? TIA for any help, -- Peter

2 8

Why are "Subscription options" left unselected if I don't manually select them?
by mrl＠psfc.mit.edu 01 Jun '23

01 Jun '23

When I subscribe to a mailing list, and I don't manually select some of the "Subscription options", they are left unselected when I go back to look at them. I would have thought that if I didn't make a selection, that they would be set to a default option. Or am I wrong? Thanks.

5 7

dmarc mitigation debug
by Thomas Krichel 01 Jun '23

01 Jun '23

Hi gang! I have a list with DMARC mitigation action "Replace From: with list address" DMARC Mitigate unconditionally "Yes". But list posts still have the poster's From:, breaking DMARC. How can I debug this? For a start, I looked in my sqlite database. Changes on the web interface list settings seem to be correctly applied to the database. But I don't see a "munge_from" in the fields of a list in the database. -- Written by Thomas Krichel http://openlib.org/home/krichel on his 21181st day.

2 3

Importing mailman 2 shows member's "Moderation Action" = "Default processing". But new members show = "None". Why
by mrl＠psfc.mit.edu 30 May '23

30 May '23

I imported my mailing lists from mailman 2. If I view the Members, it say "Moderation Action" = "Default processing". But when I now subscribe myself or other people to the list, and view the new Members, it say "Moderation Action" = "None" for them. Should that be happening? The mailing list 's "Default action to take when a member posts to the list" setting is set to "Default processing". Thanks. - Mark

2 9

How do you remove the Hold on all non-member forwarded emails?
by Sean Westfall 26 May '23

26 May '23

Hi Mailman3 users, I have recently started using mailman3 and it's a wonderful piece of software. But I am having trouble using one of its configurations. I configured my mailmain3 instance to accept all non-member emails, as I want all emails that are sent to the mailman client to go to all subscribers without having it held for moderation -- I did this by setting this setting: https://i.imgur.com/PGzaD0k.png Action to take for postings from non-members for which no explicit action is defined. (Details for generic_nonmember_action) -> "Accept" But this doesn't work for forwarded emails. Even if the email address that is being forwarded from is included in the "List of non-member addresses whose postings should be automatically accepted." I noticed that all emails that are forwarded to the mailing list are always held for moderation -- though this isn't the case for email that are sent to the mailing list directly. But I want it so that emails that are even forwarded to my mailman mailing list don't get held in moderation. How do I set mailman to do this? I was thinking if there is no way to configure this easily then I might have to do this from the code, which means I might have to ask on the developer mailing list -- or I have to go with an entirely different solution (using something other than mailman3). I hope someone here is willing to help, and in either case thanks for anyone that is willing enough to read this. Sincerely,

2 2

How to edit default 'Reject (with notification)' message
by Zaheer Abbas 26 May '23

26 May '23

Dear all, I want to modify the default text sent in response to when we select 'Reject (with Notification)' in 'Message Acceptance > Default action to take when a non-member posts to the list' settings. Currently, the default rejection text is as follows: "Your message to the $list was rejected for the following reasons: The message is not from a list member The original message as received by Mailman is attached." I have created a template with the option, "Notice sent to a poster when their message has been rejected by the list’s moderator." but it only works if message acceptance is set to 'Hold for Moderation' and then the moderator rejects the post manually. Is there any source file, which I can modify to replace the default rejection text mentioned above? Sincerely, Zee

3 2

Virtual alias + shell
by alopez＠ac.upc.edu 26 May '23

26 May '23

Hello, I want to have a mailman configured together with virtual alias. To do that I need to use alias_domain. I have tried to do it with mailman shell. The domain seams to be created but when I leave the shell and enter again, the domain is not longer there. On the other hand, If I create a domain in administrator interface, it is not listed in the shell. If I create in the web interface, which field correspond to the alias_domain : Domain Name, Display Name , Mail domain? The code I use in the shell is: mailman shell from mailman.interfaces.domain import IDomainManager from zope.component import getUtility manager = getUtility(IDomainManager) from operator import attrgetter def show_domains(*, with_owners=False): if len(manager) == 0: print('no domains') return for domain in sorted(manager, key=attrgetter('mail_host')): print(domain) owners = sorted(owner.addresses[0].email for owner in domain.owners) for owner in owners: print('- owner:', owner) manager.add('example.edu',alias_domain='x.example.edu') show_domains(with_owners=True) exit() Thanks in advance Albert

2 4

Subscribing users stuck in pending hell
by Quanah Gibson-Mount 25 May '23

25 May '23

Hi, We frequently end up with users who never receive their email to confirm their account, leaving them in a netherworld where they cannot become list members. If I try to subscribe them via the mass subscribe option, it says I can't because their subscription is pending. If I go to subscription requests, it says there are 0. If I go to "non-members" in the UI, I can find them, but I don't see an option to convert them to members. So what's the solution to getting these people subscribed and no longer stuck in limbo? Thanks! --Quanah

2 9

not correct language in subject(s)
by Jens Günther 24 May '23

24 May '23

When receiving all types of system mails from mailman3 (3.3.8) there are almost all the subjects in English, althought text is in German. Am I missing somehting? The option to have the list in german is toggled and so far all the mails are in german ... also templates on different levels work fine, either en or de, but obviously the subjects are not translated (?) or taken from an English template. Any hint is appreciated, regards, Jens.

2 6

Please contact me Odhiambo Washington...
by Marisa Giancarla 24 May '23

24 May '23

For some reason your mail got deleted, not sure why, and I don't have your email address saved :( Sorry to bother others... Marisa

2 1

Template URI gets written incorrectly
by Mark Dale 24 May '23

24 May '23

Hi, When I create a template, it writes the URI incorrectly into the template table in the mailman3 database and the list stops working. For example, it writes: http://localhost/mailman3/postorius/api/templates/list/markslist.lists.post… When I correct it like so, all is well: https://lists.postmark.io/mailman3/postorius/api/templates/list/markslist.l… Have I missed a config setting somewhere, or is this a bug with the older Debian Mailman 3.3.3 ? /Mark

2 2

Multiple server replicas
by Dave Hall 24 May '23

24 May '23

Hello. Our Mailman 2.1 setup included 4 replica servers, all with Mailman, Exim4, Apache, etc. The configuration for the 4 mailman server instances were synchronized by linking most of the directories in /var/lib/mailman to an NFS share that is mounted on all 4 servers. Cron jobs were staggered such that an hourly job would run every 4 hours on each server, yet still get run hourly. With Mailman 3 we would like to keep the same kind of setup. However, things have changed quite a bit. Having both mailman and mailman-web instances all share their respective MySql/MariaDB databases is the easy part. For /var/lib/mailman3 it is a little less clear. So far I have symlinked messages, archives, lists, data, and templates onto the NFS share. I'm wondering about cache, locks, queue, and web/fulltext_index. Is there any standard or documented way of doing this? Thanks. -Dave -- Dave Hall Binghamton University kdhall(a)binghamton.edu

2 1

Apache shows No Lists
by ceo＠sartrack.nz 24 May '23

24 May '23

Running Debian 11. I have 6 mailing lists, but Apache2 says there are no lists. I have not been able to set up Postorius because nowhere is any information on *where* the configuration file is supposed to be located. I have found an example in /usr/share/doc/python3-django-hyperkitty/examples/settings.py But I don't know if this example is the right one, and I have no idea where the final file should go...

3 10

mass remove pending confirmation
by Jens Günther 23 May '23

23 May '23

Running Mailman 3.3.8 with docker. ----- Since we migrate some lists from mailman2 to 3, there are a lot of new users/subscribers and an admin made the mistake to not checkbox the 3. option that the users don't need to verify their address. Now we have a long list of pending confirmations in different lists. Is there an easy way in the shell to mass remove these pending mailaddresses so that we don't have to do that one by one? That would be awsome. Regards, Jens.

4 5

Mailman3 / Exim4: Router fails
by ceo＠sartrack.nz 22 May '23

22 May '23

After updating my Linux server, my old Mailman 2.1 was wiped out. I now spend 2 full days desperately trying to get Mailman3 to work with Exim4 (and Apache2) Nothing works so far. At this point I am stuck with a failing Exim4 "Router" I have set Mailman3 to use Exim in the config. In Exim4 I have set all required Mailman3 options. But it fails with this: MM3_LISTCHK=/var/lib/mailman3/lists/${local_part}@${domain} (Email to: templist(a)sartrack.nz - The list exists in Mailman3) Exim4 debug: 19:15:47 100472 --------> mailman3_router router <-------- 19:15:47 100472 local_part=info domain=sartrack.nz 19:15:47 100472 checking domains 19:15:47 100472 sartrack.nz in "sartrack.nz"? yes (matched "sartrack.nz") 19:15:47 100472 data from lookup saved for cache for +mm_domains: key 'sartrack.nz' value 'sartrack.nz' 19:15:47 100472 sartrack.nz in "+mm_domains"? yes (matched "+mm_domains") 19:15:47 100472 checking require_files 19:15:47 100472 ╭considering: /var/lib/mailman3/lists/${local_part}@${domain} 19:15:47 100472 ├──expanding: /var/lib/mailman3/lists/${local_part}@${domain} 19:15:47 100472 ╰─────result: /var/lib/mailman3/lists/info(a)sartrack.nz 19:15:47 100472 ╰──(tainted) 19:15:47 100472 file check: /var/lib/mailman3/lists/${local_part}@${domain} 19:15:47 100472 expanded file: /var/lib/mailman3/lists/info(a)sartrack.nz 19:15:47 100472 stat() yielded -1 19:15:47 100472 errno = 2 19:15:47 100472 mailman3_router router skipped: file check Can somebody please help. I have no idea what is wrong here.

3 7