- Mailman-users - lists.mailman3.org

trying to clean up the "held messages" mess
by Bjoern Franke May 28, 2021

May 28, 2021

Hi, I migrated a Mailman3 installation on Debian10 yesterday evening from Debian packages to PIP (thanks to [1]). I think some bugs which existed before are now cleaned out, but mailman still threw exceptions when trying to get the "held messages". I went through the pendedkeyvalue table of the MySQL DB to get all request ids of the held messages and their lists and discarded the messages via curl and the REST API. Mailman also logged the discarding was successful. The amount of held messages is now reduced, but e.g. a list with 120 held messages before has till 59 held messages. And now I'm confused: where are they? Best Regards Bjoern [1]https://wiki.list.org/DOC/Howto_Install_Mailman3_On_Debian10

2 3

non-member moderation: list default vs default processing
by dancab＠caltech.edu May 24, 2021

May 24, 2021

I've started testing and importing lists from Mailman2 to Mailman3. I've found that there's an inconsistency with the non-members moderation setting. As a result we have non-members unable to email a list via Mailman3 that had no problem on Mailman2. Each time this problem has come up I've had to change the moderation setting from "List Default" to "Default Processing". But I've also noticed that some non-members were imported and already have "Default Processing" configured. Can you help me understand what determines this setting in Mailman3? It seems this would be something addressed via the mailman import21 option I've been using to import the lists. Thanks. ---- Dan Caballero Systems Administrator Academic Computing Solutions IMSS - Caltech https://imss.caltech.edu

2 4

Intermittent: pymysql.err.InternalError: Packet sequence number wrong - got 102 expected 77
by Torge Riedel May 24, 2021

May 24, 2021

|Hi list, sometimes I get the following error in mailman core's log: "pymysql.err.InternalError: Packet sequence number wrong - got 102 expected 77". I attached the full log after this mail. I check the provided link in the log (|||http://sqlalche.me/e/2j85|) and also searched for it on the internet and found the following possible reasons: 1. DB user does not have permissions at all -> I doubt that, because in general mailman is working ok 2. DB user is not allowed to connect from remote -> I doubt that too, because everything is on one host and DB user is allowed to connect from localhost 3. Multi-Threading -> pymysql is mentioned to be not thread-safe and each thread needs its own connection May this be caused by multi-threading? What do I have to do (is there anything I can do?) to solve this on my own?||||| Kind regards Torge || |Full log follows: [2021-05-23 07:31:45 +0200] [8244] [ERROR] Error handling request /3.1/lists?advertised=true&count=10&page=1 Traceback (most recent call last): File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1284, in _execute_context cursor, statement, parameters, context File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 590, in do_execute cursor.execute(statement, parameters) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/cursors.py", line 170, in execute result = self._query(query) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/cursors.py", line 328, in _query conn.query(q) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 517, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 732, in _read_query_result result.read() File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 1082, in read self._read_result_packet(first_packet) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 1151, in _read_result_packet self._get_descriptions() File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 1222, in _get_descriptions field = self.connection._read_packet(FieldDescriptorPacket) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 671, in _read_packet % (packet_number, self._next_seq_id)) pymysql.err.InternalError: Packet sequence number wrong - got 102 expected 77 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/core/venv/lib/python3.6/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/opt/mailman/core/venv/lib/python3.6/site-packages/mailman/rest/wsgiapp.py", line 193, in __call__ return super().__call__(environ, start_response) File "falcon/api.py", line 274, in falcon.api.API.__call__ File "falcon/api.py", line 269, in falcon.api.API.__call__ File "/opt/mailman/core/venv/lib/python3.6/site-packages/mailman/rest/lists.py", line 322, in on_get resource = self._make_collection(request) File "/opt/mailman/core/venv/lib/python3.6/site-packages/mailman/rest/helpers.py", line 172, in _make_collection request, self._get_collection(request)) File "/opt/mailman/core/venv/lib/python3.6/site-packages/mailman/rest/helpers.py", line 167, in _paginate return list_start, total_size, collection[list_start:list_end] File "/opt/mailman/core/venv/lib/python3.6/site-packages/mailman/utilities/queries.py", line 42, in __getitem__ return self._query[index] File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 3149, in __getitem__ return list(res) File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 3481, in __iter__ return self._execute_and_instances(context) File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 3506, in _execute_and_instances result = conn.execute(querycontext.statement, self._params) File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1020, in execute return meth(self, multiparams, params) File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_clauseelement distilled_params, File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1324, in _execute_context e, statement, parameters, cursor, context File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1518, in _handle_dbapi_exception sqlalchemy_exception, with_traceback=exc_info[2], from_=e File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 178, in raise_ raise exception File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1284, in _execute_context cursor, statement, parameters, context File "/opt/mailman/core/venv/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 590, in do_execute cursor.execute(statement, parameters) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/cursors.py", line 170, in execute result = self._query(query) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/cursors.py", line 328, in _query conn.query(q) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 517, in query self._affected_rows = self._read_query_result(unbuffered=unbuffered) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 732, in _read_query_result result.read() File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 1082, in read self._read_result_packet(first_packet) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 1151, in _read_result_packet self._get_descriptions() File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 1222, in _get_descriptions field = self.connection._read_packet(FieldDescriptorPacket) File "/opt/mailman/core/venv/lib/python3.6/site-packages/pymysql/connections.py", line 671, in _read_packet % (packet_number, self._next_seq_id)) sqlalchemy.exc.InternalError: (pymysql.err.InternalError) Packet sequence number wrong - got 102 expected 77 [SQL: SELECT mailinglist.list_id AS mailinglist_list_id, mailinglist.preferred_language AS mailinglist_preferred_language, mailingli$ FROM mailinglist WHERE mailinglist.advertised = true ORDER BY mailinglist.list_id LIMIT %(param_1)s] [parameters: {'param_1': 10}] (Background on this error at: http://sqlalche.me/e/2j85) |

3 5

Unknown attribute: process_bounces
by xlefloch＠alwaysdata.com May 21, 2021

May 21, 2021

Hello, I've upgraded my Mailman installation from those versions: mailman==3.2.2 postorius==1.2.4 mailmanclient==3.2.2 To those ones: mailman==3.3.0 postorius==1.3.3 mailmanclient==3.3.2 I'm having issues in Postorius in the settings section: Unknown attribute: process_bounces. When i'm printing the settings list for the concerned list retrieved by the REST API, i'am missing all the parameters related to the management of bounces. In the "mailinglist" table of the Mailman database, i have the columns managing these parameters. Anyone have any ideas? Regards,

2 3

New Mailman 3 installation issues
by sarah.hartt＠ionica.ca May 21, 2021

May 21, 2021

I have been trying to get a mailman 3 installation working for longer than I'd like to admit. Core appears to be installed and working as desired but Postorius (and hyperkitty, but I haven't even started troubleshooting it while trying to get the web interface working) is only loading the main page with no lists shown and all remaining links return a server error (specific text is: "Server error An error occurred while processing your request." with the error text highlighted). I think I followed all of the installation instructions, including the updated pythonpath line in the systemd module, but it's entirely possible that there is an error somewhere along the way. I have had to make two minor tweaks, the /static/ location was moved from /opt/mailman/web/static to /var/www/mailman/ (owner mailman:nginx) as nginx was giving permissions errors (even if it owned the files or with the mod set to 777) with the default location and wouldn't load the css, and installed postgres directly from their repo as the method in the guide doesn't create the user. Aside from that everything should be exactly as laid out in the installation guide. The logs are showing everything running and the DB logs show all the queries going through successfully, there are no errors in the web logs corresponding with the errors being served on the site aside an entry for a 500 in the access logs [18/May/2021:12:13:01] "GET /archives/ HTTP/1.1" 500 1102 "http://mailman3/mailman3/lists/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.91 Safari/537.36" "-" when I took a look in the DB tables many of them appear to be empty, I have a few lists in core that were imported from 2.1 but no new lists created. Mailman: 3.3.4 Postorius: 1.3.4 OS: Oracle Linux 8.3 Python: 3.6 postgres: 13.2

4 11

timezone in hyperkitty
by erlonmz＠hotmail.com May 21, 2021

May 21, 2021

How do I change the hyperkitty timezone?

7 8

Re: [EXTERNAL] [Mailman-Users] Re: Help with 'The message has no valid senders'
by Mark Sapiro May 21, 2021

May 21, 2021

On 5/19/21 10:37 AM, McGuire, Tommy M. (MSFC-IS90)[EAST2] wrote: > > Here are (what I think are :-)) the anonymized relevant parts of the smtp.log. > > May 19 08:52:29 2021 (126270) _handle_client readline: b'MAIL FROM:<aaaaaaaaaa.a.aaaaa-1(a)nasa.gov> SIZE=11726\r\n' > May 19 08:52:29 2021 (126270) ('127.0.0.1', 52130) >> b'MAIL FROM:<aaaaaaaaaa.a.aaaaa-1(a)nasa.gov> SIZE=11726' > May 19 08:52:29 2021 (126270) ('127.0.0.1', 52130) sender: aaaaaaaaaa.a.aaaaa-1(a)nasa.gov > May 19 08:52:29 2021 (126270) ('127.0.0.1', 52130) << b'250 OK' > ... > May 19 08:52:29 2021 (126270) DATA readline: b'From: "Aaaaa, Aaaaaaaaaa A. (location)[employer,\r\n' > May 19 08:52:29 2021 (126270) DATA readline: b' Inc.]" <aaaaaaaaaa.a.aaaaa-1(a)nasa.gov>\r\n' That all looks good. I don't understand what's wrong. Can you apply the attached patch to mailman/rules/no_senders.py and see what you get in Mailman's debug.log. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 1

Can't deliver mails in queue
by Nathanael Schneider May 20, 2021

May 20, 2021

Hello, I have stumbled upon some weird issues with my migration to mailman3.. I've followed the step by step instructions for installing mm3 manually in a venv with postfix and virtual aliases (if that is of any significance). Now the Problem is, that some lists don't deliver EMails at all. The list was one which I migrated with the mailman21 command. But the Mail I sent did not get through to no one and the mailman logs did not show anything. I then created a completely new List which did not exists in mm2.1, subscribed two addresses and sent myself an EMail. That one worked as intended. I then deleted the whole broken list and created it cleanly, added the same two people, sent an email and nothing. Did not show up in the Moderation Queue or anywhere. it also doesn't get shunted. It just never arrives. I then turned the log level to debug on the smtp module. And I only get the following statement, ever repeating, never ending: [...] May 19 18:54:40 2021 (8280) Using agent: <mailman.mta.deliver.Deliver object at 0x7fb49b143780> May 19 18:54:40 2021 (8280) IndividualDelivery to: nathanael(a)lumenliquid.net May 19 18:54:40 2021 (8280) Using agent: <mailman.mta.deliver.Deliver object at 0x7fb4974541d0> May 19 18:54:40 2021 (8280) IndividualDelivery to: nathanael(a)lumenliquid.net May 19 18:54:40 2021 (8280) Using agent: <mailman.mta.deliver.Deliver object at 0x7fb4978db438> May 19 18:54:40 2021 (8280) IndividualDelivery to: nathanael(a)lumenliquid.net May 19 18:54:40 2021 (8280) Using agent: <mailman.mta.deliver.Deliver object at 0x7fb497f05f28> May 19 18:54:40 2021 (8280) IndividualDelivery to: nathanael(a)lumenliquid.net May 19 18:54:40 2021 (8280) Using agent: <mailman.mta.deliver.Deliver object at 0x7fb4978adb38> May 19 18:54:40 2021 (8280) IndividualDelivery to: nathanael(a)lumenliquid.net [...] I have no clue what to do with this. I then turned the debug module loglevel to debug. Also nothing useful. Just an endless list of [...] May 19 18:17:29 2021 (7209) [outgoing] <function deliver at 0x7f2faf384c80>: <B9531076-2480-4925-9A2B-57802B53D5ED(a)gmx.de> May 19 18:17:29 2021 (7203) [ArchiveRunner] starting oneloop May 19 18:17:29 2021 (7203) [ArchiveRunner] ending oneloop: 0 May 19 18:17:29 2021 (7209) [OutgoingRunner] finishing filebase: 1621441049.4089153+6dff56673dc64b890dd352941267782c264586dd May 19 18:17:29 2021 (7209) [OutgoingRunner] doing periodic May 19 18:17:29 2021 (7209) [OutgoingRunner] committing transaction May 19 18:17:29 2021 (7209) [OutgoingRunner] checking short circuit May 19 18:17:29 2021 (7209) [OutgoingRunner] ending oneloop: 1 May 19 18:17:29 2021 (7209) [OutgoingRunner] starting oneloop May 19 18:17:29 2021 (7209) [OutgoingRunner] processing filebase: 1621441049.4628382+6a0437ea387a2508ad947c0a51712075cbdb6d2e May 19 18:17:29 2021 (7209) [OutgoingRunner] processing onefile May 19 18:17:29 2021 (7209) [outgoing] <function deliver at 0x7f2faf384c80>: <B9531076-2480-4925-9A2B-57802B53D5ED(a)gmx.de> [...] Which also tells me nothing I can understand. I have no clue what's going wrong. (I've turned on debugging both on the original member list and the reduced member list. Both hang on the first delivery they do). If I restart mailman, the message gets correctly shunted as it is interrupted mid-delivery. My maillogs don't register any activity beside the listpost. Any ideas what I need to do to figure out what's not working here or where the culprit could be? Not sure if it is related to the mailinglist being in mailman2.1 before. -- Nathanael Schneider

2 5

Bounce counter visibility for List Admins
by smorytko＠gmail.com May 19, 2021

May 19, 2021

As you may know, we use MM3 but the Affinity/Empathy flavor and we only have List Administrator using the Postorious/Affinity. Unlike many here, we have no access to any server-based files. Can someone tell me if Postorious gives list administrators visibility into the bounce counters? While List Admins get to set various bounce counters we have no visibility of those counters until, all of a sudden, an entire source of subscribers hits the bounce threshold and gets bounced off the list. It would be really nice to be able to see the bounce counters and possibly head off trouble before users/subscriber mail hosts. It can serve as an effective early warning system that something is wrong. Assuming Postorious cannot, is there another way List Admins can inspect bounce counters? Email command? Thanks - Steve

3 3

Re: [EXTERNAL] [Mailman-Users] Re: Help with 'The message has no valid senders'
by Mark Sapiro May 19, 2021

May 19, 2021

Putting this back on the list. On 5/19/21 9:46 AM, McGuire, Tommy M. (MSFC-IS90)[EAST2] wrote: >> -----Original Message----- >> From: Mark Sapiro <mark(a)msapiro.net> ... >> Have you set >> ``` >> [mailman] >> sender_headers: ... >> ``` >> in mailman.cfg?, and if so, to what? > > We have not changed it: > > [mailman] sender_headers: from from_ reply-to sender > > According to the smtp.log, there was an envelope sender ("MAIL FROM:.."), which matched the From header. In the example I'm looking at right now, the sender was not a member of the list, but the Accept these non-members box in the list settings has a regexp that matches the sender's domain. In another example from this morning, to a different list, the envelope sender and From header match, and is a member of the list. > > I don't see any obvious reason or configuration setting that would make either address invalid. First of all, the discard has nothing to do with whether the sender has any connection to the list. It only says the message had no sender at all. Assuming the message had a From: with a syntactically valid email address, this discard should not occur. Also, if the envelope (MAIL FROM:) was a syntactically valid email address, this discard should not occur. The address is validated by mailman/email/validate.py by first splitting it into `local_part`, `@`, `[domain_parts]` where domain_parts are the `between dots` parts of the domain and then validating the local_part and domain with regexps defined per > # What other characters should be allowed? > _valid_local = re.compile("[-0-9a-z!#$%&'*+./=?@_`{}~]", re.IGNORECASE) > # Strictly speaking, both ^ and | are allowed and others are allowed in quoted > # local parts, but this can open the door to certain web exploits so we don't > # allow them. > _valid_domain = re.compile('[-a-z0-9]', re.IGNORECASE) > # These are the only characters allowed in domain parts. Does the From: local part or the MAIL FROM: contain any characters not in the [-0-9a-z!#$%&'*+./=?@_`{}~] class? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

[Django] ERROR (EXTERNAL IP): Internal Server Error: /accounts/login/
by Mark Dadgar May 19, 2021

May 19, 2021

I have a user attempting to access the list archives and he’s generating this login error. I have verified that he does have a django account. I’ve never seen this one before and I didn’t find anything relevant in the lit archives. Any ideas what’s going on here? - Mark ----- mark(a)pdc-racing.net | 408-348-2878 ----------------------------------------------- From: noreply(a)pdc-racing.net Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: /accounts/login/ Date: May 18, 2021 at 2:38:20 PM PDT To: mark(a)pdc-racing.net Internal Server Error: /accounts/login/ MultipleObjectsReturned at /accounts/login/ get() returned more than one EmailAddress -- it returned 2! Request Method: POST Request URL: https://mail.pdc-racing.net/accounts/login/ Django Version: 3.0.12 Python Executable: /opt/mailman/mm/venv/bin/python Python Version: 3.8.5 Python Path: ['/opt/mailman/mm', '/opt/mailman/mm/', '/opt/mailman/mm/bin', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/opt/mailman/mm/venv/lib/python3.8/site-packages'] Server time: Tue, 18 May 2021 14:38:20 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 115, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/utils/decorators.py", line 43, in _wrapper return bound_method(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/views/decorators/debug.py", line 76, in sensitive_post_parameters_wrapper return view(request, *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/views.py", line 146, in dispatch return super(LoginView, self).dispatch(request, *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/views.py", line 74, in dispatch response = super(RedirectAuthenticatedUserMixin, self).dispatch( File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/views/generic/base.py", line 97, in dispatch return handler(request, *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/views.py", line 102, in post response = self.form_valid(form) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/views.py", line 159, in form_valid return form.login(self.request, redirect_url=success_url) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/forms.py", line 195, in login ret = perform_login( File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/utils.py", line 174, in perform_login if not _has_verified_for_login(user, email): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/utils.py", line 134, in _has_verified_for_login emailaddress = EmailAddress.objects.get_for_user(user, email) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/managers.py", line 54, in get_for_user ret = self.get(user=user, email__iexact=email) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/db/models/query.py", line 419, in get raise self.model.MultipleObjectsReturned( Exception Type: MultipleObjectsReturned at /accounts/login/ Exception Value: get() returned more than one EmailAddress -- it returned 2! Request information: USER: AnonymousUser

2 4

OS upgrade - anything to take care of?
by Torge Riedel May 15, 2021

May 15, 2021

Dear MM3 users, today I upgraded one of two servers from Ubuntu 18.04 to 20.04 and - besides some minor config updates - postfix & dovecot worked well afterwards. So I am very optimistic that the upgrade of the second server from 18.04 to 20.04 will also work fine. But the second server is running MM3 (installed in venv) and I saw that on upgrade Python 3.8 is installed. Is there anything I have to take care of? Anything to do / change in venv? Kind regards Torge

4 10

Re: Core, Hyperkitty and Postorius releases
by Odhiambo Washington May 15, 2021

May 15, 2021

On Fri, May 14, 2021 at 2:52 PM Jeff Steele <jeff(a)steele.com> wrote: > > > On May 14, 2021, at 7:49 AM, Odhiambo Washington <odhiambo(a)gmail.com> > wrote: > > /bin/sh: sass: Permission denied* > > > > Did you check the permissions on your sass binary? > My mailman installed in /opt/mailman/mm find /opt/mailman/ -type f -name sass yielded nothing! pip3 install sass generated so many errors then ended with: ERROR: Command errored out with exit status 1: /opt/mailman/mm/venv/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-cltizg93/sass_9783b9d070744303b5c04271674abc23/setup.py'"'"'; __file__='"'"'/tmp/pip-install-cltizg93/sass_9783b9d070744303b5c04271674abc23/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-1g2omozl/install-record.txt --single-version-externally-managed --compile --install-headers /opt/mailman/mm/venv/include/site/python3.7/sass Check the logs for full command output. I will have to blow away mailman and start afresh. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v "^$|^.*#" :-)

4 17

Core, Hyperkitty and Postorius releases
by Abhilash Raj May 15, 2021

May 15, 2021

Hey Everyone, I am pleased to announce new stable releases for Mailman Core, Postorius, Hyperkitty. These include both new features and bug fixes. Complete change log for each components: Mailman Core 3.3.3: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS.… Postorius 1.3.4 https://docs.mailman3.org/projects/postorius/en/latest/news.html Hyperkitty 1.3.4 : https://docs.mailman3.org/projects/hyperkitty/en/latest/news.html Minimum supported Python version is 3.6. You can install them using: $ pip install --upgrade postorius hyperkitty mailman We have also recently been working on making the installation instructions[1] to be more detailed and added a new FAQ[2] section for administrators where I hope to capture common questions from mailman-users list. Feedback or Merge Requests to improve these docs are welcome. You can either send an email or open an issue on Gitlab (easier to track) here[3]. [1]: https://docs.mailman3.org/en/latest/install/virtualenv.html [2]: https://docs.mailman3.org/en/latest/faq.html [3]: https://gitlab.com/mailman/mailman-suite-doc/issues Thanks to everyone who helped out with with this release and contributed if any way! :) thanks, Abhilash Raj On behalf of Mailman Core Team

4 10

Hyperkitty download mbox
by Andrew Hodgson May 14, 2021

May 14, 2021

Hi, Hyperkitty 1.3.4. I am trying to download a complete list mbox by going to all threads view and using the download option. I have tried a couple of tools (Gunzip and Winrar) and both are giving me an unexpected end of file when trying to decompress the gz file. Here is the list URL I am using: https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil… Any suggestions? Thanks. Andrew.

5 15

Sad news - Brian Carpenter
by smorytko＠gmail.com May 13, 2021

May 13, 2021

https://www.tributearchive.com/obituaries/21066847/Brian-Keith-Carpenter/wa… I mentioned some "unfortunate circumstances" in a recent post. An inquiry from Mark Sapiro prompted me to do a search and I sadly found this. Brian's company managed our list and on 4/22 we became aware that he was hospitalized with Covid. Rest in peace Brian. Steve Morytko

7 6

Problems with New MM3 Installation
by Jeff May 12, 2021

May 12, 2021

After using Mailman 2 (and possibly 1 though I don’t remember) for almost 20 years, I have just upgraded to Mailman 3. I followed the instructions here: https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst… Things generally work, but I have run into a couple of small problems: 1) The uwsgi-error.log is filling with errors that seem to culminate in "ModuleNotFoundError: No module named ‘settings’”. My settings.py is located in “/etc/mailman3” and seems to be found by other components of MM3. This error must be coming from the cron jobs. Does anyone have any ideas how to fix this problem? 2) While old messages were imported without issue, new emails are not being archives. I see them in: mailman3/mm/var/archives/prototype/[listname]@[domain]/new But they are not being delivered. I have added this to my mailman.cfg: [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /usr/local/mailman3/mailman-hyperkitty.cfg And created the "/usr/local/mailman3/mailman-hyperkitty.cfg” as such: base_url: http://localhost/archives/ api_key: [key that matches “MAILMAN_ARCHIVER_KEY” in my settings.py] Some documentation says that the url should be "http://localhost/hyperkitty/“, but url generates a page not found error on my setup while the archives are available at the “archives” url. I would greatly appreciate any assistance with these two issues. Thanks much, Jeff

4 7

List Digest - Subject line
by smorytko＠gmail.com May 12, 2021

May 12, 2021

Is there a way to optionally cause the Subject line to display with the text body and as a summary at the top of the digest? I ask because on our mailing list (and probably many others too) subscribers include important content in the subject line and do NOT repeat it in the body of the text. So when the digest formatting places the Subject lines at the top to create "Today's Topics" as it does for all digest subscribers, the subject line and text body are widely separated making comprehension of the message much more difficult and separating important content unless it's repeated. This also happens on our list which uses Affinity/Empathy rather than Hyperkitty. In general, while a Today's Topics summary is useful, I think it would be preferable to always include the subject line with the body (one add'l line per digest message). Again I'm wondering if this is a web front-end function, a MM3 core function, or perhaps both? I ask because if it's not a MM3 core function I'll need to ask our developer for an Empathy modification. Below is an example from an Empathy-base list that shows how difficult it is to fully comprehend messages when the subject line is separated from the text body. The same issue would seem to be present in a Hyperkitty based list: Today's Topics: 1. Wilson’s Warbler (Albert Laguna) 2. RB Nuthatch, Kent (John Johnson) 3. Happy Mothers Day Summer Tanager (Visit Today Only) (Aidan Kiley) 4. Wimisink Sora, Marsh Wren (Angela Dimmitt) 5. Stn 43 South Windsor (Paul Desjardins) 6. White-crowned Sparrows at Hammonasset (Paul Smith) 7. Re: White-crowned Sparrows at Hammonasset (Paul Smith) 730am Beaver Pond Park in New Haven. Wilson’s Warbler sporting its distinctive black cap. Very birdy with yellow warbler, blue headed vireo, ruby crowned kinglet warbling vireo joining the fun, among others. Sent from my iPhone Red-breasted Nuthatch at our feeder this morning. First time ever in our yard in 35 years! John Johnson Kent FOR TODAY ONLY: Our special friend is still here today! I would like to open it up allow more people to see him because I really hate how “clique like” the birding community is here. Anyone interested can come stop by but would need to email me letting me know they’re interested in coming first. I will check my email and then I will send my address with instructions and where they are allowed to go. Thanks! Jill (jmahar(a)udel.edu) Jill Mahar Easton 5/9 - Sora back, calling; marsh wren, near end of boardwalk - Sherman/Wimisink marsh, Rte.39 at 55. Angela Dimmitt New Milford Paul Desjardins paul.desjardins2(a)gmail.com Phone: (860) 623-3696 This morning at the end of the Vibert Road section White Crowned Sparrow and north of Vibert Road f o y 2 Indigo Buntings. Paul Desjardins Windsor Locks 2 White-crowned Sparrows at Middle Beach. At the circular road by the picnic tables. Sent from my iPhone Oops, sent too soon Paul Smith New Haven Sent from my iPhone

4 4

Re: content filtering in version 3.1
by Simon Handfield May 12, 2021

May 12, 2021

Hi everyone, I'm sorry to resurrect this thread from so long ago but it appeared to provide exactly the answer I was looking for, trying to manage pass_types in 3.1.1 on Ubuntu 18.04. GNU Mailman 3.1.1 (Between The Wheels) Unfortunately when I run: ./bin/mailman shell -l [list address] I receive: usage: mailman [-h] [-v] [-C CONFIG] {help,aliases,conf,create,digests,import21,info,inject,lists,members,qfile,remove,reopen,restart,shell,start,status,stop,unshunt,version,withlist} ... mailman: error: unrecognized arguments: -l Can anyone advise how I can use the -l switch to manage this setting for a list? Thanks, Simon. _ [State Library of NSW]<https://www.sl.nsw.gov.au/> Simon Handfield Desktop and Infrastructure Leader simon.handfield(a)sl.nsw.gov.au<mailto:simon.handfield@sl.nsw.gov.au> +61 2 9273 1535 Macquarie Street, Sydney NSW 2000, Australia www.sl.nsw.gov.au<https://www.sl.nsw.gov.au/> This message is intended for the addressee named and may contain confidential information. If you are not the intended recipient, please delete it and notify the sender. Views expressed in this message are those of the individual sender, and are not necessarily the views of their organisation.

2 2

[Docs] Document on how to deploy mailman suit into HA mode
by TommyLike Hu May 10, 2021

May 10, 2021

Hey mailman teams. We deployed mailman suite service for our community, and everything looks good to us now, but we are asking whether there are any documents on how to deploy the mailman suite service into HA mode, any document or conversation will be helpful, thanks! link: how we deploy mailman suite service in kubernetes: https://github.com/opensourceways/infra-common/tree/master/common-applicati… TommyLike openEuler infrastructure 2021/5/10

1 0

400 Bad Request when administrator tries to selectively override member options
by ieso＠johnwillson.com May 8, 2021

May 8, 2021

This is probably Design Intent, but I'd just like to confirm. When an administrator submits partial 'member options', it comes back with the details of a 400 - Bad Request, indicating essentially that all of the member options must be set. Screenshot: https://ibb.co/pzM5Z4m It would be a bit smoother to check that all values are selected before sending the request, and inform the administrator that they cannot selectively override member settings for their list. But most importantly, I would like to confirm that nothing is corrupt/broken in our implementation. Thanks in advance for any guidance.

2 1

[Mailman-Users] Web interface for users (not admins)?
by Stephen J. Turnbull May 8, 2021

May 8, 2021

Hi Skip! First, a bit of admin. Mailman 2 is still in active use, so we've split out a separate list for Mailman 3: mailman-users(a)mailman3.org. Subscribe at https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ You can use several common social media to authenticate yourself. You'll have to do the usual one-time key dance to verify your email address (sorry!) You will get good feedback from the users there (better than the OP list). ** Reply-To set, please use "reply to author" to follow up. ** Skip Montanaro writes: > So, I got to thinking... Are there any free web user (not admin) > interfaces which integrate with MM3? Yes. The HyperKitty archiver, which is part of the Mailman 3 suite[1], provides an interface for submitting posts as well as reading them, and has a few social media features (liking posts). > Something which when combined with MM3 could conceivably be an > alternative to Google Groups, (the now defunct) Yahoo! Groups, or > Groups.o? That's for your users to say. ;-) If you visit https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ you can try it for yourself. To post, you'll need to sign up (you can do that with a Google account, and I think both GitHub and GitLab are accepted as well. > I poked around the archives a bit and browsed list.org for a few > minutes, but turned up nothing. Or rather, all I found related to > web interfaces was the admin interface. HyperKitty issues mostly have to do with importing archives. The webservice being effectively synchronous and centralized doesn't have a lot of problems as compared to email, and many feature suggestions go directly to the tracker for HyperKitty. I'm not surprised you don't find much about HyperKitty as Web UI in the list archives.

6 7

mailman3 exim4 and debian 1 problem fconnection lost
by roberto Burceni May 6, 2021

May 6, 2021

[Mailman-Users] mailman3 and exim4 problem in debian bullseye Good evening, I'm configuring mailman3 with exim4 on a debian 11. I followed the official documentation on mailman for exim. It seems to be all rights, but I have a problem: when I send a message to a new lists in exim logs I see that exim uses correctly mailman router and transport. Unfortunately in smtp.log in mailman3 log folder I have the following error: May 04 16:51:01 2021 (2337) ('127.0.0.1', 34746) sender: servizioinformatico(a)uicbs.it May 04 16:51:01 2021 (2337) ('127.0.0.1', 34746) Data: b'RCPT TO: <listtest-unsubscribe(a)uicbs.it>' May 04 16:51:01 2021 (2337) ('127.0.0.1', 34746) recip: listtest-unsubscribe(a)uicbs.it May 04 16:51:01 2021 (2337) ('127.0.0.1', 34746) Data: b'DATA' May 04 16:51:02 2021 (2337) ('127.0.0.1', 34746) Data: b'QUIT' May 04 16:51:02 2021 (2337) ('127.0.0.1', 34746) connection lost May 04 16:51:02 2021 (2337) Connection lost during _handle_client() This causes that messages are not sent from mailman to users. Have you an idea of the problem? Can it be a memory problem that causes that mailman responses are too slow and exim closes the comunication before the end? I have no other errors in other log files Thank you in advance -- Roberto Burceni Linux System Admin & PHP developer Esperto accessibilità siti web E-mail: roberto(a)robertoburceni.it Phone: +393358208080 P.iva: 04025840986mbre per il mat

2 1

Correct way to filter auto-replies to list?
by Gary Holman May 6, 2021

May 6, 2021

I have seen a few messages on this list regarding handling 'out of office' auto-replies. However I do not see a final resolution. What is the best practice to filter auto-replies to list: header filter or postfix milter-reject or something else? We are running dockerized Mailman 3 version 1.3.4. A list user auto-replied their vacation message to list and then the listserv created a chain-reaction of continuously replying to auto-replies by that user. There isn't really a good header option to filter from, as the subject seems to be randomized. For example: From <SENDER ADDRESS> Tue May 4 19:02:29 2021 From: Sender Name <SENDER ADDRESS> To: <LIST ADDRESS> Subject: [electronics-daq] Re: 25ad Date: Tue, 04 May 2021 20:59:57 +0200 Message-ID: <A2FB195E-5261-4F26-AF19-7AFE0B0632A5> In-Reply-To: =?utf-8?q?=3C0101017937874647-cf4b59ca-737e-4db0-9a01-85d9d43c8?= =?utf-8?q?d68-000000=40us-west-2=2Eamazonses=2Ecom=3E?= MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7283775935526227777==" --===============7283775935526227777== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Thank you, Gary

2 1

Mailman 3 Web Application Startup Time or Availability - 502 Bad Gateway and Postorius
by summersan＠nclack.k12.or.us May 3, 2021

May 3, 2021

Hello, I've been setting up a new Mailman 3 installation earlier this year, and I think things have been going okay so far. I've noticed, however, that after a long amount of time passes (for example, a weekend), when I try to visit the local Mailman 3 web application (e.g., example.mailman.site/mailman3/lists/, where it says "Postorius" at the top left corner of the page and shows a list of mailing lists in the body of the page), I sometimes get a 502 Bad Gateway type of error (referenced from my notes). As far as I can tell, this looks like a normal web server (nginx?) error. If I try visiting the Mailman 3 server location again in a web browser shortly thereafter, I still might get a 502 Bad Gateway error. If I wait a while longer (maybe a minute or more?), the Mailman 3 web application appears to load as expected. I've tried looking at the gunicorn documentation (https://docs.gunicorn.org/en/stable/index.html) and searching online (including in this Mailman3 mailing list) to see if there's something that can be done to fix this issue. The closest thing I can find for now is advice for something that, while possibly being technologically unrelated, includes the idea of "warmup requests", which makes me think of simply setting up some sort of script to periodically load a page on the Mailman 3 web application in order to keep it more available for visitors (https://stackoverflow.com/a/57056170) Is there a setting or something in any of the Mailman 3 related programs that could help with keeping the Mailman 3 web application up and running more often without having to resort to making an ongoing, automated request to the Mailman 3 web application? Thank you. * Note: "Mailman 3" terminology is referenced from this page: https://lists.mailman3.org/archives/

2 3

Exception with processing subscription confirmation email
by Eric Broens April 29, 2021

April 29, 2021

Hi, A new user tried to subscribe to a mailinglist, received the confirmation mail, and replied to it. The subscriber is however not subscribed and remains listed in the "pending confirmation" list. The following exception appears in the error.log. Does anyone knows how to resolve this? In the past we didn't experience any issues and no changes but security updates have been installed. Apr 29 16:15:55 2021 (1581) deque: do_confirm_verify Traceback (most recent call last): File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/app/subscriptions.p y", line 356, in _step_send_confirmation raise StopIteration StopIteration Apr 29 16:16:28 2021 (1490) Uncaught runner exception: Expecting ':' delimiter: line 1 column 256 (char 255) Apr 29 16:16:28 2021 (1490) Traceback (most recent call last): File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/runners/command.py" , line 208, in _dispose mlist, msg, msgdata, parts, results) File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/commands/eml_confir m.py", line 54, in process mlist).confirm(token) File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/app/subscriptions.p y", line 578, in confirm workflow.restore() File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/app/workflow.py", line 146, in restore data = json.loads(state.data) File "/usr/lib64/python3.6/json/__init__.py", line 354, in loads return _default_decoder.decode(s) File "/usr/lib64/python3.6/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib64/python3.6/json/decoder.py", line 355, in raw_decode obj, end = self.scan_once(s, idx) json.decoder.JSONDecodeError: Expecting ':' delimiter: line 1 column 256 (char 255) Apr 29 16:16:28 2021 (1490) SHUNTING: 1619705788.5856323+57a1a759275c59b732cfa8e2985f76cfcc27dda5 Thanks in advance, Eric

2 3

user mail not accepted
by Christian Stalberg April 28, 2021

April 28, 2021

I have a user whose moderation rule is 'Accept immediately' yet when they send a message for distribution to the list, they only receive it and it is not distributed via the list. Logfile entries below. Please advise. Btw I have another list on this same instance which is running fine. Thank you. [26/Apr/2021:12:06:25 +0000] "GET /3.1/lists/ssan.lists.ccalternatives.org HTTP/1.1" 200 453 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:25 +0000] "POST /3.1/members/find?list_id=ssan.lists.ccalternatives.org&subscriber=christian %40sewagesludgeactionnetwork.com HTTP/1.1" 200 1257 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:25 +0000] "PATCH /3.1/members/7186cd45bde34d4fa7e7b5ab36b97272 HTTP/1.1" 204 0 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:26 +0000] "GET /3.1/lists/ssan.lists.ccalternatives.org HTTP/1.1" 200 453 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:26 +0000] "POST /3.1/members/find?list_id=ssan.lists.ccalternatives.org&subscriber=christian %40sewagesludgeactionnetwork.com HTTP/1.1" 200 1288 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:26 +0000] "GET /3.1/lists/ssan(a)lists.ccalternatives.org/requests/count?token_owner=moderato r HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:26 +0000] "GET /3.1/lists/ssan(a)lists.ccalternatives.org/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Apr/2021:12:06:26 +0000] "GET /3.1/members/7186cd45bde34d4fa7e7b5ab36b97272/preferences HTTP/1.1" 200 295 "-" "GNU Mailman REST client v3.3.2"

3 7

Non-ascii characters missing from Pipermail archive txt and gz downloads
by Mark Dale April 20, 2021

April 20, 2021

Mailman 2.1.34 Debian 10 Postfix Hi I'm hoping someone can shine a light on character encoding issue I've encountered. A plain-text email with non-ascii characters in the body gets posted to the list. As per Mark Sapiro's guide I've captured the incoming message to file. - https://www.mail-archive.com/mailman-users@python.org/msg73469.html The message is received by Mailman with the non-ascii characters displaying correctly. The header of that message has: User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.9.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-AU Content-Transfer-Encoding: 8bit In the list's mbox file and archive webpage, the message displays the non-ascii characters correctly. In the archive's downloaded .txt (and also .gz) file, the non-ascii characters are missing and displayed as "?". I've copied the message text in below, from both the correct one from the email and the erroneous .txt file. Hopefully they won't get scrambled up when I send this. Any advice on getting the non-ascii characters written into the archive .txt file would be gratefully received. Thanks, Mark === Message text as okay in mbox and as shown on the archive webpage === If one goes by the definition of veḷippaṭai as given in the Tamil Lexicon that the meaning of an ambiguous word should be disambiguated by a qualifying word, then aruvi āmpal does not conform to that definition since in the case of aruvi āmpal in Patiṟṟuppattu 63, aruvi is really made up of aru+vi, a compound. Moreover, the expression aṭai aṭuppu aṟiyā is already there to clarify that āmpal is a number and not a flower. Thus, aruvi simply provides information in addition to aṭai aṭuppu aṟiyā that āmpal is not a flower. The modern commentator Aruḷampalavaṉār also does not call it veḷippaṭai. === === Message text with missing characters in te archive's txt and gz downloads == If one goes by the definition of ve?ippa?ai as given in the Tamil Lexicon that the meaning of an ambiguous word should be disambiguated by a qualifying word, then aruvi ?mpal does not conform to that definition since in the case of aruvi ?mpal in Pati??uppattu 63, aruvi is really made up of aru+vi, a compound. Moreover, the expression a?ai a?uppu a?iy? is already there to clarify that ?mpal is a number and not a flower. Thus, aruvi simply provides information in addition to a?ai a?uppu a?iy? that ?mpal is not a flower. The modern commentator Aru?ampalava??r also does not call it ve?ippa?ai. ===

2 2

Long lines in mail composed by HyperKitty
by Stephen J. Turnbull April 19, 2021

April 19, 2021

Hi, [I prefer discussion be directed to mailman-developers, so Reply-To is set. But if you're not subscribed to -developers, following up here is OK, and I'll eventually summarize to -developers. Just don't followup to both.] I just noticed that among the agents that send non-conformant long lines[1] is HyperKitty. Nowadays violating the 80 octet limit is common and MUAs mostly handle it, but the 1000 octet limit is enforced by many MTAs[2] I think that HyperKitty should format mail per RFC 3676 format=flowed https://tools.ietf.org/html/rfc3676#section-4. However, I don't use "modern" (aka crappy HTML-oriented) clients, so I don't know whether they handle format=flowed properly. Discussion greatly desired. Steve Footnotes: [1] RFC 5321: MTAs MAY impose a limit >= 1000 octets including CRLF. RFC 5322: MUST be <= 1000 octets including CRLF, SHOULD be <= 80 octets including CRLF. [2] In practice, most (?) MTAs just break the line at 998 octets and insert CRLF rather than reject the message. I assume they would break happily in the middle of a multi-byte character, i.e., any non-ASCII in a UTF-8 text.

1 0

GNU Mailman condemns reinstatement of RMS
by Abhilash Raj April 13, 2021

April 13, 2021

To the Mailman community, The GNU Mailman Steering Committee condemns the reinstatement of Richard M. Stallman (RMS) to the Board of the Free Software Foundation (FSF), and has taken the following actions: 1. On behalf of the GNU Mailman project, signed the letter on GitHub[1] calling for the removal of the entire FSF Board, as well as RMS himself. 2. Started exploring ways to move our financial assets, for decades managed by the FSF, to new management. The management fees are small, but this is an important symbolic protest. 3. Started exploring how to leave the GNU Project. On the one hand, if we leave but GNU wants to maintain a "GNU Mailman" project, we cannot stop them, confusing users. On the other hand, RMS is leader of the GNU Project, and has intervened in Mailman affairs on many occasions. We should forestall this in the future. We wish to explain our actions to the community. Although free exchange of software among users is a practice that goes back to days of the earliest general purpose computers, RMS was the first to propose a complete free software distribution, and is the acknowledged founder of the Free Software movement. Even leaders of the Berkeley Software Distribution (BSD) acknowledge this. We all owe him a debt for this. Nevertheless, the movement has matured and thrived, spawning the competitive open source movement, with whose philosophy Mailman is more closely aligned. While we acknowledge our debt to RMS, we don't need him any longer. And unfortunately, he has become both a symbol and a source of the toxicity in tech communities. The FSF Board did the right thing by accepting RMS's resignation. They did the wrong thing by reinstating him. RMS has a long history of abusive behavior and toxic political positions. A small part of it is described in the open letter on GitHub[1] and its references[2], and several members of the Steering Committee have observed it directly. All of us have heard stories directly from those who were abused or observed it directly. His political positions are public, for example his support of pedophiles. He claims that he in no way supports abusive relationships with children, yet refuses to acknowledge that children are generally in no position to provide consent, an evasive and highly toxic position. There is no question: RMS is toxic. We came for mailing list management, but we stayed for the community. We have a right to protect our community by dissociating it from toxic influences. We do not want our project associated with such a person, nor to provide economic resources to organizations that promote him to leadership positions. We are taking these actions to protect our community, both the narrow community of Mailman developers and users, and the broader open source community, from his toxic behavior and from the reputational damage that will come from helping to enable him. While we have no information suggesting that other members of the FSF Board are similarly toxic as individuals, as a group they enabled RMS for decades, and now have taken an explicit step in enabling him again. If they want to regain their position of respect and acceptance in our community, they must acknowledge their error, and we don't see -- given their reinstatement of RMS himself -- how they can do so convincingly while maintaining their positions on the Board. They must resign, and a new Board composed, to demonstrate their sincerity. What they do is up to them, of course, but if they do not take radical steps, we will continue to consider association with the FSF a threat to our community. For the Mailman community, Abhilash Raj (project leader) Mark Sapiro Stephen J. Turnbull Aurélien Bompard Terri Oda Barry Warsaw John Viega (founder) [1] Text and signatures: https://rms-open-letter.github.io [2] Appendix to the letter: https://rms-open-letter.github.io/appendix Related statements: https://rms-open-letter.github.io/statements

1 0

Resetting users' password for them?
by Duane Raymond April 10, 2021

April 10, 2021

Hi. I have quite a few users who when they reset their password, don't receive their password reset email. It works fine for many, so they are going out. But for those who they don't go out for, I was hoping to get their password reset key/token from the database tables and send it to them...only thing is I can't find it in there! )it may not be there). So what would you suggest for enabling people to reset their password when the system email isn't received: - Is there a way to get the reset token so I can send it manually - if so, where/how do I find it? - Would enabling social login be a work around for this problem? - Anything else you can suggest? Cheers, Duane

3 3

SpamAssassin header confusion
by skenny＠scss.tcd.ie April 10, 2021

April 10, 2021

I'm struggling to understand an aspect of SpamAssassin headers, and would greatly appreciate any help. Here is my scenario: One of my mailbox addresses - say addr1(a)somewhere.com - is a member of a Mailman 3 mailing list. I send a spam email (e.g. one with the GTUBE string) to the list from a different address. My mail server (Postfix/Amavis/Spamassassin) correctly identifies the mail as spam, and, appropriately, adds several spam-related headers - X-Spam-Flag, X-Spam-Score etc. I can see, from the copy of the email that lands in /var/lib/amavis/virusmails on the mail server, that those headers are indeed present. The mail message is handed off to Mailman for processing. The list in question has nonmember_default_action set to "defer", so Mailman sends the message on to each member address. However, the message, as it appears in the inbox of addr1(a)somewhere.com, contains no X-Spam- headers. The only indication of the message's spammish nature is in the Subject line, which has been prepended with the familiar string "***SPAM*****". On the face of it, it looks like Mailman has removed the X-Spam-* headers. If that's so, I don't understand why. I would be very grateful if anyone could help me figure out what is going on here. Thanks in advance, Stephen

2 4

Database deadlock when trying to delete a member.
by Simon Coggins April 9, 2021

April 9, 2021

Hi, I’ve got a strange error. I migrated from mailman 2.1 to 3 using the migration guide on the website and things have been working fine. But I’m in the process of testing the new syncmembers command to replace some inhouse mailman API code we wrote. I’ve tracked my problem down to what appears to be a deadlock in the postgresql database. When trying to delete certain users the SQL query hangs and never returns. After doing some tracing and tracking it down to the database, I enabled DB logging of all queries and saw that the following query was never returning: DELETE FROM member WHERE member.id = 166814 If I try to run it manually I get the same issue, in psql it never returns. mailman=# explain analyze DELETE FROM member WHERE member.id = 166814; [… 60 seconds passes…] ^CCancel request sent ERROR: canceling statement due to user request CONTEXT: while deleting tuple (2998,72) in relation "member" I’m just wondering if there are any commands or scripts I can run to verify the database and it’s constraints to see if there is some error in the database data? Or where you’d recommend I go from here? It only impacts the user on this specific list. If I add this user to another list and remove them, everything works fine. This is on a test system so I can do various testing. I’m trying to find the root cause so that I can verify my production system isn’t impacted by the same thing. Setup Details: OS: Oracle Linux 7 (Redhat) Installed using pip via virtualenv talking to a local pgsql database on the same box. Data was migrated from a mailman 2.1 install into mailman3 using migration instructions on the website. PIP Modules versions: django-mailman3 1.3.5 mailman 3.3.3 mailman-hyperkitty 1.1.0 mailmanclient 3.3.2 postorius 1.3.4 psycopg2-binary 2.8.5 RPM packages: postgresql12-12.6-1PGDG.rhel7.x86_64 postgresql12-server-12.6-1PGDG.rhel7.x86_64 postgresql12-libs-12.6-1PGDG.rhel7.x86_64 postgresql12-devel-12.6-1PGDG.rhel7.x86_64 -Simon

4 13

Filter who can send on mailman3 list?
by marcus.granath＠gmail.com April 8, 2021

April 8, 2021

Hi! I have a mailman3 mailing list which I admin, and I would like setup the following rule. Me and 3 of my team mates (who are part of the mailman3 list) should be able to send on the list as well as an "no-reply" user, others on the mailman3 list should only be able to receive the e-mails (and of course be able to unsubscribe themself). Both the: "Default action to take when a non-member posts to thelist" and the "Default action to take when a member posts to the list" is set to "Default processing", and I tried to setup actions in the "Header Filters" - but no really success.. :-( So what I basically try do achieve is to have only the following addresses to be allowed to send announcements (e-mails) on the mailman3 list, and all others that are member of the mailman3 list will just receive the e-mails. The usual "announcements" are sent out as the "no-reply" address (that actually are not really part of the mailman3 list) ;-) no-reply(a)abc.com ("fake address" that actually are not really part of the mailing-list) peter(a)abc.com david(a)abc.com marcus(a)abc.com How to achieve this kind of filter with mailman3?

6 12

Configuration variables in Docker
by Jens Günther April 8, 2021

April 8, 2021

Hey there, we installed the latest Docker version of Mailman3 and it seems to work for now. But I have 2 problems with configuration: ## DJANGO_ALLOWED_HOSTS Here it says, that allowed hosts can be added: https://asynchronous.in/docker-mailman/web/ How de we add multiple hosts? Did I miss something? When we set 1 URL, everything works (with 2(!) Domains, since SERVE_FROM_DOMAIN is the first one). Is there a way I miss to input multiple hosts, that the variable is an array? We tried: - DJANGO_ALLOWED_HOSTS=example1.com,example2.com - DJANGO_ALLOWED_HOSTS='example1.com, example2.com' - DJANGO_ALLOWED_HOSTS=example1.com example2.com - DJANGO_ALLOWED_HOSTS=example1.com,\nexample2.com And I think some more, but never works. The corresponding config file says: ALLOWED_HOSTS = [ "localhost", # Archiving API from Mailman, keep it. # "lists.your-domain.org", # Add here all production URLs you may have. "mailman-web", "172.19.199.3", os.environ.get('SERVE_FROM_DOMAIN'), os.environ.get('DJANGO_ALLOWED_HOSTS'), ] -> how is it possible to add an array for multiple Domains? -> if not possible, shall we provide a fix that it is? ## FILTER_VHOST I want this variable to be true in my container. When I set it as a starting variable like the other configuration options, then the variable in the container seems to be set: <code> # export | grep FILTER_VHOST= declare -x FILTER_VHOST="True" </code> But surely it still is set to false in mm-web-container: <code> # cat settings.py | grep FILTER_VHOST FILTER_VHOST = False </code> -> is it ok to put the variable like that!? -> if not, how can it be done, that it is preserved on restarting the container? -> if I see it right, it could be then something like: <code> FILTER_VHOST = os.environ.get('FILTER_VHOST_DOCKER'), </code> -> with some more exceptions-handling, it might work? Thanks in advance, Jens.

2 1

Seeting "Maximum number of recipients"
by David Partain April 8, 2021

April 8, 2021

Hi, I have an (admittedly old) version of Postorius in my install[1] on an Ubuntu 18.04 machine. Most things work fine. However, my version doesn't seem to have a way to set the maximum number of recipients under Message Acceptance, and mail is getting shunted because there was a setting for lists on the old mailman2 lists that I migrated over. If I'm going to avoid shunting, I have to change the value :) Since it isn't in Postorius, how should I change it? I'm frankly terrified of screwing things up on my production system, so any help would be appreciated. Cheers, David [1] python-django-postorius - 1.1.2-3

2 1

Maximum number of recipients Setting
by Brian Carpenter April 4, 2021

April 4, 2021

I have run several tests. It looks like on the 'Maximum number of recipients' setting, a 2 means 1. If I set it to 2, I can have the listname(a)listdomain.com only. If I have a CC, it comes to me for moderation. If I set it to a 3, I can send out to listname(a)listdomain.com plus a CC. If I set it to 3 and add 2 CC's plus the listname(a)listdomain.com address, it comes to me for moderation. -- Brian Carpenter Harmonylists.com Emwd.com

3 3

Mailman in Kubernetes
by danil＠smirnov.la April 3, 2021

April 3, 2021

For those who are interested in trying Mailman 3 in Kubernetes there is a Helm chart: https://github.com/danil-smirnov/mailman-helm-chart Your questions and contributions are very welcome! (Sending this from Hyperkitty UI, no clue how it will look like :D )

1 0

No digest.mmdf
by Christine March 29, 2021

March 29, 2021

I have mailman3 running now, more or less. Mailman did not send messages to my list, giving a permiission error on the digest.mmdf file, which was not there. I created the file and made list.list the owner, now it sends messages. I don't know what should have created the file or what set the permissions to the directory, I just thought I'd let you know. dagdag Christine -- dagdag is just a two character rotation of byebye

3 2

Rejection Reason for refusing a subscription request
by Brian Carpenter March 28, 2021

March 28, 2021

I was testing out the process of rejecting an incoming subscription request. Choosing the reject option for a moderated subscription request does send out a rejection notice but it gives no reason for the rejection. Please see: ------------------------------------------------------------------------ Your request to the redacted(a)redacted.com mailing list Subscription request has been rejected by the list moderator. The moderator gave the following reason for rejecting your request: "[No reason given]" Any questions or comments should be directed to the list administrator at: redacted-owner(a)redacted.com ------------------------------------------------------------------------ Is there a place somewhere in Postorius to provide a rejection reasons for moderated subscription requests? Does Mailman 3 core provide this via its REST api but it is just not revealed in Postorius yet? -- Brian Carpenter Harmonylists.com Emwd.com

3 7

rest api runner not running
by Christine March 27, 2021

March 27, 2021

Hi, I have been using mailman for about ten years, now I want to move the lists to another server, I have installed mailman3 there, most of it seems to be running, but the "rest api runner" is not. Nothing is listening on port 8001. What have I missed? What do I do to start the restapi runner? I checked the logs, I don't see anything suspicious. this is what systemctl status says: root@lists:~# systemctl status mailman3 ● mailman3.service - Mailman3 server Loaded: loaded (/lib/systemd/system/mailman3.service; enabled; vendor preset: enabled) Active: failed (Result: timeout) since Sat 2021-03-27 12:04:06 UTC; 6min ago Docs: man:mailman(1) https://mailman.readthedocs.io/ Process: 173111 ExecStart=/usr/bin/mailman -C /etc/mailman3/mailman.cfg start --force (code=killed, signal=TERM) Mar 27 12:02:36 lists systemd[1]: Starting Mailman3 server... Mar 27 12:04:06 lists systemd[1]: mailman3.service: start operation timed out. Terminating. Mar 27 12:04:06 lists systemd[1]: mailman3.service: Failed with result 'timeout'. Mar 27 12:04:06 lists systemd[1]: Failed to start Mailman3 server. There is nothing in mailman.log, nor in smtp.log dagdag Christine -- dagdag is just a two character rotation of byebye

2 1

Mixing Mailman 3 with AWS SES
by Ralph Weber March 27, 2021

March 27, 2021

I am moving the website www.t10.org from a private/corporate VM to AWS EC2s. For many years, t10.org has had very happy results with using Mailman 2 for its email reflector, and I have no real concerns about moving to Mailman 3. My bugbear is the fact that I need the following mixed bag of incoming email addresses to work in concert with each other to receive and handle emails. > t10(a)t10.org (Primary Mailman Reflector) > chair(a)t10.org (Mailman Reflector to direct messages to the T10 chair and his designates) * docs(a)t10.org (document posting mechanics - serviced by a small mountain of home-grown code code) * bbs(a)t10.org (other publicly accessible services - serviced by code that recalls the days when everything as done on a Bulletin Board System, BBS) My best guess is that the AWS Simple Email Service (SES) needs to sit in front of both Mailman and the home-grown code, to properly direct the incoming emails to the right places. The big worry is as follows... All available evidence read to date suggests that the default AWS installation of Mailman 3 assumes that Mailman 3 is the *only* receiver of emails in the configuration. If true, then putting SES in front of Mailman could be a Herculean challenge. Or... Hercules may have already cleaned the Augean Stables, and left behind a AWS Lambda function that can serve as a keystone puzzle piece for solving my dilemma. Thanks for taking the time to look at this. All the best, .Ralph FWIW Information about the current t10.org Mailman reflector can be found at https://www.t10.org/t10r.htm. T10 is primarily an open-to-the-public activity, so there are no company confidential secrets there. For those interested in the archives associated with the t10.org Mailman reflector, they are available at https://www.t10.org/pipermail/t10/ and "inquiring minds" may puzzle over the fact that the archives date back to December 1993. When Mailman 2 was installed, we converted all the Majordomo archives to Mailman 2 format.

8 15

Mysterious Bounces Being Logged
by Brian Carpenter March 27, 2021

March 27, 2021

I keep seeing bounces being recorded in logs/bounce.log that have no corresponding entry in Postfix's mail.log. For instance one address had registered about 2 dozen bounces in the past week in bounce.log and yet every single entry for this address in mail.log has a status=sent. What am I missing here? -- Brian Carpenter Harmonylists.com Emwd.com

3 6

Mailman 3 centos7 installation issues
by bader＠cchmc.org March 25, 2021

March 25, 2021

So I am working with our Linux admin to install mailman3 in centos7 following this instructions https://docs.mailman3.org/en/latest/install/virtualenv.html# (and adjusting for centos versus Debian) The install went fine with the command “pip install wheel mailman psycopg2-binary”until the config file. /etc/mailman3/mailman.cfg The /etc/mailman3 directory did not get created? Should it have? We created it and the config file But “mailman info” throws errors venv) [mailman@bmimailmandr2 var]$ mailman info Traceback (most recent call last): File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 2336, in _wrap_pool_connect return fn() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 364, in connect return _ConnectionFairy._checkout(self) File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 778, in _checkout fairy = _ConnectionRecord.checkout(pool) File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 495, in checkout rec = pool._do_get() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/impl.py", line 140, in _do_get self._dec_overflow() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ with_traceback=exc_tb, File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/impl.py", line 137, in _do_get return self._create_connection() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 309, in _create_connection return _ConnectionRecor I suspect it is not using the config file at /etc/mailman3/mailman.cfg But we do not even see a mailman service in /etc/systemd/system/mailman3.service. Also, we are using python 3.6, will that be a major issue? or should spend the time to install 3.7 from source?

3 3

Changing subscription address
by Allan Hansen March 23, 2021

March 23, 2021

All, I need help with this. A subscriber is a member of 14 of the lists on my system (others have more subscriptions). This member needs to change the address and is dyslexic, so I’ve been asked to help. I added the new address to her account in Django and set it as the preferred address. However, when she was subscribed, the system set her old address as the list subscription address, instead of her ‘preferred’ address. Well, I’m not sure of this as I cannot access her Settings, but that’s how it worked with one of my own addresses. Will I now have to tell her to do this for each list she is subscribed to: Select ‘Mailman Settings’ in dialog pulldown. Select one of the lists listed. Click on ‘Manage Subscription.’ In ‘Select Emai’, select the ‘Primary Address’ pulldown option Click on ‘Change email used for subscription.’ Please note that the “Global Mailman preferences’ nor the ‘Address-based preferences’ have the option to select the preferred address. I realize that once a member has an account in Django AND has preferred address set AND has selected the ‘Primary Address’ for each list, then this will be easier. However, I have 10000+ subscriptions by some 1500 members, most of whom were moved over from MM2 and have no Django accounts. Someone on list some time ago advised me that it was possible to do this easily globally. I have spent a couple of hours on the system trying to find that way but the above per-list procedure is all I found. Please make this easy, as I get these requests all the time and some, like this one, are on many lists. Yours, Allan

5 16

FILTER_VHOST not working
by Johannes Rohr March 23, 2021

March 23, 2021

In /etc/mailman3/mailman-web.py I have added FILTER_VHOST = True so that only the list for the current domain are shown. But this has no effect. What's more, in hyperkitty I see at the top left the lable for the default domain, even though I am visiting from another domain. The web domains are exactly the same as the mail domans (lists.[domain].[tld]) In the Nginx config I have added location / { proxy_set_header X-Forwarded-Proto $scheme; proxy_set_header X-Forwarded-Host $host; proxy_pass http://localhost:8000/; [....] } to make sure that mailman3 knows from which URL it is visited. Am I overlooking something? I am using the distribution packages on Ubuntu 20.04: mailman3 3.2.2-1 mailman3-web 0+20180916-10 I see, the mailman3-web package is quite dated. Is it recommended to install via virtualenv instead? Cheers, Johannes

2 1

Mailman Core 3.3.4 is now out
by Abhilash Raj March 22, 2021

March 22, 2021

Hey Everyone, I am pleased to announce that Mailman Core 3.3.4 is now out. Because of incompatibility with the new version of a downstream library (SQLAlchemy), this release add is setting 1.3.x as the max supported version of SQLAlchemy. Even though it comes soon after 3.3.3, it has a lot of bug fixes and new features. Some notable ones are: * Email -join command now supports subscribing as digests with digest=<no|mime|plain> options being honored. * For anonymous lists, Mailman will filter all the headers except a few that can be configured using a new config option. * Mailman can do max_size checks on filtered message rather than original message (which might be larger before being filtered) * Previously deprecated --add, --del and --sync options from `mailman members` command are now removed. Their alternatives are `addmembers`, `delmembers` and `syncmembers` subcommands. * If configured, Mailman will add a report about content filtering. A complete change log is available here: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS.… This release is available via PyPI: https://pypi.org/project/mailman/3.3.4/ You can install or upgrade using: ``` $ pip install --upgrade mailman ``` Thanks to all the contributors who helped with this release! -- On behalf of Mailman Core Team Abhilash Raj

1 0

Disable user registration
by Torge Riedel March 21, 2021

March 21, 2021

Hi list, how can I disable user registration? There are only two users, me - the admin - and an additional owner/moderator. The list setup we use is completely managed by the owner/moderator (about 100 mail adresses per list). Thanks Torge

6 13

Problem with languages
by Jens Günther March 20, 2021

March 20, 2021

Hey, I set up Mailman3 from the Debian-packages and got it working. But for some reason I do have a mixed setup in languages now. Some strings are in English, some are in German. The settings I changed are: in mailman.cfg [mailman] default_language: de in mailman-web.py LANGUAGE_CODE = 'de-DE' TIME_ZONE = 'Europe/Berlin' Nothing changed after restarting services. I then came across this post: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… -> but actually I do not find any of the files, ... - no mailman.po / .mo - no generate_mo.sh - no languages folders in /usr/lib/python3/dist-packages/mailman/messages - when searching with locate (after updatedb) no LC_MESSAGES/mailman or anything stated in the post Actually it would be fantastic to be able to choose language for the web interface / lists like on this here, but this is additional :-) just to have it in one language, this time German would be cool. I also would translate, but it seems finished: https://hosted.weblate.org/projects/gnu-mailman/mailman/ Thank you for help, regards, Jens.

4 7

only show mail domains from web host on web-host-url
by jens.guenther＠posteo.de March 19, 2021

March 19, 2021

Is it possible, to only show publicly (if advertised) these lists on a certain url, that are corresponding to the web host the url I accessed mailman through? I tried to configure different Web hosts with different Mail domains ... but through all the domains all mailing lists are advertised and I don't get why I then should configure different web hosts :-) Another solution for me would be, that I have only 1 Web host, don't advertise any Mailing-lists (or only certain ones) and configure different administrators for certain mail domains. But also that I don't see how it should be done :-( Sorry for the maybe nooby/newby question, but I just started trying Mailman3 and hoped for a better support for multidomain (which I till right now like in contrast to mailman2, whih has been a hazzle to register new Domains on the same server, but worked :-)). Thanks inadvance.

4 8