- Mailman-users - lists.mailman3.org

Re: [Mailman-Developers] How to know the URLs for CURL while getting or modifying the data of mailman 3
by Stephen J. Turnbull April 25, 2020

April 25, 2020

Shashi, This whole thread is off-topic for the developers list. This list is for development of Mailman, not for teaching people to use it. Read the whole recommended documentation before you ask busy developers to tutor you in very basic things. There's a mailman-users(a)mailman3.org list for users to help each other. All of the Mailman developers who might be willing to answer your questions are there as well, but there are also many experienced users, some of whom have experimented with the REST API who will also help. Please reply there for further help. (Reply-To is set.) That said, there are plenty of URLs in the API documentation. Here's a hint: search for "dump_json". That function takes an URL. You may want https: instead of http: in your URLs, and you may need to change the port from 9001, depending on the configuration of your REST server. Try it with simple GET requests for information first, such as for domains or lists. You can also do these requests with an ordinary web browser, though I don't know what it will do with the JSON-formatted reply. If you don't have domains and lists configured, I suppose the informational requests will come back as empty JSON objects. It should be safe to make them. You can either use Postorius to bootstrap a few example domains, lists, and users, or (the hard way) figure out how to POST appropriate requests. I don't recommend trying to update the backend DBMS by hand; the schema is quite complicated. I don't know how to use curl to update Mailman's databases. That requires a POST request which I have never done with curl. The POST request needs to be valid JSON. The more I think about this, the less I think your idea of using curl is worthwhile, because formatting JSON requests by hand is going to be a real annoyance and a great way to mess up your database with spurious information. You're really going to want programmatic support for this. But that's already all available in Python in the Mailman system. It's up to you, but I feel a responsibility to warn you that using curl is not going to be simpler than learning enough Python to do these things. Regards,

2 1

Bounce processing
by Andrew Hodgson April 23, 2020

April 23, 2020

Hi, Just upgraded to Mailman 3.3.1 at the beginning of the week and its very refreshing to have bounce processing working after all this time, stops the continued delivery to dud email addresses causing problems with junk email scoring. Anyway after a few days of using this I have noted the following feedback: When users are set to disabled after their bounce score reaches a certain threshold, I seem to recall on Mailman 2 they were sent an email with a link to reactivate their subscription. On Mailman 3 they are told to contact the list admin, I have had messages from a few subscribers regarding this asking how they can re-enable delivery. I am also getting bounces that look like they are coming from Qmail (Yahoo addresses) which are being forwarded to the list owner as unrecognised bounces. Should the type of bounces that Mailman 2 was handling be handled in Mailman 3 or is the way that the addresses are extracted different? I have disabled the relevant users but do have the bounces to hand. Thanks. Andrew.

2 1

Changing web access
by Ralf Wiegand April 22, 2020

April 22, 2020

Hello Members, I am testing mailman3 in a test environment. python manage.py runserver Performing system checks... System check identified no issues (0 silenced). April 22, 2020 - 14:13:57 Django version 2.2.12, using settings 'settings' Starting development server at http://127.0.0.1:8000/ Quit the server with CONTROL-C. tcp 0 0 127.0.0.1:8000 0.0.0.0:* LISTEN 6497/python tcp 0 0 127.0.0.1:8001 0.0.0.0:* LISTEN 6404/python How can I change this to have access from any host on my local network. The server running mailman3+hyperkitty+postorius is a rhel7 server without a GUI interface. I also need to give access to our developer on the same subnet. Thank You, Best regards, Ralf Wiegand

3 5

Can't open PID file after start.
by Torge Riedel April 22, 2020

April 22, 2020

Hi, today there were some package upgrades on my server for python3. Just to be safe I did a "systemctl restart mailman" afterwards. Calling "systemctl status mailman" gave me the following output: mailman.service - GNU Mailing List Manager Loaded: loaded (/opt/mailman/core/mailman.service; enabled; vendor preset: enabled) Active: active (running) since Wed 2020-04-22 07:01:30 CEST; 6s ago Process: 24178 ExecStop=/opt/mailman/core/bin/mailman.sh stop (code=exited, status=0/SUCCESS) Process: 24180 ExecStart=/opt/mailman/core/bin/mailman.sh start (code=exited, status=0/SUCCESS) Main PID: 24182 (python3) Tasks: 13 (limit: 2335) CGroup: /system.slice/mailman.service ├─24182 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/master -C /opt/mailman/core/mailman.cfg ├─24185 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=archive:0:1 ├─24186 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=bounces:0:1 ├─24187 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=command:0:1 ├─24188 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=in:0:1 ├─24189 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=lmtp:0:1 ├─24190 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=nntp:0:1 ├─24191 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=out:0:1 ├─24192 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=pipeline:0:1 ├─24193 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=rest:0:1 ├─24194 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=retry:0:1 ├─24195 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=virgin:0:1 └─24196 /opt/mailman/core/venv/bin/python3 /opt/mailman/core/venv/bin/runner -C /opt/mailman/core/mailman.cfg --runner=digest:0:1 Apr 22 07:01:28 basis2 systemd[1]: Starting GNU Mailing List Manager... Apr 22 07:01:29 basis2 mailman.sh[24180]: Starting Mailman's master runner Apr 22 07:01:29 basis2 systemd[1]: mailman.service: Can't open PID file /opt/mailman/var/master.pid (yet?) after start: No such file or directory Apr 22 07:01:30 basis2 systemd[1]: Started GNU Mailing List Manager. Should I treat the PID message as an info or is it an error and something is now broken? The file is there (content is 24182) and timestamp is from the time where I restarted mailman. Best Torge

2 2

Different Mail Domain Cause Key Error
by Brian Carpenter April 22, 2020

April 22, 2020

I have a client that requires his list address to be list(a)domain.com. But since he is using domain.com for an external website, he has to access his list via Postorius using list.domain.com. So here is what I did: Django Admin Add Site: list.domain.com Add Mail Domain: domain.com (Site selected is list.domain.com) Postorius Add Domain: Mailhost is domain.com. Web Host is list.domain.com (list.domain.com) I have list.domain.com listed in the allowed hosts in settings_local.py. I even added domain.com there as well. When I try to access Postorius using list.domain.com I get a "An error occurred while processing your request." message and the logs shows the dreaded: ``` 'Internal Server Error: /mailman3/lists/ KeyError at /mailman3/lists/ 'file' ``` Did I miss a step here? Thanks, Brian

3 6

MM3 gateway errors and frequent reboot needs
by hansen＠rc.org April 22, 2020

April 22, 2020

We have had to reboot the list server almost every week and wonder if there is something leaking and eating up resources. I does not appear to be memory, though. The server is slow to respond (could be because it's overseas) and then after some time we get intermittent gateway errors and finally we cannot access the lists online because of the gateway errors. It appears to me that the issue is with Postorius, but I could be wrong. Do files get closed after opening? Are we alone having such issues? Please advise. PS: My old MM2 installation could (and did) run without any help. Not so with MM3.

4 3

Mailman Core 3.3.1 release
by Abhilash Raj April 19, 2020

April 19, 2020

Hey Everyone, I am pleased to announce Mailman Core 3.3.1 is now out. This release includes support for bounce processing, which had been lacking in Mailman 3 until now. So, after upgrading to this release, you will notice bounce related notifications from Mailman 3 being sent out to list owners if the list has bounce processing enabled (which, most list do by default). Postorius changes for new bounce processing options are coming out soon, I would like the current head to bake in a little longer since it went through bootstrap 4 upgrade recently. Expect it to be out in about a month. If your users would really care about bounce processing being enabled and not being able to tune threshold and notification parameters in the web interface, you might want to wait for Postorius's next release before upgrading. It also exposes all the remaining attributes of MailingList via REST API, so Postorius can expose them in the Web Interface. This should finally make all attributes of a MailingList manageable via Web Interface, without having to access command line interface. There has also been a whole lot of bug fixes. A full list of changes can be found at: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#id1 The release is available via PyPI: https://pypi.org/project/mailman/3.3.1/ To install this release via pip, you can run: $ pip install --upgrade mailman -- thanks, Abhilash Raj (maxking)

1 0

Extract posts into mbox file
by Andrew Bernard April 18, 2020

April 18, 2020

Where are the posts stored in the database? What tables? How would on go about exporting them into mbox format for the complete set?

3 2

Recommended way to backup a mailman3 instance
by Gilles Filippini April 18, 2020

April 18, 2020

Hi, I'd like to schedule periodic backup for our mailman3 instance. Are there recommended ways for doing this without down times? Thanks in advance, _g.

4 12

Is a directory: '…/mailman/templates'
by Stefan Tatschner April 14, 2020

April 14, 2020

hey folks, I am struggling with my mailman server for quite some time now. I am on 3.3 and the out runner cannot sent emails any more. According to this issue [1] I found out--by logging the exception as well--, that mailman has this problem: Mar 31 09:34:51 2020 (71057) ACCEPT: <c1e4aa1be5b61c289c69a66a6d55565333d5a35b.camel(a)rumpelsepp.org> Mar 31 09:34:52 2020 (71079) Cannot connect to SMTP server 127.0.0.1 on port 25: [Errno 21] Is a directory: '/usr/lib/python3.8/site-packages/mailman/templates' What the hell is going on here? ☹︎ any ideas what's wrong? The runner doesn't try to connect to postfix, since it fails with a strange template error. Stefan [1]: https://gitlab.com/mailman/mailman/-/issues/514

5 6

Mailman Core 3.3.1rc1 release
by Abhilash Raj April 10, 2020

April 10, 2020

Hey Everyone, I have just released Mailman Core 3.3.1rc1. The final release is scheduled for next week, 17th April. This release includes support for bounce processing, which had been lacking in Mailman 3 until now. So, after upgrading to this release, you will notice bounce related notifications from Mailman 3 being sent out to list owners if the list has bounce processing enabled (which, most list do by default). Postorius changes for new bounce processing options are coming out soon, I would like the current head to bake in a little longer since it went through bootstrap 4 upgrade recently. Expect it to be out in about a month. If your users would really care about bounce processing being enabled and not being able to tune threshold and notification parameters in the web interface, you might want to wait for Postorius's next release before upgrading. It also exposes all the remaining attributes of MailingList via REST API, so Postorius can expose them in the Web Interface. This should finally make all attributes of a MailingList manageable via Web Interface, without having to access command line interface. There has also been a whole lot of bug fixes. A full list of changes can be found at: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#rc1 The release is available via PyPI: https://pypi.org/project/mailman/3.3.1rc1/ To install this release via pip, you can run: $ pip install --upgrade --pre mailman Note the `--pre` flag because this is a pre-release. If you can, I encourage you to try this out with your environment and report any major breakage to us. We have been running this code on the server hosting this list, so it has already seen some testing, but it is always nice to have some more. If there aren't any major breaking changes reported, the final release will be identical to this one. -- thanks, Abhilash Raj (maxking)

2 1

SMTPAuthenticationError at /accounts/login/
by mmasoudf＠aaas.org April 9, 2020

April 9, 2020

I have setup the stack according to: Mailman Suite Documentation. Release 3.3 PDF file. I configured EMAIL_HOST_USER and EMAIL_HOST_PASSWORD in Django settings.py. I could not find the place that I might configure it for Postfix and , sort of logically, I get the following error: SMTPAuthenticationError at /accounts/login/ I can see that it tries the user name and password I configured in settings.py (EMAIL_HOST_USER , EMAIL_HOST_PASSWORD). When I try to access the site through the web. I can login as admin, but not as any other user. I am running the site on AWS and to be able to use AWS mail-servers I have to define following parameter for AWS: smtp_sasl_password_maps which points to a hash for AWS 'ACCESS KEY ID' and 'SECRET ACCESS KEY' Any idea is highly appreciated.

3 2

Loads of postgres requests: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" ...
by Gilles Filippini April 9, 2020

April 9, 2020

Hello, I run a small mailman3 server (6 lists, less than 100 users), and I can't access anymore to the administration web page for one of these lists: > Something went wrong > Mailman REST API not available. Please start Mailman core. The other lists seems OK. Looking at the postregsql logs I see a full load of these requests (4 to 5 per second!): LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2020-04-09T07:57:37.828200+00:00'::timestamptz) LIMIT 1 Any clue appreciated. Many thanks in advance, _g.

2 2

Re: Uncaught runner exception
by Wolfgang Bock April 9, 2020

April 9, 2020

Hello Mark, thanks for your hint. Postfix is runnig as mta on my machine. I tested port 25 with swaks ->mail to user on server: localhost port 25 -> everything fine Mailman is configured with localhost for incoming and outgoing mails. After stopping mailman3, deleting all files in the queue directories, restart mailman3 I sent a test-mail /var/log/mailman3/mailman.log Apr 07 12:08:23 2020 (28198) Master started Apr 07 12:08:24 2020 (28206) out runner started. Apr 07 12:08:24 2020 (28202) command runner started. Apr 07 12:08:24 2020 (28203) in runner started. Apr 07 12:08:24 2020 (28200) archive runner started. Apr 07 12:08:24 2020 (28201) bounces runner started. Apr 07 12:08:24 2020 (28210) retry runner started. Apr 07 12:08:25 2020 (28208) rest runner started. Apr 07 12:08:25 2020 (28212) digest runner started. Apr 07 12:08:25 2020 (28205) nntp runner started. Apr 07 12:08:26 2020 (28211) virgin runner started. Apr 07 12:08:26 2020 (28207) pipeline runner started. Apr 07 12:08:26 2020 (28204) lmtp runner started. Apr 07 12:09:19 2020 (28203) ACCEPT: <000f01d60cc4$96c9a8d0$c45cfa70$@[domain]> Apr 07 12:09:21 2020 (28206) Cannot connect to SMTP server localhost on port 25 I have no idea what to do for solving my problems. Regards from Hamburg Wolfgang -----Ursprüngliche Nachricht----- Von: Mark Sapiro <mark(a)msapiro.net> Gesendet: Montag, 6. April 2020 23:50 An: Wolfgang Bock <mailinglisten(a)wbock.de> Betreff: Re: [MM3-users] Re: Uncaught runner exception On 4/6/20 2:44 PM, Wolfgang Bock via Mailman-users wrote: > Thank you Steven for your reply! > > I Set smtp_server to port 25 and got a "Cannot connect ro SMTP Server > on port 25", the former error message didn't show again. > > As I see port 25 is reseved for postfix. So I have to fiddle out how > mailman3 could also use this port for sending mails out. .... You need an MTA for Mailman to deliver its mail to. Normally this will be Postfix, sendmail, Exim, etc running on localhost and listening on port 25. Do you have such an MTA running on localhost? Note, Mailman does not directly send mail to end recipients. It only delivers mail to an outgoing MTA. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 8

Outgoing STMP services? IP reputations?
by Seth Seeger April 7, 2020

April 7, 2020

Hello everyone, Forgive me if this is the wrong list. I’m curious to hear what users are doing for MM3 hosting and what you are using for outgoing services. I am hosting a Mailman3 installation for a community that I am part of, and we have 6 lists which generated 136,000 outgoing emails last month. I’m currently hosting this on a 2-core 4GB RAM EC2 (t3a.medium) instance at Amazon. I went with Amazon because their outgoing email relay (SES) is free for the first 62,000 emails/month. (I didn’t do my homework - I thought that would be plenty!) I’d much rather be hosting on Linode, since their setup is waaaaay simpler and easier to understand. I went with an SMTP service so that I wouldn’t have to deal with managing an IP address reputation…. (Any other SMTP relay service besides the Amazon SES/hosting would cost >$80/month.) Do you use an SMTP relay service? Do you just send directly from your VM’s IP address? Do you have trouble with getting black listed? What have you done about your IP address reputation? Is DKIM and SPF enough to get past an IP address without an established reputation? Thank you! Seth

3 2

Uncaught runner exception
by Wolfgang Bock April 7, 2020

April 7, 2020

Hello, I need your help. I got a "Uncaught runner exception: invalid literal for int() with base 10:" Referring to a discussion in Sept. 2019 with Manos Pitsidianakis "Cannot connect to SMTP server localhost on port 25" I did following: stop both postfix and mailman 3 services. Deleted all files in the /var/lib/mailman3/queue directories. Restarted both services. With following configurations: (extracts): /etc/mailman3/mailman.cfg [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver smtp_host: Tried with 127.0.0.1/localhost/server ip or FQDN=servername smtp_port: (got a "cannot connect to SMTP Server on port 25") so I let this item empty ... smtp_user: smtp_pass: lmtp_host: 127.0.0.1 lmtp_port: 8024 configuration: python:mailman.config.postfix /var/log/postfix/mail.info Apr 6 00:02:22 ... postfix/postfix-script[31407]: starting the Postfix mail system Apr 6 00:02:22 ... postfix/master[31409]: daemon started -- version 3.4.8, configuration /etc/postfix Apr 6 00:03:09 ... postfix/smtpd[31462]: connect from mout-p-103.mailbox.org[80.241.56.161] Apr 6 00:03:09 ... policyd-spf[31468]: prepend Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=80.241.56.161; helo=mout-p-103.mailbox.org; envelope-from=[mail address]; receiver=<UNKNOWN> Apr 6 00:03:09 ... postfix/smtpd[31462]: D29FE138023E: client=mout-p-103.mailbox.org[80.241.56.161] Apr 6 00:03:09 ... postfix/cleanup[31471]: D29FE138023E: message-id=<6a504834-123a-60f6-3a0e-494623b74523(a)mailbox.org> Apr 6 00:03:25 ... postfix/qmgr[31411]: D29FE138023E: from=<[mail address]>, size=2811, nrcpt=1 (queue active) Apr 6 00:03:25 ... postfix/smtpd[31462]: disconnect from mout-p-103.mailbox.org[80.241.56.161] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Apr 6 00:03:25 ... postfix/lmtp[31481]: D29FE138023E: to=<[list address]>, relay=127.0.0.1[127.0.0.1]:8024, delay=16, delays=16/0.01/0/0.1, dsn=2.0.0, status=sent (250 Ok) Apr 6 00:03:25 ... postfix/qmgr[31411]: D29FE138023E: removed /var/log/mailman3/mailman.log Apr 06 00:02:12 2020 (31148) Master started Apr 06 00:02:13 2020 (31158) rest runner started. Apr 06 00:02:13 2020 (31150) archive runner started. Apr 06 00:02:13 2020 (31159) retry runner started. Apr 06 00:02:14 2020 (31161) virgin runner started. Apr 06 00:02:14 2020 (31154) lmtp runner started. Apr 06 00:02:14 2020 (31155) nntp runner started. Apr 06 00:02:14 2020 (31153) in runner started. Apr 06 00:02:14 2020 (31151) bounces runner started. Apr 06 00:02:15 2020 (31157) pipeline runner started. Apr 06 00:02:15 2020 (31152) command runner started. Apr 06 00:02:15 2020 (31162) digest runner started. Apr 06 00:02:16 2020 (31156) out runner started. Apr 06 00:03:26 2020 (31153) ACCEPT: <6a504834-123a-60f6-3a0e-494623b74523(a)mailbox.org> Apr 06 00:03:26 2020 (31156) Uncaught runner exception: invalid literal for int() with base 10: '' Apr 06 00:03:26 2020 (31156) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/mta/deliver.py", line 77, in deliver agent = BulkDelivery(int(config.mta.max_recipients)) File "/usr/lib/python3/dist-packages/mailman/mta/bulk.py", line 50, in __init__ super().__init__() File "/usr/lib/python3/dist-packages/mailman/mta/base.py", line 45, in __init__ config.mta.smtp_host, int(config.mta.smtp_port), Any hints how to solve the problem?? Regards Wolfgang

2 4

Protocol version
by David Krantz April 5, 2020

April 5, 2020

Hi. I have the following displayed when I look at the "System Information" in Postorius: Mailman Core Version GNU Mailman 3.3.0 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.7.6 (default, Dec 19 2019, 23:49:42) [GCC 5.4.0 20160609] What surprises me is the protocol version. I have tried to set the protocol version to 3.1 in mailman core (which should be the latest according to the documentation) and restarting both core and web but that gives no effect. Normally I have not had any protocol version defined. Everything seems to work just fine but something is strange, either the documentation, my setup or mailman/postorius. // David

1 1

Postorius confirmation mails shown in uwsgi-error.log but not sent
by Ralph Seichter April 4, 2020

April 4, 2020

I have struggled for hours but cannot seem to figure it out. After registering new user accounts in Postorius, the "confirm your address" emails don't get sent via SMTP (my MTA does not even log connection attempts), but their content is displayed in uwsgi-error.log. I think I disabled developer mode in Core and Postorius: $ mailman conf | grep devmode [devmode] enabled: no [devmode] recipient: [devmode] testing: no [devmode] wait: 60s $ grep ^DEBUG settings.py DEBUG = False Users can subscribe via list-join(a)domain.tld, including confirmations. Account registration using the WebUI works as well, it's just the emails that don't get sent. What am I missing, I wonder? -Ralph

3 10

Finding a mailman3 installation description that works
by ralf.wiegand＠tena-sda.org April 1, 2020

April 1, 2020

WE are currently using mailman2. I have the task to setup and install a maiman3 server. Postfix is installed and working. Can anybody point me to a link where the actual installation is described using RHEL 7 or RHEL 8. This will be a hardened DISA compliant server, so I am trying to avoid installing compilers and tools that are not part of the standard RHEL 7 repos. Thank You, Best regards, Ralf Wiegand

3 4

Mailman3 moving to new server, not able to establish SMTP connection
by Andrew Hodgson March 28, 2020

March 28, 2020

Hi, Whilst we are all stuck in doors I have started a project to move Mailman3 from a Docker installation to a new server using a Python venv. Old server was Debian Jessie and the new one is Buster. Using Exim with stock config. Everything seems to be going ok but mail isn't delivering (cannot connect to SMTP server). I have /opt/mailman which I did chown -R list:list mailman.cfg has following MTA settings: [mta] incoming: mailman.mta.exim4.LMTP configuration: python:mailman.config.exim4 I wrote a Systemd unit which starts Mailman from the venv and started up Mailman once I got Postgres sorted so it would create the necessary files in the var directory structure. One thing I noticed and had to fix is that it doesn't creat the directories for existing lists, and the Exim config examples out there check for the existance of those directories to identify whether the address exists. I created those anyway and set ownership perms as before. Once I fixed that I sent a test message to the owner address and that routed correctly and the headers indicated the message was sent back to localhost by Mailman. However I can't get it to route a list message, here is a log showing the start of the Mailman master processes and me sending a test message from Outlook (so incoming mail is routing ok): Mar 28 16:03:20 2020 (21877) Master started Mar 28 16:03:32 2020 (21889) lmtp runner started. Mar 28 16:03:32 2020 (21896) virgin runner started. Mar 28 16:03:32 2020 (21887) command runner started. Mar 28 16:03:32 2020 (21890) nntp runner started. Mar 28 16:03:32 2020 (21886) bounces runner started. Mar 28 16:03:33 2020 (21892) pipeline runner started. Mar 28 16:03:33 2020 (21888) in runner started. Mar 28 16:03:33 2020 (21895) retry runner started. Mar 28 16:03:34 2020 (21894) rest runner started. [2020-03-28 16:03:34 +0000] [21894] [INFO] Starting gunicorn 20.0.4 [2020-03-28 16:03:34 +0000] [21894] [INFO] Listening at: http://127.0.0.1:8001 (21894) [2020-03-28 16:03:34 +0000] [21894] [INFO] Using worker: sync [2020-03-28 16:03:34 +0000] [21963] [INFO] Booting worker with pid: 21963 Mar 28 16:03:34 2020 (21885) archive runner started. [2020-03-28 16:03:34 +0000] [21965] [INFO] Booting worker with pid: 21965 Mar 28 16:03:34 2020 (21897) digest runner started. Mar 28 16:03:36 2020 (21891) out runner started. Mar 28 16:04:25 2020 (21888) ACCEPT: <AM0PR08MB39085771D0E2D9114FDE8E83AFCD0(a)AM0PR08MB3908.eurprd08.prod.outlook.com> Mar 28 16:04:26 2020 (21885) HyperKitty archived message <AM0PR08MB39085771D0E2D9114FDE8E83AFCD0(a)AM0PR08MB3908.eurprd08.prod.outlook.com> to https://lists.hodgsonfamily.org/hyperkitty/list/blind-sysadmins@lists.hodgs… [28/Mar/2020:16:04:26 +0000] "GET /3.0/lists/blind-sysadmins(a)lists.hodgsonfamily.org HTTP/1.1" 200 445 "-" "GNU Mailman REST client v3.3.0" Mar 28 16:04:27 2020 (21891) Cannot connect to SMTP server localhost on port 25 [28/Mar/2020:16:04:27 +0000] "GET /3.0/lists/blind-sysadmins(a)lists.hodgsonfamily.org/config HTTP/1.1" 200 2595 "-" "GNU Mailman REST client v3.3.0" [28/Mar/2020:16:04:27 +0000] "GET /3.0/users/andrew(a)hodgson.io HTTP/1.1" 200 439 "-" "GNU Mailman REST client v3.3.0" Now in the out queue I have this: root@elrond:/opt/mailman# ls -la /opt/mailman/var/queue/out total 32 drwxrwx--- 2 list list 4096 Mar 28 16:34 . drwxr-xr-x 14 list list 4096 Mar 28 13:25 .. -rw-rw---- 1 list list 11152 Mar 28 16:34 1585413255.2412584+390ab148e589108ed9e849445e5e90410f69def3.bak -rw-rw---- 1 list list 11152 Mar 28 16:34 1585413255.4891446+75bde47331619263b05f582c28ceb85a13bb5265.pck.tmp There is no connection attempt in the Exim log from Mailman and I can connect to localhost:25. This is a dualstack machine and I was wondering whether we had any IPV6 issues (I had an issue with Gunicorn and Nginx routing traffic due to this earlier that I had to sort), but as owner addresses are working I don't know what is different on that. Any suggestions? Thanks. Andrew.

1 1

421 - Too many sessions from source IP
by hansen＠rc.org March 27, 2020

March 27, 2020

My new MM3 server is receiving these errors from cox.net: "(delivery temporarily suspended: host cxr.mx.a.cloudfilter.net[34.212.80.54] refused to talk to me: 421 cxr-ibgw-6004a.stratus.cloudmark.com cmsmtp too many sessions from 213.125.4.246. Refer to Error Codes section at https://www.cox.com/residential/support/email-error-codes.html for more information. AUP#CXCNCT) " The link gives just this: 421 - [too many sessions from <source IP>] The sending IP address has exceeded the five maximum concurrent connection limit. Configure your sending server to establish no more than five concurrent connections. 1. Is that a legitimate excuse to refuse passing on emails or is cox.net too stingy? 2. Is that a setting we need to change in Mailman somewhere? Or should this be handled in some Postfix setting? Yours, Allan

4 3

Archives with encoding characters
by Seth Seeger March 25, 2020

March 25, 2020

Hello everyone, I have a few (but not all) members complaining that their digests are full of coded characters. Two examples below were forwarded to me: > What I ended up doing was creating 2 "practice lines" in the centre of=20 > our big teaching circle (I always teach new figures in a big circle) -=20 > which each had 3 people set up in a line with generous space between,=20 > and first=C2=A0 I walked through one of those lines myself starting first= > =20 and > Robins pass Right=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Larks Loop L= > eft What is the cause? Is there anything I can do about it? Thanks, Seth

3 7

Things I miss about mailman2
by Quanah Gibson-Mount March 24, 2020

March 24, 2020

Now that we are on mailman3, I'm finding things that were really useful in mailman2 are completely missing in mailman3, which seems odd, since they in particular affect the ability of list moderators to do their job well. a) When a post was made to a moderated list in mailman2, I would get an email that included a LINK to the held email. Now I just get a canned email saying I need to go to the dashboard, blah blah. Why was this link removed? It was extremely useful and now I have to jump through extra hoops. b) When a post is made to a moderated list in mailman2, when I went to the page to approve/deny/discard, there was additionally an option to remove the moderated flag from the user for all future emails. This option no longer exists. This was EXTREMELY useful, as we force all new members of the list to be moderated for a time while we evaluate the quality of their postings. Now I have to go manually track down the user and their settings. Unnecessary extra hoops to jump through c) When a post is made to a moderated list, one of the options when selecting REJECT was it allowed me to set a custom message when rejecting the email. This was extremely useful. For example today, someone emailed our bug tracking list directly instead of filing a bug. In the past, I would have added a note to them about what they should do (in this case, I would have told them to send their email to our community technical discussion list). Now I can no longer do that, I can only reject it or discard it. Why was this removed? --Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

6 9

Xapian alternatives
by Andrew Bernard March 24, 2020

March 24, 2020

Are there alternative search engines to Xapian that can be used for Mailman 3? I have come to understand that Xapian development stalled in the v2.0 attempt.

4 6

Thread matching query does not exist
by andrew.bernard＠gmail.com March 19, 2020

March 19, 2020

Now I am seeing this in the log every few seconds: 12:12:29 [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] 12:12:29 [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7.egg/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/tasks.py", line 189, in _rebuild_thread_cache_votes thread = Thread.objects.get(id=thread_id) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. Any help? How do I identify the thread in question? I imported an archive from a Listserv list, processed into something resembling mbox format (which I now understand not to be a standard at all) and have about 100,000 messages there. I am having a lot of trouble with these sort of errors, as you will see from my flurry of posts recently. Yes, I am running all the jobs. Andrew

3 3

IsADirectoryError: [Errno 21] Is a directory: '/usr/local/lib/python3.7/site-packages/mailman/templates'
by sunil soprey March 19, 2020

March 19, 2020

Has anyone encountered this error? I pulled the latest mailman suite (versions below), and facing this error in two places * mass subscription add of users -> Click on mass-subscription for list, enter email Django 2.2.11 django-allauth 0.41.0 django-appconf 1.0.3 django-ca 1.15.0 django-compressor 2.4 django-extensions 2.2.8 django-gravatar2 1.4.4 django-gunicorn 0.1.1 django-haystack 2.8.1 django-health-check 3.12.1 django-mailman3 1.3.2 django-object-actions 2.0.0 django-picklefield 2.1.1 django-prometheus 2.0.0 django-q 1.2.1 django-redis 4.11.0 django-redis-cache 2.1.0 django-rest-auth 0.9.5 django-saml2-auth 2.2.1 djangorestframework 3.11.0 djangorestframework-jwt 1.11.0 python3 -V Python 3.7.6 django-mailman3 1.3.2 HyperKitty 1.3.2 mailman 3.3.0 mailman-hyperkitty 1.1.0 mailmanclient 3.3.0 postorius 1.3.2 sADirectoryError: [Errno 21] Is a directory: '/usr/local/lib/python3.7/site-packages/mailman/templates' [2020-03-17 03:56:54 +0000] [4220] [ERROR] Socket error processing request. Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 134, in handle self.handle_request(listener, req, client, addr) File "/usr/local/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 190, in andle_request util.reraise(*sys.exc_info()) File "/usr/local/lib/python3.7/site-packages/gunicorn/util.py", line 625, in reraise raise value File "/usr/local/lib/python3.7/site-packages/gunicorn/workers/sync.py", line 175, in andle_request respiter = self.wsgi(environ, resp.start_response) File "/usr/local/lib/python3.7/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.7/site-packages/mailman/rest/wsgiapp.py", line 193, in __call__ return super().__call__(environ, start_response) File "falcon/api.py", line 274, in falcon.api.API.__call__ File "falcon/api.py", line 269, in falcon.api.API.__call__ File "/usr/local/lib/python3.7/site-packages/mailman/rest/members.py", line 266, in on_post pre_approved=pre_approved) File "/usr/local/lib/python3.7/site-packages/mailman/app/subscriptions.py", line 523, in register list(workflow) File "/usr/local/lib/python3.7/site-packages/mailman/app/workflow.py", line 69, in __next__ return step()

2 3

Finding a user to delete them
by Quanah Gibson-Mount March 17, 2020

March 17, 2020

Due to a bug in mailman3, I have an incorrect user that's been created via github auth that has no confirmed email address yet. I've been poking around the user manager documentation (why is there no UI for user management???), and after adding in bits that are missing from the official documentation (<https://mailman.readthedocs.io/en/latest/src/mailman/model/docs/usermanager…> is missing "from mailman.testing.documentation import dump_list" despite using dump_list repeatedly in its examples) I can't find the user. I have the confirmation email mailman3 sent out, that tells me the username mailman3 created for the incorrect account is "quanah98", but the user manager documentation doesn't detail how to find a user by their username, only their email. And apparently if the email hasn't been confirmed (and I *do not* want it confirmed), you can't find them by email. Suggestions on how to track down this user so I can delete them would be much appreciated. Thanks, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

5 13

Add old email address
by Quanah Gibson-Mount March 14, 2020

March 14, 2020

We've recently migrated our project's email lists from mailman2 to mailman3. Given the project has been around for a few decades, many people have used different email addresesses over the years, some of which they no longer have access to. However, it would be useful to still be able to associate those emails with a given account. Is there a way that I can do this as an administrator of the mailman3 system? Thanks, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

2 4

Using REST api to subscribe member
by Brian Carpenter March 11, 2020

March 11, 2020

I have a development server that only has Mailman core installed on it. I used a virtual environment to do the installation but I did not install Postorius or Hyperkitty as I am currently working on developing a custom u.i. for Mailman 3. My programmer said the following: "I have a problem with mailman on development server ... I was trying to add member to a list using REST api, but to no avail. After I tried all possible and impossible things, I finally looked at the logs. Error I found in log file is: IsADirectoryError: [Errno 21] Is a directory: '/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman/templates' I guess mailman was looking for a template for welcome mail, and failed for some reason. I also guess this has something to do with locale or language settings I tried googling, but couldn't find anything" The log that gave the error was /opt/mailman/mm/logs/mailman.log My programmer tried it on another server that has both Postorius and Hyperkitty working and the api call worked, i.e. added the member to the list and sent out a welcome email. So what else do I need to install to be able to use the api to add members to a list using a non-postorius interface? Any assistance would be appreciated. Thanks, Brian

1 0

How to configure a mailing list?
by Patrick Ben Koetter March 10, 2020

March 10, 2020

Greetings, I do have mailman 3 installed via virtualenv and it is up an running. Now I'd like to create a mailing list, but I can't find any instructions how I should do this. Is there a resource online I missed? If not, can anyone on this list tell me how to do it preferrably using a command line tool? TIA p@rick -- [*] sys4 AG https://sys4.de, +49 (89) 30 90 46 64 Schleißheimer Straße 26/MG,80333 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer, Wolfgang Stief Aufsichtsratsvorsitzender: Florian Kirstein

2 1

Scrub non digest
by Eduardo Costa March 9, 2020

March 9, 2020

Hi, on mailman2 used to scrub attachments in non digest, each member received the attachment link, how can I do it on mailman3? Best Regards, -- ...................................... Eduardo Costa Centro de Comunicações - Instituto Politécnico de Bragança raposo at ipb.pt http://www.ipb.pt/~raposo/ ......................................

2 1

Was Mailman3.org down this morning?
by Brian Carpenter March 9, 2020

March 9, 2020

I was unable to get to the lists or mailman3.org documentation at all this morning. Brian

5 5

Help on removing moderators
by sean_sullivan＠rhoworld.com March 4, 2020

March 4, 2020

Hello Mailman-users. I was hoping someone more experienced than myself would be able to help me with an issue I am currently experiencing. I have created a function to add moderators which works great, but I have also been trying to remove moderators as another function, but I am running into some issues. When I use the mailman shell based upon the documentation, it works great: https://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclien… everything works as expected. However, if I try and bring that in as a function that can be used with mailman withlist, I am consistently getting errors, and being that I am not very experienced in python, it has me scratching my head to say the least. from mailmanclient import Client from mailman.interfaces.member import MemberRole, AlreadySubscribedError from mailman.testing.helpers import subscribe addresses = ['test1(a)example.com', 'test2(a)example.com', 'test3(a)example.com'] client = Client('http://localhost:8001/3.1', 'restadmin', 'restpass') def set_owners(mlist): for email_addr in addresses: try: member = subscribe(mlist, '', email=email_addr, role=MemberRole.owner ) print (member) except AlreadySubscribedError as err: print (err) def remove(mlist): my_list = client.get_list(mlist) # print(my_list.fqdn_listname) # for email_addr in addresses: # my_list.remove_owner(email_addr) The errors I am getting are: ./bin/mailman withlist -r set_owners.remove -l it-test-b(a)lists.rhoworld.com Traceback (most recent call last): File "./bin/mailman", line 8, in <module> sys.exit(main()) File "/opt/mailman3/lib/python3.6/site-packages/click/core.py", line 764, in __call__ return self.main(*args, **kwargs) File "/opt/mailman3/lib/python3.6/site-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/opt/mailman3/lib/python3.6/site-packages/mailman/bin/mailman.py", line 68, in invoke return super().invoke(ctx) File "/opt/mailman3/lib/python3.6/site-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/mailman3/lib/python3.6/site-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman3/lib/python3.6/site-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/opt/mailman3/lib/python3.6/site-packages/click/decorators.py", line 17, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman3/lib/python3.6/site-packages/mailman/commands/cli_withlist.py", line 293, in shell r = call_name(dotted_name, m, *run_args) File "/opt/mailman3/lib/python3.6/site-packages/mailman/utilities/modules.py", line 70, in call_name return named_callable(*args, **kws) File "/opt/mailman3/bin/set_owners.py", line 24, in remove my_list = client.get_list(mlist) File "/opt/mailman3/lib/python3.6/site-packages/mailmanclient/client.py", line 347, in get_list 'lists/{0}'.format(fqdn_listname)) File "/opt/mailman3/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 112, in call error_msg, response, None) urllib.error.HTTPError: HTTP Error 404: 404 Not Found So, I am wondering, is it possible to do something like this or am I completely misunderstanding the documentation, and why do I get a 404 here, when in the shell everything works as expected. I know I must be missing something, but cannot for the life of me figure out what that is. Any help would be greatly appreciated. Thanks, Sean

2 3

Remove PDF attachents
by Eduardo Costa March 4, 2020

March 4, 2020

Hello, How do I configure the list to remove attachments of type pdf and others. Best Regards. -- ...................................... Eduardo Costa Centro de Comunicações - Instituto Politécnico de Bragança raposo at ipb.pt http://www.ipb.pt/~raposo/ ......................................

2 1

Mailman web Stopped working after upgrade
by David Krantz March 3, 2020

March 3, 2020

Hi. I have a VERY strange behaviour. I upgraded mailman3 and mailman web this weekend. It works fine (apart from ARC which don't work correctly in my setup but that is ok). But tonight the web user interface stopped working and I have not been logged in since it worked last time so something very strange is going on. I get the dreadful error message about psycopg2._psycopg is missing although it is installed both in ubuntu and in pip in the venv I run mailman. Mailman core still works fine, it is just Django being flaky. I think that this might be due to some kind of python misfeature where compiled code behaves slightly differently to interpreted code, that might explain the delay in it working initially before breaking. I have no idea of how to solve this. I have tried to uninstall and reinstlall psycopg2 in different versions without any luck. Any ideas? Logs below. I get the following in the web server error log (removing the web things that frankly are not interesting): mod_wsgi (pid=4488): Target WSGI script 'MAILMANROOT/bin/mailman-web20200229.wsgi' cannot be loaded as Python module. mod_wsgi (pid=4488): Exception occurred processing WSGI script 'MAILMANROOT/bin/mailman-web20200229.wsgi'. Traceback (most recent call last): File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/backends/postgresql/base.py", line 20, in <module> import psycopg2 as Database File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/psycopg2/__init__.py", line 50, in <module> from psycopg2._psycopg import BINARY, NUMBER, STRING, DATETIME, ROWID ImportError: No module named 'psycopg2._psycopg' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "MAILMANROOT/bin/mailman-web20200229.wsgi", line 47, in <module> application = get_wsgi_application() File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/core/wsgi.py", line 12, in get_wsgi_application django.setup(set_prefix=False) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/__init__.py", line 24, in setup apps.populate(settings.INSTALLED_APPS) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/apps/registry.py", line 114, in populate app_config.import_models() File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/apps/config.py", line 211, in import_models self.models_module = import_module(models_module_name) File "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 986, in _gcd_import File "<frozen importlib._bootstrap>", line 969, in _find_and_load File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 673, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 665, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/postorius-1.3.2-py3.7.egg/postorius/models.py", line 27, in <module> from django.contrib.auth.models import User File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/contrib/auth/models.py", line 2, in <module> from django.contrib.auth.base_user import AbstractBaseUser, BaseUserManager File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/contrib/auth/base_user.py", line 47, in <module> class AbstractBaseUser(models.Model): File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/models/base.py", line 117, in __new__ new_class.add_to_class('_meta', Options(meta, app_label)) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/models/base.py", line 321, in add_to_class value.contribute_to_class(cls, name) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/models/options.py", line 204, in contribute_to_class self.db_table = truncate_name(self.db_table, connection.ops.max_name_length()) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/__init__.py", line 28, in __getattr__ return getattr(connections[DEFAULT_DB_ALIAS], item) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/utils.py", line 201, in __getitem__ backend = load_backend(db['ENGINE']) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/utils.py", line 110, in load_backend return import_module('%s.base' % backend_name) File "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "MAILMANROOT/venv-3.7_2020/lib/python3.7/site-packages/Django-2.2.10-py3.7.egg/django/db/backends/postgresql/base.py", line 24, in <module> raise ImproperlyConfigured("Error loading psycopg2 module: %s" % e) django.core.exceptions.ImproperlyConfigured: Error loading psycopg2 module: No module named 'psycopg2._psycopg' Regards // David

2 5

Running customized version of Mailman 3
by Alan Kelm March 3, 2020

March 3, 2020

Since 2005, our organization has been running a customized version of Mailman 2 with extensions that meet our particular needs. The main novelty is support for /fixed subscription lists/, in which the list members are predetermined (corresponding to a "committee"). Fixed list subscribers are not offered the opportunity to unsubscribe, nor can others add themselves to the list. A further enhancement is /hybrid lists/ which, for example, have both a fixed and opt-in part. (This is implemented as a fixed list residing within an opt-in one in a way which is transparent to users). Our customizations consist of code adjustments (patches) to 23 files. We are considering moving to Mailman 3 and would like to do this in a way which makes it possible to periodically upgrade our installation to the newest Mailman version, without clobbering our customizations. Thus, I do not think that installing via "pip" is the right approach for us. While I'm relatively new to git and GitLab, they seem to be ideally suited to this situation. If I understand the developer documentation correctly, I start out by creating a "fork" and can later "fetch" changes from the master branch and "rebase" to bring them into our branch. I would welcome comments on what we are doing. I also wonder whether others might be interested in support for "fixed lists", if they are done in a way which can be "contributed" back into Mailman. I extend our "thank you" to the developers of Mailman who have provided the robust system which has served us well for 15 years and provides the possibility to extend this into the future. -Alan -- Alan Kelm Manager, Electronic Services Canadian Mathematical Society Tel: +1 (613) 733-2662 ext. 799 Please consider the environment. [cms web link] <https://cms.math.ca/> Alan Kelm Chef, services électroniques Société mathématique du Canada Tél : +1 (613) 733-2662 poste 799 Considérez svp l'environnement.

3 5

Question about members
by Dieter Leupold March 3, 2020

March 3, 2020

Hi together, short question: is it possible to display the time stamp when members have completed their subscriptions? Thanks a lot for your information! -- Dieter

2 1

ARC issues
by David Krantz March 2, 2020

March 2, 2020

Hi! I have now tested ARC signing of messages a bit more and have found (I think) all settings so that it works in that it generates the signed headers that ARC is. But the signature is not accepted; gmail says "body hash mismatch" and hotmail says "arc=fail (47)". I have set the following settings under the [ARC] section. I have tried both with the sig_headers set as displayed below and with it commented to lean against the defaults. I use the same key and selector as for DKIM-signing with the server's domain. The DKIM-signature is accepted. Is there any known issues with ARC that I should be aware of? I run the latest release of mailman (3.3.0 of core) on Python 3.7.6 and I use postfix as MTA. enabled: yes privkey: <my key path> selector: <my selector> domain: <my server's domain> dmarc: yes dkim: yes authserv_id: <my server's domain> trusted_authserv_ids: <my hosted domains> #sig_headers: From, Sender, Reply-To, Subject, Date, Message-ID, To, Cc, MIME-Version, Content-Type, Content-Transfer-Encoding, Content-ID, Content-Description, Resent-Date, Resent-From, Resent-Sender, Resent-To, Resent-Cc, Resent-Message-ID, In-Reply-To, References, List-Id, List-Help, List-Unsubscribe, List-Subscribe, List-Post, List-Owner, List-Archive I hope that this is something simple that I have forgot. Cheers // David

3 4

How to run 'manage.py update_index_one_list' command.
by Frank van den Heuvel Feb. 26, 2020

Feb. 26, 2020

I am importing old archives mbox files from Mailman2. I have fixed the archive mail address to reflect the address of the destination import. These are the steps: 1. sed 's|oldlist@oldexample\.org|testlist@example\.org|g' mbox > mbox.testlist 2. /opt/mailman/mm/bin/django-admin hyperkitty_import --since 01/01/1990 -l testlist(a)example.org mbox.testlist The output of the last command is: Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. \ To update the index for this list, run the 'manage.py update_index_one_list testlist(a)example.org' command. The result is that the e-mail's are imported but not indexed. To finalize this process I am seeking manage.py that will execute the update index command. I am on a Debian 10 with Mailman3 in /opt. locate manage.py returns: /opt/mailman/mm/venv/lib/python3.7/site-packages/django/conf/project_template/manage.py-tpl /opt/mailman/mm/venv/lib/python3.7/site-packages/example_project/manage.py /opt/mailman/mm/venv/lib/python3.7/site-packages/falcon/bench/dj/manage.py None of these python files can execute the needed command. What can I do to get the newly imported posts indexed? Regards, Frank

3 6

Mass unverified subscriptions end up as pending user confirmation instead.
by hansen＠rc.org Feb. 26, 2020

Feb. 26, 2020

After mass subscribing with these settings: Pre confirm: Yes, Pre approved: Yes, Pre Verified (sic): No the addresses appeared in the list's 'Pending user confirmation' list. They were pre-confirmed. The addresses did not appear in the Django Admin's non-verified addresses list. They were not verified. Also why does Postorius lists just 'Pending Approval' and 'Pending Confirmation' but not 'Pending Verification'? Yours, Allan

2 1

Tags in Hyperkitty
by Gila Halpern Feb. 21, 2020

Feb. 21, 2020

Are tags still under development? They don't appear to do anything at the moment, they are not searchable, and clicking on existing tags does nothing.

2 1

leaving Sympa for MM3
by rance.hall＠esu10.org Feb. 21, 2020

Feb. 21, 2020

Our shop is an educational shop and left mailman many years ago for Sympa because of features in Sympa not in mailman. Currently Sympa is showing its age, and is relying on perl modules that have been EOL's and the Sympa community has not discussed (within in ear-shot of me at least) what to do about it. We found that we are not using the extra features Sympa provides anymore and with MM3 already dockerized it seems that MM3 is a much better fit for our organization for the foreseeable future. So I got a dockerized setup up and running in a test environment and am pleased with the results except for now I have to start thinking about migration from Sympa to MM3. The API is useful in this effort as there are python wrappers already done and I didn't have any trouble scripting list creation with the API tools to migrate list owners, moderators and users. Now for the question/hard part. Migrating list archives. In Sympa the list archive is just a maildir format directory structure reflecting month/year. In MM3 the Archive is stored in the db with attributes that are likely only available as the message is processed. I'd really rather not loose the archive data if I can help it. Does anyone have any thoughts on how I could perhaps import this?

2 1

Advice on migrating to Mailman 3
by Christoph Groth Feb. 20, 2020

Feb. 20, 2020

Dear Mailman 3 users, Currently we are hosting the website [1] and mailing list [2] of our free software project with a shared hosting plan of a webhosting company. As such there is no dedicated server, but we do have SSH access (as a regular user) to the shared server. The mailing list software (Mailman 2) is administrated separately by our hoster on a dedicated machine. We are rather happy with this setup: we pay about 10 USD per month and have only little administration work to do. The only problem is that our list runs on Mailman 2. We would like to move to Mailman 3, but this does not seem to be that simple. Perhaps someone here would be so kind to give us advice? The number of (shared) hosters who offer Mailman 3 seems to be very limited [3]. Would it be a good idea to book a virtual private server (VPS) somewhere, that runs, say, Debian, and simply install Mailman 3 through the distribution’s package system? I’m already running a small personal box with nginx on it, and this is very little work, but running Mailman would require sending out up to a few thousand email messages per day (our list has a few hundred subscribers). Is this something that one is commonly allowed to do on a VPS system? Most VPS offers that I see are silent about mail. If we setup such a system, can we assume that it will silently operate without causing much administration work most of the time (like my nginx server)? Or is maintaining a Mailman 3 server a significant burden ([2] seems to imply that)? If yes, are you aware of organizations that propose Mailman 3 hosting for open source projects? Python.org seems to host some lists for third party projects, but otherwise I haven’t seen much. Thanks Christoph [1] https://kwant-project.org/ [2] https://mailman-mail5.webfaction.com/listinfo/kwant-discuss [3] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…

6 6

Email verification
by Allan Hansen Feb. 19, 2020

Feb. 19, 2020

Some members cannot get past the email verification when they create their accounts. They insist that they have looked in their spam folders. Their email addresses they entered are correct - the are able to log into their accounts with the right email address. But they get the message saying that a confirmation message was sent and if they don’s see it to contact us. 1. Who is ‘us’? My members are asking... 2. How do I help them? I tried subscribing them to a bogus list with pre-verified email, but that did not work, so both they and I are stuck. Tried finding help in archive, but did not see anything. Yours, Allan Hansen hansen(a)rc.org

4 9

Installing MM3 via pip fails…
by Patrick Ben Koetter Feb. 18, 2020

Feb. 18, 2020

Has anyone managed to install MM3 recently using pip on Ubuntu 18? I followed the instructions at https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst…. As soon as I get to the Django part things get hairy. It seems Django requires something that was removed from it. Any ideas or experience how I can get around that? p@rick -- [*] sys4 AG https://sys4.de, +49 (89) 30 90 46 64 Schleißheimer Straße 26/MG,80333 München Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer, Wolfgang Stief Aufsichtsratsvorsitzender: Florian Kirstein

2 4

No module named 'hyperkitty.urls' after upgrading python3
by jean-christophe manciot Feb. 18, 2020

Feb. 18, 2020

Ubuntu 20.04 python3 3.8.0-3 python3-django-hyperkitty: 1.3.2 ``` Traceback (most recent call last): File "/usr/share/mailman3-web/manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/lib/python3/dist-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/usr/lib/python3/dist-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 361, in execute self.check() File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 387, in check all_issues = self._run_checks( File "/usr/lib/python3/dist-packages/django/core/management/base.py", line 377, in _run_checks return checks.run_checks(**kwargs) File "/usr/lib/python3/dist-packages/django/core/checks/registry.py", line 72, in run_checks new_errors = check(app_configs=app_configs) File "/usr/lib/python3/dist-packages/django/core/checks/urls.py", line 13, in check_url_config return check_resolver(resolver) File "/usr/lib/python3/dist-packages/django/core/checks/urls.py", line 23, in check_resolver return check_method() File "/usr/lib/python3/dist-packages/django/urls/resolvers.py", line 399, in check for pattern in self.url_patterns: File "/usr/lib/python3/dist-packages/django/utils/functional.py", line 80, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/usr/lib/python3/dist-packages/django/urls/resolvers.py", line 584, in url_patterns patterns = getattr(self.urlconf_module, "urlpatterns", self.urlconf_module) File "/usr/lib/python3/dist-packages/django/utils/functional.py", line 80, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/usr/lib/python3/dist-packages/django/urls/resolvers.py", line 577, in urlconf_module return import_module(self.urlconf_name) File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 671, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 783, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/etc/mailman3/django/urls.py", line 30, in <module> url(r'^hyperkitty/', include('hyperkitty.urls')), File "/usr/lib/python3/dist-packages/django/urls/conf.py", line 34, in include urlconf_module = import_module(urlconf_module) File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked ModuleNotFoundError: No module named 'hyperkitty.urls' ``` ``` # dpkg --contents python3-django-hyperkitty_1.3.2+b1-20.04_amd64.deb|grep urls -rw-r--r-- root/staff 1356 2020-01-14 12:22 ./usr/local/lib/python3.7/dist-packages/HyperKitty-1.3.2-py3.7.egg/example_project/urls.py -rw-r--r-- root/staff 1043 2020-01-14 12:22 ./usr/local/lib/python3.7/dist-packages/HyperKitty-1.3.2-py3.7.egg/hyperkitty/tests/urls_test.py -rw-r--r-- root/staff 7783 2020-01-14 12:22 ./usr/local/lib/python3.7/dist-packages/HyperKitty-1.3.2-py3.7.egg/hyperkitty/urls.py -rw-r--r-- root/root 1356 2019-09-01 02:56 ./usr/share/doc/python3-django-hyperkitty/examples/urls.py ``` No such issue with python3 3.7.5-3. Any suggestion?

3 6

Random characters in "The results of your email commands" e-mail
by Jeffrey D Feb. 18, 2020

Feb. 18, 2020

Hi, Today I sending an e-mail to "mylist-request(a)domain.tld" with the subject "help" and I received the expected e-mail with the following content; confirm - Confirm a subscription request. echo - Echo back your arguments. end - Stop processing commands. help - Get help about available email commands. join - Join this mailing list. leave - Leave this mailing list. stop - An alias for 'end'. subscribe - An alias for 'join'. unsubscribe - An alias for 'leave'. No such command: -- No such command: vriendelijke Only I think my mail signature broke something in Mailman (see the No such command). Because every e-mail with a subject like "help", "stop" or "join", gives a reply with random characters. The Mailman logs doesn't show any error, so I'm not sure what is wrong. Deleting the mailinglist and create a new one won't fix the issue, also restarting Mailman doesn't help. An example of the random characters: Nzzf&ju[zZ0:v,jzkb^}nJyazZCj}{m5t5Cx<{iysG5o[w}jgn+g[lrwf*mzrLk)rjwliazZZnjyW(fvrh{aXXWj+&j)b b-'jX+zwl&v{rx &~y6.r(fu4:' Is this a bug in Mailman? Or something in my Mailman config...

2 2

Listing/Exporting member list error: Mailman REST API not available. Please start Mailman core.
by Thomas Lehker Feb. 17, 2020

Feb. 17, 2020

Our MailMan3 server is extremely slow and when trying to list or export members for a larger list it is throwing 'Mailman REST API not available. Please start Mailman core'. In Mailman core logs I am seeing [27] [CRITICAL] WORKER TIMEOUT (pid:40) [43] [INFO] Booting worker with pid: 43 Has anyone seen this issue? Is there any way to increase 'timeouts'? Thanks for any help! Tom Mailman Novice 16/Jan/2020:16:55:58 +0000] "GET /3.1/lists/somelist(a)somelist.com/requests HTTP/1.1" 200 982 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:55:58 +0000] "GET /3.1/lists/somelist(a)somelist.com/held?count=50&page=1 HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:55:58 +0000] "GET /3.1/lists/list.somelist.com HTTP/1.1" 200 347 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:55:58 +0000] "GET /3.1/lists/list.somelist.com/roster/owner HTTP/1.1" 200 634 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:01 +0000] "GET /3.1/lists/list.somelist.com/roster/moderator HTTP/1.1" 200 638 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:01 +0000] "GET /3.1/lists/somelist(a)somelist.com/config HTTP/1.1" 200 2257 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:05 +0000] "GET /3.1/lists/list.somelist.com/archivers HTTP/1.1" 200 81 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:08 +0000] "GET /3.1/lists/list.somelist.com/archivers HTTP/1.1" 200 81 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:08 +0000] "GET /3.1/lists/somelist(a)somelist.com/requests HTTP/1.1" 200 982 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:10 +0000] "GET /3.1/lists/list.somelist.com/member/somelist@somelist HTTP/1.1" 404 26 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:16 +0000] "GET /3.1/lists/somelist(a)somelist.com/requests HTTP/1.1" 200 982 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:19 +0000] "GET /3.1/lists/somelist(a)somelist.com/held?count=50&page=1 HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.0" [16/Jan/2020:16:56:26 +0000] "GET /3.1/lists/list.somelist.com HTTP/1.1" 200 347 "-" "GNU Mailman REST client v3.3.0" [2020-01-16 16:56:58 +0000] [27] [CRITICAL] WORKER TIMEOUT (pid:40) [2020-01-16 16:57:00 +0000] [43] [INFO] Booting worker with pid: 43 DISCLAIMER: The information contained in this message is privileged and confidential. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please reply to the message and delete/destroy any copy of this message. Information in this message that does not relate to the official business of the firm shall be understood as neither given nor endorsed by it.

4 4

Mailman stopping message distribution because of SMTP errors
by Victoriano Giralt Feb. 12, 2020

Feb. 12, 2020

Hi list, I have recently migrated some lists from Mailman 2 to Mailman 3. Users have been added using the mailman client as pre-verified addresses so the migration happened "silently". Thus, there was a dozen "bad" addresses (domains that did not exist anymore). Unfortunately, Mailman got some of the "bad" addresses in the first message batch for sending out, so, Postfix closed the connection because of "too many errors" and this stopped the process completely, i.e. Mailman did not continue sending messages to the rest of the list over 600 addresses. There was no more information in the logs than the Postfix error messages in smtp.log. Once the "bad" addresses were removed, the list started working as expected. I consider this a bug. The bouncing addresses should have been marked as "non deliverable" and the subscriptions "paused" and the rest should have been delivered. Or, the list owner should have been notified that there was a problem with message distribution. None of these happened. Thanks! -- Victoriano Giralt CIO University of Malaga +34952131415 SPAIN ================================================================== Note: signature.asc is the electronic signature of present message A: Yes. > Q: Are you sure ? >> A: Because it reverses the logical flow of conversation. >>> Q: Why is top posting annoying in email ?

2 2

How to get rid of footer (Mailman3)
by tarmokumar＠gmail.com Feb. 12, 2020

Feb. 12, 2020

Hi, I have read multiple posts in this forum that you should be able to get rid of the footer completely but I am unable to. I have tried: - adding the footer template to a list and not adding any "Data" to it. Result was a attachment with some "dfgdfgdfgdfg" text in it. - adding/creating a blank "list:member:generic:footer" document to /var/templates/site/en, var/templates/lists/LIST.ID/en/ and var/templates/domains/DOMAIN/en/. Result is that the sent e-mail still has the original unsubscribe text in the footer (as an attachment) - removing all the files from /mailman/src/mailman/templates/en, still no change We are running Mailman within Docker on these versions: maxking/mailman-core:0.3.2 maxking/mailman-web:0.3.2 When searching the docker for example "list:member:generic:footer" file, there isnt one (except the one I created) and when I search the file for text "unsubscribe", then it is only included in the postfix_lmtp file, but this doesnt seem to be it since it is overwritten every time.

2 1