- Mailman-users - lists.mailman3.org

Docker-mailman (performance?): "AH00894: declining URL", "AH01077: declining URL", "AH01105: NOT Closing connection", "AH01076: url: ... proxyname: (null) proxyport: 0"
by Henrik Rasmussen 09 Jan '19

09 Jan '19

I am using docker-mailman with GNU Mailman 3.2.0 (La Villa Strangiato). Even I have had no complains previously, a list admin have received proxy errors a couple of days. Right after one occurrence I immediately looked at the logs and while I had no related errors in the log files in /var/log/mailman/web/{uwsgi,uwsgi-error,mailmanweb}.log, the Apache log often shows "AH00894: declining URL", "AH01077: declining URL", "AH01105: NOT Closing connection", "AH01076: url: ... proxyname: (null) proxyport: 0". The errors seems to go back a long time, also on previous versions of Mailman, but no one have complained about it until now. Apache is version 2.4.6 on a RHEL 7 assuming Red Hat have backported any bugs about timeout previously know as hardcoded timeout of 30s etc. I assume therefore that even Mailman did not indicate any errors, it may have been too slow to respond. The server does not seem to be slow at all. Is there a way I can enhance the performance of Mailman (Docker)? I've asked about performance previously, but as I don't think my current question is related to REST, it's probably not related to https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…. Henrik

1 0

Removing Archives for a Deleted List
by kelly.close＠lrewater.com 09 Jan '19

09 Jan '19

Renewing this question ... maybe, there is now a straightforward way to delete archives associated with a deleted list in MM3? Through the UI would be ideal, but if there is a command line approach, I can make that work. Searching the message boards has not turned up anything either way for me. Thoughts? ~Kelly

2 1

hyperkitty base_url
by Thomas Stein 08 Jan '19

08 Jan '19

Hi all. Now I'm struggeling with configuring hyperkitty. It's not clear to me which base_url to set. Currently it's base_url: http://localhost:8001/hyperkitty/ but that leads to Jan 04 21:01:39 2019 (8322) HyperKitty failure on http://localhost:8000/hyperkitty/api/mailman/urls: <html><title>Auth required</title><body> <h1>Authorization Required</h1></body></html> (401) The api_key is set in /usr/share/mailman3-web/settings.py. I suppose I'm doing it wrong. Any hints appreciated. thanks and cheers t.

4 8

Auth question
by David Krantz 08 Jan '19

08 Jan '19

Hi, I have of course activated password login as it was not possible to get the provider based logins to work (might be but not worth the time for me right now). Is there any way for an user to request a new password when it is forgotten? I presume that the Persona login is removed now. I cannot hide it in my version or at least I do not know how. cheers // David

6 25

Getting Archives to work - new setup on Ubuntu 18.04 (with mailman3-full pkg)
by kelly.close＠lrewater.com 08 Jan '19

08 Jan '19

Happy New Year! I'm setting up my first Mailman 3 server and was delighted to find a distribution package for Ubuntu 18.04, since that's the environment I'm most familiar with working in, that installs an integrated mailman3-hyperkitty-postorius setup. The package install plus the additional config steps in the included README files have gotten me oh-so-very close! What isn't working yet are the archives, specifically the messages sent to lists showing up at .../mailman3/hyperkitty. I'm at a loss and I'm hoping maybe the folks on this list can help me bring it home. Messages are distributed to subscribers as they should be - subscribers can send from their emails or from the web site. People can subscribe, etc. It's all working great. Just no archives. I am able to successfully run these django-admin processes without errors (described here: http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required). I've run them all manually and then I've been running the minutely and hourly ones manually after each test message I send (haven't set up the actual cron jobs yet). I'm not sure what to try next or what info to provide here for help - can anyone suggest where I can look to see why archives aren't getting created, or let me know what information would be essential for me to post to get help on this? I'm using PostgreSQL for the database, Postfix for mail and Apache2 for the web server. Thanks for your time! ~Kelly

2 8

$member does not appear to be dereferencing correctly in moderated subscription requests
by Joel Lord 08 Jan '19

08 Jan '19

So I'm having an issue with a new 3.2 install. All the lists I have are set to confirm + approve on new subscriptions, but it seems that no matter how a new subscription come in, it does not actually pass the applicant's name to the moderator. I've tested now with a new email address previously unknown to the system and made sure I filled in the name field in the form. I've tested with an email address previously KNOWN to the system (subscribed to other lists) that has its display name fields filled in AND filled in the name on the subscription form, and yet again with that account having cleared out the display name fields associated with the account. In all cases I was careful to be sure to fill in the name on the subscription form. Buried somewhere in the templates documenation I found that the $member template variable in the list:admin:action:subscribe.txt template is supposed to be both the email address and the display name of the person applying to subscribe, but it just doesn't appear to be coming up as more than just the email address. Have I missed something horribly, or did I come across a bug? -- Joel Lord

2 1

File Attachments
by brian＠emwd.com 08 Jan '19

08 Jan '19

Happy Monday everyone. Are there any plans to include the ability to attach files via the web interface? Or did I miss something? Thanks, Brian

5 9

Mass subscriptions
by Enrique Terrazas 07 Jan '19

07 Jan '19

Hello, One of our customers has requested a list that will include around 50,000 subscribers. The customers has provided the email addresses in a CSV file, is there a way to import this data to a mailman list from a CSV file or is the Mass Subscribe option the preferred method? Best regards, Enrique J. Terrazas

2 2

ARC support
by Marvin Gülker 05 Jan '19

05 Jan '19

Hi everyone, I just stumbled over an in-progress standard called ARC. It is appearently intended to solve the problems DMARC causes for mailinglists if I understand correctly. Since I've not seen a summary of it somewhere, I just give the plain links to it: * Website: http://arc-spec.org/ * Draft: https://datatracker.ietf.org/doc/draft-ietf-dmarc-arc-protocol/ Will Mailman at some point support this new standard? Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

2 1

Avoiding the List name in TO or CC headers
by Asaf Ohayon 04 Jan '19

04 Jan '19

Hello I've made a list personalized ( =2 in mailinglist table), So in TO: I see the actual member, But still I have the list address in CC header, Can this be removed ? 10x

3 2

no mails to list members
by Thomas Stein 04 Jan '19

04 Jan '19

Hi all. I'm trying to upgrade my mailman2 installation to version 3. I thought lets test with on list first. I imported the list with: mailman import21 bla(a)lists.blabla.de bla/config.pck. This went well. Now i try to send an email to bla(a)lists.blabla.de but the message only got delivered to the mailman host. Jan 03 14:43:44 2019 (10434) Peer: ('127.0.0.1', 38784) Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) handling connection Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'LHLO shinymail.eu' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'MAIL FROM:<himbeere(a)meine-oma.de>' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) sender: himbeere(a)meine-oma.de Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'RCPT TO:<bla(a)lists.blabla.de>' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) recip: bla(a)lists.blabla.de Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'DATA' Jan 03 14:43:45 2019 (10434) ('127.0.0.1', 38784) Data: b'QUIT' Jan 03 14:43:45 2019 (10434) ('127.0.0.1', 38784) connection lost Jan 03 14:43:45 2019 (10434) Connection lost during _handle_client() No messages ar actually delivered to the list members. Can someone tell me where i have to look to solve this problem? The "Delivery status" is set to enabled. thanks and cheers t.

5 16

mailman3-suite not sending confirmation emails
by ccehb＠nus.edu.sg 04 Jan '19

04 Jan '19

Hi, This is my first experience using mailman. I recently downloaded and setup mailman3 suite which comes with hyperkitty. I don't really understand why the email is not working. I had an external smtp server (mymailserver.com) residing on different IP from my web server that hosts mailman stuff. I had modified settings.py with debug = False and added the following: EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'mymailserver.com' EMAIL_PORT = 25 I also added these inside mailman.cfg [mta] outgoing: mailman.mta.deliver.deliver lmtp_host: 127.0.0.1 lmtp_port: 8024 smtp_host: mymailserver.com smtp_port: 25 Thanks for your help! I check the logs but there isn't anything. When I sign up, nothing happens and I can't figure out why?

2 1

mailman shell
by Alan So 03 Jan '19

03 Jan '19

Sorry for my ignorance. May I know what should be imported before using mailman shell within Python? $ python3.6 Python 3.6.6 (default, Aug 13 2018, 18:24:23) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> command = cli('mailman.commands.cli_withlist.shell') Traceback (most recent call last): File "<stdin>", line 1, in <module> NameError: name 'cli' is not defined Link to documentation: https://mailman.readthedocs.io/en/latest/src/mailman/commands/docs/shell.ht…

3 6

Re: Getting Archives to work - new setup on Ubuntu 18.04 (with mailman3-full pkg)
by Abhijith PA 03 Jan '19

03 Jan '19

Hi On Thursday 03 January 2019 06:39 AM, kelly.close(a)lrewater.com wrote: > Yes - lists are known to Hyperkitty but no, no Archived-At header > in received posts. > > But, Bingo! > > I hadn't looked at the log file immediately after trying to post a > message so I missed this. I don't know the solution yet but ... > what is this telling me? Something doesn't have the permissions it > needs somewhere... > > Jan 02 18:01:15 2019 (616) 127.0.0.1 - - "GET > /3.0/lists/mailman3_test.udfcd-lists.org/member/udfcd.alert(a)gmail.com > HTTP/1.1" 200 484 Jan 02 18:01:18 2019 (609) ACCEPT: > <20190103010115.530.63813@udmailman> Jan 02 18:01:18 2019 (615) > HyperKitty failure on > https://udfcd-lists.org/mailman3/hyperkitty/api/mailman/urls: > <html><title>Auth required</title><bod$ <h1>Authorization > Required</h1></body></html> (401) ... (that line repeates 4 times) > Jan 02 18:01:20 2019 (606) Exception in the HyperKitty archiver: > <html><title>Auth required</title><body> <h1>Authorization > Required</h1></body></html> Jan 02 18:01:20 2019 (606) Traceback > (most recent call last): File > "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", > line 154, in _archive_message url = self._send_message(mlist, msg) > File > "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", > line 210, in _send_message raise ValueError(result.text) > ValueError: <html><title>Auth required</title><body> > <h1>Authorization Required</h1></body></html> What is your base_url in mailman-hyperkitty.cfg ? --a

2 2

Mailman3 and Centos 7
by brian＠emwd.com 03 Jan '19

03 Jan '19

Just a heads up for those wanting to install Mailman3 on a Centos 7 server, be aware of FirewallD. There are a number of ports and services you have to tell it to allow in order to get Mailman3 functional. More experienced sysadmins might know this but I did not.

2 2

How to get Mailman core to provide more debug info in a running environment
by Henrik Rasmussen 03 Jan '19

03 Jan '19

Docker-mailman 0.1.1 I am using Mailman 3.1 in production and I am trying to debug a problem[1] so I tried to setting Mailman to provide more debug info in the smtp.log file[2]. I might have been doing it wrong, but in the mailman-extra.cfg I set [logging.smtp-failure] path: smtp.log and restarted Mailman, which stopped incoming mails until removing the added section. What is the correct way to get Mailman to provide more debug info in the smtp.log 1) https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… 2) http://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html… Henrik Rasmussen

4 5

Customizing Look and Feel?
by Joel Lord 31 Dec '18

31 Dec '18

Is it possible to customize the look at feel of the web interface at all? I have some lists that really require that subscription requests include full name, to make the workload on the moderators, well, workable in keeping a closed list tight. I've found where the "Your name (optional)" text is in list_forms.py, but modifying that strikes me as a poor plan. Changing that text would be lovely. Actually making that field required would be seriously awesome. Is this possible in the current code base (3.2.0) without doing ill-advised things modifying source code? Thanks! -- Joel Lord Web Administrator, Alpha Psi Omega Grand Cast etc... etc... etc...

2 1

Converting non-members to members
by Alan So 27 Dec '18

27 Dec '18

Postorius is not currently exposing non-members management. Our Mailman 2 users are currently using accept_these_nonmembers, hold_these_nonmembers and reject_these_nonmembers. We know that mailman import21 will change these to nonmembers entries in Mailman 3. Since list owners will still want to manage them, we tend to move all of them to members and turn off delivery status for them. However, we met some difficulties when we try to develop using mailman client. 1) If those non-members addresses already exist as members, we will encounter error when we subscribe for them: urllib.error.HTTPError: HTTP Error 409: b'Member already subscribed' 2) We cannot change the moderation_action: urllib.error.HTTPError: HTTP Error 400: b'Cannot convert parameters: moderation_action' 3) We cannot change the preference: urllib.error.HTTPError: HTTP Error 400: b'Cannot convert parameters: delivery_status' Are there any better ways to enable the list owners to manage those previously configured nonmembers' addresses through the web? Otherwise, we probably need to have some manual effort to overcome the above three issues. We know that we can always do the above manually but we got a lot of lists to migrate to Mailman 3.

2 3

Verification Failed Error
by brian＠emwd.com 23 Dec '18

23 Dec '18

I am trying to get the reset password function to work but I am getting this error message: smtplib.SMTPRecipientsRefused: {'email(a)address.com': (550, b'Verification failed for <postorius(a)mailman3.hostname.com>\nUnknown user\nSender verify failed')} Brian

4 31

Docker Installation of Mailman -- The Hyperkitty Chronicles
by brian＠emwd.com 23 Dec '18

23 Dec '18

Using Maxking's docker project to install mailman3, I have a fairly functional mailman3 installation. However Hyperkitty is not archiving or showing list participants like: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ This is my page: https://mailman3.emwd.com/hyperkitty/list/testlist@mailman3.emwd.com/ The docker documents really don't say much about getting HK up and running. Brian

3 9

Mailman3 and Exim setup
by brian＠emwd.com 21 Dec '18

21 Dec '18

I am installing Mailman3 via the Docker image provided by maxking. In his instructions he says: "To use Exim4, it should be setup to relay emails from 172.19.199.3 and 172.19.199.2." I am not sure where in the exim.conf file this is done. I took a guess at: hostlist relay_from_hosts = localhost : 172.19.199.3 : 172.19.199.2 Was my guess wrong?

4 4

ONLY moderator senders messages
by erlonmz＠hotmail.com 21 Dec '18

21 Dec '18

how to configure the mailman 3 for only moderators to send messages?

1 0

Mailman3 via Docker and NGINX
by brian＠emwd.com 19 Dec '18

19 Dec '18

I have Mailman3 installed on CentOS 7 using maxking's docker image. I believe the installation went fine and running "curl http://172.19.199.3:8000/postorius/lists/" produces the correct output. I also will be using exim and nginx with this installation. It seems I am stuck with the nginx setup. I created a sitename.com.conf file in the /etc/nginx/conf.d folder. I have the following inputted there: server { listen 80; server_name `sitename.com`; location /static/ { alias /opt/mailman/web/static/; } location / { include uwsgi_params; uwsgi_pass 172.19.199.3:8000; uwsgi_read_timeout 300; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } } However when I go to http://sitename.com (obviously using an alias here for privacy reasons) I get the default nginx index page. Do I need to add anything to the main nginx.conf file to be able to see my mailman3 installation? Thank you for any assistance, Brian Carpenter

4 9

Templates
by David Krantz 19 Dec '18

19 Dec '18

Hi. How do I set a template for one specific list? I want one list to have a special footer template. I have tried updating the database (template table) without effect so apparently the database is not used for templates or some kind of fallback is used to set it to the generic footer. Of course I also tried to restart mailman after that operation to try to rule out any caching-related problem. I want to use a file://-path as that is the least painful way of doing it. I also would like a solution to place a file in a special location. My current templates are in a .../var/templates/site/en/ structure with names like list:member:generic:footer.txt Cheers // David

4 14

Newbie Wants To Know About Multiple Lists
by Christopher Garwood 19 Dec '18

19 Dec '18

Howdy, I am new to Mailman and there are so many things I would like to know. Before I try to find out how to install and configure the software, I need to know if, how and what is required for us to set up this software to deal with more than one email list. I am working with a plan to setup a CentOS VPS on which Mailman will be hosted. The objective is to host and administrate mailing list for the 3 entities that I am directly involved with. These lists must function completely unrelated to each other including the email addresses from which the emails & news letters are sent from. If this is possible can I be given information or a link to how it can be done and what is required?

2 2

disable-by-bounces
by erlonmz＠hotmail.com 19 Dec '18

19 Dec '18

copying a question already made here last year "I want to delete members automatically from a mailing list if the delivery has failed after a certain time of attempts because his mailbox has been removed or his mail server has been shutdown." at the time Mailman 3 was in version 3.1, today we are in 3.2. is this option available?

2 1

Button unsubscribe
by erlonmz＠hotmail.com 17 Dec '18

17 Dec '18

how to put a button unsubscribe in the message together with the part " LIST mailing list -- LIST@domain To unsubscribe send an email to LIST-leave@domain' I want to put this button in the emails to the users unsubscribe. it would already send the confirmation tolkien. my question is, has some place where generated tolkien is saved in mailman files?

3 4

Hyperkitty archives - new list not archived
by vaarcilal＠eafit.edu.co 12 Dec '18

12 Dec '18

Hi!! I'm running mailman 3.2 on Ubuntu server 18.04. Installed it via pip inside a conda virtual environment. I'm having problems related to hyperkitty on which I'd really appreciate some help. When I try to access the archives of a mailing list named 'test-nov' it redirects me to 'example.com/hyperkitty/list/test-nov@example.com/', where a 404 appears and a 'No archived mailing-list by that name.' message is thrown by hyperkitty.views.mlist.overview. I'm not very experienced with django, so I could have made a mistake on any configuration. I have not configured an MX for my mail server yet, so I'm able to send emails but I can't recieve emails for my lists. Is this somehow related to a misconfigurated MTA? Which logs should I take into account? Regards, Vincent.

2 5

Mailman3-Web lots of database queries
by Stefan Tatschner 10 Dec '18

10 Dec '18

Hey! I recently set up a mailman3 instance and it works quite nice. I use the debian packages from buster. After running the thing for a few days, I realized an unexpected network load (my postgres database is on a separate machine). Turning the postgres log on revealed that mailman3 constantly queries the database: [...] 2018-11-17 16:33:15.417 UTC [8304] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.385901+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.663 UTC [8305] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.621505+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.664 UTC [8306] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.624011+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.908 UTC [8308] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.870547+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.910 UTC [8307] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.871611+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.152 UTC [8310] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.116762+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.154 UTC [8309] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.114878+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.390 UTC [8311] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.358211+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.393 UTC [8312] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.359704+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.634 UTC [8313] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.596602+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.636 UTC [8314] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.598296+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.882 UTC [8315] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.842795+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.884 UTC [8316] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.841916+00:00'::timestamptz) LIMIT 1 [...] Is this behaviour intended? Stefan

4 12

Re: [Mailman-Users] Mailman 3 on Ubuntu 18.04
by Odhiambo Washington 09 Dec '18

09 Dec '18

On Sun, 9 Dec 2018 at 22:37, Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/9/18 10:14 AM, Odhiambo Washington wrote: > > > > In my quest to run Mailman3, I obtained a VM running Ubuntu 18.04 and > > started on getting to run Mailman3. > > I found this link -> https://github.com/iomarmochtar/mailman3_ei > > It has instructions which looked fairly simple to get Mailman3 installed. > > However, I did encounter some hitches since the script is not meant for > > Ubuntu. > > > First, a more appropriate list for Mailman 3 is > mailman-users(a)mailman3.org > <https://lists.mailman3.org/mailman3/lists/mailman-users@mailman3.org/>. > I am shifting to that list, after this. > > Also, we find it very difficult to address issues arising from third > party packages and how-tos. See <https://wiki.list.org/x/12812344>. > > And, there is a Mailman 3 package for Debian/Ubuntu > > apt install mailman3-full > In all my searching, I never found this in any documentation. I must have been searching in the wild, or my FreeBSD-mindedness got me stuck to containers and VENVs. > > With a few runs and observing the logs and modifying the script at every > > step it encountered and error, I finally managed to install Mailman3. It > > seems this is what you guys call a virtual environment in the Linux > world? > > :-) > > > I think the virtual environment in this case is a Python thing, not a > Linux thing. > I agree with you on that. > <snip> > > > Much of what I snipped is specific to > <https://github.com/iomarmochtar/mailman3_ei>, the details of which I'm > not interested in learning. > That is fine. I have put it aside for now. > > > >>From this point now is where I need help - serious help in smoothening > > things up and getting to understand these venv stuff! > > > > So I did run 'service mailman3 start' but this seems to be waiting for > too > > long to drop me back into the CLI. > > I also run 'systemctl start supervisord' and that seems to work. What I > am > > not sure is whether 'systemctl stop supervisord' actually does what it is > > expected to do because after I execute it, I still see processes running > > that I think are related. > > > > So far, I have been able to access the webUI on my VM using > > https://N.N.N.N:9090 > > I created a domain. > > But when I create a test list, I get an error - and I do not have a clue > > which logfile would have the error details - nginx or mailman... (I am > 100% > > new to nginx). > > > The nginx logs generally aren't too useful. Both Mailman core and Django > write logs. Core's log is probably in var/log/mailman.log where is > defined in mailman.cfg as var_dir. Django's log is defined in Django's > settings in the LOGGING setting. > Which file contains Django's settings? > > So now, I am stuck at: > > 1. Creating the mailing list > > 2. Getting to know whether the archiver is installed and running > > 3. Knowing is there are cron jobs to be running (Mailman2 type of > thinking!) > > > See > <http://docs.mailman3.org/en/latest/config-core.html#configuring-cron-jobs > > > and > < > http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required > > > Great to see that. I'll read and see if I make heads or tails of the writeup. > > Ultimately I need to figure out: > > 1. How the mailman queue runners are started and stopped > > mailman start > Why not systemctl mailman start?? Just wondering, as that is what I am seeing is common in Ubuntu. Does this make the components start after a reboot? > > 2. Migrate s few lists from Mailman2 to this Mailman3 > > mailman import21 > <django management> hyperkitty_import > Please show me where that is documented. I have to pull my lists from an old machine to this new one. > > 3. Mailman3 should use MySQL storage and Exim4 as the MTA (I have > > configured these bits in mailman.cfg) > > > You also need to configure MySQL in Django. See the DATABASES setting in > the Django settings. > So, when you talk about Django settings, you are referring to mailman.cfg file??? :-) I have spent all my weekend till now, trying to figure all this out. Life seems a little easier with mm2.x .... Thank you. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 1

Do not send email "The results of your email commands"
by erlonmz＠hotmail.com 07 Dec '18

07 Dec '18

Hello guys. Have to configure the mailman3 for not to send the e-mail " The results of your email commands" when an email is sent to "-leave@" and "-join@" ?? Sorry for my English, i from another country.

3 2

What is the difference between Mime Digest and Summary Digest in Mailman 3.2.0?
by Henrik Rasmussen 05 Dec '18

05 Dec '18

Having tried both Outlook and Gmail, there doesn't seem to be any visible difference between Mime Digest and Summary Digest. Of cause Gmail shows both index and all posts inline while Outlook shows both index and all posts as attachments, but overall the two digest types doesn't seem different from each other. Is that corrent or did I miss something? /Henrik Rasmussen

2 1

Mysql issue in django migrations
by Peter Sørensen 05 Dec '18

05 Dec '18

Hi, I have seen others having below problem: File "/usr/local/lib/python3.6/dist-packages/django/db/migrations/recorder.py", line 57, in ensure_schema raise MigrationSchemaMissing("Unable to create the django_migrations table (%s)" % exc) django.db.migrations.exceptions.MigrationSchemaMissing: Unable to create the django_migrations table ((1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '(6) NOT NULL)' at line 1")) But haven’t been able to find a proper solution. It’s not a syntax problem. Can anyone help ? Best regards Peter Sørensen/University of Southern Denmark

2 2

HyperKitty/Mailman3 issues
by Florian Schulze 04 Dec '18

04 Dec '18

Hi! I tried setting up Scheduled Tasks as described in <http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required> but the "runjobs" command can't be found. I see the hyperkitty and mailman commands when using "help". The "qcluster" service is working. Using Django 2.1.1 and HyperKitty 1.2.1. Maybe related to that, I have two issues with archives. 1. Changing the archiving setting in the Web-UI to something else than public seems to have no effect. The already archived messages are still accessible in public. 2. Related to 1., how can I remove a list archive without affecting other lists? Regards, Florian Schulze

2 2

Bounce processing via rest api
by Jukka Uusisalo 23 Nov '18

23 Nov '18

Hello, I looked rest api documentation and tried find out way to get information about undelivered postings to the list members. I assum, bouncing processing have this information but is it possible get via rest api? Thank you, Jukka

1 0

Rerun emails in the queue/bad
by Kaleb White 20 Nov '18

20 Nov '18

How do I run the emails in the queue/bad again? I need to see why the failed and get them to work. Thanks.

2 1

Error: 451 Requested action aborted
by Hagen Bauer 16 Nov '18

16 Nov '18

Hi I am running mailman in docker and I start to receive this error when my postfix tries to deliver a mail said: 451 Requested action aborted: error in processing (in reply to end of DATA command)) Any idea what is going wrong and where to look for problems? Regards Hagen

2 2

View only-account
by Henrik Rasmussen 15 Nov '18

15 Nov '18

Is it possible to create a Mailman 3 account as view only-access Postorius so our help desk can check users and list settings, but not manage the settings? /Henrik Rasmussen

1 0

Changing posting address
by Johannes Winter 09 Nov '18

09 Nov '18

Dear list, I'd like to change the sending address of a mailinglist, but when I try to set it via mmclient with ./manage.py mmclient lists=client.lists l=lists[listnumber] l.settings['posting_address']='new name' I get `ValueError: value is read-only`. Is it possible to change this value, or should I use another setting for this objective? Best regards, Johannes Winter

2 1

Setup Mailman3 on shared webhost
by Keyra 08 Nov '18

08 Nov '18

Iam trying to setup mailman3 on a shared webhost (with ssh access). I could use pip3.6 install mailman --user and also mailman info But when I try to start mailman using mailman start I will first get the error message TypeError: expected str, bytes or os.PathLike object, not NoneType and when I try it a second (and third etc.) time, it throws Starting Mailman's master runner /usr/bin/python3.6: can't open file '/usr/bin/master': [Errno 2] No such file or directory I didn't get any error messages during installation, so I guess whatever mailman is looking for in /user/bin/master is available in my /home/user/ folder, but I have no idea where and how to tell mailman to look there. For more infos, this is the output of `mailman info` GNU Mailman 3.2.0 (La Villa Strangiato) Python 3.6.5 (default, Apr 10 2018, 17:08:37) [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] config file: /var/www/virtual/user/html/var/etc/mailman.cfg db url: sqlite:////var/www/virtual/user/html/var/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:XXXX

2 1

Hyperkitty - Non-ascii sender address
by Guiseppin Thomas 04 Nov '18

04 Nov '18

Hi, I imported some mbox archives in Hyperkitty. I have lot issues like: /\Failed adding message <5b0900ab.1c69fb81.70ab.2f87(a)mx.google.com>: ('Non-ascii sender address', <email.message.EmailMessage object at 0x7f05f1606048>)// //Non-ascii sender address from "Stéphane blipblop <stlablipblop at gmail.com>" about [HATLAB][It] Re: A débarrasser ! / It's probably because "Stéphane". Some advise to fix it ? Name: HyperKitty Version: 1.2.1 Thanks, Thomas.

3 4

Mailman 3 on RHEL 7 help
by A Almeda 03 Nov '18

03 Nov '18

Hi. I am trying to install mailman 3 on RHEL7. Docker install is not a possibility. I am trying to install it using a bundler by following https://media.readthedocs.org/pdf/mailman-bundler/stable/mailman-bundler.pdf, but after logging in as mailman, I can't do virtualenv venv. It works if I login as root, but still fails during buildout. In short, I need help. Has anyone of you guys installed mailman 3 on RHEL 7 or CEntOS 7? If so would you share me detailed instructions? Thank you in advance.

3 8

how to integrate subscription into static jekyll website
by Hagen Bauer 23 Oct '18

23 Oct '18

Hi, I am running a static website with jekyll and I want to integrate a form that executes a subription rest api call to mailman. From my first investigation this seems to be a bad idea from a security perspective (rest api needs managaer access). Is there a secure way to do this? Any other ideas? Regards Hagen

3 7

Problem with missing MySQLDatabase
by Peter Sørensen 23 Oct '18

23 Oct '18

Hi, I have looked into installing this before without success but found The Debian package Mailman3-full I installed this succesfully along with the mailman-suite. I have configured varios setting but are stuck when trying to generate aliases For mailman with: mailman aliases Traceback (most recent call last): File /usr/bin/mailman, line 11, in <module> load_entry_point('mailman==3.1.1', 'console_scripts', 'mailman')() File /usr/lib/python3/dist-packages/mailman/bin/mailman.py, line 94, in main initialize(config_path) File /usr/lib/python3/dist-packages/mailman/core/initialize.py, line 189, in initialize initialize_2(propagate_logs=propagate_logs) File /usr/lib/python3/dist-packages/mailman/core/initialize.py, line 160, in initialize_2 config.db = getUtility(IDatabaseFactory, utility_name).create() File /usr/lib/python3/dist-packages/mailman/database/factory.py, line 52, in create database = call_name(database_class) File /usr/lib/python3/dist-packages/mailman/utilities/modules.py, line 67, in call_name named_callable = find_name(dotted_name) File /usr/lib/python3/dist-packages/mailman/utilities/modules.py, line 50, in find_name __import__(package_path) ModuleNotFoundError: No module named 'mailman.database.mysql.MySQLDatabase\t\t\t#MOD(inserted ) 02'; 'mailman.database.mysql' is not a package I can see from the message that I’m missing a module but I can’t figure out. how to get This installed. The mudule is referenced in the mailman.cfg as class: mailman.database.mysql.MySQLDatabase Can anybody help ? Best regards Peter Sørensen University Of Southern Denmark

2 3

autoresponse not sent
by shadiakiki1986＠gmail.com 22 Oct '18

22 Oct '18

Hello. Newbie to mailman here. I tried out mailman3 today. My setup is - mailman3 suite using the docker-compose file from asynchronous.io - exim4 on the local machine and configuring it as smarthost using mailgun smtp server The emails to the mailing list are received by the subscribers, but the autoresponse is not being received by the sender (who is not from the subscribers list). I'm not sure if the problem is from mailman-core, settings from mailman-web, or from exim. The setting for autoresponse to posters is set to yes, with some text to be sent in the autoresponse message. The autoresponse grace period is set to "0d60.0s" (I was unable to set to "0" or "negative" due to error saying something like "could not update parameter") The "Acknowledge posts" in the "global mailman settings" is set to "yes". The "Acknowledge posts" in the list-based preferences is also "yes". Here are the exim logs after I send the email from the non-subscriber to the mailing list ``` 2018-10-19 15:13:32 1gDWSy-0004n7-VR DKIM: d=gmail.com s=20161025 c=relaxed/relaxed a=rsa-sha256 b=2048 [verification succeeded] 2018-10-19 15:13:32 1gDWSy-0004n7-VR <= shadiakiki1986(a)gmail.com H=mail-vk1-f171.google.com [209.85.221.171] P=esmtp K S=2416 id=CACk+RNtq_hu+M_ufoCJQFCtOWOD_DX0omdVJbKfva0w=n4Qhuw(a)mail.gmail.com 2018-10-19 15:13:33 1gDWSy-0004n7-VR => quotations(a)mailman3.akikieng.com R=mailman3_router T=mailman3_transport H=172.19.199.2 [172.19.199.2] C="250 Ok" 2018-10-19 15:13:33 1gDWSy-0004n7-VR Completed 2018-10-19 15:13:35 1gDWT1-0004nC-1I DKIM: d=gmail.com s=20161025 c=relaxed/relaxed a=rsa-sha256 b=2048 [verification failed - signature did not verify (headers probably modified in transit)] 2018-10-19 15:13:35 1gDWT1-0004nC-1I <= quotations-bounces(a)mailman3.akikieng.com H=ip-172-19-199-2.us-west-2.compute.internal [172.19.199.2] P=esmtp S=3847 id=CACk+RNtq_hu+M_ufoCJQFCtOWOD_DX0omdVJbKfva0w=n4Qhuw(a)mail.gmail.com 2018-10-19 15:13:35 1gDWT1-0004nC-1I => shadi(a)akikieng.com R=smarthost T=remote_smtp_smarthost H=smtp.mailgun.org [35.161.201.187] X=TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256 CV=yes DN="C=US,ST=California,L=San Francisco,O=MAILGUN TECHNOLOGIES\, INC,OU=MAILGUN TECHNOLOGIES\, INC,CN=*.mailgun.org" A=plain C="250 Great success" 2018-10-19 15:13:35 1gDWT1-0004nC-1I Completed ``` 1. Is the signature verification failure due to mailman-core trying to send the autoresponse outgoing message? At first, I thought that the DKIM signature verification caused Exim to be dropping the autoresponse. So I set `DISABLE_DKIM_VERIFY=true` in exim, but still no autoresponse. Here are the exim logs after the sender sends the email ``` ^[[A2018-10-19 14:58:40 1gDWEa-0004Ww-QF <= shadiakiki1986(a)gmail.com H=mail-vs1-f53.google.com [209.85.217.53] P=esmtp K S=2410 id=CACk+RNvnfS+e+Uh-OSKjPB8oe+b1=efAJ6BSrc51jz_h9sVoFQ(a)mail.gmail.com 2018-10-19 14:58:40 1gDWEa-0004Ww-QF => quotations(a)mailman3.akikieng.com R=mailman3_router T=mailman3_transport H=172.19.199.2 [172.19.199.2] C="250 Ok" 2018-10-19 14:58:40 1gDWEa-0004Ww-QF Completed 2018-10-19 14:58:42 1gDWEc-0004Wz-R1 <= quotations-bounces(a)mailman3.akikieng.com H=ip-172-19-199-2.us-west-2.compute.internal [172.19.199.2] P=esmtp S=3841 id=CACk+RNvnfS+e+Uh-OSKjPB8oe+b1=efAJ6BSrc51jz_h9sVoFQ(a)mail.gmail.com 2018-10-19 14:58:42 1gDWEc-0004Wz-R1 => shadi(a)akikieng.com R=smarthost T=remote_smtp_smarthost H=smtp.mailgun.org [54.69.10.167] X=TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256 CV=yes DN="C=US,ST=California,L=San Francisco,O=MAILGUN TECHNOLOGIES\, INC,OU=MAILGUN TECHNOLOGIES\, INC,CN=*.mailgun.org" A=plain C="250 Great success" 2018-10-19 14:58:42 1gDWEc-0004Wz-R1 Completed ``` 2. is my understanding correct in reading these logs that there is nothing here about an autoresponse?

3 2

MM3 vs. Sympa
by Tom Browder 21 Oct '18

21 Oct '18

I still haven’t gotten around to getting a new MM3 service up and running, and now I’m looking at Sympa. I’ve seen a few comparisons of the two systems on the net, but the ones I’ve seen are for announcement lists only. I did see one university that did a study of list managers to replace Listproc and chose Sympa. I must admit my short-lived MM2 experience (used for my social sites for my high school and college classmates) seven years ago wasn’t the best was for two reasons: (1) no duplication of list names even for different domains and (2) it’s written in Python (instead of Perl). But, thanks to much help from Mark, I did get it runnng. I think it would be running today but it failed after about a year when Gmail (whose sntp server I was using) stopped allowing that, and I just didn’t know enough to get around the situation and had too much else to do. I waited expectantly for MM3 to come out and was ready to try again, but the separation of a formerly-integrated system into several systems was a bit daunting. Now I’m considering using Sympa: it’s coded in Perl, it’s monolithic, and it can support identical list names for different domains, so I am leaning in that direction. Before I go, I would appreciate anyone giving me a good reason to stay with MM (besides excellent support and a welcoming community—one which is a member of an unfortunately small group of such communities). Thanks so much. Best regards, -Tom

4 5

Difficulties setting up MM3 with Postfix MTA in Docker Environment: Invalid EHLO domain name & Authentification as lists.local
by Niklas Frühauf 21 Oct '18

21 Oct '18

Hi everyone, I managed to setup mailman using the maxking/mailman-* docker containers, connected to a postfix/dovecot mailserver and a mysql database. The mail domain is @mail.local, mailman is reachable at lists.local. I can see the mailman UI fine, its connection to the database is working as well, the only things that’s not working is the initial login: When I try to login with the correct credentials of the superuser I added, I get An error occurred while processing your request. To me it seems like mailman is trying to authenticate as “lists.local” or “mail.local” or “localhost” to postfix (which of course isn’t working), then issues a EHLO/HELO to postfix which is not a FQDN. So I guess the latter issue could be resolved by providing a FQDN by mailman. These are the logfiles from the period: mail | Oct 21 11:15:07 mail postfix/postscreen[1862]: CONNECT from [172.18.18.8]:49288 to [172.18.18.254]:25 ldap_1 | 5bcc5fc1 conn=1000 fd=12 ACCEPT from IP=172.18.19.8:49252 (IP=0.0.0.0:389) ldap_1 | 5bcc5fc1 conn=1000 op=0 BIND dn="cn=admin,dc=..." method=128 ldap_1 | 5bcc5fc1 conn=1000 op=0 BIND dn="cn=admin,dc=..." mech=SIMPLE ssf=0 ldap_1 | 5bcc5fc1 conn=1000 op=0 RESULT tag=97 err=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=1 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=1 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=1 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=2 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=2 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=2 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=3 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fc1 conn=1000 op=3 SRCH attr=mail ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fc1 conn=1000 op=3 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=4 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=mail.local)" ldap_1 | 5bcc5fc1 conn=1000 op=4 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=4 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=5 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=mail.local)" ldap_1 | 5bcc5fc1 conn=1000 op=5 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=5 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=6 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@mail.local)(mailalias=*@mail.local))" ldap_1 | 5bcc5fc1 conn=1000 op=6 SRCH attr=mail ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fc1 conn=1000 op=6 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=7 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=7 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=7 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=8 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=8 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=8 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=9 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fc1 conn=1000 op=9 SRCH attr=mail ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fc1 conn=1000 op=9 SEARCH RESULT tag=101 err=0 nentries=0 text= mail | Oct 21 11:15:13 mail postfix/postscreen[1862]: PASS OLD [172.18.18.8]:49288 mail | Oct 21 11:15:13 mail postfix/smtpd[1873]: connect from srv-docker_mailman-web_1.srv-docker_frontend[172.18.18.8] mail | Oct 21 11:15:17 mail postfix/postscreen[1862]: warning: dnsblog reply timeout 10s for list.dnswl.org mail | Oct 21 11:15:27 mail postfix/dnsblog[1866]: warning: dnsblog_query: lookup error for DNS query 8.18.18.172.list.dnswl.org: Host or domain name not found. Name service error for name=8.18.18.172.list.dnswl.org type=A: Host not found, try again ldap_1 | 5bcc5fdf conn=1000 op=10 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=10 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=10 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=11 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=11 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=11 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=12 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fdf conn=1000 op=12 SRCH attr=mail ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fdf conn=1000 op=12 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=13 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=localhost)" ldap_1 | 5bcc5fdf conn=1000 op=13 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=13 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=14 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=localhost)" ldap_1 | 5bcc5fdf conn=1000 op=14 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=14 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=15 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@localhost)(mailalias=*@localhost))" ldap_1 | 5bcc5fdf conn=1000 op=15 SRCH attr=mail ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fdf conn=1000 op=15 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=16 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=16 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=16 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=17 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=17 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=17 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=18 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fdf conn=1000 op=18 SRCH attr=mail ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fdf conn=1000 op=18 SEARCH RESULT tag=101 err=0 nentries=0 text= mail | Oct 21 11:15:43 mail policyd-spf[1886]: prepend Received-SPF: Temperror (mailfrom) identity=mailfrom; client-ip=172.18.18.8; helo=c98c668820fd; envelope-from=postorius(a)lists.local; receiver=<UNKNOWN> mail | Oct 21 11:15:43 mail postfix/smtpd[1873]: NOQUEUE: reject: RCPT from srv-docker_mailman-web_1.srv-docker_frontend[172.18.18.8]: 504 5.5.2 <c98c668820fd>: Helo command rejected: need fully-qualified hostname; from=<postorius(a)lists.local> to=<niklas.fruehauf(a)mail.local> proto=ESMTP helo=<c98c668820fd> mail | Oct 21 11:15:43 mail postfix/postscreen[1862]: CONNECT from [172.18.18.8]:49304 to [172.18.18.254]:25 mail | Oct 21 11:15:43 mail postfix/postscreen[1862]: PASS OLD [172.18.18.8]:49304 mail | Oct 21 11:15:43 mail postfix/smtpd[1903]: connect from srv-docker_mailman-web_1.srv-docker_frontend[172.18.18.8] proxy_1 | 172.18.18.1 - - [21/Oct/2018:11:16:13 +0000] "POST /accounts/login/ HTTP/1.1" 500 1102 "https://lists.local/accounts/login/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36" "-"

3 2

footer message
by Abhijith PA 19 Oct '18

19 Oct '18

Hello. Is there any way to enable footer for some lists at the same time disable for lists. I maintain an mailman3 instance and some of the lists in it need the footer message well some not. Regards, Abhijith.

3 5

dkim failing
by Abhijith PA 16 Oct '18

16 Oct '18

Hello. I am seeing dkim fail in mail that people send to lists /dkim=fail reason="signature verification failed"/ but it is not happening when the list solely sending mail to subscribers (like digest, or subscribe/unsubscribe messages etc). I recently added a new domain to the mailman3. After this I started noticing this issue. Any help ?

2 1

dkim failing
by Abhijith PA 16 Oct '18

16 Oct '18

Hello. I am seeing dkim fail in mail that people send to lists /dkim=fail reason="signature verification failed"/ but it is not happening when the list solely sending mail to subscribers (like digest, or subscribe/unsubscribe messages etc). I recently added a new domain to the mailman3. After this I started noticing this issue. Any help ? Thanks Abhijith PA

2 1

Change digest frequency and default threshold
by Henrik Rasmussen 12 Oct '18

12 Oct '18

When creating a new list in Mailman 3, the Digest Size Threshold is set to 30KB, which is not much in my opnion. 1) How do I set another default for Digest Size Threshold for new lists. 2) How do I change the default for existing lists When Digest Size Threshold is not reached, mails seems to be sent according to digest_volume_frequency': which is set to 'monthly'. The web interface doesn't seem to have a setting for this. How do I change this setting, both on a single list and the default for new lists? Henrik Rasmussen

2 9

Can't remove footer(s)
by Henrik Rasmussen 11 Oct '18

11 Oct '18

I have a problem removing the footer(s) from a list imported from MM2.1. I have been testing by entering my message in Hyperkitty (the list forum). I an aware about the double footer issue[1], and I am aware that footers are cached, but I have removed the footer files according to [2], run Mailman shell according to [3], restarted the Mailman (Mailman core, Mailan web, Postgres database and postfix). Did I miss something in order to remove the footers? [1] https://gitlab.com/mailman/mailman/issues/407 [2] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… [3] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… I'm running Docker-Mailman (Mailman version 3.2.0a1). -- Henrik Rasmussen

2 5

Archiving error
by Enrique Terrazas 05 Oct '18

05 Oct '18

Hello, I'm hoping someone can help me configure hyperkitty correctly. I've got mailman3 installed and working. I created a test list and can send/receive, moderate message. However, archiving does not seem to be working. Below is a copy of my (sanitized) hyperkitty.cfg file and settings.py file(edited) along with the errors being logged to mailman.log hyperkitty.cfg ----- # Mailman-Hyperkitty Archiver plugin [general] base_url: http://localhost:8002/ api_key: ----- settings.py # Mailman API credentials MAILMAN_REST_API_URL = 'http://localhost:8001' MAILMAN_REST_API_USER = '' MAILMAN_REST_API_PASS = '' MAILMAN_ARCHIVER_KEY = '' MAILMAN_ARCHIVER_FROM = ('my.host.name', 'myIPaddress', '127.0.0.1', '::1') ------ This is the error being sent to maillog.log ------ Oct 05 01:54:59 2018 (15127) Exception in "hyperkitty" archiver Traceback (most recent call last): File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connection.py", line 171, in _new_ conn (self._dns_host, self.port), self.timeout, **extra_kw) File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/util/connection.py", line 79, in c reate_connection raise err File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/util/connection.py", line 69, in c reate_connection sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen chunked=chunked) File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 354, in _make_request conn.request(method, url, **httplib_request_kw) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1239, in request self._send_request(method, url, body, headers, encode_chunked) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1285, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1234, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1026, in _send_output self.send(msg) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 964, in send self.connect() File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connection.py", line 196, in connect conn = self._new_conn() File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connection.py", line 180, in _new_conn self, "Failed to establish a new connection: %s" % e) urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f0ba1c22048>: Failed to establish a new connection: [Errno 111] Connection refused During handling of the above exception, another exception occurred: ------ Thanks in advance, Enrique J. Terrazas

3 5

Hyperkitty 1.1.1 to HyperKitty 1.2.1
by Thomas G 05 Oct '18

05 Oct '18

Hi, I would like to migrate my current Mailman3.1/Hyperkitty data to a fresh install in Mailman3.2. I didn't found how migrate the archives. From : HyperKitty - Version: 1.1.1 - Python2.7 To : HyperKitty - Version: 1.2.1 - Python3.5 I exported a mbox from hyperkitty (web interface) and tried to re-import it, without result. """""""""""""""""""""""""""""""""""""""" xxxx @xxxxxx :/opt/mailman# python3.5 manage.py hyperkitty_import -l listedetests(a)hatlab.fr /home/admin/listedetests(a)hatlab.fr.mbox.gz Importing from mbox file /home/admin/listedetests(a)hatlab.fr.mbox.gz to listedetests(a)hatlab.fr Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the 'manage.py update_index_one_list listedetests(a)hatlab.fr' command. """""""""""""""""""""""""""""""""""""" The database stay empty (and web interface): """""""""""""""""""""""""""""""""""""" mailmandbnameprod=# select * from hyperkitty_email; id | message_id | message_id_hash | subject | content | date | timezone | in_reply_to | archived_date | thread_depth | thread_order | mailinglist_id | parent_id | sender_id | thread_id | sender_name ----+------------+-----------------+---------+---------+------+----------+-------------+---------------+--------------+--------------+----------------+-----------+-----------+-----------+------------- (0 rows) """""""""""""""""""""""""""""""""""""" Any idea to do this importation ? Thanks !

3 7

Proper permissions for mailman installation under home directory, with layout: local
by Eric Abrahamsen 03 Oct '18

03 Oct '18

I recently upgraded my server from Ubuntu 16.04 to 18.04, and have hit some snags in the process. I've had my mailman3 installation under my home directory, running as my own user, without too many problems. var_dir was set to something in my home directory. Recently, while tracking down some weird behavior, I realized that with this sort of setup I'm supposed to use "layout: local", and that previously I'd had a sort of weird half-way installation where some things were kept in my /home/<me>/sites/mailman directory, and other bits (pids and whatnot) were scattered around the filesystem. Now that I'm using "layout: local", mailman really is trying to keep everything under that main directory, and now everything's breaking. The hyperkitty search indexer is saying it has no permissions to write into that directory, postfix won't deliver mail, saying the mailbox is unavailable, and in the web UI postorius shows no configured list domains (though hyperkitty still displays the archives correctly). So obviously I've got quite a big problem with permissions, but I don't know how to resolve it. My webserver is nginx, running as www-data. I'm starting mailman in a systemd script, with User and Group set to my user -- though maybe that should be set to root? I guess postfix runs as root, I'm not sure, but obviously it's not able to read the files in var/data/*, which appear all correct to me. What's the recommended solution here? I'd still like to keep this whole directory under my home directory, if possible... Thanks, Eric

1 0

About the link destination of the logo image of the homepage
by Ooyama Yosiyuki 01 Oct '18

01 Oct '18

At next page: https://www.gnu.org/software/mailman/ Despite the fact that "Mailman" is written in the logo on the upper left of the screen, However if I click the logo image on the upper left of the screen,then it is to move to https://www.gnu.org/software/ I think it is strange. In the Wikipedia English version, the following address is introduced as mailman's website. www.gnu.org/software/mailman/

3 2

Hyperkitty splitting threads?
by Marvin Gülker 30 Sep '18

30 Sep '18

Hi, I'm experiencing a problem with regard to how Hyperkitty decides how to group messages into a thread. It appearently randomly splits a thread and creates a new one from the replies, even though the replies have the proper In-Reply-To: header set. As of now, the front page for our mailing list[1] illustrates the issue nicely: the "TSC Boost Build Issues" topic has been split over three threads for no appearent reason, and the "Providing an APT repository" one in two. Sometimes replies are collected into the proper thread, though (see the latter thread). Exact links follow as the front page can change later on: * The "Boost Build Issues" topic (these should all be in one thread page): * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * The "APT repository" topic (these should all be in one thread page as well): * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… This is Mailman 3.2.0 with Hyperkitty 1.2.0. We will shortly upgrade Hyperkitty to the current version, but since I didn't find something related in the release notes for newer versions, I thought I'd ask here if the problem is known. Also, is there a way to rebuild the thread structure so that the existing errorneous splits can be corrected? Marvin [1]: https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

2 2

Docker-mailman: Performance issue
by Henrik Rasmussen 28 Sep '18

28 Sep '18

I am using Docker-mailman (currently Mailman version 3.2.0a1). I have a list with 38513 subscribers and when I operate on a very large number of them (for example click Unsubscribe all), the web interface times out. The same happens if I use the REST API, one member at the time, but run from a python script i've made). The Docker containers for both Mailman core (mostly) and mailman web (sometimes) are using 100% CPU (quart of the server's amount of CPUs). By doubleing the CPU shares that the two docker containers can use (using RHEL Cockpit) from 1024 to 2048 for each, Mailman-core had a max usage of 190% and Mailman-web about 101%. Still, mass unsubscribing the members by clicking Unsubscribe all made theinterface time out. Using the REST API succeeded unsubscribing all, but still made the Mailman web interface inaccessible. How can I make Docker-mailman perform better, to avoid these timeouts. -- Henrik Rasmussen University of Copenhagen

2 2

Where is the site to translate HyperKitty?
by Ooyama Yosiyuki 27 Sep '18

27 Sep '18

Where can I translate HyperKitty(GNU Mailman v3)? please tell me.

3 3

Dump/restore users (with passwords) via API
by Dmitry Makovey 26 Sep '18

26 Sep '18

We are trying to dump/restore users using API calls and it seems that API allows us to dump password hashes (a good thing), but then API does not allow to insert users back using saved password hashes - only cleartext passwords. Aside from create_user is there any other way to create users/change their password? -- Sr System and DevOps Engineer SoM IRT

4 9

List description as sender
by Henrik Rasmussen 26 Sep '18

26 Sep '18

When receiving a mail from Mailman 3, the From: User name is the description of the list, like From: Long desription of the list for all members of certain project <project(a)lists.example.com>. Starting to get old, I recall something about a discussion we once had on http://mail.python.org/pipermail/mailman-users/, but I don't recall the reason for this and I can't find the discussion, so it might be something I dreamed. What was the reason for implementing this? And could it be a selectable choise in Mailman 3?

2 7

Disable Archive for a mailing list
by Hagen Bauer 24 Sep '18

24 Sep '18

Hi to all, is there a way to totally disable the archive of a mailing list? I would like to setup mailman as a "mailforwarder" without the ability to store the mails Regards Hagen

2 1

Text encoding problem, preapproved header
by Thor Atle Rustad 20 Sep '18

20 Sep '18

Mailman 3.2. I send a message to the list with some national characters (æøå ÆØÅ), and everything shows up fine. Then I send the same message using pseudo-header approved: with the list password. This messes up the character encoding, so that instead I get (=C3=A6=C3=B8=C3=A5 =C3= =86=C3=98=C3=85) I experience the problem when I send or receive with Gmail web client, however, when using the Claws-mail (an ordinary mail client) to pick up from my gmail account, the contents is shown correctly. Any suggestions?

3 3

Rejection based on total message size including attachments
by leith＠khimaira.com 20 Sep '18

20 Sep '18

As a web hosting provider I have searched and searched for a way to limit the total size of messages posted to all lists. We have moderators who just can't get it through their heads to limit the size of attachments. One list today distributed a 6 mb pdf to over 700 recipients. I have found information on creating a custom handler and some old and brief logic on limiting max_message_size from Mr. Sapiro. Would anyone who has developed a custom handler to reject messages based on total size, mind sharing the full file? If so, could you also state where the handler was positioned in the chain of handlers. Thank you for your time.

2 2

Set domain inactive / archive import from other domain.
by Johannes Winter 19 Sep '18

19 Sep '18

Dear list, we've migrated a list from another domain and would like to keep the archives. Hyperkitty doesn't recognize the emails in the mbox archive during import due to the other domain name. As a workaround we thought of creating a placeholder list with the original and than import the mbox. But actually I don't like to have dysfunctional lists in the domain list. Is it possible to set domains invisible? Or is there a switch to import a list from another domain? Best regards, Johannes Winter

2 3

Disable "confirmation emails"
by Hagen Bauer 19 Sep '18

19 Sep '18

Hi to all, even after a lot of google search I could not find a way to disable the Confirmation Mails like .... The results of your email command are provided below. - Original message details: ....... Is there a way to do this? I have users who would be irritated and I dont want them to recieve this Regards Hagen

3 3

Counter-intuitive header filter processing
by Jonas Meurer 18 Sep '18

18 Sep '18

Hello, it seems like the way mailman3 processes header filters is a bit counter-intuitive. With a header filter (HeaderMatch) like the following: header => from pattern => .*(a)freesources.org chain => accept I expect mails from *(a)freesources.org to be accepted regardless of the default message acceptance settings. Apparently, that's not the case. If the default message acceptance setting for members is set to "reject", then mails from *(a)freesources.org get rejected even though the header filter says "accept". In other words, the default message acceptance action seems to overrule any header filters. Is this expected behaviour? Kind regards jonas

2 3

New platform administrators
by Hellen Cubero 18 Sep '18

18 Sep '18

Hello! I would like to know how to add a new site administrator to the mailman 3.2 platform. Can you help me please?

3 2

Using as a forum
by tokyoprogressive＠mailbox.org 18 Sep '18

18 Sep '18

Our group of 30 plus people have the perennial problem in MM II of not checking previous messages before replying. A second problem is starting a new topic rather than responding to a message in the same topic, which makes searching even harder. I previously suggested a forum or something like Stack or Flock. People had no interest in a Word Press forum yet moan about the inefficiency of a list, also it is something new and involves leaving email. Stack and Flock make it hard to require all to be a member of all topics in their free versions. Then it occurred to me, the threaded view in Mailman III looks good and could help us nudge people back on topic. Am I being too optimistic. It is a closed group only open to people we approve. I would like to migrate to MM III but lack the technical skills to fo this? Anyone who could do this for a fee? We probably do not need to bring in the old topics. (I guess there us no way like a forum to limit the topics but at least we could keep things on track). Thanks Paul Arenson Japan Association for Language Teaching Sent from my iPhone

5 12

How to connect mailman into existing postfix server
by Hagen Bauer 16 Sep '18

16 Sep '18

Hi to all, I am trying to setup mailman3 with the Docker Image. Everythings works relative nicely but I am blocked by the Postfix integration part. I have a small postfix server that is delivering mails to known domains and an alias map. The standard use case assumes that the external postfix is only routing mails to the mailman lmtp. If I do this all my old users are recected. I am looking for an example(s) to integrate mailman into a Postfix configuration as an additional target for postfix. Any hints Regards Hagen

2 1

Stability issues
by schultmc＠cinlug.org 14 Sep '18

14 Sep '18

We're currently piloting Mailman3 to replace a failing Ecartis installation. We've had to push back our go live date several times due to stability issues with our Mailman 3 installation. We currently have Mailman core 3.2.0 running on Red Hat Enterprise Linux 7.5 with 2 vCPUs, 8GB RAM and 25GB swap space. Occasionally, we see mailman become unresponsive both via the REST API and the web UI. We haven't seen anything glaring in the logs but would be happy to check further. I know Mailman 3 powers many large lists and would appreciate any performance, stability and tuning information that can be provided.

3 2

Memory usage
by Adi Kriegisch 13 Sep '18

13 Sep '18

Dear all, I've been using mailman2 for quite some time and I am considering upgrading to mailman3. In a test setup I noticed that mailman3 with just a basic setup (Debian with mailman3 package and sqlite as backend using exim4) uses over 700MB RAM (RSS): | USER VSZ RSS COMMAND | list 73072 54568 /usr/bin/python3 /usr/lib/mailman3/bin/master | list 73100 54500 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=archive:0:1 | list 73100 54572 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=bounces:0:1 | list 73100 54560 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=command:0:1 | list 73100 54600 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=in:0:1 | list 146832 54700 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=lmtp:0:1 | list 73100 54808 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=nntp:0:1 | list 73100 54652 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=out:0:1 | list 73100 54504 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=pipeline:0:1 | list 150516 58228 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=rest:0:1 | list 73100 54508 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=retry:0:1 | list 73100 54500 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=virgin:0:1 | list 73100 54608 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=digest:0:1 This is with only one test list configured that just has one member. Compared to a mailman2 setup with many lists with up to 300 members that only uses around 70MB RAM: | USER VSZ RSS COMMAND | list 63724 1396 /usr/bin/python /usr/lib/mailman/bin/mailmanctl -q start | list 62896 10660 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s | list 61156 1792 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s | list 58148 1808 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s | list 73116 23316 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s | list 55464 1672 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s | list 65840 11868 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s | list 62036 10840 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s | list 58716 5712 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s This is without hyperkitty or a management interface, just mailman3 core that uses 10 times as much ram as mailman2. Did I do something wrong here? Is there probably a bug in my python environment? Are there any config options that I should set to avoid this huge memory footprint? I found one thread[1] on this mailing list where a user asked a question similar to mine with comparable numbers. best regards, Adi Kriegisch [1] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…

2 1

Subscription notification sent from the site admins work-mail.
by Henrik Rasmussen 13 Sep '18

13 Sep '18

One of my list administrators told me that all seven list administrators on a list received a "None <foo(a)example.com> has been successfully subscribed to [LIST NAME].", when someone subscribed to their list, however the sender of the mail (From:) was my own work mail address. I am not associated with the list other that I am site admin. The log /opt/mailman/web/logs/smtp.log seems to confirm that Mailman have sendt the mail on behalf of me. Sep 13 09:07:24 2018 (34) <153682964402.36.12950433926619808467@mailman-core> smtp to [LISTNAME](a)lists.example.com for 7 recips, completed in 0.12819194793701172 seconds Sep 13 09:07:24 2018 (34) <153682964402.36.12950433926619808467@mailman-core> post to [LISTNAME](a)lists.example.com from me(a)example.com, 525 bytes How can I, the site admin, be the sender og the mail? Note: Mailman 3 have been running with users half a year, but last week the particular list was imported from Mailman 2 using import21.

2 2

MM3 management tools (for those who need them)
by Dmitry Makovey 13 Sep '18

13 Sep '18

Hi, I wanted to share our current development of MM3-related tools that we currently employ on a daily basis. forks, ideas, pointers and issue reports are welcome: https://gitlab.med.stanford.edu/irt-public/mailman-tools Note that it's a "work in progress" bunch of scripts that work, but YMMV. ...so no refunds ;) -- Sr System and DevOps Engineer SoM IRT

1 0

LookupError: unknown encoding: _iso-2022-jp$esc
by Thor Atle Rustad 07 Sep '18

07 Sep '18

This happens when I open a page of Held Messages containing an offending message. I get Server Error (500) in Postorius. Here is the mailman.log: Sep 07 15:25:39 2018 (32) REST request handler error: Traceback (most recent call last): File "/usr/local/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/local/lib/python3.6/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/site-packages/mailman/rest/wsgiapp.py", line 214, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/site-packages/falcon/api.py", line 244, in __call__ responder(req, resp, **params) File "/usr/local/lib/python3.6/site-packages/mailman/rest/post_moderation.py", line 160, in on_get resource = self._make_collection(request) File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/post_moderation.py", line 150, in _resource_as_dict resource = self._make_resource(request.id) File "/usr/local/lib/python3.6/site-packages/mailman/rest/post_moderation.py", line 77, in _make_resource resource['msg'] = msg.as_string() File "/usr/local/lib/python3.6/site-packages/mailman/email/message.py", line 54, in as_string value = email.message.Message.as_string(self) File "/usr/local/lib/python3.6/email/message.py", line 158, in as_string g.flatten(self, unixfrom=unixfrom) File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/local/lib/python3.6/email/generator.py", line 181, in _write self._dispatch(msg) File "/usr/local/lib/python3.6/email/generator.py", line 214, in _dispatch meth(msg) File "/usr/local/lib/python3.6/email/generator.py", line 243, in _handle_text msg.set_payload(payload, charset) File "/usr/local/lib/python3.6/email/message.py", line 315, in set_payload payload = payload.encode(charset.output_charset) LookupError: unknown encoding: _iso-2022-jp$esc

2 1

confusing contents of database (data corruption?)
by Dmitry Makovey 07 Sep '18

07 Sep '18

I'm troubleshooting slowness and issues in our mailman (container-based) setup. (See also "ORM exceptions" thread) And I've come across really odd contents of DB: mailmandb=# select * from address, (select email, count(email) as instances from address group by email) as emails where emails.instances>1 and emails.email=address.email ; -[ RECORD 1 ]--+---------------------------------------------- id | 1001 email | some_person(a)some.org _original | Some_Person(a)some.org display_name | Some Person verified_on | registered_on | 2018-07-02 03:23:18.761679 user_id | 22543 preferences_id | 146541 email | some_person(a)some.org instances | 2 -[ RECORD 2 ]--+---------------------------------------------- id | 1002 email | some_person(a)some.org _original | display_name | verified_on | registered_on | 2018-07-02 03:23:19.036667 user_id | preferences_id | 146543 email | some_person(a)some.org instances | 2 mailmandb=# select * from member where address_id in (1002,1001); -[ RECORD 1 ]-----+------------------------------------- id | 73682 _member_id | f4cdxxxx-5c64-xxxx-9ac8-1f5xxxxa0f1c role | 4 list_id | mylist.lists.here.stanford.edu moderation_action | address_id | 1002 preferences_id | 146544 user_id | so: 1. address for the same email gets created twice 2. membership references "empty" address 3. membership does not reference proper user 4. preferences_id in all 3 records are different is there a documentation on the DB contents someplace? I feel like our mailman instance slowness is related to DB content but cleaning up that content seems to be risky at best. -- Sr System and DevOps Engineer SoM IRT

1 0

message file gone, but exists in database?
by Thor Atle Rustad 06 Sep '18

06 Sep '18

I'm investigating some problems, and in the process I want to delete some messages. First, listing all messages: >>> messages = list(message_store.messages) Traceback (most recent call last): File "<console>", line 1, in <module> File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 117, in messages yield self._get_message(row) File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 95, in _get_message with open(path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/messages/5X/7W/5X7WMWNORTGVNB6KVWTHHOI2VF2BEQ7K' Since this message should not exist in database, I try to delete it: >>> message_store.delete_message('5X7WMWNORTGVNB6KVWTHHOI2VF2BEQ7K') >>> commit() >>> messages = list(message_store.messages) Traceback (most recent call last): File "<console>", line 1, in <module> File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 117, in messages yield self._get_message(row) File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 95, in _get_message with open(path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/messages/5X/7W/5X7WMWNORTGVNB6KVWTHHOI2VF2BEQ7K' However, it continues to exist in mailman's mind I also cannot delete messages that actually exist. For instance, I find a message in Postorius that I want to delete. I look at the headers and then run >>> message_store.delete_message('6XFISRRFY74NJEE4FTRNWOA2KGKDBZ3T') >>> commit() After that, the message continues to live, both in postorius and as a file: bash-4.3# ls 6XFISRRFY74NJEE4FTRNWOA2KGKDBZ3T What is wrong?

1 0

ORM exceptions
by Dmitry Makovey 06 Sep '18

06 Sep '18

I'm tracing slowness of mailman in our infrastructure, and came across ORM exception: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2837, in one ret = self.one_or_none() File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2816, in one_or_none "Multiple rows were found for one_or_none()") sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none() During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/local/lib/python3.6/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/site-packages/mailman/rest/wsgiapp.py", line 214, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/site-packages/falcon/api.py", line 244, in __call__ responder(req, resp, **params) File "/usr/local/lib/python3.6/site-packages/mailman/rest/members.py", line 365, in on_post return self._find(request, response) File "/usr/local/lib/python3.6/site-packages/mailman/rest/members.py", line 389, in _find okay(response, etag(resource._make_collection(request))) File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/members.py", line 72, in _resource_as_dict user = member.user File "/usr/local/lib/python3.6/site-packages/mailman/model/member.py", line 128, in user else getUtility(IUserManager).get_user(self._address.email)) File "/usr/local/lib/python3.6/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/local/lib/python3.6/site-packages/mailman/model/usermanager.py", line 88, in get_user return addresses.one().user File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2840, in one "Multiple rows were found for one()") sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one() is this a known thing and what's the best path for fixing it? -- Sr System and DevOps Engineer SoM IRT

1 1

log rotation
by Dmitry Makovey 06 Sep '18

06 Sep '18

I've been looking for a while and cannot find any information regarding log rotation for Mailman3. We're running containerized deployment which complicates the matter slightly, but having "some" approach for log rotation would be helpful. So before I dig into the code looking for SIGUSR1 or SIGHUP handlers can someone point me to a proper documentation for log management with MM3 ? -- Sr System and DevOps Engineer SoM IRT

3 3

ARC
by David Krantz 30 Aug '18

30 Aug '18

Hi, I just found out that gmail uses ARC (sometimes, at least). Is there support for that in Mailman 3? Without having had the time (yet) to read about in depth it it seems as if ARC is intended to solve at least some of the problems that mail lists have with DKIM. Probably causes others... It might be that no support really is needed in mailman so that just milters in sendmail, postfix etc. might do the trick. regards // David

2 1

Migration advice
by Quanah Gibson-Mount 29 Aug '18

29 Aug '18

Hi, I'm looking at migrating from an old server running mailman 2.1.15 (Debian wheezy) to a new Ubuntu 18.04 LTS system. I'd like to upgrade to mailman3 as a part of this migration. I was reading the migration docs (<http://docs.mailman3.org/en/latest/migration.html>), which seem to require both mailman2 and mailman3 be installed concurrently on the same system. Is that correct, or can I rsync the mailman2 list information onto the new server without mailman2 itself being present, and import from there? Thanks! Regards, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

2 1

Implicit destination
by David Krantz 28 Aug '18

28 Aug '18

Hi, I have a spam-problem like anyone else. Most of the spam my listserver receives has some kind of impilict destination so the implicit rule catches most of the spam that way. This is fine. What is not so fine, however, is that this results in a moderation message to the sender. I'd like to stop that so that the spammer has no confirmation that the mail was received. I can probably stop this in postfix before the mail reaches mailman3, but I'd prefer changing the behaviour of the rule. Is there any setting that could be used or should I just modify the rule? Cheers. // David

4 5

Whitelist non subscriber
by Mark Ziranski 27 Aug '18

27 Aug '18

Hello, I want to whitelist an email address on all lists to bypass moderation. The email address is not a subscriber. On google I found accept_these_nonmembers but I do not know how to use it. Please show me some examples how to whitelist someone(a)example.org. Thanks in advance. M.Z.

4 6

Configuration Question
by Ryan McClung 24 Aug '18

24 Aug '18

Greetings, Is there a simple way to force the mailman3 install to run off of a specified config/specified db without having to enter it manually each time? I just want any administrator to be able to enter mailman without wrecking the config/db. -- Ryan McClung Systems Administrator @ Afilias Canada A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> W. www.afilias.info T. +1.416.646.3304 x4186

2 3

changing adverstised status
by Alexander Klotz 24 Aug '18

24 Aug '18

Hi there, we are trying to set a once public list to private but have trouble doing so. In Postorius this doesn't seem to work - you can change "show list on index page" via the settings, but the value isn't saved. Is there a way to set advertised = False to a specific list via the shell? Thanks & Regards, Alex (Kulturserver editorial staff)

6 5

Docker release cycle maxking/mailman-core
by Johannes Winter 24 Aug '18

24 Aug '18

Hi guys, I'd like to test out some bugfixes in the master branch, namely the merge request related to: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… But I use the maxking docker images of which the 'rolling' and 'latest' tags are apparently not really used. Might it be possible to push these a litte bit more frequently? Thank you and best regards, Johannes Winter

2 1

Avoiding welcome message when subscribing using REST API
by Henrik Rasmussen 21 Aug '18

21 Aug '18

In Mailman 2 the site admin could add a member to a list using the -wn parameter of add_members to avoid sending a welcome message. On the host (outside the docker container) I've made an updater using the REST API to keep certain lists updated with imported addresses from one of our other systems, though respecting opt ins and opt outs. Similar to Mailman 2 I would like to avoid the welcome message to those automatic updated members, even the list is configred to send welcome message to those opting in by will, and I also like to avoid forcing the list owner/moderator to approve all new members automatically updated even the list is set for moderation of new members opting in by will. What is the payload for "no welcome message"? def add_new_members(listname_fqdn, members): [SNIP] for member in newmembers: payload['list_id'] = listname_fqdn.replace('@', '.') payload['subscriber'] = member payload['pre_verified'] = True payload['pre_confirmed'] = True payload['pre_approved'] = True response = mmapipost('members', payload) def mmapipost(apicommand,payload): response = requests.post('http://172.19.199.2:8001/%s/%s' % (restapiversion, apicommand), data=payload, auth=('restadmin', 'restpass'))

2 2

Moving from old-school install to docker
by David Krantz 19 Aug '18

19 Aug '18

Hi, Is there any documented procedure moving from a working install of mailman3 and postorius to a docker-based version? The reason would be to get a setup that is somewhat easier to maintain and upgrade. That said much of the work is to keep a mta, web server, spamfilter, grey list solution, dkim signing etc. running and up to date. I suspect that there is no pre-made docker images for that? cheers // David

1 0

receiving digest
by Abhijith PA 14 Aug '18

14 Aug '18

Hello. How a subscriber can receive the digest of a list ( assuming the list has enabled digests. Is there something to do for a subscriber in web interface to receive. Abhijith

2 1

Re: issue with Hyperkitty
by Mark Sapiro 08 Aug '18

08 Aug '18

On 08/07/2018 07:14 AM, Ali Alnubani wrote: > > I'm seeing the following trace when I go to http://example.com/hyperkitty/list/dev@example.com/2018/5/: This was fixed by downgrading Django to 2.0.8. See <https://gitlab.com/mailman/hyperkitty/issues/192> for more detail. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

proper update procedure for MM3 docker containers
by Fabian A. Santiago 07 Aug '18

07 Aug '18

Hello, Can someone remind me of the proper / best way to update my docker containers for MM3 / postorius based on maxking's images? Thanks. and this for both the stable and rolling releases. -- Fabian S. OpenPGP: 0x643082042DC83E6D94B86C405E3DAA18A1C22D8F (new key) *** 0x3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC (to be retired, still valid)

2 2

issue with Hyperkitty
by Ali Alnubani 07 Aug '18

07 Aug '18

Hi, I'm migrating from mailman 2.1.15, I did the following: * Installed packages * Created database * ./manage.py migrate * mailman create dev(a)example.com<mailto:dev@example.com> * ./manage.py hyperkitty_import -l dev(a)example.com /usr/local/mailman2/archives/private/dev.mbox/dev.mbox (the archive includes 69 emails). * ./manage.py update_index_one_list dev(a)example.com I'm seeing the following trace when I go to http://example.com/hyperkitty/list/dev@example.com/2018/5/: ``` ERROR 2018-08-07 13:54:23,897 19997 django.request Internal Server Error: /hyperkitty/list/dev(a)example.com/2018/5/ Traceback (most recent call last): File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 126, in _get_response response = self.process_exception_by_middleware(e, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 124, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/lib/view_helpers.py", line 134, in inner return func(request, *args, **kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 94, in archives return _thread_list(request, mlist, threads, extra_context=extra_context) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 123, in _thread_list return render(request, template_name, context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/shortcuts.py", line 36, in render content = loader.render_to_string(template_name, context, request, using=using) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/backends/django.py", line 61, in render return self.template.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 171, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 234, in render return t.render(new_context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 173, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 209, in render nodelist.append(node.render_annotated(context)) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 192, in render output = self.func(*resolved_args, **resolved_kwargs) File "venv_path/lib/python3.5/site-packages/django_mailman3-1.2.0-py3.5.egg/django_mailman3/templatetags/pagination.py", line 36, in add_to_query_string return conditional_escape(qs.urlencode()) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in urlencode for v in list_ File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in <genexpr> for v in list_ AttributeError: 'int' object has no attribute 'encode' ERROR 2018-08-07 13:54:23,897 19997 django.request Internal Server Error: /hyperkitty/list/dev(a)example.com/2018/5/ Traceback (most recent call last): File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 126, in _get_response response = self.process_exception_by_middleware(e, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 124, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/lib/view_helpers.py", line 134, in inner return func(request, *args, **kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 94, in archives return _thread_list(request, mlist, threads, extra_context=extra_context) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 123, in _thread_list return render(request, template_name, context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/shortcuts.py", line 36, in render content = loader.render_to_string(template_name, context, request, using=using) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/backends/django.py", line 61, in render return self.template.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 171, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 234, in render return t.render(new_context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 173, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 209, in render nodelist.append(node.render_annotated(context)) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 192, in render output = self.func(*resolved_args, **resolved_kwargs) File "venv_path/lib/python3.5/site-packages/django_mailman3-1.2.0-py3.5.egg/django_mailman3/templatetags/pagination.py", line 36, in add_to_query_string return conditional_escape(qs.urlencode()) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in urlencode for v in list_ File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in <genexpr> for v in list_ AttributeError: 'int' object has no attribute 'encode' ERROR 2018-08-07 13:54:25,721 19997 django.server "GET /hyperkitty/list/dev(a)example.com/2018/5/ HTTP/1.1" 500 317983 ``` Environment: ``` alembic==1.0.0 arrow==0.12.1 click==6.7 Django==2.1 django-haystack==2.8.1 django-mailman3==1.2.0 django-q==0.9.4 djangorestframework==3.8.2 httplib2==0.11.3 HyperKitty==1.2.0 mailman==3.2.0 mailman-hyperkitty==1.1.1 mailmanclient==3.2.0 Mako==1.0.7 postorius==1.2.0 psycopg2-binary==2.7.5 python-dateutil==2.7.3 requests==2.19.1 requests-oauthlib==1.0.0 SQLAlchemy==1.2.10 urllib3==1.23 uWSGI==2.0.17.1 Whoosh==2.7.4 ``` Some of the archives are listed fine tho. The same trace reproduced with 2 different imported archives. I'm on Debian stretch and using python 3.5.3. Can you help please? Thanks, Ali

1 0

migration subscribers from mm2 to mm3
by Mateusz Ostrzyżek 07 Aug '18

07 Aug '18

Hello, Is there any way to migrate subscribers from mailman2 to mailman3 other than writing them to mm3? I have a fiew lists on mailman2 an i want to migrate them to mailman 3, i found a way to migrate archive but cannot find any information about subscribers. Best regards -- Mateusz Ostrzyżek (null) (null)

2 1

dedicated mailman3 list server on Ubuntu 18.04 LTS - questions after installation
by John Seifarth 06 Aug '18

06 Aug '18

My goal is to build a stable dedicated list server using mailman3. It should use all current email authentication techniques to clearly show that it is an authentic non-spam mail list server. In the future, I may want to use the REST interface, so that’s why mailman2 is not an option. My installation: Installed Ubuntu 18.04 LTS server, with postfix, mysql and postgres. I then installed mail-stack-delivery, postfix-policyd-spf-python, OpenDKIM, and OpenDMARC. I configured SPF, DKIM, and DMARC records on my DNS server, and then configured postfix and dovecot to DKIM sign outgoing mail from local users, and check SPF, DMARC, and DKIM on incoming mail. I then installed the package mailman3-full, which provides version 3.1.1-9, using postgres 10 as the database. I have looked in Ubuntu bionic-backports and bionic-updates and do not see a more recent version. I see that version 3.2 was released in July, are debian/ubuntu mailman 3.2 packages available somewhere? I set up the /etc/mailman3 files: I added this to the end of mailman.cfg [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /etc/mailman3/mailman-hyperkitty.cfg In mailman-hyperkitty.cfg I copied the api_key: value from mailman-web.py MAILMAN_ARCHIVER_KEY, but removed the single quotes surrounding the value in the mailman-web.py file when writing the key in the mailman-hyperkitty.cfg file. I modified /etc/postfix/main.cf with this appended to the end: # Mailman-postfix integration owner_request_special = no # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no transport_maps = hash:/var/lib/mailman3/data/postfix_lmtp local_recipient_maps = proxy:unix:passwd.byname, $alias_maps, hash:/var/lib/mailman3/data/postfix_lmtp relay_domains = ${{$compatibility_level} < {2} ? {$mydestination} : {}} hash:/var/lib/mailman3/data/postfix_domains I ran /usr/share/mailman3-web/manage.py createsuperuser I ran a2enmod proxy_uwsgi I made a symbolic link from /etc/mailman3/apache.conf to /etc/apache2/conf-available/mailman3.conf, then ran a2enconf mailman3 I have read the documentation in /usr/share/docs/mailman3* along with what I could find concerning mailman3 on the web. The installation allows me to sign into the web interface, create a host, create mailing lists, and mass subscribe members. When members send email to the list address, the server sends the messages normally to the other members of the list. However, when I look at the list archives, there are no posts. I deliberately mass-subscribed an invalid address, and I can see in /var/log/mail.log that the message bounces, but I get no notification, nor do I see any bounce info when I look at the member info. My questions: 1) logging A lot of my questions would probably be answered if I could figure out hot to activate logging correctly. Currently, I see: root@mailman:/var/log/mailman3# ll -R -rw-rw---- 1 list list 0 Jul 29 20:06 bounce.log -rw-rw---- 1 list list 0 Jul 29 20:06 debug.log -rw-r----- 1 list list 3298 Aug 4 00:00 mailman.log -rw-rw---- 1 list list 34606 Jul 30 17:44 smtp.log drwxr-xr-x 2 www-data www-data 4096 Aug 3 06:25 web/ ./web: -rw-rw-r-- 1 www-data www-data 1520 Aug 3 06:25 mailman-web.log The bounce log and debug log are empty. I’ve set propagate: yes in the [logging.debian] section From /etc/mailman3/mailman.cfg # In this section, you can define defaults for all loggers, which will be # prefixed by 'mailman.'. Use subsections to override settings for specific # loggers. The names of the available loggers are: # # - archiver -- All archiver output # - bounce -- All bounce processing logs go here # - config -- Configuration issues <…snip…> Can anyone post an example of a ‘subsection’ to set archiver and bounce to debug? Do I have to create /var/log/mailman3/mailman.archiver.log and set ownership to list:list? 2) Where are posts stored? For me, this is the biggest mystery in mailman3. Local mail is delivered to ~/Maildir by dovecot. In the $var_dir hierarchy the directory messages contains just 2 messages dating to my initial tests. Anything I send to a list now, and which seems to be sent properly to the member addresses, I cannot find on the filesystem. Any clues as to what may be going on here? 3) Archival - Hyperkitty How does this work? All the parts seem to be in place, and I can see from ps /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=archive:0:1 -C /etc/mailman3/mailman.cfg How can I figure out why this is not working? In the web interface, I see that each of my lists has zero posts. But posts mailed to the list address do appear in the list members’ mailboxes! 4) Bounces I’ve deliberately put an erroneous email address as a list member. In postfix’s /var/log/mail.log I see the bounces, but get no notification, and /var/log/mailman3/bounce.log remains empty. 5) DKIM and DMARC I’ve got OpenDKIM running on inet:12345@localhost and OpenDMARC running on net:54321@localhost. How can I get mailman to use these milters and sign messages? How should DMARC munging be configured when signing? 6) Is there an overview of how mailman3 works? Is there documentation which explains the path of an incoming post through the system, including initial reception, list processing, sending to members, processing bounces, and archiving posts? Thanks in advance for help and pointers to any available documentation! John Seifarth Words & Wires SPRL Computer Consulting & Language Services Brussels, Belgium

3 2

bad ssl cert on docker guide site
by Fabian A. Santiago 06 Aug '18

06 Aug '18

hello, On the docker deployment guide site: https://asynchronous.in/docker-mailman/ linked to from here: http://docs.mailman3.org/en/latest/prodsetup.html the ssl cert is invalid, as it's issued against CN = www.github.com. just an fyi (although I"m sure others have seen this and there's likely a perfectly valid explanation I just haven't thought of). good day. -- Fabian S. OpenPGP: 0x643082042DC83E6D94B86C405E3DAA18A1C22D8F (new key) *** 0x3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC (to be retired, still valid)

2 1

getting spammed when sending lots of mails (>1000)
by Asaf Ohayon 06 Aug '18

06 Aug '18

Hello Using Mailman 3.2 / Posfix 2.10.1 I have a list configured, when having only few members, all is OK, email gets to inbox (at GMail) But when sending to thousands of members, it gets to the Spam folder, Is it a matter of rate-limiting at postfix ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

2 1

"To:" header field
by Asaf Ohayon 05 Aug '18

05 Aug '18

Hello I'm having trouble with getting into spam folder (at least at gmail), I'm suspecting to "To:" field (among other things). Comparing to Mailman 2.1, which we recently upgrading from, and didn't got spammed, the "To:" field was set to the actual reciever, While in Mailman 3.2, the "To:" field is set to the list's address. How can this be configured ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

2 1

Archiving error
by Eric Abrahamsen 03 Aug '18

03 Aug '18

Since about two days ago, all attempts to archive messages via Hyperkitty have raised the error below. So far as I know, I haven't updated any packages, or changed any config. I don't know why this has started happening. Internal Server Error: /hyperkitty/api/mailman/archive IntegrityError at /hyperkitty/api/mailman/archive NOT NULL constraint failed: hyperkitty_attachment.size Request Method: POST Request URL: http://lists.my-domain.org/hyperkitty/api/mailman/archive?key=NotMyRealKey Django Version: 2.0.5 Python Executable: /home/eric/.local/share/virtualenvs/mailman-FH66s6f7/bin/python Python Version: 3.5.2 Traceback: File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute 85. return self.cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/sqlite3/base.py" in execute 303. return Database.Cursor.execute(self, query, params) The above exception (NOT NULL constraint failed: hyperkitty_attachment.size) was the direct cause of the following exception: File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/core/handlers/exception.py" in inner 35. response = get_response(request) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/core/handlers/base.py" in _get_response 128. response = self.process_exception_by_middleware(e, request) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/core/handlers/base.py" in _get_response 126. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/hyperkitty/views/mailman.py" in _decorator 72. return func(request, *args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/views/decorators/csrf.py" in wrapped_view 54. return view_func(*args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/hyperkitty/views/mailman.py" in archive 119. add_to_list(mlist_fqdn, msg) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/hyperkitty/lib/incoming.py" in add_to_list 162. encoding=encoding) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/manager.py" in manager_method 82. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/query.py" in create 417. obj.save(force_insert=True, using=self.db) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in save 729. force_update=force_update, update_fields=update_fields) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in save_base 759. updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in _save_table 842. result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in _do_insert 880. using=using, raw=raw) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/manager.py" in manager_method 82. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/query.py" in _insert 1125. return query.get_compiler(using=using).execute_sql(return_id) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/sql/compiler.py" in execute_sql 1283. cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in execute 68. return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute_with_wrappers 77. return executor(sql, params, many, context) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute 85. return self.cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/utils.py" in __exit__ 89. raise dj_exc_value.with_traceback(traceback) from exc_value File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute 85. return self.cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/sqlite3/base.py" in execute 303. return Database.Cursor.execute(self, query, params) Exception Type: IntegrityError at /hyperkitty/api/mailman/archive Exception Value: NOT NULL constraint failed: hyperkitty_attachment.size Request information: USER: AnonymousUser GET: key = 'NotMyRealKey' POST: mlist = 'my-list(a)lists.my-domain.org' FILES: message = <InMemoryUploadedFile: message.txt ()> COOKIES: No cookie data META: CONTENT_LENGTH = '579002' CONTENT_TYPE = 'multipart/form-data; boundary=4c9a29456f514b2a9ef4f9a5d042abc6' HTTP_ACCEPT = '*/*' HTTP_ACCEPT_ENCODING = 'gzip, deflate' HTTP_CONNECTION = 'close' HTTP_HOST = 'lists.my-domain.org' HTTP_USER_AGENT = 'python-requests/2.18.4' HTTP_X_FORWARDED_FOR = 'xxx.xxx.xx.xxx' HTTP_X_FORWARDED_HOST = 'lists.my-domain.org' HTTP_X_REAL_IP = 'xxx.xxx.xx.xxx' PATH_INFO = '/hyperkitty/api/mailman/archive' QUERY_STRING = 'key=NotMyRealKey' REMOTE_ADDR = '127.0.0.1' REQUEST_METHOD = 'POST' SCRIPT_NAME = '' SERVER_NAME = '127.0.0.1' SERVER_PORT = '231742768' SERVER_PROTOCOL = 'HTTP/1.0' wsgi.errors = <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'> wsgi.file_wrapper = '' wsgi.input = <_io.BytesIO object at 0x7f940d0055c8> wsgi.multiprocess = True wsgi.multithread = False wsgi.run_once = False wsgi.url_scheme = 'http' wsgi.version = '(1, 0)'

1 0

Removing banned emails
by Kaleb White 02 Aug '18

02 Aug '18

I am trying to remove a banned email with a special character via the rest api and it's not working. It's also not working via the UI. Any ideas? http://localhost:8001/3.0/lists/example.com/bans/provisor#41@bankofamerica.… <Response [404]>

3 2

Re: Mailman 3 Keeps Forgettings Imported Lists
by Ryan McClung 31 Jul '18

31 Jul '18

I do see the output of the script and it shows the mailing lists being created. If you put "${VARIABLE}"@domain.com it outputs correctly. Also, to that end, the output of lists changes depending on which directory I am in which makes 0 sense. On Tue, Jul 31, 2018 at 3:27 PM Ryan McClung <rmcclung(a)afilias.info> wrote: > I do see the output of the script and it shows the mailing lists being > created. If you put "${VARIABLE}"@domain.com it outputs correctly. > > On Tue, Jul 31, 2018 at 3:22 PM Mark Sapiro <mark(a)msapiro.net> wrote: > >> On 07/31/2018 07:04 AM, Ryan McClung wrote: >> > Scratch that. Ran with the corrected script and getting the following: >> > [root@mailman3(stg) archives]# mailman lists >> > No matching mailing lists found >> > >> > Any thoughts? >> >> This >> >> > for DIR in $DIRS; do mailman create "${DIR}"; mailman import21 "${DIR}"@ >> afilias.info "${DIR}"/config.pck; >> >> is still wrong. The list name for mailman create needs to be fully >> qualified as in >> >> > for DIR in $DIRS; do mailman create ${DIR}(a)afilias.info; mailman >> import21 ${DIR}(a)afilias.info ${DIR}/config.pck; >> >> (Do you look at the output from your script?) >> >> -- >> Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, >> San Francisco Bay Area, California better use your sense - B. Dylan >> _______________________________________________ >> Mailman-users mailing list -- mailman-users(a)mailman3.org >> To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >> > > > -- > > Ryan McClung > Systems Administrator @ Afilias Canada > A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 > <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> > W. www.afilias.info > T. +1.416.646.3304 x4186 > -- Ryan McClung Systems Administrator @ Afilias Canada A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> W. www.afilias.info T. +1.416.646.3304 x4186

2 3