- Mailman-users - lists.mailman3.org

Postorius performance with over 1000 pending users
by Nick W 11 Jun '19

11 Jun '19

I've got a couple things I need help with: The Symptom and The Problem. The Symptom: Postorius has gotten quite slow to load, taking more than 30s to load the Subscription Requests tab. Having zero pending subscription requests (I'm on v1.2.5), I started investigating unconfirmed subscriptions. I followed the commands from here[1] and got this: mailman shell -l your.list.id util = getUtility(IPendings) print(len(list(util.find(mlist=m,pend_type='subscription')))) 1816 Wow, 1816 pending subscription requests. I can say for certain that my list is not popular so these requests must have been submitted by bots. Let's get there in The Problem. How can I "purge" this list? I'm willing to assume that none of these requests are valid and would reject all unconfirmed user requests. The Problem: How might this activity be happening? Running cat /opt/mailman/core/var/logs/mailman.log | grep POST returns a lot of 202 and 409 responses for `POST /3.1/members`. Could it be that these requests are being submitted through Postorius? I'd assume there would be some sort of honeypot input to prevent abuse. I'll continue investigating and follow up with any insight I can on the cause of The Problem. Thanks, Nick [1]: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…>

3 4

WSGI: gunicorn and uwsgi
by andrew.bernard＠gmail.com 09 Jun '19

09 Jun '19

Using the Ubuntu 19 packages for all the mailman suite, uwsgi is the Python WSGI server included. I have now switched over to a full build from current source from gitlab, following Mark Sapiro's excellent instructions. It would appear that the current code has the use of gunicorn built in. Is gunicorn the preferred way now to run the mailman Django apps? Is it worth spending time converting everything to use uwsgi, or should I go with the flow and use gunicorn? What are the advantages of gunicorn over uwsgi?

2 1

Help with installing Postorius and Hyperkitty on Ubuntu 19
by andrew.bernard＠gmail.com 09 Jun '19

09 Jun '19

I'm new to Mailman. I have a Ubuntu 19 production server. I attempted to get Mailman 3 and the web components going with the system packages, but I encountered a few showstopper errors (such as indexing not working at all) which I know have been fixed in the codebase. To that end I erased my installation, and installed mailman from the gitlab source. That all works much more nicely now and I feel I have a lot more control of the layout of all the files (the various Ubuntu packages smear the parts all over the place, confusingly). Now I want to get Postorius and Hyperkitty going again, independently of Ubuntu packages. I would like to run Postorius and Hyperkitty under one Django project. So I downloaded the git source for mailman_web. I do not know if this is the right way to install. I am partially familiar with Django, but to come to the point, I have no idea once having obtained the source from git how to setup and install the project, where it lives in the filesystem, and so on. Are there any pointers to help in this area? The very nice readthedocs format files for Postorius and Hyperkitty are very silent on basic matters like this, which is not of much help! The git README files also define a new level of brevity. I need some initial hand holding here. If any help is forthcoming, such as links to more full documentation for newbies to Mailman, I would be most grateful.

4 6

Daily Cronjob fails
by Stefan Tatschner 08 Jun '19

08 Jun '19

Hey hey, I applied a recent Update from Debian Buster, und this night a received an email about a failing cronjob. The traceback can be reproduced using: # sudo -u www-data flock -n /var/run/mailman3-web/cron.daily /usr/share/mailman3-web/manage.py runjobs daily ERROR OCCURED IN DAILY JOB: sync_mailman (APP: hyperkitty) START TRACEBACK: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) psycopg2.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (2, hb-events(a)hackbrettl.de, hb-events, null, [hb-events] , 1, 2015-10-22 09:54:53.684306+00, hb-events.hackbrettl.de). The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_extensions/management/commands/runjobs.py", line 36, in runjobs job().execute() File "/usr/lib/python3/dist-packages/hyperkitty/jobs/sync_mailman.py", line 35, in execute sync_with_mailman() File "/usr/lib/python3/dist-packages/hyperkitty/lib/mailman.py", line 131, in sync_with_mailman mlist.update_from_mailman() File "/usr/lib/python3/dist-packages/hyperkitty/models/mailinglist.py", line 192, in update_from_mailman self.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 808, in save force_update=force_update, update_fields=update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 838, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 905, in _save_table forced_update) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 955, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 667, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1204, in execute_sql cursor = super(SQLUpdateCompiler, self).execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 899, in execute_sql raise original_exception File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 889, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/lib/python3/dist-packages/django/utils/six.py", line 685, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) django.db.utils.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (2, hb-events(a)hackbrettl.de, hb-events, null, [hb-events] , 1, 2015-10-22 09:54:53.684306+00, hb-events.hackbrettl.de). END TRACEBACK Appearently there is something wrong with the database. Is there anything what I can do about this? Running the migrations doesn't help: # sudo -u www-data flock -n /var/run/mailman3-web/cron.daily /usr/share/mailman3-web/manage.py migrate Operations to perform: Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, sessions, sites, socialaccount Running migrations: No migrations to apply. Thanks! Stefan

3 3

Import Archives using Docker Image
by brian＠emwd.com 07 Jun '19

07 Jun '19

I want to test out importing a 2.1 archive into a Mailman 3.2 list. I am using maxking's docker images for MM3. How would I go about importing the mbox file? I don't think the following commands would work on a Docker installation of MM3: $ python manage.py hyperkitty_import -l foo-list(a)example.com $var_prefix/archives/private/foo-list.mbox/foo-list.mbox $ python manage.py update_index_one_list foo-list(a)example.com I am not sure how to go about doing this within Docker. Thanks for any assistance, Brian

2 2

Hyperkitty Authorization Required
by andrew.bernard＠gmail.com 06 Jun '19

06 Jun '19

Nearly there configuring my first Mailman 3 installation with Postorius and Hyperkiity. This issue eludes me: When trying to start a new thread in the archive, we have: HyperKitty failure on https://list.jackrail.org/hyperkitty/api/mailman/archive: <html><title>Auth required</title><body> <h1>Authorization Required</h1></body></html> (401) I can access this URL just fine" https://list.jackrail.org/hyperkitty/api/ Where do we look to solve this issue?

4 3

Hope for Mailman 3.X in cPanel
by Cold Kayak 06 Jun '19

06 Jun '19

Hi, it appears that cPanel is interested in supporting MailMan 3.X! See - https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870 <https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870> "We’re hoping to work with the Mailman folks at some point in the future to accomplish this goal." Hopefully this happens sooner than later. regards, Edmond

2 1

Changing default message limit (max_message_size)
by roger＠reasonal.com 30 May '19

30 May '19

Right, me again. I'm so close to having what I need up and running ... but a showstopper is the max message size that triggers a moderate in it. 40kB these days is just way small ... unless you're a 1% using text-only email. So found this on list archive: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… $ bin/mailman shell -l list(a)example.com // Welcome to the GNU Mailman shell // The variable 'm' is the list(a)example.com // mailing list m.max_message_size = nn // commit() Unfortunately this does not work in the containerised mailman. So I get the container ID and run: docker exec 3373d426996d /usr/local/bin/mailman shell -i test-list(a)iotcouncil.org.za (in the post by Mark it says "-l" but I get "unrecognized argument" -- I assume it should be -i for "interactive"? Either way, it fires up the mailman shell and then throws me straight out back to the command line: Welcome to the GNU Mailman shell The variable 'm' is the test-list(a)iotcouncil.org.za mailing list >>> [root@listman ~]# So that doesn't help...

3 7

Bug - if you change primary email address, you're "semi-subscribed"
by roger＠reasonal.com 30 May '19

30 May '19

Subscribed to the list, sending mails worked. Changed primary email (my company email system adds branding crap that exceeded the 40k limit). Then mails to list simply vanished. Sent mail via UI, suddenly get a "welcome to list" and held message says "The message comes from a moderated member".

3 4

Re: Bug - if you change primary email address, you're "semi-subscribed"
by Roger Hislop 30 May '19

30 May '19

Testing if emails are being delivered to the list …

1 0

How to separate bans for sending emails to lists and subscribing to them
by Nathan Dixon 29 May '19

29 May '19

Hi, Our requirements for using Mailman are that we can have non-members send an email to a list from any domain name, but only people who's email addresses match a list of specific domains should be able to actually subscribe to those lists. I can't seem to find any way of doing this. Any ideas? I have tried using the bans (global and on each list) but these appear to stop all subscriptions and emails being sent to or from a list if the address matches a ban. Having moderated list subscriptions seems to be the only workaround, but this wouldn't be great if we could automate it (we are currently using Listserv which does allow us to do this) Thank you, -- *Nathan Dixon* MEng Senior Software Architect

2 1

update_index_one_list in parallel?
by Szymon Sokół 29 May '19

29 May '19

Hello, I am new to this list. Last week I upgraded my old Mailman 2.1 site (running since 2011) to Mailman 3.2.1; wasn't quite straightforward, and part of the blame goes to people who made the choice of using sqlite as default database backend for mailman3-full Debian package, but finally I have it running with PostgreSQL, which I should've been using from the beginning. Now, however, I have noticed that indexing my archives in hyperkitty (using "manage.py update_index_one_list" for each list in sequence) takes quite a lot of time while using only one CPU (out of 4). Hence my question - is it safe to run several such processes in parallel, and if so, will it have any benefits? I have no idea how locking on the database is done in this code, maybe I'll end up running the jobs in sequence anyway due to exclusive locks… Any informed answers will be appreciated.

3 2

What to backup?
by Alain Kohli 28 May '19

28 May '19

Hi What exactly are we supposed to include in our mailman backups? Obviously the database, but are there any other files that should be included to make sure we can properly restore? Regards, Alain

2 8

Hyperkitty CPU usage
by Alain Kohli 24 May '19

24 May '19

Hi I have hyperkitty running and noticed that the process 'python manage.py runjobs minutely' is running for over 70h now and is constantly using 100% of a CPU core. That can hardly be intended, but I don't know why it's doing that. As far as I could see, this job mainly updates the search index. Running 'python manage.py rebuild_index' only takes about an hour, though, so I don't see why this would take so much longer. The text search is not working in the first place, so that might be connected as well. I'm currently running the v1.2.2. Regards, Alain

3 9

Changing Mailman's "from" domain - redux
by roger＠reasonal.com 23 May '19

23 May '19

(this is a posting directly into this web ui as mails to this list just vanish without a trace) -- Anyone? Anyone? With reference to the original mail here https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… It seems that the "From" domain field is set by Postorius, but I can't find anything in its documentation on how to change it. I've done obvious things like change the boxes hostname to what I want, have fiddled around in the various Postfix settings for mydomain, etc etc. But all admin messages, listserver replies etc come from the partial domain "blah.blah", not "listman.blah.blah". Any ideas welcome.

2 1

Changing Mailman's "from" domain
by Roger Hislop (IS) 23 May '19

23 May '19

Hi guys -- I'm a little baffled here... I'd got my Mailman instance running, then went on leave, and then tried to use it. No dice. If I subscribed an address, no confirmation email would come through. Checked the Postfix log and see this: Roger Hislop (IS) Executive Head - IOT T +27 11 5751600 M+27 78 4595952 May 16 14:34:50 ip-172-31-23-250 postfix/smtp[5025]: 15B87A35FB: to=<iotic-za(a)reasondigital.co.za>, relay=email-smtp.eu-west-1.amazonaws.com[52.51.155.83]:587, delay=0.22, delays=0.01/0.02/0.1/0.1, dsn=5.0.0, status=bounced (host email-smtp.eu-west-1.amazonaws.com[52.51.155.83] said: 554 Message rejected: Email address is not verified. The following identities failed the check in region EU-WEST-1: test-list-request(a)iotcouncil.org.za, test-list-bounces(a)iotcouncil.org.za (in reply to end of DATA command)) I've verified the domain listman.iotcouncil.org.za, so it would seem the obvious solution is to change the domain the mails come from. It appeared that I just change the postfix config to specify domain list so: # INTERNET HOST AND DOMAIN NAMES # # The myhostname parameter specifies the internet hostname of this # mail system. The default is to use the fully-qualified domain name # from gethostname(). $myhostname is used as a default value for many # other configuration parameters. # myhostname = listman.iotcouncil.org.za <<< HERE #myhostname = virtual.domain.tld # The mydomain parameter specifies the local internet domain name. # The default is to use $myhostname minus the first component. # $mydomain is used as a default value for many other configuration # parameters. # mydomain = listman.iotcouncil.org.za <<< and HERE # SENDING MAIL # # The myorigin parameter specifies the domain that locally-posted # mail appears to come from. The default is to append $myhostname, # which is fine for small sites. If you run a domain with multiple # machines, you should (1) change this to $mydomain and (2) set up # a domain-wide alias database that aliases each user to # user(a)that.users.mailhost. # # For the sake of consistency between sender and recipient addresses, # myorigin also specifies the default domain name that is appended # to recipient addresses that have no @domain part. # myorigin = listman.iotcouncil.org.za <<< and HERE #myorigin = $mydomain But when I look in the log: May 16 15:13:05 ip-172-31-23-250 postfix/qmgr[5700]: D58F9A35FB: from=<test-list-bounces(a)iotcouncil.org.za>, size=1224, nrcpt=1 (queue active) May 16 15:13:05 ip-172-31-23-250 postfix/smtpd[5710]: disconnect from ip-172-19-199-2.eu-west-1.compute.internal[172.19.199.2] May 16 15:13:06 ip-172-31-23-250 postfix/smtp[5713]: D58F9A35FB: to=<iotic-za(a)reasondigital.co.za>, relay=email-smtp.eu-west-1.amazonaws.com[52.51.155.83]:587, delay=0.25, delays=0.01/0.03/0.1/0.12, dsn=5.0.0, status=bounced (host email-smtp.eu-west-1.amazonaws.com[52.51.155.83] said: 554 Message rejected: Email address is not verified. The following identities failed the check in region EU-WEST-1: test-list-request(a)iotcouncil.org.za, test-list-bounces(a)iotcouncil.org.za (in reply to end of DATA command)) But the "from" is not changing. I see that messages TO the mailman server are also not being delivered ("-- 5.1.1 Requested action not taken: mailbox unavailable"). So there's another problem. Should I just verify iotcouncil.org.za and add DKIM to its MX record? Seems like a fail...

2 1

Upgrade
by David Krantz 23 May '19

23 May '19

Hi all, I am running a relatively old version of mailman 3, namely 3.2.0a1 from late september 2017. This is installed using the old mailman-bundler method. I use postfix and postgres. I really have two questions: First: What is the normal way to upgrade such a setup? I guess that I just can get the updated versions of all packages through git, set up new venv's to simplify a rollback, back up the database and then just restarting with the new version hoping for the best. Second: Another way would be to set up a new virtual server and reinstall everything and then just switching IPs on the servers. Then: what is the preferred way to install mailman3 today, docker only? I will also have to move all config and data to the new server, this should be mainly about restoring a database backup and copying relevant config, is there anything I miss here? cheers // David

2 1

How to remove global ban using API?
by Nathan Dixon 22 May '19

22 May '19

I am using a global ban to stop anyone not in a list of valid domains from being able to subscribe to any of our lists. This ban needs to be maintained using the Mailman3 api as it is being fed from another source. I can create the ban fine by the following: from mailmanclient import Client client = Client(URI,apiuser,apipass) client.bans.add("^(?!.*[(a)\.](validdomain1\.com|validdomain2\.org|validdomain3\.co\.uk)") However, I cannot seem to be able to remove it using the api: >>> client.bans[0].delete() Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 137, in delete self._connection.call(self._url, method='DELETE') File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 99, in call raise HTTPError(url, response.status, content, response, None) urllib.error.HTTPError: HTTP Error 404: b'' Or >>> client.bans.remove(str(client.bans[0])) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restobjects/ban.py", line 83, in remove ban.delete() File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 137, in delete self._connection.call(self._url, method='DELETE') File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 99, in call raise HTTPError(url, response.status, content, response, None) urllib.error.HTTPError: HTTP Error 404: b'' Or >>> client.bans.remove("^(?!.*[(a)\.](validdomain1\.com|validdomain2\.org|validdomain3\.co\.uk))") Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restobjects/ban.py", line 83, in remove ban.delete() File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 137, in delete self._connection.call(self._url, method='DELETE') File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 99, in call raise HTTPError(url, response.status, content, response, None) urllib.error.HTTPError: HTTP Error 404: b'' And also, when I now try and go into the mailman-core docker image to use the mailman.interfaces.bans, it will not let me see the global bans: >>> from mailman.interfaces.bans import IBanManager >>> global_bans = IBanManager(None) Traceback (most recent call last): File "<stdin>", line 1, in <module> TypeError: ('Could not adapt', None, <InterfaceClass mailman.interfaces.bans.IBanManager>) I have opened an issue in Gitlab for this as I feel it may be a bug related to regex and global bans (there was a similar one for list banned addresses): https://gitlab.com/mailman/mailman/issues/598 Many thanks for your time, -- *Nathan Dixon* MEng Senior Software Architect m: +44 (0)7402 690311 t: +44 (0)20 81231252 e: nathan.dixon(a)evadon.com w: www.evadon.com This e-mail and any attachments are confidential and may be protected by legal, professional or other privilege. If you are not the intended recipient you should not store it, copy it, re-transmit it, use it or disclose its contents, but should return it to the sender immediately and delete your copy from your system. The views expressed are those of the sender and not necessarily those of Evadon. Please note that whilst we scan all e-mails for viruses we cannot guarantee that any e-mail is virus-free. Please be advised that we expressly reserve the right to monitor email content for the purposes of ensuring compliance with legal requirements and company policies and your sending to, or receiving from, us of any email constitutes your agreement to these terms. Evadon Dynamics Limited, registered in England No. 09494097. Registered Office: Electric Works, Sheffield Digital Campus, 3 Concourse Way, Sheffield, S1 2BJ

2 2

Uncaught runner exception with out runner process
by Alan So 18 May '19

18 May '19

The out runner process shutdown with the following error. Any clue? May 16 17:32:12 2019 (31602) Uncaught runner exception: (pymysql.err.InternalError) (1053, 'Server shutdown in progress') [SQL: 'SELECT anon_1.member_id AS anon_1_member_id, anon_1.member__member_id AS anon_1_member__member_id, anon_1.member_role AS anon_1_member_role, anon_1.member_list_id AS anon_1_member_list_id, anon_1.member_moderation_action AS anon_1_member_moderation_action, anon_1.member_address_id AS anon_1_member_address_id, anon_1.member_preferences_id AS anon_1_member_preferences_id, anon_1.member_user_id AS anon_1_member_user_id \nFROM (SELECT member.id AS member_id, member._member_id AS member__member_id, member.`role` AS member_role, member.list_id AS member_list_id, member.moderation_action AS member_moderation_action, member.address_id AS member_address_id, member.preferences_id AS member_preferences_id, member.user_id AS member_user_id \nFROM member, address \nWHERE member.list_id = %(list_id_1)s AND member.`role` = %(role_1)s AND address.email = %(email_1)s AND member.address_id = address.id UNION SELECT member.id AS member_id, member._member_id AS member__member_id, member.`role` AS member_role, member.list_id AS member_list_id, member.moderation_action AS member_moderation_action, member.address_id AS member_address_id, member.preferences_id AS member_preferences_id, member.user_id AS member_user_id \nFROM member, address, user \nWHERE member.list_id = %(list_id_2)s AND member.`role` = %(role_2)s AND address.email = %(email_2)s AND member.user_id = user.id AND user._preferred_address_id = address.id) AS anon_1'] [parameters: {'list_id_1': 'listname.list.company.domain', 'role_1': 1, 'email_1': 'usera(a)company.domain', 'list_id_2': 'listname.list.company.domain', 'role_2': 1, 'email_2': 'usera(a)company.domain'}] (Background on this error at: http://sqlalche.me/e/2j85) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 173, in _one_iteration File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 266, in _process_one_file File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose

2 1

installation choices for mm3
by John Griessen 17 May '19

17 May '19

I've been reading https://wiki.list.org/DOC/Mailman%203%20installation%20experience and see that a virtual is recommended, which is not something I have done yet, and wonder if just putting the mm3 on a different server is easier? I have a server, mail1.cibolo.us that has postfix, postgresql, dovecot, mm2, nsd on it. Another server has just web pages and nsd doing backup DNS for mail1.cibolo.us DNS server. I could do a straight debian install of mailman3-full on the 2nd server and keep it simple, let debian setup a blank database installation, right? Has anyone seen a good write up on how to do that on a debian server step by step?

2 2

Any known limit of number of lists that one can be owner/member of?
by Alan So 15 May '19

15 May '19

We have just migrated hundreds of lists from Mailman 2 to Mailman 3. It was smooth in most of the cases. However, we just notice that there are some abnormal behaviour of Postorius for particular users who are owner/member of a large number of lists. We further look into a particular user who is owner of 84 lists. When the user login Postorius, only 50 lists are displayed no matter what the number of "Results per page" is chosen. Prev/Next page cannot be clicked as there is only 1 page. When I use the following mailman client snippet, it also displays the same 50 lists: lists = client.find_lists('xxx(a)yyy.com', 'owner') for m_list in lists: print(m_list.fqdn_listname) Did we hit any limit of find_lists? Is it a bug or are something wrong during the migration? When the user use "Mailman settings", the page can still display all lists though (it's slow as it probably did a lot of SQL queries!).

2 7

Re: Archive Policy not reflecting in Hyperkitty
by Abhilash Raj 14 May '19

14 May '19

Are you using images with "rolling" tags? If yes, you should try to switch to "0.2" tag and the new release will be tagged with the same one. To update, you can do: $ docker pull ... $ docker pull .. $ docker-compose stop $ docker-compose rm $ docker-compose up -d This should basically get you up and running with the new image you pulled. -- thanks, Abhilash Raj (maxking)

2 2

Archive Policy not reflecting in Hyperkitty
by Nathan Dixon 07 May '19

07 May '19

So the issue I am seeing is that when I set a lists archive policy to prviate, it isn't reflecting that in Hyperkitty. I am running the docker installation of Mailman, postorius and hyperkitty. So I go into the docker instance of mailman-core and run this: python3 manage.py shell from hyperkitty.models.mailinglist import MailingList MailingList.objects.all().values_list('name', 'archive_policy') And all my lists are showing '2', regardless of how I set the mailing list archive policy. This might be a duplicate of https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… Am I missing something in my install? Or is this a bug? Many thanks for your attention, -- *Nathan Dixon* MEng Senior Software Architect m: +44 (0)7402 690311 t: +44 (0)20 81231252 e: nathan.dixon(a)evadon.com w: www.evadon.com This e-mail and any attachments are confidential and may be protected by legal, professional or other privilege. If you are not the intended recipient you should not store it, copy it, re-transmit it, use it or disclose its contents, but should return it to the sender immediately and delete your copy from your system. The views expressed are those of the sender and not necessarily those of Evadon. Please note that whilst we scan all e-mails for viruses we cannot guarantee that any e-mail is virus-free. Please be advised that we expressly reserve the right to monitor email content for the purposes of ensuring compliance with legal requirements and company policies and your sending to, or receiving from, us of any email constitutes your agreement to these terms. Evadon Dynamics Limited, registered in England No. 09494097. Registered Office: Electric Works, Sheffield Digital Campus, 3 Concourse Way, Sheffield, S1 2BJ

3 5

Moderate mails from owner
by Henrik Rasmussen 07 May '19

07 May '19

I assume this is by design, but is it correct that a list owner, who are not member, will always be allowed to post to the list, even though "Default action to take when a member posts to the list" and "Default action to take when a non-member posts to thelist" are both set to "Hold for moderation"? The owner is set as also moderator, by the way, which seems redundant. I have a list administrator who would like to be moderated when sending to the list, but there is no Member Options on Owners (nor Moderators). A workaround may be to create a new account for the owner and let the current owner be member instead of owner, as she will then be moderated. /Henrik Rasmussen

4 16

Creating and placing custom templates
by kelly.close＠lrewater.com 02 May '19

02 May '19

I know there are previous threads related to this topic but none were very recent so I thought I'd start a new one. I've referenced two of the old ones below. I am attempting to implement a custom footer on one of my lists. This seems like it should be straightforward but I'm clearly doing something wrong, since the default footer keeps coming through despite my efforts. I've referenced the docs as well as these two posts, to no avail. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… Here's what I'm doing: I found my templates folder and verified it matched what is set in the mailman.cfg file - on my Ubuntu Bionic system it is /var/lib/mailman3/templates/ In that folder I created the following folders and made sure they were properly owned (by list:list) /var/lib/mailman3/templates/lists/f2p2-test.udfcd-lists.org/en/ Into that en/ folder I placed a file called "list:member:regular:footer" It is a text file with just one line of text in it (a link to a website). Also, because there was a mention in one of the earlier posts that this file should have a .txt extension, I also put the same file in there named "list:member:regular:footer.txt". I have two of my own emails subscribed t my "f2p2-test" list at the domain udfcd-lists.org. When I post to the list, and check my other email for the disseminated post, it still has the default footer. I have restarted the mailman3 service. Can anyone spot an obvious error here or offer troubleshooting suggestions? Thank You! ~Kelly

2 1

We're in Season of Docs!
by Stephen J. Turnbull 01 May '19

01 May '19

So, we're in Season of Docs! Currently, Abhilash and I are registered as mentor/admins. I don't think we need more admins, but more mentors is always a good thing. Hey, users! You don't need to be a programmer to mentor docs, of course, and it may be a *good* thing to *not* be a programmer and even *not* a Mailman developer. :-) Suggestions as to doc projects we *really oughtta do!* are very welcome. (I can't believe we got in with the thin doc proposal I put together literally at the last minute, but here we are. ;-) Feel free to get in touch with us on mailman-developers (reply-to set; please respect) if you're interested in mentoring. Or if you prefer you can contact me or Abhilash directly. We can presumably add mentors up to July 23 (deadline for technical writer selection by orgs). For more information: https://wiki.list.org/DEV/SeasonOfDocs2019 https://developers.google.com/season-of-docs/ https://developers.google.com/season-of-docs/docs/participants/ https://developers.google.com/season-of-docs/docs/timeline Regards, Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

1 0

GDPR - save subscriptions confirmation emails
by contact＠maadix.net 01 May '19

01 May '19

Hi, I am new in the list. I have been looking for this topic in the archives in order to avoid duplicate, but I could not find any thread. According to the new GDPR rules, lists owners need to have a confirmation from subscribers, and this is easy to do with Mailman 3. What I can't figure out is how to save all the confirmation emails received from users. I only see the confirmations commands emails in the logs, Is there another place/way to store them? For GDPR compliance it is important to be able to demonstrate that you received the confirmation, in case you may need it in the future. Bests Maddish -- *MaadiX* Tu nube en tus manos https://maadix.net https://twitter.com/MaadiXnet

3 4

HTML email sent to lists migrated from Mailman 2.1
by Nate Coraor 16 Apr '19

16 Apr '19

Hello all, I have some lists migrated from 2.1 that are stripping the HTML parts (perhaps all attachments?) from messages despite the options to do so not being enabled and lynx not even being installed. I'm trying to get a new list to behave the same way so I can figure out what's going on without spamming a production list, but have been unsuccessful: despite setting nearly all the list options the same as the old lists, new lists pass HTML portions and attachments just fine. I've verified the settings using mailing list objects directly with `mailman withlist` on the command line and the only differences are things that I can't imagine would be related like admin_notify_mchanges, advertised, and archive_policy. Are there are really old options that can't be accessed via mailing list objects obtained with `withlist` on the command line? Thanks, --nate

3 3

Mailman in EC2 / Docker -- working but HTTPS not serving static content
by roger.hislop＠is.co.za 15 Apr '19

15 Apr '19

Hi again ... I got everything working thanks to Danil, Abhilash, and finally found a simple NGINX conf that worked, using WSGI. Cool. Set up certificates using LetsEncrypt, used another conf to set up SSL, like the conf pasted below. I edited nginx.conf so that it only takes server config from the nginx/conf.d/blahblah.conf below. This works for HTTP, HTTPS works but it (apparently) is not serving static content. There are loads of how-tos to get this to work, but I've failed in all -- it seems to be the static path (I've not tried option using thttpd I've not tried as there is no easy install onto AQWS AMI and it seems like it's not specifically necessary. I'm so close... so close... ------------------------------- server { listen 80 default_server; # listen [::]:80 default_server ipv6only=on; root /usr/share/nginx/html; index index.html index.htm; server_name listman.iotcouncil.org.za; return 301 https://$server_name$request_uri; #<< AUTO_REDIRECT HTTP TO HTTPS # location / { # proxy_pass http://172.19.199.3:8000/; # proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; # proxy_set_header X-Forwarded-Host $host; # proxy_set_header X-Forwarded-Server $host; # proxy_set_header X-Forwarded-Proto $scheme; # proxy_redirect off; # } # # location /static/ { # alias /var/spool/mailman-web/static/; # } # # location /robots.txt { # alias /var/spool/mailman-web/static/hyperkitty/robots.txt; # } # # location /favicon.ico { # alias /var/www/listorg/images/favicon.ico; # } # } server { listen 443 default_server; # listen [::]:443 default_server ipv6only=on; #root /usr/share/nginx/html; #index index.html index.htm; server_name listman.iotcouncil.org.za; ssl on; ssl_certificate /etc/letsencrypt/live/listman.iotcouncil.org.za/fullchain.pem; ssl_certificate_key /etc/letsencrypt/live/listman.iotcouncil.org.za/privkey.pem; ssl_session_timeout 5m; ssl_protocols SSLv3 TLSv1 TLSv1.1 TLSv1.2; ssl_ciphers "HIGH:!aNULL:!MD5 or HIGH:!aNULL:!MD5:!3DES"; ssl_prefer_server_ciphers on; location / { proxy_pass http://172.19.199.3:8000/; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host; proxy_set_header X-Forwarded-Proto $scheme; proxy_redirect off; } location /static/ { alias /opt/mailman/web/static; } location /robots.txt { alias /var/spool/mailman-web/static/hyperkitty/robots.txt; } location /favicon.ico { alias /var/www/listorg/images/favicon.ico; } }

4 3

Mailman Core 3.2.2 is now out
by Abhilash Raj 14 Apr '19

14 Apr '19

Hello Everyone, Mailman Core 3.2.2 is released and available on PyPI[1]. This is a regular bugfix release and I had to do that to fix a version constraint which pulled in a pre-release of a dependency (falcon) when installed via pip and caused the default install to break. There are few other changes included in this release, including a big refactor of error reporting in Core's REST API. All the error responses are now correctly formatted as JSON with more information about the error. For example, invalid inputs for Enum data types return the valid options. Other error message are now generated from the input validtor and will be more informative. REST API also accepts input as JSON formatted body, alongside the x-www-form-urlencoded. A full list of changes are available here: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#id1 This release supports Python 3.5-3.7. Thanks very much to all the contributors involved in this release. [1]: https://pypi.org/project/mailman/ -- thanks, Abhilash Raj (maxking)

2 3

List options question
by Phil Stracchino 13 Apr '19

13 Apr '19

So, I've just sucscribed to this list, and when I go to set subscription options, I find: Receive list copies (possible duplicates) Yes No When you are listed explicitly in the To: or Cc: headers of a list message, you can opt to not receive another copy from the mailing list. Select No to receive copies. Select Yes to avoid receiving copies from the mailing list. This seems rather ... backwards. "Receive copies? Answer no for yes, yes for no." Is that how the option actually works in mailman3, or is the text of the option decription garbled? -- Phil Stracchino Babylon Communications phils(a)caerllewys.net phil(a)co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958

2 1

Mailman3 in dockers on EC2 - running out of memory and puking ev.ry.where.
by roger.hislop＠is.co.za 11 Apr '19

11 Apr '19

Hi all -- really need some help. I'm tech literate, but definitely not a sysadmin or dev. I'm following the tutorial at "Olay's Farmland" at https://www.olay.xyz/2018/01/01/deploy-mailman-3-on-aws-using-docker/ which seems to be a clone of the same content here https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ Easy enough to get most of the way ... set up EC2 instance, configure SES and add DNS settings with DKIM etc. Set up Postfix, test it. All working groovy. I run through the how to all the way through setting up the containers and firing it up. This is where things start to get funky. Once the docker-compose is run, I run "curl http://172.19.199.3:8000/postorius/lists/" to test. First time it said it couldn't connect to database. So I nuked and restarted from scratch. Second time it said the same thing... was reading around the place and tried again, and then reran that curl and it worked -- gave me html from a page. But the VM started running slowly --taking forever to follow keypresses. Eventually became unresponsive. So I rebooted the machine via AWS console, and docker ps showed only the postgres db running. docker-compose ps shows Name Command State Ports ------------------------------------------------------------------------------------------ docker-mailman_database_1 docker-entrypoint.sh postgres Up 5432/tcp mailman-core docker-entrypoint.sh maste ... Exit 255 8001/tcp, 8024/tcp mailman-web docker-entrypoint.sh uwsgi ... Exit 255 8000/tcp, 8080/tcp So rebuilt the container -- same thing. It looks and feels like its running out of memory. I used the compose file from https://gist.githubusercontent.com/Yexiaoxing/833bfcc5d3e4e0c06a8b7f0bac7c4… (with appropriate edits). I have no idea how to proceed from here... Go to logs... Partial log (they're LONG) docker logs docker-mailman_database_1 The files belonging to this database system will be owned by user "postgres". This user must also own the server process. The database cluster will be initialized with locale "en_US.utf8". The default database encoding has accordingly been set to "UTF8". The default text search configuration will be set to "english". Data page checksums are disabled. fixing permissions on existing directory /var/lib/postgresql/data ... ok creating subdirectories ... ok selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting dynamic shared memory implementation ... posix creating configuration files ... ok running bootstrap script ... ok sh: locale: not found performing post-bootstrap initialization ... No usable system locales were found. Use the option "--debug" to see details. ok syncing data to disk ... ok WARNING: enabling "trust" authentication for local connections You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. Success. You can now start the database server using: pg_ctl -D /var/lib/postgresql/data -l logfile start waiting for server to start....LOG: database system was shut down at 2019-04-09 14:37:48 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started done server started CREATE DATABASE /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/* LOG: received fast shutdown request LOG: aborting any active transactions LOG: autovacuum launcher shutting down LOG: shutting down waiting for server to shut down....LOG: database system is shut down done server stopped PostgreSQL init process complete; ready for start up. LOG: database system was shut down at 2019-04-09 14:37:50 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: relation "social_auth_usersocialauth" does not exist at character 15 STATEMENT: SELECT 1 from social_auth_usersocialauth LOG: database system was interrupted; last known up at 2019-04-09 14:48:37 UTC LOG: database system was not properly shut down; automatic recovery in progress LOG: invalid record length at 0/1767BB8: wanted 24, got 0 LOG: redo is not required LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started LOG: received smart shutdown request LOG: autovacuum launcher shutting down LOG: shutting down LOG: database system is shut down LOG: database system was shut down at 2019-04-09 15:18:06 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: duplicate key value violates unique constraint "auth_user_username_key" DETAIL: Key (username)=(lists) already exists. STATEMENT: INSERT INTO "auth_user" ("password", "last_login", "is_superuser", "username", "first_name", "last_name", "email", "is_staff", "is_active", "date_joined") VALUES ('!lS8pgTTV7CyhUbZItku00ZnUGxLQkVEuc3ENZKbV', NULL, true, 'lists', '', '', 'iotic-za(a)reasondigital.co.za', true, true, '2019-04-09T15:39:57.715036+00:00'::timestamptz) RETURNING "auth_user"."id" TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (3 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (12 chunks); 179176 used ERROR: out of memory DETAIL: Failed on request of size 4032. CONTEXT: writing block 0 of relation base/16384/16797 TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (2 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used LOG: could not fork autovacuum worker process: Out of memory MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used LOG: could not fork autovacuum worker process: Out of memory Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (11 chunks); 179176 used LOG: could not fork autovacuum worker process: Out of memory ERROR: out of memory DETAIL: Failed on request of size 4032. CONTEXT: writing block 0 of relation base/16384/16797 LOG: could not fork autovacuum worker process: Out of memory WARNING: could not write block 0 of base/16384/16797 DETAIL: Multiple failures --- write error might be permanent. TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (2 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used TopMemoryContext: 51040 total in 4 blocks; 1344 free (1 chunks); 49696 used TopTransactionContext: 8192 total in 1 blocks; 6968 free (0 chunks); 1224 used Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used Statistics snapshot: 0 total in 0 blocks; 0 free (0 chunks); 0 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (11 chunks); 179176 used Per-database function: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database table: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database function: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database table: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Databases hash: 24576 total in 2 blocks; 15072 free (5 chunks); 9504 used ERROR: out of memory For UWSGI cat uwsgi.log [pid: 49|app: 0|req: 1/1] 172.19.199.1 () {24 vars in 291 bytes} [Tue Apr 9 14:43:43 2019] GET /postorius/lists/ => generated 3710 bytes in 705 msecs (HTTP/1.1 200) 5 headers in 163 bytes (1 switches on core 0) [pid: 39|app: 0|req: 1/1] 172.19.199.1 () {24 vars in 291 bytes} [Tue Apr 9 15:40:12 2019] GET /postorius/lists/ => generated 3710 bytes in 694 msecs (HTTP/1.1 200) 5 headers in 163 bytes (1 switches on core 0) [ec2-user@ip-172-31-23-250 logs]$ cat uwsgi-error.log cat: uwsgi-error.log: Permission denied [ec2-user@ip-172-31-23-250 logs]$ sudo cat uwsgi-error.log *** Starting uWSGI 2.0.15 (64bit) on [Tue Apr 9 14:38:03 2019] *** compiled with version: 6.3.0 on 29 December 2017 00:16:31 os: Linux-4.14.77-70.59.amzn1.x86_64 #1 SMP Mon Nov 12 22:02:45 UTC 2018 nodename: mailman-web machine: x86_64 clock source: unix detected number of CPU cores: 1 current working directory: /opt/mailman-web detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! setgid() to 101 setuid() to 100 chdir() to /opt/mailman-web your processes number limit is 3860 your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address 0.0.0.0:8080 fd 8 uwsgi socket 1 bound to TCP address 0.0.0.0:8000 fd 9 Python version: 2.7.14 (default, Dec 19 2017, 17:52:21) [GCC 6.3.0] Python main interpreter initialized at 0x55ca1d90e1e0 python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds [uwsgi-cron] command "./manage.py runjobs minutely" registered as cron task [uwsgi-cron] command "./manage.py runjobs quarter_hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs daily" registered as cron task [uwsgi-cron] command "./manage.py runjobs monthly" registered as cron task [uwsgi-cron] command "./manage.py runjobs weekly" registered as cron task [uwsgi-cron] command "./manage.py runjobs yearly" registered as cron task mapped 166144 bytes (162 KB) for 2 cores *** Operational MODE: threaded *** WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x55ca1d90e1e0 pid: 1 (default app) *** uWSGI is running in multiple interpreter mode *** spawned uWSGI master process (pid: 1) spawned uWSGI worker 1 (pid: 49, cores: 2) Tue Apr 9 14:38:04 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 51) [uwsgi-daemons] spawning "./manage.py qcluster" (uid: 100 gid: 101) 14:38:07 [Q] INFO Q Cluster-52 starting. 14:38:07 [Q] INFO Process-1 guarding cluster at 67 14:38:07 [Q] INFO Process-1:1 ready for work at 68 14:38:07 [Q] INFO Process-1:3 pushing tasks at 70 14:38:07 [Q] INFO Q Cluster-52 running. 14:38:07 [Q] INFO Process-1:2 monitoring at 69 [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 51 exited after 4 second(s) Tue Apr 9 14:39:04 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 71) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 71 exited after 269 second(s) Tue Apr 9 14:43:33 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 79) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 79 exited after 3 second(s) Tue Apr 9 14:51:35 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 89) *** Starting uWSGI 2.0.15 (64bit) on [Tue Apr 9 15:39:58 2019] *** compiled with version: 6.3.0 on 29 December 2017 00:16:31 os: Linux-4.14.109-80.92.amzn1.x86_64 #1 SMP Mon Apr 1 23:07:39 UTC 2019 nodename: mailman-web machine: x86_64 clock source: unix detected number of CPU cores: 1 current working directory: /opt/mailman-web detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! setgid() to 101 setuid() to 100 chdir() to /opt/mailman-web your processes number limit is 3860 your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address 0.0.0.0:8080 fd 8 uwsgi socket 1 bound to TCP address 0.0.0.0:8000 fd 9 Python version: 2.7.14 (default, Dec 19 2017, 17:52:21) [GCC 6.3.0] Python main interpreter initialized at 0x562e2c0b11e0 python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds [uwsgi-cron] command "./manage.py runjobs minutely" registered as cron task [uwsgi-cron] command "./manage.py runjobs quarter_hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs daily" registered as cron task [uwsgi-cron] command "./manage.py runjobs monthly" registered as cron task [uwsgi-cron] command "./manage.py runjobs weekly" registered as cron task [uwsgi-cron] command "./manage.py runjobs yearly" registered as cron task mapped 166144 bytes (162 KB) for 2 cores *** Operational MODE: threaded *** WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x562e2c0b11e0 pid: 1 (default app) *** uWSGI is running in multiple interpreter mode *** spawned uWSGI master process (pid: 1) spawned uWSGI worker 1 (pid: 39, cores: 2) Tue Apr 9 15:39:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 41) [uwsgi-daemons] spawning "./manage.py qcluster" (uid: 100 gid: 101) 15:40:02 [Q] INFO Q Cluster-43 starting. 15:40:02 [Q] INFO Process-1:1 ready for work at 58 15:40:02 [Q] INFO Process-1:2 monitoring at 59 15:40:02 [Q] INFO Process-1 guarding cluster at 57 15:40:02 [Q] INFO Process-1:3 pushing tasks at 60 15:40:02 [Q] INFO Q Cluster-43 running. [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 41 exited after 4 second(s) Tue Apr 9 15:40:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 63) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 63 exited after 13 second(s) Tue Apr 9 15:41:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 71) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 71 exited after 33 second(s) Tue Apr 9 15:42:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 79) 16:33:36 [Q] ERROR could not translate host name "database" to address: Try again 16:35:17 [Q] INFO Process-1:3 stopped pushing tasks 16:35:25 [Q] ERROR reincarnated pusher Process-1:3 after sudden death 16:35:25 [Q] INFO Process-1:4 pushing tasks at 87 [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 79 exited after 3146 second(s) Tue Apr 9 16:35:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 88) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 88 exited after 3 second(s) Tue Apr 9 16:36:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 96) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 96 exited after 3 second(s) Tue Apr 9 16:37:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 104) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 104 exited after 3 second(s) Tue Apr 9 16:38:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 112) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 112 exited after 3 second(s) Tue Apr 9 16:39:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 120) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 120 exited after 3 second(s) Tue Apr 9 16:40:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 128) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 128 exited after 3 second(s) Tue Apr 9 16:41:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 136) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 136 exited after 3 second(s) Tue Apr 9 16:42:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 144) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 144 exited after 3 second(s) Tue Apr 9 16:43:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 152) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 152 exited after 3 second(s) Tue Apr 9 16:44:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 160) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 160 exited after 3 second(s) Tue Apr 9 16:45:00 2019 - [uwsgi-cron] running "./manage.py runjobs quarter_hourly" (pid 168) [uwsgi-cron] command "./manage.py runjobs quarter_hourly" running with pid 168 exited after 2 second(s) Tue Apr 9 16:45:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 176) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 176 exited after 3 second(s) Tue Apr 9 16:46:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 184) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 184 exited after 2 second(s) Tue Apr 9 16:47:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 192) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 192 exited after 3 second(s) Tue Apr 9 16:48:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 200) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 200 exited after 3 second(s) Tue Apr 9 16:49:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 208) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 208 exited after 3 second(s) Tue Apr 9 16:50:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 216) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 216 exited after 3 second(s) Tue Apr 9 16:51:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 224) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 224 exited after 3 second(s) Tue Apr 9 16:52:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 232) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 232 exited after 3 second(s) Tue Apr 9 16:53:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 240) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 240 exited after 2 second(s) Tue Apr 9 16:54:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 248) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 248 exited after 2 second(s) Tue Apr 9 16:55:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 256) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 256 exited after 3 second(s) Tue Apr 9 16:56:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 264) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 264 exited after 3 second(s) Tue Apr 9 16:57:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 272) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 272 exited after 3 second(s) Tue Apr 9 16:58:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 280) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 280 exited after 3 second(s) Tue Apr 9 16:59:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 288) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 288 exited after 3 second(s) Tue Apr 9 17:00:00 2019 - [uwsgi-cron] running "./manage.py runjobs quarter_hourly" (pid 296) Tue Apr 9 17:00:00 2019 - [uwsgi-cron] running "./manage.py runjobs hourly" (pid 297) Traceback (most recent call last): File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 363, in execute_from_command_line Traceback (most recent call last): File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 363, in execute_from_command_line File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 337, in execute utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 337, in execute django.setup() django.setup() File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup apps.populate(settings.INSTALLED_APPS) apps.populate(settings.INSTALLED_APPS) File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate app_config.import_models() app_config.import_models() File "/usr/local/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models File "/usr/local/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models self.models_module = import_module(models_module_name) self.models_module = import_module(models_module_name) File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) __import__(name) File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/__init__.py", line 28, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/__init__.py", line 28, in <module> from .email import Email, Attachment from .email import Email, Attachment File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/email.py", line 37, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/email.py", line 37, in <module> from hyperkitty.lib.analysis import compute_thread_order_and_depth from hyperkitty.lib.analysis import compute_thread_order_and_depth File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/analysis.py", line 28, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/analysis.py", line 28, in <module> import networkx as nx import networkx as nx File "/usr/local/lib/python2.7/site-packages/networkx/__init__.py", line 114, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/__init__.py", line 114, in <module> import networkx.generators import networkx.generators File "/usr/local/lib/python2.7/site-packages/networkx/generators/__init__.py", line 6, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/generators/__init__.py", line 6, in <module> from networkx.generators.classic import * from networkx.generators.classic import * File "/usr/local/lib/python2.7/site-packages/networkx/generators/classic.py", line 26, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/generators/classic.py", line 26, in <module> from networkx.algorithms.bipartite.generators import complete_bipartite_graph from networkx.algorithms.bipartite.generators import complete_bipartite_graph File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/__init__.py", line 57, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/__init__.py", line 57, in <module> import networkx.algorithms.connectivity import networkx.algorithms.connectivity File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/__init__.py", line 3, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/__init__.py", line 3, in <module> from .connectivity import * from .connectivity import * File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/connectivity.py", line 13, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/connectivity.py", line 13, in <module> from networkx.algorithms.flow import boykov_kolmogorov from networkx.algorithms.flow import boykov_kolmogorov File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/flow/__init__.py", line 1, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/flow/__init__.py", line 1, in <module> from .maxflow import * from .maxflow import * MemoryErrorMemoryError 18:16:37 [Q] ERROR could not translate host name "database" to address: Try again ...etc ... For Mailman cat mailmanweb.log ERROR 2019-04-09 20:05:48,878 934 hyperkitty.lib.utils Failed to update the fulltext index: could not translate host name "database" to address: Try again Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/utils.py", line 186, in run_with_lock fn(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/search_indexes.py", line 87, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 240, in update_backend total = qs.count() File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 363, in count return self.query.get_count(using=self.db) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 498, in get_count number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 479, in get_aggregation result = compiler.execute_sql(SINGLE) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 874, in execute_sql cursor = self.connection.cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor return self._cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor self.ensure_connection() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect self.connection = self.get_new_connection(conn_params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py", line 176, in get_new_connection connection = Database.connect(**conn_params) File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) OperationalError: could not translate host name "database" to address: Try again ERROR 2019-04-09 20:15:08,192 983 hyperkitty.lib.utils Failed to update the fulltext index: could not translate host name "database" to address: Try again Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/utils.py", line 186, in run_with_lock fn(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/search_indexes.py", line 87, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 240, in update_backend total = qs.count() File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 363, in count return self.query.get_count(using=self.db) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 498, in get_count number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 479, in get_aggregation result = compiler.execute_sql(SINGLE) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 874, in execute_sql cursor = self.connection.cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor return self._cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor self.ensure_connection() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect self.connection = self.get_new_connection(conn_params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py", line 176, in get_new_connection connection = Database.connect(**conn_params) File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) OperationalError: could not translate host name "database" to address: Try again

3 3

Simplified installation instructions
by Frank Yappa 08 Apr '19

08 Apr '19

I've looked at installing Mailman3 many times but have never succeeded - there simply too many instructions. Is there a simple guide to get just web front end to Mailman3 where you can import an existing mailing list simply for viewing? Which is the easiest system to install Mailman3 on? I have a Debian system and would be grateful for any pointers showing how to install it . I came across:- https://iomarmochtar.wordpress.com/2017/07/21/mailman3-easy-installation/ but this is for Centos and I don't know what to change. Elsewhere I came across a list of apps which needed to be installed on Debian but that didn't work because of missing packages. apt-get install python3-setuptools python3-virtualenv python3-dev git gcc node-less nodejs postfix python3-tox

2 1

easy way to delete old mails in hyperkitty?
by l.schimmer＠cgv.tugraz.at 08 Apr '19

08 Apr '19

Hi! is thjere a easy way to delete old mails in hyperkitty? e.g. with a list and checkmarks, or via a cli command? We got several mailinglists and we did import them from mailman2.x into mailman 3.2. Now it is time to remove old posts before 2016. But I do not see a easy way to remove old posts in one go, just the "remove thread" button in each mail view. thank you, Lars

2 1

Archiver "prototype" and disabling archiving at all
by Torge Riedel 07 Apr '19

07 Apr '19

Hi list, in the settings of a mailing list I can choose two archivers: "Hyperkitty" and "prototype". What is this archive "prototype" and how can I disable/remove/deinstall it? And how can I disable archiving at all, so no archiver can be chosen in the settings. Best regards Torge

3 4

UI changes in Hyperkitty
by Abhilash Raj 02 Apr '19

02 Apr '19

Hi All, I have been working this past weekend trying to change some UI elements of Hyperkitty to make it a bit more cleaner, easier to read quoted emails and make unread posts more visible than they were before. As a test bed, I have deployed my changes to lists.mailman3.org[1]. A complete summary of changes is available in my MR[2] on Gitlab. I would appreciate some feedback from users to make sure that is is a step in the right direction. Since it has been a long long time since I ever designed a UI, I would also really appreciate if there people who want to work with me on fixing some of the UX issues in Hyperkitty. Summary of Changes: --------------------------------- - The grey background for the email headers are removed. - Gravatars are now round in shape instead of square. - Links to permalink of the message and fixed-font button has been moved to the bottom to remove clutter from the top of the message. - The date format is changed to remove the Day of the week and uses 3 letter month names for minimalism. - Right sidebar is now fixed and doesn't scroll with the page. - All buttons on the bottom of the email now have a hover property that changes their background on mouse hover. - Quoted part of the email now has a different background. Each level of quoting gets a different background till 3-levels of indentation. After, which we don't process more quoted text. - Unread threads show a blue bar on the left side as a more prominent indication as compared to current envelope icon. [1]: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ [2]: https://gitlab.com/mailman/hyperkitty/merge_requests/132 Feel free to reply here or just comment on MR in Gitlab. -- thanks, Abhilash Raj (maxking)

3 2

mail stuck in "out" queue
by Dmitry Makovey 30 Mar '19

30 Mar '19

I've had encountered this situation now twice: mail is being stuck in "out" queue and nothing in the logs indicates the issue. Is there a way to ask mailman-core politely to attempt delivery (perhaps with increased debugging in the logs) *without* restarting the core (which does solve *this* problem but creates other problems, like availability of the mailman as a whole) -- Sr System and DevOps Engineer SoM IRT

2 1

Delete archive of mailing list
by Torge Riedel 28 Mar '19

28 Mar '19

Hi list, I've successfully set up mailman3 in a test environment and deleted a test list which I only used for some basic tests. Looking at the archiver, the archive is still there and I haven't found a way to delete it. Although I am logged in as admin. Is there a (non-) official way to delete the archive? I want a clean environment for the later user to test mailman3. Thanks and regards Torge

2 2

Introducing Mailman Web project
by Abhilash Raj 26 Mar '19

26 Mar '19

I have been working on a new sub-project Mailman Web[1][2]. This project basically combines Postorius and Hyperkitty together in a single package which you can easily use to serve Mailman's web interface. The basic motivation behind this was to make it simpler for people to install the web interface *and* make it easier for people to configure Mailman's web ui. Both Postorius and Hyperkitty are based on Django Web Framework, which uses settings.py as its default configuration language. While it is quite convenient for Python developers to be able to put Python statements in configuration to join/edit/configure settings. However, I think a traditional INI, or TOML style configuration is easier for non-developers without having to worry about PYTHONPATH, valid Python sytax etc, etc. For this reason, I decided to combine all the projects together into a Django project which can be easily installed and run: $ pip install mailman-web # Export Settings for commands to just work. $ export DJANGO_SETTINGS=mailman_web.settings $ django-admin migrate $ django-admin runserver This should get you default settings for running. If you want to customize your installation, which you almost always would need to in a prod environment, you can create a config file at one of these locations (which are searched in following order): - /etc/mailman-web.toml - /etc/mailman3/mailman-web.toml - ./mailman-web.toml Note that we support only TOML as the configuration language[3][4] because of its simplicity. I would have loved to use INI, like Mailman Core, but it turns out to be way too simple to represent more complex data structures like maps and tables, that is commonly used in Django's Settings. This project is currently in alpha stage (I created it today!), but can be installed with pip[5] and in my basic tests works. There isn't much in the project itself beyond some configurations. I also took this opportunity to document all the settings that are used in Mailman Web (both Postorius and Hyperkitty) together[6]. This is documented in code and so I really hope that it won't go out of date like many other places ;-) Improvements to docs is very welcome, just a modification of a comment and is quite easy to propose right in your web browser using Gitlab! Any questions, comments or suggestions are welcome. You can open issues for feature requests on gitlab[1] too. [1]: https://gitlab.com/mailman/mailman-web [2]: https://mailman-web.readthedocs.io/en/latest/ [3]: https://github.com/maxking/django-settings-toml [4]: https://github.com/toml-lang/toml [5]: https://pypi.org/project/mailman-web/ [6]: https://mailman-web.readthedocs.io/en/latest/settings.html -- thanks, Abhilash Raj (maxking)

2 6

Configuring the List-Archive and Archived-At headers
by Ralph Seichter 25 Mar '19

25 Mar '19

With archiving enabled, mail is sent with headers like the following: Archived-At: <https://example.com/hyperkitty/list/foo-users@lists.example.com/message/ABC/> List-Archive: <https://example.com/hyperkitty/list/foo-users@lists.example.com/> List-Post: <mailto:foo-users@lists.example.com> List-Subscribe: <mailto:foo-users-join@lists.example.com> The 'mailto:' entries are fine, but I need all 'https:' links to be prefixed with https://lists.example.com instead of https://example.com . Does Mailman extract CN parts from the SSL certificate to populate the header values (that would explain 'example.com' in my tests), or is this something I can influence using configuration parameters? I searched the docs for Mailman Suite and HyperKitty, but did not find an answer. -Ralph

5 9

Non resolved placeholders in action message
by Torge Riedel 23 Mar '19

23 Mar '19

Hi, after adding a new moderator to a list I get the following message in a green box: %(email)s has been added with the role %(role)s Looks like the placeholders are not resolved (correctly). Should I report this somewhere as a bug? Mailman Core Version GNU Mailman 3.2.0 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.6.7 (default, Oct 22 2018, 11:32:17) [GCC 8.2.0] Best regards Torge

2 1

State of STARTTLS/SMTPS support?
by Ralph Seichter 21 Mar '19

21 Mar '19

Hello list. I just found https://gitlab.com/mailman/mailman/issues/252 and was surprised to see that a) the issue is two years old and b) a related merge request has been submitted a year ago and is also still open. The possibility to send mail unencrypted via localhost is something I have in a test environment, but not in production. I need to be able to specify settings that look like these: [mta] smtp_host: outbound-mta.mydomain.tld smtp_port: 587 smtp_security: STARTTLS When is STARTTLS/SMTPS likely to become available in Mailman? -Ralph

2 2

How to best disable message decoration for all lists defined for a domain
by Ralph Seichter 19 Mar '19

19 Mar '19

Hello list. I have read [1] and [2], but I am not quite sure what the recommended method is to completely disable message headers/footers and subject modifications for *all* lists tied to a specific domain. Being new to Mailman 3, I was actually surprised that there are no configuration switches in the Web UI's settings for mailing lists that allow me to get rid of unwanted message decorations. [1] https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/decorate… [2] https://mailman.readthedocs.io/en/latest/build/lib/mailman/rest/docs/templa… Thanks for your input. -Ralph

3 4

REST Runner (and other runners) taking long time to boot up
by Dmitry Makovey 18 Mar '19

18 Mar '19

splitting this discussion into it's own thread from "MM3 occasionally chokes (?)". Re-iterating background info for posterity: we have been experiencing increasingly long boot ups from mailman-core over the past year to the point where it's at about 45min for the sequence to complete. We run couple of mailing lists (20+) that are anywhere between 100 and 10K+ members and most of them are low traffic. From what I can tell all that time is spent doing some sort of indexing operations, I'm writing from memory since I can't restart the system to confirm that. sizes of directories that containers use: 3.6G core 352M database 285M web state of my queues (as far as I understand how to evaluate them: $ for q in core/var/queue/*; do echo ${q}; ls ${q}/ | wc -l ; done core/var/queue/archive 1 core/var/queue/bad 3845 core/var/queue/bounces 0 core/var/queue/command 0 core/var/queue/digest 0 core/var/queue/in 0 core/var/queue/nntp 0 core/var/queue/out 7 core/var/queue/pipeline 0 core/var/queue/retry 1 core/var/queue/shunt 958 core/var/queue/virgin 0 what kind of tuning should we be looking into to speed up our boot-ups? -- Sr System and DevOps Engineer SoM IRT

2 1

Maximum number of recipients error
by brian＠emwd.com 18 Mar '19

18 Mar '19

I am unable to modify the "Maximum number of recipients" setting. It generates the following error when I click the "save changes" button: "An error occured: Unknown attribute: max_num_recipients" I am using the docker version of MM3 and its happening on "Postorius Version 1.2.3". Is this a known bug? Brian

3 2

MM3 occasionally chokes (?)
by Dmitry Makovey 18 Mar '19

18 Mar '19

In the last couple of month we've observed some odd behavior from MM3 (namely the core) where it seems like email that is about to be sent to a large-ish mailing list (10K users) has been processed yet never gets sent out until we restart the core. I would appreciate any pointers on where to look for the source of the problem. At the moment, since I can't reliably reproduce it I can't really test it nor do I know where to look next time things get stuck. Mailing list in question is high profile thus when event like this happens I have only limited time amount to spend on troubleshooting/digging before I just restart the core (which by the way takes about 45min to fully start... which is another puzzle to solve at later time) -- Sr System and DevOps Engineer SoM IRT

2 5

REST API Question: possible to change user preferred email?
by Nathan Dixon 18 Mar '19

18 Mar '19

Hi, We are in need of being able to change a user's email address via the REST API. After looking through the documentation and code, I can't see a way to do this in a simple way. Although the documentation seems to show that if a user changes their preferred address, it will track throughout all their subscriptions. See: https://gitlab.com/mailman/mailman/blob/master/src/mailman/rest/docs/member… "When Gwen changes her preferred address, her subscription automatically tracks the new address." The only way I can see to do this via the REST API would be to do the following long winded way: *1. Create a new address:* POST to http://<api_url>/3.1/users/<$OldEmail>/addresses $postData: {email = "$NewEmail"} *2. Verify the new address:* POST to http://<api_url>/3.1/addresses/<$NewEmail>/verify $postData: { } *3. Get all the memberships for the old email address* $memberships = GET to http://<api_url>/3.1/addresses/<$OldEmail>/memberships *4. Change users email for each membership individually* foreach ($membership in $memberships) { PATCH to http://<api_url>/3.1/members/<$membership.member_id> $pathData: { address = $NewEmail } } *5. Delete Old Address* DELETE to http://<api_url>/3.1/addresses/<$OldEmail> Am I missing something (as in there is a way to do a single PATCH request somewhere)? Or is this the only way to update someone's email address with these 5 steps? Thanks, Nathan Dixon

2 1

[Mailman-Users] mailman 3 and freeipa
by Stephen J. Turnbull 18 Mar '19

18 Mar '19

Crossposting and redirecting replies to mailman-users(a)mailman3.org. Steven Jones writes: > I cant find anything on this so far but can Mailman3's webui use > freeipa as the authentication mechanism? Hi Steve, I don't have a complete answer offhand (and right now I'm just reducing my inbox so a single google search is as much as I can do), but searching for "freeipa django" indicates that there are "connectors" for Django and FreeIPA. The nicest option would be a plugin for Django's socialauth application. If that doesn't seem to exist, perhaps you can just add a FreeIPA application to the Django configuration. You would need to add it to both Postorius and HyperKitty configurations. Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

2 1

How to count the number of members in a list using Mailman client?
by Alan So 18 Mar '19

18 Mar '19

I tried to do so using Mailman client but it is really slow for lists with size > 1000. I use the following code snippet: my_list = client.get_list(listname) print ("number of members =", len(my_list.members)) Are there any other ways to do so in a much faster speed? Thanks.

2 1

Assistance with mailman3
by ayen＠afilias.info 15 Mar '19

15 Mar '19

Hi all I'm pretty new to mailman but been trying to install mailman 3 and been running into issues, following the documentation at http://docs.mailman3.org/en/latest/prodsetup.html installed Python 3.6, nginx, ruby-sass then with pip installed whoosh mailman-hyperkitty postorius hyperkitty mailman tried to start mailman core, symlinked master and runner -> /usr/bin/ (otherwise it wouldn't run) mailman core starts but when I hit the api url I get this in the logs File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/rest/wsgiapp.py", line 218, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 248, in __call__ responder, params, resource, req.uri_template = self._get_responder(req) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 664, in _get_responder route = self._router_search(path, req=req) TypeError: find() got an unexpected keyword argument 'req' Mar 13 10:54:44 2019 (17273) 127.0.0.1 - - "GET /3.1/ HTTP/1.1" 500 59 and on frontend "A server error occurred. Please contact the administrator." that leads to my gnu not working and throwing keyerrors for postorius. I'm using a clean install of ubuntu 18.04 but have also tried to install on centos 7 with no success. Are there any missing dependencies or steps that I've missed any assistance would be appreciated. Andy

3 2