May 2018 - Mailman-users - lists.mailman3.org

Urgent help needed...
by Darren Smith May 24, 2018

May 24, 2018

Hello, This morning our Mailman 3/Hyperkitty/Postorius installation has become unresponsive. When looking at the machine, postgres is pegging all 4 CPUs on the machine. We did some digging in postgres, and here is the query that is causing problems: "SELECT hyperkitty_email.date FROM hyperkitty_email WHERE hyperkitty_email.mailinglist_id = 'fooey(a)rootsweb.com' ORDER BY hyperkitty_email.date ASC LIMIT 1;" We have found that it doesn't matter what mailinglist_id is being used. We have also found that this might be an issue with the LIMIT 1 - our investigation is showing that using LIMIT 1 in postgres makes things execute very differently than if you use a limit 2 or more, and that this is probably what is going on. Basically, every time this gets called, it pegs an entire CPU for 20-30 seconds. It appears to be called a LOT. So our users are getting 504 gateway timeouts right now. What has changed: We have been in the process of importing our 40 million archived emails from our old mailman 2 archives. Questions: 1) We have tried doing a grep in the codebase - mailman3, hyperkitty, postorius, django - basically anything that might be calling this code, but we can't find it. Does anyone know what generates this query? 2) We are positing that it might be our archive imports that are causing this problem. Does anyone know of any sort of limit/threshold that might cause this to go haywire? Any help you can give, any direction you can point us would be useful. Right now our lists are just down for our users. Thank you, Darren

2 2

Is it possible to use an authenticator with incorrect, missing, or changing email addresses?
by andrew＠fsf.org May 24, 2018

May 24, 2018

Hello Mailman 3 users list, I was wondering if it's possible to set up a CAS authenticator with django-allauth ( https://pypi.org/project/django-allauth-cas/ ) even if we cannot guarantee the correctness of email addresses supplied by our CAS instance? Some contacts may also be missing an email address. I read about this here, and it seems like it wouldn't be possible: http://docs.mailman3.org/en/latest/config-web.html#configure-social-login > To see a list of all the providers, please have a look at the documentation of django-allauth. Make sure that the one you choose provides “email” as part of user data, otherwise it won’t work with Mailman. e.g. Twitter doesn’t give out emails. What if a user's email address changes on the CAS server? Will their email address in Mailman 3 be updated the next time they log in? Thanks, Andrew

2 1

What implications do GDPR have on Mailman, and how to requiring members to accept registration
by Henrik Rasmussen May 23, 2018

May 23, 2018

In regards to GDPR*) I am wondering if there is any ways I can require my current and future subscribers, members and list administrators to accept registration. I am also concerned that new lists are created with a subscription policy "Confirm" as default, rather than at least "Moderate", which can cause people to be subscribed by others against there will. Also, regardless of this setting, administrators can subscribe people without their knowledge. Away from Gravatar, mentioned in another post, what implications do GDPR have on Mailman? *) http://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1510481733260&uri=CELEX%… Henrik Rasmussen

4 6

No archived messages in hyperkitty
by Eric Abrahamsen May 12, 2018

May 12, 2018

I've got mailman3 up on Ubuntu 16.04, in a virtualenv, and (eventually) got everything working mostly okay. My last hurdle is archiving into hyperkitty: the web interface says "no archived list yet". The list I'm starting with is set to archive both to prototype (which I set up in the beginning, before I got hyperkitty going) and to hyperkitty. There appear to be no further boxes I can check, and mailman_hyperkitty.cfg is in place and I think correct. I think it's nearly working because new messages get filed to ./var/archives/hyperkitty/spool, in individual *.pck files, but then these files don't go anywhere, and the archives don't appear in the web view. It could be a problem with cronjobs, with qrunner, or maybe there's just one last hidden switch in a database somewhere that I haven't thrown. But I can't find anything. Any hints? TIA, Eric

2 3

List enumeration problem
by kawhite＠ancestry.com May 11, 2018

May 11, 2018

On our mailman instance we see the following enumeration of ALL lists and ALL users consistently every 7.5 minutes. Does anyone know why this would be the case? We have a lot of mailing lists so it slows our machine down a lot. Apr 30 15:31:36 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/a(a)example.com HTTP/1.1" 200 310 Apr 30 15:31:36 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/a(a)example.com/config HTTP/1.1" 200 2021 Apr 30 15:31:36 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/b(a)example.com HTTP/1.1" 200 325 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/b(a)example.com/config HTTP/1.1" 200 2108 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/c(a)example.com HTTP/1.1" 200 326 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/c(a)example.com/config HTTP/1.1" 200 2049 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/d(a)example.com HTTP/1.1" 200 324 ... Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/a@a HTTP/1.1" 404 13 Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/b@b HTTP/1.1" 404 13 Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/c@c HTTP/1.1" 404 13 Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/d@d HTTP/1.1" 404 13

4 3

Subscribe only to one thread
by Ivan Perez May 8, 2018

May 8, 2018

Dear Mailman users, There are many high-traffic mailing lists in which I would only be interested in receiving messages in specific threads (not all messages, nor some topics, nor a daily digest). Is there a way of "subscribing" to individual threads only, mainly those I initiate, or I actively participate in, but generally not receiving any emails from the list? If not, would others find this useful, and could it be implemented? (I understand that everyone wants features; I just don't know if it's a 2-hour patch or a 2-month project). Best wishes Ivan

2 2

Mailman, Supervisor, and keeping things running
by Darren Smith May 7, 2018

May 7, 2018

Hello, Previously I had a problem when upgrading to the newest versions of the mailman modules - and it turns out that everything requires Python 3 or higher. That was fine - I spent some time today moving everything from a Python 2.7 virtual environment to a Python 3.6 virtual environment. What no longer works is Supervisor... The mailman easy install script from Omar Mochtar set up a webui service that runs wsgi and nginx and keeps them running. However...supervisor won't run on python 3.6. I'm not seeing a way to make that work. I've read that you can shim it in, but that it isn't recommended to be used in a production environment. I've looked into circus, and I'm not familiar with it. I'm wondering if anyone has any examples of setting up a service that keeps processes up and running? I've seen circus, but I'm wondering if anyone has an example of how to set it up, or another service that does the same thing? -Darren

3 4

Message Personalization: embed User name in header/footer‏
by Asaf Ohayon May 7, 2018

May 7, 2018

Hello I'm trying to find info on how to embed personal details in message's header/footer Is it possible with mailman 3, if this is not implemented, how one start such feature ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

3 7

Could Mailman3 act like a private forum?
by andrew＠fsf.org May 6, 2018

May 6, 2018

Hello Mailman3 users and maintainers, I'm wondering whether it would be possible for Mailman3 to act like a private forum. I know that Mailman3 has private lists and may allow for custom authenticators. However making some lists private seems to be different than making all list signups and archives public to those who are able to log in, but hidden from all users who cannot. Would Mailman3 be able to act like a forum that hides or shows lists based on whether someone is logged in? Thanks, Andrew

2 1

django-mailman3 update causing errors
by Darren Smith May 2, 2018

May 2, 2018

Hello, In attempting to update our mailman3/postorius/hyperkitty installation, I have run into an error after upgrading the django-mailman3 project. Our webui is being run through supervisord. The command being run is this: /<path>/mailman3/conda/envs/mailman3_ext/bin/waitress-serve --listen=localhost:8787 webui.wsgi:application The error I'm getting is pretty long, but most of it appears to be usage instructions. Here are what I believe to be the pertinent parts: Error: Bad module 'webui.wsgi' Usage: waitress-serve [OPTS] MODULE:OBJECT <lots and lots of usage instructions> There was an exception (ImportError) importing your module. It had these arguments: 1. No module named error Any thoughts on why updating django-mailman3 would cause this? Thanks! -Darren

3 4