- Mailman-users - lists.mailman3.org

Failed first login
by Massimo Zappalà 11 Sep '20

11 Sep '20

Hi everyone, i installed mailman3-full on debian 10. During installation, it asks me to enter the admin user credentials. After configuration, I restart mailman3 and mailman3-web. When I try to log in for the first time by entering the admin credentials, a message warns me that the credentials are incorrect. I looked at the mailman logs, but I find nothing. It seems that it is a django authentication problem, because even in the django admin panel I can't log in. Looking at the mailman3web db, in the auth_user table, I see the admin user. How can I see why it does not accept the credentials? Thank you in advance

2 2

Affinity and Empathy Are Now Available
by Brian Carpenter 11 Sep '20

11 Sep '20

Dear Mailman 3 Users, We have launched Affinity and Empathy and they now are part of our shared and cloud Mailman 3 hosting services. Affinity replaces Postorius and Empathy replaces Hyperkitty. You can read more at https://mailmanhost.com Please email me off-list if you have any questions. Brian Carpenter Harmony Lists

1 0

Messages disappearing into hole??
by Ruth Ivimey-Cook 11 Sep '20

11 Sep '20

Folks, I have been trying to set up a mailing list that is mostly for message distribution, so there is a single sender of messages and multiple receivers, but the receivers are moderated. I wouldn't mind receiver messages being explicitly rejected but that's not an issue for now. I looked around the interface and decided to set up the sender as a non-member, as that appeared to permit them to be "special" and outside of the normal access rules for the list. Before I did that I could send a message from this sender and that would be sent to me as list owner for moderation, so both incoming (from my mailserver) and outgoing (to it) can be completed. However, with a non-member who is auto-accepted the message is passed from my mailserver to mailman and then disappears. I cannot find anything in the logs to indicate what happened next. I have tried setting the default non-member policy to both 'hold' and 'default' with no change in that behaviour. The logs for the mailserver show the message being sent to mailman; mailman's "smtp.log" shows an LMTP message being received ok, and then nothing. Any ideas how to find out what is going on? I can share config if that helps but not sure what would be useful. As a side-issue, at one point I added a regex matching the sender address to the acceptable members list, but find that I cannot now delete it (using postorius): If I delete the field and Save, it returns on page refresh. Regards, Ruth -- Software Manager & Engineer Blog: http://www.ivimey.org/blog LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/

2 1

messages go to shunt queue
by Danil Smirnov 10 Sep '20

10 Sep '20

Hi guys, I've faced weird Core behaviour after the last upgrade of the docker images. All the messages sent to a list now go straight to shunt queue with the following error in the logs: --- Sep 06 22:41:32 2020 (27) Uncaught runner exception: 0 Sep 06 22:41:32 2020 (27) Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/lib/python3.8/site-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/lib/python3.8/site-packages/mailman/runners/incoming.py", line 79, in _dispose process(mlist, msg, msgdata, start_chain) File "/usr/lib/python3.8/site-packages/mailman/core/chains.py", line 57, in process if link.rule.check(mlist, msg, msgdata): File "/usr/lib/python3.8/site-packages/mailman/rules/dmarc.py", line 314, in check if maybe_mitigate(mlist, address): File "/usr/lib/python3.8/site-packages/mailman/rules/dmarc.py", line 286, in maybe_mitigate answer = is_reject_or_quarantine( File "/usr/lib/python3.8/site-packages/mailman/rules/dmarc.py", line 217, in is_reject_or_quarantine for record in txt_rec.items[0].strings) KeyError: 0 Sep 06 22:41:32 2020 (27) SHUNTING: 1599432092.4326646+4cbb58a0dd5d9705946ca583835e63ec175536e3 I'm witnessing the same behaviour in two different installations for all the messages sent to list (with plain text body like "it's a test"). --- Any insight would be greatly appreciated! Danil Smirnov

2 2

Please help: Mailaman3 -
by Jane Anara 06 Sep '20

06 Sep '20

Hello everyone, I hope my questions don't sound ridiculous. In my team, I have been tasked with moving our mailman installations from version 1:2.1 to the current version, mailman3. I followed the documentations online and installed all the components, created a Django project and configured settings.py and url.py. However, when I run the development server, I receive the following on the body of Postorius main page: Page not found This page either doesn't exist, or it moved somewhere else. Clicking on the "Lists" menu link, I receive the following: HTTP Error 404: <!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <title>example.com</title> <link rel="shortcut icon" href="/static/postorius/img/favicon.ico"> <link rel="stylesheet" href="/static/postorius/libs/bootstrap/css/bootstrap.min.css"> <link rel="stylesheet" href="/static/django-mailman3/css/main.css"> <link rel="stylesheet" href="/static/postorius/css/style.css"> <link rel="stylesheet" href="/static/postorius/libs/fonts/font-awesome/css/font-awesome.min.css" type="text/css" media="all" />    </head> <body> <nav class="navbar navbar-expand-md navbar-light bg-light navbar-default"> <div class="container"> <div class="navbar-header"> <button type="button" class="navbar-toggler collapsed" data-toggle="collapse" data-target="#header-nav" aria-expanded="false"> <span class="sr-only">Toggle navigation</span> <span class="fa fa-bars"></span> </button> <a class="navbar-brand" href="/mailman3/lists/"><span><img src="/static/postorius/img/mailman_logo_small_trans.png" alt="Mailman logo"/> Postorius</span></a> </div> <div class="collapse navbar-collapse" id="header-nav"> <ul class="nav navbar-nav mr-auto"> <li class="nav-item"><a href="/mailman3/lists/" class="nav-link"> <span class="fa fa-envelope"></span> Lists </a></li> <li class="nav-item"><a href="/archives/" class="nav-link"> <span class="fa fa-comment"></span> Archives </a></li> </ul> <ul class="nav navbar-nav navbar-right"> <li class="nav-item"><a class="nav-link" href="/accounts/login/?next=/3.1/lists"> <span class="fa fa-sign-in"></span> Login </a></li> <li class="nav-item"><a class="nav-link" href="/accounts/signup/?next=/3.1/lists"> <span class="fa fa-user-plus"></span> Sign Up </a></li> </ul> </div> </div> </nav> <div class="container" role="main"> <h1>Page not found</h1> <div class="alert alert-danger">This page either doesn't exist, or it moved somewhere else.</div> </div> <footer class="footer"> <div class="container"> <p class="text-center"> <a href="https://postorius.readthedocs.org">Postorius Documentation</a> • <a href="http://list.org">GNU Mailman</a> • Postorius Version 1.3.3 • Happy Mailman Day! </p> </div> </footer> <script src="/static/postorius/libs/jquery/jquery-1.11.3.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.11.0/umd/popper.min.js" integrity="sha384-b/U6ypiBEHpOf/4+1nzFpr53nxSS+GLCkfwBdFNTxtclqqenISfwAzpKaMNFNmj4" crossorigin="anonymous"></script> <script src="/static/postorius/libs/bootstrap/js/bootstrap.min.js"></script> <script src="/static/django-mailman3/js/main.js"></script> <script src="/static/postorius/js/script.js"></script> </body> </html> So far, the Postorious component is where there seem to be issues, all other link or component produce no errors thus far. Please advice on how I can troubleshoot this. I herein include the relevant sessions of my settings.py file and url.py which I have tweaked with various configurations to no avail. settings.py: # Application definition INSTALLED_APPS = [ # Apps added for mailman components 'hyperkitty', 'postorius', 'django_mailman3', 'mailmanclient', # Other useful apps 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', # end other useful apps 'django.contrib.sites', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.messages', 'django.contrib.staticfiles', ] url.py: urlpatterns = [ #Django admin path('admin/', admin.site.urls), path('mailman3/', include('postorius.urls')), path('archives/', include('hyperkitty.urls')), path('', include('django_mailman3.urls')), path('accounts/', include('allauth.urls')), #path('postorius', include('postorius.urls')), #path('lists/', list_index), path('search/', include('haystack.urls')), #url(r'^$', list_index), ] Note that when I uncomment the lines relating to list_index or use configurations similar to that on mailman-suit, I get: NameError: name 'list_index' is not defined. Looking forward to any help anyone can render. Thank you! Regards, Jane.

2 5

Struggling with log rotation in Docker context
by skenny＠scss.tcd.ie 05 Sep '20

05 Sep '20

I'm running Mailman 3 via maxking's Docker implementation, and had an incident recently where something went badly wrong, and the file uwsgi-error.log filled up. As a consequence, so did the file system where that file resides,and things ground to a halt. The file is visible on the Docker host as /opt/mailman/web/logs/uwsgi-error.log. I am unsure about how to rotate this file correctly. I could use logrotate on the host, but I can't locate any documentation that describes how to signal the relevant processes inside the mailman-web container. (Maybe this should be done within the container?) I'd be grateful for any good advice on this. Stephen

2 5

mailman procesing small amount of mail, then stop process them like 30 seconds, and then loop back
by mathias.bedu＠epitech.eu 04 Sep '20

04 Sep '20

Hi, I am currently trying to optimize my mailman installation, which is working. The only issue is that i see that mailman seems to process a few number of messages (around 50 each times), then stopping, and then processing few next messages. I spend quite some times searching for eventual parameters that could slow down. I precise that the machine itself is largely more powerful than what mailman is using. So my question is : could you give me some leads for potentials parameters or stuff like this that i could modify to optimize the installation ? Best regards, Mathias

2 2

Unsubscribe Notifications Clarification
by Brian Carpenter 03 Sep '20

03 Sep '20

I am trying to understand how Mailman 3 handles unsubscribe notifications. From my testing I see the following behavior: 1. If list member sends email to listname-leave@listname, an unsubscribe notification is sent to both list owner and list member if list settings have them enabled. 2. If list list member is a registered user of Postorius and he uses Postorius to unsubscribe, then no notification is sent out to either list owner or list member, even if list settings has unsubscribe notifications enabled. Is this correct? Brian

2 2

adding imprint / private policy link to postorius
by Thomas Stein 03 Sep '20

03 Sep '20

Hello one and all. Is it possible to add an imprint link to the postorius start page? I guess it is, but it would be nice if someone could me point to the right direction / documentation. Something like they have: https://lists.openrailwaymap.org/mailman3/postorius/lists/ cheers, t.

2 2

Timeout in Postorius when trying to approve or reject moderated messages
by Sebastian Hagedorn 30 Aug '20

30 Aug '20

Hi, I just set up a new Mailman 3 Suite installation (GNU Mailman 3.3.1 (Tom Sawyer)) on CentOS 7 using the virtualenv installation guide: https://docs.mailman3.org/en/latest/install/virtualenv.html I encountered a few issues, but I was able to resolve all of them, I think. All three components of the suite are up and running. The backend is a MariaDB database, the frontend is Apache with mod_wsgi. I can send messages to the server, and they are delivered to list members. One thing that I can't figure out is why I can't approve or reject messages that are held for moderation. In case it matters, I'm trying to moderate the list using the "root" account. Discarding works, but when I try to either accept or reject a message, there is a timeout. I can't find anything in mailman.log, mailmansuite.log or even /var/log/httpd/access_log. I managed to reject and approve messages manually using mailmanclient and the REST API, so the issue appears to be somewhere between Postorius 1.3.3 and mailmancore. Any ideas? -- .:.Sebastian Hagedorn - Weyertal 121 (Gebäude 133), Zimmer 2.02.:. .:.Regionales Rechenzentrum (RRZK).:. .:.Universität zu Köln / Cologne University - ✆ +49-221-470-89578.:.

4 6

Throttle outgoing emails to a certain rate?
by arvid.teichtmann＠gmx.de 21 Aug '20

21 Aug '20

Is there a possibility to throttle the sending of outgoing emails to a certain rate, e.g. 100 emails per hour, or to split them up into corresponding chunks? I run Mailman 2.1.33 on a hosted server and the provider only allows me to send a maximum of 100 emails per hour. The excess emails are also simply discarded and the sender and list administrator get a bunch of error emails. This is very annoying, especially because I didn't know about it and the problem only now occurs occasionally during operation... ;-( Thanks for all hints.

3 2

Spam sign ups
by Seth Seeger 21 Aug '20

21 Aug '20

Hello all, I've suddenly started getting a slow but steady stream of fake sign ups. They fail because I'm getting a bounce back from the mail host saying that the email address they signed up with doesn't exist. I know this was asked a while back on this list, but I'm hoping there might be an update? Any way to add an am-I-human test to the sign up? Thanks, Seth

2 1

mailman not starting, status is active (exited)
by Ricardo Kleemann 19 Aug '20

19 Aug '20

Hi, After quite a long time with no issues, I’ve started having a problem where mailman won’t start and I don’t see any clear error message I’m running on Ubuntu, not sure which mailman version (forgot how to determine). Here is the status info sudo systemctl status mailman ● mailman.service - LSB: Mailman Master Queue Runner Loaded: loaded (/etc/init.d/mailman; generated) Active: active (exited) since Wed 2020-08-19 07:38:59 PDT; 2h 46min ago Docs: man:systemd-sysv-generator(8) Process: 2351 ExecStop=/etc/init.d/mailman stop (code=exited, status=0/SUCCESS) Process: 2386 ExecStart=/etc/init.d/mailman start (code=exited, status=0/SUCCESS) Aug 19 07:38:59 relay1 systemd[1]: Starting LSB: Mailman Master Queue Runner... Aug 19 07:38:59 relay1 systemd[1]: Started LSB: Mailman Master Queue Runner Any ideas? thanks Ricardo

3 2

mailman stopped working, it shows active (exited)
by Ricardo Kleemann 19 Aug '20

19 Aug '20

Hi, it’s been quite a while since I’ve been back to the list, mailman has been working very well for me But recently it has stopped working. I’m not exactly sure what I did to cause this. I’m not seeing any clear error message. Running on Ubuntu linux, I don’t quite remember how to determine my mailman version. Here’s the status info sudo systemctl status mailman.service ● mailman.service - LSB: Mailman Master Queue Runner Loaded: loaded (/etc/init.d/mailman; generated) Active: active (exited) since Wed 2020-08-19 07:38:59 PDT; 13min ago Docs: man:systemd-sysv-generator(8) Process: 2351 ExecStop=/etc/init.d/mailman stop (code=exited, status=0/SUCCESS) Process: 2386 ExecStart=/etc/init.d/mailman start (code=exited, status=0/SUCCESS) Aug 19 07:38:59 relay1 systemd[1]: Starting LSB: Mailman Master Queue Runner... Aug 19 07:38:59 relay1 systemd[1]: Started LSB: Mailman Master Queue Runner.

1 0

Invalid confirm text
by w.schoener＠alp.dillingen.de 19 Aug '20

19 Aug '20

Hi there, I am new to mailman 3, python and django. I try to configure a mailman 3 list. To establish german text, I used the web-admin interface of mm3 in the "templates"-section. I inserted a text for "The message sent to subscribers when a subscription confirmation is required" Now, when I try to subscribe to the list, I get my first message in german language, with the confirm request: return the message unchange. When I return the message, I get an answer: Invalid confirm text. My request is pending. And there is no way to solve this pending request, in the webinterface, no subscription request is shown, no member is shown and no no-member is shown. Have you any hint, what is going wrong. What do I have to respect to create a message, where the confirmation is working. Thank you Wolfgang

2 5

Single-Sign-out for List member
by w.schoener＠alp.dillingen.de 17 Aug '20

17 Aug '20

Hello, I have to configure mailman 3 for a german company. The privacy policy in our country demands for mailing-lists, that its member can sign out in one step, it is called sigle-sign-out. So I would like to ad a link in the footer of every message, with which every receiver/member can sign out of the newsletter with one click. It does not seam to be possible, to put this into effect with mailman 3. Does anybody have any hints, how to create a link, and when this link is called, the user is signed out of the newsletter. Thank you, Wolfgang

5 7

postfix docker image
by Danil Smirnov 16 Aug '20

16 Aug '20

Hi, For those who are using Abhilash's Docker images for Mailman 3 deployment and willing to up Postfix as a container - I've created a lightweight Docker image for this purpose: https://github.com/danil-smirnov/docker-postfix It has been tested for awhile already. I'd appreciate more testing and bug reports/feature requests. Best regards, Danil Smirnov https://mailman3.com/

1 0

base64 re-encoding and line endings
by David Bremner 15 Aug '20

15 Aug '20

I (along with some other admins) run a mailman3 (3.2.1, on debian stable) mailing list for notmuch (https://notmuchmail.org). It's our main method of reviewing, so we get lots of mail from git-send-email. Occasionaly people send it with Content-Transfer-Encoding 8bit. As far as I can tell what happens then is mailman3 re-encodes it as base64, taking the line endings as CRLF. git-am is unable to apply the patches that have been re-encoded. This seems somewhat related to [1]. Like one commentator there, I would be happy to be able to turn off the re-encoding, although I have the feeling from playing with the python email libraries that this might not be that easy. I'm writing in hope that someone can suggest another workaround, perhaps some kind line-ending rewriting before base64 encoding. I guess with 8bit transfer encoding there probably isn't a clear distinction between the line-endings on the wire, and the intended line-endings for delivery, but it could be inferred from the "X-Mailer: git-send-email" header. As a test, I sent the same patch through our mailman instance with Content-Transfer-Encoding base64 and that applies fine, since the original \n line endings are inside the base64 container. It's a known mis-feature of git-am that it can handle either CRLF line endings or base64 encoding, but not the combination of both. I have a local workaround involving re-formatting the patches, but I'd really like anyone to be able to apply the patches from the list archive. [1]: https://gitlab.com/mailman/mailman/-/issues/269

2 1

Announce Only List
by joseverde＠gmail.com 14 Aug '20

14 Aug '20

So if we want to make a list announce only (e.g. only specific folks) can post, I've found I can set the list settings to automatically discard messages from members and non-members. Then I go into the individual permissions on each user to be allowed to post without moderation. This works fine, however it seems cumbersome. My expected solution was to make the announce only members moderators - however it appears being a moderator does not give any special ability to post to the list (nor does it appear to make you a 'member' from the point of mailman when sending messages to the list, since a moderator who is not a subscriber gets treated like a nonmember from the posting permissions perspective). Is this correct?

7 9

Missing mailman archives?
by Marco Marinello 12 Aug '20

12 Aug '20

I've recently migrated from Mailman 2 to Mailman 3 but I'm setting up Hyperkitty just now. I imported the old mbox and that worked fine but now I'm missing the mails in the time between Mailman 3 started working and now: mailman config reports [paths.custom] var_dir: /opt/mailman/var But root@mm:/opt/mailman/var# find . . [OMISS] ./archives Where are the e-mails? Can I import them into Hyperkitty? Thanks, Marco

2 6

Hold messages that have binary attachments
by Quanah Gibson-Mount 12 Aug '20

12 Aug '20

Is there a way to configure a list automatically put a hold on messages that have binary attachments such as jpgs, pngs, etc? Thanks, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

2 2

How to Unshunt Specific Message ?
by Shashikanth Komandoor 12 Aug '20

12 Aug '20

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 in production environment from the past 3 months almost. I learnt how to unshunt the messages that got unshunted in mailman 3. But the command *mailman unshunt* would unshunt all the messages in the shunt queue. I want only a specific message to be unshunted and resent. I don't find my requirement reached with the help of *mailman unshunt*. Please suggest. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 3

Removing users account
by Massimo Zappalà 11 Aug '20

11 Aug '20

Hi everybody, is there a method that allows the list administrator to delete a user account? I run this version: Mailman Core Version 3.2.1 Mailman Core API Version 3.0 Mailman Core Python Version 3.7.3 Postorius 1.2.4 HyperKitty version 1.2.2 Thanks Max

2 2

How to create user accounts and mail addresses through CURL instead of Site Administration ?
by Shashikanth Komandoor 11 Aug '20

11 Aug '20

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 in production environment from the past 3 months almost. I am currently automating a few things using the CURL commands but only postorius related as of now. Now I have a requirement. I need to create a lot many users and their mapping email ids through Site Administration almost daily. But it is becoming to do the same through Graphical Interface. So, I just want to know the CURL commands that can be used to create the user accounts and email ids mapped to user accounts. Please do the needful. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 2

Better documentation for Mailman Core's config options
by Abhilash Raj 07 Aug '20

07 Aug '20

Hey All, For the past few days, I've been trying to improve the documentation style for Mailman Core's config options. Internally, Mailman has all configurations defined in an ini formatted `schema.cfg` file, which serves as a schema for our `zope.configuration` library. We had that file simply embedded in the sphinx documentation previously as a wall of text. I ended up writing a Sphinx (our documentation generator) plugin which parses the config file and presents the same documentation with more bells and whistles so it is easier to lookup and link sections and config options.[1] The process of doing that was fun and I learnt how to write a simple sphinx plugin, so yay! It treats the comments above each config option in the ini file as it's doc and basically generates ReST text that it passes to Sphinx to parse and convert to the markup format that you see in browser. You can look at it in the source repo[2] . Do note that not all sections are documented yet, I am still figuring out what would be a good way to document template sections like `[plugins.master]` and other similar sections of that kind. [1]: https://gnu-mailman--667.org.readthedocs.build/projects/mailman/en/667/src/… ((URL is for the PR, the main doc seems like is serving the cached version from an older build). [2]: https://gitlab.com/mailman/mailman/-/blob/master/_ext/configplugin.py -- thanks, Abhilash Raj (maxking)

2 1

How to turn off Emergency Moderation for imported MM2 lists?
by Brian Carpenter 07 Aug '20

07 Aug '20

I recently imported a number of MM2 lists into MM3. Unfortunately, the person had emergency moderation turned on for these lists. Since EM is not exposed to Postorius what can be done to reverse this? Thanks, Brian

3 6

Installation Help on Ubuntu 18
by joseverde＠gmail.com 03 Aug '20

03 Aug '20

Hi folks, I spent many hours last night trying to get Mailman 3 up and running. I am using Ubuntu on a Digital Ocean LAMP droplet (so PHP, Apache, Sql, and Postfix are already installed). The LAMP stack works as I have a successful installation of YOURLS going on. So, I tried to use this guide (https://docs.google.com/document/d/1xIcSsoNFp2nHi7r4eQys00s9a0k2sHhu1V5Plan…) to install the Mailman3 package and got to the configuration screen (the one with all the DOS-esque GUI). I ran it but it kept saying the DB wasn't installed. Was I supposed to create SQL databases and users before running that and use those usernames/databases in the credentials it asks for? It doesn't seem like that in the way it asks the questions (since it asks to create a password) but I wasn't sure. Anywho, I tried to remove the package completely and restart but I keep spinning my wheels. So my questions: 1. Does that guide actually work? Did I just foul up the database part? 2. Is there a better way to install mailman3 with some nice step-by-step directions to follow? 3. Is there a way to completely wipe my previous installs without wiping the server? ( I didn't back up...silly I know ). I used apt-get --purge remove to uninstall mailman3 and mailman to start over, did that do the trick? Sorry for all the questions.

4 6

Custom Templates and reject_message() error
by Marcel Pietschmann 02 Aug '20

02 Aug '20

Hi everyone, I'm running Mailman 3 in maxking's Docker container (tag 0.3). Mailman3 runs really well, thanks for that good job! But I noticed two errors. 1) When a new list is created, Mailman will not notify the list owners of their new mailing list. I tested it with the default template "domain:admin:notice:new-list.txt" and my own template (which i copied in $var_dir/templates/domains/DOMAIN/de/ Any customs templates in $var_dir/templates... aren't sent out, always the default templates from /usr/lib/python3/site-packages/mailman/templates/de. I can't find anything in the logs for that issue. 2) When a post requires an approval and I reject it with a notification a server error occurs: "An error occurred while processing your request." The Traceback in mailmanweb.log is: ERROR 2020-08-01 16:19:19,926 17 django.request Internal Server Error: /postorius/lists/list.domain.de/held_messages/moderate Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/usr/lib/python3.6/site-packages/django/core/handlers/base.py", line 115, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3.6/site-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3.6/site-packages/django/views/decorators/http.py", line 40, in inner return func(request, *args, **kwargs) File "/usr/lib/python3.6/site-packages/django/contrib/auth/decorators.py", line 21, in _wrapped_view return view_func(request, *args, **kwargs) File "/usr/lib/python3.6/site-packages/postorius/auth/decorators.py", line 60, in wrapper return fn(*args, **kwargs) File "/usr/lib/python3.6/site-packages/postorius/views/list.py", line 549, in moderate_held_message mailing_list.reject_message(msg.request_id, reason=reason) TypeError: reject_message() got an unexpected keyword argument 'reason' Thanks a lot for any suggestion. Greets Marcel Mailman Core Version: 3.3.1 Mailman Core API Version: 3.1 Postorius Version 1.3.3 HyperKitty Version 1.3.3

2 1

Mailman 3.2.0 Hyperkitty fulltext index error
by Marvin Gülker 31 Jul '20

31 Jul '20

Hi, I've just upgraded to Mailman 3.2.0 (finally everything Python 3 now, thanks!) and it appears to work. However, there's a repeating error message in mailman-suite's logfile for Hyperkitty that looks like this: ERROR 2018-07-12 14:28:33,895 2742 hyperkitty.lib.utils Failed to update the fulltext index: ord() expected a character, but string of length 0 found Traceback (most recent call last): File "/home/mailman/env3/lib/python3.5/site-packages/hyperkitty/lib/utils.py", line 179, in run_with_lock fn(*args, **kwargs) File "/home/mailman/env3/lib/python3.5/site-packages/hyperkitty/search_indexes.py", line 115, in update_index update_cmd.update_backend("hyperkitty", "default") File "/home/mailman/env3/lib/python3.5/site-packages/haystack/management/commands/update_index.py", line 276, in update_backend last_max_pk=max_pk) File "/home/mailman/env3/lib/python3.5/site-packages/haystack/management/commands/update_index.py", line 97, in do_update backend.update(index, current_qs, commit=commit) File "/home/mailman/env3/lib/python3.5/site-packages/haystack/backends/whoosh_backend.py", line 178, in update self.setup() File "/home/mailman/env3/lib/python3.5/site-packages/haystack/backends/whoosh_backend.py", line 126, in setup self.index = self.storage.open_index(schema=self.schema) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/filedb/filestore.py", line 176, in open_index return indexclass(self, schema=schema, indexname=indexname) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 421, in __init__ TOC.read(self.storage, self.indexname, schema=self._schema) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 632, in read check_size("int", _INT_SIZE) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 626, in check_size sz = stream.read_varint() File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/filedb/structfile.py", line 191, in read_varint return read_varint(self.read) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/util/varints.py", line 102, in read_varint b = ord(readfn(1)) TypeError: ord() expected a character, but string of length 0 found The error repeats every minute, so I suppose it comes from the minutely cronjob. This cronjob looks like this: * * * * * mailman bash -c 'cd /home/mailman && . /home/mailman/env3/bin/activate && django-admin runjobs minutely --pythonpath /home/mailman/mailman-suite/mailman-suite_project --settings settings' What's wrong here? Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

3 3

Owner's or Moderator's Lists
by Johnny Cison 31 Jul '20

31 Jul '20

I feel like I'm missing something obvious, but is there a page in Postorius that lists all of the lists of which the user is the owner or moderator? When I visit the /lists/ URL as an admin, I see a full list. When I visit the /lists/ URL without being logged in, I see public lists. I've heard from two people who are list owners (and confirmed they're logged in and their email is showing as verified) that they also just see the public lists on the /lists/ page. (I tried searching the archives and didn't see anything that addressed this. My apologies if I overlooked it!)

2 3

Good choice of defaults for content filtering?
by hansen＠rc.org 31 Jul '20

31 Jul '20

Hi all, I had MM2 set to the default filtering that I think came OOTB. MM3 has none such and I was wondering: a. What were those MM2 defaults (My MM2 server is long gone now). b. Is there a better set today. I know that MIME types can be faked, but they have worked. I want to avoid anything that can contain malicious code while also allowing simple text to go through. Yours, Allan

3 2

A little stuck with installation of MM3 - ModuleNotFoundError: No module named 'flufl.lock'
by Odhiambo Washington 30 Jul '20

30 Jul '20

I decided to try this again, on FreeBSD-12.1 I still decided to follow https://wiki.list.org/DOC/Mailman%203%20installation%20experience which I know is not the main documentation, but I find the process easier to follow. I am also taking notes to see if I could share if I manage to succeed. This is important for me because Python-2.7 is being removed from FreeBSD in Dec 2020. I need to bail out of mailman-2.x before that happens so I am trying my hand again om MM3. I have failed before :-) I am stuck at this step: (venv) [root@gw /opt/mailman/mm]# /opt/mailman/mm/bin/mailman-post-update + '[' False == False ']' + mkdir -p /opt/mailman/mm/static + /opt/mailman/mm/bin/django-admin collectstatic --clear --noinput --verbosity 0 Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 33, in <module> sys.exit(load_entry_point('Django==3.0.8', 'console_scripts', 'django-admin')()) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/core/management/__init__.py", line 401, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/core/management/__init__.py", line 377, in execute django.setup() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/__init__.py", line 24, in setup apps.populate(settings.INSTALLED_APPS) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/apps/registry.py", line 114, in populate app_config.import_models() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/apps/config.py", line 211, in import_models self.models_module = import_module(models_module_name) File "/usr/local/lib/python3.7/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1006, in _gcd_import File "<frozen importlib._bootstrap>", line 983, in _find_and_load File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 677, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 728, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/models/__init__.py", line 26, in <module> from .email import Attachment, Email File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/models/email.py", line 35, in <module> from .mailinglist import MailingList File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/models/mailinglist.py", line 37, in <module> from hyperkitty.lib.utils import pgsql_disable_indexscan File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/lib/utils.py", line 42, in <module> from flufl.lock import Lock *ModuleNotFoundError: No module named 'flufl.lock'* (venv) [root@gw /opt/mailman/mm]# pip install flufl.lock Requirement already satisfied: flufl.lock in ./venv/lib/python3.7/site-packages/flufl.lock-4.0-py3.7.egg (4.0) Requirement already satisfied: atpublic in ./venv/lib/python3.7/site-packages/atpublic-1.0-py3.7.egg (from flufl.lock) (1.0) Requirement already satisfied: psutil in ./venv/lib/python3.7/site-packages/psutil-5.7.2-py3.7-freebsd-12.1-RELEASE-p7-amd64.egg (from flufl.lock) (5.7.2) Even after the 'pip install flufl.lock' it still doesn't find it! I have had a similar problem earlier with installing pylibmc. It could not find libmemcache.h despite it being inside /usr/local/include somewhere and I luckily solved that with export LIBMEMCACHED=/usr/local && pip install pylibmc. I am wondering if there is an equivalent to resolve this one with flufl.lock. Thanks in advance. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

3 21

500 Internal Server Error on specific list pages
by Johnny Cison 30 Jul '20

30 Jul '20

I have a new Mailman 3 server set up and am having a strange issue with just one particular list. Accessing the list's Info page URL or it's Archiving Settings page URL returns a 500 Internal Server Error, but its other pages work correctly. Also, the Info and Archiving pages on the other lists are working correctly. When I access the info page for the problem list, I get these errors in the log: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 249, in _legacy_get_response response = self._get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 68, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/views/generic.py", line 59, in dispatch return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 88, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/views/list.py", line 216, in get 'hyperkitty' in self.mailing_list.archivers and File "/usr/lib/python2.7/_abcoll.py", line 388, in __contains__ self[key] File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 151, in __getitem__ return self._get(key) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 90, in _get return self.rest_data[key] File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 76, in rest_data response, content = self._connection.call(self._url) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/connection.py", line 103, in call raise HTTPError(url, response.status, content, response, None) HTTPError: HTTP Error 500: A server error occurred. Please contact the administrator. When I access the Archiving page in Settings, I get these: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 249, in _legacy_get_response response = self._get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/dist-packages/django/contrib/auth/decorators.py", line 23, in _wrapped_view return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/auth/decorators.py", line 39, in wrapper return fn(*args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/views/list.py", line 719, in list_settings form = form_class(initial=initial_data, mlist=m_list) File "/usr/lib/python2.7/dist-packages/postorius/forms.py", line 303, in __init__ [(key, key) for key in sorted(self._mlist.archivers.keys())]) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 172, in keys return list(self) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 166, in __len__ return len(self.rest_data) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 76, in rest_data response, content = self._connection.call(self._url) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/connection.py", line 103, in call raise HTTPError(url, response.status, content, response, None) HTTPError: HTTP Error 500: A server error occurred. Please contact the administrator. Not a python developer, which makes debugging based on the above more difficult. I've seen some other errors posted to this list that highlight specific setting or config issues, but I'm not seeing that in these. Any ideas?

2 5

The email confirming the registration of an account on postorius is not correctly translated in Italian
by Massimo Zappalà 30 Jul '20

30 Jul '20

Hi everyone, thanks to the files.po on Weblate, I have translated all Mailman-Core, Postorius, Hyperkitty and Django_mailman3. I have also translated the confirmation message to subscribe to a list. Everything works, except for this: When I register a new account on postorius, he sends me a confirmation email totally in English, except the following final block which is sent in Italian: in my /usr/lib/python3/dist-packages/allauth/locale/it/LC_MESSAGES/django.po #: templates/account/email/email_confirmation_message.txt:7 #, python-format msgid "" "Thank you from %(site_name)s!\n" "%(site_domain)s" msgstr "" "Grazie da %(site_name)s!\n" "%(site_domain)s" By carefully analyzing the same file .po, I notice that the Italian translation of the whole text already exists. Why does the confirmation email arrive in English? #: templates/account/email/email_confirmation_message.txt:1 #, fuzzy, python-format #| msgid "" #| "User %(user_display)s at %(site_name)s has given this as an email " #| "address.\n" #| "\n" #| "To confirm this is correct, go to %(activate_url)s\n" msgid "" "Hello from %(site_name)s!\n" "\n" "You're receiving this e-mail because user %(user_display)s has given yours " "as an e-mail address to connect their account.\n" "\n" "To confirm this is correct, go to %(activate_url)s\n" msgstr "" "Ciao da %(site_name)s!\n" "\n" "L'Utente %(user_display)s di %(site_name)s ha registrato questo indirizzo e-" "mail.\n" "Per confermare, clicca qui %(activate_url)s\n" Thanks Max

2 2

Change language to welcome message in mailman3
by Massimo Zappalà 30 Jul '20

30 Jul '20

Hi everyone, My Version installed on Debian buster: mailman3: 3.2.1 postorius: 1.2.4 hyperkitty: 1.2.2 All interfaces work well in Italian language, but "Welcome message" is in English. I'm trying to change the language to the "Welcome message" with mailman shell, but it doesn't work sudo mailman shell -l test(a)pratico.work >>>m.preferred_language='it' >>>commit() >>>CTRL-D This is my file /etc/mailman3/mailman-web.py LANGUAGE_CODE = 'it-IT' TIME_ZONE = 'Europe/Rome' USE_I18N = False USE_L10N = True USE_TZ = True Would anyone know how to do it? Thank you Max

2 10

Moderation of held emails vs. spam
by David Krantz 30 Jul '20

30 Jul '20

Hi, I now run Mailman 3.3.1, installed from pip. Is there now any way to prevent Mailman from forwarding the contents of the held message when notifying moderators of held messages? In my case these messages often are spam messages and if the entire contents are forwarded it triggers spam handling in the recipient address(es) which over time risks classifying all moderation emails as spam or even classifying the list domain or server as a spam source. Even my own outgoing filter classifies it as spam, which I will fix. I currently run rspamd for spam filtering, graylisting and DKIM and ARC verification/signing. Someone on this recommended it, thank you for that as it removes the need for other milters. I guess that this would be a simple change to make as a kludge but a proper implementation as a setting would be a lot better. I'd like it as a global setting but that might be too coarse. Cheers // David

2 2

Anyone integrated Single Sign On like Azure SSO with Mailman3?
by Jacob Bargery 29 Jul '20

29 Jul '20

We are looking at whether it is possible to integrate Azure Single Sign On with Mailman3 to streamline use for our users, has anyone had any luck with doing this? If so, how did you go about doing so? Thanks

3 2

mailman2 import not working
by Abhijith PA 29 Jul '20

29 Jul '20

Hello. Recently I migrated a mailman2 mailing list to mailmam3. There was one problem[1] I faced. Currently I am running Debian packaged version (3.2.2-1) which don't have this fix. But it was manually done with this[2] method. Basically this is what I did for migration: ------------------------------------------- mailman create -o <foo(a)example.com> foo-bar(a)lists.example.com mailman import 21 foo-bar(a)lists.example.com path/to/config.pck ------------------------------------------- Then imported archives with ------------------------------------------ python3 manage.py hyperkitty_import --pythonpath /usr/share/mailman3-web --settings settings -l foo-list(a)list.example.com <path to>/foo-list.mbox python3 manage.py update_index_one_list foo-list(a)example.com --pythonpath /usr/share/mailman3-web --settings settings ------------------------------------------ After everything done tried a test mail, but didn't reach any of the inbox though mail is archived. mailman.log says message is accepted ACCEPT: <FEE2E515-C054-41E6-9853-744D3312A137(a)xxxxxx.org> Nothing after this. On smtp.log we have Jul 29 16:11:52 2020 (16161) Peer: ('127.0.0.1', 54792) Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) handling connection Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'LHLO lists.xxxxxxx.in' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'MAIL FROM:<abhijith(a)xxxxxxxxx.org>' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) sender: abhijith(a)xxxxxxx.org Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'RCPT TO:<temptest(a)lists.xxxxxxxxxx.in>' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) recip: temptest(a)lists.xxxxxxxxxx.in Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'DATA' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'QUIT' Please help. Abhijith [1] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… [2] - https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…

2 3

Could not locate column in row for column 'user.id'
by Shashikanth Komandoor 28 Jul '20

28 Jul '20

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 in production environment from the past 2 months almost. From the past few days, I found my server is responding to the users very slowly and throwing the Server Error page (of course getting the required page after multiple refreshes) for almost every click on the postorius pages (not yet observed on hyperkitty front end which in fact is not so important for me as of now). During that time, I observed in the mailman.log an error message saying "Could not locate column in row for column 'user.id'". The complete traceback log is attached with the mail. The error message is generated for almost all the lists and all the clicks. And despite this error message, I don't know how the required page is loaded after a few refreshes of the webpage. I don't know how to resolve this issue. Please advise. Also, please let me know if anything I need to share with you. -- Thanks & Regards, Shashi Kanth.K 9052671936

2 5

Creating superuser - problem with documentation or it's just me?
by Odhiambo Washington 28 Jul '20

28 Jul '20

Hi, In my quest to create a superuser, I followed another HOWTO - https://docs.mailman3.org/en/latest/devsetup.html (venv) [root@gw /opt/mailman/git/mailman-suite/mailman-suite_project]# python manage.py migrate Traceback (most recent call last): File "manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/core/management/__init__.py", line 401, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/core/management/__init__.py", line 377, in execute django.setup() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/__init__.py", line 24, in setup apps.populate(settings.INSTALLED_APPS) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/apps/registry.py", line 114, in populate app_config.import_models() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/apps/config.py", line 211, in import_models self.models_module = import_module(models_module_name) File "/usr/local/lib/python3.7/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1006, in _gcd_import File "<frozen importlib._bootstrap>", line 983, in _find_and_load File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 677, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 728, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/opt/mailman/git/hyperkitty/hyperkitty/models/__init__.py", line 25, in <module> from .category import ThreadCategory File "/opt/mailman/git/hyperkitty/hyperkitty/models/category.py", line 61, in <module> class ThreadCategory(models.Model): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/models/base.py", line 121, in __new__ new_class.add_to_class('_meta', Options(meta, app_label)) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/models/base.py", line 325, in add_to_class value.contribute_to_class(cls, name) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/models/options.py", line 208, in contribute_to_class self.db_table = truncate_name(self.db_table, connection.ops.max_name_length()) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/__init__.py", line 28, in __getattr__ return getattr(connections[DEFAULT_DB_ALIAS], item) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/utils.py", line 207, in __getitem__ backend = load_backend(db['ENGINE']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/utils.py", line 111, in load_backend return import_module('%s.base' % backend_name) File "/usr/local/lib/python3.7/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/db/backends/sqlite3/base.py", line 14, in <module> from sqlite3 import dbapi2 as Database File "/usr/local/lib/python3.7/sqlite3/__init__.py", line 23, in <module> from sqlite3.dbapi2 import * File "/usr/local/lib/python3.7/sqlite3/dbapi2.py", line 27, in <module> from _sqlite3 import * ModuleNotFoundError: No module named '_sqlite3' *<==============================================================* (venv) [root@gw /opt/mailman/git/mailman-suite/mailman-suite_project]# pip install pysqlite3 Collecting pysqlite3 Using cached pysqlite3-0.4.3.tar.gz (40 kB) Building wheels for collected packages: pysqlite3 Building wheel for pysqlite3 (setup.py) ... done WARNING: Legacy build of wheel for 'pysqlite3' created no files. Command arguments: /opt/mailman/mm/venv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-ge24cqof/pysqlite3/setup.py'"'"'; __file__='"'"'/tmp/pip-install-ge24cqof/pysqlite3/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ou7p1uhx Command output: [use --verbose to show] Running setup.py clean for pysqlite3 Failed to build pysqlite3 Installing collected packages: pysqlite3 Running setup.py install for pysqlite3 ... done Successfully installed pysqlite3 <============================================================== But even after that, the error about *'ModuleNotFoundError: No module named '_sqlite3'* still persists.. How does one solve this issue?? So I figured out that I need to put my own settings_local.py into the directory and let the command rely on MySQL as the database backend since by default, it uses sqlite3 backend. But the question then is WHY is this not documented on the above page??? How can I delete the superuser after creating it?? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

2 5

# comment allowed in a template file?
by skenny＠scss.tcd.ie 28 Jul '20

28 Jul '20

I've found that dropping files in to the templates directory is a simple and convenient way to make certain things happen. E.g. I can set a default footer for all posts by putting the desired content in a file called var/templates/site/en/list:member:generic:footer.txt. I'm running Mailman 3 in maxking's Docker container. I'm also using Puppet to do as much configuration as possible, so I'd like to add a comment to the file that reads something like: # This file is managed by Puppet. Is it ok to do this? I may not have searched the docs enough, but I couldn't find anything relating to comments. One other observation in case it's any use: Initially, I created the template files with owner set to "root". This resulted in postings to lists getting stuck in mailman-core. It's vital that these files are owned by user "mailman". Once I changed the owner of the file to the latter, everything worked. Stephen

3 4

MM3 not starting afte an upgrade
by Gelpi Andrea 28 Jul '20

28 Jul '20

Hi, to day in a Debian system I upgraded some packages. After the MM3 doesn't start anymore. These are the packages I upgraded: [UPGRADE] clamav:amd64 0.102.3+dfsg-1 -> 0.102.4+dfsg-1 [UPGRADE] clamav-base:amd64 0.102.3+dfsg-1 -> 0.102.4+dfsg-1 [UPGRADE] clamav-daemon:amd64 0.102.3+dfsg-1 -> 0.102.4+dfsg-1 [UPGRADE] clamav-freshclam:amd64 0.102.3+dfsg-1 -> 0.102.4+dfsg-1 [UPGRADE] clamdscan:amd64 0.102.3+dfsg-1 -> 0.102.4+dfsg-1 [UPGRADE] gcc-10-base:amd64 10.1.0-4 -> 10.1.0-6 [UPGRADE] libc-l10n:amd64 2.30-8 -> 2.31-1 [UPGRADE] libclamav9:amd64 0.102.3+dfsg-1 -> 0.102.4+dfsg-1 [UPGRADE] libgcc-s1:amd64 10.1.0-4 -> 10.1.0-6 [UPGRADE] libnss3:amd64 2:3.42.1-1+deb10u2 -> 2:3.42.1-1+deb10u3 [UPGRADE] python3-django-hyperkitty:amd64 1.3.2-1 -> 1.3.2-1.1 [UPGRADE] python3-django-postorius:amd64 1.3.2-2 -> 1.3.2-2.1 [UPGRADE] qemu-guest-agent:amd64 1:3.1+dfsg-8+deb10u5 -> 1:3.1+dfsg-8+deb10u6 MM3 on start up says: Jul 23 13:29:39 posta mailman3[2608]: Traceback (most recent call last): Jul 23 13:29:39 posta mailman3[2608]: File "/usr/bin/mailman", line 11, in <module> Jul 23 13:29:39 posta mailman3[2608]: load_entry_point('mailman==3.2.1', 'console_scripts', 'mailman')() Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__ Jul 23 13:29:39 posta mailman3[2608]: return self.main(*args, **kwargs) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main Jul 23 13:29:39 posta mailman3[2608]: rv = self.invoke(ctx) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 69, in invoke Jul 23 13:29:39 posta mailman3[2608]: return super().invoke(ctx) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke Jul 23 13:29:39 posta mailman3[2608]: return _process_result(sub_ctx.command.invoke(sub_ctx)) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke Jul 23 13:29:39 posta mailman3[2608]: return ctx.invoke(self.callback, **ctx.params) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke Jul 23 13:29:39 posta mailman3[2608]: return callback(*args, **kwargs) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func Jul 23 13:29:39 posta mailman3[2608]: return f(get_current_context(), *args, **kwargs) Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/mailman/commands/cli_control.py", line 81, in start Jul 23 13:29:39 posta mailman3[2608]: status, lock = master_state() Jul 23 13:29:39 posta mailman3[2608]: File "/usr/lib/python3/dist-packages/mailman/bin/master.py", line 104, in master_state Jul 23 13:29:39 posta mailman3[2608]: os.kill(pid, 0) Jul 23 13:29:39 posta mailman3[2608]: PermissionError: [Errno 1] Operation not permitted There is a permission error, but on what? Thanks for any help. Regards -- Gelpi ing. Andrea -------------------------------------------------------------- It took the computing power of three C-64s to fly to the Moon. It takes a 486 to run Windows 95. Something is wrong here. --------------------------------------------------------------

3 7

sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none()
by Shashikanth Komandoor 28 Jul '20

28 Jul '20

Hi Team, Today, I found an error message like "Multiple rows were found for one_or_none()" when a hold message is approved for a list. Until yesterday the mails were accepted and delivered fine. But today the above said error message is thrown. Apart from that, I saw the mail had gone into the shunt queue. The "mailman qfile" output of the shunt message and the respective traceback log from mailman.log are attached. You may please go through them and help me out. Please also let me know if I have to share any more details. -- Thanks & Regards, Shashi Kanth.K 9052671936

2 5

Running Mailman3 under supervisord
by Odhiambo Washington 27 Jul '20

27 Jul '20

Hello world, Is it possible to run MM3 under supervisord? What would I use for command= ?? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

3 4

mailman3 nightly script(s) are leaking memory + mitigation
by Mark Dadgar 24 Jul '20

24 Jul '20

So as I mentioned in another thread, I have a shiny new install of mailman3 latest using venv (thanks, Brian!). It’s running on ubuntu 20.04 using python 3.8.2, django 2.2.12, nginx, postgres, and memcached. The only functions this server runs are 1) postfix and dovecot for a small number of personal email accounts, and 2) mailman3 for a couple of mailing lists (one of which is fairly high traffic). Not long after install, I saw a couple of instances of the OOM killer activating in the logs. I set up a 1GB swapfile (discouraged on Digital Ocean instances because they don’t like their flash drives to take that kind of pounding) as a safety net. Then I saw the free swap space eroding over time, so I started collecting some data. Initial evening stats: top - 23:29:16 up 15 days, 9:20, 1 user, load average: 0.07, 0.16, 0.17 Tasks: 200 total, 1 running, 199 sleeping, 0 stopped, 0 zombie %Cpu(s): 2.0 us, 1.7 sy, 0.0 ni, 96.3 id, 0.0 wa, 0.0 hi, 0.1 si, 0.0 st MiB Mem : 3936.2 total, 264.9 free, 1651.4 used, 2019.9 buff/cache MiB Swap: 1000.0 total, 811.2 free, 188.8 used. 1854.5 avail Mem Stats the next morning: top - 08:42:15 up 13 days, 18:33, 1 user, load average: 0.29, 0.27, 0.19 Tasks: 204 total, 1 running, 203 sleeping, 0 stopped, 0 zombie %Cpu(s): 2.5 us, 1.4 sy, 0.0 ni, 96.0 id, 0.0 wa, 0.0 hi, 0.1 si, 0.0 st MiB Mem : 3936.2 total, 214.7 free, 2244.8 used, 1476.7 buff/cache MiB Swap: 1000.0 total, 500.3 free, 499.7 used. 1318.8 avail Mem Stats the next evening: top - 23:26:00 up 14 days, 9:17, 1 user, load average: 0.10, 0.06, 0.08 Tasks: 209 total, 1 running, 208 sleeping, 0 stopped, 0 zombie %Cpu(s): 2.6 us, 1.7 sy, 0.0 ni, 95.2 id, 0.3 wa, 0.0 hi, 0.3 si, 0.1 st MiB Mem : 3936.2 total, 206.0 free, 2253.6 used, 1476.6 buff/cache MiB Swap: 1000.0 total, 485.9 free, 514.1 used. 1305.5 avail Mem Stats the following morning: top - 08:09:32 up 14 days, 18:01, 1 user, load average: 0.01, 0.07, 0.14 Tasks: 194 total, 1 running, 193 sleeping, 0 stopped, 0 zombie %Cpu(s): 2.0 us, 1.4 sy, 0.0 ni, 96.6 id, 0.0 wa, 0.0 hi, 0.1 si, 0.0 st MiB Mem : 3936.2 total, 270.6 free, 1974.5 used, 1691.2 buff/cache MiB Swap: 1000.0 total, 266.5 free, 733.5 used. 1545.1 avail Mem As you can see, something during the night is eating memory and not letting it go. If I restart gunicorn, I get the memory back: sudo systemctl restart gunicorn top - 08:52:29 up 14 days, 18:44, 1 user, load average: 0.71, 0.49, 0.25 Tasks: 243 total, 1 running, 242 sleeping, 0 stopped, 0 zombie %Cpu(s): 6.1 us, 3.0 sy, 0.0 ni, 90.9 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st MiB Mem : 3936.2 total, 936.3 free, 1277.1 used, 1722.9 buff/cache MiB Swap: 1000.0 total, 804.8 free, 195.2 used. 2242.5 avail Mem I did a little googling and a mitigation that seems to mostly work is to have gunicorn retire its workers periodically to free up memory. gunicorn.cf: max_requests = 1000 max_requests_jitter = 50 That restarts a worker after 1000 requests and adds some jitter so they don’t all get restarted at the same time. I am still seeing the erosion of a couple of MB of swap each day, but it’s WAY better than losing 250MB-350MB overnight. FYI for others who may see this. - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 1

Re: Mailman REST API not available. Please start Mailman Core.
by Shashikanth Komandoor 23 Jul '20

23 Jul '20

Thank you Mark for your response. I understood that gunicorn is a front end that is used like web server like nginx. But I don't think I am using it instead I am using the httpd to redirect requests to postorius. And I am starting the mailman-suite with the command "python manage.py runserver 0.0.0.0:8000 --insecure &". Hope this does not use gunicorn (which of course I don't know what it is until now). Please correct me if any point I am mentioning is wrong. So, in this case, do you think configuring gunicorn as below would work: *calling gunicorn.cfg in mailman.cfg as below * *[webservice]* *configuration: /var/lib/mailman/mailman/src/mailman/config/gunicorn.cfg* *and content of gunicorn.cfg as below* *(venv3) [root@lsmgr mailman]# cat /var/lib/mailman/mailman/src/mailman/config/gunicorn.cfg[gunicorn]# All the options that can be put here are available at# http://docs.gunicorn.org/en/stable/settings.html#settings <http://docs.gunicorn.org/en/stable/settings.html#settings># No of seconds to wait before killing the worker processes.* *workers = 4graceful_timeout = 90* Also what is the difference between timeout and graceful_timeout ? Please help me if I can increase the management better. Any guide is also helpful for me. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> On Thu, Jul 23, 2020 at 4:10 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 7/22/20 9:21 AM, Shashikanth Komandoor wrote: > > Hi Mark, > > > > Never mind please I am sending to you only instead of group as I am > > sending you the production content along with the mail. > > > See my other reply. > > > > I have configured the workers count as 4 and timeout as 900 in > > mailman.cfg under [webservice]. This is FYI. > > You can't configure Mailman's REST gunicorn workers directly in the > [webservice] section of mailman.cfg. The only thing you can configure > there is: > > configuration: /path/to/gunicorn.cfg > > That file, which is separate from your web server gunicorn.cfg, is where > you put things like > > [gunicorn] > timeout = 900 > > It also will not work to put a gunicorn section in mailman.cfg. It must > be in a separate file pointed to by webservice.configuration. > > Increasing the number of workers won't help this issue. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > -- Thanks & Regards, Shashi Kanth.K 9052671936

3 2

Re: [ERROR] Error handling request List archivers
by Shashikanth Komandoor 23 Jul '20

23 Jul '20

Thank you Mark for guiding me to the benefit of putting the list and so I have added the list. Along with the [archiver.hyperkitty], [mta] and [database], few lines of my mailman.cfg look like below: *[webservice]workers = 4timeout = 900* The above block of webservice is added yesterday for testing or trail as I am getting the above issue. And there is no line that is calling *gunicorn* in my mailman.cfg. Apart from that I tried to locate and see the content of the gunicorn.cfg file as below : *(venv3) [root@lsmgr mailman]# cat /var/lib/mailman/mailman/src/mailman/config/gunicorn.cfg[gunicorn]# All the options that can be put here are available at# http://docs.gunicorn.org/en/stable/settings.html#settings <http://docs.gunicorn.org/en/stable/settings.html#settings># No of seconds to wait before killing the worker processes.graceful_timeout = 30* Please confirm the time I have to change is *graceful_timeout *in *gunicorn.cfg* and if I have changed how do I restart the *gunicorn*. I have never used or never known about this *gunicorn* but still running the service in production. Please help me and also suggest if I could provide you any more data from giving resolution. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#m_5710631741815235215_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> On Thu, Jul 23, 2020 at 3:47 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 7/22/20 9:13 AM, Shashikanth Komandoor wrote: > > > Never mind please I am sending to you only instead of group as I am > sending you the production content along with the mail. > > I don't see anything there that can't be posted to the > mailman-users(a)mailman3.org list. If your concern is revealing the > support-tnvc.lsmgr.nic.in list id, just replace it with <list-id> or > list.example.com or similar. > > Messages sent to me personally rather than the list suffer many > problems. They are my absolute last priority, and I am only one person, > the collective knowledge of the list is greater. Also, at times I am off > line for several days or longer. > > Finally, there is no opportunity for other members of the community to > benefit from an off-list exchange. > > > When I am trying to browse one of my lists, I am getting "[ERROR] > > Error handling request /3.1/lists/support-tnvc.lsmgr.nic.in/archivers > > <http://support-tnvc.lsmgr.nic.in/archivers>" in the mailman.log and the > > full error message is in attachment. > > Try increasing your gunicorn worker timeout from the default 30 seconds. > I.e., add > > timeout = 90 > > to your gunicorn.cfg and restart gunicorn. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

migration plan and auto responder
by Mohsen Masoudfar 23 Jul '20

23 Jul '20

Hi, I am writing this in the hope to get some good advises for migration lists from Mailman2 to Mailman3. Thanks a lot in advance. Here is the requirements: * During the migration the old system shouldn't process the emails for the list under migration in the normal way. It should send an email, and only one to the member who sent the original email to the list saying the list is under migration. I know I could do this by auto responder, but the original email would be processed and sent to all members, which I want to block . * After migration the old system should send, per auto responder again, an email to the member who sent to the list, mentioning the new address (the domain is a new one, the list name the same), but again not sending the original email to the list members. * No hackers, robots, spammers should get the new list address. The lists are all hidden. Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

2 4

Python 3.5 support?
by Joel Lord 22 Jul '20

22 Jul '20

I'm looking through the recent changes to Core and Postorius and I keep spotting what looks like removal of the test cases for Python 3.5. Is the next release going to be dropping support for 3.5? Is this because 3.5 is going EOL shortly or because there are changes in the upcoming release that actively will not work on 3.5? -- Joel Lord

2 1

Docker Support Sucks
by Brian Carpenter 22 Jul '20

22 Jul '20

Ok, now that I got that out of the way. Maybe I can get some help here for a Docker Installation of Mailman 3. I updated a Maxking's Docker installation to Postorius 1.3.3. It made my client's list unusable to a continual stream of removals due to ghost bounce processes. So, I want to totally move away from the use of Docker (mainly because I have found it buggy and the support is simply lacking) and install Mailman 3 for this client from source. However I need to get an export of their list members. But of course, I can't. Rest API times out and I don't know how to apply the instructions I was given to fix it and I don't have days to way for one. So please help. I increased the gunicorn workers to 4, hoping that would allow me to do the CSV export. No. So was given these instructions: ### The issues seems to be due to timeout not due to high load. You want to increase the timeout for gunicorn and you can do that by specifying a gunicorn.ini config file: [webservice] configuration: /path/to/gunicorn.cfg and then in the gunicorn.cfg you can add [gunicorn] timeout = 90 graceful_timeout = 30 ### I applied the above changes to /opt/mailman/core/mailman-extra.cfg and created the gunicorn.cfg file. Restarted the docker container (mailman-core) and no access to Postorius due to no REST api. After restarting docker-mailman, I can't access Postorius due to the following error: ERROR 2020-07-20 20:16:27,351 15 postorius Mailman REST API not available Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 160, in _new_conn (self._dns_host, self.port), self.timeout, **extra_kw File "/usr/lib/python3.6/site-packages/urllib3/util/connection.py", line 84, in create_connection raise err File "/usr/lib/python3.6/site-packages/urllib3/util/connection.py", line 74, in create_connection sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 677, in urlopen chunked=chunked, File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 392, in _make_request conn.request(method, url, **httplib_request_kw) File "/usr/lib/python3.6/http/client.py", line 1254, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.6/http/client.py", line 1300, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.6/http/client.py", line 1249, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.6/http/client.py", line 1036, in _send_output self.send(msg) File "/usr/lib/python3.6/http/client.py", line 974, in send self.connect() File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 187, in connect conn = self._new_conn() File "/usr/lib/python3.6/site-packages/urllib3/connection.py", line 172, in _new_conn self, "Failed to establish a new connection: %s" % e urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f96340a2e10>: Failed to establish a new con$ During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 725, in urlopen Commenting out "configuration: /opt/mailman/gunicorn.cfg" brings Postorius back up. I am really frustrated here. All I want to do is export a 3000 member list and I can't. Updating Mailman 3 using new Docker images shouldn't break a stable installation either. Please help. Brian

3 4

Fwd: HOWTO: Mailman 3 Equivalent of "Accept: @all"
by Abhilash Raj 21 Jul '20

21 Jul '20

Please use the mailman-users(a)mailman3.org list for questions related to Mailman 3 usage. Abhilash ----- Original message ----- From: "hmills(a)t-online.de" <hmills(a)t-online.de> To: "mailman-users-owner(a)mailman3.org" <mailman-users-owner(a)mailman3.org> Subject: HOWTO: Mailman 3 Equivalent of "Accept: @all" Date: Tuesday, July 21, 2020 9:31 AM Greetings, I have a question concerning usage of mailman3 (not an installation issue). Previously we used mailman2 & changed to mailman3 some months ago. "We" being a sports club located in Northern Germany. I guess I'm the "List Administrator" & "Moderator" - a colleague is the "Site Administrator". We use a number of maillists - one for "all" members and further ones e.g. for "instructors", "juniors" and so on. With mailman 2 it was possible to add "Accept: @all" in the configuration of the smaller maillists such as "instructors" thus enabling any club member to mail to the "instructors" but mails amongst the "instructors" remained just with themselves. Up to now we cannot do this with mailman3 which means I have to frequently approve mails (with the associated delay). I'm told (but not "how to do it") that with the recent update to mailman3 which our Site Administrator has installed it should be possible to do the "Accept: @all" mechanism - or similar. Could some kind soul please simply explain how I can achieve this? Best Wishes Howard -- thanks, Abhilash Raj (maxking)

1 0

Mail going to Held Messaging even the moderation is set to Accept Immediately
by Shashikanth Komandoor 21 Jul '20

21 Jul '20

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 in production environment from the past 2 months almost. Recently I observed a peculiar case. There is a list say testlist(a)lists.testdom.com has a member say testuser(a)testdom.com whose Moderation attribute is set to "Accept immediately (bypass all other rules)". It is expected that the mail should be delivered to the recipients without being held irrespective of the body content as per my knowledge. (Correct me if I am wrong). But the mail went to "held messages" and is waiting for pending approval. The same user if he sends a normal and simple test mail, it is getting delivered automatically without coming to the "held message". And the same mail (which went to "held messages") is tried to be sent by another member whose moderation attribute is also set to "Accept immediately" only but observed the same effect as the message going to the "held messages". As per my understanding on Mailman 3, if the moderation attribute is set to "Accept immediately (bypass all other rules)" then without checking any rules, it should be delivered to the recipients of the list irrespective of the message or body of the message but is there any such checking if the body content or subject or any thing else is checked even if the moderation bit is set to "Accept immediately". Please help me to resolve this issue. Also, please let me know if I need to share any details. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

Sudden increase in "***UNCHECKED***" in email subjects
by Dave Clements 20 Jul '20

20 Jul '20

Hi all, I have just noticed a big jump in the number of emails going out with "***UNCHECKED***" added to the subject line. Some of these are from users who had their moderation set to "Accept Immediately," but even after I change that to "Default processing" I am still getting those messages. The default action for members is "Default processing" Any ideas what settings I am missing? Thanks, Dave C -- https://bcc2020.github.io/ https://galaxyproject.org/

6 7

Confusing mailman user model
by Gilles Filippini 19 Jul '20

19 Jul '20

Hi, I'm trying to understand the Mailman user model, and I'm confused about the respective roles of tables 'auth_user' and 'user'. Both have an 'id' column referred to as 'user_id' when used as a foreign key. But there seems to be no relation at all between them as they use different ids for the same user. Our mailman server was migrated from mailman2 to mailman3 about 1.5 year ago, and there is an inconsistency I'd like to fix: 2 of our users have a registered Mailman account with their respective email addresses in table 'auth_user', but these very same addresses in the 'address' table are linked to another old admin account in the 'user' table. Then if add one of these addresses as a domain owner, it it the old admin address which is selected instead. How could I fix that? Thanks in advance, _g.

2 4

Creating new lists
by Gilles Filippini 19 Jul '20

19 Jul '20

Hi, I'd like to delegate lists creation to a couple of other users. I've added their email addresses as domain owners, but still they don't have the "Create New List" button available. Which condition a mailman user has to fulfill to be allowed to create new lists? Thanks, _g.

3 4

How to setup mailman?
by waqar.pixako＠gmail.com 17 Jul '20

17 Jul '20

Hi @all I need to maintain mailing via api. I need to setup mailman for this purpose. I don't know how to setup it & how does it works. Please help me to resolve this issue. Thanks

3 2

Also deleted website example.com
by w.schoener＠alp.dillingen.de 17 Jul '20

17 Jul '20

Hi there, i also deleted the website example.com, while I tried to configure my mailman 3 site. Now I get a Server-error, when I try to open my mailman3 sites: "An error occurred while processing your request" I tried to fix this problem by changing the SITE_ID=2 in my settings_local.py. But nothing helped, also the SITE_ID=0 did change nothing. I made a "/etc/init.d/apache2 restart" to ensure, that the settings are loaded again, but it didnt help. Is there anything I can do, besides reinstalling all django and mailman 3? Mailman Version 3.2.1, Python 2.7.16, Django 1.11.28 Thanks for any hints :-) Wolfgang

2 1

The Use of Hyperkitty as a Forum and Archiver
by Brian Carpenter 15 Jul '20

15 Jul '20

Dear Mailman 3 Users, Since Mailman 3 includes a forum feature via Hyperkitty, I would like to know the following: - Has the forum feature (Hyperkitty) of MM3 been received well by your list members or is it mostly ignored? - Do you see an increase in the use of HK as a forum from your list members? - What kind of feedback have you received from your list members considering the forum function of MM3? Positive or negative? - Do you think HK is received well by your list members as an archiver and do you think it provides a better user experience for viewing/searching archives vs Pipermail of MM2? Thank you for anything you shared. I am very curious to know the state of Hyperkitty among the Mailman 3 user community. -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

4 4

R: Re: mailman3 does not send to the members of the lists
by blackout69 13 Jul '20

13 Jul '20

Hi, my mailman.cfg [mailman] site_owner: admin(a)pratico.work noreply_address: noreply default_language: en sender_headers: from from_ reply-to sender email_commands_max_lines: 10 pending_request_life: 3d cache_life: 7d pre_hook: post_hook: layout: debian filtered_messages_are_preservable: no html_to_plain_text_command: /usr/bin/lynx -dump $filename listname_chars: [-_.0-9a-z] [shell] prompt: >>> banner: Welcome to the GNU Mailman shell use_ipython: no history_file: [paths.debian] var_dir: /var/lib/mailman3 queue_dir: $var_dir/queue bin_dir: /usr/lib/mailman3/bin list_data_dir: $var_dir/lists log_dir: /var/log/mailman3 lock_dir: $var_dir/locks data_dir: $var_dir/data cache_dir: $var_dir/cache etc_dir: /etc/mailman3 ext_dir: $var_dir/ext messages_dir: $var_dir/messages archive_dir: $var_dir/archives template_dir: $var_dir/templates pid_file: /run/mailman3/master.pid lock_file: $lock_dir/master.lck [database] class: mailman.database.mysql.MySQLDatabase url: mysql+pymysql://mailman3:dbpassword@localhost/mailman3?charset=utf8&use_unicode=1 debug: no [logging.debian] format: %(asctime)s (%(process)d) %(message)s datefmt: %b %d %H:%M:%S %Y propagate: no level: info path: mailman.log [webservice] hostname: localhost port: 8001 use_https: no show_tracebacks: yes api_version: 3.1 admin_user: rest_user admin_pass: rest_pass [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver smtp_host: localhost smtp_port: 25 smtp_user: smtp_pass: lmtp_host: 127.0.0.1 lmtp_port: 8024 configuration: python:mailman.config.postfix [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /etc/mailman3/mailman-hyperkitty.cfg

4 8

Re: Using external services for deliverability?
by Tom ＠ Gather 13 Jul '20

13 Jul '20

Thank you both for the help. I have SPF and reverse DNS setup. But I thought DKIM is no help because Mailman rewrites the email headers?

4 5

mailman3 does not send to the members of the lists
by maszap＠tin.it 12 Jul '20

12 Jul '20

Goodmorning everyone, I'm setting up a mail server to manage a mailinglist. I installed mailman3-full and configured everything. I can create a list, add members to the list, but when I create a new thread, I only get it on the email from the same domain as the list. While all the other members of the list, they do not receive the thread. I tried to check the logs, but I don't see anything significant. What can I check? Thank you in advance Max

2 7

Mail control not given from Mailman 3 to postfix
by Shashikanth Komandoor 12 Jul '20

12 Jul '20

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 in production environment from the past 2 months almost. Recently I observed a peculiar case. There is a list say testlist(a)lists.testdom.com has a non member say testuser(a)testdom.com whose Moderation attribute is set to "Accept immediately (bypass all other rules). This testuser(a)testdom.com has sent a mail to testlist(a)lists.testdom.com and postfix of my Maliman 3 received the request and handed over to Mailman at 0.0.0.0:8024 socket running on the same machine and the same is logged in /var/log/maillog. Since the user has the moderation attribute set to Accept, the /var/lib/mailman/mailman/var/logs/vette.log also displayed "ACCEPT" on searching with the same message id. At this point, to my expectations, there should be 2 entries for this message id in smtp.log one for smtp and one for post. But I don't find any log records with this message id in smtp.log and of course the mail is not delivered even. Could you please help me out if I have missed any point or improperly understood the mail flow while using the mailman 3? Please also let me know if I need to see any more log files for tracing the issue. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 4

ARC
by David Krantz 11 Jul '20

11 Jul '20

Hi, A completely different question: Is there anyone that has a working non-naive setup for ARC signing of mail list mail in mailman? I've tried both the built-in version but it was not usable in the version I tried for the case where there are several domains with different selectors and keys and where the outgoing mail also is DKIM-signed. This might be that the documentation is lacking but a very shallow look in the source gave me the impression that the implementation is limited to one domain which is not enough for my use case as I have lists in several domains. I use DKIM on outgoing mail with a setup where each domain has its own keys and selectors. As discussed here earlier, the DKIM signature should be added before the ARC signature. I have tried to use rspamd after a tip here for this but without luck so far, but this is somewhat off topic for mailman although related of course. rspamd seems very good for other purposes and solves my other problems with greylisting, DKIM-signing and spam filtering. That said, ARC seems difficult to get to work for forwarded mails there also... cheers // David

2 1

Update a member's display_name
by Nick Wynja 08 Jul '20

08 Jul '20

Hi all, I want to update some list member's display_name either with mailman shell or mailmanclient. These mostly aren't users in Postorius so I only want to operate on the subscribed list member. I've tried everything I can find in the docs and am stuck. I've tried using `user_manager.get_user()` and then updating `user.display_name` followed by a `commit()` but it doesn't seem to persist the change. The `absorb_existing` flag for mailmanclient's `User.add_address()` looks promising but the docs read "It will import the existing user into the current one, not overwriting any previously set value." which in some cases, the member already has a display_name set. I haven't tried this yet. I'd appreciate any help pointing in the right direction. Thanks, Nick

5 10

Bounce handling after upgrade
by David Krantz 08 Jul '20

08 Jul '20

Hi, I am in the process of configuring a new mailman3 server based on my old one. This includes upgrading to the latest version of mailman and installing a database upgrade. To my surprise mailman core started by sending tens of mails and blocking the corresponding users for very old bounces. What is worse is that this happens every time I start mailman core. Now I have blocked (almost) all outgoing mail in postfix using a transport map which discards it but this is a temporary testing measure of course. When I deploy this server into production, I do not want these recipients to be blocked as the old problems have been solved since very long. My plan is to reload the database from a newer backup anyway... Would it be enough to empty the bounce table (bounceevent) or is there anything else driving this behaviour? Or is there a better way to do this via the mailman shell? For me a "delete from bounceevent" seems a lot simpler than anything via the shell but there may be dependencies in the database. Cheers // David

2 1

Crash while importing archives
by Mark Dadgar 08 Jul '20

08 Jul '20

This is actually an mbox file generated by mailman3. (venv) mailman@mail:/opt/mailman/mm$ /opt/mailman/mm/bin/django-admin hyperkitty_import --since 2020-02-19 -l trackjunkies(a)pdc-racing.net /temp/archive/trackjunkies-new-1.mbox Importing from mbox file /temp/archive/trackjunkies-new-1.mbox to trackjunkies(a)pdc-racing.net \Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 364, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 327, in handle importer.from_mbox(mbfile) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 152, in from_mbox for msg in mbox: File "/usr/lib/python3.8/mailbox.py", line 109, in itervalues value = self[key] File "/usr/lib/python3.8/mailbox.py", line 73, in __getitem__ return self.get_message(key) File "/usr/lib/python3.8/mailbox.py", line 781, in get_message msg.set_from(from_line[5:].decode('ascii')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 27: ordinal not in range(128) mailman 3.3.1 / core 3.1 Easy fix? I’m missing about 10 days' worth of archives as a result of this. - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 1

Importing list archives
by Mark Dadgar 07 Jul '20

07 Jul '20

So I got a shiny new instance of Mailman3 installed (thanks Brian!). I recreated my lists and I am now importing large historical list archives from an mbox file (24GB). It takes a couple of hours to run this import, so I killed the import task after about 20 minutes so I could restart it in a screen session. Now when I restart the import, it finishes almost immediately: (venv) mailman@mail:/opt/mailman/mm$ /opt/mailman/mm/bin/django-admin hyperkitty_import -l trackjunkies(a)pdc-racing.net trackjunkies.mbox Importing from mbox file trackjunkies.mbox to trackjunkies(a)pdc-racing.net Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the Django admin command with arguments 'update_index_one_list trackjunkies(a)pdc-racing.xn--net-to0a. (venv) mailman@mail:/opt/mailman/mm$ Which is clearly not correct. Anyone have an idea on how to restart this import? THanks! - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 2

Error after HyperKitty 1.3.x upgrade
by Florian Schulze 06 Jul '20

06 Jul '20

Hi! After upgrading to HyperKitty 1.3.x I get the following error for qcluster: File ".../lib/python3.7/site-packages/django_q/cluster.py", line 300, in pusher task = SignedPackage.loads(task[1]) File ".../lib/python3.7/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File ".../lib/python3.7/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File ".../lib/python3.7/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) AttributeError: Can't get attribute 'process_task_result' on <module 'hyperkitty.tasks' from '.../lib/python3.7/site-packages/hyperkitty/tasks.py'> How do I recover from that? It seems like there are still persisted tasks in the qcluster queue using the old code from 1.2.x with the old locking implementation. Regards, Florian Schulze

2 4

Using external services for deliverability?
by tom＠gather.coop 04 Jul '20

04 Jul '20

I have a Mailman 3 server up and running but I'm terrified to migrate to it from my existing Mailman 2 provider for fear that services like Gmail will randomly start blacklisting my IP with little I can do about it. I have SPF records set up so I'm hoping I'll be Ok but I'd like to have a backup plan. Has anyone ever tried using an external service like Mailgun or Sendgrid as a relay? I tried both but couldn't get either to work due to their sender authentication mechanism. They want all 'From:' headers to be from domains that are pre-authenticated as senders. But Mailman keeps the 'From' header from the original sender so it won't match any authenticated domains. Right? Is there anything to be done here or do I just have to migrate and pray?

3 6

Example Logrotate files for Mailman3
by Andrew Hodgson 03 Jul '20

03 Jul '20

Hi, Does anyone have any usable Logrotate files for Mailman3 (especially for the web stuff)? Will look to create my own if no one comes forward but if anyone has anything they are willing to share it would be fab. Thanks. Andrew.

2 2

hidden list is hidden even to the owner
by Mohsen Masoudfar 02 Jul '20

02 Jul '20

Hi, I am not sure, if it is designed this way, or I am doing something wrong. I created a list in MM3 as a hidden list, meaning: Show list on index page: NO and assigned the owner. When I login as Postorius web admin, I see the list on the list page which is listed as: (unadvertised*). This is fine. But when the owner or moderator login to Postorius they don't see the list at all. Of course if they add the list name at the end of the URL, they get to the list and as the owner can manage it too. My question is: I am just not sure, if I am missing something or this is how it is supposed to work? You could expect, that the owner or the moderator should see the list as (unadvertised*) too. Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

3 4

clarifying configuration
by trewtus+200629maitr＠gmail.com 30 Jun '20

30 Jun '20

Hey Team, I'm new to Mailman and after some failed attempts to install from git on CentOS8, I have just installed it on Ubuntu 20.04 using mostly aptitude. But it's not quite working and I want to increase the log level to better understand the problem. I did see another post that suggested that I add to /etc/mailman3/mailman.cfg [logging.template] level: debug But that doesn't work for me. For example, after using that `mailman conf` doesn't list and debug values and as far as I can tell, the service, even after restarting, is not logging any more than it was. On the other hand, if I add [logging.smtp] level: debug Invoking `mailman conf` will reflect that new loglevel. This started me down the path of trying to figure out the configuration system of mailman in hope that that will save me time down the road. I have read https://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html but that doesn't seem to agree with what I'm seeing. For an additional example, my mailman.cfg file has a "logging.debian" section, but I don't see that section listed in the `mailman conf` output. Why would that be? I don't see in the documentation if `mailman conf` only sees values after the service is restarted. Nevertheless, restarting mailman hasn't helped. What guidance can you give? Context: `mailman info` produces: GNU Mailman 3.2.2 (La Villa Strangiato) Python 3.8.2 (default, Apr 27 2020, 15:53:34) [GCC 9.3.0] config file: /etc/mailman3/mailman.cfg db url: sqlite:////var/lib/mailman3/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:KI5TuWE/v.....

2 1

Moderation of posts via email is not working in mailman 3
by Shashikanth Komandoor 30 Jun '20

30 Jun '20

Hi Team, In mailman 2, few of my users used to approve the held messages through the mail by writing Approved: header and the password of the list in the first line of the reply mail to the "confirm" attachment in the mail notification of the held messages. But after I started migrating my distribution lists from mailman 2 to mailman 3, my users are complaining that they could not approve the posts or the held messages through the mail as they usually do while they were browsing their lists in mailman 2. Is there any bug or limitation in mailman 3 or if I am doing any wrong at the server side? Please suggest. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 3

User settings triggers error
by Mark Dadgar 29 Jun '20

29 Jun '20

If one of my users (including admin) goes to their user drop-down in the upper-right of Postorius and clicks Mailman Settings, it triggers an error: Here’s the error log: Internal Server Error: /mailman3/postorius/accounts/subscriptions/ KeyError at /postorius/accounts/subscriptions/ 'file' Request Method: GET Request URL: https://mail.pdc-racing.net/mailman3/postorius/accounts/subscriptions/ <https://mail.pdc-racing.net/mailman3/postorius/accounts/subscriptions/> Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Tue, 16 Jun 2020 10:31:56 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/contrib/auth/decorators.py" in _wrapped_view 21. return view_func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/user.py" in user_subscriptions 307. memberships = [m for m in mm_user.subscriptions] File "/usr/lib/python3/dist-packages/mailmanclient/restobjects/user.py" in subscriptions 62. for address in self.addresses: File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __iter__ 221. for entry in self.rest_data: File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 197. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 36. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 91. log_response( File "/usr/lib/python3/dist-packages/django/utils/log.py" in log_response 222. getattr(logger, level)( File "/usr/lib/python3.8/logging/__init__.py" in error 1463. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.8/logging/__init__.py" in _log 1577. self.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 1587. self.callHandlers(record) File "/usr/lib/python3.8/logging/__init__.py" in callHandlers 1649. hdlr.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 950. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 119. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.8/tempfile.py" in __getattr__ 607. file = self.__dict__['file'] Exception Type: KeyError at /postorius/accounts/subscriptions/ Exception Value: 'file' Request information: USER: admin GET: No GET data POST: No POST data FILES: No FILES data Anyone got a solution to this? - Mark ----- mark(a)pdc-racing.net | 408-348-2878

3 21

Server 500 error for just one list, just one page
by kelly.close＠lrewater.com 28 Jun '20

28 Jun '20

I am having a curious problem with just ONE list management page for ONE list on my server. Every other list I've checked, and every other management page for this affected list, seem fine. But when I go to the Subscribers page for this one list I get a Server 500 error, and I can't find anything in the apache or mailman logs to give me a clue (granted I'm not sure I know for sure where all the different logs are). So specifically this page: https://udfcd-lists.org/mailman3/postorius/lists/alarms-all.udfcd-lists.org… For a list called "alarms-all" obviously. Any ideas? I'm able to review the list, it's members, etc in the PostsgreSQL tables and I'm not seeing any members with funky characters in their address - the one thing I could think of to check. Thanks, ~Kelly

2 1

Null sender?
by tom＠gather.coop 28 Jun '20

28 Jun '20

Does Mailman generally send email with a null sender? This is what I see in the log: Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) handling connection Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'LHLO mail.example.coop' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'MAIL FROM:<>' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) sender: <> Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'RCPT TO:<techque-bounces(a)example.org>' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) recip: techque-bounces(a)example.org Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'DATA' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'QUIT' Notice the empty MAIL FROM. Sendgrid seems to be choking on that because it needs to check if sending domain has been validated. If there is no sending domain it seems to reject. Why does Mailman do this? Can it be changed? I've been trying to find the relevant section of the code to no avail.

2 3

Hyperkitty 403 Forbidden Error
by Phil Thompson 25 Jun '20

25 Jun '20

I'm in the process of setting up mailman3. The only problem I seem to be having is getting Hyperkitty to archive messages. Rather than the authorisation problems people have previously asked about on the list, I am getting a 403 error... Aug 05 15:38:40 2019 (10229) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/urls: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Aug 05 15:38:58 2019 (10222) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/archive: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Any suggestions would be appreciated. Phil

6 16

HyperKitty failure
by Gelpi Andrea 24 Jun '20

24 Jun '20

Hi, in mailman log I found: Jun 20 17:36:49 2020 (1269) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/urls: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Jun 20 17:36:49 2020 (1263) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/archive: (405) Jun 20 17:36:49 2020 (1263) Exception in the HyperKitty archiver: Jun 20 17:36:49 2020 (1263) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", line 154, in _archive_message url = self._send_message(mlist, msg) File "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", line 210, in _send_message raise ValueError(result.text) ValueError And checking archive list I notice nothing has been added. Is it a permission issue (where?) or something else? Thanks in advance. -- Gelpi ing. Andrea -------------------------------------------------------------- It took the computing power of three C-64s to fly to the Moon. It takes a 486 to run Windows 95. Something is wrong here. --------------------------------------------------------------

3 4

List archives Recent Posts problem
by Mark Dadgar 23 Jun '20

23 Jun '20

In the last day or so, hitting the Recent page in my list archives results in a spinner and an error message: Internal Server Error: /mailman3/hyperkitty/list/trackjunkies(a)pdc-racing.net <mailto:mailman3/hyperkitty/list/trackjunkies@pdc-racing.net>/recent-threads AttributeError at /hyperkitty/list/trackjunkies(a)pdc-racing.net <mailto:hyperkitty/list/trackjunkies@pdc-racing.net>/recent-threads 'NoneType' object has no attribute 'subject' Request Method: GET Request URL: https://mail.pdc-racing.net/mailman3/hyperkitty/list/trackjunkies@pdc-racin… <https://mail.pdc-racing.net/mailman3/hyperkitty/list/trackjunkies@pdc-racin…> Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Thu, 18 Jun 2020 08:58:02 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/template/base.py" in _resolve_lookup 829. current = current[bit] During handling of the above exception ('Thread' object is not subscriptable), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/lib/view_helpers.py" in inner 135. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mlist.py" in overview_recent_threads 194. return render(request, "hyperkitty/fragments/overview_threads.html", { File "/usr/lib/python3/dist-packages/django/shortcuts.py" in render 36. content = loader.render_to_string(template_name, context, request, using=using) File "/usr/lib/python3/dist-packages/django/template/loader.py" in render_to_string 62. return template.render(context, request) File "/usr/lib/python3/dist-packages/django/template/backends/django.py" in render 61. return self.template.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 171. return self._render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in _render 163. return self.nodelist.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/usr/lib/python3/dist-packages/django/template/defaulttags.py" in render 309. return nodelist.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/usr/lib/python3/dist-packages/django/template/defaulttags.py" in render 209. nodelist.append(node.render_annotated(context)) File "/usr/lib/python3/dist-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 987. output = self.filter_expression.resolve(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in resolve 671. obj = self.var.resolve(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in resolve 796. value = self._resolve_lookup(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in _resolve_lookup 837. current = getattr(current, bit) File "/usr/lib/python3/dist-packages/hyperkitty/models/thread.py" in subject 108. return self.cached_values["subject"]() File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in __call__ 59. return self.get_or_set(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in get_or_set 55. value = self.rebuild(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in rebuild 47. value = self.get_value(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/thread.py" in get_value 223. return self.instance.starting_email.subject Exception Type: AttributeError at /hyperkitty/list/trackjunkies(a)pdc-racing.net <mailto:hyperkitty/list/trackjunkies@pdc-racing.net>/recent-threads Exception Value: 'NoneType' object has no attribute 'subject' Request information: USER: admin Thoughts? Other than that I really need to migrate off the Ubuntu packages and into the latest docker image. 😁 - Mark ----- mark(a)pdc-racing.net | 408-348-2878

3 4

Relaying email from external SMTP server (office365 or Exchange)
by Waqas Ahmed Khan 23 Jun '20

23 Jun '20

Hi, I have installed mailman3 with postfix. The server is working fine. To protect the IPs from blacklisting, I want to relay all emails from postfix/mailman to external SMTP servers like O365, Gmail, or our exchange server. Could you please confirm is this possible. And how to do its configuration. Regards, *Waqas Ahmed Khan* p: +923212608044 Skype: waqas-ahmed00 <waqas.ahmed0(a)gmail.com> waqas.ahmed0(a)gmail.com [image: LinkedIn] <http://pk.linkedin.com/pub/waqas-ahmed-khan/15/96a/39a/> <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_cam…> Virus-free. www.avg.com <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_cam…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 3

Key Error when clicking on a list
by Jacob Bargery 21 Jun '20

21 Jun '20

I looked back and tried to see if this is related to the Filter_Vhost = true error. In the email log I received at the bottom where it lists settings I am seeing Filter_Vhost = false. So I am guessing it is not related I could be wrong though. I can see lists populated that have been created, but when I click to open them it immediately goes to page titled "Server Error" and reading "An error occurred while processing your request.". This is part of the email, I can include the rest with settings if that will help. Internal Server Error: /mailman3/postorius/lists/testlist.groups.smccme.edu/ KeyError at /postorius/lists/testlist.groups.smccme.edu/ 'file' Request Method: GET Request URL: http://groups.smccme.edu/mailman3/postorius/lists/testlist.groups.smccme.ed… Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Fri, 19 Jun 2020 15:58:55 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in view 71. return self.dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/generic.py" in dispatch 65. return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in dispatch 97. return handler(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/list.py" in get 252. 'hyperkitty' in self.mailing_list.archivers and # noqa: W504 File "/usr/lib/python3.8/_collections_abc.py" in __contains__ 666. self[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __getitem__ 151. return self._get(key) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in _get 90. return self.rest_data[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 76. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 36. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 91. log_response( File "/usr/lib/python3/dist-packages/django/utils/log.py" in log_response 222. getattr(logger, level)( File "/usr/lib/python3.8/logging/__init__.py" in error 1463. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.8/logging/__init__.py" in _log 1577. self.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 1587. self.callHandlers(record) File "/usr/lib/python3.8/logging/__init__.py" in callHandlers 1649. hdlr.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 950. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 119. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.8/tempfile.py" in __getattr__ 607. file = self.__dict__['file'] Exception Type: KeyError at /postorius/lists/testlist.groups.smccme.edu/ Exception Value: 'file' Request information: USER: AnonymousUser GET: No GET data POST: No POST data FILES: No FILES data COOKIES: _gcl_au = '1.1.1102478800.1589213781' _ga = 'GA1.2.1690352573.1589213781' _fbp = 'fb.1.1589213781323.923398139' _vwo_uuid_v2 = 'DFA87B9402ED2688F901371C0D8762876|62ec9e1b3ef24592591d21d8721a02f4' __unam = '9d295ea-172141ffc75-1251e599-36' csrftoken = 'Pw0mKujRHosZ9QrA92GxhGVJHNN72qQBYU5NOMkizBHbdKSDLwjHIMsHnYdsNL3C'

2 3

Does mailman2 regular_exclude_list equal mailman3 receive_list_copy ?
by sunil soprey 21 Jun '20

21 Jun '20

Question: Reduce cross-posting to multiple lists (either BCC: or To: or CC:) Use-case: User sends email ( to: their email) and ( bcc: list1, list2 ) The sender-user and target-user1 (and target-userX) have receive_list_copy = False, and receive_own = True Issue: For mailman 3.3.1, a user receives their email from To:, however target receipients receive multiple copies of the emails. This is different from mailman2 with the regular_exclude_list. Questions: * this is a configuration issue or expected behaviour ? * target-user is a "user" who is member on list1 and list2 (verified via api) * see list-config - any missing? { "acceptable_aliases": [], "accept_these_nonmembers": [], "admin_immed_notify": true, "admin_notify_mchanges": false, "administrivia": true, "advertised": true, "allow_list_posts": true, "anonymous_list": false, "archive_policy": "public", "autorespond_owner": "none", "autorespond_postings": "none", "autorespond_requests": "none", "autoresponse_grace_period": "90d", "autoresponse_owner_text": "", "autoresponse_postings_text": "", "autoresponse_request_text": "", "bounces_address": "duplicate1-bounces(a)mydomain.local", "bounce_info_stale_after": "7d", "bounce_notify_owner_on_disable": true, "bounce_notify_owner_on_removal": true, "bounce_score_threshold": 5, "bounce_you_are_disabled_warnings": 3, "bounce_you_are_disabled_warnings_interval": "7d", "collapse_alternatives": false, "convert_html_to_plaintext": false, "created_at": "2020-05-31T14:43:48", "default_member_action": "defer", "default_nonmember_action": "hold", "description": "", "digest_last_sent_at": "2020-06-04T00:41:35", "digest_send_periodic": true, "digest_size_threshold": 30.0, "digest_volume_frequency": "monthly", "digests_enabled": true, "display_name": "Duplicate1", "discard_these_nonmembers": [], "dmarc_mitigate_action": "munge_from", "dmarc_mitigate_unconditionally": true, "dmarc_moderation_notice": "", "dmarc_wrapped_message_text": "", "filter_action": "discard", "filter_content": true, "filter_extensions": [ "exe", "bat", "cmd", "com", "pif", "cpl" ], "filter_types": [], "first_strip_reply_to": false, "forward_unrecognized_bounces_to": "administrators", "fqdn_listname": "duplicate1(a)mydomain.local", "gateway_to_mail": false, "gateway_to_news": false, "hold_these_nonmembers": [], "include_rfc2369_headers": true, "info": "", "join_address": "duplicate1-join(a)mydomain.local", "last_post_at": "2020-06-04T01:17:13", "leave_address": "duplicate1-leave(a)mydomain.local", "linked_newsgroup": "", "list_name": "duplicate1", "mail_host": "mydomain.local", "max_message_size": 9990, "max_num_recipients": 10, "max_days_to_hold": 0, "member_roster_visibility": "moderators", "moderator_password": null, "newsgroup_moderation": "none", "next_digest_number": 5, "nntp_prefix_subject_too": true, "no_reply_address": "noreply(a)mydomain.local", "owner_address": "duplicate1-owner(a)mydomain.local", "pass_types": [], "pass_extensions": [], "personalize": "none", "post_id": 51, "posting_address": "duplicate1(a)mydomain.local", "posting_pipeline": "default-posting-pipeline", "preferred_language": "en", "process_bounces": true, "reject_these_nonmembers": [], "reply_goes_to_list": "point_to_list", "reply_to_address": "duplicate1(a)mydomain.local", "request_address": "duplicate1-request(a)mydomain.local", "require_explicit_destination": false, "respond_to_post_requests": true, "send_welcome_message": true, "subject_prefix": "[Duplicate1] ", "subscription_policy": "confirm", "unsubscription_policy": "confirm", "usenet_watermark": null, "volume": 1, "http_etag": "\"8ec001cb705f24c19f1a48de5b551a6a9653fcd6\"" }

3 3

Is there a "global" max_message_size?
by skenny＠scss.tcd.ie 20 Jun '20

20 Jun '20

I'm running Mailman under Docker (maxking). I've a test list with a max_message_size set to 0 (unlimited). I know it's not what anyone should be doing in production, but I still want to test this. I've sent a series of messages with increasingly larger attachments to the list. Going up in 5MB increments, I find that while a message with a 15MB attachement gets through to the list members, a 20MB one doesn't. The interesting thing is the message in the mail logs: Jun 19 11:44:50 venus postfix/lmtp[17630]: C0C7928564: to=<mj(a)lists.scss.tcd.ie>, relay=172.19.199.2[172.19.199.2]:8024, delay=109, delays=2.2/0.04/0.01/107, dsn=5.0.0, status=bounced (host 172.19.199.2[172.19.199.2] said: 552 Error: Too much mail data (in reply to end of DATA command)) So 172.19.199.2 is complaining about "Too much mail data". That's the IP address of the mailman-core container. I'm wondering why this is happening, and where the decision is being made, as it seems at odds with the fact that the mailing list has no limit on message size. Would be grateful for any insights, many thanks. Stephen Kenny

2 3

hyperkitty: "incorrect string value" for botched utf-8 encoding
by thoralf 20 Jun '20

20 Jun '20

hi, my hyperkitty installation (3.2.1 from debian buster) started to act up recently with (1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") for every new mail that is about to be archived, i'll quote the full error mail at the end of this mail. i traced the issue to a slighty smiling face (aka u+1f642) in this rather interestingly encoded email: […] Content-Type: multipart/mixed; boundary="===============2457401976140816263==" --===============2457401976140816263== Content-Type: multipart/alternative; boundary="5ecb6fd9_327b23c6_2042" --5ecb6fd9_327b23c6_2042 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline kann halt NIE am mittwoch. viel spass =F0=9F=99=82 […] --5ecb6fd9_327b23c6_2042 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline <html xmlns=3D=22http://www.w3.org/1999/xhtml=22> […] <div dir=3D=22auto=22>kann halt NIE am mittwoch. viel spass =F0=9F=99=82<= /div> --5ecb6fd9_327b23c6_2042-- […] --===============2457401976140816263==-- … which still lingers around in /var/lib/mailman3/archives/hyperkitty/spool . is this to be expected, or might it be a good idea to amend mailman3 / hyperkitty to deal with this more gracefully? thank you & with kind regards, t. --- Internal Server Error: /hyperkitty/api/mailman/archive OperationalError at /hyperkitty/api/mailman/archive (1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") Request Method: POST Request URL: https://redacted Django Version: 1.11.28 Python Executable: /usr/bin/uwsgi-core Python Version: 3.7.3 Python Path: ['.', '', '/usr/lib/python37.zip', '/usr/lib/python3.7', '/usr/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Mon, 25 May 2020 13:26:09 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 101. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 250. self.errorhandler(self, exc, value) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in defaulterrorhandler 50. raise errorvalue File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 247. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 411. rowcount = self._do_query(q) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _do_query 374. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 292. _mysql.connection.query(self, query) The above exception ((1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1")) was the direct cause of the following exception: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/http.py" in inner 40. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in _decorator 69. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/csrf.py" in wrapped_view 58. return view_func(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in archive 115. add_to_list(mlist_fqdn, msg) File "/usr/lib/python3/dist-packages/hyperkitty/lib/incoming.py" in add_to_list 151. email.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save 808. force_update=force_update, update_fields=update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save_base 838. updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _save_table 924. result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _do_insert 963. using=using, raw=raw) File "/usr/lib/python3/dist-packages/django/db/models/manager.py" in manager_method 85. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py" in _insert 1079. return query.get_compiler(using=using).execute_sql(return_id) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py" in execute_sql 1112. cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py" in __exit__ 94. six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/lib/python3/dist-packages/django/utils/six.py" in reraise 685. raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 101. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 250. self.errorhandler(self, exc, value) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in defaulterrorhandler 50. raise errorvalue File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 247. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 411. rowcount = self._do_query(q) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _do_query 374. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 292. _mysql.connection.query(self, query) Exception Type: OperationalError at /hyperkitty/api/mailman/archive Exception Value: (1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") Request information: USER: AnonymousUser GET: key = 'redacted' POST: mlist = 'redacted' FILES: message = <InMemoryUploadedFile: message.txt ()> COOKIES: No cookie data META: CONTENT_LENGTH = '6223' CONTENT_TYPE = 'multipart/form-data; boundary=4cd93acbb8c0c45d7bd46fdf1d6a31fa' CONTEXT_DOCUMENT_ROOT = '/var/www/html' CONTEXT_PREFIX = '' DOCUMENT_ROOT = '/var/www/html' GATEWAY_INTERFACE = 'CGI/1.1' HTTPS = 'on' HTTP_ACCEPT = '*/*' HTTP_ACCEPT_ENCODING = 'gzip, deflate' HTTP_CONNECTION = 'keep-alive' HTTP_HOST = 'lists.bing-bong.de' HTTP_USER_AGENT = 'python-requests/2.21.0' PATH = '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' PATH_INFO = '/hyperkitty/api/mailman/archive' QUERY_STRING = 'key=redacted' REMOTE_ADDR = '78.47.218.110' REMOTE_PORT = '36358' REQUEST_METHOD = 'POST' REQUEST_SCHEME = 'https' REQUEST_URI = 'redacted' SCRIPT_FILENAME = 'proxy:uwsgi://localhost/hyperkitty/api/mailman/archive' SCRIPT_NAME = '' SERVER_ADDR = '78.47.218.110' SERVER_ADMIN = 'admin(a)bing-bong.de' SERVER_NAME = 'lists.bing-bong.de' SERVER_PORT = '443' SERVER_PROTOCOL = 'HTTP/1.1' SERVER_SIGNATURE = '<address>Apache/2.4.38 (Debian) Server at lists.bing-bong.de Port 443</address>\n' SERVER_SOFTWARE = 'Apache/2.4.38 (Debian)' SSL_TLS_SNI = 'lists.bing-bong.de' uwsgi.core = 1 uwsgi.node = b'bing-bong' uwsgi.version = b'2.0.18-debian' wsgi.errors = <_io.TextIOWrapper name=2 mode='w' encoding='UTF-8'> wsgi.file_wrapper = '' wsgi.input = <uwsgi._Input object at 0x7f2ae6af2d68> wsgi.multiprocess = False wsgi.multithread = True wsgi.run_once = False wsgi.url_scheme = 'https' wsgi.version = '(1, 0)' Settings: Using settings module settings ABSOLUTE_URL_OVERRIDES = {} ACCOUNT_AUTHENTICATION_METHOD = 'username_email' ACCOUNT_DEFAULT_HTTP_PROTOCOL = 'https' ACCOUNT_EMAIL_REQUIRED = True ACCOUNT_EMAIL_VERIFICATION = 'mandatory' ACCOUNT_UNIQUE_EMAIL = True ADMINS = "(('Mailman Suite Admin', 'mm3admin(a)bing-bong.de'),)" ALLOWED_HOSTS = ['*'] APPEND_SLASH = True AUTHENTICATION_BACKENDS = "('django.contrib.auth.backends.ModelBackend', 'allauth.account.auth_backends.AuthenticationBackend')" AUTH_PASSWORD_VALIDATORS = '********************' AUTH_USER_MODEL = 'auth.User' BASE_DIR = '/usr/share/mailman3-web' CACHES = {'default': {'BACKEND': 'django.core.cache.backends.locmem.LocMemCache'}} CACHE_MIDDLEWARE_ALIAS = 'default' CACHE_MIDDLEWARE_KEY_PREFIX = '********************' CACHE_MIDDLEWARE_SECONDS = 600 COMPRESS_CACHEABLE_PRECOMPILERS = '()' COMPRESS_CACHE_BACKEND = 'default' COMPRESS_CACHE_KEY_FUNCTION = '********************' COMPRESS_CLEAN_CSS_ARGUMENTS = '' COMPRESS_CLEAN_CSS_BINARY = 'cleancss' COMPRESS_CLOSURE_COMPILER_ARGUMENTS = '' COMPRESS_CLOSURE_COMPILER_BINARY = 'java -jar compiler.jar' COMPRESS_CSS_COMPRESSOR = 'compressor.css.CssCompressor' COMPRESS_CSS_FILTERS = ['compressor.filters.css_default.CssAbsoluteFilter'] COMPRESS_CSS_HASHING_METHOD = 'mtime' COMPRESS_DATA_URI_MAX_SIZE = 1024 COMPRESS_DEBUG_TOGGLE = None COMPRESS_ENABLED = True COMPRESS_JINJA2_GET_ENVIRONMENT = <function CompressorConf.JINJA2_GET_ENVIRONMENT at 0x7f2ae8341f28> COMPRESS_JS_COMPRESSOR = 'compressor.js.JsCompressor' COMPRESS_JS_FILTERS = ['compressor.filters.jsmin.JSMinFilter'] COMPRESS_MINT_DELAY = 30 COMPRESS_MTIME_DELAY = 10 COMPRESS_OFFLINE = True COMPRESS_OFFLINE_CONTEXT = {'STATIC_URL': '/mailman3/static/'} COMPRESS_OFFLINE_MANIFEST = 'manifest.json' COMPRESS_OFFLINE_TIMEOUT = 31536000 COMPRESS_OUTPUT_DIR = 'CACHE' COMPRESS_PARSER = 'compressor.parser.AutoSelectParser' COMPRESS_PRECOMPILERS = "(('text/less', 'lessc {infile} {outfile}'), ('text/x-scss', 'sassc -t compressed {infile} {outfile}'), ('text/x-sass', 'sassc -t compressed {infile} {outfile}'))" COMPRESS_REBUILD_TIMEOUT = 2592000 COMPRESS_ROOT = '/var/lib/mailman3/web/static' COMPRESS_STORAGE = 'compressor.storage.CompressorFileStorage' COMPRESS_TEMPLATE_FILTER_CONTEXT = {'STATIC_URL': '/mailman3/static/'} COMPRESS_URL = '/mailman3/static/' COMPRESS_URL_PLACEHOLDER = '/__compressor_url_placeholder__/' COMPRESS_VERBOSE = False COMPRESS_YUGLIFY_BINARY = 'yuglify' COMPRESS_YUGLIFY_CSS_ARGUMENTS = '--terminal' COMPRESS_YUGLIFY_JS_ARGUMENTS = '--terminal' COMPRESS_YUI_BINARY = 'java -jar yuicompressor.jar' COMPRESS_YUI_CSS_ARGUMENTS = '' COMPRESS_YUI_JS_ARGUMENTS = '' CSRF_COOKIE_AGE = 31449600 CSRF_COOKIE_DOMAIN = None CSRF_COOKIE_HTTPONLY = False CSRF_COOKIE_NAME = 'csrftoken' CSRF_COOKIE_PATH = '/' CSRF_COOKIE_SECURE = False CSRF_FAILURE_VIEW = 'django.views.csrf.csrf_failure' CSRF_HEADER_NAME = 'HTTP_X_CSRFTOKEN' CSRF_TRUSTED_ORIGINS = [] CSRF_USE_SESSIONS = False DATABASES = {'default': {'ENGINE': 'django.db.backends.mysql', 'NAME': 'mailman3web', 'USER': 'mailman3web', 'PASSWORD': '********************', 'HOST': 'localhost', 'PORT': '', 'OPTIONS': {'init_command': "SET sql_mode='STRICT_TRANS_TABLES'"}, 'ATOMIC_REQUESTS': False, 'AUTOCOMMIT': True, 'CONN_MAX_AGE': 0, 'TIME_ZONE': None, 'TEST': {'CHARSET': None, 'COLLATION': None, 'NAME': None, 'MIRROR': None}}} DATABASE_ROUTERS = [] DATA_UPLOAD_MAX_MEMORY_SIZE = 2621440 DATA_UPLOAD_MAX_NUMBER_FIELDS = 1000 DATETIME_FORMAT = 'N j, Y, P' DATETIME_INPUT_FORMATS = ['%Y-%m-%d %H:%M:%S', '%Y-%m-%d %H:%M:%S.%f', '%Y-%m-%d %H:%M', '%Y-%m-%d', '%m/%d/%Y %H:%M:%S', '%m/%d/%Y %H:%M:%S.%f', '%m/%d/%Y %H:%M', '%m/%d/%Y', '%m/%d/%y %H:%M:%S', '%m/%d/%y %H:%M:%S.%f', '%m/%d/%y %H:%M', '%m/%d/%y'] DATE_FORMAT = 'N j, Y' DATE_INPUT_FORMATS = ['%Y-%m-%d', '%m/%d/%Y', '%m/%d/%y', '%b %d %Y', '%b %d, %Y', '%d %b %Y', '%d %b, %Y', '%B %d %Y', '%B %d, %Y', '%d %B %Y', '%d %B, %Y'] DEBUG = False DEBUG_PROPAGATE_EXCEPTIONS = False DECIMAL_SEPARATOR = '.' DEFAULT_CHARSET = 'utf-8' DEFAULT_CONTENT_TYPE = 'text/html' DEFAULT_EXCEPTION_REPORTER_FILTER = 'django.views.debug.SafeExceptionReporterFilter' DEFAULT_FILE_STORAGE = 'django.core.files.storage.FileSystemStorage' DEFAULT_FROM_EMAIL = 'postorius(a)bing-bong.de' DEFAULT_INDEX_TABLESPACE = '' DEFAULT_TABLESPACE = '' DISALLOWED_USER_AGENTS = [] EMAILNAME = 'bing-bong.de' EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'localhost' EMAIL_HOST_PASSWORD = '********************' EMAIL_HOST_USER = '' EMAIL_PORT = 25 EMAIL_SSL_CERTFILE = None EMAIL_SSL_KEYFILE = '********************' EMAIL_SUBJECT_PREFIX = '[Django] ' EMAIL_TIMEOUT = None EMAIL_USE_LOCALTIME = False EMAIL_USE_SSL = False EMAIL_USE_TLS = False FILE_CHARSET = 'utf-8' FILE_UPLOAD_DIRECTORY_PERMISSIONS = None FILE_UPLOAD_HANDLERS = ['django.core.files.uploadhandler.MemoryFileUploadHandler', 'django.core.files.uploadhandler.TemporaryFileUploadHandler'] FILE_UPLOAD_MAX_MEMORY_SIZE = 2621440 FILE_UPLOAD_PERMISSIONS = None FILE_UPLOAD_TEMP_DIR = None FILTER_VHOST = False FIRST_DAY_OF_WEEK = 0 FIXTURE_DIRS = [] FORCE_SCRIPT_NAME = None FORMAT_MODULE_PATH = None FORM_RENDERER = 'django.forms.renderers.DjangoTemplates' HAYSTACK_CONNECTIONS = {'default': {'ENGINE': 'haystack.backends.whoosh_backend.WhooshEngine', 'PATH': '/var/lib/mailman3/web/fulltext_index'}} HOSTNAME = 'localhost.local' IGNORABLE_404_URLS = [] INSTALLED_APPS = "('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount')" INTERNAL_IPS = [] LANGUAGES = [('af', 'Afrikaans'), ('ar', 'Arabic'), ('ast', 'Asturian'), ('az', 'Azerbaijani'), ('bg', 'Bulgarian'), ('be', 'Belarusian'), ('bn', 'Bengali'), ('br', 'Breton'), ('bs', 'Bosnian'), ('ca', 'Catalan'), ('cs', 'Czech'), ('cy', 'Welsh'), ('da', 'Danish'), ('de', 'German'), ('dsb', 'Lower Sorbian'), ('el', 'Greek'), ('en', 'English'), ('en-au', 'Australian English'), ('en-gb', 'British English'), ('eo', 'Esperanto'), ('es', 'Spanish'), ('es-ar', 'Argentinian Spanish'), ('es-co', 'Colombian Spanish'), ('es-mx', 'Mexican Spanish'), ('es-ni', 'Nicaraguan Spanish'), ('es-ve', 'Venezuelan Spanish'), ('et', 'Estonian'), ('eu', 'Basque'), ('fa', 'Persian'), ('fi', 'Finnish'), ('fr', 'French'), ('fy', 'Frisian'), ('ga', 'Irish'), ('gd', 'Scottish Gaelic'), ('gl', 'Galician'), ('he', 'Hebrew'), ('hi', 'Hindi'), ('hr', 'Croatian'), ('hsb', 'Upper Sorbian'), ('hu', 'Hungarian'), ('ia', 'Interlingua'), ('id', 'Indonesian'), ('io', 'Ido'), ('is', 'Icelandic'), ('it', 'Italian'), ('ja', 'Japanese'), ('ka', 'Georgian'), ('kk', 'Kazakh'), ('km', 'Khmer'), ('kn', 'Kannada'), ('ko', 'Korean'), ('lb', 'Luxembourgish'), ('lt', 'Lithuanian'), ('lv', 'Latvian'), ('mk', 'Macedonian'), ('ml', 'Malayalam'), ('mn', 'Mongolian'), ('mr', 'Marathi'), ('my', 'Burmese'), ('nb', 'Norwegian Bokmål'), ('ne', 'Nepali'), ('nl', 'Dutch'), ('nn', 'Norwegian Nynorsk'), ('os', 'Ossetic'), ('pa', 'Punjabi'), ('pl', 'Polish'), ('pt', 'Portuguese'), ('pt-br', 'Brazilian Portuguese'), ('ro', 'Romanian'), ('ru', 'Russian'), ('sk', 'Slovak'), ('sl', 'Slovenian'), ('sq', 'Albanian'), ('sr', 'Serbian'), ('sr-latn', 'Serbian Latin'), ('sv', 'Swedish'), ('sw', 'Swahili'), ('ta', 'Tamil'), ('te', 'Telugu'), ('th', 'Thai'), ('tr', 'Turkish'), ('tt', 'Tatar'), ('udm', 'Udmurt'), ('uk', 'Ukrainian'), ('ur', 'Urdu'), ('vi', 'Vietnamese'), ('zh-hans', 'Simplified Chinese'), ('zh-hant', 'Traditional Chinese')] LANGUAGES_BIDI = ['he', 'ar', 'fa', 'ur'] LANGUAGE_CODE = 'en-us' LANGUAGE_COOKIE_AGE = None LANGUAGE_COOKIE_DOMAIN = None LANGUAGE_COOKIE_NAME = 'django_language' LANGUAGE_COOKIE_PATH = '/' LOCALE_PATHS = [] LOGGING = {'version': 1, 'disable_existing_loggers': False, 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'}}, 'handlers': {'mail_admins': {'level': 'ERROR', 'filters': ['require_debug_false'], 'class': 'django.utils.log.AdminEmailHandler'}, 'file': {'level': 'INFO', 'class': 'logging.handlers.RotatingFileHandler', 'filename': '/var/log/mailman3/web/mailman-web.log', 'formatter': 'verbose'}, 'console': {'class': 'logging.StreamHandler', 'formatter': 'simple'}}, 'loggers': {'django.request': {'handlers': ['mail_admins', 'file'], 'level': 'INFO', 'propagate': True}, 'django': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}, 'hyperkitty': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}, 'postorius': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}}, 'formatters': {'verbose': {'format': '%(levelname)s %(asctime)s %(process)d %(name)s %(message)s'}, 'simple': {'format': '%(levelname)s %(message)s'}}} LOGGING_CONFIG = 'logging.config.dictConfig' LOGIN_REDIRECT_URL = 'list_index' LOGIN_URL = 'account_login' LOGOUT_REDIRECT_URL = None LOGOUT_URL = 'account_logout' MAILMAN_ARCHIVER_FROM = "('127.0.0.1', '::1', '78.47.218.110', '2a01:4f8:c17:567::2/64')" MAILMAN_ARCHIVER_KEY = '********************' MAILMAN_REST_API_PASS = '********************' MAILMAN_REST_API_URL = '********************' MAILMAN_REST_API_USER = '********************' MANAGERS = [] MEDIA_ROOT = '' MEDIA_URL = '' MESSAGE_STORAGE = 'django.contrib.messages.storage.fallback.FallbackStorage' MESSAGE_TAGS = {40: 'danger'} MIDDLEWARE = "('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware')" MIDDLEWARE_CLASSES = ['django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware'] MIGRATION_MODULES = {} MONTH_DAY_FORMAT = 'F j' NUMBER_GROUPING = 0 PASSWORD_HASHERS = '********************' PASSWORD_RESET_TIMEOUT_DAYS = '********************' POSTORIUS_TEMPLATE_BASE_URL = 'http://lists.bing-bong.de/mailman3/' PREPEND_WWW = False Q_CLUSTER = {'timeout': 300, 'save_limit': 100, 'orm': 'default', 'poll': 5} ROOT_URLCONF = 'urls' SECRET_KEY = '********************' SECURE_BROWSER_XSS_FILTER = False SECURE_CONTENT_TYPE_NOSNIFF = False SECURE_HSTS_INCLUDE_SUBDOMAINS = False SECURE_HSTS_PRELOAD = False SECURE_HSTS_SECONDS = 0 SECURE_PROXY_SSL_HEADER = None SECURE_REDIRECT_EXEMPT = [] SECURE_SSL_HOST = None SECURE_SSL_REDIRECT = False SERVER_EMAIL = 'root(a)bing-bong.de' SESSION_CACHE_ALIAS = 'default' SESSION_COOKIE_AGE = 1209600 SESSION_COOKIE_DOMAIN = None SESSION_COOKIE_HTTPONLY = True SESSION_COOKIE_NAME = 'sessionid' SESSION_COOKIE_PATH = '/' SESSION_COOKIE_SECURE = False SESSION_ENGINE = 'django.contrib.sessions.backends.db' SESSION_EXPIRE_AT_BROWSER_CLOSE = False SESSION_FILE_PATH = None SESSION_SAVE_EVERY_REQUEST = False SESSION_SERIALIZER = 'django.contrib.sessions.serializers.PickleSerializer' SETTINGS_MODULE = 'settings' SHORT_DATETIME_FORMAT = 'm/d/Y P' SHORT_DATE_FORMAT = 'm/d/Y' SIGNING_BACKEND = 'django.core.signing.TimestampSigner' SILENCED_SYSTEM_CHECKS = [] SITE_ID = 1 SOCIALACCOUNT_PROVIDERS = {} STATICFILES_DIRS = '()' STATICFILES_FINDERS = "('django.contrib.staticfiles.finders.FileSystemFinder', 'django.contrib.staticfiles.finders.AppDirectoriesFinder', 'compressor.finders.CompressorFinder')" STATICFILES_STORAGE = 'django.contrib.staticfiles.storage.StaticFilesStorage' STATIC_ROOT = '/var/lib/mailman3/web/static' STATIC_URL = '/mailman3/static/' TEMPLATES = [{'BACKEND': 'django.template.backends.django.DjangoTemplates', 'DIRS': [], 'APP_DIRS': True, 'OPTIONS': {'context_processors': ['django.template.context_processors.debug', 'django.template.context_processors.i18n', 'django.template.context_processors.media', 'django.template.context_processors.static', 'django.template.context_processors.tz', 'django.template.context_processors.csrf', 'django.template.context_processors.request', 'django.contrib.auth.context_processors.auth', 'django.contrib.messages.context_processors.messages', 'django_mailman3.context_processors.common', 'hyperkitty.context_processors.common', 'postorius.context_processors.postorius']}}] TEST_NON_SERIALIZED_APPS = [] TEST_RUNNER = 'django.test.runner.DiscoverRunner' THOUSAND_SEPARATOR = ',' TIME_FORMAT = 'P' TIME_INPUT_FORMATS = ['%H:%M:%S', '%H:%M:%S.%f', '%H:%M'] TIME_ZONE = 'UTC' USE_ETAGS = False USE_I18N = True USE_L10N = True USE_THOUSAND_SEPARATOR = False USE_TZ = True USE_X_FORWARDED_HOST = True USE_X_FORWARDED_PORT = False WSGI_APPLICATION = 'wsgi.application' X_FRAME_OPTIONS = 'SAMEORIGIN' YEAR_MONTH_FORMAT = 'F Y'

2 3

locked files problem after reboot
by mailman3＠malevil.cc 20 Jun '20

20 Jun '20

hey, I have got a problem with flufl.lock in mailman3. When my server is rebooted, locked files seems to stay and cause errors so mailman3 core wont start (it is started automatically by supervisord service): PermissionError: [Errno 1] Operation not permitted Traceback (most recent call last): File "/home/user/.local/lib/python3.6/site-packages/mailman/bin/master.py", line 146, in acquire_lock lock = acquire_lock_1(force) File "/home/user/.local/lib/python3.6/site-packages/mailman/bin/master.py", line 125, in acquire_lock_1 lock.lock(timedelta(seconds=0.1)) File "/home/user/.local/lib/python3.6/site-packages/flufl/lock/_lockfile.py", line 259, in lock raise TimeOutError('Could not acquire the lock') flufl.lock._lockfile.TimeOutError: Could not acquire the lock I have to remove the files in var/locks manually to go forward. Is there a configuration error for my setup? Or is it just a not fixed bug? Greetsn, jekyl

3 4

Exim: is it possible to host mailman and exim on different hosts? Howto?
by Jörg Schulz 20 Jun '20

20 Jun '20

as of the documentation, https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… , exim4 (and postfix similarly) need to have access to the mailman filesystem (MM3_HOME=/opt/mailman/var). If exim and MM would be on different hosts (or different docker environments), how would we need to configure that?

3 2

What database to choose for production deployment: Postgres or MySql
by pgrzywaczewski＠gmail.com 20 Jun '20

20 Jun '20

Hi, What database is better for large deployment: Postgres or MySql? 'Large' means - around 15k mailing lists - 36k incoming messages per day - 270k outgoing messages per day distributed to recipients Is there preference from performance point of view? Or something else worth mentioning? Thanks, Paweł

4 4

how to delete a list member using the Linux command line
by Mike Wertheim 19 Jun '20

19 Jun '20

I have Mailman 3.2.1 installed (on Debian Linux), using exim4 as the MTA. I have been trying to figure out how to use the Linux command line to add members to a list and delete members from a list, but am having trouble with deleting. Here is what works for adding a list member... % echo mike(a)foo.com | mailman members --add - mylist(a)domain.org Here is what works for viewing the list members... % mailman members mylist(a)domain.org But I'm having trouble deleting a member. Here is what I have tried that didn't work... # echo mike(a)foo.com | mailman members --delete - mylist(a)domain.org Usage: mailman members [OPTIONS] LISTSPEC Try "mailman members -h" for help. Error: no such option: --delete # echo mike(a)foo.com | mailman members --delmembers - mylist(a)domain.org Usage: mailman members [OPTIONS] LISTSPEC Try "mailman members -h" for help. Error: no such option: --delmembers What is the correct command to delete the member mike(a)foo.com from the list mylist(a)domain.org? (I ran "mailman members -h", and it mentions "add" but does not mention deleting at all.)

2 3

LTMP to Postfix problem
by Brian Carpenter 19 Jun '20

19 Jun '20

On one of my mailman 3 servers, I am having a problem with Postfix failing to deliver email to Mailman. I keep seeing this in the mail.log: status=deferred (connect to 127.0.0.1[127.0.0.1]:8024: Connection refused) What is causing this and how can I fix it? -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

4 12

Mailman do not honor non-members moderation setting sometimes
by Alan So 19 Jun '20

19 Jun '20

Some of our users reported that their list do not honor the nonmembers moderation setting sometimes. We were not able to repeat the issue consistently earlier. Luckily, we found the following way to repeat the issue: 1) Create a new list with user(a)example.com as owner. (Ordinary disussion mailing list style) 2) Change the list Settings -> Message Acceptance -> Default action to take when a non-member posts to the list: Discard 3) Add a non-member user(a)example.com and change the moderation setting to Hold for Moderation 4) Send an email to the list using user(a)example.com. The message is discarded instead of being held. The above can also be repeated with the list setting Default action to take when a non-member posts to the list: Accept immediately. The message sent from user(a)example.com is accepted instead of being held. So, it looks like that the non-members moderation setting is ignored for this case. Further study indicate that the issue did not happen if the owner is set to user(a)example.com *after* adding the non-member. It looks like that we can avoid the issue during list creation. However, the issue can also be triggered through other ways such as adding the non-member as member and remove. There are also ways to resolve the issue by removing all corresponding member, non-member, owner setting and add them back in the following order: non-member, owner. However, it does not always work and so I do not go into the detail at this moment to complicate the issue.

2 2

Affinity Mailman Is Now Beta
by Brian Carpenter 18 Jun '20

18 Jun '20

Dear Mailman Admins and Users, Affinity Mailman is our new admin interface for Mailman 3 and we intend to use it to replace Postorius. It has been under development for about 3 months now and it recently reached beta. Calling For Beta Testers Now that Affinity is in beta, we are looking for list admins to help us beta test it. We are interested in getting some feedback and feature requests from beta users. If you are interested in helping us test out Affinity and get a sneak peek of the future of Mailman administration, then email me at brian_carpenter(a)emwd.com <mailto:brian_carpenter@emwd.com?subject=Affinity%20Beta&body=I%20am%20interested%20in%20Beta%20Testing%20Affinity> and I will begin the process of setting you up with an Affinity Mailman admin account and provide 2 test lists to use for beta testing purposes. While I am at it: Empathy Is Now Under Development "So what in the world is Empathy? I mean really - first Affinity and now Empathy?" That is correct. We figured if we are going to replace the default admin UI (Postorius) for Mailman 3, we might as well replace the default forum/archive UI (Hyperkitty) for Mailman 3. With Empathy, we are bringing a beautiful and user-friendly experience for those who wish to use Mailman 3 as a modern forum. We want Empathy to bring a true community like approach to the use of Mailman 3 via a browser. It will supplement the mailing list feature of Mailman 3 with an easy to use online forum. So Mailman 3 users will get the best of both worlds: a modern mailing list app AND a modern forum app. Empathy can also be used to display your list threads (archives) in an easy-to-read manner, and those threads can be categorized by tags and will be searchable. -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

2 1

mailman2 vs Mailman3 database usage
by Ralf Wiegand 18 Jun '20

18 Jun '20

Do you have a list of the information that is stored in the DB? I don’t think it is emails, so it may be an issue of the number of lists and email addresses or users that are allowed to post or moderate. Thank You, Ralf Wiegand -- Ralf K. Wiegand -- Leidos 6909 Metro Park Dr Franconia, VA 22310 469-289-7372 (mobile) ralf.wiegand(a)tena-sda.org

1 0

Exception in the HyperKitty archiver: 'utf-8' codec can't encode characters
by Gilles Filippini 18 Jun '20

18 Jun '20

Hi, I'm seeing the above error in mailman-core logs each time an email is processed. Is there something I missed in the configuration? I'm using dockerized mailman 0.3 from maxking. Thanks in advance, _g.

2 7

Mailman3 on Ubuntu 20.04 LTS - Best Installation Method?
by matthew＠alberti.us 18 Jun '20

18 Jun '20

Hi Everyone, I have been trying unsuccessfully for several weeks to install Mailman3 on a new Ubuntu 20.04 LTS server. First I tried to just use the Ubuntu packages, which is MM3 version 3.2.2. Unfortunately Ubuntu 20.04 also uses Python 3.8 which has a compatibility issue with MM 3.2.2. There is a bug submission submitted to the Ubuntu team. Next I tried to use the virtualenv method, as that was recommended for production anyway by Mailman installation documentation. I couldn't get that to work either, as there is again some known issue between one of the django packages and another python package called 'six'. Has anyone been able to get Mailman3 running stable on Ubuntu 20.04? What installation method did you use? At this point, I'm really tempted to just stay at MM2 until the Ubuntu packages get sorted out. I've also considered just closing the Gitlab repo and trying to set it up manually. But I feel like it isn't worth all the trouble. Thanks in advance for your thoughts. - Matt

3 4

Is it possible to add non-members in regex format in Mailman 3 ?
by Shashikanth Komandoor 17 Jun '20

17 Jun '20

Hi Team, In mailman 2, I was able to add the non-members in the respective privileged box even using the regex also which will be used to add the domains instead of a single mail id. But in mailman 3, I am not allowed to add the non members in the regex format. Of course it is allowing me to add individual mail ids and give permissions. But I want to add a non-member which may be something like the entire cisco.com domain on which I want to set the rule. Please help me out by suggesting over this or if mailman 3 is not providing then please hint me out with a work around at least. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 3

Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup
by Michael Sage 17 Jun '20

17 Jun '20

Hi, I came across this really useful guide (posted to the list earlier). It has all gone really well and mailman 3 is installed. However, I have an issue, when I go to login using Postorius, I get the login page when I enter my credentials the page appears to hang and eventually goes to a Error 500 page. This totally hangs all of the mailman 3 web interface (but not apache). I then have to reboot the server to even get back to the login page. Any tips please? Thanks

5 10

List invisible to moderator
by Olaf Zaplinski 16 Jun '20

16 Jun '20

I just have promoted a member to a moderator. Now when he logs in to Postorius, he gets the message "There are currently no mailing lists.". I have set "Show list on index page" to "no" before. But as a moderator, the list should be shown, right? I mean, all lists are shown to the administrator also. When I manually enter the complete URL, the moderator can see the list. I think this is a bug. Moderators should see their lists. What do you thing? Olaf

2 1

ACL on archives
by pgrzywaczewski＠gmail.com 16 Jun '20

16 Jun '20

Hello, Is it possible to define permissions who can access archives? For example members of another list, or a single user? Thanks, Paweł

2 1

Hyperkitty CSS issue
by Ryan Morash 16 Jun '20

16 Jun '20

I migrated my existing mailman3 install from using the Debian packages to a virtualenv setup. For the most part everything seems to be running fine, but I'm running into an issue where Hyperkitty 1.3.3 is referencing an incorrect CSS file. It is trying to load "/static/CACHE/css/hyperkitty.39ef00cc7454.css" which does not exist. If I replace that reference (using my browser's dev tools) with "/static/CACHE/css/output.12a071da81b1.css" everything looks fine. I've ran the collectstatic, compress, and migrate commands successfully with no change. Any ideas on how to fix this?

4 5

Removing a mail addresses and users
by Abhijith PA 15 Jun '20

15 Jun '20

Hello. I tried to remove random email address signing ups (which I signed up while testing) via admin panel. After removing I tried to sign up again, but I am getting, 'A user is already registered with this e-mail address' Combing through the database, I found auth_user table in mailman3web db still contain those mail address. How to wipe email address entirely from the db so I can signup again without the 'forget password' method --abhijith

6 9