- Mailman-users - lists.mailman3.org

Hyperkitty Recommended mySQL Database Setup & Archive Importing
by matthew＠alberti.us 10 Dec '20

10 Dec '20

Hi, I've been working for quite a while to setup a production mailman3. Using the docker containers, I have been pretty successful getting it to work. Part of the challenge now is that there are a lot of issues when importing archives from mailman2. This of course is more common on lists that are over 10 years old. From what I've been reading, it seems like Mailman3 expects the mysql database to use UTF8 encoding. It appears, by default, that when using the docker-mailman containers, that the character set is set to latin1. This may explain why there are lots of import errors, and maybe also why there are a lot of errors when threads are deleted in hyperkitty's UI. Is it the case that UTF8 is the preferred character set? I also saw some threads indicating that maybe utf8mb4 is more preferred. I'd like to try to change the character_set on the database, if that is advisable. Also, is Hyperkitty 1.3.4 officially released? I see that the list.org instance is using it, but the latest announce I've seen is for 1.3.3. Thanks. - Matt Alberti

3 8

Version mismatch
by Andrew Bernard 09 Dec '20

09 Dec '20

In the annoucement mail, the new version is - Mailman Core 3.3.0 (Tom Swayer) but on my webpage I see: Mailman Core Version GNU Mailman 3.3.0 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.7.3 (default, Apr 3 2019, 05:39:12) [GCC 8.3.0] Why is the version name from the previous release? is my setup wrong? [There are so many issues I keep reporting here about Mailman that get no response that I wonder if there is something fundamentally wrong with my site.] Andrew

4 3

Message moderatin without login
by Michael Lorenzen 08 Dec '20

08 Dec '20

Hi, are there any plans to allow message moderation without having to login to posterious? I am very pleased with the new web interface and the rest api, but i miss the ability to moderate messages either by mail, with different reply addresses to discard, reject or accept hold messages or by html links with one time codes to achieve the same. I tried to reply on the mail attachment with the confirm ... subject, but that did not seem to work (neither reject nor accept with approved: placed into the first line of the mail). Best regards, Michael

2 1

Moderated Signup with "info" box?
by chris＠zimmerman.to 08 Dec '20

08 Dec '20

Hi all, we have a mailman deployment that we are using for a private neighborhood community board. We have the list setup for moderated approval signup. The trouble is, when someone signs up, we only get a request with their email address. I would like to be able to use the web form, but have a "notes" field that would get submitted with the signup request. the notes field would be where the user would note name/home address. So when one of our moderators get the request, they can figure out quick who the request is coming from. Can anyone provide some guidance or assistance on how to make that happen?

5 8

Spam getting in for moderated list
by Quanah Gibson-Mount 06 Dec '20

06 Dec '20

I have a list that has the following settings: List members -> Hold: This holds the message for approval by the list moderators. Non-subscribers -> Silent discard And yet, spam emails from a spammer that signed up to the list are going straight through and being delivered. Is this a known bug in mailman 3.2.1? Example: <https://lists.openldap.org/hyperkitty/list/openldap-bugs@openldap.org/threa…> It even has this list header: X-Mailman-Rule-Hits: member-moderation and version is X-Mailman-Version: 3.2.1 I think it was sent via the web interface? User-Agent: HyperKitty on https://lists.openldap.org/ I checked the settings for this subscribed spam user, and it specifically says "list default" for moderation, so it should have been moderated. Thanks, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

2 2

mailman-suite scheduled tasks
by Eric Broens 06 Dec '20

06 Dec '20

Hi, The documentation https://docs.mailman3.org/en/latest/config-web.html includes a section on scheduled tasks that need to be included in cron. "runjobs" seems to be available only from "manage.py". Do these scheduled tasks need to be executed from the python virtual environment?If so, is there a way to do that directly from cron, or should I create a script for these tasks which can be called from by cron? Best Regards,Eric

2 2

Server name in new account confirmation email
by Meehan, John 03 Dec '20

03 Dec '20

Hi, when someone creates a new account (Sign Up), an email is sent to them to confirm their email address. It has the form below. Does anyone know how I can change the server name in the URL (From server.example.com to something else)? I have an SSL proxy server that I want to direct users through. Thanks. - John Hello from example.com! You're receiving this e-mail because user johndoe has given yours as an e-mail address to connect their account. To confirm this is correct, go to https://server.example.com/accounts/confirm-email/Mg:1kkdMg:i4i4ycbBdukoSMd… Thank you from example.com! example.com

3 3

mailman3 OWNERS_CAN_ENABLE_PERSONALIZATION option
by Henry S 03 Dec '20

03 Dec '20

I am trying to change email "To" field to user's email instead of mailing list's email. e.g. "To: <user(a)gmail.com>" instead of "To: <mailman-users(a)mailman3.org>" I looked around old mailman configs they mentioned about adding OWNERS_CAN_ENABLE_PERSONALIZATION option in mm_cfg.py is this feature still available in mailman3 ? Can I do it via Postorius or REST API? Thanks.

2 2

Initial success: Mailman 3.3 integrated with Zimbra 8.8
by Morris Jones 02 Dec '20

02 Dec '20

I have a very old existing mail server running Zimbra 6 with a mailman 2.1 instance alongside. I needed to rebuild my mail server for some compelling reasons (the old server used outdated TLS protocol, I could no longer compile clamav, nothing could really be updated). The final straw was a lack of support for my old commercial SSL certificates. I patched in a letsencrypt certificate to get through the past six months. I'm in the process of commissioning a new mail server using an 8GB Linode, Ubuntu 18, Zimbra 8.8, and Mailman 3.3. A couple of days ago I had my first successful list creation, with user confirmation working by email. I have django running with uwsgi, and am using Zimbra's installed nginx proxy to reverse proxy http traffic to Postorius and Hyperkitty. Nginx is doing the SSL layer. The mailman core mta hooks are all done using Zimbra's "local configuration" technique. In theory I should be able to do Zimbra upgrades with a minimum of hassle. I've written up a "case history" of how it came together. I have a .rst file in a gitlab project here: https://gitlab.com/MojoLA/mailman3.3-zimbra-8.8-integration I suppose this is a crazy project, but it's worthwhile to me. (Mark, thank's so much for integrating the virtual domain maps. It took me about three days to recognize that they were the solution to bounced mails to list-owner@...) Now I can spend some time migrating my email accounts (only four) from the old server to the new one, and move a dozen or so mailing lists to the new mailman3 instance. I'll have to get accustomed to a new way to manage the mail lists, and already really like what I've seen. Thank you. :) Best regards, Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

1 0

Mailmansuite.log Entries
by Brian Carpenter 02 Dec '20

02 Dec '20

I see the following log entries in mailmansuite.log: INFO 2020-11-28 00:00:52,242 29142 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-11-28 00:01:00,600 29142 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 INFO 2020-11-29 00:00:52,135 15513 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-11-29 00:01:00,192 15513 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 INFO 2020-11-30 00:00:52,484 22622 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-11-30 00:01:00,758 22622 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 INFO 2020-12-01 00:00:50,246 11946 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-12-01 00:00:59,688 11946 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 I assume this is a result of importing archives from a MM2 mbox file. This happen months ago however. Why are these entries still showing up? -- Brian Carpenter Harmonylists.com Emwd.com

2 3

12/24 hour clock ?
by Per Jessen 28 Nov '20

28 Nov '20

Hi all at openSUSE we have recently migrated to mailman3, and we seem to be having a couple of teething issues: a) hyperkitty and postorius both seem to insist on using a 12 hour clock format, no matter what the user has set. Is there a way of changing it system-wide ? b) overriding the default set of footers - despite having set the template "list:member:regular:footer" to empty for a specific list, I am still getting the default footers attached. We are using version 1.3.3. thanks Per Jessen

2 2

No styling for web apps?
by Morris Jones 27 Nov '20

27 Nov '20

I have most of a new mailman suite server built and working ... collectstatic gathered a good array of static files (uncompressed so far) nginx appears to be serving them successfully The Firefox developer tools show css and js files all being delivered But none of the postorius or hyperkitty pages exhibit any styling at all, only bare HTML elements. The Firefox inspector will show the available styles being requested and delivered (style.css, bootstrap, jquery, all the things). But if I use the inspector to look at the page, nothing has any CSS properties. I know I'm missing something simple. (Happy Thanksgiving!) Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

2 3

where is manage.py for migration?
by Dan Langille 26 Nov '20

26 Nov '20

Hello, I am following https://docs.mailman3.org/en/latest/migration.html and I'm trying to "Migrate the list archives from Mailman 2 to Mailman 3 by running the following command": [mailman@mailman ~]$ python manage.py hyperkitty_import -l biking(a)lists.example.org /usr/local/mailman/archives/private/biking.mbox python: can't open file 'manage.py': [Errno 2] No such file or directory Is the documentation correct? I cannot locate manage.py in the code: $ git clone https://gitlab.com/mailman/mailman.git Cloning into 'mailman'... ... $ cd mailman/ $ find . -name manage.py $ Am I doing this wrong? Thank you. -- Dan Langille dan(a)langille.org

2 1

mailman 3.3.2 config file location
by Eric Broens 25 Nov '20

25 Nov '20

Hi, I am trying to install Mailman 3.3.2 in a python virtual environment, and don't understand why the following is happening.When executing "mailman info", it shows that "the config file is located in /etc/mailman3/mailman.cfg as is intended, hence "outside" the virtual environment. However, after having started mailman, and running "mailman info" again, the default (empty) config files seems to be created in the directory where mailman has been started:config file: /opt/mailman/mailman-suite/mailman-suite_project/var/etc/mailman.cfg This happens even when mailman is started with the option "-C /etc/mailman3/mailman.cfg".Does this mean that the config file needs to be located in a subdirectory of python's virtual environment? (venv) [root@test-vps mailman-suite_project]# mailman infoGNU Mailman 3.3.2 (Tom Sawyer)Python 3.6.8 (default, Apr 16 2020, 01:36:27)[GCC 8.3.1 20191121 (Red Hat 8.3.1-5)]config file: /etc/mailman3/mailman.cfgdb url: mysql+pymysql://*****:*****@localhost/mailman?charset=utf8&use_unicode=1devmode: DISABLEDREST root url: http://localhost:8001/3.1/REST credentials: restadmin:restpass (venv) [root@test-vps mailman-suite_project]# mailman startStarting Mailman's master runnerGenerating MTA alias maps (venv) [root@test-vps mailman-suite_project]# mailman infoGNU Mailman 3.3.2 (Tom Sawyer)Python 3.6.8 (default, Apr 16 2020, 01:36:27)[GCC 8.3.1 20191121 (Red Hat 8.3.1-5)]config file: /opt/mailman/mailman-suite/mailman-suite_project/var/etc/mailman.cfgdb url: sqlite:////opt/mailman/mailman-suite/mailman-suite_project/var/data/mailman.dbdevmode: DISABLEDREST root url: http://localhost:8001/3.1/REST credentials: restadmin:restpass Thanks,Eric

2 2

Welcome Message
by brian＠emwd.com 25 Nov '20

25 Nov '20

Is it possible for a list admin to modify the welcome message for a list via Postorius? Is the process: 1. Log into Postorious 2. Click on the Templates tab. 3. Select New Template. 4. Select "The notice sent to a member when they are subscribed to the mailing list" 5. Add your text and click the save button. Is the correct process? I am using the latest Docker release of Mailman 3.

5 25

Mailman automatic accept notification
by tambet.paide＠mkm.ee 25 Nov '20

25 Nov '20

How can I configure mailman so that all the users in mailing list won't get automatic accept notification (uncaught bounce notification)? I'm using Mailman 3 and cat figure it out

1 0

Mailman Core 3.3.2 is now out
by Abhilash Raj 25 Nov '20

25 Nov '20

Hi Everyone, I am pleased to announce that with a week long delay from the planned date, GNU Mailman Core 3.3.2 is now finally out. This release includes both bug fixes and some new features. Some notable changes include: - Support for inviting users to join mailing lists. - New adddmembers, delmembers and syncmembers command to manage membership from CLI. - Addition of new REST API endpoints that return the count of held messages and subscription requests of much faster page loads in Postorius. - Addition of support for filtering in some API endpoints like Members and Subscription requests. - Support for address= option in email join command to subscribe an address other then sending address. - Addition of who email command to lookup memberships. - Expose emergency field for MailingList resource in REST API. - Several bug fixes to support new major version of libraries like dnspython, flufl.* etc. You can install it using: $ pip install --upgrade mailman The tarball for the release is available at PyPI: https://pypi.org/project/mailman/ Finally, many thanks to all the contributors who have helped make this release a success! -- Abhilash Raj (maxking) on behalf of Mailman Core team

5 12

Moderation not working?
by peter＠chubb.wattle.id.au 24 Nov '20

24 Nov '20

Hi Folks, Running a shiny new instance of mailman3, as per the Debian package (version 3.2.2) but the moderation doesn't seem to work. WE got hit by a heap of spammers overnight, even though the 'hold for moderation' bit is set for non-members (and now for members too). Emails seem just to get straight through. Any advice on how to debug this? Would upgrading to a later version using pip help? Peter C

2 3

How to strip DKIM headers on a domain level or a list level
by Stephen J. Turnbull 24 Nov '20

24 Nov '20

Rob Jenson writes: > I need to strip DKIM headers on the inbound messages to my list or > to my domain. Why do you need to strip DKIM headers? The standard specifies that an invalid DKIM signature must be treated the same as if there were no signature at all. So an invalid DKIM signature may be treated as spammier than a message with a valid signature, but that should not be treated differently from an unsigned message (as would appear after removing those header fields). I know this feature is in demand from list admins, but I've never seen convincing evidence that it's actually effective for any of the usual suspects (Yahoo!, AOL, Gmail), only for small domains with pigheaded admins who are proud of their non-conforming configurations, and announce that they are discarding messages which have invalid DKIM signatures. > What I do not understand from the documentation for Mailman 3 Core > is whether it is possible for my hosting service to set > remove_dkim_headers just for our domain. It currently is not possible. It probably could be made possible on a per-domain or per-list basis, but it's not clear to me why it would be useful to do so. If there really are non-conforming receivers out there, it's probably a good idea to strip host-wide. > If that is not possible, then the question becomes "is there a way, > in the list configuration, to strip the DKIM headers? It is possible, but that requires changing the list's processing pipeline to add that capability. I believe this is not difficult (I haven't done similar changes with Mailman 3 yet) but it does require the assistance of the host, and possibly imposes a future maintenance burden on the host. > We are munging the text of the message in Mailman, so the DKIM > headers from the original poster are invalid. As I explained above, both DKIM and DMARC are specified so that "no signature" == "invalid signature" for the purposes of spam processing. Are you sure that Yahoo! (or any other provider used by your subscribers) is treating invalid signatures differently from absence of signatures? The person responsible for Yahoo! MTA configuration is a well-known mail security expert who participated actively in the specification of all these protocols (and she also gave me a kitten, so I may be biased). > As far as I can see, our service provider is using ARC in our > Mailman configuration, but not signing the outbound messages with > DKIM. That surprises me. ARC isn't really a substitute for the MTA's own DKIM signature, at least not yet. > Therefore the DKIM signature from the poster's mail service > provider is sent out with their DKIM header, which seems to be > problematic. It shouldn't be. > If I understand ARC correctly, it is validating the DKIM signature > from the poster, creating a new signature and metadata indicating > that what it received was properly signed. That is correct. As far as I know, Yahoo! does participate in the ARC protocol and used to have conforming implementations of DKIM and DMARC. That doesn't mean you get a free ride: they may still have your IP on a blacklist from former owners of the IP, for example. Or your posts may "look like" spam for some other reason, or your lists may need more time to build up a clean reputation. But I need evidence more convincing than "list posts are recognized as spam" to believe that removing DKIM headers will help. (For example, my employer's filters regularly recognize messages from department heads as spam, even with DKIM signatures intact. ;-)

6 9

Re: mailman 3.3.2 config file location
by Eric Broens 24 Nov '20

24 Nov '20

Apparently I lost the "layout:" config setting which defaults to [paths.here]. Best Regards,Eric

1 0

installation
by Christian Stalberg 24 Nov '20

24 Nov '20

I am working through installing mailman3 on Ubuntu 20.04.1 LTS / apache 2.4.41 / postfix 3.4.13 and have a couple of questions. I've installed Django, cloned the mailman-suite repo, installed and tested apache with Mod_wsgi [ according to https://tecadmin.net/install-apache-with-python-mod-wsgi-on-ubuntu-20-04/ ] and it worked fine. Now I am at 'Setting up a WSGI' server in the MM3 instructions where it says I am to configure uwsgi.ini file. Does that .ini file go in /opt/mailman/mailman where other .ini files reside? In setting up the apache virtual server [ according to https://docs.mailman3.org/projects/postorius/en/latest/deployment.html?highl ight=apache#apache-with-mod-wsgi ] I do not find a postorius.wsgi which WSGIScriptAlias points to. Thank you! ~Christian

5 9

mailman services under systemd
by Morris Jones 22 Nov '20

22 Nov '20

First post, I'm building a new mail server as my tired old server can no longer meet security requirements. (It's long overdue.) I see where Torge Riedel is running the mailman service under systemd, but I'm having trouble doing that. I don't see a mailman option that doesn't detach as a daemon. Did I miss something? Anyone have a systemd service example I might pilfer? Mojo -- Morris Jones, Monrovia, CA [1]BridgeMojo [2]Old Town Sidewalk Astronomers [3]Mojo's Blog References 1. http://bridgemojo.com/ 2. http://otastro.org/ 3. http://mojo.whiteoaks.com/

2 1

Reply w/Email Clients - From: vs. Reply-To:
by j＠manygoodideas.com 20 Nov '20

20 Nov '20

I'm setting up a new list, and a number of new list members are reporting a problem with replying to the thread. Their email clients seem to ignore the Reply-To: field and instead use from From: field. When they use Reply All, the email is addressed to both the From: and Reply-To:. Reading through previous threads here, I've tried a number of things: 1) DMARC mitigation action is "Replace From: with list address" 2) For Alter Messages - Set "Reply goes to list" The goal is that we want a reply to go to the list, not the person posting. Since Reply-To seems to be ignored by some clients, I'm hoping there's a way to force the "From" field to become the list address. Thanks in advance for your suggestions!

3 2

mailman-suite: Error 500 on Lists /setting/ pages
by ljsbw-it＠riseup.net 20 Nov '20

20 Nov '20

I just installed Mailman3 (mailman-suite) on my Server following these instructions: https://lab.uberspace.de/guide_mailman-3.html and everything works fine so far. I can create lists, subscribe people and send mails through lists but when I click the settings button and get redirected to /postorius/lists/listname/settings/ i get an Error 500 message. I couldn't find anything in the logs except the uwsgi log: [pid: 20568|app: 0|req: 62/62] 100.64.115.1 () {48 vars in 1052 bytes} [Wed Nov 18 16:27:59 2020] GET /postorius/lists/listname/settings/ => generated 1102 bytes in 1438 msecs (HTTP/1.1 500) 6 headers in 209 bytes (1 switches on core 0)

3 2

Moderation for nested mailing lists
by peterbw＠gmail.com 20 Nov '20

20 Nov '20

Hi Everyone, I have a list that has other mailing lists as members. When a non-member posts to this list I receive a moderation message. After approving the moderation message I then receive a lot of other moderation messages for the sub-lists that are members of the "top-most" list (since the non-member is not a member of any of the sub-lists). Is there any way to approve a message for moderation once and have all sub-lists automatically approve the message? Thanks for your help with this and have a nice day! Peter

2 1

How can I allow members of list A to post to List B and vice versa
by mario.mailman3＠frese.online 19 Nov '20

19 Nov '20

Hi, I am trying to setup Mailman3 for our school. There I have several groups (teachers, parents) that have their own mailling lists. But it also should be possible that the parents can sent mails to the teachers list and vice versa. The manual management via the non-members list will be very inconvenient and the command-line options that I saw so far do not include the import of non-members (mailman syncmembers and mailman addmembers). The best option I would like to have is to enter the name of List A in the non-members of List B an vice versa. All those nonmembers should not need to be moderated. How can I manage this? I would be very glad for your ideas. Best Mario

2 1

Customising hyperkitty and postorius
by peter＠chubb.wattle.id.au 19 Nov '20

19 Nov '20

Hi, I've put up a mailman3 instance, with hyperkitty enabled, and imported all my mailman2.1 archives -- it all seems to be working. How do I now customise the look and feel of my site? In particular, I'd like to render archived emails with a monospace font, and I'd like to change the colour scheme and styles of all the pages to match other pages on the same website. Peter C

2 1

Dealing with confirmation requests for unsubscribes
by Brian Carpenter 18 Nov '20

18 Nov '20

Hello List, I ran into the following issue for some mailman 3 lists that I am hosting: https://gitlab.com/mailman/mailman/-/issues/768 Since there is no way for a list owner to deal with a moderation request for an unsubscription task, I assume I need to do something via the command line. This is where I need some help with. How do I deal with these moderation requests that are unable to be reviewed in an admin gui (Postorius/Affinity)? I do recommend removing such choices for Postorius for Member policy. I will be doing this for Affinity until issue 768 is resolved. Thanks! -- Brian Carpenter Harmonylists.com Emwd.com

2 2

KeyError: 'subject_prefix'
by Torge Riedel 18 Nov '20

18 Nov '20

Hi, today I had the following error in my inbox: KeyError: 'subject_prefix' AttributeError: 'MailingList' object has no attribute 'subject_prefix' I checked the database, there is a column "subject_prefix", so I feel it is something in the code causing the error. It's mailman 3.3.1 and I don't see a fix for such an error in the Changes of 3.3.2 Kind regards Torge Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 119, in __getattr__ return self._get(name) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 86, in _get raise KeyError(key) KeyError: 'subject_prefix' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/models/mailinglist.py", line 197, in update_from_mailman value = getattr(mm_list, propname) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 124, in __getattr__ self.__class__.__name__, name)) AttributeError: 'MailingList' object has no attribute 'subject_prefix' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/django_extensions/management/commands/runjobs.py", line 36, in runjobs job().execute() File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/jobs/sync_mailman.py", line 36, in execute sync_with_mailman() File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/lib/mailman.py", line 132, in sync_with_mailman mlist.update_from_mailman() File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/models/mailinglist.py", line 199, in update_from_mailman value = mm_list.settings[propname] File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 146, in __getitem__ return self._get(key) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 88, in _get return self.rest_data[key] File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 74, in rest_data response, content = self._connection.call(self._url) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 112, in call error_msg, response, None) urllib.error.HTTPError: HTTP Error 500: <html> <head> <title>Internal Server Error</title> </head> <body> <h1><p>Internal Server Error</p></h1> </body> </html> ERROR OCCURED IN DAILY JOB: sync_mailman (APP: hyperkitty) START TRACEBACK: END TRACEBACK

3 6

Templates
by Odhiambo Washington 18 Nov '20

18 Nov '20

Hello good people, So today I decided that I should be looking at MM3 to see how far it can take me. I started from the templates and created one for a footer for non-digest messages. When I sent a test mail to the list I am using for testing, the following errors popped up: --- Logging error --- Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/model/template.py", line 110, in get contents = protocols.get(actual_uri, **auth) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/utilities/protocols.py", line 39, in get response.raise_for_status() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/requests-2.24.0-py3.7.egg/requests/models.py", line 941, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://localhost:8000/mm3/mailman3/api/templates/list/kictanet-2.lists.kict… During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/logging.py", line 76, in emit msg = self.format(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 869, in format return fmt.format(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 611, in format s = self.formatMessage(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 580, in formatMessage return self._style.format(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 422, in format return self._fmt % record.__dict__ KeyError: 't' Call stack: File "/opt/mailman/mm/venv/bin/runner", line 33, in <module> sys.exit(load_entry_point('mailman==3.3.3b1', 'console_scripts', 'runner')()) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 782, in main rv = self.invoke(ctx) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/decorators.py", line 21, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/bin/runner.py", line 188, in main runner.run() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/runner.py", line 134, in run filecnt = self._one_iteration() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/mta/deliver.py", line 86, in deliver refused = agent.deliver(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/mta/base.py", line 167, in deliver callback(mlist, message_copy, msgdata_copy) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/mta/decorating.py", line 32, in decorate decorator.process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/handlers/decorate.py", line 264, in process process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/handlers/decorate.py", line 89, in process footer = decorate('list:member:regular:footer', mlist, d) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/handlers/decorate.py", line 226, in decorate template = getUtility(ITemplateLoader).get(name, mlist, **extradict) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/model/template.py", line 189, in get name, lookup_context, **substitutions) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/model/template.py", line 118, in get actual_uri, auth.get('auth', '<no authorization>'))) File "/usr/local/lib/python3.7/logging/__init__.py", line 1413, in exception self.error(msg, *args, exc_info=exc_info, **kwargs) File "/usr/local/lib/python3.7/logging/__init__.py", line 1407, in error self._log(ERROR, msg, args, **kwargs) File "/usr/local/lib/python3.7/logging/__init__.py", line 1514, in _log self.handle(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 1524, in handle self.callHandlers(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 1586, in callHandlers hdlr.handle(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 894, in handle self.emit(record) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/logging.py", line 85, in emit self.handleError(record) Message: 'Cannot retrieve template at http://localhost:8000/mm3/mailman3/api/templates/list/kictanet-2.lists.kict… (<no authorization>)' Arguments: () I am unable to guess the cause of this. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

2 3

warning: database postfix_domains.db is older than source file postfix_domains
by Torge Riedel 15 Nov '20

15 Nov '20

Hi, I frequently get this warning mail.log. stat'ing the files give: # stat /opt/mailman/var/data/postfix_domains File: /opt/mailman/var/data/postfix_domains Size: 361 Blocks: 8 IO Block: 4096 regular file Device: 801h/2049d Inode: 1573095 Links: 1 Access: (0660/-rw-rw----) Uid: ( 1004/ mailman) Gid: ( 1002/ mailman) Access: 2020-10-24 19:52:16.887258326 +0200 Modify: 2020-10-20 07:09:48.792000000 +0200 Change: 2020-10-20 07:09:48.792000000 +0200 Birth: - # stat /opt/mailman/var/data/postfix_domains.db File: /opt/mailman/var/data/postfix_domains.db Size: 12288 Blocks: 24 IO Block: 4096 regular file Device: 801h/2049d Inode: 1583965 Links: 1 Access: (0640/-rw-r-----) Uid: ( 1004/ mailman) Gid: ( 1002/ mailman) Access: 2020-10-26 07:46:54.569935782 +0100 Modify: 2020-10-20 07:09:47.575889000 +0200 Change: 2020-10-20 07:09:47.575889000 +0200 Birth: - I do not have the feeling that this is really a problem, cause everything works well. But it is confusing and misleading and might makes me missing a problem in the future, when the database is really outdated. Could this be easily fixed in mailman? It's mailman core 3.3.1. Kind regards Torge

3 6

MIMEDefang to fix footers
by Ryan Morash 15 Nov '20

15 Nov '20

Does anyone know how to use MIMEDefang to fix the footer as attachment issue when using Mailman3? I've seen several guides/scripts referring to its use with Mailman2, but I'm unsure of how they would match with Mailman 3. Other ways of fixing this issue are also welcome. Ryan Morash IT Support Technician Questar III BOCES Confidential Transmission This correspondence is confidential and may contain privileged materials or information. It is intended for the use of the addressee only and all others are prohibited from copying or disseminating this message or its contents. If you have received this transmission in error, delete it immediately and notify the sender.

3 2

Hyperkitty Error Curiosity
by Brian Carpenter 12 Nov '20

12 Nov '20

Hello Everyone, There was a message sent to a list that could not be archived by Hyperkitty for the following reason: WARNING 2020-11-03 17:20:54,507 800 hyperkitty.views.mailman Could not archive the email with message-id '<67BEBD75-B3DC-45E3-9C2F-55482F811238(a)ispdomain.com>': A string literal cannot contain NUL (0x00) characters. It looks like there was a problem with the email message itself. What causes such an error? Thank you for any insight. -- Brian Carpenter Harmonylists.com Emwd.com

2 8

digest summary heavily cluttered with hrml code
by Mohsen Masoudfar 11 Nov '20

11 Nov '20

Hi, I am running Mailman 3.1.1 on Ubuntu 18.04. The user complains that the digest summary is cluttered with HTML code. I thought, I may fix it by: Members > {user} > Member options > Delivery mode set to [Plain Text Digest]. After setting the value and clicking [save changes], I tried to check the value by getting back to Members setting for the user, it shows the value as "Regular", which was the value before I tried to update it. Question 1: How may I be sure that the value is set, if it is set? Question 2: How may set it for all members of the list? Question 3: Is there a CLI way to do this? I tried "mailman members " command. But it seems not supporting this option. Any help is much appreciated. Thanks Mohsen

2 4

How to Increase outgoing mail volume for Mailman 3
by Brian Carpenter 10 Nov '20

10 Nov '20

Hello everyone, We had a new client come on board that brought a list that had the largest out-going mail volume that I have ever dealt with. So I did what any sane server administrator would do that is running Mailman 3: I ran to Mark Sapiro for help! Here is what the Sage of all things Mailman counseled me to do: 1. Disabled VERP delivery. VERP can help improve mail delivery by delivering 1 message per SMTP transaction (I think I got that right). Using VERP is counter-productive as it can seriously delay outgoing mail delivery for a high-volume list. So you can use something like the following in the MTA section of your mailman.cfg: [mta] verp_confirmations: no verp_personalized_deliveries: no verp_delivery_interval: 0 2. I configured Mailman 3 to run 4 outgoing runners. The default is 1. This action was the game changer. It allows Mailman to handle 4 incoming messages at a time instead of 1. My client's incoming list volume was high enough where it was overwhelming the single outgoing runner. Here is what I added to the mailman.cfg file: [runner.out] instances: 4 Doing this step immediately solved the backlog in var/queue/out. 3. If you start up with a new server for a list that is high volume then keep an eye out for Proofpoint and Vade Security as they will block your new IP address quicker than Mark Sapiro can say "This is a bug. See <some Gitlab.com url>" Mark, thank you! -- Brian Carpenter Harmonylists.com Emwd.com

3 7

members list in Postorius
by Peter Münster 10 Nov '20

10 Nov '20

Hi, Where can I display the members list of a mailing list please? The setting of "Members List Visibility" is "Only mailing list members". So I guess that a member should be able to see the members list somewhere... I'm using Postorius 1.3.3 and Mailman 3.3.1. TIA for any help, -- Peter

2 1

Mailman3 don't work if aliases are enabled
by Massimo Zappalà 09 Nov '20

09 Nov '20

Hi everybody, Using the following postfix configuration file, email messages and mailing lists works fine with mailman3. But if I send an email to an alias, the message is not received. My main.cf alias_maps = hash:/etc/aliases compatibility_level = 2 content_filter = amavis:[127.0.0.1]:10024 inet_protocols = ipv4 local_recipient_maps = proxy:unix:passwd.byname $alias_maps hash:/var/lib/mailman3/data/postfix_lmtp mailbox_size_limit = 0 message_size_limit = 20480000 milter_default_action = accept milter_protocol = 2 myhostname = glugct.catania.linux.it non_smtpd_milters = inet:localhost:12301 owner_request_special = no recipient_delimiter = + relay_domains = smtp_header_checks = regexp:/etc/postfix/header_checks smtp_mime_header_checks = regexp:/etc/postfix/header_checks smtp_tls_CApath = /etc/ssl/certs smtp_tls_cert_file = $smtpd_tls_cert_file smtp_tls_key_file = $smtpd_tls_key_file smtp_tls_security_level = may smtp_use_tls = yes smtpd_banner = $myhostname ESMTP smtpd_milters = inet:localhost:12301 smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_invalid_hostname, reject_non_fqdn_hostname, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_destination, check_policy_service inet:[127.0.0.1]:10023, reject_rbl_client zen.spamhaus.org, reject_rbl_client bl.spamcop.net, reject_rbl_client cbl.abuseat.org, permit smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CApath = /etc/ssl/certs smtpd_tls_cert_file = /etc/letsencrypt/live/mail.catania.linux.it/fullchain.pem smtpd_tls_eecdh_grade = strong smtpd_tls_key_file = /etc/letsencrypt/live/mail.catania.linux.it/privkey.pem smtpd_tls_security_level = may tls_preempt_cipherlist = yes transport_maps = hash:/var/lib/mailman3/data/postfix_lmtp virtual_gid_maps = static:5000 virtual_mailbox_base = /var/vmail virtual_mailbox_domains = mysql:/etc/postfix/mysql_virtual_mailbox_domains.cf virtual_transport = lmtp:unix:private/dovecot-lmtp virtual_uid_maps = static:5000 #virtual_alias_maps = mysql:/etc/postfix/mysql_virtual_alias_emails.cf, mysql:/etc/postfix/mysql_virtual_alias_maps.cf #virtual_mailbox_maps = mysql:/etc/postfix/mysql_virtual_mailbox_maps.cf ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_alias_emails.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT email FROM users WHERE email='%s' ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_alias_maps.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT destination FROM aliases WHERE source='%s' ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_mailbox_domains.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT 1 FROM domains WHERE domain='%s' ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_mailbox_maps.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT 1 FROM users WHERE email='%s' ----------------------------------------------------------------------------------------- If I try to uncomment the last two rows in main.cf virtual_alias_maps = mysql:/etc/postfix/mysql_virtual_alias_emails.cf, mysql:/etc/postfix/mysql_virtual_alias_maps.cf virtual_mailbox_maps = mysql:/etc/postfix/mysql_virtual_mailbox_maps.cf The aliases and email messeges works fine but the mailman3's mailinglist don't work. How can I solve this? Thank You in advance.

2 2

Digest Formatting
by mailman＠manygoodideas.com 07 Nov '20

07 Nov '20

It appears that a digest is formatted as: list:member:digest:masthead 1. Thread 1 ... N. Thread N foreach thread list:member:digest:header thread list:member:digest:footer A number of my testers are complaining about the formatting: 1) it's hard to visually identify each of the threads (the TOC numbers them, but the numbers aren't shown next to each thread, for example) and 2) it's hard for a novice to know how to reply to a digest thread I'm wondering how other admins have customized their digests to make them more useful. For example, if there was a way in list:member:digest:header to display a link to the archived thread, that would be a good start. list:member:digest:header could emit a horizontal line to separate each thread, but it would be nice to be able to show the number of the thread, etc. Yahoo! Groups used to send out HTML digests that had the thread titles nicely distinguished, live links to the thread, and links to Reply to sender, Reply to All, etc. Thanks for any suggestions!

4 8

Member Issue Discovered
by Brian Carpenter 06 Nov '20

06 Nov '20

Hi Everyone, If I subscribed to a MM3 list with barn(a)emwd.com with the name of Barn Quilter. It shows up in the member roster. So far, so good. I then unsubscribe barn(a)emwd.com. It no longer shows up in the member roster. So far so good. I then resubscribe barn(a)emwd.com with either no name or Barn User and it shows up in the member roster as barn(a)emwd.com with the name of Barn Quilter. Is this a known bug and has been fixed with the latest release? -- Brian Carpenter Harmonylists.com Emwd.com

10 52

Open Subscription Policy
by Brian Carpenter 05 Nov '20

05 Nov '20

I have a question regarding the use of an open subscription policy. What is the reasoning behind such a policy? Is this something for an organization that runs a Mailman 3 instance on a private network? -- Brian Carpenter Harmonylists.com Emwd.com

2 1

Internal Server Error by Clicking on OrmQ Queue
by Stephan Krinetzki 04 Nov '20

04 Nov '20

Dear list, on our Mailman 3 system we are hitting the following error by clicking a link to admin/django_q/ormq/: Server Error The Log prints: --- ERROR 2019-08-26 08:48:01,704 10311 django.request Internal Server Error: /admin/django_q/ormq/ Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 566, in get_field return self.fields_map[field_name] KeyError: 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 276, in lookup_field f = _get_non_gfk_field(opts, name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 307, in _get_non_gfk_field field = opts.get_field(name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 568, in get_field raise FieldDoesNotExist("%s has no field named '%s'" % (self.object_name, field_name)) django.core.exceptions.FieldDoesNotExist: OrmQ has no field named 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/library.py", line 214, in render _dict = self.func(*resolved_args, **resolved_kwargs) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 326, in result_list 'results': list(results(cl))} File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 302, in results yield ResultList(None, items_for_result(cl, res, None)) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 293, in __init__ super().__init__(*items) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 212, in items_for_result f, attr, value = lookup_field(field_name, result, cl.model_admin) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 289, in lookup_field value = attr() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 200, in task_id return self.task()['id'] File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 194, in task return SignedPackage.loads(self.payload) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128) ERROR 2019-08-26 08:48:01,704 10311 django.request Internal Server Error: /admin/django_q/ormq/ Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 566, in get_field return self.fields_map[field_name] KeyError: 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 276, in lookup_field f = _get_non_gfk_field(opts, name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 307, in _get_non_gfk_field field = opts.get_field(name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 568, in get_field raise FieldDoesNotExist("%s has no field named '%s'" % (self.object_name, field_name)) django.core.exceptions.FieldDoesNotExist: OrmQ has no field named 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/library.py", line 214, in render _dict = self.func(*resolved_args, **resolved_kwargs) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 326, in result_list 'results': list(results(cl))} File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 302, in results yield ResultList(None, items_for_result(cl, res, None)) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 293, in __init__ super().__init__(*items) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 212, in items_for_result f, attr, value = lookup_field(field_name, result, cl.model_admin) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 289, in lookup_field value = attr() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 200, in task_id return self.task()['id'] File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 194, in task return SignedPackage.loads(self.payload) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128) --- Any ideas how to see the complete queue an maybe delete some defunct entries?

2 1

Change Default Settings
by Dieter Leupold 03 Nov '20

03 Nov '20

Hi Team, I want to change default settings (like "welcome message" to set to no) for the lists to create. How can i do that? Thanks a lot Dieter Leupold

2 3

Hyperkitty: usage of h2-tags
by Peter Münster 02 Nov '20

02 Nov '20

Hi, Why does Hyperkitty use h2-tags for the last line before the signature please? Example: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… Kind regards, -- Peter

2 2

Subscription issue with ghost confirmations
by Brian Carpenter 01 Nov '20

01 Nov '20

I have a list owner who had his subscription policy set to confirm. Apparently that was too hard for his list members to handle so he changed it to moderate only. If someone sent a subscription request that needed to be confirm, did not respond to it, and then tried subscribing again after the member policy changed to moderate, their 2nd subscription attempt still shows up in the confirmation queue. Is that normal behavior. My understanding is it is. Please let me know if I am wrong here. The real mystery here is when someone tried subscribing again (listname-subscribe@listdomain) hours after the subscription policy was changed to moderate and they still showed up in the confirm queue. How is that possible? I tested the list with two of my addresses and both showed up in the moderation queue as expected. As far as I can tell from the mailman logs, this was the person's first attempt at subscribing. -- Brian Carpenter Harmonylists.com Emwd.com

3 9

Internal Server Error on installing Mailman 3 using PIP
by Shashikanth Komandoor 28 Oct '20

28 Oct '20

Dear Mark, As you have suggested in my earlier issue, I have implemented the latest stable version of mailman 3 through the URL https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst… . But after the installation through the above URL, when I tried running the command *elinks http://localhost:8000/postorius/lists <http://localhost:8000/postorius/lists>* or *elinks http://localhost:8000/admin <http://localhost:8000/admin>*, I got the error as *Internal Server Error*. I don't find any specific log in mailman.log or in mailmansuite.log. Is there any way to solve this issue ? -- Thanks & Regards, Shashi Kanth.K 9052671936

2 1

AttributeError: 'MailingList' object has no attribute 'get_requests_count'
by Shashikanth Komandoor 28 Oct '20

28 Oct '20

Hi Team, I am currently running Mailman 3 with version 3.3.2rc2 and in built postfix version 2.10.1-6 on RHEL 7.5 with PostgreSQL 11.9 version with default values. As of now, we don't have any lists and just installed software components only. After the installation and configuration, I have tried creating the domains and lists. I was successful in creating them but when I tried to login and browse the lists using LDAP authentication, I am getting the "Mailman REST API not available. Restart Mailman core". I see the below trace in the mailmansuite.log. *Traceback (most recent call last): File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/mailmanclient/restbase/base.py", line 119, in __getattr__ return self._get(name) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/mailmanclient/restbase/base.py", line 86, in _get raise KeyError(key)KeyError: 'get_requests_count'During handling of the above exception, another exception occurred:Traceback (most recent call last): File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/core/handlers/base.py", line 115, in _get_response response = self.process_exception_by_middleware(e, request) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/var/lib/mailman/postorius/src/postorius/views/generic.py", line 74, in dispatch return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/views/generic/base.py", line 97, in dispatch return handler(request, *args, **kwargs) File "/var/lib/mailman/postorius/src/postorius/views/list.py", line 311, in get return render(request, 'postorius/lists/summary.html', data) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/shortcuts.py", line 19, in render content = loader.render_to_string(template_name, context, request, using=using) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 171, in render return self._render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/library.py", line 234, in render return t.render(new_context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 173, in render return self._render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 986, in render output = self.filter_expression.resolve(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 697, in resolve new_obj = func(obj, *arg_vals) File "/var/lib/mailman/postorius/src/postorius/templatetags/nav_helpers.py", line 80, in pending_subscriptions return mlist.get_requests_count(token_owner='moderator') File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/mailmanclient/restbase/base.py", line 124, in __getattr__ self.__class__.__name__, name))AttributeError: 'MailingList' object has no attribute 'get_requests_count'ERROR 2020-10-25 19:29:46,101 835 django.server "GET /postorius/lists/mailteamhyd.dlist.nic.in/ <http://mailteamhyd.dlist.nic.in/> HTTP/1.1" 500 1162* I don't see any error messages in the mailman.log. And I also executed a few curl commands in getting the details of the lists created and list info which I got their results successfully. Could you please guide where exactly I am missing or do I need to make any changes in my customizations ? -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 21

Cron error
by gordon＠dickens.com 25 Oct '20

25 Oct '20

I recently upgraded to mailman3 on two Debian servers and I am getting a cron error periodically sent to me as depicted below. It looks like a permission problem, however, /var/lib/mailman3/locks and /var/lib/mailman3/* all have user = "list" and group = "list" and the cron job runs as user = "list" so I don't quite understand why I am getting these errors. Hopefully, someone might reply with what the problem is. Thanks, Gordon Here is some additional information: "ls -ld locks" output: drwxr-xr-x 2 list list 4096 Sep 28 08:51 locks ls -l locks" output: total 12 -rw-rw---- 1 list list 80 Sep 28 00:00 'dbcreate.lck|slc.mailhub4u.com|24435|4056142050254595815' -rw-rw---- 2 list list 77 Sep 28 2020 master.lck -rw-rw---- 2 list list 77 Sep 28 2020 'master.lck|slc.mailhub4u.com|5291|3708878559945320758' Here is the error message that is emailed to me: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 216, in lock os.link(self._claimfile, self._lockfile) FileExistsError: [Errno 17] File exists: '/var/lib/mailman3/locks/dbcreate.lck|slc.mailhub4u.com|24435|4056142050254595815' -> '/var/lib/mailman3/locks/dbcreate.lck' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/mailman", line 11, in <module> load_entry_point('mailman==3.2.1', 'console_scripts', 'mailman')() File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/core.py", line 716, in main with self.make_context(prog_name, args, **extra) as ctx: File "/usr/lib/python3/dist-packages/click/core.py", line 641, in make_context self.parse_args(ctx, args) File "/usr/lib/python3/dist-packages/click/core.py", line 1089, in parse_args rest = Command.parse_args(self, ctx, args) File "/usr/lib/python3/dist-packages/click/core.py", line 940, in parse_args value, args = param.handle_parse_result(ctx, opts, args) File "/usr/lib/python3/dist-packages/click/core.py", line 1477, in handle_parse_result self.callback, ctx, self, value) File "/usr/lib/python3/dist-packages/click/core.py", line 96, in invoke_param_callback return callback(ctx, param, value) File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 94, in initialize_config initialize(value) File "/usr/lib/python3/dist-packages/mailman/core/initialize.py", line 218, in initialize initialize_2(propagate_logs=propagate_logs) File "/usr/lib/python3/dist-packages/mailman/core/initialize.py", line 177, in initialize_2 config.db = getUtility(IDatabaseFactory, utility_name).create() File "/usr/lib/python3/dist-packages/mailman/database/factory.py", line 50, in create with Lock(os.path.join(config.LOCK_DIR, 'dbcreate.lck')): File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 334, in __enter__ self.lock() File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 248, in lock elif self._read() == self._claimfile: File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 442, in _read with open(self._lockfile) as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/locks/dbcreate.lck'

3 8

migration from 2.1 - owners and moderators
by Alex Schuilenburg 25 Oct '20

25 Oct '20

We're migrating from 2.1 to 3.2.1 and an odd issue has popped up. It may be something different in the way mailman3 works, or a misconfiguration on my part. Most of the lists migrated so far don't have moderators, just owners. However, when these lists have messages requiring moderation, the owners dont get notified of held messages - unlike 2.1 where they did. Is this a change or is there something I am missing in the configuration? I have the minute/quarterly/hourly etc cron jobs running, although I have had to tune down the frequency of minute to hourly as it takes 6.5 minutes to run* - but I doubt this is the cause. While for the moment I have found the held messages in files in /var/lib/mailman3/messages and figured out which lists are in need of attention (and notified the owners), it seems I may have to do a bit of coding myself to walk through the lists and notify owners when their list is in need of attention. There must surely be something that does this already - or is this moderators only in mailman3? Guidance appreciated. Thanks -- Alex * From the list I realise this is because I am still using the default whoosh backend to haystack and need urgently to switch to xapian or solr, but the info on how to get this working for a noob like me is unfortunately lacking :-(

3 5

How to get Hyperkitty to show actual sender e-mail addresses?
by Hans-Martin Mosner 24 Oct '20

24 Oct '20

Hi, I'd like to show actual sender e-mail addresses (basically to block spammers sending to a list that is used as a contact address, so it has no moderation for non-member postings). Hyperkitty just show the display name, which not very informative. Is there a setting to change this behavior? I did not find any using internet search and sifting through the various config files, but I could easily have missed something. Cheers, Hans-Martin

2 1

Alias Domains in postfix_domains wrong way around?
by Hans-Martin Mosner 24 Oct '20

24 Oct '20

Hi, we have an "Unusual Postfix configuration" and use "Alias Domains" to work around. However, it looks like "mailman aliases" generates the postfix_domains map the wrong way around, resulting in postfix "Relay access denied" errors for mails received from outside. Didn't notice at first since I tried locally of course. Is my understanding correct that postfix_domains should have the true (externally visible) domains as keys, and values that basically don't matter, or should it have both the real domains and their alias names as keys? With such a convoluted setup, my brain twists a little. For now, I'm listing the real domains explicitly, that seems to work for the local and non-local cases. Cheers, Hans-Martin

2 1