August 2021 - Mailman-users - lists.mailman3.org

can't get mail into mailman3 in docker
by bob B 13 Aug '21

13 Aug '21

I am trying to get mail into mailman in docker, I can send a test messages out from the container. But can't get mail in. Any idea what I am missing? mydomain.mydomain.com is substituted for the actual domain in the below output My /etc/postfix/main.cf has ------------------------------------- mydestination = $myhostname, localhost.$mydomain, localhost, mydomain.mydomain.com transport_maps = regexp:/opt/mailman/core/var/data/postfix_lmtp local_recipient_maps = regexp:/opt/mailman/core/var/data/postfix_lmtp relay_domains = regexp:/opt/mailman/core/var/data/postfix_domains # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no ------------------------------------- my /opt/mailman/core/mailman-extra.cfg has ------------------------------------- # mailman-extra.cfg [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver # mailman-core hostname or IP from the Postfix server lmtp_host: localhost lmtp_port: 8024 # Postfix server's hostname or IP from mailman-core smtp_host: outbound-mail.mydomain.mydomain.com smtp_port: 25 configuration: /etc/postfix-mailman.cfg [mailman] # This address is the "site owner" address. Certain messages which must be # delivered to a human, but which can't be delivered to a list owner (e.g. a # bounce from a list owner), will be sent to this address. It should point to # a human. site_owner: admin(a)mydomain.mydomain.com ------------------------------------- The instructions say "The configuration file /etc/postfix-mailman.cfg is generated automatically." But I do not have that file is this the issue?? cat: /etc/postfix-mailman.cfg: No such file or directory When I send mail to my domain to a list i created called 'test' I get ------- 2021-08-02T13:33:08.666502-04:00 bmimailmandr1 postfix/cleanup[113557]: A068930294D8: message-id=<7C8556BA-156D-4A31-A64E-428C62D31AA1(a)mac.com> 2021-08-02T13:33:08.680953-04:00 bmimailmandr1 postfix/qmgr[113209]: A068930294D8: from=<testuser @bmail.com>, size=8275, nrcpt=1 (queue active) 2021-08-02T13:33:08.713683-04:00 bmimailmandr1 postfix/lmtp[113559]: A068930294D8: lost connection with localhost[127.0.0.1] while receiving the initial server greeting 2021-08-02T13:33:08.725326-04:00 bmimailmandr1 postfix/lmtp[113559]: connect to localhost[::1]:8024: Connection refused 2021-08-02T13:33:08.735727-04:00 bmimailmandr1 postfix/lmtp[113559]: A068930294D8: to=<test-join(a)mydomain.mydomain.com>, relay=none, delay=0.07, delays=0.03/0.01/0.03/0, dsn=4.4.1, status=deferred (connect to localhost[::1]:8024: Connection refused) -----

4 17

Using Header filters
by Mohsen Masoudfar 13 Aug '21

13 Aug '21

Hi, I wonder if it is possible using the "Header filters" option to filter for a specific word to push the message to Moderation? Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

2 2

Mailman3 Issue with Sending Mail to Yahoo/AOL
by chris＠zimmerman.to 11 Aug '21

11 Aug '21

Hi everyone. I have a dedicated Ubuntu box that is running mailman3. I have a single email list on it. The subscriber base is about 350 users. There is a good chunk of these users that are aol.com or yahoo.com users. I've been getting complaints from the Yahoo people that mail is delayed at times, or messages that come out of order. Looking at the mailq on the box, I can see there are plenty of emails stuck in the queue. I have all sorts of messages like this ... -Queue ID- --Size-- ----Arrival Time---- -Sender/Recipient------- 3576C540CB4 9917 Tue May 11 11:27:13 pcho-bounces(a)pchochat.com (host mta6.am0.yahoodns.net[67.195.204.74] said: 452 Too many recipients tnmpmscs (in reply to RCPT TO command)) <removed list of email addresses> (host mta6.am0.yahoodns.net[67.195.204.74] said: 421 [IPTS04] Messages from 74.112.73.65 temporarily deferred due to unexpected volume or user complaints - 4.16.55.1; see https://postmaster.verizonmedia.com/error-codes (in reply to end of DATA command)) <removed list of email addresses> 10932540D16 32765 Tue May 11 18:34:13 pcho-bounces(a)pchochat.com (host mta6.am0.yahoodns.net[67.195.228.111] said: 421 4.7.0 [TSS04] Messages from 74.112.73.65 temporarily deferred due to unexpected volume or user complaints - 4.16.55.1; see https://postmaster.verizonmedia.com/error-codes (in reply to MAIL FROM command)) <removed list of email addresses> (host mx-biz.mail.am0.yahoodns.net[67.195.204.83] said: 421 4.7.0 [TSS04] Messages from 74.112.73.65 temporarily deferred due to unexpected volume or user complaints - 4.16.55.1; see https://postmaster.verizonmedia.com/error-codes (in reply to MAIL FROM command)) <removed list of email addresses> (host mx-aol.mail.gm0.yahoodns.net[67.195.228.84] said: 421 4.7.0 [TSS04] Messages from 74.112.73.65 temporarily deferred due to unexpected volume or user complaints - 4.16.55.1; see https://postmaster.verizonmedia.com/error-codes (in reply to MAIL FROM command)) (host mta6.am0.yahoodns.net[67.195.228.111] said: 421 4.7.0 [TSS04] Messages from 74.112.73.65 temporarily deferred due to unexpected volume or user complaints - 4.16.55.1; see https://postmaster.verizonmedia.com/error-codes (in reply to MAIL FROM command)) <removed list of email addresses> So it seems that Yahoo/AOL keeps detecting my mailman3 server as either spam, sending too much email, or too many recipients. This email server is for our neighborhood community. Its moderated to join, and we know every single user on this list. We know it's not being reported as spam by our users. Anyone anyone shed some light on how to appropriately solve this issue?

8 8

Avoiding non-members to be saved.
by Guillermo Hernandez (Oldno7) 09 Aug '21

09 Aug '21

Hi all: Yesterday I had a problem with a private list. A spammer sent a mail forging one address that was a non-member (in fact was an "accept this no subscriber mails" from mailman 2.1 import) with very bad intentions and it was distributed. There were no list of "accept this non members" in the Postorius config (but I'm sure that that address was "accepted" in 2.1). To avoid this from any other non member address I deleted ALL non-members. I think it is solved now (deleting all and putting to hold just the non-members addresses that I would want to pass messages on) The fact is that any sender address of mails sent to the list is saved as a "non member", and it make me nervous as it will grow despite it is a legitimate message or not. Anybody knows if there is a per list config to avoid saving all that addresses as non members? o a overall config? I couldn't find anything about this in the config pages (or googling it) Thanks in advance. --

3 7

nginx config example link broken for docker and mailman3
by bob B 09 Aug '21

09 Aug '21

FYI, on this page https://asynchronous.in/docker-mailman/ this link is broken for nginx config example in "See the nginx configuration as an example." https://docs.mailman3.org/en/latest/prodsetup.html#nginx-configuration

2 1

I need professional help to get virtualenv Mailman3 installation running
by John Seifarth 09 Aug '21

09 Aug '21

Hello, I have been running Linux mailman2 servers for about 10 years, and sendmail/postfix servers for over 20 years. I have a client who wants to upgrade to Mailman 3 from their current Mailman2 system. I wanted to avoid the disruption of an upgrade, so I implemented a series of test servers with different names (leaving the mailman2 server in production at its historical address) running Ubuntu 18 and Ubuntu 20, using the mailman3 packages (3.1and 3.2 respectively). I sort of got it running with mailman 3.2 on Ubuntu 20, but couldn’t get Hyperkitty archiving to work. Plus the fact that mail bounce handling isn’t implemented prior to mailman 3.3.2, I decided to install the latest mailman version available in a venv environment, using the instructions at https://docs.mailman3.org/en/latest/install/virtualenv.html I followed the instructions carefully using the same paths, and tracked down and fixed errors as each step progressed. I finally set up a WSGI server according to the instructions, searched for and found (fragmentary) instructions for setting up the Apache configuration, started the mailman3 and mailman web services, and now have no errors in the /opt/mailman/web/logs files, the /var/log/apache files, and in syslog. But when I try to connect via the Web, I get the message "Server error An error occurred while processing your request.” in my browser. No other clues. I’m completely stuck, and I need help to conclude this rapidly, the client really needs the new service up and running ASAP. I’m at the limit of my competence. I’ve been learning Python on and off (insufficient available time), and I installed Django and ran the tutorials. I still am woefully unskilled in the subtleties of a complex Python project like Mailman/Posterious/Hyperkitty, and I really need the help of an expert who can log into the server and see for themselves where the problem(s) are, and fix them. What I need is an experienced Python programmer, who has installed, run, and upgraded venv mailman3 installations. Of course, I will pay for this expertise, and charge it to the end client. In other words, I will pay you directly, and then I will worry about getting paid myself later. I am ready to pay €60/h for your skills, paid directly to your bank account, after receipt of your invoice. It shouldn’t be all that much work, since everything has been installed according to instructions, I’m just not a good enough Python programmer to get all the parts to work together correctly. It’s important to note that the end client is an organisation of European political parties, the virtual machine running the Ubuntu 20 server is hosted at OVH in France. Thus the professional with whom I would work should preferably also be based in the EU, and subject to EU law. Practically speaking, if anyone is interested, please send me a direct email with your email address and phone number, and then we can discuss how to do this practically in terms of SSH access, passwords, etc. Thanks for taking the time to read this, and I hope some Python Mailman pro can come to my aid. John

3 2

Mailman3 stopped working after Upgrade to Ubuntu 21.04
by Thomas Möhle 08 Aug '21

08 Aug '21

Hey, I have set up mailman3 with mailman3-web on my mailserver and after upgrading to Ubuntu 21.04 my setup stopped working. I can see repeating log entries of mailman trying to reach something within hyperkitty and getting an error. The same constant repeating cycle of log entries is visible in my log files. I have attached my config files as well as the logfiles for mailman3 and mailman-web. As you can see, I'm not really getting many errors, yet within 5 seconds there are almost 2000 lines of log entries where mailman tries to reach something within hyperkitty over and over and over again. One thing I did to create an error message is start up both services, then edit a test list, that I created, in the web interface. This is the error you can find in the logs then: ERROR 2021-08-07 12:50:26,932 2343625 postorius Un-handled exception: HTTP Error 404: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/generic.py", line 74, in dispatch return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py", line 97, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/list.py", line 301, in get primary_email = set_preferred(request.user, mm_user) File "/usr/lib/python3/dist-packages/postorius/utils.py", line 77, in set_preferred mm_user.preferred_address = primary_email.email File "/usr/lib/python3/dist-packages/mailmanclient/restobjects/user.py", line 57, in __setattr__ super(User, self).__setattr__(name, value) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py", line 131, in __setattr__ return super(RESTObject, self).__setattr__(name, value) File "/usr/lib/python3/dist-packages/mailmanclient/restobjects/user.py", line 145, in preferred_address response, content = self._connection.call(url, {'email': email}) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py", line 127, in call raise HTTPError(url, response.status_code, urllib.error.HTTPError: HTTP Error 404: WARNING 2021-08-07 12:50:26,938 2343625 django.request Not Found: /mailman3/postorius/lists/test.lists.example.com/ Can anyone here help me debug this? I'm working on this problem for days now and can't seem to find a solution. Thanks so much in advance, Thomas

2 3

remove non members from a list
by Guillermo Hernandez (Oldno7) 06 Aug '21

06 Aug '21

Hi all: I need to remove all non members from a list. I know I can do it via Postorius, but it has to be done one at a time. (you can delete ALL suscribers but not all non members...) Anyone has a python recipe to do this? I've been searching and googling but I cannot find the way of doing it safely. And via DDBB there are more than one table involved and I'd rather not mess it all... Thanks in advance

2 6

Not able to start mailman server
by Kartheek Reddy Bondugula 05 Aug '21

05 Aug '21

Hi, I am trying to start the mailman server on a mac according to the instructions given on the website as shown - $(py3) git clone git@gitlab.com:mailman/mailman.git $(py3) cd mailman $(py3) python setup.py develop $(py3) mailman start $(py3) cd .. But I run into the following problem - Starting Mailman's master runner Generating MTA alias maps /usr/local/Cellar/python(a)3.9/3.9.5/bin/python3.9: can't open file '/usr/local/opt/python(a)3.9/bin/master': [Errno 2] No such file or directory Can anyone help me out with this? Thanks, Kartheek

3 5

UnpicklingError on mailman lists command
by Bryan Loniewski 04 Aug '21

04 Aug '21

Hi all -- I'm getting the error below when trying to exec the "mailman lists" command. I've turned debugging on within my test mailman.cfg like so... [database] class: mailman.database.mysql.MySQLDatabase <snip> debug: yes [logging.database] level: debug path: dbmailman.log and can see a lot of info including the row(s) with each lists data returned in dbmailman.log. Any guidance on further troubleshooting/debugging? Note that listing the members returns fine (at least for the handful of lists I just tested, i.e., /opt/mailman/mm/bin/mailman members bry_test(a)lists-test.rutgers.edu) $ /opt/mailman/mm/bin/mailman lists Traceback (most recent call last): File "/opt/mailman/venv/bin/mailman", line 8, in <module> sys.exit(main()) File "/opt/mailman/venv/lib/python3.6/site-packages/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/opt/mailman/venv/lib/python3.6/site-packages/click/core.py", line 782, in main rv = self.invoke(ctx) File "/opt/mailman/venv/lib/python3.6/site-packages/mailman/bin/mailman.py", line 68, in invoke return super().invoke(ctx) File "/opt/mailman/venv/lib/python3.6/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/mailman/venv/lib/python3.6/site-packages/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman/venv/lib/python3.6/site-packages/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/opt/mailman/venv/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman/venv/lib/python3.6/site-packages/mailman/commands/cli_lists.py", line 78, in lists for mlist in list_manager.mailing_lists: File "/opt/mailman/venv/lib/python3.6/site-packages/mailman/model/listmanager.py", line 100, in mailing_lists MailingList._list_id).all() File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 3246, in all return list(self) File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/orm/loading.py", line 101, in instances cursor.close() File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 69, in __exit__ exc_value, with_traceback=exc_tb, File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 178, in raise_ raise exception File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/orm/loading.py", line 81, in instances rows = [proc(row) for row in fetch] File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/orm/loading.py", line 81, in <listcomp> rows = [proc(row) for row in fetch] File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/orm/loading.py", line 589, in _instance populators, File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/orm/loading.py", line 726, in _populate_full dict_[key] = getter(row) File "/opt/mailman/venv/lib/python3.6/site-packages/sqlalchemy/sql/sqltypes.py", line 1708, in process return loads(value) _pickle.UnpicklingError: pickle data was truncated ________________________ Bryan Loniewski Rutgers University OIT:EAS:Messaging and Collaboration Services System Administrator

2 7