August 2021 - Mailman-users - lists.mailman3.org

Logging subscriptions and unsubscriptions
by Christian Schoepplein 28 Aug '21

28 Aug '21

Hi, I am in the process to migrate from mailman 2 to mailman 3 and currently I am setting up the new environment and do some tests and play around with the new system. I'd like to have a seperate log for list subscriptions and unsubscriptions. For that reason I added the following section to the mailman-extra.cfg file: [logging.subscribe] path: subscribe.log That created a file called subscribe.log but not everything regarding subscription / unsubscriptions is added to the file. When subscribing and unsubscribing a user via mail only the following line is shown: Aug 27 10:58:31 2021 (28) tmod(a)mm3.example.com: held subscription request from chris(a)example.com Nothing regarding the finished subscription and absolutely nothing regarding the unsubscription performed later. Also in mailman.log I can find the following lines: Aug 27 10:58:05 2021 (28) deque: do_confirm_verify Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 356, in _step_send_confirmation raise StopIteration StopIteration Aug 27 10:58:31 2021 (28) deque: subscribe_from_restored Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 326, in _step_get_moderator_approval raise StopIteration StopIteration Aug 27 10:58:33 2021 (29) OWNER: <163005471133.28.13827351997075408419@mailman-core> Is this because a higher logging level or is this an error? I can find nothing really helpfull regarding subscriptions and unsubscriptions in any logfile. Is this wanted or can this changed by any configuration setting or are this information stored in the database? Cheers, Schoepp

2 1

Unwanted E-mail to Maillists Submitted via Postorius Interface
by matthew＠alberti.us 28 Aug '21

28 Aug '21

Hi Everyone, I’ve seen a recent uptick in SPAM messages making it into mailing lists. Looking at the raw, it seems that the e-mails are being submitted thru the Postorius/Hyperkitty “Start a New Thread” interface. Is there a way to turn that off? We would want people to only be able to post via e-mail. Part of the problem is that our anti-spam system RSPAMD trusts the mailman-web IP… so it doesn’t scan things originating from there.. ☹ Another uestion: Is there a way to implement captcha, or is there a recommended gate that can be put in the signup process? Apparently bots are finding a way thru the signup process, and then sending messages to the list via the Postorius web interface. There seems to be a Django plugin for it; but it appears the Mailman code would have to be adjusted to implement it. I’m open to any suggestions, including on places to check for misconfiguration. 😊 Thanks. - Matt Alberti

4 5

docker mailman-core mailman3 image not responding on port 8024
by bob B 25 Aug '21

25 Aug '21

Ok, I took a step back and started fresh... So the issue appears to be that mailman-core docker image is not replying on port 8024. I did a packet capture and it shows (172.23.01 is the gateway for the docker network on the host, 172.23.03 is the IP of mailman-core when I did the capture) *************************************** 1 2021-08-16 14:15:14.865053 172.23.0.1 172.23.0.3 TCP 74 34066 → 8024 [SYN] Seq=0 Win=29200 Len=0 MSS=1460 SACK_PERM=1 TSval=985607751 TSecr=0 WS=128 2 2021-08-16 14:15:14.865084 172.23.0.3 172.23.0.1 TCP 54 8024 → 34066 [RST, ACK] Seq=1 Ack=1 Win=0 Len=0 *************************************** The above show the docker host sending/relaying mail to mailman-core, but mailman-core does not acknowledge on port 8024. The images are up i.e *************************************** 58923db6fb9f maxking/mailman-core:0.3 "docker-entrypoint.s…" 26 minutes ago Up 25 minutes 127.0.0.1:8001->8001/tcp, 127.0.0.1:8024->8024/tcp mailman-core *************************************** Docker yamel has the port setup (8024) *************************************** services: mailman-core: image: maxking/mailman-core:0.3 container_name: mailman-core hostname: mailman-core . . ports: - "127.0.0.1:8001:8001" # API - "127.0.0.1:8024:8024" # LMTP - incoming emails networks: mailman: *************************************** I can nc to the ports for docker web & 8001 on core and they are listening But 8024 is not responding *************************************** #>docker-mailman-host]# nc -v 172.23.0.4 8000 Ncat: Version 7.50 ( https://nmap.org/ncat ) Ncat: Connected to 172.23.0.4:8000. ^C #>docker-mailman-host]# nc -v 172.23.0.4 8080 Ncat: Version 7.50 ( https://nmap.org/ncat ) Ncat: Connected to 172.23.0.4:8080. ^C #>docker-mailman-host]# nc -v 172.23.0.3 8001 Ncat: Version 7.50 ( https://nmap.org/ncat ) Ncat: Connected to 172.23.0.3:8001. ^C #>docker-mailman-host]# nc -v 172.23.0.3 8024 Ncat: Version 7.50 ( https://nmap.org/ncat ) Ncat: Connection refused *************************************** Docker logs show postfix is up on mailman-core *************************************** sudo docker logs mailman-core List of databases Name | Owner | Encoding | Collate | Ctype | Access privileges -----------+---------+----------+------------+------------+--------------------- mailmandb | mailman | UTF8 | en_US.utf8 | en_US.utf8 | postgres | mailman | UTF8 | en_US.utf8 | en_US.utf8 | template0 | mailman | UTF8 | en_US.utf8 | en_US.utf8 | =c/mailman + | | | | | mailman=CTc/mailman template1 | mailman | UTF8 | en_US.utf8 | en_US.utf8 | =c/mailman + | | | | | mailman=CTc/mailman (4 rows) Postgres is up - continuing Using Postfix configuration Found configuration file at /opt/mailman/mailman-extra.cfg HYPERKITTY_URL not set, using the default value of http://mailman-web:8000/hyperkitty *************************************** Any ideas is there anything else I can do to troubleshoot? Is the issue with the mailman-core image?

3 10

Error on timeout vs retry values
by Robert Moody 25 Aug '21

25 Aug '21

Hi everyone, I have recently setup a new mailman3 service using the venv method. Everything is functionally working however I keep getting an error sent to the mailman email every min which I can not seem to figure out why. /opt/mailman/venv/lib/python3.7/site-packages/django_q/conf.py:142: UserWarning: Retry and timeout are misconfigured. Set retry larger than timeout, failure to do so will cause the tasks to be retriggered before completion. See https://django-q.readthedocs.io/en/latest/configure.html#retry for details. See https://django-q.readthedocs.io/en/latest/configure.html#retry for details.""" I have edited the timeout and retry values in the /opt/mailman/venv/lib/python3.7/site-packages/django_q/conf.py file and restarted both mailman and mailman-web however this still keeps repeating. Any ideas? Regards, Robert -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

3 6

Mailman backend maintenance task
by eugenio.jordan＠esa.int 24 Aug '21

24 Aug '21

Dear all. My apologies if the answer to this question is obvious, but I am pretty newbie for 3 version, and to be very honest I haven't had enough time yet to have a deep look into the documentation. Our customer is currently using PostGRESQL as backend, and we would like to perform some maintenance tasks, namely running vacuum full, or at least trying to rebuild hyperkitty_email primary key related index. We have been asked on the real impact of putting in place such initiative. Though the latter is related to archiving, I haven't found a way to stop just Hyperkitty or Django related processes other than stopping Mailman's core, hence preventing mails addressed to distribution lists from being delivered, could you please confirm if I am correct? Regarding the former, as far as I have read, the "mappings" lists -> addresses are stored just in the database, so if we run some kind of procedure or task like vacuum which will lock exclusively tables, or want anyway to have the database stopped for a cold backup or whatever, Mailman willl not work, that is, again the mails addressed to the distribution lists will not be delivered. Will you please confirm this point, too? Really wish we had a testing environment to have been able to check this ourselves and not bothering others, but unfortunately we lack it, and we need to provide an answer as soon as possible. Thanks a lot for your time. Best regards.

5 9

Installing mailman3 from Ubuntu 20.04 repository
by Andy Cravens 24 Aug '21

24 Aug '21

I’m testing Mailman3 on Ubuntu 20.04 and installing the packages from the default Ubuntu repo. I’m not sure I’ll perform the install this way once we move to production. I don’t know what group is responsible for keeping the Mainlam3 package in the Ubuntu repository up to date but I’d like to find out how committed that groups is to keeping the package current. We patch often and it would be convenient if the Mailman3 package is kept updated and current. If there is going to be some significant lag time I may decide to install manually when we go to production. Any thoughts on this? — Andy

3 2

How to change the language in mailman3
by maszap＠tin.it 19 Aug '21

19 Aug '21

Hi everyone, from here: https://hosted.weblate.org/projects/gnu-mailman/hyperkitty/it/ I see that there is a way to change the language of mailman3, postorius and hyperkitty But I don't find how. I read that you can download the .po files for the chosen language, but I didn't understand how to use these files. Could anyone show me how to do it? Thank you in advance. Max

6 13

Error when disabling signup
by Rainer Herbst 17 Aug '21

17 Aug '21

Dear all, over the last couple of weeks, I have installed and configured mailman3 using the docker containers. It took me some time, but now it works quite well. At last, I wanted to disable the sign-up because only LDAP users should be able to login. As described in django_mailman3/views/user_adapter.py, I added the following line to my settings_local.py: ACCOUNT_ADAPTER = 'django_mailman3.views.user_adapter.DisableSignupAdapter' After that, an error is thrown: ModuleNotFoundError at /accounts/login/ No module named 'django_mailman3.views.user_adapter' What could be the reason for that and how to solve it? Thanks in advance! Rainer Here is the traceback: Environment: Request Method: GET Request URL: https://mailman.aip.de:1443/accounts/login/?next=%2Faccounts%2Flogin%2F Django Version: 2.2.19 Python Version: 3.8.5 Installed Applications: ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount'] Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3.8/site-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3.8/site-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3.8/site-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3.8/site-packages/django/views/generic/base.py" in view 71. return self.dispatch(request, *args, **kwargs) File "/usr/lib/python3.8/site-packages/django/utils/decorators.py" in _wrapper 45. return bound_method(*args, **kwargs) File "/usr/lib/python3.8/site-packages/django/views/decorators/debug.py" in sensitive_post_parameters_wrapper 76. return view(request, *args, **kwargs) File "/usr/lib/python3.8/site-packages/allauth/account/views.py" in dispatch 146. return super(LoginView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python3.8/site-packages/allauth/account/views.py" in dispatch 74. response = super(RedirectAuthenticatedUserMixin, self).dispatch( File "/usr/lib/python3.8/site-packages/django/views/generic/base.py" in dispatch 97. return handler(request, *args, **kwargs) File "/usr/lib/python3.8/site-packages/allauth/account/views.py" in get 90. response = super(AjaxCapableProcessFormViewMixin, self).get( File "/usr/lib/python3.8/site-packages/django/views/generic/edit.py" in get 133. return self.render_to_response(self.get_context_data()) File "/usr/lib/python3.8/site-packages/allauth/account/views.py" in get_context_data 173. signup_url = passthrough_next_redirect_url( File "/usr/lib/python3.8/site-packages/allauth/account/utils.py" in passthrough_next_redirect_url 444. next_url = get_next_redirect_url(request, redirect_field_name) File "/usr/lib/python3.8/site-packages/allauth/account/utils.py" in get_next_redirect_url 45. if not get_adapter(request).is_safe_url(redirect_to): File "/usr/lib/python3.8/site-packages/allauth/account/adapter.py" in get_adapter 535. return import_attribute(app_settings.ADAPTER)(request) File "/usr/lib/python3.8/site-packages/allauth/utils.py" in import_attribute 155. ret = getattr(importlib.import_module(pkg), attr) File "/usr/lib/python3.8/importlib/__init__.py" in import_module 127. return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>" in _gcd_import 1014. <source code not available> File "<frozen importlib._bootstrap>" in _find_and_load 991. <source code not available> File "<frozen importlib._bootstrap>" in _find_and_load_unlocked 973. <source code not available> Exception Type: ModuleNotFoundError at /accounts/login/ Exception Value: No module named 'django_mailman3.views.user_adapter' Viele Grüße, Rainer Herbst Leiter IT-Service Phone: +49 331 7499-257 e-mail: rainer.herbst(a)aip.de https://www.aip.de ----------------------------------------------------------------------------------------------- Leibniz-Institut für Astrophysik Potsdam (AIP) An der Sternwarte 16, 14482 Potsdam Vorstand: Prof. Dr. Matthias Steinmetz, Wolfram Rosenbach Stiftung bürgerlichen Rechts Stiftungsverzeichnis Brandenburg: 26 742-00/7026 -----------------------------------------------------------------------------------------------

2 1

can't get mail into mailman3 in docker
by bob B 13 Aug '21

13 Aug '21

I am trying to get mail into mailman in docker, I can send a test messages out from the container. But can't get mail in. Any idea what I am missing? mydomain.mydomain.com is substituted for the actual domain in the below output My /etc/postfix/main.cf has ------------------------------------- mydestination = $myhostname, localhost.$mydomain, localhost, mydomain.mydomain.com transport_maps = regexp:/opt/mailman/core/var/data/postfix_lmtp local_recipient_maps = regexp:/opt/mailman/core/var/data/postfix_lmtp relay_domains = regexp:/opt/mailman/core/var/data/postfix_domains # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no ------------------------------------- my /opt/mailman/core/mailman-extra.cfg has ------------------------------------- # mailman-extra.cfg [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver # mailman-core hostname or IP from the Postfix server lmtp_host: localhost lmtp_port: 8024 # Postfix server's hostname or IP from mailman-core smtp_host: outbound-mail.mydomain.mydomain.com smtp_port: 25 configuration: /etc/postfix-mailman.cfg [mailman] # This address is the "site owner" address. Certain messages which must be # delivered to a human, but which can't be delivered to a list owner (e.g. a # bounce from a list owner), will be sent to this address. It should point to # a human. site_owner: admin(a)mydomain.mydomain.com ------------------------------------- The instructions say "The configuration file /etc/postfix-mailman.cfg is generated automatically." But I do not have that file is this the issue?? cat: /etc/postfix-mailman.cfg: No such file or directory When I send mail to my domain to a list i created called 'test' I get ------- 2021-08-02T13:33:08.666502-04:00 bmimailmandr1 postfix/cleanup[113557]: A068930294D8: message-id=<7C8556BA-156D-4A31-A64E-428C62D31AA1(a)mac.com> 2021-08-02T13:33:08.680953-04:00 bmimailmandr1 postfix/qmgr[113209]: A068930294D8: from=<testuser @bmail.com>, size=8275, nrcpt=1 (queue active) 2021-08-02T13:33:08.713683-04:00 bmimailmandr1 postfix/lmtp[113559]: A068930294D8: lost connection with localhost[127.0.0.1] while receiving the initial server greeting 2021-08-02T13:33:08.725326-04:00 bmimailmandr1 postfix/lmtp[113559]: connect to localhost[::1]:8024: Connection refused 2021-08-02T13:33:08.735727-04:00 bmimailmandr1 postfix/lmtp[113559]: A068930294D8: to=<test-join(a)mydomain.mydomain.com>, relay=none, delay=0.07, delays=0.03/0.01/0.03/0, dsn=4.4.1, status=deferred (connect to localhost[::1]:8024: Connection refused) -----

4 17

Using Header filters
by Mohsen Masoudfar 13 Aug '21

13 Aug '21

Hi, I wonder if it is possible using the "Header filters" option to filter for a specific word to push the message to Moderation? Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

2 2