- Mailman-users - lists.mailman3.org

High Server Load problem
by Brian Carpenter 30 Oct '19

30 Oct '19

For about a week now, I am seeing very high server loads and it seems to have something to do with the following process hanging: uwsgi --ini /opt/mailman-web/uwsgi.ini I am using the docker version of Mailman. When this process hangs, the server load just goes sky high and both Postorius and Hyperkitty no longer responds. I don't have very many sites on this server and I am running about 30 lists. I really need some assistance here as this needs to be fixed. I am seeing nothing in the logs that is explaining why this process is hanging and why the server load goes through the roof. Running docker-compose restart mailman-web kills the hanged process and the server load goes down. Postorius and Hyperkitty starts responding again. This seems to happen once a day. Brian

2 4

Rendering HTML for moderation
by Gila Halpern 30 Oct '19

30 Oct '19

Hi, new member here doing some research for my boss. Does Mailman 3 allow HTML rendering in the moderation queue, or only plain text? I'm asking because our list mod doesn't have time to check each image in a submission individually, so we currently don't allow images, but the boss wants to allow them.

2 1

Mangled digests on Mailman3
by Mark Dadgar 29 Oct '19

29 Oct '19

So since I upgraded to Mailman3 recently, I’m getting reports of mangled digests even with with plaintext digests turned on. Running 3.2.1 from the ubuntu packages. This list was imported from mailman 2.1.x. Example below. Any thoughts on how to fix this? - Mark ----- mark(a)pdc-racing.net | 408-348-2878 From: tr*****-request(a)pdc-racing.net <mailto:trackjunkies-request@pdc-racing.net> Subject: tr***** Digest, Vol 267, Issue 464 Date: October 19, 2019 at 5:49:46 PM PDT To: tr*****(a)pdc-racing.net <mailto:trackjunkies@pdc-racing.net> Reply-To: tr*****(a)pdc-racing.net <mailto:trackjunkies@pdc-racing.net> Send tr***** mailing list submissions to tr*****(a)pdc-racing.net <mailto:trackjunkies@pdc-racing.net> To subscribe or unsubscribe via email, send a message with subject or body 'help' to tr*****-request(a)pdc-racing.net <mailto:trackjunkies-request@pdc-racing.net> You can reach the person managing the list at tr*****-owner(a)pdc-racing.net <mailto:trackjunkies-owner@pdc-racing.net> When replying, please edit your Subject line so it is more specific than "Re: Contents of tr***** digest..." Today's Topics: 1. Re: PGE phasing out EV-A (XXXXX) ---------------------------------------------------------------------- Date: Sun, 20 Oct 2019 00:49:38 +0000 From: XXXXX Subject: [PDC] Re: PGE phasing out EV-A To: tr***** - The Single Biggest Drag On US GDP <tr*****(a)pdc-racing.net <mailto:trackjunkies@pdc-racing.net>> Message-ID: <0bca2bfb8e294ea5b910d7ae6d2a698c(a)Progent.com <mailto:0bca2bfb8e294ea5b910d7ae6d2a698c@Progent.com>> Content-Type: multipart/related; boundary="_005_0bca2bfb8e294ea5b910d7ae6d2a698cProgentcom_"; type="multipart/alternative" --_005_0bca2bfb8e294ea5b910d7ae6d2a698cProgentcom_ Content-Type: multipart/alternative; boundary="_000_0bca2bfb8e294ea5b910d7ae6d2a698cProgentcom_" --_000_0bca2bfb8e294ea5b910d7ae6d2a698cProgentcom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGVyZSBhcmUgdGhlIFNNVUQgcmF0ZXMuIFNvY2lhbGlzbSB3b3JrcyENCg0KVGltZS1vZi1EYXkg KDUtOCBwLm0uKSBSYXRlIGRldGFpbHMNCiBOb24tc3VtbWVyDQpPY3RvYmVyIDEgLSBNYXkgMzEN Ck9mZi1wZWFrDQpNaWRuaWdodCDigJMgNSBwLm0uDQokMC4wOTY5IGtXaA0KQWxsIGRheSB3ZWVr ZW5kcyBhbmQgaG9saWRheXMNClBlYWsNCjUgcC5tLiDigJMgOCBwLm0uDQokMC4xMzM4IGtXaA0K T2ZmLXBlYWsNCjggcC5tLiAtIG1pZG5pZ2h0DQokMC4wOTY5IGtXaA0KIFN1bW1lcg0KSnVuZSAx IC0gU2VwdGVtYmVyIDMwDQpPZmYtcGVhaw0KTWlkbmlnaHQg4oCTIG5vb24NCiQwLjExNjYga1do Etc.

2 1

Chinese characters in list name shows question mark (?)
by Franklin Weng 26 Oct '19

26 Oct '19

Hi list, I set up a mailman3 server and built a few lists to test. When I set the list name using Chinese characters, the web site shows correctly. However in the subscribing welcome mail the list name was shown in question marks. Screenshot is here: https://nextcloud.slat.org/index.php/s/CxPjpYMbQzQ6444 The LANGUAGE_CODE settings.py (in Debian /etc/mailman3/mailman-web.py) is set to zh-tw , and USE_I18N and USE_L10N are all set to True. Is there any other setting I should look at? Thanks, Franklin

2 7

Search problem in 3.2.1?
by Mark Dadgar 23 Oct '19

23 Oct '19

Anyone seen this before? This is the result of any search query I run. I installed ElasticSearch as the search engine yesterday and this is the result. It is still indexing (large archives). Mailman 3.2.1 from the debian packages in Ubuntu 19.10. - Mark ----- mark(a)pdc-racing.net | 408-348-2878 Begin forwarded message: From: root(a)pdc-racing.net Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: /mailman3/hyperkitty/search Date: October 22, 2019 at 7:44:49 AM PDT To: mark(a)pdc-racing.net Internal Server Error: /mailman3/hyperkitty/search UnboundLocalError at /hyperkitty/search local variable 'search_exception' referenced before assignment Request Method: GET Request URL: https://mail.pdc-racing.net/mailman3/hyperkitty/search?q=Ken Django Version: 1.11.22 Python Executable: /usr/bin/uwsgi-core Python Version: 3.7.5 Python Path: ['.', '', '/usr/lib/python37.zip', '/usr/lib/python3.7', '/usr/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Tue, 22 Oct 2019 14:44:49 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/paginator.py" in count 79. return self.object_list.count() File "/usr/lib/python3/dist-packages/haystack/query.py" in count 522. return len(self) File "/usr/lib/python3/dist-packages/haystack/query.py" in __len__ 86. self._result_count = self.query.get_count() File "/usr/lib/python3/dist-packages/haystack/backends/__init__.py" in get_count 619. self.run() File "/usr/lib/python3/dist-packages/haystack/backends/elasticsearch_backend.py" in run 951. results = self.backend.search(final_query, **search_kwargs) File "/usr/lib/python3/dist-packages/haystack/backends/__init__.py" in wrapper 33. return func(obj, query_string, *args, **kwargs) File "/usr/lib/python3/dist-packages/haystack/backends/elasticsearch_backend.py" in search 524. _source=True) File "/usr/local/lib/python3.7/dist-packages/elasticsearch/client/utils.py" in _wrapped 84. return func(*args, params=params, **kwargs) During handling of the above exception (search() got an unexpected keyword argument 'doc_type'), another exception occurred: File "/usr/lib/python3/dist-packages/hyperkitty/views/search.py" in search 90. request.GET.get('count'), File "/usr/lib/python3/dist-packages/django_mailman3/lib/paginator.py" in paginate 72. objects = paginator.page(page_num) File "/usr/lib/python3/dist-packages/django/core/paginator.py" in page 57. number = self.validate_number(number) File "/usr/lib/python3/dist-packages/django/core/paginator.py" in validate_number 46. if number > self.num_pages: File "/usr/lib/python3/dist-packages/django/utils/functional.py" in __get__ 35. res = instance.__dict__[self.name] = self.func(instance) File "/usr/lib/python3/dist-packages/django/core/paginator.py" in num_pages 91. if self.count == 0 and not self.allow_empty_first_page: File "/usr/lib/python3/dist-packages/django/utils/functional.py" in __get__ 35. res = instance.__dict__[self.name] = self.func(instance) File "/usr/lib/python3/dist-packages/django/core/paginator.py" in count 84. return len(self.object_list) File "/usr/lib/python3/dist-packages/haystack/query.py" in __len__ 86. self._result_count = self.query.get_count() File "/usr/lib/python3/dist-packages/haystack/backends/__init__.py" in get_count 619. self.run() File "/usr/lib/python3/dist-packages/haystack/backends/elasticsearch_backend.py" in run 951. results = self.backend.search(final_query, **search_kwargs) File "/usr/lib/python3/dist-packages/haystack/backends/__init__.py" in wrapper 33. return func(obj, query_string, *args, **kwargs) File "/usr/lib/python3/dist-packages/haystack/backends/elasticsearch_backend.py" in search 524. _source=True) File "/usr/local/lib/python3.7/dist-packages/elasticsearch/client/utils.py" in _wrapped 84. return func(*args, params=params, **kwargs) During handling of the above exception (search() got an unexpected keyword argument 'doc_type'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/search.py" in search 100. if not isinstance(e, search_exception): Exception Type: UnboundLocalError at /hyperkitty/search Exception Value: local variable 'search_exception' referenced before assignment Request information: USER: admin GET: q = 'Ken' POST: No POST data FILES: No FILES data

2 6

Domain Issue with MM3
by Liebeskind Uri (luri) 23 Oct '19

23 Oct '19

Hi all, our University has various departments and research projects and teams. Each of them might want more than one mailing list. It would be straight forward to create mailing lists such as: <list-name>@lists.mydomain.ch Example: In this case "digital" is an entity / Project / Department marketing.digital(a)lists.zhaw.ch<mailto:marketing.digital@lists.zhaw.ch> newsletter.digital(a)lists.zhaw.ch<mailto:newsletter.digital@lists.zhaw.ch> research.digital(a)lists.zhaw.ch<mailto:research.digital@lists.zhaw.ch> Other Examples might be: help.health(a)lists.zhaw.ch newsletter.health(a)lists.zhaw.ch research.health(a)lists.zhaw.ch<mailto:research.health@lists.zhaw.ch> If entities have more than one mailing list, it is required to build a stronger "mailing list identity", it is required to let the "entity" be part of the domain name: marketing(a)digital.lists.zhaw.ch newsletter@digital@lists.zhaw.ch career(a)health.lists.zhaw.ch newsletter(a)health.lists.zhaw.ch career(a)ict.lists.zhaw.ch support(a)ict.lists.zhaw.ch The University of Zurich (uzh.ch) does this as well and it looks very reasonable and useful to me: https://lists.uzh.ch/sympa/ca/domains https://business.lists.uzh.ch/sympa https://dqbm.lists.uzh.ch/sympa https://chess.lists.uzh.ch/sympa I have setup this mailing list test(a)digital.lists.zhaw.ch<mailto:test@digital.lists.zhaw.ch> but subscribing failed. * Subscribing via the Mass Import Form failed with a Server Error message in the browser. * Subscribing via e-mail test-join(a)digital.lists.zhaw.ch<mailto:test-join@digital.lists.zhaw.ch> because no response came from MM3. The mail to join has been delivered properly to MM3 but MM3 has swallowed the mail w/o response or error message. There also has not been any pending subscription. 2019-10-23T19:51:33.678705+02:00 svma-s-01321 postfix/smtpd[98348]: connect from srv-mail-013.zhaw.ch[160.85.104.123] 2019-10-23T19:51:33.692258+02:00 svma-s-01321 postfix/smtpd[98348]: A8EFC3FA6A: client=srv-mail-013.zhaw.ch[160.85.104.123] 2019-10-23T19:51:33.693192+02:00 svma-s-01321 postfix/cleanup[98351]: A8EFC3FA6A: message-id=<eb90deb6-58af-a873-3382-c27ce6d05031(a)anydomain.org> 2019-10-23T19:51:33.704102+02:00 svma-s-01321 postfix/qmgr[90603]: A8EFC3FA6A: from=<name(a)anydomain.org>, size=5329, nrcpt=1 (queue active) 2019-10-23T19:51:33.704864+02:00 svma-s-01321 postfix/smtpd[98348]: disconnect from srv-mail-013.zhaw.ch[160.85.104.123] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 2019-10-23T19:51:33.763670+02:00 svma-s-01321 postfix/lmtp[98352]: A8EFC3FA6A: to=<test-join(a)digital.lists.zhaw.ch>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.08, delays=0.02/0.01/0/0.05, dsn=2.0.0, status=sent (250 Ok) 2019-10-23T19:51:33.764485+02:00 svma-s-01321 postfix/qmgr[90603]: A8EFC3FA6A: removed 2019-10-23T19:52:29.278529+02:00 svma-s-01321 postfix/smtpd[98348]: table hash:/var/lib/mailman3/data/postfix_lmtp(0,lock|fold_fix|utf8_request) has changed -- restarting 2019-10-23T19:52:29.286154+02:00 svma-s-01321 postfix/smtpd[98558]: connect from localhost[127.0.0.1] 2019-10-23T19:52:29.288612+02:00 svma-s-01321 postfix/cleanup[98351]: table hash:/var/lib/mailman3/data/postfix_domains(0,lock|utf8_request) has changed -- restarting 2019-10-23T19:52:29.292655+02:00 svma-s-01321 postfix/smtpd[98558]: 476AD3FA6A: client=localhost[127.0.0.1] 2019-10-23T19:52:29.293671+02:00 svma-s-01321 postfix/cleanup[98559]: 476AD3FA6A: message-id=<157185314763.94537.10517326910475727036(a)svma-s-01321.zhaw.ch> 2019-10-23T19:52:29.296393+02:00 svma-s-01321 postfix/qmgr[90603]: table hash:/var/lib/mailman3/data/postfix_domains(0,lock|utf8_request) has changed -- restarting 2019-10-23T19:52:29.298231+02:00 svma-s-01321 postfix/smtpd[98558]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 commands=4 I'd be grateful for a useful hint what is going wrong here? Kind regards, Uri Liebeskind -- ------------------------------------ Zurich University of Applied Sciences Information and Communication Technology Uri Liebeskind System Administrator Gertrudstrasse 15 Postfach 805 CH-8401 Winterthur Tel. +41 58 934 72 63 Fax. +41 58 935 72 63 http://www.zhaw.ch/en/ -------------------------------------

2 1

Issues installing postorius and hyperkitty
by thushantha.lakmal＠arm.com 23 Oct '19

23 Oct '19

Hi All. Im trying to install the mailmain suite with the postorius and hyperkitty . Mailman installation completed successfully but for postorius and hyperkitty Im getting the following errors .. Please can someone help me .. For postorius (Using pip3 install postorius ) ERROR: django-mailman3 1.3.0 has requirement Django<2.2,>=1.11, but you'll have django 2.2.6 which is incompatible. For hyperkitty (Using pip3 install hyperkitty ) de41118f448bcb3b8df405c5228e1 Stored in directory: /root/.cache/pip/wheels/79/50/a5/9410f4b2e62e35c285de46ffa88c2562403cb576e1e7859d68 Building wheel for rcssmin (setup.py) ... error ERROR: Command errored out with exit status 1: command: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-563o314q/rcssmin/setup.py'"'"'; __file__='"'"'/tmp/pip-install-563o314q/rcssmin/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-491rzr5s --python-tag cp36 cwd: /tmp/pip-install-563o314q/rcssmin/ Complete output (12 lines): running bdist_wheel running build running build_py creating build creating build/lib.linux-x86_64-3.6 copying ./rcssmin.py -> build/lib.linux-x86_64-3.6 running build_ext building '_rcssmin' extension creating build/temp.linux-x86_64-3.6 gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DEXT_MODULE=_rcssmin -UEXT_PACKAGE -I_setup/include -I/usr/include/python3.6m -c rcssmin.c -o build/temp.linux-x86_64-3.6/rcssmin.o unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1 ---------------------------------------- ERROR: Failed building wheel for rcssmin Running setup.py clean for rcssmin Successfully built robot-detection django-haystack Failed to build rcssmin Installing collected packages: rjsmin, django-appconf, rcssmin, django-compressor, robot-detection, django-haystack, djangorestframework, decorator, networkx, django-extensions, wcwidth, blessed, arrow, django-picklefield, django-q, hyperkitty Running setup.py install for rcssmin ... error ERROR: Command errored out with exit status 1: command: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-563o314q/rcssmin/setup.py'"'"'; __file__='"'"'/tmp/pip-install-563o314q/rcssmin/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-6g8g9aoj/install-record.txt --single-version-externally-managed --compile cwd: /tmp/pip-install-563o314q/rcssmin/ Complete output (12 lines): running install running build running build_py creating build creating build/lib.linux-x86_64-3.6 copying ./rcssmin.py -> build/lib.linux-x86_64-3.6 running build_ext building '_rcssmin' extension creating build/temp.linux-x86_64-3.6 gcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DEXT_MODULE=_rcssmin -UEXT_PACKAGE -I_setup/include -I/usr/include/python3.6m -c rcssmin.c -o build/temp.linux-x86_64-3.6/rcssmin.o unable to execute 'gcc': No such file or directory error: command 'gcc' failed with exit status 1 ---------------------------------------- ERROR: Command errored out with exit status 1: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-563o314q/rcssmin/setup.py'"'"'; __file__='"'"'/tmp/pip-install-563o314q/rcssmin/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-6g8g9aoj/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.

2 1

bouncing mail commands
by Liebeskind Uri (luri) 23 Oct '19

23 Oct '19

Hi all, when a subscribtion confirmation is sent to MM it replies a bounce mail about unknown commands in the mail. This is very confusing for the users / subscribers and I'd like to disable this function. Actually our users do not need to send commands in the subject and in the body. So responding to words that are unknown commands is not helpful. Currently I have Postfix header and body checks in place that discard this messages from MM to avoid bothering our users. But how can MM3 be configured not to respond to unknown commands or not to parse the mail for commands at all? Thank you for your help and kind regards, Uri Liebeskind -- ------------------------------------ Zurich University of Applied Sciences Information and Communication Technology Uri Liebeskind System Administrator Gertrudstrasse 15 Postfach 805 CH-8401 Winterthur Tel. +41 58 934 72 63 Fax. +41 58 935 72 63 http://www.zhaw.ch/en/ -------------------------------------

2 1

why owner mails rerouted to list
by Tamas HOLCZER 23 Oct '19

23 Oct '19

Hi All, we have moved to Mailman3 from Mailman2 recently, and have a quite strange problem: Every message sent to owners is forwarded to the lists instead of the owner's mail address. So for example if a non-member sends a message to MYLIST(a)MYDOMAIN.COM, then a notification appears on MYLIST (and all members receive it, the message also appears in the archive) instead of sending it to the private address of the owner set on the web interface. I found no obvious error either in mailman.log, smtp.log or the MTA's logs. This problem can cause a storm of mails as per default the owner is not allowed to send a message to a member-only list so each notifications generates a new notification. This storm is mitigated temporarily by accepting everything from the owner in a non-member setting, but it is only a workaround. I want mails sent to MYLIST-owner(a)MYDOMAIN.COM to be forwarded to the real owner instead of the list. The same is true for MYLIST-admin(a)MYDOMAIN.COM, and probably for the other administrative addresses. We are using GNU Mailman 3.2.1 (La Villa Strangiato) from the Debian Buster repo. As MTA we use exim4 (running on the same machine as Mailman), and have Amavisd on a separate machine for spam filtering. How can I test what happens to mails sent to the owner inside Mailman? Any help or tips on debugging this issue would be highly appreciated. Best regards, Tamas Here is an anonymized header for such a message: From MYLIST-bounces(a)MYDOMAIN.COM Mon Oct 21 21:13:59 2019 Return-path: <MYLIST-bounces(a)MYDOMAIN.COM> Envelope-to: MYADDRESS(a)MYDOMAIN.COM Delivery-date: Mon, 21 Oct 2019 21:13:59 +0200 Received: from [SPAMFILTER] (helo=localhost) by MAILSERVER.MYDOMAIN.COM with esmtp (Exim 4.92) (envelope-from <MYLIST-bounces(a)MYDOMAIN.COM>) id 1iMd7u-0007pv-VR; Mon, 21 Oct 2019 21:13:59 +0200 X-Virus-Scanned: by amavis-dc Received: from MAILSERVER.MYDOMAIN.COM ([MAILSERVER-LOCAL-IP]) by localhost (spamfilter.MYDOMAIN.COM [SPAMFILTER]) (amavisd-new, port 10023) with ESMTP id Pe6CPG7d_0VR; Mon, 21 Oct 2019 21:13:57 +0200 (CEST) Received: from MAILSERVER2.MYDOMAIN.COM ([MAILSERVER-PUBLIC-IP] helo=MAILSERVER.MYDOMAIN.COM) by MAILSERVER.MYDOMAIN.COM with esmtp (Exim 4.92) (envelope-from <MYLIST-bounces(a)MYDOMAIN.COM>) id 1iMd7t-0007pn-Mu; Mon, 21 Oct 2019 21:13:57 +0200 Received: from MAILSERVER2.MYDOMAIN.COM ([MAILSERVER-PUBLIC-IP] helo=MAILSERVER.MYDOMAIN.COM) by MAILSERVER.MYDOMAIN.COM with esmtp (Exim 4.92) (envelope-from <MYLIST-bounces(a)MYDOMAIN.COM>) id 1iMd7r-0007pR-JZ for MYLIST-owner(a)MYDOMAIN.COM; Mon, 21 Oct 2019 21:13:55 +0200 From: MYLIST-owner(a)MYDOMAIN.COM To: MYLIST-owner(a)MYDOMAIN.COM MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1338746665924884909==" Message-ID: <157168523467.30989.13607822853875106726(a)MAILSERVER.MYDOMAIN.COM> Date: Mon, 21 Oct 2019 21:13:54 +0200 Precedence: bulk X-Mailman-Version: 3.2.1 Message-ID-Hash: UWYSMZDJO3ZXNBKY6GE6AS6FBLCZL6BG X-Message-ID-Hash: UWYSMZDJO3ZXNBKY6GE6AS6FBLCZL6BG X-MailFrom: MYLIST-bounces(a)MYDOMAIN.COM X-Mailman-Rule-Hits: nonmember-moderation X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation Subject: [MYLIST] MYLIST(a)MYDOMAIN.COM post from ... requires approval List-Id: Name of the List <MYLIST.MYDOMAIN.COM> Archived-At: <https://MYDOMAIN.COM/hyperkitty/list/MYLIST@MYDOMAIN.COM/message/UWYSMZDJO3…> List-Archive: <https://MYDOMAIN.COM/hyperkitty/list/MYLIST@MYDOMAIN.COM/> List-Help: <mailto:MYLIST-request@MYDOMAIN.COM?subject=help> List-Post: <mailto:MYLIST@MYDOMAIN.COM> List-Subscribe: <mailto:MYLIST-join@MYDOMAIN.COM> List-Unsubscribe: <mailto:MYLIST-leave@MYDOMAIN.COM> --===============1338746665924884909== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit As list administrator, your authorization is requested for the following mailing list posting: List: MYLIST(a)MYDOMAIN.COM From: ... Subject: ... The message is being held because: The message is not from a list member At your convenience, visit your dashboard to approve or deny the request. ...

2 1

To what extent can mailman 3 handle images and html?
by Paul Arenson 23 Oct '19

23 Oct '19

Hi The other day I attempted to send a message from my mail client (Apple computer, Mail program, html--well, what they call Rich Text). While a user was able to send a message previously that contained an image, I was unsuccessful. As well, links were weird. LINKS ===== Because My wordpress often has a Japanese URL and they can become very long, I tried both the URL as is and embedded (made a clickable html link). URL === So while I typed https://www.tokyoprogressive.org/journalist-ito-shiori-sues-alleged-rapis.... It came out double as https://www.tokyoprogressive.org/journalist-ito-shiori-sues-alleged-rapis... <https://www.tokyoprogressive.org/journalist-ito-shiori-sues-alleged-rapis... (The full link was truncated with ... at the end, and the link appeared twice with the second instance preceded by "">") The embedded one did not come out embedded buy showed the text like this: Alternate link: 多摩川河川敷に男性の遺体、増水した川に流されたか <https://www.tokyoprogressive.org/%e5%a4%9a%e6%91%a9%e5%b7%9d%e6%b2%b3%e5%... QUESTION 1: Is there a preferred way to write links, or will there always be problems with the mail clients? (Even the web archive shows this problem though): https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… See the top item Homeless man drowns in river during Typhoon and what I mean. IMAGE No image appears though one was added inline. And, as I said, a user was previously able to add one. I do not know how she did it. I also posted it to my web site instead of the newsletter for unrelated reasons. But there was an image (Originally got a warning the message was held because the attachment or something). So are there guidelines one whether/how to attach an image so that it makes it? Thanks

4 7

Re: To what extent can mailman 3 handle images and html?
by tokyoprogressive＠mailbox.org 23 Oct '19

23 Oct '19

Thank you, Mark. Yes. All solved and your explanation on how THIS list handles attachments also understood. Appreciate as always. Sent from my iPhone

1 0

LMTP on unix socket
by Hristo Venev 21 Oct '19

21 Oct '19

How do I configure mailman to use a unix socket for lmtp connections? Setting [mta] incoming: mailman.mta.null.NullMTA lmtp_host: /path/to/socket does not work. Mailman still tries to create a TCP socket.

3 3

Receiving 8bit-clean mail
by Alyssa Ross 20 Oct '19

20 Oct '19

A subscriber to a mailing list I administer has been sending 8bit UTF-8 encoded mail, with no further quoted-printable / base64 / etc. encoding. This is handled fine by my MTA and MUA, but Mailman seems to have trouble with it. When mail is sent out from Mailman, the « character is replaced by ??. Is this a bug, or is there just a configuration option or something I need to set? I couldn't find anything in the documentation.

3 3

Ubuntu package?
by Mark Dadgar 18 Oct '19

18 Oct '19

Are the Ubuntu package maintainers on this list? Can you ping me directly if you are? Thanks. - Mark ----- mark(a)pdc-racing.net <mailto:mark@pdc-racing.net> | 408-348-2878

1 0

Re: [Mailman-i18n] Mailman 3 Internationalization setup
by Abhilash Raj 17 Oct '19

17 Oct '19

On Thu, Oct 17, 2019, at 6:55 AM, Rémi Oudin wrote: > Hi! > > It seems that the projects are not public anymore. > Should we ask you to give us access for the translations? It should be, I haven't changed anything in past few days. What makes you think they aren't public? Are you not able to visit their page? Just as side note, the URL for Postorius is now changed to https://hosted.weblate.org/projects/gnu-mailman/postorius/ Everything else is same. > > Cheers, > -- > Guinness > > Attachments: > * signature.asc -- thanks, Abhilash Raj (maxking)

1 0

Converting discussion list to read-only list (settings)
by Paul Arenson 17 Oct '19

17 Oct '19

I have found that my users in the discussion list are creating their own topics rather than using the existing ones, so decided to make it a read-only list and use WordPress moderated comments. Since I do not have the original settings for READ ONLY (this is a hosted version), I want to make sure that these are correct. Can someone comment. Thanks MOST IMPORTANT—> What setting makes it a discussion list as opposed to read only? ALTER MESSAGES ----------------------- Filter content Now YES Collapse Alternatives Now yes Convert html to plain text Now NO Anonymous NOW YES Include RFC2369 headers Now Yes Include the list post header Now Yes Reply Goes to List Now No munging Pipeline Default DMARC MITIFGATIONS ----------------------- Replace From with list address DMARC mitigate unconditionally Now NO MESSAGE ACCEPTANCE ----------------------- Require Explicit Destination Yes Administrivia YES Default action to take when a member posts to the list Hold for moderation Default action to take when a member posts to the list Hold for moderation OTHER? ------------- Thanks Paul Arenson

2 14

max_delivery_threads
by Sven Buesing 16 Oct '19

16 Oct '19

Hi, we are currently running mailman version 3.3.0. We want to enable max_delivery_threads - we want to send personalized mails (To: ), and we hope that threading would speed things up - but it seems this option has no functionality despite being documented in the schema.cfg. Threading is compiled into python: >>> import sysconfig >>> print(sysconfig.get_config_vars('WITH_THREAD')) [1] Am I doing anything wrong or is the documentation simply wrong? This ist the mta-section of the mailman.cfg. [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver max_delivery_threads: 20 max_recipients: 500 lmtp_host: 127.0.0.1 lmtp_port: 8024 smtp_host: 127.0.0.1 smtp_port: 25 configuration: python:mailman.config.postfix Regards, Sven

2 2

Tune Mail Delivery
by Brian Carpenter 14 Oct '19

14 Oct '19

Some ISPs require outgoing delivery to not exceed a certain threshold. With Mailman 2, we used the following: SMTP_MAX_RCPTS SMTP_MAX_SESSIONS_PER_CONNECTION Does Mailman 3 have an equivalent to the above 2 settings? Thank, Brian

2 1

Help with fresh debian install
by Mark Dadgar 11 Oct '19

11 Oct '19

Mailman3-Users, First-time poster, long-time Mailman user (since August of 2002!). I brought up a fresh install of Mailman3 via the current Debian package alongside my current 2.1 setup (installed and updated from source since 2002) on Ubuntu 18.04 LTS. Importing lists from 2.1 has been a real problem. I am trying to import a list with no archives to keep it simple while I prove out the process. If I run the mailman import21 comment as my user, I get the following errors: — mark@mail:/tmp$ mailman import21 announce(a)pdc-racing.net ./announce-config.pck Traceback (most recent call last): File "/usr/bin/mailman", line 11, in <module> load_entry_point('mailman==3.1.1', 'console_scripts', 'mailman')() File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 94, in main initialize(config_path) File "/usr/lib/python3/dist-packages/mailman/core/initialize.py", line 189, in initialize initialize_2(propagate_logs=propagate_logs) File "/usr/lib/python3/dist-packages/mailman/core/initialize.py", line 152, in initialize_2 mailman.core.logging.initialize(propagate_logs) File "/usr/lib/python3/dist-packages/mailman/core/logging.py", line 157, in initialize _init_logger(propagate, sub_name, log, logger_config) File "/usr/lib/python3/dist-packages/mailman/core/logging.py", line 110, in _init_logger handler = ReopenableFileHandler(sub_name, path_abs) File "/usr/lib/python3/dist-packages/mailman/core/logging.py", line 50, in __init__ self._stream = self._open() File "/usr/lib/python3/dist-packages/mailman/core/logging.py", line 53, in _open return codecs.open(self.filename, 'a', 'utf-8') File "/usr/lib/python3.6/codecs.py", line 897, in open file = builtins.open(filename, mode, buffering) PermissionError: [Errno 13] Permission denied: '/var/log/mailman3/mailman.log' Error in atexit._run_exitfuncs: Traceback (most recent call last): File "/usr/lib/python3.6/logging/__init__.py", line 1945, in shutdown h.flush() File "/usr/lib/python3/dist-packages/mailman/core/logging.py", line 56, in flush if self._stream: AttributeError: 'ReopenableFileHandler' object has no attribute '_stream' — If I run it as root, it runs for a long time but spews a HUGE stream of these errors to /var/log/mailman3/mailman.log: — Oct 03 17:08:48 2019 (19118) Skipping and preserving unparseable message: 1570147727.3029191+80f1cc4d18f54868ad6162e8e41e52567185e983 Oct 03 17:08:49 2019 (19118) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147728.618866+174175d39c301feab4ebb2aac0a51226334fa54c.pck' Oct 03 17:08:49 2019 (19118) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 156, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147728.618866+174175d39c301feab4ebb2aac0a51226334fa54c.pck' Oct 03 17:08:49 2019 (19118) Skipping and preserving unparseable message: 1570147728.618866+174175d39c301feab4ebb2aac0a51226334fa54c Oct 03 17:08:50 2019 (19118) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147729.8732843+1cd24522f62dbd73c759a0f9a749a2ed63c91668.pck' Oct 03 17:08:50 2019 (19118) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 156, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147729.8732843+1cd24522f62dbd73c759a0f9a749a2ed63c91668.pck' Oct 03 17:08:50 2019 (19118) Skipping and preserving unparseable message: 1570147729.8732843+1cd24522f62dbd73c759a0f9a749a2ed63c91668 Oct 03 17:08:51 2019 (19118) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147731.1456919+4354e647280c69f4dbfbd5a158b682fe3ed6cbcf.pck' Oct 03 17:08:51 2019 (19118) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 156, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147731.1456919+4354e647280c69f4dbfbd5a158b682fe3ed6cbcf.pck' Oct 03 17:08:51 2019 (19118) Skipping and preserving unparseable message: 1570147731.1456919+4354e647280c69f4dbfbd5a158b682fe3ed6cbcf Oct 03 17:08:53 2019 (19118) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147732.4526153+f423b0ba2693b41ffc3f829da2290639634c349d.pck' Oct 03 17:08:53 2019 (19118) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 156, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/virgin/1570147732.4526153+f423b0ba2693b41ffc3f829da2290639634c349d.pck' Oct 03 17:08:53 2019 (19118) Skipping and preserving unparseable message: 1570147732.4526153+f423b0ba2693b41ffc3f829da2290639634c349d — It also dumps some mail footer templates into the template directory that are owned by root, which seems … incorrect? Any thoughts on what’s going wrong here? Many thanks in advance! Really looking forward to having modern archives! - Mark ----- mark(a)pdc-racing.net | 408-348-2878

5 9

Show diplay_name in a list
by ruben＠bkonrad.de 10 Oct '19

10 Oct '19

Hello, I'm trying to figure out how to show the display_name of a member in postorius in Members > Subscriber. I was trying to add {{ member.diplay_name }} in the template ${postorius}/templates/postorius/lists/members.html Here an abstract of where I inserted the code: [...] {% for member in members %} <tr> {% if role == 'subscriber' %} <td> <label class="checkbox-inline"> <input type="checkbox" class="member-checkbox" name="choices" id="id_choices_{{ forloop.counter0 }}" value="{{ member.email }}" /> {{ member.display_name }} <{{ member.email }}> </label> [...] I could not figure out why it wouldn't work. I'm running mailman3 Version 3.1.1-9 on an Ubuntu 18.04. Any idea what I was missing there? Thanks in advance for any help. - Ruben

4 4

Personalization issue when no To header?
by Alan So 08 Oct '19

08 Oct '19

We have ported a number of lists from mailman 2 to mailman 3 earlier. We cannot find any personalization setting in the mailman 3 web UI or using the mailman client. It is fine as it is not essential. However, recently we notice an issue. As the lists in the mailman 2 probably have personalization turned on, it looks like that the setting are also migrated by using "mailman import21". Recently, some users start sending mail simply with Bcc without any addresses in the To header. We notice the following error: Oct 08 11:26:03 2019 (1832) Uncaught runner exception: 'to' Oct 08 11:26:03 2019 (1832) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/deliver.py", line 86, in deliver refused = agent.deliver(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/base.py", line 163, in deliver callback(mlist, message_copy, msgdata_copy) File "/usr/local/lib/python3.6/site-packages/mailman/mta/personalized.py", line 58, in personalize_to msg.replace_header('To', formataddr((name, recipient))) File "/usr/lib64/python3.6/email/message.py", line 558, in replace_header raise KeyError(_name) KeyError: 'to' After tracing the source codes above, we suspect that the issue was caused by no To header due to personalization is turned on. Any quick suggestion of workarounds such as how to turn off personalization for all lists? We do not have much experiences with mailman shell. Thanks a lot.

1 0

Mailman 3 Internationalization setup
by Abhilash Raj 07 Oct '19

07 Oct '19

Hi All, Mailman 3 is now setup for continuous internationalization. We are using Hosted Weblate[1], which is the hosted service for the Weblate project[2]. It is actually quite nice and I've been learning how to properly document a Django project from it's documentation. Which brings me to it's documentation. Weblate has great documentation for translators[2]. The UI pretty simple and should be easy to navigate around. We have setup the workflow in a way that each commit in Gitlab generates a webhook and updates Weblate. Weblate is then able to pull all the changes in real time. To pull translations back into Gitlab, I have a custom script running every night that pulls translations (as commits) and generates pull requests against the upstream repos. Weblate has the ability to automatically push the translations back, but for security reasons, I didn't want to give a 3rd party service direct push access to our repos. I've been working on a Patch to Weblate[3], which would allow it to send translations as Merge Requests (as compared to direct-push). After it is merged and deployed at hosted.weblate.org, I hope I can retire my custom script. We have setup the following projects: - Mailman Core (https://hosted.weblate.org/projects/gnu-mailman/mailman/) - Postorius* (https://hosted.weblate.org/projects/gnu-mailman/translations/) - Hyperkitty (https://hosted.weblate.org/projects/gnu-mailman/hyperkitty/) - Django-mailman3 (https://hosted.weblate.org/projects/gnu-mailman/django-mailman3/) There should be empty .po files generated for most languages supported by Django and Mailman Core. If there are any questions or bugs related to source strings, please send out an email to mailman-developers(a)python.org. The current translation %age is pretty low, hopefully we'll be ale to get it close to Mailman 2 sometime soon :) [1]: https://hosted.weblate.org/projects/gnu-mailman/ [2]: https://docs.weblate.org/en/latest/user/translating.html [3]: https://github.com/WeblateOrg/weblate/pull/3024 [*] Yeah, the URL for Postorius is a bit weird, because it was called "translations" before. At the time, I didn't know the difference between a project and a translation component in Weblate terminologies. And they don't give out permissions to change the URL, so we're maybe stuck with it. -- thanks, Abhilash Raj (maxking)

1 0

Mailman 3 installation documentation
by Abhilash Raj 07 Oct '19

07 Oct '19

Hi All, I have been trying to work on revamping the documentation site we have at https://docs.mailman3.org. It is on https:// but I am not sure why the http->https redirect doesn't work in Readthedocs. I have set it to "serve always from https". Anyway, it might not look too different right now, but there are some small re-organizations. I have been learning some new ReST and Sphinx tricks and been trying to cross-reference and link various sections and settings. The docs site shows up Mailman's logo now (I didn't even know we could do that ;-). There is a place[1] for all supported Django settings that Postorius and Hyperkitty have. I am also planning to add some common Django settings that often people have to lookup and is not fun for people from non-python backgrounds. Hopefully, it will make lives easier for administrators. I have reverted my own stupid decision to use "sudo pip3 install" in the docs to instead use virtualenv. The installation docs are going to grow to be more comprehensive. I am also working on mailman-web project[3], which should simply installation process for all the web components using a single project and provide better guidance on Django's settings file management and howto run manage.py commands. I have added a `mailman-web` command, which, for those of you familiar with internal details of Django, is going to be our custom manage.py script. It sets up settings correctly and would hopefully reduce the pain of using `django-admin` and/or finding out the right path for `manage.py` script. It is still not ready for prime time, but it is usable. Early adopters can play with it if they like! I would really appreciate if people who have tried to manually install Mailman 3 in the past would share their experiences about what they think could be documented better. You can reply here or open an issue[2]. The user documentation are going to follow, hopefully soon :) [1]: https://docs.mailman3.org/en/latest/config-web.html#configure-postorius-hyp… [2]: https://gitlab.com/mailman/mailman-suite-doc/issues [3]: https://gitlab.com/mailman/mailman-web -- thanks, Abhilash Raj (maxking)

2 1

confirm mail rejected
by Marc Sluiter 29 Sep '19

29 Sep '19

Hi, im trying to setup mailman and have an issue: first my environment: - I’m running postfix etc with "mailcow-dockerized": https://mailcow.github.io/mailcow-dockerized-docs/ - I’m running mailman with "docker-mailman": https://asynchronous.in/docker-mailman/ I got almost everything working (with some configuration modifications, see other mail). The only thing which doesn’t work is conformation mails, they are rejected: In the logs I see that postfix is trying both "liste-confirm+extension@domain" and "liste-confirm@domain" for another lookup map of type mysql (so "recipient_delimiter" is working), but not for the mailman map of type regexp. Just a wild guess, I didn't find anything about it: can it be that “recipient_delimiter" doesn't work for “regexp" maps? For now I worked around this issue by manually modifying the confirm regex in "postfix_lmtp” to /^liste-confirm\+.*(a)domain\.tld$/ Does anyone have an idea why the regexp map isn’t working for me and at least 1 other user (see https://gitlab.com/mailman/mailman/issues/401)? Would my workaround be a long term solution which could be implemented in mailman? That would mean that mailman could work independent of the “recipient_delimiter” setting (or do I oversee something?) Thanks and greetings, Marc

4 4

Cannot show archives
by Qiuhong.Su �K秋�t 27 Sep '19

27 Sep '19

Hi all, After I setup mailman3 and run mailman-suite, I can do: 1. Register user 2. Login 3. Create new Domain 4. Create new List 5. Subscribe to the list When I try to send email to the list by run command: echo ��test email�� | mail �Cs ��test email�� test(a)example.com<mailto:test@example.com> User test can receive this email, but I cannot find it on Archives, and other members cannot receive this email too. Can anyone help me? Thank you! Regards, Qiuhong ************************************************************************* This email message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. [Delta Electronics, INC. China] *************************************************************************

4 4

Linking to a forum thread from a (news) website.
by Paul Arenson 25 Sep '19

25 Sep '19

I have been struggling to get this right and I think I have finally done it. I have a website with many opinion and news articles. I have linked from the article to a pre-written thread, such as from here: EXAMPLE WEBSITE ARTICLE https://www.tokyoprogressive.org/remembering-the-tsushima-maru-disaster-75-… to EXAMPLE THREAD ON LIST Title: Remembering the Tsushima Maru Disaster 75 Years Later https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… PROBLEM The problem is that this does not show the subsequent comment that was added. And SHOW REPLIES BY DATE does not do it either. SOLUTION I figured out that all replies are listed under Re:, so if the first comment does not have the Re:, then it gets cut off. So if I click https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… you will see all the subsequent posts. Since I want to post a link BEFORE anyone starts replying, I have to make my first post in the thread titled Re: EXAMPLE OF NEW POSTING STYLE Make sure the thread has a Re: in it. (Actually I made a mistake and wrote Re; and it still worked.) https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… Or: https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… ----------------- QUESTION Am I correct that if I want to create a thread and link to it, but make sure the first note is included, I need to make the thread title: Re: Something? -----------------

2 2

Manual setup - permissions
by Tobias Hachmer 25 Sep '19

25 Sep '19

Hello, I'm new to mailman3 and started to setup an instance from scratch per hand, but I'm struggeling running the peaces with the correct user/permissions. I can't find anything regarding running this and that with that user in the docs, so I have the following: virtualenv_dir: /opt/venvs/mailman3 Installed packages in venv: - "Django>=1.11" - "django-haystack" - "libsass" - "mailman==3.3.0" - "mailmanclient" - "mailman-hyperkitty==1.1.0" - "postorius==1.3.0" - "hyperkitty==1.3.0" - "whoosh" - "uwsgi" I have installed the core stuff in /opt/mailman3/core, all is owned by user+group "mailman3": root@host:/opt/mailman3# tree . ├── core │ ├── etc │ │ ├── hyperkitty.cfg │ │ ├── mailman.cfg │ │ └── uwsgi.ini │ ├── log │ │ ├── bounce.log │ │ ├── debug.log │ │ ├── mailman.log │ │ ├── plugins.log │ │ └── smtp.log │ └── var │ ├── archives │ │ └── hyperkitty │ │ └── spool │ │ ├── ... │ ├── cache │ ├── data │ │ ├── mailman.db │ │ ├── postfix_domains │ │ ├── postfix_domains.db │ │ ├── postfix_lmtp │ │ └── postfix_lmtp.db │ ├── lists │ │ └── admin.lists.... │ ├── locks │ ├── master.lck │ ├── master.lck|...|...|... │ ├── master.pid │ ├── message" │ │ ├── ... │ ├── queue │ │ ├── archive │ │ ├── bad │ │ ├── bounces │ │ ├── command │ │ ├── digest │ │ ├── in │ │ ├── nntp │ │ ├── out │ │ ├── pipeline │ │ ├── retry │ │ ├── shunt │ │ └── virgin │ └── templates The django project is installed in /opt/mailman3/web, all is owned by user+group "nginx": └── web └── project ├── db │ └── mailmansuite.db ├── emails ├── fulltext_index │ └── _MAIN_0.toc ├── logs │ ├── mailmansuite.log │ ├── uwsgi-error.log │ └── uwsgi.log ├── manage.py ├── __pycache__ │ ├── settings.cpython-35.pyc │ └── urls.cpython-35.pyc ├── run │ └── uwsgi.sock ├── settings.py ├── static ├── urls.py └── wsgi.py The mailman3 core ist running with user+group "mailman3". And the uwsgi service is running as root with drops privileges to user+group "nginx". Now, running the scheduled tasks (which run from user+group "nginx") for django I ran into permission problems, because the nginx user can't access/write to the needed files in /opt/mailman3/core/... If anyone of you is able to read ansible tasks, this is how I set this up via ansible: https://github.com/freifunk-mwu/ansible-ffmwu/blob/mail/roles/service-bundl… I would appreciate any hints how to run the different peaces of mailman3 with the correct user/groups/permissions. Thanks in advance, Tobias

4 4

Re: Issues with migrating from Mailman2 to Mailman 3
by Mark Sapiro 24 Sep '19

24 Sep '19

On 9/23/19 12:03 AM, Paul Arenson wrote: > Thank you Mark. > > I found my solution. Simplifies things. People do not have to even > think about subscribing….. <snip> > How does that sound? OK -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

Issues with migrating from Mailman2 to Mailman 3
by Uwe Grasshoff 23 Sep '19

23 Sep '19

Hello all, I'm currently trying to convert a Debian based mailman2 installation to a docker based mailman3 installation. I successfully running the mailman-web and mailman-core containers together with the database container but I'm struggling with the import of the old mailing lists. In the core container I'm running this two commands for every mailing list: mailman create mailman(a)example.com mailman import21 mailman(a)example.com /oldmailman/lists/mailman/config.pck Then I'm switching over to the mailman-web container and running this two commands: python3.6 manage.py hyperkitty_import -l mailman(a)example.com /oldmailman/archives/private/mailman.mbox/mailman.mbox python3.6 manage.py update_index_one_list mailman(a)example.com I'm getting no errors or something else which could indicate a problem. After that I'm looking into the web interface http://example.com/postorius/lists/ There I can only see the public mailing list and the private ones are not shown there (as expected). When I then try to login with the List Manager credentials of the lists (from mailman2) I can't login in. So I thought maybe I have to "register" myself again to than get access to the list management. So I tried that but when I filled out the form and click "Register" I'm presented with an error page which titles "Serverfehler" (Server error in german) and the message "An error occurred while processing your request." When I then go back a step and try to register again I got the error message that the username is already taken. When I then try to login I can't login I always get the "An error occurred while processing your request." page. Does anyone have an idea what point I'm missing? -- With best Regards Uwe Grasshoff

2 2

Weird response to postings after subscriptions and accounts
by Paul Arenson 23 Sep '19

23 Sep '19

I accidentally posted to a test account I had not actually used. Am reposting to my correct account. Sorry to the moderators. In my test of the two forms of signup, I am getting these unexpected results. Is it my settings or is something weird within the program itself? 1) https://list.tokyoprogressive.org/postorius/lists/discuss.list.tokyoprogres… 2) Choose "You can also subscribe without creating an account. If you wish to do so, please use the form below" 3) Then I have to approve it. They get "Welcome to the "Discuss" mailing list! To post to this list, send your email to: discuss(a)list.tokyoprogressive.org 4) But I have to approve it.I assume this is because they do not yet have a real account. And they should be listed as a NON MEMBER? 5) But even when they sign up here: https://list.tokyoprogressive.org/accounts/signup/?next=%2Fpostorius%2Flist… they get an email from my provider (NOT MY LIST????) as follows: "Hello from mailman3.emwd.com! You're receiving this e-mail because user iCloud has given yours as an e-mail address to connect their account. To confirm this is correct, go to https://list.tokyoprogressive.org/accounts/confirm-email/MTE3:1iA44k:E7w7xh… Thank you from mailman3.emwd.com! mailman3.emwd.com" 6) And this is where it gets weird. If they send from their email program and get the welcome (Welcome to the "Discuss" mailing list! To post to this list, send your email to: discuss(a)list.tokyoprogressive.org You can unsubscribe or make adjustments to your options via email by sending a message to....... I then get a notice: "Your mail to 'discuss(a)list.tokyoprogressive.org' with the subject test notice Is being held until the list moderator can review it for approval. The message is being held because: The message is not from a list member" 7) While if they send FROM THE interface it goes through. 8) What I am confused about. Signing up for an account should make them a member, right? Subscribing should make them a non member, no? But here it seems that both make them a non member. And worse, someone with an account sending from the Interface has their message get through while the same person sending from an email program has me get a notice that a non member is trying to post. Before I can move my actual members over from another mailing list provider, I want to make sure what works and what doesn't. Thanks. PS I am running out of test accounts to use to test my own setup. Thanks. paul!!!Subscribe to this list still shows up at the bottom.

4 9

"Cannot connect to SMTP server localhost on port 25"
by Manos Pitsidianakis 22 Sep '19

22 Sep '19

Hello, I've been getting "Cannot connect to SMTP server localhost on port 25" from runner "out" in mailman.log over some mails stuck in shunt queue, postfix logs show nothing when this happens, tcpdump on lo interface port 25 shows nothing. The log shows up when I start mailman, and then it seems not to show up again. This is my mailman.cfg's relevant parts: [mta] verp_confirmations: yes verp_personalized_deliveries: yes verp_delivery_interval: 1 incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: localhost lmtp_port: 8024 smtp_host: localhost smtp_port: 25 configuration: python:mailman.config.postfix I can do 'telnet localhost 25' just fine, including as mailman user. I can send and receive mail on my mail server. I tried making a test list and sent/received messages fine. smtp debug logs show "Using agent: <mailman.mta.deliver.Deliver object at 0x7fdd9793c940>" and "IndividualDelivery to: <email(a)address.tld>" on repeat, where the email address is one of the addresses of the shunted mails. version 3.2.2

2 12

User integration with Django application
by Victoriano Giralt 21 Sep '19

21 Sep '19

Hi! Is there a way to integrate Mailman3 user database with an already existing Django application? And then, generate the list roster with a subset of those users. I've been scavenging the archives and failing to find an answer. Thanks! -- Victoriano Giralt CIO University of Malaga +34952131415 SPAIN ================================================================== Note: signature.asc is the electronic signature of present message A: Yes. > Q: Are you sure ? >> A: Because it reverses the logical flow of conversation. >>> Q: Why is top posting annoying in email ?

2 1

Huge performance issue: Mailman doesn't (seem to) receive any mails.
by Henrik Rasmussen 20 Sep '19

20 Sep '19

I am running maxking/mailman-*:0.2 (GNU Mailman 3.2.0 (La Villa Strangiato)). It looks like Mailman is not receiving (enough) mails, but are keps in the Postfix queue and I can't figure out why. I get a lot of "mail for [172.19.199.2]:8024 is using up 7841 of 7841 active queue entries" in the postfix container log (more postfix log at the buttom. I have restarted all Mailman containers this morning, but this didn't help anything. Last entries in Mailman's smtp.log were when we restarted the containers: Sep 18 08:30:02 2019 (36) Peer: ('172.19.199.1', 35454) Sep 18 08:30:02 2019 (36) ('172.19.199.1', 35454) handling connection Sep 18 08:30:13 2019 (36) ('172.19.199.1', 35454) EOF received Sep 18 08:30:13 2019 (36) Connection lost during _handle_client() Sep 18 08:30:13 2019 (36) ('172.19.199.1', 35454) connection lost Sep 18 08:30:18 2019 (36) Peer: ('172.19.199.1', 37164) Sep 18 08:30:18 2019 (36) ('172.19.199.1', 37164) handling connection Sep 18 08:30:20 2019 (36) ('172.19.199.1', 37164) EOF received Sep 18 08:30:20 2019 (36) Connection lost during _handle_client() Sep 18 08:30:20 2019 (36) ('172.19.199.1', 37164) connection lost The runners last ran at Sep 18 08:42:21 2019 The mailman.log updates constantly, but with "Sep 18 09:45:16 2019 (39) 172.19.199.3 - - "GET /3.0/users/" something something only or other http gets. A lot of them is 404 errors, but also a lot of "GET /3.0/lists/LISTNAME HTTP 200 responces, which should not be related. In "uwsgi-error.log" I get some tracebacks, but since I don't think should be related to incoming mails, I'll leave the traceback for now. Sep 18 10:07:47 postfix postfix/smtpd[5426]: connect from gateway[172.19.199.1] Sep 18 10:07:47 postfix postfix/smtpd[5426]: 45DAA7E97BE94: client=gateway[172.19.199.1] Sep 18 10:07:47 postfix postfix/cleanup[5429]: 45DAA7E97BE94: message-id=<A29DAD01610ED744A9D6F14880665668011C8A2C@P 1KITMBX01WC01.unicph.domain> Sep 18 10:07:47 postfix opendkim[19]: 45DAA7E97BE94: DKIM-Signature field added (s=default, d=listsgw.ku.dk) Sep 18 10:07:47 postfix postfix/smtpd[5426]: disconnect from gateway[172.19.199.1] Sep 18 10:07:47 postfix postfix/qmgr[98]: 45DAA7E97BE94: from=<sender(a)example.com>, size=7988, nrcpt=1 (queue active) Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: mail for [172.19.199.2]:8024 is using up 7844 of 7844 active queue entries Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: you may need to reduce lmtp connect and helo timeouts Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: so that Postfix quickly skips unavailable hosts Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: you may need to increase the main.cf minimal_backoff_time and maximal_backoff_time Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: so that Postfix wastes less time on undeliverable mail Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: you may need to increase the master.cf lmtp process limit Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: please avoid flushing the whole queue when you have Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: lots of deferred mail, that is bad for performance Sep 18 10:07:47 postfix postfix/qmgr[98]: warning: to turn off these warnings specify: qmgr_clog_warn_time = 0 [SLIP] Sep 18 10:26:34 postfix postfix/qmgr[98]: B34C07E980CA3: from=<LISTNAME(a)lists.example.com>, size=1219, nrcpt=1 (queue active) Sep 18 10:26:34 postfix postfix/smtp[6559]: connect to sst-dk.mx1-dk.mailanyone.net[130.226.237.91]:25: Connection refused Sep 18 10:26:34 postfix postfix/smtp[6559]: connect to sst-dk.mx1-dk.mailanyone.net[::ffff:130.226.237.91]:25: Connection refused Sep 18 10:26:34 postfix postfix/smtp[6559]: connect to sst-dk.mx2-dk.mailanyone.net[::ffff:130.226.237.91]:25: Connection refused Sep 18 10:26:34 postfix postfix/smtp[6559]: connect to sst-dk.mx2-dk.mailanyone.net[130.226.237.91]:25: Connection refused Sep 18 10:26:34 postfix postfix/smtp[6559]: connect to sst-dk.mx3-dk.mailanyone.net[130.226.237.91]:25: Connection refused Sep 18 10:26:34 postfix postfix/smtp[6559]: B34C07E980CA3: to=<RECIPIENT(a)foo.bar>, relay=none, delay=420673, delays=420673/0.05/0.2/0, dsn=4.4.1, status=deferred (connect to sst-dk.mx3-dk.mailanyone.net[130.226.237.91]:25: Connection refused) / Henrik Rasmussen

3 10

My list has been switched from public to private archives, but they are still visible
by Paul Arenson 20 Sep '19

20 Sep '19

Can anyone help with this? I set my list to private archives today. Up until then, it was pubic. And yet, if you go to the list page, you will see that if you click archives (top left), you can see them. (Filled with a bunch of tests posts for now) https://list.tokyoprogressive.org/postorius/lists/discuss.list.tokyoprogres… Am I misunderstanding what a private archive is? Is something wrong with my setup (which is hosted)? Thank you.

4 8

Mailing List Description that can't be modified by list owners
by chilfer＠unr.edu 20 Sep '19

20 Sep '19

Is there a way to create an additional mailing list field or lock down the current Description or Information fields so they are not modifiable by a list owner? The goal is to have a field that identifies the department or area a list belongs to so that it's easier to find if an owner leaves the organization and the owner needs to be updated on multiple lists.

2 1

Re: hosted signup is producing unexpected results
by tokyoprogressive＠mailbox.org 17 Sep '19

17 Sep '19

I mistakenly posted twice. Please see: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… Sent from my iPhone

1 0

Execution of msgfmt failed when performing post upgrade steps
by Torge Riedel 17 Sep '19

17 Sep '19

Hi, I'm currently running a test setup of MM3 using Mark Sapiros approach with two venv. I also adopted his post-upgrade-script for the web part (django). Just some minutes ago I updated the packages of my test setup with pip3 where hyperkitty is now 1.3.0 When runnin the post-upgrade-script I get the following error message: Execution of msgfmt failed: /opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/locale/nb_NO/LC_MESSAGES/django.po:630: duplicate message definition... /opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/locale/nb_NO/LC_MESSAGES/django.po:273: ...this is the location of the first definition msgfmt: found 1 fatal error Not sure whether this is an error of MM3 or one of its dependency packages. Best regards Torge

2 1

hosted signup is producing unexpected results
by tokyoprogressive＠mac.com 17 Sep '19

17 Sep '19

In my test of the two forms of signup, I am getting these unexpected results. Is it my settings or is something weird within the program itself? 1) https://list.tokyoprogressive.org/postorius/lists/discuss.list.tokyoprogres… 2) Choose "You can also subscribe without creating an account. If you wish to do so, please use the form below" 3) Then I have to approve it. They get "Welcome to the "Discuss" mailing list! To post to this list, send your email to: discuss(a)list.tokyoprogressive.org 4) But I have to approve it.I assume this is because they do not yet have a real account. And they should be listed as a NON MEMBER? 5) But even when they sign up here: https://list.tokyoprogressive.org/accounts/signup/?next=%2Fpostorius%2Flist… they get an email from my provider (NOT MY LIST????) as follows: "Hello from mailman3.emwd.com! You're receiving this e-mail because user iCloud has given yours as an e-mail address to connect their account. To confirm this is correct, go to https://list.tokyoprogressive.org/accounts/confirm-email/MTE3:1iA44k:E7w7xh… Thank you from mailman3.emwd.com! mailman3.emwd.com" 6) And this is where it gets weird. If they send from their email program and get the welcome (Welcome to the "Discuss" mailing list! To post to this list, send your email to: discuss(a)list.tokyoprogressive.org You can unsubscribe or make adjustments to your options via email by sending a message to....... I then get a notice: "Your mail to 'discuss(a)list.tokyoprogressive.org' with the subject test notice Is being held until the list moderator can review it for approval. The message is being held because: The message is not from a list member" 7) While if they send FROM THE interface it goes through. 8) What I am confused about. Signing up for an account should make them a member, right? Subscribing should make them a non member, no? But here it seems that both make them a non member. And worse, someone with an account sending from the Interface has their message get through while the same person sending from an email program has me get a notice that a non member is trying to post. Before I can move my actual members over from another mailing list provider, I want to make sure what works and what doesn't. Thanks. paul!!!

1 0

HyperKitty and duplicate emails across maillists
by Derek Lambert 17 Sep '19

17 Sep '19

How does HyperKitty handle duplicate messages/message-ids across maillists? We have quite a few lists that are members of other lists. I'm in the process of importing our old Mailman 2.1 archives and seeing a lot of duplicate message errors, and wondering if this is why. Would new messages coming into Mailman be handled the same way? Thanks, Derek

5 8

Template's encoding setup
by Ugnius 15 Sep '19

15 Sep '19

I use Lithuanian language (it has special characters like ąčįū...) for regular message template feature. I noticed that some posts come correct, but some have question marks (?) in places of these characters. Looks like there is sittings trick. But footers adds mailman, so it should be always correct, or it depends on senders environment setup? Kind regards Ugnius

3 6

Weird recipient
by Andrew Bernard 12 Sep '19

12 Sep '19

Both before and after upgrading tonight, my lists send out bizarre recipients that I cannot understand. It usually happens at the end of the distribution to other valid recipients. Sep 5 10:05:54 www postfix/smtp[3344]: A5DF9FA14E: to=<0101016d00e302ec-4db56da5-fd69-4b5e-9327-292c55e13ea8-000000(a)us-west-2.amazonses.com>, relay=email-smtp.us-west-2.amazonaws.com[52.36.120.66]:587, delay=2.4, delays=0/0/2.2/0.22, dsn=5.0.0, status=bounced (host email-smtp.us-west-2.amazonaws.com[52.36.120.66] said: 501 Invalid MAIL FROM address provided (in reply to MAIL FROM command)) Help! This behaviour is able to be replicated - it happens on every post. Andrew

2 1

Alter Messages: Reply to confusion
by paul＠arenson.org 12 Sep '19

12 Sep '19

This is one thing I am confused about. The explanations in the settings about No Munging, etc. are not completely clear. MY GOAL What I want to make sure, since this is a discussion list, is that most messages go to the mailing list, not to individuals. I plan to put something in one of the templates to remind people that a reply goes to the discussion list. If they do not want to send it to everyone, they should send to the original poster. 1) I understand there are plusses and minuses but I am not sure I understand the explanation given. If it IS preferable to use NO MUNGING, how do I make sure that this is easy to accomplish? 2) I can put something in the footer of every message to remind people, but first I need confirmation of what I should choose in this section. Thanks in advance.

4 3

Mailman 3 installation, no mails in hyperkitty, unable to add footer.
by ugniusviln＠gmail.com 12 Sep '19

12 Sep '19

I have read documentation, but still have stupid questions, could You please help, because I can't make it working. I do not understand something important. I have no experience with python at all. I have mailman 3, python 3.5 in my debian OS system, and additional packages like uwsgi and ect. using https://buildmedia.readthedocs.org/media/pdf/gnu-mailman/latest/gnu-mailman… about till chapter 6. I understand mailman suite has hyperkitty already. But I am not sure about: 1. Does mailman-suite have hyper-kitty inside? Because if I run $python manage.py runserver - it runs. In installed it under dedicated OS user home and fonfigured to run. I can create lists, event add lists to hyperkitty page using: $django-admin runjob new_lists_from_mailman list server sends messages to list members as well. But nothing happens more. No emails come to hyperkitty, arciver log 0 size. $ python manage.py runjobs -l shows the lists of the jobs, so seems nothing to add. Except uwsgi.ini, I have only 2 configuration files in mailman-suite project directory: settings.py and mailman.cfg So I do not understand what did I configured badly. 2. If I (using Postorius web interface) add footer template to my list under regular message, something strange happens. Mailman stops to send messages for list members. No any entries in the logs. Just Mailman log writes: "unable to connect localhost port 25" and no more explanation. If I delete list's footer template (web interface), mailman starts working again. What is bad here? How to add custom footer? In mailman 2 if was working so good and was easy to setup.

4 7

Suspend a list temporarily
by Andrew Bernard 12 Sep '19

12 Sep '19

Is there any way to do this, while keeping other lists running?

3 3

Re: HYPERKITTY_ATTACHMENT_FOLDER
by Ugnius S 11 Sep '19

11 Sep '19

Could You please confirm that this parameter should be placed in mailman-hyperkitty.cfg file? I have checked mailman/postorius/hyperkitty owner user can write files there and web user group has privileges to write and to read, but *no any files appear there*. Mailman works, it is possible to download attachments from hyperkitty. Mailman restarted, uwsgi restarted, runjobs restarted. No files in /full/path/to/folder/ File looks like: [general] base_url: https://flistserv.example.com/hyperkitty/ api_key: BlaBlabla HYPERKITTY_ATTACHMENT_FOLDER = /full/path/to/folder/ BR Ugnius 2019-09-11, tr, 21:21 Ugnius S <ugniusviln(a)gmail.com> rašė: > Thank You so much. > > 1) https://hyperkitty.readthedocs.io/en/latest/install.html > Close to the end before the "UPDATE" topic, chapter "Customization". > > 2) > https://buildmedia.readthedocs.org/media/pdf/hyperkitty/stable/hyperkitty.p… > Page 10, chapter 2.8 "Customization" > > BR > Ugnius > > 2019-09-11, tr, 20:16 Abhilash Raj <maxking(a)asynchronous.in> rašė: > >> >> >> On Wed, Sep 11, 2019, at 9:52 AM, Ugnius S wrote: >> > Hi. >> > >> > Can anybody send example how to set it? It is mentioned in >> documentation, >> > but very vaguely. >> >> If you can point out where did you find it in docs, I can update it. >> Information is kind of duplicated in a few places. >> >> > HYPERKITTY_ATTACHMENT_FOLDER = /full/unix/path >> >> This is the right value. >> >> It is a path on the filesystem, where the user running Hyperkitty is >> allowed to write. >> >> > >> > HYPERKITTY_ATTACHMENT_FOLDER = http://localhost:8000/something >> > >> > HYPERKITTY_ATTACHMENT_FOLDER = ./var/data/something/ >> > >> > Has anybody experience of using this, maybe have recommendations of >> using >> > it? Better under project user or better under web content owner where >> the >> > static content is. I would like to store attachments separately to avoid >> > growing database. >> > Hyperkitty documentation: >> > By default, HyperKitty stores the email attachments in the database. >> If >> > you would rather have them stored on the filesystem, you can set the >> > HYPERKITTY_ATTACHMENT_FOLDER configuration value to a directory. >> > Make sure that the user running the Django process (for example, apache >> or >> > www-data) has the permissions to write in this directory. >> > >> > ------------- >> > _______________________________________________ >> > Mailman-users mailing list -- mailman-users(a)mailman3.org >> > To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >> > >> >> -- >> thanks, >> Abhilash Raj (maxking) >> _______________________________________________ >> Mailman-users mailing list -- mailman-users(a)mailman3.org >> To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >> >

2 2

HYPERKITTY_ATTACHMENT_FOLDER
by Ugnius S 11 Sep '19

11 Sep '19

Hi. Can anybody send example how to set it? It is mentioned in documentation, but very vaguely. HYPERKITTY_ATTACHMENT_FOLDER = /full/unix/path HYPERKITTY_ATTACHMENT_FOLDER = http://localhost:8000/something HYPERKITTY_ATTACHMENT_FOLDER = ./var/data/something/ Has anybody experience of using this, maybe have recommendations of using it? Better under project user or better under web content owner where the static content is. I would like to store attachments separately to avoid growing database. Hyperkitty documentation: By default, HyperKitty stores the email attachments in the database. If you would rather have them stored on the filesystem, you can set the HYPERKITTY_ATTACHMENT_FOLDER configuration value to a directory. Make sure that the user running the Django process (for example, apache or www-data) has the permissions to write in this directory. -------------

2 1

Custom templates error and archive link
by Ugnius S 11 Sep '19

11 Sep '19

My server uses https connection. According this error seems that certificate of course has not localhost written in it: requests.exceptions.SSLError: HTTPSConnectionPool(host='localhost', port=443): Max retries exceeded with url: /mailman3/api/ templates/list/example.com/list:user:notice:welcome (Caused by SSLError(CertificateError("hostname 'localhost' doesn't match either of 'listserv.example.com', 'example.com', 'www.example.com ",),)) ------ Second question, is archiver template example: $hyperkitty_url: Permalink to archived message in Hyperkitty If to set as in the example, then it add " : " to the end of the line, and link does not work. I would recommend to update it. My question is: My server's address is listserv.example.com, but mailman to email message variable $hyperkitty replaces like https://example.com/.... What does then happen? https://example.com does not point to my web interface address. I have resolved it with the Apache2 redirection tools, but is it possible to set it correct in mailman's configuration? Kind regards Ugnius

1 0

mailman-users archive search
by Mark Dale 10 Sep '19

10 Sep '19

Is this list's search function kaput, or is it an issue with MM3, or is it me? *** https://lists.mailman3.org/archives/search?mlist=mailman-users%40mailman3.o… *** Mailman-users search results for query "Postorius" mailman-users(a)mailman3.org 0 messages Sorry no email could be found for this query. /Mark

2 2

django 2.2.5 which is incompatible
by Mark Dale 10 Sep '19

10 Sep '19

Hi, On Debian, in the process of setting up Mailman 3.3.0 I'm getting: $ pip3 install postorius ... django-mailman3 1.3.0 has requirement Django<2.2,>=1.11, but you'll have django 2.2.5 which is incompatible. ... Successfully installed Django-2.2.5 ... Which may or may not be causing a later error when creating superuser: ImportError: No module named django.core.management Am I missing the obvious somewhere? Thanks, Mark

2 1

Google auth issue redirect_uri_mismatch
by Ugnius S 09 Sep '19

09 Sep '19

Hi. New question about configuration, maybe somebody has experience and know what I should change it. I have tried to implement Google authorisation. I have created Google credentials keys and successfully added using Django admin page. I use UWSGI proxy for apache setup like "ProxyPass / http://127.0.0.1:8002", UWSGI runs on 0.0.0.0:8002. (So Appache from external address redirects to internal) What happens when I try Google auth... If I set Authorised redirect URIs: http://lists.example.com/accounts/google/login/callback/ , Google gives me error 400 Error: redirect_uri_mismatch and requests for: http://127.0.0.1:8002/accounts/google/login/callback/ If I set that requested address to Google, then Google authorises me, but and after authorisation redirects to http://127.0.0.1:8002/accounts/google....../.... (very long line) Of course this internal address does not open, but... If I just manually replace part of address just: http://127.0.0.1:8002 replace to https://lists.example.com/.../...(long line) this makes me get in as authorised user to the page. How to make django to send external request to Google? Because Google should not point back to internal address... This seems simple, but I do not find what I should change in the configuration: Apache or Django or uwsgi.ini I hope anybody of You have experience and made it to run. Kind regards Ugnius

2 2

Downloads corrupt
by Andrew Bernard 08 Sep '19

08 Sep '19

Latest upgrade version has not improved matters. When I download, the file is generated but it is ten bytes long and obviously therefore corrupt. Why am I the only one seeing this error? What can I do to diagnose it? Andrew

3 9

Dmarc settings and
by paul＠arenson.org 08 Sep '19

08 Sep '19

In a long thread I asked this but have not gotten a clear enough explanation. Presumably, to insure fewer problems with users of Yahoo etc,, there seem to be two settings: 1) Alter messages 2) Dmarc mitigations I don’t understand how my choice in one affect the other, if they do even, Two experts have tried to help, but I think I need a little hand holding. I understand there is no consumer ready manual and all I have found us this: https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/dmarc-mi… My settings; REPLY GOES TO LIST (alter messages)--current settings REPLACE FROM: with list (DMARC mitigations) -> current settings DMARCH Mitigation YES OR NO (DMARC mitigations)--> currently NO I was told that Dmarc mitigations YES might prevent people from not getting mail How about Replace from with list? How about reply goes to list? In other words, what is the relationship between these two different menu items and the effect of the settings in one on the settings of the other? Can anyone help a confused would be happy user? Thanks? If so, what about the Alter Messages settings:

3 5

sqlite3 Database "read only" error on mailman_sync job
by ugniusviln＠gmail.com 06 Sep '19

06 Sep '19

Hi. All the project installation is under the same user / path and it works. Archiving working as well, (just one remark: no matter what to set in postorius, hyperkitty shows list as public) I have found work around - it is possible to change list as private in "admin" page. I started to get issues with runjobs after I have created couple of new lists with "no archive" option. If as owner user from project home I run: django-admin mailman_sync Traceback (most recent call last): File "/home/user/.local/lib/python3.5/site-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/home/user/.local/lib/python3.5/site-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: attempt to write a readonly database "django-admin runjob sync_mailman " - makes read only errors as well. "django-admin runjob new_lists_from_mailman" django.db.utils.OperationalError: attempt to write a readonly database END TRACEBACK I did not find information how to fix this. It was worked without errors before. I noticed, that if I stop mailman, "django-admin mailman_sync" starts to work. If I start "mailman start", then "django-admin mailman_sync" failing again. I did not check other jobs, but I think what is related to database, will get errors. Seems mailman locking the database. It is not a file permissions issue. Mailman db location is: /project_directory/var/data/mailman.db if to rename /project_directory/var/data/mailman.db to something, mailman creates database file size 0, django-admin runjobs start working, but of course postorius stops working. I did it for testing. I have returned this database file back, postorius started to work again, but django-admin runjobs does not work, error: "database read only". Please help me how to fix this issue.

4 10

Mass subscribe bug - if you delete and re-add users it does not use updated info
by roger＠reasonal.com 05 Sep '19

05 Sep '19

Hi all -- think this is a bug. I had added some users as a mass subscribe. Some were Name Surname <name(a)foo.bar> format, some were just email addresses. I wanted to update the member list with complete name & email addresses. I unsubscribed the partials, and re-added them as full versions. However the updated member list keeps showing the partial address only. This bug also works the other way. I added "Bob Smith <bob(a)bob.com>", checked it was there in list. Unsubscribed the address, and then re-added as "bob(a)bob.com" -- now in the members list it appears as the full "Bob Smith <bob(a)bob.com>.

2 1

Posting replies vs starting a thread via email
by paul＠arenson.org 05 Sep '19

05 Sep '19

In my tests where replies go to the list, when a person uses the email client? So far a reply to the original message and a reply to a reply to a reply all go in the same thread. Is this standard? Do I have to warn users not to have endless Re re re re? And the other question is what happens if a user sends a message via email with a new subject? Does the list accept it as a new thread? This should be one of my last big questions. Thank you. Paul

3 6

Mailman Suite release announcement
by Abhilash Raj 05 Sep '19

05 Sep '19

Hi All, I am pleased to announce new releases for Mailman Suite, including - Mailman Core 3.3.0 (Tom Swayer) - Mailmanclient 3.3.0 - django-mailman3 1.3.0 - Postorius 1.3.0 - Hyperkitty 1.3.0 This is a feature release and also includes a bunch of bugfixes. I am really really thankful to a lot of contributors who have helped out with this release. It is really nice to see Mailman 3 gaining more users and contributors. Python 3.5 is the minimum supported version, but all the releases have been tested to work with Python 3.5-3.7. This is the last release to support Python 3.5 since it has been in security only maintenance mode for a while now. Some of the highlights of this release includes: Mailman Core 3.3.0 - Support for ARC signing. Thanks to Gene Shuman and Stephen Turnbull. - Many many improvements to "mailman import21" command. Thanks to Mark Sapiro. - Addition of French templates. Thanks to Stéphane Parunakian. - A better and more scalable REST API server using Gunicorn. - Support for SMTPS/STARTTLS. Thanks to J08ny. A full copy of change log is available at: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html Postorius 1.3.0 - Many more settings for MailingList configuration exposed, including preferred language, digest related settings. - Support for FILTER_VHOST to filter MailingLists based on the serving domain. Thanks to Nate Coraor. - Ability to write MailingList info in Markdown to render info in HTML instead of Plaintext. A full copy of change log is available at: https://postorius.readthedocs.io/en/latest/news.html Hyperkitty 1.3.0 - Unread messages, when logged in, are more easily recognizable with blue envelope icon. - Improved thread view with colored background for quoted parts of messages. - Improved readability on small screens by removing the indentation in thread view. A full copy of the change log is available at: https://hyperkitty.readthedocs.io/en/latest/news.html All the packages are available to download from PyPi (https://pypi.org). https://pypi.org/project/postorius/ https://pypi.org/project/hyperkitty/ https://pypi.org/project/django-mailman3/ https://pypi.org/project/mailman/ https://pypi.org/project/mailmanclient/ -- thanks, Abhilash Raj (maxking)

1 0

Re: Amazon SES
by Andrew Bernard 05 Sep '19

05 Sep '19

No, out of the sandbox, and fully verified. Andrew On 5/9/19 12:18 pm, S. Selby Mats Mats wrote: > Are you still in the “Amazon SES sandbox”?

1 0

Amazon SES
by Andrew Bernard 05 Sep '19

05 Sep '19

Is it possible to use Amazon SES with Mailman? Despite my best efforts, I have conclusively verified my sending domain, but Amazon SES rejects mails with the 'sender email not verified' message. If you verify a domain, you do not have to verift individual senders. The help from amazon SES mentions it looks at several headers, but I am not sure what is what. Has anybody had success with this? Andrew'

1 0

My email address appears in quoted test in my list. Hoot change that.
by paul＠arenson.org 05 Sep '19

05 Sep '19

Hi. I thought I had the settings right, but I do not see one to get rid of this. My name appears as "On Tue, Sep 3, 2019, at 9:26 PM, paul(a)domainname.org wrote. How can I hide that?

2 3

How to delete an archive
by Andrew Bernard 05 Sep '19

05 Sep '19

I deleted a list but I want to delete the archive as well. How do you do that? Also, I had a list called Test. I deleted it. I made a new list called Testing, with a different email address, bu the archive points to the test list. This seems to be messed up. Why? I am sorry to say I have had continuous trouble with many aspects of Hyperkitty from the beginning several months ago. I know that is not helpful, but I am starting to wonder about all this. Andrew

2 1

Editing templates from settings
by paul＠arenson.org 05 Sep '19

05 Sep '19

Hello again. Gradually coming along thanks to the help of other members. One thing I want to do is edit my headers or footers to have key info about my site. But it seems even if I skip spaces, when a message is received the spaces disappear. Likewise, is there any way to add basic formatting like BOLD? For example, if I make a footer like this... Skipping a space here __/__/__/__/__/_/__/__/__/__/ Our List _/__/__/__/__/_/__/__/__/__/ Skipping a space here ...the centering disappears, as do the skipped spaces, meaning the message after a header or before a footer looks cluttered, Is there a fix? Thank you.

1 2

Editing templates from settings
by paul＠arenson.org 05 Sep '19

05 Sep '19

Hello again. Gradually coming along thanks to the help of other members. One thing I want to do is edit my headers or footers to have key info about my site. But it seems even if I skip spaces, when a message is received the spaces disappear. Likewise, is there any way to add basic formatting like BOLD? For example, if I make a footer like this... Skipping a space here __/__/__/__/__/_/__/__/__/__/ Our List _/__/__/__/__/_/__/__/__/__/ Skipping a space here ...the centering disappears, as do the skipped spaces, meaning the message after a header or before a footer looks cluttered, Is there a fix? Thank you.

2 2

Save original message/headers in HyperKitty?
by Derek Lambert 05 Sep '19

05 Sep '19

Is it possible to configure HyperKitty to store the original messages, or the headers? Has this ever been discussed? Thanks, Derek Lambert

2 1

Basic settings for a discussion list
by paul＠arenson.org 05 Sep '19

05 Sep '19

Over the last 20 hours I have been trying to figure out setup for list members to sign up. One person has kindly helped out, though I am still unsure of the difference between the several signups. That thread is here and I welcome more advice. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… But it occurs to me that my problem is that I have not actually configured my list. So this thread is for help on that. I have found a guide for general users here: http://docs.mailman3.org/en/latest/userguide.html But I have only found a highly technical guide for administrators here: https://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclien… It is written for coders and I am looking for a guide similar to the one for users. It seems not to exist yet. WHAT I WANT Discussion only list. Ideally anyone who signs up via the various ways should be able to get the archives and post via email and the interface if they want. The list should be closed to others. In the absence of any guide, all I can do is cross check with you guys and hope I am on the right track. I am non technical, although I managed a Mailman 2 list without difficulty. 1) FIRST ANOMALY Under https://list.tokyoprogressive.org/postorius/accounts/subscriptions/ I see myself twice: List Name Subscription Address Delivery Mode Role discuss.list.tokyoprogressive.org paul(a)tokyoprogressive.org None member discuss.list.tokyoprogressive.org paul(a)tokyoprogressive.org regular owner Is this correct? I added My name in one field somewhere and this is the result. I even got a welcome message. I think it is because I subscribed to my own list.If this was not necessary, what should I do? Global based preferences are listed. Address and email based ones are not showing either enabled or disabled. 2) MANAGE LISTS For myself I have done the following in my MAILING LIST SETTINGS Subscribe to this list My email and name (Maybe that is why i am listed twice) Now I see 3) Users For now only me- I am listed as member and owner. There will be no other moderators or owners I have no idea what a non member is (if they register aren't they a member?) 4) Templates This is showing nothing at this point. Before it was. I am not sure what i did to stop it from showing. Perhaps because I made it a private list? 5) Settings a) List identity I have it set for NOT SHOWING on the Index page because I will link to it from my news magazine website as a way to comment on articles. Is this ok? Other data will be filled in later. I think I am confusing this with private list. I also will have no other list. b) AUTO RESPOND LIST OWNER-- I added a short note thanking people. Respond and Continue Processing c) AUTO RESPOND POSTER--Your message has been been received. If you are a member, it should be posted soon. Respond and Continue Processing d) AUTO RESPOND REQUESTS--No auto response OTHER THINGS DEFAULT e) URL WELCOME MESSAGE--NOT SURE. I want people to subscribe themselves but I also have 500 people from another list from DADA I will import. I want them automatically be able to post. Is it possible? If so, I hope to add them manually. DO I compose a text on my website and welcome them by adding the URL, or enter it in my list? f) NOTIFY OF MEMBERSHIP CHANGES--Yes g) ALTER MESSAGES ---I have left most things as they are. However, as this is a discussion list, I want replies ONLY to go to the list. I chose that. h) DMARC --I have left as is i) DIGEST--I have left as is 6) MASS OPERATIONS--I have left as is 7) BAN--left as is 8) MESSAGE ACCEPTANCE--I have left as is 9) HEADER FILTERS--left as is 10) ARCHIVES--Private Archives (Maybe this is why templates do not show???) 11) SUBSCRIPTION POLICY--MODERATE-- I intend to send them an email to confirm their reasons for subscribing to avoid spammers. LAST THING. My Gravity does not work. I edited it online as per instructions but it does not appear. That is all I can think of. Thanks in advance. paul

2 4

Trying to configure a list (hosted)
by paul＠arenson.org 04 Sep '19

04 Sep '19

Is there a how to on how to configure a list? For example, using a hosted option, I see this menu: Subscription requests Held messages Users Templates Settings Mass operations Banned addresses Header filters And cling on settings, for example. I have already removed my list from the list of lists on the server since I want my website users to only see my list. They can either do that here https://list.tokyoprogressive.org/postorius/lists/discuss.list.tokyoprogres… or here https://list.tokyoprogressive.org/accounts/signup/ I actually do not WANT people to join without being able to use the web interface because it is intended to be a discussion list. So the option to subscribe without creating an account. is confusing to me, which is why I prefer the latter. BUT...using a test of signing up myself (using 3 other email addresses I have), some using the subscription option and some using the bottom one (no account), all the email addresses end up in my members list and non end up in my non members list. (So I am wondering what a non member is. I had thought it was someone who signed up without registering (just name, no password), but if so i wonder why all 3 of my addresses end up in the members place. Lastly, I want to configure it as a discussion list. However, I do not see that option, which was clear in MAILMAN 2. (And I understand that if someone registers without making an account, I cannot set them myself to have an account enabling them to see the archives and post from the web? If it IS possible, that would be great, because the purpose of the archives in my case is to enable better discussions than if one has only to refer to their past emails.) That is about it for now, but I am stuck on this right now and a user manual for non techie people, if it exists, would be nice. I see one for list members but not administrators. Maybe I am looking in the wrong place? Thanks paul

3 8

Settings: No templates are visible in settings
by paul＠arenson.org 03 Sep '19

03 Sep '19

I am struggling to find out why I do not see TEMPLATES in the Settings. When I first logged they were there. Many of them. Then, toying with the settings, they disappeared. I cannot find them now. Originally i thought I would not list the mailing list but changed my mind. Likewise, archives are now listed as public. I am still thinking about that. In any case, I want to see if there are templates to allow me to change headers or footers in messages, such as give the address of the list. Thank you for your advice. P.S> Sorry i asked too many questions the other day. Trying to keep this brief.

1 1

still up to date?
by mailman3＠malevil.cc 27 Aug '19

27 Aug '19

I have subscribed to the following rss feeds to keep track of updates: https://libraries.io/pypi/mailman/versions.atom https://libraries.io/pypi/mailman-hyperkitty/versions.atom https://libraries.io/pypi/HyperKitty/versions.atom https://libraries.io/pypi/postorius/versions.atom https://gitlab.com/mailman/mailman-suite/commits/master?feed_token=yitiVdhX… but none of them was updated for half a year, is that actually the status? No current releases or updates for mailman3?

2 2

Status of hosting options after a year for non techies
by paul＠arenson.org 26 Aug '19

26 Aug '19

Hi all This is Paul Arenson in Japan. I temporarily dropped off the list year ago when it was clear there was no Cpanel Solution forthcoming. I thought I would check in again. I used to be on CPanel and I was advised it might be a wait. 1) I am now on Plesk. I heard Plesk might allow Docker and installation may be possible. Am I misinformed or a possibility? --->Assuming no, I guess jump to question 4. 2) Assuming yes, I see a list of people who can possibly help install. https://wiki.list.org/COM/Mailman%20consulting%20services Only a few people on it. Has anyone used any or can recommend someone. 3) There is also a Python list, but before I submit a request, is this something that works on general. For example, when a new version or bug release comes up, will I need to call on the person or persons again? Is it still better to wait? 4) Hosting services: Only a few listed at https://wiki.list.org/COM/Mailman%20hosting%20services are or Mailman 3. Has anyone used this: https://mailman3.com The site seems incomplete. Or this: https://maadix.net/en/servers Looks good. Might be a bit expensive for my use. Or this: https://www.mailmanhost.com/mailman-3-hosting/ Also looks good. A long time ago we corresponded. They seem reasonable. My list is about 700 people. These seem to be the same people: https://www.emwd.com/mailman-3-shared-list-hosting/ Any others I should know about? Thanks in advance. paul arenson japan

2 3

MM3 + Postfix + Dovecot + PostfixAdmin
by maztec＠gmail.com 20 Aug '19

20 Aug '19

System: Debian Buster Install: Functioning Postfix w/ Dovecot using PostfixAdmin for virtual domain and mailbox management Definitions: Host.TLD = my server's domain name; List.TLD = listserv's domain name; ListName = list's name. Issue: Postfix LMTP does not pass messages onto MM3:LMTP. Instead the behavior summary is as follows: postfix/lmtp[...]: ###: to=<mailman3:[127.0.0.1]:8024@Host.TLD>, orig_to=<ListName-confirm+###(a)ListServer.TLD>, relay=Host.TLD[private/dovecot-lmtp], delay=439, delays=439/0.03/0.01/0.01, dsn=5.1.1, status=bounced (host Host.TLD[private/dovecot-lmtp] said: 550 5.1.1 <"mailman3:[127.0.0.1]:8024"@Host.TLD> User doesn't exist: mailman3:[127.0.0.1]:8024@Host.TLD (in reply to RCPT TO command)) The problem appears to be that Postfix defaults the relay to being private/dovecot-lmtp and not the general lmtp protocol or the mailman3 dedicated lmtp protocol. ---------------------------------------- ---------------------------------------- Details: # cat /proc/version Linux version 4.19.0-5-amd64 (debian-kernel(a)lists.debian.org) (gcc version 8.3.0 (Debian 8.3.0-6)) #1 SMP Debian 4.19.37-5+deb10u1 (2019-07-19) ---------------------------------------- # postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no broken_sasl_auth_clients = yes compatibility_level = 2 debug_peer_level = 4 html_directory = /usr/share/doc/postfix/html inet_interfaces = all inet_protocols = ipv4 local_recipient_maps = $virtual_mailbox_maps,regexp:/var/lib/mailman3/data/postfix_lmtp local_transport = virtual mailbox_size_limit = 0 mydestination = localhost myhostname = rijr.com mynetworks = 127.0.0.0/8 [::ffff:127.0.0.0]/104 [::1]/128 myorigin = /etc/mailname owner_request_special = no policy-spf_time_limit = 3600s readme_directory = /usr/share/doc/postfix recipient_delimiter = + relay_domains = $mydestination,regexp:/var/lib/mailman3/data/postfix_domains relayhost = smtp_tls_loglevel = 1 smtp_tls_security_level = may smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache smtpd_banner = $myhostname ESMTP $mail_name (Debian/GNU) smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_relay_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_local_domain = $mydomain smtpd_sasl_path = private/auth smtpd_sasl_security_options = noanonymous smtpd_sasl_tls_security_options = $smtpd_sasl_security_options smtpd_sasl_type = dovecot smtpd_tls_auth_only = yes smtpd_tls_cert_file = /etc/ssl/private/vmail.crt smtpd_tls_key_file = /etc/ssl/private/vmail.key smtpd_tls_loglevel = 1 smtpd_tls_received_header = yes smtpd_tls_security_level = may smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache smtpd_use_tls = yes transport_maps = hash:/etc/postfix/transport,regexp:/var/lib/mailman3/data/postfix_lmtp virtual_alias_domains = proxy:mysql:/etc/postfix/virtual_alias_domains.cf virtual_alias_maps = proxy:mysql:/etc/postfix/virtual_alias_maps.cf,proxy:mysql:/etc/postfix/virtual_alias_domains_maps.cf,regexp:/var/lib/mailman3/data/postfix_lmtp virtual_gid_maps = static:5000 virtual_mailbox_base = /home/vmail virtual_mailbox_domains = proxy:mysql:/etc/postfix/virtual_mailbox_domains.cf virtual_mailbox_limit = 512000000 virtual_mailbox_maps = regexp:/var/lib/mailman3/data/postfix_lmtp,proxy:mysql:/etc/postfix/virtual_mailbox_maps.cf virtual_minimum_uid = 5000 virtual_transport = lmtp:unix:private/dovecot-lmtp virtual_uid_maps = static:5000 # cat master.cf [grep'd for lmtp and mailman3] lmtp unix - - y - - lmtp mailman3 unix - - - - - lmtp -o lmtp_send_xforward_command=yes -o disable_dns_lookups=yes ---------------------------------------- # cat mailman.cfg [mta section only] [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver smtp_host: localhost smtp_port: 25 lmtp_host: 127.0.0.1 lmtp_port: 8024 configuration: /etc/mailman3/postfix-mailman.cfg ---------------------------------------- # cat /var/lib/mailman3/data/postfix_lmtp # AUTOMATICALLY GENERATED BY MAILMAN ON 2019-08-06 06:39:21 # # This file is generated by Mailman, and is kept in sync with the binary hash # file. YOU SHOULD NOT MANUALLY EDIT THIS FILE unless you know what you're # doing, and can keep the two files properly in sync. If you screw it up, # you're on your own. # Aliases which are visible only in the @List.TLD domain. /^List(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-bounces(\+.*)?(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-confirm(\+.*)?(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-join(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-leave(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-owner(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-request(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-subscribe(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 /^List-unsubscribe(a)List\.TLD$/ mailman3:[127.0.0.1]:8024 ---------------------------------------- # cat postfix-mailman.cfg [postfix] # if I don't have postmap_command set, mailman errors out, even though transport_file_type is regex. postmap_command: /usr/sbin/postmap transport_file_type: regex ---------------------------------------- # cat mail.debug Aug 6 01:03:28 Host dovecot: lmtp(23055): Connect from local Aug 6 01:03:28 Host dovecot: auth: Debug: master in: USER#0112#011mailman3:[127.0.0.1]:8024@Host.TLD#011service=lmtp Aug 6 01:03:28 Host dovecot: auth: userdb(?): Username character disallowed by auth_username_chars: 0x3a (username: mailman3:[127.0.0.1]:8024@Host.TLD) Aug 6 01:03:28 Host dovecot: auth: Debug: userdb out: NOTFOUND#0112 Aug 6 01:03:28 Host postfix/cleanup[22970]: 2937FB0: message-id=<20190806080328.2937FB0(a)rijr.com> Aug 6 01:03:28 Host postfix/lmtp[23054]: CA030AA: to=<mailman3:[127.0.0.1]:8024@rijr.com>, orig_to=<gilman-clan-confirm+51c0564a95aa31a8840305bec77e9023baa46477(a)List.TLD>, relay=Host.TLD[private/dovecot-lmtp], delay=439, delays=439/0.03/0.01/0.01, dsn=5.1.1, status=bounced (host Host.TLD[private/dovecot-lmtp] said: 550 5.1.1 <"mailman3:[127.0.0.1]:8024"@Host.TLD> User doesn't exist: mailman3:[127.0.0.1]:8024@Host.TLD (in reply to RCPT TO command)) Aug 6 01:03:28 Host dovecot: lmtp(23050): Disconnect from local: Client has quit the connection (state=READY) Aug 6 01:03:28 Host postfix/lmtp[22981]: C0EEEA8: to=<mailman3:[127.0.0.1]:8024@Host.TLD>, orig_to=<ListName-confirm+51c0564a95aa31a8840305bec77e9023baa46477(a)List.TLD>, relay=Host.TLD[private/dovecot-lmtp], delay=566, delays=566/0.04/0.01/0.01, dsn=5.1.1, status=bounced (host Host.com[private/dovecot-lmtp] said: 550 5.1.1 <"mailman3:[127.0.0.1]:8024"@Host.TLD> User doesn't exist: mailman3:[127.0.0.1]:8024@Host.TLD (in reply to RCPT TO command)) ---------------------------------------- I have played with dozens of variations on the configuration files and tracing what is going on. The only reason I see that relay=Host.TLD[private/dovecot-lmtp] is because of: virtual_transport = lmtp:unix:private/dovecot-lmtp Hopefully I can get this figured out .... - Jay

4 6

Some threads donw download
by Andrew Bernard 18 Aug '19

18 Aug '19

Further to my previos queries about download failures - the generated file is corrupt, I turned up debugging and I now see this on the threads that don't download. [pid: 25261|app: 0|req: 27/27] 59.167.198.231 () {48 vars in 1198 bytes} [Sat Aug 17 08:55:15 2019] GET /archives/list/jackrail@jackrail.org/export/jackrail@jackrail.org-CKOK7BEELMHIFF2MTPUZXQXQYZZGWF3D.mbox.gz?thread=CKOK7BEELMHIFF2MTPUZXQXQYZZGWF3D => generated 0 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 241 bytes (0 switches on core 0) Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/views/mlist.py", line 327, in stream_mbox msg = email.as_message() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/models/email.py", line 188, in as_message subtype=mimetype[1], filename=attachment.name) File "/usr/lib/python3.7/email/message.py", line 1147, in add_attachment self._add_multipart('mixed', *args, _disp='attachment', **kw) File "/usr/lib/python3.7/email/message.py", line 1135, in _add_multipart part.set_content(*args, **kw) File "/usr/lib/python3.7/email/message.py", line 1162, in set_content super().set_content(*args, **kw) File "/usr/lib/python3.7/email/message.py", line 1092, in set_content content_manager.set_content(self, *args, **kw) File "/usr/lib/python3.7/email/contentmanager.py", line 35, in set_content handler = self._find_set_handler(msg, obj) File "/usr/lib/python3.7/email/contentmanager.py", line 58, in _find_set_handler raise KeyError(full_path_for_error) KeyError: 'builtins.NoneType' What is this saying? Andrew [Somewhat perplexed at why Mailman 3 is behaving so badly for me...]

2 2

Idle connections to Postgres
by Andrew Bernard 17 Aug '19

17 Aug '19

I have 20 idle connections to Postgres with Mailman 3. What are these for, and what are they doing (apart from apparently nothing)? main: mailman3 mailman3 ::1(46058) idle Andrew

1 0

Compression error
by Andrew Bernard 17 Aug '19

17 Aug '19

I did a git pull today. Now I get the following error and the archives wont display: compressor.exceptions.OfflineGenerationError: You have offline compression enabled but key "b5ae52a1ebb585c556edceb45a148cb948b2a2673d133a340a90cd02fdd34828" is missing from offline manifest. You may need to run "python manage.py compress". Here is the original content: Any clues?

2 2

Download errors
by Andrew Bernard 17 Aug '19

17 Aug '19

Whenever i try to download an archive, the file seems to be generated and it downloads, but it will never open, with errors like 'an error occurred while extracting files'. What can be causing this?

2 2

qcluster CPU usage
by Andrew Bernard 17 Aug '19

17 Aug '19

Recently the qcluster program is engaging the CPU continuously at about 5% CPU. While that may not be much, previously it was not doing this. What could be the cause of this? I cant see any warnings in the logs.

1 0

Hyperkitty reply indent
by Andrew Bernard 16 Aug '19

16 Aug '19

Is there any way the indent in the thread view can be reduced or set to zero? My users are complaining that by the time you have a reply four or five deep the view on a mobile phone leaves only one or two words, because it does not wrap responsively correctly (have I set something wrongly?) Andrew

3 8

Question after upgrade to mm 3.2.3 and latest postorius
by David Krantz 13 Aug '19

13 Aug '19

Hi all, I have just upgraded to mailman 3.2.3. My installation is from the git sources and I use two different venv:s, one for the web part as I did not want to compile the web server plugin to a newer python version than 3.5, and one venv for the rest running python 3.7. Apart from some missing dependencies and some changes that affected the django config I just have two issues with postorius: 1. The index page with all lists is not sorted in any useful way although it is based on something as the order seems to be stable. Prior to the upgrade the lists were sorted in alphabetical order after list name which is a lot more usable for me as admin. If I click the link at the bottom with "click to view all lists" I get the old behaviour. 2. The template menu simply does not work, it seems as if some database table is missing even after running migrations. Django logs the following: ERROR 2019-08-11 20:58:55,038 exception 11837 139756347221760 Internal Server Error: /mailman3/lists/TESTLIST/templates Traceback (most recent call last): File "/...VENV3.5/lib/python3.5/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) psycopg2.errors.UndefinedTable: relation "postorius_emailtemplate" does not exist LINE 1: ...ext", "postorius_emailtemplate"."identifier" FROM "postorius.. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/...VENV3.5/lib/python3.5/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/...VENV3.5/lib/python3.5/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/...VENV3.5/lib/python3.5/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/...VENV3.5/lib/python3.5/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/...VENV3.5/lib/python3.5/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/...VENV3.5/lib/python3.5/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/...VENV3.5/lib/python3.5/site-packages/django/template/defaulttags.py", line 313, in render if match: File "/...VENV3.5/lib/python3.5/site-packages/django/db/models/query.py", line 276, in __bool__ self._fetch_all() File "/...VENV3.5/lib/python3.5/site-packages/django/db/models/query.py", line 1179, in _fetch_all self._result_cache = list(self._iterable_class(self)) File "/...VENV3.5/lib/python3.5/site-packages/django/db/models/query.py", line 54, in __iter__ results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size) File "/...VENV3.5/lib/python3.5/site-packages/django/db/models/sql/compiler.py", line 1063, in execute_sql cursor.execute(sql, params) File "/...VENV3.5/lib/python3.5/site-packages/django/db/backends/utils.py", line 68, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/...VENV3.5/lib/python3.5/site-packages/django/db/backends/utils.py", line 77, in _execute_with_wrappers return executor(sql, params, many, context) File "/...VENV3.5/lib/python3.5/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) File "/...VENV3.5/lib/python3.5/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/...VENV3.5/lib/python3.5/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) django.db.utils.ProgrammingError: relation "postorius_emailtemplate" does not exist LINE 1: ...ext", "postorius_emailtemplate"."identifier" FROM "postorius... Cheers // David

3 4

Internal server error
by Andrew Bernard 09 Aug '19

09 Aug '19

My mailbox is filling up with dozens of notification of an internal server error. i wont post the whole mail as it is long, but here is the top: Internal Server Error: /archives/list/jackrail-meta(a)jackrail.org/recent-threads TypeError at /archives/list/jackrail-meta(a)jackrail.org/recent-threads 'datetime.date' object is not iterable Request Method: GET Request URL: https://list.jackrail.org/archives/list/jackrail-meta@jackrail.org/recent-t… Django Version: 2.1.9 Python Executable: /opt/mailman/mm/venv/bin/uwsgi Python Version: 3.7.3 What is causing this? [Assuming that knowing the cause will lead to me fixing it.] Andrew

2 1

Error in mailman3 debian package, python error
by Lars Schimmer 08 Aug '19

08 Aug '19

Hi! Mailman Core Version GNU Mailman 3.2.1 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.7.3 (default, Apr 3 2019, 05:39:12) [GCC 8.3.0] Since yesterday our mailman3 (debian package) throws this error: Internal Server Error: /mailman3/hyperkitty/api/mailman/archive OperationalError at /hyperkitty/api/mailman/archive (1366, "Incorrect string value: '\\xF0\\x9F\\x8D\\x8E' for column `mailman3web`.`hyperkitty_email`.`subject` at row 1") Request Method: POST Request URL: http://localhost/mailman3/hyperkitty/api/mailman/archive?key=zMxTGlteq4tqkL… Django Version: 1.11.22 Python Executable: /usr/bin/uwsgi-core Python Version: 3.7.3 Python Path: ['.', '', '/usr/lib/python37.zip', '/usr/lib/python3.7', '/usr/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Wed, 7 Aug 2019 08:03:47 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 101. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 250. self.errorhandler(self, exc, value) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in defaulterrorhandler 50. raise errorvalue File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 247. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 411. rowcount = self._do_query(q) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _do_query 374. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 292. _mysql.connection.query(self, query) The above exception ((1366, "Incorrect string value: '\\xF0\\x9F\\x8D\\x8E' for column `mailman3web`.`hyperkitty_email`.`subject` at row 1")) was the direct cause of the following exception: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/http.py" in inner 40. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in _decorator 69. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/csrf.py" in wrapped_view 58. return view_func(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in archive 115. add_to_list(mlist_fqdn, msg) File "/usr/lib/python3/dist-packages/hyperkitty/lib/incoming.py" in add_to_list 151. email.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save 808. force_update=force_update, update_fields=update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save_base 838. updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _save_table 924. result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _do_insert 963. using=using, raw=raw) File "/usr/lib/python3/dist-packages/django/db/models/manager.py" in manager_method 85. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py" in _insert 1079. return query.get_compiler(using=using).execute_sql(return_id) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py" in execute_sql 1112. cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py" in __exit__ 94. six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/lib/python3/dist-packages/django/utils/six.py" in reraise 685. raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 101. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 250. self.errorhandler(self, exc, value) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in defaulterrorhandler 50. raise errorvalue File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 247. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 411. rowcount = self._do_query(q) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _do_query 374. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 292. _mysql.connection.query(self, query) Exception Type: OperationalError at /hyperkitty/api/mailman/archive Exception Value: (1366, "Incorrect string value: '\\xF0\\x9F\\x8D\\x8E' for column `mailman3web`.`hyperkitty_email`.`subject` at row 1") Request information: USER: AnonymousUser Has anyone a idea what went wrong or howto fix it? MfG, Lars Schimmer -- ------------------------------------------------------------- TU Graz, Institut für ComputerGraphik & WissensVisualisierung Tel: +43 316 873-5405 E-Mail: l.schimmer(a)cgv.tugraz.at Fax: +43 316 873-5402 PGP-Key-ID: 0x4A9B1723

3 4

exposing Mailman3 API securely
by dancab＠caltech.edu 05 Aug '19

05 Aug '19

I'm working on a container based Mailman3 solution for my university. We have a help desk tool which needs to access the API remotely for creating and deleting Mailman lists. The API will be restricted to a private network, behind a firewall, etc. What is the simplest way to expose the API to an external host? At the moment, I seem to have this partially working via an Apache virtual host configuration which simply proxies via api.example.edu:80 to localhost:8001 on the container. I'm able to remotely use the mailmanclient module for the client.lists, client.system and client.members commands. However running client.domains generates an API connection error. So it seems unstable. Any thoughts or suggestions? Thanks. ---- Dan Caballero Systems Administrator Academic Computing Solutions IMSS - Caltech https://imss.caltech.edu

4 10

Replies unthreading
by Andrew Bernard 01 Aug '19

01 Aug '19

In my new list, I have a user - one of the foundation members, so an important use case - who will not be talked out of using a very old version of Eudora (!) for mail. Replies to threads from that mailer keep sometimes being properly threaded in Hyperkitty and then randomly jumping out into a new thread. This messes up the web view of the threads, and it's not right. Yet the threading appears to be correct in mail programs such as Thunderbird, using the email based interface to the list. Have others seen such behaviour with ancient mailers? Is it the mailer, or is there a known issue with threading the web interface? Looking carefully at message ID's and how they are threaded to examine the behaviour, I can't see what is causing this. Possibly some interaction with other RFC-822 headers? Andrew

3 3

Authenticating against Hyperkitty's DB
by Marvin Gülker 29 Jul '19

29 Jul '19

Hi, inspired by the question about LDAP, I want to ask a related question. We're currently thinking about adding a wiki to our small OSS project, and requiring users to have multiple accounts for the same project is nonsense. We don't have LDAP set up yet, but we do have a running Mailman 3 installation, including Hyperkitty. Thus I thought about whether it's possible to just write some glue script that authenticates against the user information in Hyperkitty's database. Creating an account for Hyperkitty would then be sufficient to get access to the wiki. Could someone give me a hint where and in what format Hyperkitty stores the user information into its database? Marvin -- Blog: https://mg.guelker.eu

2 6

Exim, Mailman3 and missing Message-ID:
by Robert Lister 29 Jul '19

29 Jul '19

Just a note that may help some people. After a bit of a learning curve, managed to get Mailman3 working in Debian 10 using the Debian package. I have mailman3-full + exim4 + apache2 setup: I did quite a lot of testing and getting it working, then when all seemed well, declared success and made it live. As (bad) luck would have it, the very first real message bounced: :-( 2019-07-25 20:53:09 1hqjnY-0005ms-RD <= xxxxxxx(a)ntlworld.com H=cloudi.spamtitan.com [52.26.55.167] P=esmtps X=TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256 CV=no S=7854 DKIM=ntlworld.com 2019-07-25 20:53:09 1hqjnY-0005ms-RD ** mylist(a)lentil.org R=mailman3_router T=mailman3_t H=127.0.0.1 [127.0.0.1]: LMTP error after DATA: 550 No Message-ID header provided 2019-07-25 20:53:09 1hqjnZ-0005mx-3F <= <> R=1hqjnY-0005ms-RD U=Debian-exim P=local S=9222 The user forwarded me the bounce, which contained the original message and headers, and indeed the original message did not contain a Message-ID: header. (Oddly, his message to me reporting the error using the same mail client DID contain a Message-ID: header.) Mail client: X-Mailer: Microsoft Outlook 16.0 So it seems in certain circumstances, Outlook doesn't put a Message-ID: header in its messages. The change from Mailman2.x to Mailman3 means it's now using LMTP to deliver to mailman instead of a local submission seems to have exposed this issue. Exim tries to be helpful for "locally submitted" messages: <https://www.exim.org/exim-html-current/doc/html/spec_html/ch-message_proces…> "12. The Message-ID: header line If a locally-generated or submission-mode incoming message does not contain a Message-ID: or Resent-Message-ID: header line, and the suppress_local_fixups control is not set, Exim adds a suitable header line to the message. If there are any Resent-: headers in the message, it creates Resent-Message-ID:. The id is constructed from Exim's internal message id, preceded by the letter E to ensure it starts with a letter, and followed by @ and the primary host name." However: "Note: Messages received over TCP/IP on the loopback interface (127.0.0.1 or ::1) are not considered to be locally-originated. Exim does not treat the loopback interface specially in any way." Therefore, Mailman3 using LMTP means exim will NOT "fix up" this problem before mailman3 receives the message. My solution for now (apart from telling people not to use old broken Outlook!) is to modify the exim mailman3_transport so that any message with a missing Message-ID: will have one generated by exim before it's passed to LMTP. This reproduces the same behaviour exim uses for locally submitted messages. (headers_remove ensures that we end up only with one Message-ID: header and not two, then we put back either the original Message-ID, or if that's not there, use Exim's ID to generate a new Message-ID header.) Here's an updated version of the example at: https://mailman.readthedocs.io/en/latest/src/mailman/docs/mta.html#exim # /etc/exim4/conf.d/main/25_mm3_macros # The colon-separated list of domains served by Mailman. domainlist mm_domains=list.example.net MM3_LMTP_PORT=8024 # MM3_HOME must be set to mailman's var directory, wherever it is # according to your installation. # debian default is /var/lib/mailman3 MM3_HOME=/opt/mailman/var MM3_UID=list MM3_GID=list ################################################################ # The configuration below is boilerplate: # you should not need to change it. # The path to the list receipt (used as the required file when # matching list addresses) MM3_LISTCHK=MM3_HOME/lists/${local_part}.${domain} # /etc/exim4/conf.d/router/455_mm3_router mailman3_router: driver = accept domains = +mm_domains require_files = MM3_LISTCHK local_part_suffix_optional local_part_suffix = \ -bounces : -bounces+* : \ -confirm : -confirm+* : \ -join : -leave : \ -owner : -request : \ -subscribe : -unsubscribe transport = mailman3_transport # /etc/exim4/conf.d/transport/55_mm3_transport mailman3_transport: driver = smtp protocol = lmtp allow_localhost hosts = localhost port = MM3_LMTP_PORT rcpt_include_affixes = true mailman3_transport: driver = smtp protocol = lmtp allow_localhost hosts = localhost port = MM3_LMTP_PORT rcpt_include_affixes = true headers_remove = message-id headers_add = "Message-ID: ${if def:header_message-id:{$h_message-id:}{<E${message_exim_id}@${qualify_domain}>}}"

4 6

import21 / hyperkitty_import: sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none()
by Christian Schwarz 29 Jul '19

29 Jul '19

Hi all, after upgrading from Mailman 2.1 to Mailman 3 (Debian Buster), one (but not all) of the lists causes the following exception. The list was imported using import21 and archives were imported using manage.py hyperkitty_import. Jul 29 10:19:43 2019 (761) REST request handler error: Traceback (most recent call last): File "/usr/lib/python3.7/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/lib/python3/dist-packages/mailman/rest/wsgiapp.py", line 216, in __call__ return super().__call__(environ, start_response) File "falcon/api.py", line 215, in falcon.api.API.__call__ File "falcon/api.py", line 189, in falcon.api.API.__call__ File "/usr/lib/python3/dist-packages/mailman/rest/lists.py", line 402, in on_get archiver_set = IListArchiverSet(self._mlist) File "/usr/lib/python3/dist-packages/zope/interface/interface.py", line 135, in __call__ adapter = self.__adapt__(obj) File "/usr/lib/python3/dist-packages/zope/interface/interface.py", line 151, in __adapt__ adapter = hook(self, obj) File "/usr/lib/python3/dist-packages/zope/component/_api.py", line 156, in adapter_hook return sitemanager.queryAdapter(object, interface, name, default) File "/usr/lib/python3/dist-packages/zope/interface/registry.py", line 348, in queryAdapter return self.adapters.queryAdapter(object, interface, name, default) File "/usr/lib/python3/dist-packages/zope/interface/adapter.py", line 353, in queryAdapter return self.adapter_hook(provided, object, name, default) File "/usr/lib/python3/dist-packages/zope/interface/adapter.py", line 363, in adapter_hook result = factory(object) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/mailinglist.py", line 607, in __init__ ListArchiver.name == archiver_name).one_or_none() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/query.py", line 3017, in one_or_none "Multiple rows were found for one_or_none()" sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none() I got that from the log file /var/log/mailman3/mailman.log. The Installation also sends emails to me, indicating some kind of exception in the except branch (see below). What can I do to debug this? Thanks, Christian --------------------------------------------- Internal Server Error: /postorius/lists/LISTNAMEREDACTED/ KeyError at /postorius/lists/LISTNAMEREDACTED/ 'file' Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in view 68. return self.dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/generic.py" in dispatch 65. return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in dispatch 88. return handler(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/list.py" in get 252. 'hyperkitty' in self.mailing_list.archivers and # noqa: W504 File "/usr/lib/python3.7/_collections_abc.py" in __contains__ 666. self[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __getitem__ 151. return self._get(key) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in _get 90. return self.rest_data[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 76. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 43. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 93. response = handle_uncaught_exception(request, get_resolver(get_urlconf()), sys.exc_info()) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in handle_uncaught_exception 135. extra={'status_code': 500, 'request': request}, File "/usr/lib/python3.7/logging/__init__.py" in error 1412. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.7/logging/__init__.py" in _log 1519. self.handle(record) File "/usr/lib/python3.7/logging/__init__.py" in handle 1529. self.callHandlers(record) File "/usr/lib/python3.7/logging/__init__.py" in callHandlers 1591. hdlr.handle(record) File "/usr/lib/python3.7/logging/__init__.py" in handle 905. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 118. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 246. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.7/tempfile.py" in __getattr__ 614. file = self.__dict__['file'] Exception Type: KeyError at /postorius/lists/LISTNAMEREDACTED/ Exception Value: 'file'

1 1

import21: ModuleNotFoundError: No module named 'Mailman'
by Christian Schwarz 29 Jul '19

29 Jul '19

Hi, I am migrating a Mailman 2.1 setup to Mailman 3 (Debian Buster). Most mailing lists can be imported successfully using the `import21` subcommand, as described in the docs. Some mailing lists fail with the following error: sudo -u list mailman import21 REDACTEDLIST(a)example.org /var/lib/mailman/lists/REDACTEDLIST/config.pck Traceback (most recent call last): File "/usr/bin/mailman", line 11, in <module> load_entry_point('mailman==3.2.1', 'console_scripts', 'mailman')() File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 69, in invoke return super().invoke(ctx) File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func return f(get_current_context(), *args, **kwargs) File "/usr/lib/python3/dist-packages/mailman/commands/cli_import.py", line 64, in import21 pickle_file, encoding='utf-8', errors='ignore') ModuleNotFoundError: No module named 'Mailman' Note again: most mailing lists of the installation work fine. And this particular pck file is fairly recently modified. Has this happened before? Any suggestions how to debug this? Thanks, Christian

2 3

Mailman 3 Installation Assistance
by brian＠emwd.com 26 Jul '19

26 Jul '19

I am making a serious attempt at installing Mailman 3 using docker. I have a CentOS 7 server setup via Linode. I am using the following documentation to setup a Mailman 3 server: https://xiaoxing.us/2018/01/02/Deploy-Mailman-3-on-AWS-using-Docker/ I have Docker, Postfix, and Nginx installed and working fine. The installation of the Mailman 3 container went fine. However I am getting the following error when I go to test Posterius via shell: curl http://172.19.199.3:8000/postorius/lists/ curl: (7) Failed connect to 172.19.199.3:8000; Connection refused I assume this has something to do with uwsgi which I have no experience with. Appreciate any assistance with getting Mailman 3 up and running. Thanks! Brian Carpenter

4 28

Ldap integration with Mailman 3
by sandeep kumar 18 Jul '19

18 Jul '19

Hi Team Is anyone using Ldap authentication for Mailman 3. It would be helpful if any such inputs -- Regards Sandeep Kumar +91-9642669192

1 0

Default posting pipeline
by Andrew Bernard 16 Jul '19

16 Jul '19

What is a posting pipeline, and what is the difference between detault-posting-pipeline and default-owner-pipeline and virgin? Where to read about this? Andrew

2 1

Delete a single email or thread from hyperkitty archive
by andrew.bernard＠gmail.com 15 Jul '19

15 Jul '19

How can one do this? Raw database access gets you involved in all the usual foreign key constraints. I don't know how to make use of this information: https://gitlab.com/mailman/hyperkitty/commit/6e3e6a5270f37543a757d76c0aee12… After a very large import of decades of data, I need to delete just one wrong mail that is corrupt. I think it is a valid case. I could run the import again after fixing the import mbox, but it takes many hours to load. Andrew

4 7

RHEL 7 + Mailman 3 : Need help and guidance
by vgandhi＠fdu.edu 15 Jul '19

15 Jul '19

Hi, We would like to use the latest Mailman 3 in our environment. We are planning to set up RHEL 7 virtual machine. I am trying to figure out best method (if possible - step-by-step guide) for installing and configuring Mailman3 on RHEL 7 . Can someone please provide me some guidance or point me in direction. Thank you.

4 5

Unable to get mailman3-full on Debian
by Frank Yappa 15 Jul '19

15 Jul '19

When trying apt-get install on Debian, I get E: Unable to locate package mailman3-full. What am I doing wrong? I have run apt-get update.

3 2

unable to un-subscribe
by Steven Jones 13 Jul '19

13 Jul '19

Please fix / unsubscribe me, thanks regards Steven

1 0

How to see post headers
by Andrew Bernard 13 Jul '19

13 Jul '19

Once a post has gone into Hyperkitty, how can I see the full mail headers? Andrew

3 5

Looking for large sites that have migrated to mailman3
by ssw＠washington.edu 10 Jul '19

10 Jul '19

Hi. We're looking for information on large sites that have migrated to mailman3. Preferably academic institutions. As we start to look at a migration project we're hoping to hear any 'lessons learned' from those who have gone before us. (Sorry if this information is already posted somewhere, I wasn't able to find it) Thanks, Steve Mats Mats Software Engineer Academic & Collaborative Applications - UW-IT University of Washington Seattle, Washington

3 2

List nonmembers
by Andrew Bernard 09 Jul '19

09 Jul '19

Under Users for a list, there is a category for List nonmembers. What does this term mean? [It's rather curious philosophically when you think about it, because I would have thought that the category [all humans - list members] fits that category term.] But seriously, I don't understand it. I have several email addresses there and I don't know what do with them, if anything. Andrew

4 5

delete examples.com site
by enrique.terrazas＠utsa.edu 09 Jul '19

09 Jul '19

Hello, I've been working on setting up Mailman3 on a RHEL 7.5 vm using the guides and documentation found here: http://docs.mailman3.org/en/latest/index.html https://mailman.readthedocs.io/en/latest/README.html http://docs.mailman3.org/projects/postorius/en/latest/index.html http://docs.mailman3.org/projects/mailmanclient/en/latest/README.html https://hyperkitty.readthedocs.io/en/latest/index.html https://gitlab.com/mailman/mailman-hyperkitty nginx is serving the Django applications via uwsgi. I was able to get mailman, postorius + hyperkitty, running and test sending out email verifications. In an attempt to set the default domain to something other than example.com I deleted the site: example.com, I did have another site. Unfortunately, this seems to have broken the Django applications. At the moment I am preparing to delete the virtual environment and set things up again. Unless there is something that can be done in the current virtual environment to "reset" things back to start. I was also running into an issue where the verification emails were successfully sent out. The url to verify the email looks like this: http://my.domain.com:8000/accounts/confirm-email/xxxxxxxxxxxx/ Replacing my.domain.com with the domain I added. How can I get the outgoing verification emails to not reference port 8000? If I take that same link and remove the port, I get the desired page. Port 8000 is blocked at our sites permitter firewall, I don't necessarily want to open it. I'd rather the URL just obfuscate the port and send it to https... Thank you in advance for your attention and assistance. Best regards, Enrique J. Terrazas

3 4

HTML post only showing as attachment
by andrew.bernard＠gmail.com 08 Jul '19

08 Jul '19

I have a post come in that is in HTML and has an image attached. It is distributed fine to email subscribers. Hyperkitty shows a blank message, with the in an html attachment, and the image as a jpg attachment. Why doesn't the text show in Hyperkitty? So far, all other messages display correctly. Andrew

2 2

Rich Text support in Hyperkitty
by Abhilash Raj 08 Jul '19

08 Jul '19

Hi All, I have been recently working on adding rich text support through markdown in Hyperkitty so that emails can be made easier to read. The core design idea in my mind when working on this was building something that doesn't bother writers of plain text emails too much, but allows people to write emails in markdown. The supported syntax is limited Markdown, for example: Hyperkitty's Markdown Syntax ============================ - List items are supported - Even nested ones - Headers with `#` aren't supported, mostly due to their widespread use as comments in code shared on mailing lists. - You can **emphasize** text and _itcalize_ them too - Block code and `inline code` works. - URLs work like they usually do. - Images _do work_, but are disabled by default because of their potential for tracking users. They need to be enabled by administrators through a configuration flag. ``` def sample(): return "yay" ``` While text intentionally written for Markdown rending looks pretty good, plain text sometimes isn't as good. I have applied my branch[1] on both the Mailman installations for these two lists (mail.python.org & lists.mailman3.org). Any feedback or bug reports on weird looking stuff is welcome here or directly [on my PR][1] [1]: https://gitlab.com/mailman/hyperkitty/merge_requests/160 -- thanks, Abhilash Raj (maxking)

4 9

Mandatory First and Last Name
by andrew.bernard＠gmail.com 08 Jul '19

08 Jul '19

Is there a way to make the profile require users to fill out their name? Andrew

3 3

Odd hold message
by Andrew Bernard 08 Jul '19

08 Jul '19

I received a very simple post today that was held with the following reason: The message is being held because: Message contains administrivia At your convenience, visit your dashboard to approve or deny the request. What is this all about? What does Mailman consider to be administrivia, of all things, and why is this a reason to hold a message? The only thing in the message I can see is that it mentioned '100 members'. Is Mailman becoming sentient and developing an attitude? Seriously, I'd like to know more about this. Andrew

2 2

Images and rich content in hyperkitty
by andrew.bernard＠gmail.com 07 Jul '19

07 Jul '19

I see discussion about this topic here in July. My immediate interest is that I had hoped to move from an antique plain-text only list to modern list software that will support content such as inline images (partly to staunch the flow of subscribers to facebook, simply to be able to post pictures.) Does hyperkitty support this, and where can one read about that? Andrew

3 2

Post confirmation
by andrew.bernard＠gmail.com 07 Jul '19

07 Jul '19

Some mailing lists have an intermediary step where when the user posts, an email is received frm the server asking them to confirm posting, or discard it. Some of my users feel this gives them the chance to not post something they may have composed in error, or regret, or changed their mind about something. Is it possible to configure this behaviour (I think from Listserv) in Mailman? Andrew

2 1

Hyperkitty message threading
by andrew.bernard＠gmail.com 07 Jul '19

07 Jul '19

I am seeing some anomalies with message threading. without going into detail about the symptoms, first le me ask how does Hyperkitty thread messages? Is it based on the message-id in the header, guaranteed unique, or on the subject header? I appear to have a situation where people reply to a message, and then probably thinking to start a new thread, change the subject field., and them post. The message goes to the original thread. I cant stop people doing this as it seems the vast majority of people all over just hit reply for most things anyway as they are generally too lazy to start a new mail (drives me nuts). With this situation, where the subject has apparently been changed, Hyperkitty adds a not to the top of the post "New subject ...' which is what makes me think the message id is involved. Some of my subscribers say they do this all the time on the old Listserv mailing list and a new thread is started. Any help would be appreciated. It's difficult fro me to manually ressign the incorrectly threaded replies as there is no parent message to attach them to. Andrew

3 3

Show number of subscribers
by andrew.bernard＠gmail.com 04 Jul '19

04 Jul '19

Would there be a way to show the number of subscribers to a list in the web UI? The number of participants per message is great, but this would be good too. My users seem very interested in this number. I guess they want to know how big the audience is that is reading their posts. Andrew

4 3

opt in/out for hidden lists
by mailman3＠malevil.cc 04 Jul '19

04 Jul '19

Is it possible to change the default value for list visibility? Sometime when my list admins create a new list they forget to check that they should be hidden, I think that should be the default value anyway because its a potentially security issue when a list is unwanted visible...

2 1

Documentation for users for Mailman 3
by andrew.bernard＠gmail.com 04 Jul '19

04 Jul '19

There exists this: https://wiki.list.org/DOC/Mailman%202.1%20Members%20Manual I cant find a version for Mailman 3. Does it exist? If not, i will volunteer to write/update it. Let me know. Andrew

3 2

Waht are all these messages
by andrew.bernard＠gmail.com 30 Jun '19

30 Jun '19

My log is flooded with messages like this, with apparent IP address in them: [pid: 1014|app: 0|req: 228/228] 148.251.78.18 () {38 vars in 865 bytes} [Sun Jun 30 13:26:10 2019] GET /accounts/login/?next=/archives/list/jackrail(a)jackrail.org/thread/E5WNO25XQV74CIV4QS7MQ32EZ5EWKLQ7/ => generated 7658 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 331 bytes (1 switches on core 1) What are these? The flow is continuous, many different IP addresses? Andrew

1 1

Reset digest number and volume
by andrew.bernard＠gmail.com 29 Jun '19

29 Jun '19

How to do this? After lots of testing on my pre-release beta testing list, I want the first production digest to be reset toVolume 1, Number 1. Andrew

3 3

Monthly job failure
by andrew.bernard＠gmail.com 26 Jun '19

26 Jun '19

I see this error oin startup: 3:22:11 [Q] INFO Process-1:1 processing [rebuild_mailinglist_cache_for_month] 13:22:11 [Q] ERROR Failed [rebuild_mailinglist_cache_for_month] - MailingList matching query does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7.egg/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/tasks.py", line 79, in _rebuild_mailinglist_cache_for_month mlist = MailingList.objects.get(name=mlist_name) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.mailinglist.MailingList.DoesNotExist: MailingList matching query does not exist. Latest build versions of everything. Any pointers? Andrew

3 7

SECRET_KEY is not defined. Aborting.
by Steven Jones 26 Jun '19

26 Jun '19

8><--- root@debian-mailman-001:/opt/mailman/docker-mailman# docker run maxking/mailman-web:0.2 SECRET_KEY is not defined. Aborting. root@debian-mailman-001:/opt/mailman/docker-mailman# 8><--- I keep getting this, I have attempted to set a SECRET_KEY in /opt/mailman/web/settings_local.py and, docker-compose.yaml No joy, can you tell me how I set this variable? or where I get it from? is it pre-generated somewhere? your documentation just does not explain this that I can find, despite even a lot of time googling. PS I have assumed the hyprekitty key is something I set myself, just like a manual password sort of thing, again there is no explanation I can find that explains how to do this properly either. Can this documentation be improved please. To get anywhere at all I finally found this, https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ So I have core running OK I think, ====== root@debian-mailman-001:/opt/mailman/docker-mailman# docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 99f434ef3664 maxking/mailman-core:0.2 "docker-entrypoint.s…" 2 hours ago Up About an hour 8001/tcp, 8024/tcp mailman-core 4c0e165d3a90 postgres:9.6-alpine "docker-entrypoint.s…" 2 hours ago Up About an hour 5432/tcp dockermailman_database_1 root@debian-mailman-001:/opt/mailman/docker-mailman# ====== regards Steven

2 2

Confirmation for subscriptions
by andrew.bernard＠gmail.com 24 Jun '19

24 Jun '19

Suddenly stopped working. For all the lists I have created, suddenly the confirm setting is ignored for subscriptions and users are subscribed right away. This only happened after I added another domain - surely that can't be the cause? Where to look to troubleshoot this? Andrew

3 5

Unable to download attachments from HyperKitty
by Derek Lambert 24 Jun '19

24 Jun '19

I’m having an issue downloading attachments from HyperKitty. The download begins as expected, but never progresses. Eventually it times out. I imagine the browser is expecting data matching the content-length header, but never receives it. Inspecting the contents of the download file reveals (address varies): <memory at 0x7f148fcb9588> I’ve been able to work around the issue with the following patch: --- env/lib/python3.7/site-packages/hyperkitty/models/email.py.orig 2018-12-06 21:38:39.544448735 +0000 +++ env/lib/python3.7/site-packages/hyperkitty/models/email.py 2018-12-06 23:01:39.923239421 +0000 @@ -309,7 +309,7 @@ def get_content(self): folder = self._get_folder() if folder is None: - return self.content + return self.content.tobytes() filepath = os.path.join(folder, str(self.counter)) if not os.path.exists(filepath): logger.error("Could not find local attachment %s for email %s", I haven't been able to replicate the issue with the HyperKitty tests, presumably the issue is somewhere in the Django <-> uwsgi <-> nginx stack. My configs are based on mailman-suite and maxking/docker-mailman. I've tried stripping out all the performance tweaks from my uwsgi and nginx configs, but no change. Versions: HyperKitty 1.2.1 Postorius 1.2.3 Django 2.1.7 nginx 1.14.1 uwsgi 2.0.18 Python 3.7.2 Has anyone come across this before? Derek Lambert

5 6

Unwanted indent on first line of post in hyperkiity
by andrew.bernard＠gmail.com 23 Jun '19

23 Jun '19

I don't want hyperkiitty adding an unasked for indent on the first line of all posts. How can one turn that off? Andrew

2 1

Mail not going out
by andrew.bernard＠gmail.com 22 Jun '19

22 Jun '19

What process handles the sending of the mail out to subscribers? My new installation suddenly stopped sending. Apologies for so many newbie questions. Andrew

2 1

How to download attachments from hyperkitty
by andrew.bernard＠gmail.com 22 Jun '19

22 Jun '19

Not working - download just waits forever after a few bytes in the browser. Could it be that you have to set hyperkitty to store attachments in the filesystem, and configure uwsgi to serve them as static files? Is that what the hyperkitty setting HYPERKITYY_ATTACHMENT_FOLDER is for? If this is so, can anybody show the fragment of uwsgi configuration required? Andrew

1 1

change preferred language of list
by mailman3＠malevil.cc 22 Jun '19

22 Jun '19

hey, I am not very experienced with the mailman shell and configuration. I configured mailman using the mailman.cnf and I know that I can use "mailman conf" to get all the parameters. But now I would like to change the preferred language of a list. Because despite I set [mailman] default_language: de even new lists will still have "en" as preferred language. I checked this just by reading the $language variable in a list template. How can I change the list parameters and how can I make mailman to use the german language files? I found the files, so I know they exist, but still need to make mailman use them...

3 8

join via webform
by mailman3＠malevil.cc 21 Jun '19

21 Jun '19

Is there a simple possibility to join a mailinglist besider writing a mail to list-join(a)example.com? I know you can register and then join a list, but thats only possible for public lists and I would like to have such a very simple webform for a specific list where you just enter your email address and then get the confirmation mail. I guess there was something like this with mailman2

2 5

Please help - Held message is crashing mailman.
by Alex King 21 Jun '19

21 Jun '19

Hi, I've used mailman a lot in the past, and decided to install mailman3 in a recent install. I'm unimpressed so far, it seems buggy. Running on Ubuntu 18.04.2 LTS from packages, mailman3 3.1.1-9, mailman3-web 0+20170523-14, python-django-postorius 1.1.2-3. After a few messages, I now can't go to the "Held Messages" in postorius, I get a 500 error. I tried to interact on the command line, but could not work out how. Reading https://mailman.readthedocs.io/en/latest/src/mailman/docs/install.html and https://mailman.readthedocs.io/en/latest/src/mailman/commands/docs/shell.ht…, I tried: # mailman shell Welcome to the GNU Mailman shell >>> command = cli('mailman.commands.cli_withlist.shell') Traceback (most recent call last): File "/usr/lib/python3.6/code.py", line 91, in runcode exec(code, self.locals) File "<console>", line 1, in <module> NameError: name 'cli' is not defined I did a lot of reading of the manual and googled, but I have no idea where the cli object is supposed to come from.....? The documentation is confusing. Anyway, after some trial and error, i found: # mailman shell Welcome to the GNU Mailman shell >>> list_manager = getUtility(IListManager) >>> m=list_manager.get("committee(a)[redacted].org") >>> from mailman.interfaces.requests import IListRequests >>> requests = IListRequests(m) >>> [x for x in requests.held_requests][0].id 8 >>> requests.get_request(8) Traceback (most recent call last): File "/usr/lib/python3.6/code.py", line 91, in runcode exec(code, self.locals) File "<console>", line 1, in <module> File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/requests.py", line 120, in get_request result.data_hash, expunge=False) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/pending.py", line 138, in confirm value = json.loads(keyvalue.value) File "/usr/lib/python3.6/json/__init__.py", line 354, in loads return _default_decoder.decode(s) File "/usr/lib/python3.6/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.6/json/decoder.py", line 355, in raw_decode obj, end = self.scan_once(s, idx) json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 1 (char 0) It seems something was written out to disk that can't be read in for some reason (assuming a json object on disk?) How do I debug this further? How do I find the json being decoded? Any help would be appreciated. (I found mailman2 just worked, I was happy with that.) (My colleague posted a bug about this I believe but I don't have the link to that.) Thanks, Alex

3 3

mass invitation
by mailman3＠malevil.cc 20 Jun '19

20 Jun '19

in postorius there is just the option to make a mass subscription, in mailman2 there was also the possibility to just invite users, so they need to click a link when they really want to join the list. Is this also available in mailman3/postorius?

3 2

Importing mbox files into hyperkitty since date
by andrew.bernard＠gmail.com 20 Jun '19

20 Jun '19

What is the syntax for the data in the --since argument to hyperkitty_import> --since SINCE SINCE is not very informative. :-) Guessing, using '1/1/1970' does not seem to achieve anything, and gives no error.

2 3

Hyperkitty Archives - Sidebar years/months
by Enrique Terrazas 20 Jun '19

20 Jun '19

Hello, I’m going through importing archives from mm2 to mm3. One of the lists I’ve imported has messages going back to 11/2013. I was able to successfully import the lists settings using: mailman import21 lists(a)domain.com<mailto:lists@domain.com> /path/to/list/config.pck This successfully imported lists owners, moderators, subscribers, & settings. I then imported the messages with the following command: python /path/to/manage.py hyperkitty_import -l list(a)domain.com<mailto:list@domain.com> /path/to/list.mbox —since 10/01/2013 I used that date because it is older than the first message sent to the list: 11/13/2013 And followed that up with the update index command: python /path/to/manage.py update_index_one_list list(a)domain.com<mailto:list@domain.com> This successfully imported all the messages from 11/13/2013 through 09/30/2018. Here is where I’m facing two issues: * Messages from October 2018 were not imported * The sidebar only shows the year 2018. Fdasfds If I modify the URL to go to https://my.domain.org/hyperkitty/list/list@domain.com/2013/11 the archived emails show up fine. October 2018 shows two test messages I’ve sent but not any of the messages from October 2018 that should have been imported. Is there something additional that needs to be done to show the previous years and months in the sidebar? Thanks, Enrique

4 5

Flushing/syncing hyperkitty with mailman
by Eric Abrahamsen 20 Jun '19

20 Jun '19

I've got mailman running on Ubuntu 14.04, with systemd service files to govern the mailman and hyperkitty qcluster processes. I notice in the systemctl status call for the qcluster command that there are a bunch of errors like: [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. [Q] INFO Process-1:1 processing [rebuild_email_cache_votes] [Q] ERROR Failed [rebuild_email_cache_votes] - Email matching query does not exist. [Q] INFO Process-1:2 processing [rebuild_thread_cache_votes] [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. [Q] INFO Process-1:3 processing [rebuild_email_cache_votes] [Q] ERROR Failed [rebuild_email_cache_votes] - Email matching query does not exist. [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. Is there something more I should be doing to sync hyperkitty's database with mailman? I've got the crontab file in place, and that appears to be running without error. Anything else? Thanks, Eric

4 5

Django error - External IP
by andrew.bernard＠gmail.com 20 Jun '19

20 Jun '19

I am seeing this error frequently: Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/list/jackrail(a)list.jackrail.org/message/new Internal Server Error: /archives/list/jackrail(a)list.jackrail.org/message/new Error at /archives/list/jackrail(a)list.jackrail.org/message/new error 14 from memcached_get(:2:User:11:subscriptions) Request Method: GET Request URL: https://list.jackrail.org/archives/list/jackrail@list.jackrail.org/message/… ... followed by many many pages of settings information, none of which is informative to me. What does this signify? I am trying to bring my list to a go live state, but this does not bode well. I can send the full diagnostic (long) if need be. Andrew

2 2

problems in setting up mailman3 containers.
by Steven Jones 20 Jun '19

20 Jun '19

Hi, Trying to setup the 2 mailman3 containers, they fail to start, config and failure messages are, ======== [root@rhel8-svr-001 mailman]# pwd /opt/mailman [root@rhel8-svr-001 mailman]# !269 more core/mailman-extra.cfg # mailman-extra.cfg [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 172.19.199.2 lmtp_port: 8024 smtp_host: 172.19.199.1 smtp_port: 25 configuration: /etc/postfix-mailman.cfg [mailman] site_owner: steven(a)xx.co.nz SECRET_KEY: testing123 [root@rhel8-svr-001 mailman]# !271 more web/settings_local.py SECRET_KEY: testing123 [root@rhel8-svr-001 mailman]# !272 podman run mailman-core DATABASE_URL is not defined. Using sqlite database... No MTA environment variable found, defaulting to Exim HYPERKITTY_API_KEY not defined, please set this environment variable... exiting... [root@rhel8-svr-001 mailman]# !273 podman run mailman-web SECRET_KEY is not defined. Aborting. [root@rhel8-svr-001 mailman]# ========= Could really do with some examples of these files as well... regards Steven

2 1

join via webform
by mailman3＠malevil.cc 19 Jun '19

19 Jun '19

Is there a simple possibility to join a mailinglist besider writing a mail to list-join(a)example.com? I know you can register and then join a list, but thats only possible for public lists and I would like to have such a very simple webform for a specific list where you just enter your email address and then get the confirmation mail. I guess there was something like this with mailman2

1 0

howto reallow a banned email ?
by Nicolas Pettiaux 19 Jun '19

19 Jun '19

Hello, By mistake a user has been banned to post to mailman list. How can I allow him not only to post but also to become a member of a list ? I have not found any info on the web, or I have been unable to search correctly. Much thanks, Nicolas -- Nicolas Pettiaux - PhD - nicolas(a){educode,pettiaux}.be - Président de Educode asbl Informer, former et susciter la réflexion des acteurs du monde de l'enseignement face aux évolutions d'un monde numérique - http://2019.educode.be & http://2018.educode.be

2 4

Do not show archives to public
by andrew.bernard＠gmail.com 19 Jun '19

19 Jun '19

Is there a way to have list archives only visible to list subscribers? Presently, they are world visible - unless I have configured my site incorrectly.

4 3

Domain owner functionality?
by Derek Lambert 14 Jun '19

14 Jun '19

I noticed there's a "domain_owners" table in the mailman core database. If I add a user and domain id to this table will it grant the user owner permissions for all lists in a domain? Will they be able to create lists? Thanks! Derek

2 1

Invalid FilterAction: discard. Treating as discard
by Henrik Rasmussen 12 Jun '19

12 Jun '19

Having set the Filter content to Yes - regardless of other setting in the "Alter Messages" tab, make a HTML message come out empty. I can replicate this on my test list. I have tried debugging by changing each setting one-by-one and sending the user's mail, but no change makes the mail come out with a content. However setting "Filter content" to "no" makes the mail come out okay. With "Filter content" set to "Yes", sending another HTML mail is okay, so something in the user's mail may not be right, but I wonder why setting "Filter content" to no "solves" the problem. Afte all this setting is switching all other settings on and off, so I can't just ask the user to turn it off. May 06 11:53:32 2019 (33) ACCEPT: <250E794B36C1E646AF3D81E1F15348C79DA8CA83(a)P2KITMBX06WC03.unicph.domain> May 06 11:53:32 2019 (37) [LISTNAME](a)lists.example.com invalid FilterAction: discard. Treating as discard May 06 11:53:32 2019 (37) <250E794B36C1E646AF3D81E1F15348C79DA8CA83(a)P2KITMBX06WC03.unicph.domain> discarded by "default-posting-pipeline" pipeline handler "mime-delete": After content filtering, the message was empty May 06 17:27:35 2019 (33) ACCEPT: <250E794B36C1E646AF3D81E1F15348C79DA8CAEC(a)P2KITMBX06WC03.unicph.domain> May 06 17:27:35 2019 (37) [LISTNAME](a)lists.example.com invalid FilterAction: discard. Treating as discard May 06 17:27:35 2019 (37) <250E794B36C1E646AF3D81E1F15348C79DA8CAEC(a)P2KITMBX06WC03.unicph.domain> discarded by "default-posting-pipeline" pipeline handler "mime-delete": After content filtering, the message was empty /Henrik Rasmussen

2 9

Postorius performance with over 1000 pending users
by Nick W 11 Jun '19

11 Jun '19

I've got a couple things I need help with: The Symptom and The Problem. The Symptom: Postorius has gotten quite slow to load, taking more than 30s to load the Subscription Requests tab. Having zero pending subscription requests (I'm on v1.2.5), I started investigating unconfirmed subscriptions. I followed the commands from here[1] and got this: mailman shell -l your.list.id util = getUtility(IPendings) print(len(list(util.find(mlist=m,pend_type='subscription')))) 1816 Wow, 1816 pending subscription requests. I can say for certain that my list is not popular so these requests must have been submitted by bots. Let's get there in The Problem. How can I "purge" this list? I'm willing to assume that none of these requests are valid and would reject all unconfirmed user requests. The Problem: How might this activity be happening? Running cat /opt/mailman/core/var/logs/mailman.log | grep POST returns a lot of 202 and 409 responses for `POST /3.1/members`. Could it be that these requests are being submitted through Postorius? I'd assume there would be some sort of honeypot input to prevent abuse. I'll continue investigating and follow up with any insight I can on the cause of The Problem. Thanks, Nick [1]: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…>

3 4

WSGI: gunicorn and uwsgi
by andrew.bernard＠gmail.com 09 Jun '19

09 Jun '19

Using the Ubuntu 19 packages for all the mailman suite, uwsgi is the Python WSGI server included. I have now switched over to a full build from current source from gitlab, following Mark Sapiro's excellent instructions. It would appear that the current code has the use of gunicorn built in. Is gunicorn the preferred way now to run the mailman Django apps? Is it worth spending time converting everything to use uwsgi, or should I go with the flow and use gunicorn? What are the advantages of gunicorn over uwsgi?

2 1

Help with installing Postorius and Hyperkitty on Ubuntu 19
by andrew.bernard＠gmail.com 09 Jun '19

09 Jun '19

I'm new to Mailman. I have a Ubuntu 19 production server. I attempted to get Mailman 3 and the web components going with the system packages, but I encountered a few showstopper errors (such as indexing not working at all) which I know have been fixed in the codebase. To that end I erased my installation, and installed mailman from the gitlab source. That all works much more nicely now and I feel I have a lot more control of the layout of all the files (the various Ubuntu packages smear the parts all over the place, confusingly). Now I want to get Postorius and Hyperkitty going again, independently of Ubuntu packages. I would like to run Postorius and Hyperkitty under one Django project. So I downloaded the git source for mailman_web. I do not know if this is the right way to install. I am partially familiar with Django, but to come to the point, I have no idea once having obtained the source from git how to setup and install the project, where it lives in the filesystem, and so on. Are there any pointers to help in this area? The very nice readthedocs format files for Postorius and Hyperkitty are very silent on basic matters like this, which is not of much help! The git README files also define a new level of brevity. I need some initial hand holding here. If any help is forthcoming, such as links to more full documentation for newbies to Mailman, I would be most grateful.

4 6

Daily Cronjob fails
by Stefan Tatschner 08 Jun '19

08 Jun '19

Hey hey, I applied a recent Update from Debian Buster, und this night a received an email about a failing cronjob. The traceback can be reproduced using: # sudo -u www-data flock -n /var/run/mailman3-web/cron.daily /usr/share/mailman3-web/manage.py runjobs daily ERROR OCCURED IN DAILY JOB: sync_mailman (APP: hyperkitty) START TRACEBACK: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) psycopg2.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (2, hb-events(a)hackbrettl.de, hb-events, null, [hb-events] , 1, 2015-10-22 09:54:53.684306+00, hb-events.hackbrettl.de). The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_extensions/management/commands/runjobs.py", line 36, in runjobs job().execute() File "/usr/lib/python3/dist-packages/hyperkitty/jobs/sync_mailman.py", line 35, in execute sync_with_mailman() File "/usr/lib/python3/dist-packages/hyperkitty/lib/mailman.py", line 131, in sync_with_mailman mlist.update_from_mailman() File "/usr/lib/python3/dist-packages/hyperkitty/models/mailinglist.py", line 192, in update_from_mailman self.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 808, in save force_update=force_update, update_fields=update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 838, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 905, in _save_table forced_update) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 955, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 667, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1204, in execute_sql cursor = super(SQLUpdateCompiler, self).execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 899, in execute_sql raise original_exception File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 889, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/lib/python3/dist-packages/django/utils/six.py", line 685, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) django.db.utils.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (2, hb-events(a)hackbrettl.de, hb-events, null, [hb-events] , 1, 2015-10-22 09:54:53.684306+00, hb-events.hackbrettl.de). END TRACEBACK Appearently there is something wrong with the database. Is there anything what I can do about this? Running the migrations doesn't help: # sudo -u www-data flock -n /var/run/mailman3-web/cron.daily /usr/share/mailman3-web/manage.py migrate Operations to perform: Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, sessions, sites, socialaccount Running migrations: No migrations to apply. Thanks! Stefan

3 3

Import Archives using Docker Image
by brian＠emwd.com 07 Jun '19

07 Jun '19

I want to test out importing a 2.1 archive into a Mailman 3.2 list. I am using maxking's docker images for MM3. How would I go about importing the mbox file? I don't think the following commands would work on a Docker installation of MM3: $ python manage.py hyperkitty_import -l foo-list(a)example.com $var_prefix/archives/private/foo-list.mbox/foo-list.mbox $ python manage.py update_index_one_list foo-list(a)example.com I am not sure how to go about doing this within Docker. Thanks for any assistance, Brian

2 2

Hyperkitty Authorization Required
by andrew.bernard＠gmail.com 06 Jun '19

06 Jun '19

Nearly there configuring my first Mailman 3 installation with Postorius and Hyperkiity. This issue eludes me: When trying to start a new thread in the archive, we have: HyperKitty failure on https://list.jackrail.org/hyperkitty/api/mailman/archive: <html><title>Auth required</title><body> <h1>Authorization Required</h1></body></html> (401) I can access this URL just fine" https://list.jackrail.org/hyperkitty/api/ Where do we look to solve this issue?

4 3

Hope for Mailman 3.X in cPanel
by Cold Kayak 06 Jun '19

06 Jun '19

Hi, it appears that cPanel is interested in supporting MailMan 3.X! See - https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870 <https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870> "We’re hoping to work with the Mailman folks at some point in the future to accomplish this goal." Hopefully this happens sooner than later. regards, Edmond

2 1

Changing default message limit (max_message_size)
by roger＠reasonal.com 30 May '19

30 May '19

Right, me again. I'm so close to having what I need up and running ... but a showstopper is the max message size that triggers a moderate in it. 40kB these days is just way small ... unless you're a 1% using text-only email. So found this on list archive: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… $ bin/mailman shell -l list(a)example.com // Welcome to the GNU Mailman shell // The variable 'm' is the list(a)example.com // mailing list m.max_message_size = nn // commit() Unfortunately this does not work in the containerised mailman. So I get the container ID and run: docker exec 3373d426996d /usr/local/bin/mailman shell -i test-list(a)iotcouncil.org.za (in the post by Mark it says "-l" but I get "unrecognized argument" -- I assume it should be -i for "interactive"? Either way, it fires up the mailman shell and then throws me straight out back to the command line: Welcome to the GNU Mailman shell The variable 'm' is the test-list(a)iotcouncil.org.za mailing list >>> [root@listman ~]# So that doesn't help...

3 7

Bug - if you change primary email address, you're "semi-subscribed"
by roger＠reasonal.com 30 May '19

30 May '19

Subscribed to the list, sending mails worked. Changed primary email (my company email system adds branding crap that exceeded the 40k limit). Then mails to list simply vanished. Sent mail via UI, suddenly get a "welcome to list" and held message says "The message comes from a moderated member".

3 4

Re: Bug - if you change primary email address, you're "semi-subscribed"
by Roger Hislop 30 May '19

30 May '19

Testing if emails are being delivered to the list …

1 0

How to separate bans for sending emails to lists and subscribing to them
by Nathan Dixon 29 May '19

29 May '19

Hi, Our requirements for using Mailman are that we can have non-members send an email to a list from any domain name, but only people who's email addresses match a list of specific domains should be able to actually subscribe to those lists. I can't seem to find any way of doing this. Any ideas? I have tried using the bans (global and on each list) but these appear to stop all subscriptions and emails being sent to or from a list if the address matches a ban. Having moderated list subscriptions seems to be the only workaround, but this wouldn't be great if we could automate it (we are currently using Listserv which does allow us to do this) Thank you, -- *Nathan Dixon* MEng Senior Software Architect

2 1

update_index_one_list in parallel?
by Szymon Sokół 29 May '19

29 May '19

Hello, I am new to this list. Last week I upgraded my old Mailman 2.1 site (running since 2011) to Mailman 3.2.1; wasn't quite straightforward, and part of the blame goes to people who made the choice of using sqlite as default database backend for mailman3-full Debian package, but finally I have it running with PostgreSQL, which I should've been using from the beginning. Now, however, I have noticed that indexing my archives in hyperkitty (using "manage.py update_index_one_list" for each list in sequence) takes quite a lot of time while using only one CPU (out of 4). Hence my question - is it safe to run several such processes in parallel, and if so, will it have any benefits? I have no idea how locking on the database is done in this code, maybe I'll end up running the jobs in sequence anyway due to exclusive locks… Any informed answers will be appreciated.

3 2

What to backup?
by Alain Kohli 28 May '19

28 May '19

Hi What exactly are we supposed to include in our mailman backups? Obviously the database, but are there any other files that should be included to make sure we can properly restore? Regards, Alain

2 8

Hyperkitty CPU usage
by Alain Kohli 24 May '19

24 May '19

Hi I have hyperkitty running and noticed that the process 'python manage.py runjobs minutely' is running for over 70h now and is constantly using 100% of a CPU core. That can hardly be intended, but I don't know why it's doing that. As far as I could see, this job mainly updates the search index. Running 'python manage.py rebuild_index' only takes about an hour, though, so I don't see why this would take so much longer. The text search is not working in the first place, so that might be connected as well. I'm currently running the v1.2.2. Regards, Alain

3 9

Changing Mailman's "from" domain - redux
by roger＠reasonal.com 23 May '19

23 May '19

(this is a posting directly into this web ui as mails to this list just vanish without a trace) -- Anyone? Anyone? With reference to the original mail here https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… It seems that the "From" domain field is set by Postorius, but I can't find anything in its documentation on how to change it. I've done obvious things like change the boxes hostname to what I want, have fiddled around in the various Postfix settings for mydomain, etc etc. But all admin messages, listserver replies etc come from the partial domain "blah.blah", not "listman.blah.blah". Any ideas welcome.

2 1

Changing Mailman's "from" domain
by Roger Hislop (IS) 23 May '19

23 May '19

Hi guys -- I'm a little baffled here... I'd got my Mailman instance running, then went on leave, and then tried to use it. No dice. If I subscribed an address, no confirmation email would come through. Checked the Postfix log and see this: Roger Hislop (IS) Executive Head - IOT T +27 11 5751600 M+27 78 4595952 May 16 14:34:50 ip-172-31-23-250 postfix/smtp[5025]: 15B87A35FB: to=<iotic-za(a)reasondigital.co.za>, relay=email-smtp.eu-west-1.amazonaws.com[52.51.155.83]:587, delay=0.22, delays=0.01/0.02/0.1/0.1, dsn=5.0.0, status=bounced (host email-smtp.eu-west-1.amazonaws.com[52.51.155.83] said: 554 Message rejected: Email address is not verified. The following identities failed the check in region EU-WEST-1: test-list-request(a)iotcouncil.org.za, test-list-bounces(a)iotcouncil.org.za (in reply to end of DATA command)) I've verified the domain listman.iotcouncil.org.za, so it would seem the obvious solution is to change the domain the mails come from. It appeared that I just change the postfix config to specify domain list so: # INTERNET HOST AND DOMAIN NAMES # # The myhostname parameter specifies the internet hostname of this # mail system. The default is to use the fully-qualified domain name # from gethostname(). $myhostname is used as a default value for many # other configuration parameters. # myhostname = listman.iotcouncil.org.za <<< HERE #myhostname = virtual.domain.tld # The mydomain parameter specifies the local internet domain name. # The default is to use $myhostname minus the first component. # $mydomain is used as a default value for many other configuration # parameters. # mydomain = listman.iotcouncil.org.za <<< and HERE # SENDING MAIL # # The myorigin parameter specifies the domain that locally-posted # mail appears to come from. The default is to append $myhostname, # which is fine for small sites. If you run a domain with multiple # machines, you should (1) change this to $mydomain and (2) set up # a domain-wide alias database that aliases each user to # user(a)that.users.mailhost. # # For the sake of consistency between sender and recipient addresses, # myorigin also specifies the default domain name that is appended # to recipient addresses that have no @domain part. # myorigin = listman.iotcouncil.org.za <<< and HERE #myorigin = $mydomain But when I look in the log: May 16 15:13:05 ip-172-31-23-250 postfix/qmgr[5700]: D58F9A35FB: from=<test-list-bounces(a)iotcouncil.org.za>, size=1224, nrcpt=1 (queue active) May 16 15:13:05 ip-172-31-23-250 postfix/smtpd[5710]: disconnect from ip-172-19-199-2.eu-west-1.compute.internal[172.19.199.2] May 16 15:13:06 ip-172-31-23-250 postfix/smtp[5713]: D58F9A35FB: to=<iotic-za(a)reasondigital.co.za>, relay=email-smtp.eu-west-1.amazonaws.com[52.51.155.83]:587, delay=0.25, delays=0.01/0.03/0.1/0.12, dsn=5.0.0, status=bounced (host email-smtp.eu-west-1.amazonaws.com[52.51.155.83] said: 554 Message rejected: Email address is not verified. The following identities failed the check in region EU-WEST-1: test-list-request(a)iotcouncil.org.za, test-list-bounces(a)iotcouncil.org.za (in reply to end of DATA command)) But the "from" is not changing. I see that messages TO the mailman server are also not being delivered ("-- 5.1.1 Requested action not taken: mailbox unavailable"). So there's another problem. Should I just verify iotcouncil.org.za and add DKIM to its MX record? Seems like a fail...

2 1

Upgrade
by David Krantz 23 May '19

23 May '19

Hi all, I am running a relatively old version of mailman 3, namely 3.2.0a1 from late september 2017. This is installed using the old mailman-bundler method. I use postfix and postgres. I really have two questions: First: What is the normal way to upgrade such a setup? I guess that I just can get the updated versions of all packages through git, set up new venv's to simplify a rollback, back up the database and then just restarting with the new version hoping for the best. Second: Another way would be to set up a new virtual server and reinstall everything and then just switching IPs on the servers. Then: what is the preferred way to install mailman3 today, docker only? I will also have to move all config and data to the new server, this should be mainly about restoring a database backup and copying relevant config, is there anything I miss here? cheers // David

2 1

How to remove global ban using API?
by Nathan Dixon 22 May '19

22 May '19

I am using a global ban to stop anyone not in a list of valid domains from being able to subscribe to any of our lists. This ban needs to be maintained using the Mailman3 api as it is being fed from another source. I can create the ban fine by the following: from mailmanclient import Client client = Client(URI,apiuser,apipass) client.bans.add("^(?!.*[(a)\.](validdomain1\.com|validdomain2\.org|validdomain3\.co\.uk)") However, I cannot seem to be able to remove it using the api: >>> client.bans[0].delete() Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 137, in delete self._connection.call(self._url, method='DELETE') File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 99, in call raise HTTPError(url, response.status, content, response, None) urllib.error.HTTPError: HTTP Error 404: b'' Or >>> client.bans.remove(str(client.bans[0])) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restobjects/ban.py", line 83, in remove ban.delete() File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 137, in delete self._connection.call(self._url, method='DELETE') File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 99, in call raise HTTPError(url, response.status, content, response, None) urllib.error.HTTPError: HTTP Error 404: b'' Or >>> client.bans.remove("^(?!.*[(a)\.](validdomain1\.com|validdomain2\.org|validdomain3\.co\.uk))") Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restobjects/ban.py", line 83, in remove ban.delete() File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 137, in delete self._connection.call(self._url, method='DELETE') File "/home/wanout/.local/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 99, in call raise HTTPError(url, response.status, content, response, None) urllib.error.HTTPError: HTTP Error 404: b'' And also, when I now try and go into the mailman-core docker image to use the mailman.interfaces.bans, it will not let me see the global bans: >>> from mailman.interfaces.bans import IBanManager >>> global_bans = IBanManager(None) Traceback (most recent call last): File "<stdin>", line 1, in <module> TypeError: ('Could not adapt', None, <InterfaceClass mailman.interfaces.bans.IBanManager>) I have opened an issue in Gitlab for this as I feel it may be a bug related to regex and global bans (there was a similar one for list banned addresses): https://gitlab.com/mailman/mailman/issues/598 Many thanks for your time, -- *Nathan Dixon* MEng Senior Software Architect m: +44 (0)7402 690311 t: +44 (0)20 81231252 e: nathan.dixon(a)evadon.com w: www.evadon.com This e-mail and any attachments are confidential and may be protected by legal, professional or other privilege. If you are not the intended recipient you should not store it, copy it, re-transmit it, use it or disclose its contents, but should return it to the sender immediately and delete your copy from your system. The views expressed are those of the sender and not necessarily those of Evadon. Please note that whilst we scan all e-mails for viruses we cannot guarantee that any e-mail is virus-free. Please be advised that we expressly reserve the right to monitor email content for the purposes of ensuring compliance with legal requirements and company policies and your sending to, or receiving from, us of any email constitutes your agreement to these terms. Evadon Dynamics Limited, registered in England No. 09494097. Registered Office: Electric Works, Sheffield Digital Campus, 3 Concourse Way, Sheffield, S1 2BJ

2 2

Uncaught runner exception with out runner process
by Alan So 18 May '19

18 May '19

The out runner process shutdown with the following error. Any clue? May 16 17:32:12 2019 (31602) Uncaught runner exception: (pymysql.err.InternalError) (1053, 'Server shutdown in progress') [SQL: 'SELECT anon_1.member_id AS anon_1_member_id, anon_1.member__member_id AS anon_1_member__member_id, anon_1.member_role AS anon_1_member_role, anon_1.member_list_id AS anon_1_member_list_id, anon_1.member_moderation_action AS anon_1_member_moderation_action, anon_1.member_address_id AS anon_1_member_address_id, anon_1.member_preferences_id AS anon_1_member_preferences_id, anon_1.member_user_id AS anon_1_member_user_id \nFROM (SELECT member.id AS member_id, member._member_id AS member__member_id, member.`role` AS member_role, member.list_id AS member_list_id, member.moderation_action AS member_moderation_action, member.address_id AS member_address_id, member.preferences_id AS member_preferences_id, member.user_id AS member_user_id \nFROM member, address \nWHERE member.list_id = %(list_id_1)s AND member.`role` = %(role_1)s AND address.email = %(email_1)s AND member.address_id = address.id UNION SELECT member.id AS member_id, member._member_id AS member__member_id, member.`role` AS member_role, member.list_id AS member_list_id, member.moderation_action AS member_moderation_action, member.address_id AS member_address_id, member.preferences_id AS member_preferences_id, member.user_id AS member_user_id \nFROM member, address, user \nWHERE member.list_id = %(list_id_2)s AND member.`role` = %(role_2)s AND address.email = %(email_2)s AND member.user_id = user.id AND user._preferred_address_id = address.id) AS anon_1'] [parameters: {'list_id_1': 'listname.list.company.domain', 'role_1': 1, 'email_1': 'usera(a)company.domain', 'list_id_2': 'listname.list.company.domain', 'role_2': 1, 'email_2': 'usera(a)company.domain'}] (Background on this error at: http://sqlalche.me/e/2j85) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 173, in _one_iteration File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 266, in _process_one_file File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose

2 1

installation choices for mm3
by John Griessen 17 May '19

17 May '19

I've been reading https://wiki.list.org/DOC/Mailman%203%20installation%20experience and see that a virtual is recommended, which is not something I have done yet, and wonder if just putting the mm3 on a different server is easier? I have a server, mail1.cibolo.us that has postfix, postgresql, dovecot, mm2, nsd on it. Another server has just web pages and nsd doing backup DNS for mail1.cibolo.us DNS server. I could do a straight debian install of mailman3-full on the 2nd server and keep it simple, let debian setup a blank database installation, right? Has anyone seen a good write up on how to do that on a debian server step by step?

2 2

Any known limit of number of lists that one can be owner/member of?
by Alan So 15 May '19

15 May '19

We have just migrated hundreds of lists from Mailman 2 to Mailman 3. It was smooth in most of the cases. However, we just notice that there are some abnormal behaviour of Postorius for particular users who are owner/member of a large number of lists. We further look into a particular user who is owner of 84 lists. When the user login Postorius, only 50 lists are displayed no matter what the number of "Results per page" is chosen. Prev/Next page cannot be clicked as there is only 1 page. When I use the following mailman client snippet, it also displays the same 50 lists: lists = client.find_lists('xxx(a)yyy.com', 'owner') for m_list in lists: print(m_list.fqdn_listname) Did we hit any limit of find_lists? Is it a bug or are something wrong during the migration? When the user use "Mailman settings", the page can still display all lists though (it's slow as it probably did a lot of SQL queries!).

2 7

Re: Archive Policy not reflecting in Hyperkitty
by Abhilash Raj 14 May '19

14 May '19

Are you using images with "rolling" tags? If yes, you should try to switch to "0.2" tag and the new release will be tagged with the same one. To update, you can do: $ docker pull ... $ docker pull .. $ docker-compose stop $ docker-compose rm $ docker-compose up -d This should basically get you up and running with the new image you pulled. -- thanks, Abhilash Raj (maxking)

2 2

Archive Policy not reflecting in Hyperkitty
by Nathan Dixon 07 May '19

07 May '19

So the issue I am seeing is that when I set a lists archive policy to prviate, it isn't reflecting that in Hyperkitty. I am running the docker installation of Mailman, postorius and hyperkitty. So I go into the docker instance of mailman-core and run this: python3 manage.py shell from hyperkitty.models.mailinglist import MailingList MailingList.objects.all().values_list('name', 'archive_policy') And all my lists are showing '2', regardless of how I set the mailing list archive policy. This might be a duplicate of https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… Am I missing something in my install? Or is this a bug? Many thanks for your attention, -- *Nathan Dixon* MEng Senior Software Architect m: +44 (0)7402 690311 t: +44 (0)20 81231252 e: nathan.dixon(a)evadon.com w: www.evadon.com This e-mail and any attachments are confidential and may be protected by legal, professional or other privilege. If you are not the intended recipient you should not store it, copy it, re-transmit it, use it or disclose its contents, but should return it to the sender immediately and delete your copy from your system. The views expressed are those of the sender and not necessarily those of Evadon. Please note that whilst we scan all e-mails for viruses we cannot guarantee that any e-mail is virus-free. Please be advised that we expressly reserve the right to monitor email content for the purposes of ensuring compliance with legal requirements and company policies and your sending to, or receiving from, us of any email constitutes your agreement to these terms. Evadon Dynamics Limited, registered in England No. 09494097. Registered Office: Electric Works, Sheffield Digital Campus, 3 Concourse Way, Sheffield, S1 2BJ

3 5

Moderate mails from owner
by Henrik Rasmussen 07 May '19

07 May '19

I assume this is by design, but is it correct that a list owner, who are not member, will always be allowed to post to the list, even though "Default action to take when a member posts to the list" and "Default action to take when a non-member posts to thelist" are both set to "Hold for moderation"? The owner is set as also moderator, by the way, which seems redundant. I have a list administrator who would like to be moderated when sending to the list, but there is no Member Options on Owners (nor Moderators). A workaround may be to create a new account for the owner and let the current owner be member instead of owner, as she will then be moderated. /Henrik Rasmussen

4 16

Creating and placing custom templates
by kelly.close＠lrewater.com 02 May '19

02 May '19

I know there are previous threads related to this topic but none were very recent so I thought I'd start a new one. I've referenced two of the old ones below. I am attempting to implement a custom footer on one of my lists. This seems like it should be straightforward but I'm clearly doing something wrong, since the default footer keeps coming through despite my efforts. I've referenced the docs as well as these two posts, to no avail. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… Here's what I'm doing: I found my templates folder and verified it matched what is set in the mailman.cfg file - on my Ubuntu Bionic system it is /var/lib/mailman3/templates/ In that folder I created the following folders and made sure they were properly owned (by list:list) /var/lib/mailman3/templates/lists/f2p2-test.udfcd-lists.org/en/ Into that en/ folder I placed a file called "list:member:regular:footer" It is a text file with just one line of text in it (a link to a website). Also, because there was a mention in one of the earlier posts that this file should have a .txt extension, I also put the same file in there named "list:member:regular:footer.txt". I have two of my own emails subscribed t my "f2p2-test" list at the domain udfcd-lists.org. When I post to the list, and check my other email for the disseminated post, it still has the default footer. I have restarted the mailman3 service. Can anyone spot an obvious error here or offer troubleshooting suggestions? Thank You! ~Kelly

2 1

We're in Season of Docs!
by Stephen J. Turnbull 01 May '19

01 May '19

So, we're in Season of Docs! Currently, Abhilash and I are registered as mentor/admins. I don't think we need more admins, but more mentors is always a good thing. Hey, users! You don't need to be a programmer to mentor docs, of course, and it may be a *good* thing to *not* be a programmer and even *not* a Mailman developer. :-) Suggestions as to doc projects we *really oughtta do!* are very welcome. (I can't believe we got in with the thin doc proposal I put together literally at the last minute, but here we are. ;-) Feel free to get in touch with us on mailman-developers (reply-to set; please respect) if you're interested in mentoring. Or if you prefer you can contact me or Abhilash directly. We can presumably add mentors up to July 23 (deadline for technical writer selection by orgs). For more information: https://wiki.list.org/DEV/SeasonOfDocs2019 https://developers.google.com/season-of-docs/ https://developers.google.com/season-of-docs/docs/participants/ https://developers.google.com/season-of-docs/docs/timeline Regards, Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

1 0

GDPR - save subscriptions confirmation emails
by contact＠maadix.net 01 May '19

01 May '19

Hi, I am new in the list. I have been looking for this topic in the archives in order to avoid duplicate, but I could not find any thread. According to the new GDPR rules, lists owners need to have a confirmation from subscribers, and this is easy to do with Mailman 3. What I can't figure out is how to save all the confirmation emails received from users. I only see the confirmations commands emails in the logs, Is there another place/way to store them? For GDPR compliance it is important to be able to demonstrate that you received the confirmation, in case you may need it in the future. Bests Maddish -- *MaadiX* Tu nube en tus manos https://maadix.net https://twitter.com/MaadiXnet

3 4

HTML email sent to lists migrated from Mailman 2.1
by Nate Coraor 16 Apr '19

16 Apr '19

Hello all, I have some lists migrated from 2.1 that are stripping the HTML parts (perhaps all attachments?) from messages despite the options to do so not being enabled and lynx not even being installed. I'm trying to get a new list to behave the same way so I can figure out what's going on without spamming a production list, but have been unsuccessful: despite setting nearly all the list options the same as the old lists, new lists pass HTML portions and attachments just fine. I've verified the settings using mailing list objects directly with `mailman withlist` on the command line and the only differences are things that I can't imagine would be related like admin_notify_mchanges, advertised, and archive_policy. Are there are really old options that can't be accessed via mailing list objects obtained with `withlist` on the command line? Thanks, --nate

3 3

Mailman in EC2 / Docker -- working but HTTPS not serving static content
by roger.hislop＠is.co.za 15 Apr '19

15 Apr '19

Hi again ... I got everything working thanks to Danil, Abhilash, and finally found a simple NGINX conf that worked, using WSGI. Cool. Set up certificates using LetsEncrypt, used another conf to set up SSL, like the conf pasted below. I edited nginx.conf so that it only takes server config from the nginx/conf.d/blahblah.conf below. This works for HTTP, HTTPS works but it (apparently) is not serving static content. There are loads of how-tos to get this to work, but I've failed in all -- it seems to be the static path (I've not tried option using thttpd I've not tried as there is no easy install onto AQWS AMI and it seems like it's not specifically necessary. I'm so close... so close... ------------------------------- server { listen 80 default_server; # listen [::]:80 default_server ipv6only=on; root /usr/share/nginx/html; index index.html index.htm; server_name listman.iotcouncil.org.za; return 301 https://$server_name$request_uri; #<< AUTO_REDIRECT HTTP TO HTTPS # location / { # proxy_pass http://172.19.199.3:8000/; # proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; # proxy_set_header X-Forwarded-Host $host; # proxy_set_header X-Forwarded-Server $host; # proxy_set_header X-Forwarded-Proto $scheme; # proxy_redirect off; # } # # location /static/ { # alias /var/spool/mailman-web/static/; # } # # location /robots.txt { # alias /var/spool/mailman-web/static/hyperkitty/robots.txt; # } # # location /favicon.ico { # alias /var/www/listorg/images/favicon.ico; # } # } server { listen 443 default_server; # listen [::]:443 default_server ipv6only=on; #root /usr/share/nginx/html; #index index.html index.htm; server_name listman.iotcouncil.org.za; ssl on; ssl_certificate /etc/letsencrypt/live/listman.iotcouncil.org.za/fullchain.pem; ssl_certificate_key /etc/letsencrypt/live/listman.iotcouncil.org.za/privkey.pem; ssl_session_timeout 5m; ssl_protocols SSLv3 TLSv1 TLSv1.1 TLSv1.2; ssl_ciphers "HIGH:!aNULL:!MD5 or HIGH:!aNULL:!MD5:!3DES"; ssl_prefer_server_ciphers on; location / { proxy_pass http://172.19.199.3:8000/; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_set_header X-Forwarded-Host $host; proxy_set_header X-Forwarded-Server $host; proxy_set_header X-Forwarded-Proto $scheme; proxy_redirect off; } location /static/ { alias /opt/mailman/web/static; } location /robots.txt { alias /var/spool/mailman-web/static/hyperkitty/robots.txt; } location /favicon.ico { alias /var/www/listorg/images/favicon.ico; } }

4 3

Mailman Core 3.2.2 is now out
by Abhilash Raj 14 Apr '19

14 Apr '19

Hello Everyone, Mailman Core 3.2.2 is released and available on PyPI[1]. This is a regular bugfix release and I had to do that to fix a version constraint which pulled in a pre-release of a dependency (falcon) when installed via pip and caused the default install to break. There are few other changes included in this release, including a big refactor of error reporting in Core's REST API. All the error responses are now correctly formatted as JSON with more information about the error. For example, invalid inputs for Enum data types return the valid options. Other error message are now generated from the input validtor and will be more informative. REST API also accepts input as JSON formatted body, alongside the x-www-form-urlencoded. A full list of changes are available here: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#id1 This release supports Python 3.5-3.7. Thanks very much to all the contributors involved in this release. [1]: https://pypi.org/project/mailman/ -- thanks, Abhilash Raj (maxking)

2 3

List options question
by Phil Stracchino 13 Apr '19

13 Apr '19

So, I've just sucscribed to this list, and when I go to set subscription options, I find: Receive list copies (possible duplicates) Yes No When you are listed explicitly in the To: or Cc: headers of a list message, you can opt to not receive another copy from the mailing list. Select No to receive copies. Select Yes to avoid receiving copies from the mailing list. This seems rather ... backwards. "Receive copies? Answer no for yes, yes for no." Is that how the option actually works in mailman3, or is the text of the option decription garbled? -- Phil Stracchino Babylon Communications phils(a)caerllewys.net phil(a)co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958

2 1

Mailman3 in dockers on EC2 - running out of memory and puking ev.ry.where.
by roger.hislop＠is.co.za 11 Apr '19

11 Apr '19

Hi all -- really need some help. I'm tech literate, but definitely not a sysadmin or dev. I'm following the tutorial at "Olay's Farmland" at https://www.olay.xyz/2018/01/01/deploy-mailman-3-on-aws-using-docker/ which seems to be a clone of the same content here https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ Easy enough to get most of the way ... set up EC2 instance, configure SES and add DNS settings with DKIM etc. Set up Postfix, test it. All working groovy. I run through the how to all the way through setting up the containers and firing it up. This is where things start to get funky. Once the docker-compose is run, I run "curl http://172.19.199.3:8000/postorius/lists/" to test. First time it said it couldn't connect to database. So I nuked and restarted from scratch. Second time it said the same thing... was reading around the place and tried again, and then reran that curl and it worked -- gave me html from a page. But the VM started running slowly --taking forever to follow keypresses. Eventually became unresponsive. So I rebooted the machine via AWS console, and docker ps showed only the postgres db running. docker-compose ps shows Name Command State Ports ------------------------------------------------------------------------------------------ docker-mailman_database_1 docker-entrypoint.sh postgres Up 5432/tcp mailman-core docker-entrypoint.sh maste ... Exit 255 8001/tcp, 8024/tcp mailman-web docker-entrypoint.sh uwsgi ... Exit 255 8000/tcp, 8080/tcp So rebuilt the container -- same thing. It looks and feels like its running out of memory. I used the compose file from https://gist.githubusercontent.com/Yexiaoxing/833bfcc5d3e4e0c06a8b7f0bac7c4… (with appropriate edits). I have no idea how to proceed from here... Go to logs... Partial log (they're LONG) docker logs docker-mailman_database_1 The files belonging to this database system will be owned by user "postgres". This user must also own the server process. The database cluster will be initialized with locale "en_US.utf8". The default database encoding has accordingly been set to "UTF8". The default text search configuration will be set to "english". Data page checksums are disabled. fixing permissions on existing directory /var/lib/postgresql/data ... ok creating subdirectories ... ok selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting dynamic shared memory implementation ... posix creating configuration files ... ok running bootstrap script ... ok sh: locale: not found performing post-bootstrap initialization ... No usable system locales were found. Use the option "--debug" to see details. ok syncing data to disk ... ok WARNING: enabling "trust" authentication for local connections You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. Success. You can now start the database server using: pg_ctl -D /var/lib/postgresql/data -l logfile start waiting for server to start....LOG: database system was shut down at 2019-04-09 14:37:48 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started done server started CREATE DATABASE /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/* LOG: received fast shutdown request LOG: aborting any active transactions LOG: autovacuum launcher shutting down LOG: shutting down waiting for server to shut down....LOG: database system is shut down done server stopped PostgreSQL init process complete; ready for start up. LOG: database system was shut down at 2019-04-09 14:37:50 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: relation "social_auth_usersocialauth" does not exist at character 15 STATEMENT: SELECT 1 from social_auth_usersocialauth LOG: database system was interrupted; last known up at 2019-04-09 14:48:37 UTC LOG: database system was not properly shut down; automatic recovery in progress LOG: invalid record length at 0/1767BB8: wanted 24, got 0 LOG: redo is not required LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started LOG: received smart shutdown request LOG: autovacuum launcher shutting down LOG: shutting down LOG: database system is shut down LOG: database system was shut down at 2019-04-09 15:18:06 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: duplicate key value violates unique constraint "auth_user_username_key" DETAIL: Key (username)=(lists) already exists. STATEMENT: INSERT INTO "auth_user" ("password", "last_login", "is_superuser", "username", "first_name", "last_name", "email", "is_staff", "is_active", "date_joined") VALUES ('!lS8pgTTV7CyhUbZItku00ZnUGxLQkVEuc3ENZKbV', NULL, true, 'lists', '', '', 'iotic-za(a)reasondigital.co.za', true, true, '2019-04-09T15:39:57.715036+00:00'::timestamptz) RETURNING "auth_user"."id" TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (3 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (12 chunks); 179176 used ERROR: out of memory DETAIL: Failed on request of size 4032. CONTEXT: writing block 0 of relation base/16384/16797 TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (2 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used LOG: could not fork autovacuum worker process: Out of memory MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used LOG: could not fork autovacuum worker process: Out of memory Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (11 chunks); 179176 used LOG: could not fork autovacuum worker process: Out of memory ERROR: out of memory DETAIL: Failed on request of size 4032. CONTEXT: writing block 0 of relation base/16384/16797 LOG: could not fork autovacuum worker process: Out of memory WARNING: could not write block 0 of base/16384/16797 DETAIL: Multiple failures --- write error might be permanent. TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (2 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used TopMemoryContext: 51040 total in 4 blocks; 1344 free (1 chunks); 49696 used TopTransactionContext: 8192 total in 1 blocks; 6968 free (0 chunks); 1224 used Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used Statistics snapshot: 0 total in 0 blocks; 0 free (0 chunks); 0 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (11 chunks); 179176 used Per-database function: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database table: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database function: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database table: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Databases hash: 24576 total in 2 blocks; 15072 free (5 chunks); 9504 used ERROR: out of memory For UWSGI cat uwsgi.log [pid: 49|app: 0|req: 1/1] 172.19.199.1 () {24 vars in 291 bytes} [Tue Apr 9 14:43:43 2019] GET /postorius/lists/ => generated 3710 bytes in 705 msecs (HTTP/1.1 200) 5 headers in 163 bytes (1 switches on core 0) [pid: 39|app: 0|req: 1/1] 172.19.199.1 () {24 vars in 291 bytes} [Tue Apr 9 15:40:12 2019] GET /postorius/lists/ => generated 3710 bytes in 694 msecs (HTTP/1.1 200) 5 headers in 163 bytes (1 switches on core 0) [ec2-user@ip-172-31-23-250 logs]$ cat uwsgi-error.log cat: uwsgi-error.log: Permission denied [ec2-user@ip-172-31-23-250 logs]$ sudo cat uwsgi-error.log *** Starting uWSGI 2.0.15 (64bit) on [Tue Apr 9 14:38:03 2019] *** compiled with version: 6.3.0 on 29 December 2017 00:16:31 os: Linux-4.14.77-70.59.amzn1.x86_64 #1 SMP Mon Nov 12 22:02:45 UTC 2018 nodename: mailman-web machine: x86_64 clock source: unix detected number of CPU cores: 1 current working directory: /opt/mailman-web detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! setgid() to 101 setuid() to 100 chdir() to /opt/mailman-web your processes number limit is 3860 your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address 0.0.0.0:8080 fd 8 uwsgi socket 1 bound to TCP address 0.0.0.0:8000 fd 9 Python version: 2.7.14 (default, Dec 19 2017, 17:52:21) [GCC 6.3.0] Python main interpreter initialized at 0x55ca1d90e1e0 python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds [uwsgi-cron] command "./manage.py runjobs minutely" registered as cron task [uwsgi-cron] command "./manage.py runjobs quarter_hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs daily" registered as cron task [uwsgi-cron] command "./manage.py runjobs monthly" registered as cron task [uwsgi-cron] command "./manage.py runjobs weekly" registered as cron task [uwsgi-cron] command "./manage.py runjobs yearly" registered as cron task mapped 166144 bytes (162 KB) for 2 cores *** Operational MODE: threaded *** WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x55ca1d90e1e0 pid: 1 (default app) *** uWSGI is running in multiple interpreter mode *** spawned uWSGI master process (pid: 1) spawned uWSGI worker 1 (pid: 49, cores: 2) Tue Apr 9 14:38:04 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 51) [uwsgi-daemons] spawning "./manage.py qcluster" (uid: 100 gid: 101) 14:38:07 [Q] INFO Q Cluster-52 starting. 14:38:07 [Q] INFO Process-1 guarding cluster at 67 14:38:07 [Q] INFO Process-1:1 ready for work at 68 14:38:07 [Q] INFO Process-1:3 pushing tasks at 70 14:38:07 [Q] INFO Q Cluster-52 running. 14:38:07 [Q] INFO Process-1:2 monitoring at 69 [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 51 exited after 4 second(s) Tue Apr 9 14:39:04 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 71) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 71 exited after 269 second(s) Tue Apr 9 14:43:33 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 79) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 79 exited after 3 second(s) Tue Apr 9 14:51:35 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 89) *** Starting uWSGI 2.0.15 (64bit) on [Tue Apr 9 15:39:58 2019] *** compiled with version: 6.3.0 on 29 December 2017 00:16:31 os: Linux-4.14.109-80.92.amzn1.x86_64 #1 SMP Mon Apr 1 23:07:39 UTC 2019 nodename: mailman-web machine: x86_64 clock source: unix detected number of CPU cores: 1 current working directory: /opt/mailman-web detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! setgid() to 101 setuid() to 100 chdir() to /opt/mailman-web your processes number limit is 3860 your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address 0.0.0.0:8080 fd 8 uwsgi socket 1 bound to TCP address 0.0.0.0:8000 fd 9 Python version: 2.7.14 (default, Dec 19 2017, 17:52:21) [GCC 6.3.0] Python main interpreter initialized at 0x562e2c0b11e0 python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds [uwsgi-cron] command "./manage.py runjobs minutely" registered as cron task [uwsgi-cron] command "./manage.py runjobs quarter_hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs daily" registered as cron task [uwsgi-cron] command "./manage.py runjobs monthly" registered as cron task [uwsgi-cron] command "./manage.py runjobs weekly" registered as cron task [uwsgi-cron] command "./manage.py runjobs yearly" registered as cron task mapped 166144 bytes (162 KB) for 2 cores *** Operational MODE: threaded *** WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x562e2c0b11e0 pid: 1 (default app) *** uWSGI is running in multiple interpreter mode *** spawned uWSGI master process (pid: 1) spawned uWSGI worker 1 (pid: 39, cores: 2) Tue Apr 9 15:39:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 41) [uwsgi-daemons] spawning "./manage.py qcluster" (uid: 100 gid: 101) 15:40:02 [Q] INFO Q Cluster-43 starting. 15:40:02 [Q] INFO Process-1:1 ready for work at 58 15:40:02 [Q] INFO Process-1:2 monitoring at 59 15:40:02 [Q] INFO Process-1 guarding cluster at 57 15:40:02 [Q] INFO Process-1:3 pushing tasks at 60 15:40:02 [Q] INFO Q Cluster-43 running. [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 41 exited after 4 second(s) Tue Apr 9 15:40:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 63) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 63 exited after 13 second(s) Tue Apr 9 15:41:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 71) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 71 exited after 33 second(s) Tue Apr 9 15:42:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 79) 16:33:36 [Q] ERROR could not translate host name "database" to address: Try again 16:35:17 [Q] INFO Process-1:3 stopped pushing tasks 16:35:25 [Q] ERROR reincarnated pusher Process-1:3 after sudden death 16:35:25 [Q] INFO Process-1:4 pushing tasks at 87 [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 79 exited after 3146 second(s) Tue Apr 9 16:35:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 88) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 88 exited after 3 second(s) Tue Apr 9 16:36:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 96) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 96 exited after 3 second(s) Tue Apr 9 16:37:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 104) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 104 exited after 3 second(s) Tue Apr 9 16:38:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 112) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 112 exited after 3 second(s) Tue Apr 9 16:39:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 120) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 120 exited after 3 second(s) Tue Apr 9 16:40:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 128) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 128 exited after 3 second(s) Tue Apr 9 16:41:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 136) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 136 exited after 3 second(s) Tue Apr 9 16:42:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 144) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 144 exited after 3 second(s) Tue Apr 9 16:43:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 152) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 152 exited after 3 second(s) Tue Apr 9 16:44:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 160) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 160 exited after 3 second(s) Tue Apr 9 16:45:00 2019 - [uwsgi-cron] running "./manage.py runjobs quarter_hourly" (pid 168) [uwsgi-cron] command "./manage.py runjobs quarter_hourly" running with pid 168 exited after 2 second(s) Tue Apr 9 16:45:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 176) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 176 exited after 3 second(s) Tue Apr 9 16:46:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 184) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 184 exited after 2 second(s) Tue Apr 9 16:47:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 192) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 192 exited after 3 second(s) Tue Apr 9 16:48:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 200) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 200 exited after 3 second(s) Tue Apr 9 16:49:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 208) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 208 exited after 3 second(s) Tue Apr 9 16:50:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 216) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 216 exited after 3 second(s) Tue Apr 9 16:51:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 224) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 224 exited after 3 second(s) Tue Apr 9 16:52:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 232) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 232 exited after 3 second(s) Tue Apr 9 16:53:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 240) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 240 exited after 2 second(s) Tue Apr 9 16:54:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 248) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 248 exited after 2 second(s) Tue Apr 9 16:55:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 256) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 256 exited after 3 second(s) Tue Apr 9 16:56:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 264) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 264 exited after 3 second(s) Tue Apr 9 16:57:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 272) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 272 exited after 3 second(s) Tue Apr 9 16:58:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 280) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 280 exited after 3 second(s) Tue Apr 9 16:59:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 288) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 288 exited after 3 second(s) Tue Apr 9 17:00:00 2019 - [uwsgi-cron] running "./manage.py runjobs quarter_hourly" (pid 296) Tue Apr 9 17:00:00 2019 - [uwsgi-cron] running "./manage.py runjobs hourly" (pid 297) Traceback (most recent call last): File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 363, in execute_from_command_line Traceback (most recent call last): File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 363, in execute_from_command_line File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 337, in execute utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 337, in execute django.setup() django.setup() File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup apps.populate(settings.INSTALLED_APPS) apps.populate(settings.INSTALLED_APPS) File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate app_config.import_models() app_config.import_models() File "/usr/local/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models File "/usr/local/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models self.models_module = import_module(models_module_name) self.models_module = import_module(models_module_name) File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) __import__(name) File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/__init__.py", line 28, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/__init__.py", line 28, in <module> from .email import Email, Attachment from .email import Email, Attachment File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/email.py", line 37, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/email.py", line 37, in <module> from hyperkitty.lib.analysis import compute_thread_order_and_depth from hyperkitty.lib.analysis import compute_thread_order_and_depth File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/analysis.py", line 28, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/analysis.py", line 28, in <module> import networkx as nx import networkx as nx File "/usr/local/lib/python2.7/site-packages/networkx/__init__.py", line 114, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/__init__.py", line 114, in <module> import networkx.generators import networkx.generators File "/usr/local/lib/python2.7/site-packages/networkx/generators/__init__.py", line 6, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/generators/__init__.py", line 6, in <module> from networkx.generators.classic import * from networkx.generators.classic import * File "/usr/local/lib/python2.7/site-packages/networkx/generators/classic.py", line 26, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/generators/classic.py", line 26, in <module> from networkx.algorithms.bipartite.generators import complete_bipartite_graph from networkx.algorithms.bipartite.generators import complete_bipartite_graph File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/__init__.py", line 57, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/__init__.py", line 57, in <module> import networkx.algorithms.connectivity import networkx.algorithms.connectivity File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/__init__.py", line 3, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/__init__.py", line 3, in <module> from .connectivity import * from .connectivity import * File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/connectivity.py", line 13, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/connectivity.py", line 13, in <module> from networkx.algorithms.flow import boykov_kolmogorov from networkx.algorithms.flow import boykov_kolmogorov File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/flow/__init__.py", line 1, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/flow/__init__.py", line 1, in <module> from .maxflow import * from .maxflow import * MemoryErrorMemoryError 18:16:37 [Q] ERROR could not translate host name "database" to address: Try again ...etc ... For Mailman cat mailmanweb.log ERROR 2019-04-09 20:05:48,878 934 hyperkitty.lib.utils Failed to update the fulltext index: could not translate host name "database" to address: Try again Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/utils.py", line 186, in run_with_lock fn(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/search_indexes.py", line 87, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 240, in update_backend total = qs.count() File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 363, in count return self.query.get_count(using=self.db) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 498, in get_count number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 479, in get_aggregation result = compiler.execute_sql(SINGLE) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 874, in execute_sql cursor = self.connection.cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor return self._cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor self.ensure_connection() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect self.connection = self.get_new_connection(conn_params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py", line 176, in get_new_connection connection = Database.connect(**conn_params) File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) OperationalError: could not translate host name "database" to address: Try again ERROR 2019-04-09 20:15:08,192 983 hyperkitty.lib.utils Failed to update the fulltext index: could not translate host name "database" to address: Try again Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/utils.py", line 186, in run_with_lock fn(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/search_indexes.py", line 87, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 240, in update_backend total = qs.count() File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 363, in count return self.query.get_count(using=self.db) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 498, in get_count number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 479, in get_aggregation result = compiler.execute_sql(SINGLE) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 874, in execute_sql cursor = self.connection.cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor return self._cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor self.ensure_connection() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect self.connection = self.get_new_connection(conn_params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py", line 176, in get_new_connection connection = Database.connect(**conn_params) File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) OperationalError: could not translate host name "database" to address: Try again

3 3

Simplified installation instructions
by Frank Yappa 08 Apr '19

08 Apr '19

I've looked at installing Mailman3 many times but have never succeeded - there simply too many instructions. Is there a simple guide to get just web front end to Mailman3 where you can import an existing mailing list simply for viewing? Which is the easiest system to install Mailman3 on? I have a Debian system and would be grateful for any pointers showing how to install it . I came across:- https://iomarmochtar.wordpress.com/2017/07/21/mailman3-easy-installation/ but this is for Centos and I don't know what to change. Elsewhere I came across a list of apps which needed to be installed on Debian but that didn't work because of missing packages. apt-get install python3-setuptools python3-virtualenv python3-dev git gcc node-less nodejs postfix python3-tox

2 1

easy way to delete old mails in hyperkitty?
by l.schimmer＠cgv.tugraz.at 08 Apr '19

08 Apr '19

Hi! is thjere a easy way to delete old mails in hyperkitty? e.g. with a list and checkmarks, or via a cli command? We got several mailinglists and we did import them from mailman2.x into mailman 3.2. Now it is time to remove old posts before 2016. But I do not see a easy way to remove old posts in one go, just the "remove thread" button in each mail view. thank you, Lars

2 1

Archiver "prototype" and disabling archiving at all
by Torge Riedel 07 Apr '19

07 Apr '19

Hi list, in the settings of a mailing list I can choose two archivers: "Hyperkitty" and "prototype". What is this archive "prototype" and how can I disable/remove/deinstall it? And how can I disable archiving at all, so no archiver can be chosen in the settings. Best regards Torge

3 4

UI changes in Hyperkitty
by Abhilash Raj 02 Apr '19

02 Apr '19

Hi All, I have been working this past weekend trying to change some UI elements of Hyperkitty to make it a bit more cleaner, easier to read quoted emails and make unread posts more visible than they were before. As a test bed, I have deployed my changes to lists.mailman3.org[1]. A complete summary of changes is available in my MR[2] on Gitlab. I would appreciate some feedback from users to make sure that is is a step in the right direction. Since it has been a long long time since I ever designed a UI, I would also really appreciate if there people who want to work with me on fixing some of the UX issues in Hyperkitty. Summary of Changes: --------------------------------- - The grey background for the email headers are removed. - Gravatars are now round in shape instead of square. - Links to permalink of the message and fixed-font button has been moved to the bottom to remove clutter from the top of the message. - The date format is changed to remove the Day of the week and uses 3 letter month names for minimalism. - Right sidebar is now fixed and doesn't scroll with the page. - All buttons on the bottom of the email now have a hover property that changes their background on mouse hover. - Quoted part of the email now has a different background. Each level of quoting gets a different background till 3-levels of indentation. After, which we don't process more quoted text. - Unread threads show a blue bar on the left side as a more prominent indication as compared to current envelope icon. [1]: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ [2]: https://gitlab.com/mailman/hyperkitty/merge_requests/132 Feel free to reply here or just comment on MR in Gitlab. -- thanks, Abhilash Raj (maxking)

3 2

mail stuck in "out" queue
by Dmitry Makovey 30 Mar '19

30 Mar '19

I've had encountered this situation now twice: mail is being stuck in "out" queue and nothing in the logs indicates the issue. Is there a way to ask mailman-core politely to attempt delivery (perhaps with increased debugging in the logs) *without* restarting the core (which does solve *this* problem but creates other problems, like availability of the mailman as a whole) -- Sr System and DevOps Engineer SoM IRT

2 1

Delete archive of mailing list
by Torge Riedel 28 Mar '19

28 Mar '19

Hi list, I've successfully set up mailman3 in a test environment and deleted a test list which I only used for some basic tests. Looking at the archiver, the archive is still there and I haven't found a way to delete it. Although I am logged in as admin. Is there a (non-) official way to delete the archive? I want a clean environment for the later user to test mailman3. Thanks and regards Torge

2 2

Introducing Mailman Web project
by Abhilash Raj 26 Mar '19

26 Mar '19

I have been working on a new sub-project Mailman Web[1][2]. This project basically combines Postorius and Hyperkitty together in a single package which you can easily use to serve Mailman's web interface. The basic motivation behind this was to make it simpler for people to install the web interface *and* make it easier for people to configure Mailman's web ui. Both Postorius and Hyperkitty are based on Django Web Framework, which uses settings.py as its default configuration language. While it is quite convenient for Python developers to be able to put Python statements in configuration to join/edit/configure settings. However, I think a traditional INI, or TOML style configuration is easier for non-developers without having to worry about PYTHONPATH, valid Python sytax etc, etc. For this reason, I decided to combine all the projects together into a Django project which can be easily installed and run: $ pip install mailman-web # Export Settings for commands to just work. $ export DJANGO_SETTINGS=mailman_web.settings $ django-admin migrate $ django-admin runserver This should get you default settings for running. If you want to customize your installation, which you almost always would need to in a prod environment, you can create a config file at one of these locations (which are searched in following order): - /etc/mailman-web.toml - /etc/mailman3/mailman-web.toml - ./mailman-web.toml Note that we support only TOML as the configuration language[3][4] because of its simplicity. I would have loved to use INI, like Mailman Core, but it turns out to be way too simple to represent more complex data structures like maps and tables, that is commonly used in Django's Settings. This project is currently in alpha stage (I created it today!), but can be installed with pip[5] and in my basic tests works. There isn't much in the project itself beyond some configurations. I also took this opportunity to document all the settings that are used in Mailman Web (both Postorius and Hyperkitty) together[6]. This is documented in code and so I really hope that it won't go out of date like many other places ;-) Improvements to docs is very welcome, just a modification of a comment and is quite easy to propose right in your web browser using Gitlab! Any questions, comments or suggestions are welcome. You can open issues for feature requests on gitlab[1] too. [1]: https://gitlab.com/mailman/mailman-web [2]: https://mailman-web.readthedocs.io/en/latest/ [3]: https://github.com/maxking/django-settings-toml [4]: https://github.com/toml-lang/toml [5]: https://pypi.org/project/mailman-web/ [6]: https://mailman-web.readthedocs.io/en/latest/settings.html -- thanks, Abhilash Raj (maxking)

2 6

Configuring the List-Archive and Archived-At headers
by Ralph Seichter 25 Mar '19

25 Mar '19

With archiving enabled, mail is sent with headers like the following: Archived-At: <https://example.com/hyperkitty/list/foo-users@lists.example.com/message/ABC/> List-Archive: <https://example.com/hyperkitty/list/foo-users@lists.example.com/> List-Post: <mailto:foo-users@lists.example.com> List-Subscribe: <mailto:foo-users-join@lists.example.com> The 'mailto:' entries are fine, but I need all 'https:' links to be prefixed with https://lists.example.com instead of https://example.com . Does Mailman extract CN parts from the SSL certificate to populate the header values (that would explain 'example.com' in my tests), or is this something I can influence using configuration parameters? I searched the docs for Mailman Suite and HyperKitty, but did not find an answer. -Ralph

5 9

Non resolved placeholders in action message
by Torge Riedel 23 Mar '19

23 Mar '19

Hi, after adding a new moderator to a list I get the following message in a green box: %(email)s has been added with the role %(role)s Looks like the placeholders are not resolved (correctly). Should I report this somewhere as a bug? Mailman Core Version GNU Mailman 3.2.0 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.6.7 (default, Oct 22 2018, 11:32:17) [GCC 8.2.0] Best regards Torge

2 1

State of STARTTLS/SMTPS support?
by Ralph Seichter 21 Mar '19

21 Mar '19

Hello list. I just found https://gitlab.com/mailman/mailman/issues/252 and was surprised to see that a) the issue is two years old and b) a related merge request has been submitted a year ago and is also still open. The possibility to send mail unencrypted via localhost is something I have in a test environment, but not in production. I need to be able to specify settings that look like these: [mta] smtp_host: outbound-mta.mydomain.tld smtp_port: 587 smtp_security: STARTTLS When is STARTTLS/SMTPS likely to become available in Mailman? -Ralph

2 2

How to best disable message decoration for all lists defined for a domain
by Ralph Seichter 19 Mar '19

19 Mar '19

Hello list. I have read [1] and [2], but I am not quite sure what the recommended method is to completely disable message headers/footers and subject modifications for *all* lists tied to a specific domain. Being new to Mailman 3, I was actually surprised that there are no configuration switches in the Web UI's settings for mailing lists that allow me to get rid of unwanted message decorations. [1] https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/decorate… [2] https://mailman.readthedocs.io/en/latest/build/lib/mailman/rest/docs/templa… Thanks for your input. -Ralph

3 4

REST Runner (and other runners) taking long time to boot up
by Dmitry Makovey 18 Mar '19

18 Mar '19

splitting this discussion into it's own thread from "MM3 occasionally chokes (?)". Re-iterating background info for posterity: we have been experiencing increasingly long boot ups from mailman-core over the past year to the point where it's at about 45min for the sequence to complete. We run couple of mailing lists (20+) that are anywhere between 100 and 10K+ members and most of them are low traffic. From what I can tell all that time is spent doing some sort of indexing operations, I'm writing from memory since I can't restart the system to confirm that. sizes of directories that containers use: 3.6G core 352M database 285M web state of my queues (as far as I understand how to evaluate them: $ for q in core/var/queue/*; do echo ${q}; ls ${q}/ | wc -l ; done core/var/queue/archive 1 core/var/queue/bad 3845 core/var/queue/bounces 0 core/var/queue/command 0 core/var/queue/digest 0 core/var/queue/in 0 core/var/queue/nntp 0 core/var/queue/out 7 core/var/queue/pipeline 0 core/var/queue/retry 1 core/var/queue/shunt 958 core/var/queue/virgin 0 what kind of tuning should we be looking into to speed up our boot-ups? -- Sr System and DevOps Engineer SoM IRT

2 1

Maximum number of recipients error
by brian＠emwd.com 18 Mar '19

18 Mar '19

I am unable to modify the "Maximum number of recipients" setting. It generates the following error when I click the "save changes" button: "An error occured: Unknown attribute: max_num_recipients" I am using the docker version of MM3 and its happening on "Postorius Version 1.2.3". Is this a known bug? Brian

3 2

MM3 occasionally chokes (?)
by Dmitry Makovey 18 Mar '19

18 Mar '19

In the last couple of month we've observed some odd behavior from MM3 (namely the core) where it seems like email that is about to be sent to a large-ish mailing list (10K users) has been processed yet never gets sent out until we restart the core. I would appreciate any pointers on where to look for the source of the problem. At the moment, since I can't reliably reproduce it I can't really test it nor do I know where to look next time things get stuck. Mailing list in question is high profile thus when event like this happens I have only limited time amount to spend on troubleshooting/digging before I just restart the core (which by the way takes about 45min to fully start... which is another puzzle to solve at later time) -- Sr System and DevOps Engineer SoM IRT

2 5

REST API Question: possible to change user preferred email?
by Nathan Dixon 18 Mar '19

18 Mar '19

Hi, We are in need of being able to change a user's email address via the REST API. After looking through the documentation and code, I can't see a way to do this in a simple way. Although the documentation seems to show that if a user changes their preferred address, it will track throughout all their subscriptions. See: https://gitlab.com/mailman/mailman/blob/master/src/mailman/rest/docs/member… "When Gwen changes her preferred address, her subscription automatically tracks the new address." The only way I can see to do this via the REST API would be to do the following long winded way: *1. Create a new address:* POST to http://<api_url>/3.1/users/<$OldEmail>/addresses $postData: {email = "$NewEmail"} *2. Verify the new address:* POST to http://<api_url>/3.1/addresses/<$NewEmail>/verify $postData: { } *3. Get all the memberships for the old email address* $memberships = GET to http://<api_url>/3.1/addresses/<$OldEmail>/memberships *4. Change users email for each membership individually* foreach ($membership in $memberships) { PATCH to http://<api_url>/3.1/members/<$membership.member_id> $pathData: { address = $NewEmail } } *5. Delete Old Address* DELETE to http://<api_url>/3.1/addresses/<$OldEmail> Am I missing something (as in there is a way to do a single PATCH request somewhere)? Or is this the only way to update someone's email address with these 5 steps? Thanks, Nathan Dixon

2 1

[Mailman-Users] mailman 3 and freeipa
by Stephen J. Turnbull 18 Mar '19

18 Mar '19

Crossposting and redirecting replies to mailman-users(a)mailman3.org. Steven Jones writes: > I cant find anything on this so far but can Mailman3's webui use > freeipa as the authentication mechanism? Hi Steve, I don't have a complete answer offhand (and right now I'm just reducing my inbox so a single google search is as much as I can do), but searching for "freeipa django" indicates that there are "connectors" for Django and FreeIPA. The nicest option would be a plugin for Django's socialauth application. If that doesn't seem to exist, perhaps you can just add a FreeIPA application to the Django configuration. You would need to add it to both Postorius and HyperKitty configurations. Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

2 1

How to count the number of members in a list using Mailman client?
by Alan So 18 Mar '19

18 Mar '19

I tried to do so using Mailman client but it is really slow for lists with size > 1000. I use the following code snippet: my_list = client.get_list(listname) print ("number of members =", len(my_list.members)) Are there any other ways to do so in a much faster speed? Thanks.

2 1

Assistance with mailman3
by ayen＠afilias.info 15 Mar '19

15 Mar '19

Hi all I'm pretty new to mailman but been trying to install mailman 3 and been running into issues, following the documentation at http://docs.mailman3.org/en/latest/prodsetup.html installed Python 3.6, nginx, ruby-sass then with pip installed whoosh mailman-hyperkitty postorius hyperkitty mailman tried to start mailman core, symlinked master and runner -> /usr/bin/ (otherwise it wouldn't run) mailman core starts but when I hit the api url I get this in the logs File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/rest/wsgiapp.py", line 218, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 248, in __call__ responder, params, resource, req.uri_template = self._get_responder(req) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 664, in _get_responder route = self._router_search(path, req=req) TypeError: find() got an unexpected keyword argument 'req' Mar 13 10:54:44 2019 (17273) 127.0.0.1 - - "GET /3.1/ HTTP/1.1" 500 59 and on frontend "A server error occurred. Please contact the administrator." that leads to my gnu not working and throwing keyerrors for postorius. I'm using a clean install of ubuntu 18.04 but have also tried to install on centos 7 with no success. Are there any missing dependencies or steps that I've missed any assistance would be appreciated. Andy

3 2

Import Mailman 2.1.15 => Mailman 3 fails
by Jens Bretschneider 15 Mar '19

15 Mar '19

Hi, we want to replace our Mailman 2.1.15 installation and have installed Mailman 3 with Docker (maxking/docker-mailman). Everything seems to be fine so far, but the import of the old mailing lists fails. There are two different exceptions: MySQLdb._exceptions.OperationalError: (1366, "Incorrect string value: '\\xE2\\\x80\x8D0\xE2\\x80...' for column `mailmandb`.`hyperkitty_email`.`content` at row 1") as well as MySQLdb._exceptions.OperationalError: (1048, "Column 'description' cannot be null") The complete log can be found here: https://www.dropbox.com/s/htd4eia1cg1kyi7/mailman3_import_log.txt?dl=0 Any idea what's going wrong here? Kind regards, Jens

3 3

Unable to configure mailman . Please give any information
by pradeep Kumar xplorer 14 Mar '19

14 Mar '19

Subject: [Fwd: Please list the variables i need to modify in the configure.in] From: "Pradeep Kumar Xplorer" pradeepkumarxplorer(a)pradeepkumarxplorer.com Date: Mon, March 11, 2019 4:04 am To: mailman-users(a)mailman3.org Priority: High Read Receipt: Requested [ Send Read Receipt Now ] Options: View Full Header | Print | Download this as a file ---------------------------- Original Message ---------------------------- Subject: Please list the variables i need to modify in the configure.in From: "Pradeep Kumar Xplorer" pradeepkumarxplorer(a)pradeepkumarxplorer.com Date: Thu, March 7, 2019 6:36 am To: mailman-users(a)python.org before running the configure script I changed AC_PREFIX_DEFAULT(/home1/explodi4/public_html/MAILMAN) and it still says /home/mailman does not exist. Pradeep Kumar Xplorer http://www.dhyanayoga.info http://www.pradeepkumarxplorer.com/2016/CyberCrime/index.php

2 1

hyperkitty error importing (from mm2 mbox) HTML emails / binary attachments
by M4tze 13 Mar '19

13 Mar '19

Dear list, I am importing emails from mm2 mbox archives into hyperkitty. This generally works but for HTML mails or mails having binary attachments, I get some errors: + ProgrammingError: (1064, u'You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near \'_binary\'<html>\\n<head>\\n<meta http-equiv=\\"Content-Type\\" content=\\"text/html; c\' at line 1') + I am using the following debian/ubuntu packages: * mailman3 3.1.1-9 * mailman3-full 3.1.1-9 * mailman3-web 0+20170523-14 * python-django-mailman3 1.1.0-4 * python-mailmanclient 3.1.1-5 * python3-mailman-hyperkitty 1.1.0-4 * mysql-server 5.7.25-0ubuntu0.18.04.2 * mysql-server-5.7 5.7.25-0ubuntu0.18.04.2 * mysql-server-core-5.7 5.7.25-0ubuntu0.18.04.2 I changed the charset & collation of the mailman-web (incl. hyperkitty's) tables from latin1 to UTF8_mb4, which was neccessary to fix errors importing UTF8 mail. Does anyone has an idea of how to fix that? Kind regards - m4tze

1 0

mailman admin (django) interface does not work anymore after deleting website example.com
by Torge Riedel 10 Mar '19

10 Mar '19

Hi, I've just installed successfully mailman3 and started with basic configuration. When adding a new domain it gives me a link to a django admin page where I have to configure the available websites. I deleted the existing "example.com" and added a new one "lists.mydomain.de". Now the admin (django) interface always gives "An error occurred while processing your request". After one of the first navigation clicks I saw a message that "site with id 1 is missing". Can you point me to where the problem is and how to solve it? Maybe it was not a good idea to delete the existing one, but I would have expected that django will prevent this, if it will fail afterwards. Thanks and regards Torge The logs: Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 154, in _get_response response = response.render() File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/base.py", line 169, in render with context.bind_template(self): File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/context.py", line 246, in bind_template updates.update(processor(self.request)) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django_mailman3/context_processors.py", line 32, in common context["site_name"] = get_current_site(request).name File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/contrib/sites/shortcuts.py", line 13, in get_current_site return Site.objects.get_current(request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/contrib/sites/models.py", line 60, in get_current return self._get_site_by_id(site_id) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/contrib/sites/models.py", line 32, in _get_site_by_id site = self.get(pk=site_id) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/db/models/query.py", line 399, in get self.model._meta.object_name django.contrib.sites.models.Site.DoesNotExist: Site matching query does not exist.

3 3

Automatic response to non-members
by daniel.eckhoff＠gmail.com 08 Mar '19

08 Mar '19

Hi! I have a mailing list, where I accept every incoming message without subscription. I set this up for a recruitment website (jobs(a)xyz.org). It works nice. All mails are sent to archive where me and other admins can go through all applications. Now we want to set up an automatic response to incoming messages. I tried to set "Autorespond postings" but since the applicants are not subscribers, this won't work. I aso set the template for "Notice sent to a poster when their message has been received by the mailing list". Both approaches don't seem to work. Any ideas to get this working without relying on additional software?

2 1

Domain Resolving Issue
by brian＠emwd.com 07 Mar '19

07 Mar '19

I am running a Mailman 3 server with about 5 list domains configured on it. Most of them resolve quickly both to Postorius and HyperKitty. However there is one domain that resolves very slowly. Once it does, access to other pages/tasks go quickly. If you don't do anything with that domain in the browser after about 5 minutes, it takes its time again to resolve. What could be causing this? The webserver is Nginx. Not sure if this is a Mailman 3 issue or not. Brian

2 1

Change settings via mailman shell
by kk＠eco.cept.org 06 Mar '19

06 Mar '19

I am trying to find a way to set some parameters on the lists from a shell script. One specific parameter - max_message_size is not presented through the REST interface apparantly, and i found a way to set this with mailman shell command. Continuing this path i seem not to be able to set any other parameters like this: m.archive_policy = 'never' m.subject_prefix = '' m.dmarc_mitigate_action = 'munge_from' m.dmarc_mitigate_unconditionally = True commit() However i end up with this error: sqlalchemy.exc.StatementError: (builtins.AttributeError) 'str' object has no attribute 'value' [SQL: 'UPDATE mailinglist SET archive_policy=?, dmarc_mitigate_action=?, dmarc_mitigate_unconditionally=?, subject_prefix=? WHERE mailinglist.id = ?'] [parameters: [{'dmarc_mitigate_unconditionally': 'True', 'dmarc_mitigate_action': 'munge_from', 'subject_prefix': '', 'archive_policy': 'never', 'mailinglist_id': 65}]] Not sure what to make of it, but it seems like the fields are not there. I then proceed to get a list of all parameters with information found here: http://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclient… and the parameters seems to exist - however this list is made with the REST interface - so my question are - are there a difference in parameters in "mailman shell" command and REST interface - and how do i then get a list of parameter and possible settings in the "mailman shell" command ? Thanks in advance Kenneth Denmark

2 1

Mailman3 without Hyperkitty in docker
by Danil Smirnov 04 Mar '19

04 Mar '19

Hi, I'm interesting in Mailman3 deployment with archiving feature completely disabled. I've tried to deploy Core + Postorius using this docker-compose template: https://github.com/maxking/docker-mailman/blob/master/docker-compose-postor… Unfortunately Postorius version came with this template is quite outdated: 1.2.0a1 (as reported in page footer). In Hyperkitty-enabled docker image I see version 1.2.3. I've also checked image maxking/postorius:rolling but it seems irrelevant/broken (container exits with error). Are there newer Postorius docker image I can use? Thanks, Danil Smirnov

3 18

Re: postorius only show 50 owner lists
by Alejandro Lopez 03 Mar '19

03 Mar '19

Ok, thanks!

1 0

postorius only show 50 owner lists
by elalelopez＠gmail.com 02 Mar '19

02 Mar '19

Hi, I have installed mailman3 suite on Debian 9. And postorius only lists up to 50 addresses when filter by owner: https: //lists.domain/mailman3/postorius/lists/? role = owner A first query in the database returns all the lists, but then, when it makes the subsequent queries for each list, it ends when it reaches 50. Any ideas? regards

2 3

Selective mailing
by chucka＠blackforest-co.com 02 Mar '19

02 Mar '19

I'm trying to find out if I move my web site to a hosting company using MM Ver 3 - with SQL. If I have a membership list in MySql used by MM - can I send an email to a select group? ["Your dues are due"]. Assumes the MM tables can be accessed? Anyhow what I want to do is: send message96 where expire > next month else send message95 Thanks

4 7

From address of subscription notifications
by worik 02 Mar '19

02 Mar '19

Friends When I subscribe some body to to a list I on I get a notification that says it comes from changeme(a)example.com As far as I can tell no subscribers are getting mail with that, so this is not a crises. But it is untidy and I cannot find where to change it. SERVE_FROM_DOMAIN is set in the mailman-web/environment section of docker-compose.yaml (I am using the docker distribution...) cheers Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

4 4

Managing users
by worik 01 Mar '19

01 Mar '19

Is there a interface for managing users? I can use the data base directly to query `auth_user` etcetera, but Postorious? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 1

Bounces address spammed
by Enrique Terrazas 28 Feb '19

28 Feb '19

Greetings, I hope everyone is having a good day. We have a highly visible list that is being spammed with join requests from spoofed addresses. When the confirmation email is sent a bounce is received by the list owner. The count is in the 100’s of bounced emails/hour. We noticed they are all coming from one particular domain, this may help if we are able to filter/block the domain. What would be the best way to handle this? Is there a way to handle this granularly at the list level? Thank you as always for your assistance. Enrique

2 2

Member occur in Subscription Requests when Subscription Policy = Confirm
by Henrik Rasmussen 27 Feb '19

27 Feb '19

When Subscription Policy is set to Confirm (only), new potential subscriber appears in Subscription Requests until they have confirmed that they actually want to subscribe. As expected, the new potential subscriber receives a mail with a link to confirm. And also as expected, since moderation is NOT needed, the admin does not receive a mail about authorisation. Why does the new potential subscriber appear in Subscription Requests until confirmed by the subscriber, when the admin doesn't have to appove anyway? Is that by design? /Henrik Rasmussen

2 1

Archives visible to all
by worik 25 Feb '19

25 Feb '19

When I load my new mailing list system, before I log in, I can see the archives of all the lists. Without logging in. Even lists with archives set to private archives. What can I do about that? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 3

Is logging.subscribe working in /etc/mailman.cfg?
by ktso＠cuhk.edu.hk 25 Feb '19

25 Feb '19

I have put the following in /etc/mailman.cfg and restart mailman. An empty file can be created but nothing can be logged when admin or non-member subscribe/unsubscribe. Anything I have missed? So far I can only see log appear in mailman.log and smtp.log. Thanks. [logging.subscribe] path: subscribe.log level: debug

3 5

Changing delivery mode for ALL subscribers on a SINGLE list using REST
by Henrik Rasmussen 25 Feb '19

25 Feb '19

While in Mailman Settings a user can change delivery mode for either Global (all subscriptions regardless of address or list), Address based (regardless of list name) or List Based (regardless of address). The list admin can change a user's delivery mode setting on a single list (affecting only that address and only that list), but only one subscriber at the time on the list. Changing a user's delivery mode can also be done using REST[1], but I asume this will affect the user's subscription on all the lists where she subscribed using the same address. How do I change ALL the subscribers[2] on a _single list_ to a certain delivery mode, using REST? [1] https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/preferences.… [2] Most likely by iterating through all subscribers, one at the time, on the list in question.

2 4

Tracking from gravatar
by worik 19 Feb '19

19 Feb '19

Privacy badger reports one tracker (for which it disables cookies) on my Mailman installation. It is: secure.gravatar.com What is this for and how do I get rid of it? I looked at the site and it seems like some sort of take a avatar any where. I do not want that on the lists I am managing for this group of users. cheers Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

3 3

Turn off social logins?
by worik 18 Feb '19

18 Feb '19

How do I turn off the social logins? I looked in the admin manual but They are not working, but I absolutely do not want them for now. Maybe one day, but my users will be allergic to even the hint.... Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

12 27

hyperkitty failed to create a thread
by Danil Smirnov 17 Feb '19

17 Feb '19

Hi all, What could be a reason of HyperKitty failing to create a thread from chained emails? For example, see "RECENTLY ACTIVE DISCUSSIONS" on page https://wlug.mailman3.com/hyperkitty/list/wlug@lists.wlug.org/ "Openvpn and Network mapping" discussion displayed as five threads instead of only one... Any ideas how to improve HyperKitty ability to detect threaded messages? With my best regards, Danil Smirnov

6 19

Logging of unsubscribe process
by Johannes Winter 16 Feb '19

16 Feb '19

Dear MM3 list, I was wondering whether the unsubscribe process is logged. One user accidentally hit "unsubscribe all" aborted the process but is now unsure whether he accidentally deleted users. Is there a easy way to check? Best regards, Johannes Winter

2 1