- Mailman-users - lists.mailman3.org

Docker release cycle maxking/mailman-core
by Johannes Winter 24 Aug '18

24 Aug '18

Hi guys, I'd like to test out some bugfixes in the master branch, namely the merge request related to: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… But I use the maxking docker images of which the 'rolling' and 'latest' tags are apparently not really used. Might it be possible to push these a litte bit more frequently? Thank you and best regards, Johannes Winter

2 1

Avoiding welcome message when subscribing using REST API
by Henrik Rasmussen 21 Aug '18

21 Aug '18

In Mailman 2 the site admin could add a member to a list using the -wn parameter of add_members to avoid sending a welcome message. On the host (outside the docker container) I've made an updater using the REST API to keep certain lists updated with imported addresses from one of our other systems, though respecting opt ins and opt outs. Similar to Mailman 2 I would like to avoid the welcome message to those automatic updated members, even the list is configred to send welcome message to those opting in by will, and I also like to avoid forcing the list owner/moderator to approve all new members automatically updated even the list is set for moderation of new members opting in by will. What is the payload for "no welcome message"? def add_new_members(listname_fqdn, members): [SNIP] for member in newmembers: payload['list_id'] = listname_fqdn.replace('@', '.') payload['subscriber'] = member payload['pre_verified'] = True payload['pre_confirmed'] = True payload['pre_approved'] = True response = mmapipost('members', payload) def mmapipost(apicommand,payload): response = requests.post('http://172.19.199.2:8001/%s/%s' % (restapiversion, apicommand), data=payload, auth=('restadmin', 'restpass'))

2 2

Moving from old-school install to docker
by David Krantz 19 Aug '18

19 Aug '18

Hi, Is there any documented procedure moving from a working install of mailman3 and postorius to a docker-based version? The reason would be to get a setup that is somewhat easier to maintain and upgrade. That said much of the work is to keep a mta, web server, spamfilter, grey list solution, dkim signing etc. running and up to date. I suspect that there is no pre-made docker images for that? cheers // David

1 0

receiving digest
by Abhijith PA 14 Aug '18

14 Aug '18

Hello. How a subscriber can receive the digest of a list ( assuming the list has enabled digests. Is there something to do for a subscriber in web interface to receive. Abhijith

2 1

Re: issue with Hyperkitty
by Mark Sapiro 08 Aug '18

08 Aug '18

On 08/07/2018 07:14 AM, Ali Alnubani wrote: > > I'm seeing the following trace when I go to http://example.com/hyperkitty/list/dev@example.com/2018/5/: This was fixed by downgrading Django to 2.0.8. See <https://gitlab.com/mailman/hyperkitty/issues/192> for more detail. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

proper update procedure for MM3 docker containers
by Fabian A. Santiago 07 Aug '18

07 Aug '18

Hello, Can someone remind me of the proper / best way to update my docker containers for MM3 / postorius based on maxking's images? Thanks. and this for both the stable and rolling releases. -- Fabian S. OpenPGP: 0x643082042DC83E6D94B86C405E3DAA18A1C22D8F (new key) *** 0x3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC (to be retired, still valid)

2 2

issue with Hyperkitty
by Ali Alnubani 07 Aug '18

07 Aug '18

Hi, I'm migrating from mailman 2.1.15, I did the following: * Installed packages * Created database * ./manage.py migrate * mailman create dev(a)example.com<mailto:dev@example.com> * ./manage.py hyperkitty_import -l dev(a)example.com /usr/local/mailman2/archives/private/dev.mbox/dev.mbox (the archive includes 69 emails). * ./manage.py update_index_one_list dev(a)example.com I'm seeing the following trace when I go to http://example.com/hyperkitty/list/dev@example.com/2018/5/: ``` ERROR 2018-08-07 13:54:23,897 19997 django.request Internal Server Error: /hyperkitty/list/dev(a)example.com/2018/5/ Traceback (most recent call last): File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 126, in _get_response response = self.process_exception_by_middleware(e, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 124, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/lib/view_helpers.py", line 134, in inner return func(request, *args, **kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 94, in archives return _thread_list(request, mlist, threads, extra_context=extra_context) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 123, in _thread_list return render(request, template_name, context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/shortcuts.py", line 36, in render content = loader.render_to_string(template_name, context, request, using=using) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/backends/django.py", line 61, in render return self.template.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 171, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 234, in render return t.render(new_context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 173, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 209, in render nodelist.append(node.render_annotated(context)) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 192, in render output = self.func(*resolved_args, **resolved_kwargs) File "venv_path/lib/python3.5/site-packages/django_mailman3-1.2.0-py3.5.egg/django_mailman3/templatetags/pagination.py", line 36, in add_to_query_string return conditional_escape(qs.urlencode()) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in urlencode for v in list_ File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in <genexpr> for v in list_ AttributeError: 'int' object has no attribute 'encode' ERROR 2018-08-07 13:54:23,897 19997 django.request Internal Server Error: /hyperkitty/list/dev(a)example.com/2018/5/ Traceback (most recent call last): File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 126, in _get_response response = self.process_exception_by_middleware(e, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 124, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/lib/view_helpers.py", line 134, in inner return func(request, *args, **kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 94, in archives return _thread_list(request, mlist, threads, extra_context=extra_context) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 123, in _thread_list return render(request, template_name, context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/shortcuts.py", line 36, in render content = loader.render_to_string(template_name, context, request, using=using) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/backends/django.py", line 61, in render return self.template.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 171, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 234, in render return t.render(new_context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 173, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 209, in render nodelist.append(node.render_annotated(context)) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 192, in render output = self.func(*resolved_args, **resolved_kwargs) File "venv_path/lib/python3.5/site-packages/django_mailman3-1.2.0-py3.5.egg/django_mailman3/templatetags/pagination.py", line 36, in add_to_query_string return conditional_escape(qs.urlencode()) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in urlencode for v in list_ File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in <genexpr> for v in list_ AttributeError: 'int' object has no attribute 'encode' ERROR 2018-08-07 13:54:25,721 19997 django.server "GET /hyperkitty/list/dev(a)example.com/2018/5/ HTTP/1.1" 500 317983 ``` Environment: ``` alembic==1.0.0 arrow==0.12.1 click==6.7 Django==2.1 django-haystack==2.8.1 django-mailman3==1.2.0 django-q==0.9.4 djangorestframework==3.8.2 httplib2==0.11.3 HyperKitty==1.2.0 mailman==3.2.0 mailman-hyperkitty==1.1.1 mailmanclient==3.2.0 Mako==1.0.7 postorius==1.2.0 psycopg2-binary==2.7.5 python-dateutil==2.7.3 requests==2.19.1 requests-oauthlib==1.0.0 SQLAlchemy==1.2.10 urllib3==1.23 uWSGI==2.0.17.1 Whoosh==2.7.4 ``` Some of the archives are listed fine tho. The same trace reproduced with 2 different imported archives. I'm on Debian stretch and using python 3.5.3. Can you help please? Thanks, Ali

1 0

migration subscribers from mm2 to mm3
by Mateusz Ostrzyżek 07 Aug '18

07 Aug '18

Hello, Is there any way to migrate subscribers from mailman2 to mailman3 other than writing them to mm3? I have a fiew lists on mailman2 an i want to migrate them to mailman 3, i found a way to migrate archive but cannot find any information about subscribers. Best regards -- Mateusz Ostrzyżek (null) (null)

2 1

dedicated mailman3 list server on Ubuntu 18.04 LTS - questions after installation
by John Seifarth 06 Aug '18

06 Aug '18

My goal is to build a stable dedicated list server using mailman3. It should use all current email authentication techniques to clearly show that it is an authentic non-spam mail list server. In the future, I may want to use the REST interface, so that’s why mailman2 is not an option. My installation: Installed Ubuntu 18.04 LTS server, with postfix, mysql and postgres. I then installed mail-stack-delivery, postfix-policyd-spf-python, OpenDKIM, and OpenDMARC. I configured SPF, DKIM, and DMARC records on my DNS server, and then configured postfix and dovecot to DKIM sign outgoing mail from local users, and check SPF, DMARC, and DKIM on incoming mail. I then installed the package mailman3-full, which provides version 3.1.1-9, using postgres 10 as the database. I have looked in Ubuntu bionic-backports and bionic-updates and do not see a more recent version. I see that version 3.2 was released in July, are debian/ubuntu mailman 3.2 packages available somewhere? I set up the /etc/mailman3 files: I added this to the end of mailman.cfg [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /etc/mailman3/mailman-hyperkitty.cfg In mailman-hyperkitty.cfg I copied the api_key: value from mailman-web.py MAILMAN_ARCHIVER_KEY, but removed the single quotes surrounding the value in the mailman-web.py file when writing the key in the mailman-hyperkitty.cfg file. I modified /etc/postfix/main.cf with this appended to the end: # Mailman-postfix integration owner_request_special = no # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no transport_maps = hash:/var/lib/mailman3/data/postfix_lmtp local_recipient_maps = proxy:unix:passwd.byname, $alias_maps, hash:/var/lib/mailman3/data/postfix_lmtp relay_domains = ${{$compatibility_level} < {2} ? {$mydestination} : {}} hash:/var/lib/mailman3/data/postfix_domains I ran /usr/share/mailman3-web/manage.py createsuperuser I ran a2enmod proxy_uwsgi I made a symbolic link from /etc/mailman3/apache.conf to /etc/apache2/conf-available/mailman3.conf, then ran a2enconf mailman3 I have read the documentation in /usr/share/docs/mailman3* along with what I could find concerning mailman3 on the web. The installation allows me to sign into the web interface, create a host, create mailing lists, and mass subscribe members. When members send email to the list address, the server sends the messages normally to the other members of the list. However, when I look at the list archives, there are no posts. I deliberately mass-subscribed an invalid address, and I can see in /var/log/mail.log that the message bounces, but I get no notification, nor do I see any bounce info when I look at the member info. My questions: 1) logging A lot of my questions would probably be answered if I could figure out hot to activate logging correctly. Currently, I see: root@mailman:/var/log/mailman3# ll -R -rw-rw---- 1 list list 0 Jul 29 20:06 bounce.log -rw-rw---- 1 list list 0 Jul 29 20:06 debug.log -rw-r----- 1 list list 3298 Aug 4 00:00 mailman.log -rw-rw---- 1 list list 34606 Jul 30 17:44 smtp.log drwxr-xr-x 2 www-data www-data 4096 Aug 3 06:25 web/ ./web: -rw-rw-r-- 1 www-data www-data 1520 Aug 3 06:25 mailman-web.log The bounce log and debug log are empty. I’ve set propagate: yes in the [logging.debian] section From /etc/mailman3/mailman.cfg # In this section, you can define defaults for all loggers, which will be # prefixed by 'mailman.'. Use subsections to override settings for specific # loggers. The names of the available loggers are: # # - archiver -- All archiver output # - bounce -- All bounce processing logs go here # - config -- Configuration issues <…snip…> Can anyone post an example of a ‘subsection’ to set archiver and bounce to debug? Do I have to create /var/log/mailman3/mailman.archiver.log and set ownership to list:list? 2) Where are posts stored? For me, this is the biggest mystery in mailman3. Local mail is delivered to ~/Maildir by dovecot. In the $var_dir hierarchy the directory messages contains just 2 messages dating to my initial tests. Anything I send to a list now, and which seems to be sent properly to the member addresses, I cannot find on the filesystem. Any clues as to what may be going on here? 3) Archival - Hyperkitty How does this work? All the parts seem to be in place, and I can see from ps /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=archive:0:1 -C /etc/mailman3/mailman.cfg How can I figure out why this is not working? In the web interface, I see that each of my lists has zero posts. But posts mailed to the list address do appear in the list members’ mailboxes! 4) Bounces I’ve deliberately put an erroneous email address as a list member. In postfix’s /var/log/mail.log I see the bounces, but get no notification, and /var/log/mailman3/bounce.log remains empty. 5) DKIM and DMARC I’ve got OpenDKIM running on inet:12345@localhost and OpenDMARC running on net:54321@localhost. How can I get mailman to use these milters and sign messages? How should DMARC munging be configured when signing? 6) Is there an overview of how mailman3 works? Is there documentation which explains the path of an incoming post through the system, including initial reception, list processing, sending to members, processing bounces, and archiving posts? Thanks in advance for help and pointers to any available documentation! John Seifarth Words & Wires SPRL Computer Consulting & Language Services Brussels, Belgium

3 2

bad ssl cert on docker guide site
by Fabian A. Santiago 06 Aug '18

06 Aug '18

hello, On the docker deployment guide site: https://asynchronous.in/docker-mailman/ linked to from here: http://docs.mailman3.org/en/latest/prodsetup.html the ssl cert is invalid, as it's issued against CN = www.github.com. just an fyi (although I"m sure others have seen this and there's likely a perfectly valid explanation I just haven't thought of). good day. -- Fabian S. OpenPGP: 0x643082042DC83E6D94B86C405E3DAA18A1C22D8F (new key) *** 0x3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC (to be retired, still valid)

2 1