- Mailman-users - lists.mailman3.org

Moderation emails
by peter＠chubb.wattle.id.au March 4, 2021

March 4, 2021

Hi Folks, Whenever a non-member posts to a members-only list, the owners (because I haven't set any moderators) get a 3-part MIME message, from the xxx-owner email address. The first part is the template from .../mailman/templates/en/list:admin:action:post.txt The second part is a message/rfc822 copy of the held message. The third part is another message/rfc822 part that says, If you reply to this message, keeping the Subject: header intact, Mailman will discard the held message. Do this if the message is spam. If you reply to this message and include an Approved: header with the list password in it, the message will be approved for posting to the list. The Approved: header can also appear in the first line of the body of the reply. This is really confusing, as replying to the whole message will go to the '-owner' not the '-request' address, which will neither discard nor authorise the message, and will not contain the subject: heading from the encapsulated message. Is there any easy way, either to turn off generation of the third message, or make it so that acting on the message (hitting reply in your email client) will actually discard the message? Peter C

2 1

postorius / adjusted settings menu
by Andreas Barth March 3, 2021

March 3, 2021

Hi together, I want to adjust the settings menu to reduce to the options really needed. The easiest way would be to edit src/postorius/views/list* but I don't think that's a good idea. So what comes to my mind is to have some variable in the configuration that contains the menu items and - if set - the submenus. E.g. the following: { 'list_identity': ['!gateway_to_mail', '!gateway_to_news', '!linked_newsgroup', '!newsgroup_moderation', '!nntp_prefix_subject_too' ], 'automatic_responses', 'alter_messages', 'dmarc_mitigations', 'digest', 'message_acceptance', 'archiving', 'subscription_policy', 'bounce_processing' } would express: default menu and just remove the mentioned items. Of course, something like ['advertised', 'description', 'info', 'display_name', 'subject_prefix'] would work as well. Resorting should also be possible, so something like { 'list_identity': ['advertised', 'description', 'info', 'personalize'] } would give a very small list of items to select from. What do you think about the idea? Andi

2 1

Shunt Error Mail?
by Pete Ashdown March 3, 2021

March 3, 2021

I have a number of list managers with subscribers who are confused as to why their messages are silently disappearing. I've read the archives on how to decipher why a message was shunted, but this is not workable at scale. Is sending an error email back to the sender a consideration?

3 3

Domain ownership issues
by peter＠chubb.wattle.id.au March 2, 2021

March 2, 2021

Hi, I wanted to give another user the ability to create lists, so added that user as 'owner' of the domain. But he does not see the 'create list' button. I decided to try deleting him as owner, and the result is a python exception: KeyError: 'file' ERROR 2021-03-01 20:35:07,195 550 django.request Internal Server Error: /postori us/domains/sel4.systems/owners/b55d58c434c94f6dbd19ae338502dd2e/remove Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 115, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/http.py", line 40 , in inner return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/contrib/auth/decorators.py", line 21, in _wrapped_view return view_func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/auth/decorators.py", line 75, i n wrapper return fn(*args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/domain.py", line 182, in remove_owners remove_email = client.get_user(user_id).addresses[0].email File "/usr/lib/python3/dist-packages/mailmanclient/client.py", line 324, in get_user display_name=display_name)) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py", line 111, in call raise HTTPError(url, response.status_code, urllib.error.HTTPError: HTTP Error 404: 404 Not Found Mailman Core Version GNU Mailman 3.2.2 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.9.0+ (default, Oct 19 2020, 09:51:18) [GCC 10.2.0] Peter C

2 4

Hyperkitty "All Threads" results in error
by Mark Dadgar March 2, 2021

March 2, 2021

So I have been wrestling with this problem for a while now. Most times, but not every time, when someone clicks on the All Threads link in hyperkitty, a 500 error is generated. I googled it, obviously, and at first I thought it was related to this issue, but that has not proven to be the case: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…> I’ve attached a “backtrace” below. The archives were imported from a previous mm3 install a couple of months ago. The problem occurs even with a list state full of immediately recent posts. Anyone have thoughts on how I can fix this? - Mark ----- mark(a)pdc-racing.net | 408-348-2878 — Internal Server Error: /archives/list/trackjunkies(a)pdc-racing.net <mailto:archives/list/trackjunkies@pdc-racing.net>/latest VariableDoesNotExist at /archives/list/trackjunkies(a)pdc-racing.net <mailto:archives/list/trackjunkies@pdc-racing.net>/latest Failed lookup for key [sender] in None Request Method: GET Request URL: https://mail.pdc-racing.net/archives/list/trackjunkies@pdc-racing.net/latest <https://mail.pdc-racing.net/archives/list/trackjunkies@pdc-racing.net/latest> Django Version: 2.2.14 Python Executable: /opt/mailman/mm/venv/bin/python Python Version: 3.8.2 Python Path: ['/opt/mailman/mm', '/opt/mailman/mm/', '/opt/mailman/mm/bin', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/opt/mailman/mm/venv/lib/python3.8/site-packages'] Server time: Sun, 4 Oct 2020 10:27:10 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _resolve_lookup 829. current = current[bit] During handling of the above exception ('NoneType' object is not subscriptable), another exception occurred: File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _resolve_lookup 837. current = getattr(current, bit) During handling of the above exception ('NoneType' object has no attribute 'sender'), another exception occurred: File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _resolve_lookup 843. current = current[int(bit)] During handling of the above exception (invalid literal for int() with base 10: 'sender'), another exception occurred: File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/lib/view_helpers.py" in inner 134. return func(request, *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/views/mlist.py" in archives 114. return _thread_list(request, mlist, threads, extra_context=extra_context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/views/mlist.py" in _thread_list 143. return render(request, template_name, context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/shortcuts.py" in render 36. content = loader.render_to_string(template_name, context, request, using=using) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/loader.py" in render_to_string 62. return template.render(context, request) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/backends/django.py" in render 61. return self.template.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 171. return self._render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _render 163. return self.nodelist.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/loader_tags.py" in render 150. return compiled_parent._render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _render 163. return self.nodelist.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/loader_tags.py" in render 62. result = block.nodelist.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/defaulttags.py" in render 209. nodelist.append(node.render_annotated(context)) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/loader_tags.py" in render 188. return template.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 173. return self._render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _render 163. return self.nodelist.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/defaulttags.py" in render 513. return self.nodelist.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/templatetags/i18n.py" in render 132. context.update({var: val.resolve(context) for var, val in self.extra_context.items()}) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/templatetags/i18n.py" in <dictcomp> 132. context.update({var: val.resolve(context) for var, val in self.extra_context.items()}) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in resolve 692. arg_vals.append(arg.resolve(context)) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in resolve 796. value = self._resolve_lookup(context) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/base.py" in _resolve_lookup 848. raise VariableDoesNotExist("Failed lookup for key " Exception Type: VariableDoesNotExist at /archives/list/trackjunkies(a)pdc-racing.net <mailto:archives/list/trackjunkies@pdc-racing.net>/latest Exception Value: Failed lookup for key [sender] in None

2 4

[Django] ERROR (EXTERNAL IP): Internal Server Error: /hyperkitty/list/direttivo@catania.linux.it/top-threads
by blackout69 March 1, 2021

March 1, 2021

Hello everybody,I received this error message and from that moment the maiilan3 has stopped working.I restarted the following services mailman3 and mailman3-web and everything started working fine.Can you tell me what is the problem my django server has encountered? Internal Server Error: /hyperkitty/list/direttivo(a)catania.linux.it/top-threads DoesNotExist at /hyperkitty/list/direttivo(a)catania.linux.it/top-threads Thread matching query does not exist. Request Method: GET Request URL: https://lists.catania.linux.it/hyperkitty/list/direttivo@catania.linux.it/t… Django Version: 1.11.29 Python Executable: /usr/bin/uwsgi-core Python Version: 3.7.3 Python Path: ['.', '', '/usr/lib/python37.zip', '/usr/lib/python3.7', '/usr/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Ven, 26 Feb 2021 20:10:53 +0100 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/lib/view_helpers.py" in inner 134. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mlist.py" in overview_top_threads 196. 'threads': mlist.top_threads, File "/usr/lib/python3/dist-packages/hyperkitty/models/mailinglist.py" in top_threads 157. return self.cached_values["top_threads"]() File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in __call__ 59. return self.get_or_set(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/mailinglist.py" in get_or_set 365. return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/usr/lib/python3/dist-packages/hyperkitty/models/mailinglist.py" in <listcomp> 365. return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/usr/lib/python3/dist-packages/django/db/models/manager.py" in manager_method 85. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py" in get 380. self.model._meta.object_name Exception Type: DoesNotExist at /hyperkitty/list/direttivo(a)catania.linux.it/top-threads Exception Value: Thread matching query does not exist. Request information: USER: blackout69 GET: No GET data POST: No POST data FILES: No FILES data COOKIES: csrftoken = 'tqNIiLrMWyYNHYhkmnmQfjRdd0AtCeCAAW46VOL24wk2g7Opl5LSZWB2dZ2p79Sb' sessionid = 'brhb9jd3ko9blnluuc6bz3c1627u6h22' META: CONTENT_LENGTH = '' CONTENT_TYPE = '' CSRF_COOKIE = 'tqNIiLrMWyYNHYhkmnmQfjRdd0AtCeCAAW46VOL24wk2g7Opl5LSZWB2dZ2p79Sb' DOCUMENT_ROOT = '/usr/share/nginx/html' HTTPS = 'on' HTTP_ACCEPT = 'text/html, */*; q=0.01' HTTP_ACCEPT_ENCODING = 'gzip, deflate, br' HTTP_ACCEPT_LANGUAGE = 'it-IT' HTTP_COOKIE = 'csrftoken=tqNIiLrMWyYNHYhkmnmQfjRdd0AtCeCAAW46VOL24wk2g7Opl5LSZWB2dZ2p79Sb; sessionid=brhb9jd3ko9blnluuc6bz3c1627u6h22' HTTP_HOST = 'lists.catania.linux.it' HTTP_REFERER = 'https://lists.catania.linux.it/hyperkitty/list/direttivo@catania.linux.it/' HTTP_TE = 'trailers' HTTP_USER_AGENT = 'Mozilla/5.0 (Android 11; Mobile; rv:86.0) Gecko/86.0 Firefox/86.0' HTTP_X_REQUESTED_WITH = 'XMLHttpRequest' PATH_INFO = '/hyperkitty/list/direttivo(a)catania.linux.it/top-threads' QUERY_STRING = '' REMOTE_ADDR = '2.38.155.170' REMOTE_PORT = '39208' REQUEST_METHOD = 'GET' REQUEST_SCHEME = 'https' REQUEST_URI = '/hyperkitty/list/direttivo(a)catania.linux.it/top-threads' SCRIPT_NAME = '' SERVER_NAME = 'lists.catania.linux.it' SERVER_PORT = '443' SERVER_PROTOCOL = 'HTTP/2.0' uwsgi.core = 1 uwsgi.node = b'glugct.catania.linux.it' uwsgi.version = b'2.0.18-debian' wsgi.errors = <_io.TextIOWrapper name=2 mode='w' encoding='UTF-8'> wsgi.file_wrapper = '' wsgi.input = <uwsgi._Input object at 0x7f0e65582f00> wsgi.multiprocess = False wsgi.multithread = True wsgi.run_once = False wsgi.url_scheme = 'https' wsgi.version = '(1, 0)' Thank you in advance -- blackout69

3 9

How to disable subscribe by mail in mailman3?
by Thomas Koch March 1, 2021

March 1, 2021

Hello, I've setup a mailman3 for an organization. Organization members are authenticated by an LDAP backend and can thus use the web UI to subscribe. To avoid unnecessary moderation, I'd like to disable subscription by mail but still allow subscription through the web interface. (I've already hacked some code to dissallow subscribe by mail through posteros.) Regards, Thomas

2 2

Import Archives Assistance
by Brian Carpenter Feb. 28, 2021

Feb. 28, 2021

I am working with a client in importing a large MM2 mbox file (around 1GB in size) into a Mailman 3 list using: /opt/mailman/mm/bin/django-admin hyperkitty_import --no-sync-mailman -l list@listdomain list.mbox I planned on syncing after the import. Well, the client did not have enough memory on the server for the above job and it crashed in the middle of it. I informed the client who added more memory to the VPS. I went and deleted the partial archives via Hyperkitty and proceeded with the above import job again. The job finished but it seems only the messages that were imported were those AFTER the crash happened. How can I remove the archives completely so I can rerun this mbox file in its entirety? -- Brian Carpenter Harmonylists.com Emwd.com

1 1

who request
by Vako Nicolian Feb. 27, 2021

Feb. 27, 2021

Is there a way to stop the who request to get membership list? i.e.: if we send an email to {list}-request@... with *who {password} *on the subject line, it will send the membership list to the member, I want that option to be disabled for privacy reasons. Thanks, Vako

2 1

Added two tasks for Google Summer of Code
by Stephen J. Turnbull Feb. 27, 2021

Feb. 27, 2021

Based on recent threads, I've added two tasks to our 2021 GSoC ideas page: https://wiki.list.org/DEV/Google%20Summer%20of%20Code%202021#List_Configura… https://wiki.list.org/DEV/Google%20Summer%20of%20Code%202021#User_Profile_T… Bcc'd to David and Johannes because I referred to threads starting with their posts. If you want me to paraphrase in the task description, let me know, but I preferred to do it this way to encourage applicants to join the community. (Note: we haven't been selected yet, so this isn't any more public than the archived mailing lists.) Suggestions of other GSoC tasks and refinements to existing ones welcome. However, please discuss them on the list (or to a core dev privately) unless you have GSoC experience. Google has specific requirements for Summer of Code projects, so there are a lot of important tasks that should not be on that page. If you have an enhancement that you'd definitely like to put on our agenda, and also suggest for GSoC, feel free to file an issue on the tracker and point me, Mark, or Abhilash to it. Steve

1 0

Disable archives per list
by Bernd Wurst Feb. 27, 2021

Feb. 27, 2021

Hello, we are about to migrate our Mailman 2 instance to Mailman 3. As we are hosting many (small) mailing lists for different customers, we get in trouble about future handling of mail archives. Mailman 2 just used mbox files per list and flat files for public archive, so archives do not matter apart from some storage. With hyperkitty, all messages for all lists are stored in on single database and I'm a little bit scared of a single database table with dozens of GB of data. Many of our users do not really need archiving, some customers also asked archiving to be disabled for legal reasons within their lists. Can I as the server admin disable archiving (or set other list options) in a way that the list admin can not change it via postorious? Can I have custom archiver settings per list or per domain (customer-specific hyperkitty)? regards, Bernd

3 3

Documentation for transferiering a list between mm3 and mm3
by Johannes Winter Feb. 27, 2021

Feb. 27, 2021

Hi, I didn't find any documentation on how to export list data from mm3 and import it into another mm3 instance. Have I missed something, or is it yet nonexistant? Best greetings, Johannes

5 6

Two Questions: One General, the Other Specific
by David Wilson Feb. 26, 2021

Feb. 26, 2021

Salutations; For context, I have been lurking on this site for a number of years now, in order to track the progress of this wonderful mailman3 project. Further context, I am chair of a 66 unit condominium and pay for two lists provided by EMWD.com and get a hands on feel from an mailman3 operations perspective. *Is there another site that might best communicate the future goals, plans, objectives, and time frames for mailman3 or is the status of the project at the state of being primarily reacting to problems, as evidenced in this problem solving forum, at least as it seems to me, with no offense meant or intended?* Something I find surprising is a problem described in an image grab below relating to an inability to amend a list entry to include a name to be associated with an email address, as if the data needs to be immutable. When a workaround was unsuccessfully explored to delete the entry and then resubmit an amended entry but with the same already deleted email address, that was still refused, presumably because of pointers to archived data don't permit, but this seems like a particularly onerous restriction, or perhaps even a bug, or at least a severe design constraint. *Is this item on an existing to do list?* *Comments please?* Thank you in advance for any responses to the questions in bold to facilitate faster reading, etc. Best regards. Dave Wilson ------------------------------------------------------------------------

3 2

missing links in admin request mail Fwd: New subscription request to Mm3-test-mem from hstahl@uw.edu
by Stephen Willey Mats Mats Feb. 25, 2021

Feb. 25, 2021

Mailman2 and other mailman3 installs I’ve seen included links in the moderation ‘requires approval’ or list subscription request approvals. But the messages from my mailman3 server does not have the links. What configuration am I missing? I’m running off the stable 0.3 docker images as updated this morning to the current releases (3.3.3, 1.3.4, 1.3.4) thanks, steve > From: list2-owner(a)mm3.xxx.s.uw.edu > Subject: list2(a)mm3.xxx.s.uw.edu post from xxx(a)jhmi.edu requires approval > Date: February 25, 2021 at 2:18:14 PM PST > To: list2-owner(a)mm3.xxx.s.uw.edu > > As list administrator, your authorization is requested for the > following mailing list posting: > > List: list2(a)mm3.xxx.s.uw.edu > From: xxx(a)jhmi.edu > Subject: this is a post that should be moderated > > The message is being held because: > > The message is not from a list member > > At your convenience, visit your dashboard to approve or deny the > request. > Begin forwarded message: > > From: mm3-test-mem-owner(a)mm3.xxx.s.uw.edu > Subject: New subscription request to Mm3-test-mem from xxx(a)uw.edu > Date: February 25, 2021 at 12:49:05 PM PST > To: mm3-test-mem-owner(a)mm3.xxx.s.uw.edu > > Your authorization is required for a mailing list subscription request > approval: > > For: xxx(a)uw.edu > List: mm3-test-mem(a)mm3.xxx.s.uw.edu

2 1

docker-mailman Release Schedule
by matthew＠alberti.us Feb. 25, 2021

Feb. 25, 2021

Hi, Is there an estimated date that a new docker-mailman release will be issued? I think .3.10 is still the latest, which doesn't include the latest releases of core, web, etc. Thanks.

2 2

Correcting name spellings in a list
by Morris Jones Feb. 24, 2021

Feb. 24, 2021

I typo'd some full names in a mailing list. I want to correct them ... I can't see a way to do that in the Member Options, so I thought I'd try "remove" and re-add, either from the command line or the UI. But the name gets readded with the typo intact. :( Is there a way to fix it without writing SQL? Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

3 3

Best guide for installing from pypi
by duane＠fairsay.com Feb. 24, 2021

Feb. 24, 2021

Hi. I've got a partial mailman3 install done and, based on the documentation, am not sure how to complete it! (this is my first time) I've installed mailman3 (3.3.3) on a Debian 10 server using python3.7, mysql, postfix, apache, etc. and have run the install using pip3 install mailman. The "mailman info" command works, version shows "3.3.3 (Tom Sawyer)" the databases creates, tables, all exist, etc. So it seems the necessary services are running. I'm running froxlor on the server to configure the non-mailman services (apache, ssl, postfix, etc). I had also tried apt install mailman-full but it was an older version, so using the pypi route ensured I was on the latest version. Looking at https://docs.mailman3.org/en/latest/install/virtualenv.html, what I can't figure out is: 1) There is no /opt/mailman/ user - the user installed seems to be "list" 2) Is a virtual environment needed for a production environment? 3) if django is setup properly or the webservice is working 4) I've tried to connect to some web interface (posterious/hyperkitty/some mailman3 web frontend) via lynx to localhost:8001 on the local machine - but it has a 404 error Anyone got any tips as to next steps? (I'm also happy to pay someone to coach me through it!) Cheers, Duane

3 2

Internal Server Error: /hyperkitty/list/my@lists.domain.eu/pop-threads
by Marco Marinello Feb. 24, 2021

Feb. 24, 2021

Dear all, I've setup my own instance of Hyperkitty working as archiver of a Mailman 3 server. It works fine but, sometimes, I get an email of a Django error: Internal Server Error: /hyperkitty/list/my(a)lists.domain.eu/pop-threads KeyError at /hyperkitty/list/my(a)lists.domain.eu/pop-threads 'file' Request Method: GET Django Version: 2.2.12 Python Executable: /usr/bin/python3 Python Version: 3.7.3 Traceback: File "/usr/local/lib/python3.7/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/local/lib/python3.7/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/local/lib/python3.7/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/local/lib/python3.7/dist-packages/hyperkitty/lib/view_helpers.py" in inner 129. if not is_mlist_authorized(request, mlist): File "/usr/local/lib/python3.7/dist-packages/hyperkitty/lib/view_helpers.py" in is_mlist_authorized 146. if mlist.list_id in get_subscriptions(request.user): File "/usr/local/lib/python3.7/dist-packages/django_mailman3/lib/mailman.py" in get_subscriptions 130. _get_value, 60, version=2) # 1 minute File "/usr/local/lib/python3.7/dist-packages/django/core/cache/backends/base.py" in get_or_set 167. default = default() File "/usr/local/lib/python3.7/dist-packages/django_mailman3/lib/mailman.py" in _get_value 122. for member in mm_user.subscriptions File "/usr/local/lib/python3.7/dist-packages/mailmanclient/restobjects/user.py" in subscriptions 66. 'members/find', data={'subscriber': address}) File "/usr/local/lib/python3.7/dist-packages/mailmanclient/restbase/connection.py" in call 112. error_msg, response, None) During handling of the above exception (HTTP Error 500: <html> <head> <title>Internal Server Error</title> </head> <body> <h1><p>Internal Server Error</p></h1> </body> </html> ), another exception occurred: File "/usr/local/lib/python3.7/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/local/lib/python3.7/dist-packages/django/utils/deprecation.py" in __call__ 94. response = response or self.get_response(request) File "/usr/local/lib/python3.7/dist-packages/django/core/handlers/exception.py" in inner 36. response = response_for_exception(request, exc) File "/usr/local/lib/python3.7/dist-packages/django/core/handlers/exception.py" in response_for_exception 95. exc_info=sys.exc_info(), File "/usr/local/lib/python3.7/dist-packages/django/utils/log.py" in log_response 228. exc_info=exc_info, File "/usr/lib/python3.7/logging/__init__.py" in error 1412. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.7/logging/__init__.py" in _log 1519. self.handle(record) File "/usr/lib/python3.7/logging/__init__.py" in handle 1529. self.callHandlers(record) File "/usr/lib/python3.7/logging/__init__.py" in callHandlers 1591. hdlr.handle(record) File "/usr/lib/python3.7/logging/__init__.py" in handle 905. self.emit(record) File "/usr/local/lib/python3.7/dist-packages/django/utils/log.py" in emit 119. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/local/lib/python3.7/dist-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.7/tempfile.py" in __getattr__ 614. file = self.__dict__['file'] Exception Type: KeyError at /hyperkitty/list/my(a)lists.domain.eu/pop-threads Exception Value: 'file' Request information: USER: myuser GET: No GET data POST: No POST data FILES: No FILES data Where did I go wrong? Best, Marco

2 3

Help with troubleshooting mailman3 DNS lookups
by Simon Handfield Feb. 24, 2021

Feb. 24, 2021

Dear users, hoping someone can point me in the right direction. Since we set up mailman3 on Ubuntu last year we have migrated to new DNS servers. The Ubuntu host's systemd-resolved service is correctly using the new DNS servers for lookups and postfix is honouring the change as well. However when messages are sent to mailman3 lists we're still seeing hits on the old DNS servers. I have tried to find a config that references the old servers but have not been able to find one. Can anyone provide a tip on where to look next or if there is something that mailman3 requires to recognise the change? Thanks, Simon. _ [State Library of NSW]<https://www.sl.nsw.gov.au/> Simon Handfield Desktop and Infrastructure Leader simon.handfield(a)sl.nsw.gov.au<mailto:simon.handfield@sl.nsw.gov.au> +61 2 9273 1535 Macquarie Street, Sydney NSW 2000, Australia www.sl.nsw.gov.au<https://www.sl.nsw.gov.au/> This message is intended for the addressee named and may contain confidential information. If you are not the intended recipient, please delete it and notify the sender. Views expressed in this message are those of the individual sender, and are not necessarily the views of their organisation.

2 1

Bounce Problems
by M4tze Feb. 23, 2021

Feb. 23, 2021

Dear List, I experience some strange effects regarding the bounce handling. The lists are configured with a bounce_info_stale_after = 7d and bounce_score_threshold = 5. (full config dump here: https://pastebin.com/42uTkdTJ) It just happend, that a user has been disabled but should not when regarding the config. The bounce log for the user looks like this: (see here: https://pastebin.com/bWRPa88H) If I understand the settings correctly, bounce_info_stale_after = 7d means that any bounce received > 7d ago are not counted (which would be intuitive). It seems, that there must be a 7d gap between the last bounce received and a new bounce to get the score reset to 1. Is my interpretation right? Is this intentional? Can this be changed? Kind regards - M4tze

2 1

list owner creation
by Christian Stalberg Feb. 22, 2021

Feb. 22, 2021

If one inadvertently deleted a list owner account, how could one either create a new account and make them a list owner -or- make an existing account a list owner? Thanks!

3 3

A new issue with installation
by Brian Carpenter Feb. 20, 2021

Feb. 20, 2021

As usual, a new issue has arisen with installing Mailman 3. It seems Postorius and Hyperkitty want to install a module called cryptography. Which I am unable to install because of this: error: Can not find Rust compiler Question 1: Is cryptography a new addition to Hyperkitty/Postorius? Or was cryptography always included and something else is different about my installation process? "Building wheels for collected packages: hyperkitty, django-haystack, django-mailman3, mailmanclient, robot-detection, rcssmin, django-allauth, cryptography" Question 2: Will Hyperkitty/Postorius work without cryptography? I haven't proceed with this installation once I received the above error. Question 3: Are there any Mailman 3/Postorius/HK documentation that addresses with the installation of cryptography? -- Brian Carpenter Harmonylists.com Emwd.com

4 8

more about spanish translations
by Guillermo Hernandez (Oldno7) Feb. 20, 2021

Feb. 20, 2021

I've just made a test creating a user in postorius to change an address that already has a suscription (from mailman 2.1). It's a test address with the digest enabled to be aware from any problem in the digest sending messages (e.g. I had to change all digest addresses to mime whe I did the migration from 2.1) The fact is that I cannot find from which template or Weblate term chains it could be from, and the address confirmation email is a language mix in spanish and english. I copy it down. I would like to translate it all, but as said, I cannot find where to do it. I wonder if it's comes from another package as allauth or something like this. Here is the mail: Subject: =?utf-8?q?=5Bescepticos=2Ees=5D_Por_favor_confirmar_direcci=C3=B3n_de_correo?= =?utf-8?q?_electr=C3=B3nico?= From: postorius(a)XXXXXXXXXXX.es To: XXXXXXXX(a)gmail.com Date: Fri, 19 Feb 2021 10:26:26 -0000 Message-ID: <161373038620.5080.16387108004007982309(a)XXXXXXX.es> X-Spam-Status: No, score=-1.0 required=8.0 tests=ALL_TRUSTED=-1,URIBL_BLOCKED=0.001 <dns:XXXXXXXXX.es> [172.67.131.28, 104.21.3.190] <dns:XXXXXXXXXX.es?type=MX> [0 XXXXXXXXXXXX.es.] autolearn=unavailable autolearn_force=no version=3.4.4 X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on XXXXXXXXXXX.es Hello from XXXXXXXXXXX.es! You're receiving this e-mail because user XXXXXXXXXX(a)gmail.com has given your e-mail address to register an account on XXXXXXXXXXXXXXX.es. To confirm this is correct, go to https://XXXXXXXXXXX.es/mailman3/accounts/confirm-email/MTM:1lD2zR:3GpALYKI1… Muchas gracias por usar XXXXXXXXXX.es! XXXXXXXXXXX.es

2 3

How to modify system preferences
by Jack Lenox Feb. 19, 2021

Feb. 19, 2021

Hello everyone, I've been making headway with getting Mailman 3 to run how I like it. However I've hit something of a road-block with system preferences. By that, I'm referring to the default set of preferences set out in the documentation here: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… The documentation states that these are only accessible in a read-only format via the REST API, but presumably there is a way of modifying these somewhere? I can't find a way of specifying this in my config and can't find a relevant example in the sample schema.cfg. At this stage, all I want to do is set the default for "receive_own_postings" to False. Can anyone point me in the right direction here? Many thanks! Jack

3 2

archiving problem & updates
by Christian Stalberg Feb. 19, 2021

Feb. 19, 2021

Archiving has stopped working. No changes were made to the server. How can I diagnose and troubleshoot this please? Are there instructions for how to update mailman3 somewhere? Is there a listing of bug fixes also? Thank you!

3 5

Membership list changes
by Vako Nicolian Feb. 18, 2021

Feb. 18, 2021

Using MM 2.1.33 When I send an email to /{list}-request(a){domain.com} /with /who <password> /on the subject line, I get a list of the members of the list. Here are my questions: A) Is there a way to export the list to cvs or txt format? B) Can we format the list to have it come in name 1st and then email C) display number of members D) Sort the list Thank you, Vako

2 1

spanish localization
by Guillermo Hernandez (Oldno7) Feb. 18, 2021

Feb. 18, 2021

I contributed in january to translate to spanish all the items left in Mailman Core, Django-mailman, HyperKitty and Postorius via Weblate. I thought they will be used in the next upgrade, but I cannot see any improvement and there are many words untranslated. Is there any way to upgrade the .po files in order to get the last translation? P.S.: I will follow translating the Weblate updates, by the way.

5 44

Mailman, etc. upgrade woes and persistent bugs
by hansen＠rc.org Feb. 18, 2021

Feb. 18, 2021

I just had my Mailman suite upgraded. When it got started, I starting receiving messages that hundreds of subscribers to the lists had been disables, including several of the list moderators. This version started supporting bounce processing, but how in the world was this upgrade allowed to act on bounces that were being collected PRIOR to enabling bounce processing?? I got many angry emails, messages and phone calls asking what was going on, as they were bona fide list members. I was very surprised myself. I then looked at several of the disabled accounts, but the subscription info page in Postorius had no information about whether an account was enabled or disabled. Why is this not displayed???. The members can't see if their account is enabled. Is this another example of the disconnect between Mailman and Postorius? Further, even after the upgrade, the moderators still cannot access the list memberships even though all the lists are set to allow that. I would have asked the moderators to do this if this access bug had been fixed, but they can't get there. As a result of these bugs, after consulting with Brian, who helped with the upgrade, I spent many hours re-enabling the several hundred accounts that had been disabled. I had to go through each email notification to find the address of a disabled account, then find the list, then the member, in Postorius, and finally enable the account (at which time Postorius DID show the enabled status). Please, can the next upgrade include these very basic fixes/enhancements, which I requested a long time ago: a. The ability of moderators to see the list membership (a bug). b. The ability of members to change their addresses for all lists they are subscribed to. and further, now: c. That when members go to look at their subscription info, they can actually see the settings. Thank you, Allan

8 36

Mailman3 crashes on restart
by Gelpi Andrea Feb. 18, 2021

Feb. 18, 2021

After restarting my mail server mailman3 does not start any more. Mailman3 in on a debian 10. I upgraded the django packets but no result. This the syslog output. Feb 17 17:00:24 posta mailman3[21303]: Traceback (most recent call last): Feb 17 17:00:24 posta mailman3[21303]: File "/usr/bin/mailman", line 11, in <module> Feb 17 17:00:24 posta mailman3[21303]: load_entry_point('mailman==3.2.1', 'console_scripts', 'mailman')() Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__ Feb 17 17:00:24 posta mailman3[21303]: return self.main(*args, **kwargs) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main Feb 17 17:00:24 posta mailman3[21303]: rv = self.invoke(ctx) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 69, in invoke Feb 17 17:00:24 posta mailman3[21303]: return super().invoke(ctx) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke Feb 17 17:00:24 posta mailman3[21303]: return _process_result(sub_ctx.command.invoke(sub_ctx)) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke Feb 17 17:00:24 posta mailman3[21303]: return ctx.invoke(self.callback, **ctx.params) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke Feb 17 17:00:24 posta mailman3[21303]: return callback(*args, **kwargs) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func Feb 17 17:00:24 posta mailman3[21303]: return f(get_current_context(), *args, **kwargs) Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/mailman/commands/cli_control.py", line 81, in start Feb 17 17:00:24 posta mailman3[21303]: status, lock = master_state() Feb 17 17:00:24 posta mailman3[21303]: File "/usr/lib/python3/dist-packages/mailman/bin/master.py", line 104, in master_state Feb 17 17:00:24 posta mailman3[21303]: os.kill(pid, 0) Feb 17 17:00:24 posta mailman3[21303]: PermissionError: [Errno 1] Operation not permitted Feb 17 17:00:24 posta systemd[1]: mailman3.service: Control process exited, code=exited, status=1/FAILURE Feb 17 17:00:24 posta systemd[1]: mailman3.service: Failed with result 'exit-code'. Any idea? What have I to check? Thanks -- Gelpi ing. Andrea ************************************************** I documenti vitali dimostreranno la loro vitalitˆ spostandosi spontaneamente da dove li avevate lasciati a dove non riuscirete a trovarli. **************************************************

4 5

Re: Mailman, etc. upgrade woes and persistent bugs
by Ruth Ivimey-Cook Feb. 18, 2021

Feb. 18, 2021

Steve, What I mean by per-user permissions is that some transitions, for example bounce-disabled to enabled, should be only possible by someone with appropriate permission to do so -- perhaps the list admin, perhaps someone else, but not just anyone. Another example _could_ be if a user disables themselves then only that user can re-enable them again (though I can see that might not be good). Of course, you can to some extent group users by role, so 'admin' role is always ok, 'list-owner' role is ok for any action on that list, etc. If you had a 'role' which was 'account-owner' then you can probably code the rule for re-enabling an account disabled by the account owner as "role = admin or role = list-owner or role = account-owner". Whether this needs to be extended to "role=admin or user = guy" (where 'guy' is a named account holder) I don't know... I suspect it would be better if that wasn't done unless it was shown to be necessary, as "here be dragons". Do you see where I'm at? In writing this up it occurs to me that being able to see/edit rules such as these, stored in per-list config, would probably be a good thing. Don't know how practical that is though. Regards, Ruth On 16/02/2021 15:29, Stephen J. Turnbull wrote: > Hi, Ruth, > > Thanks for the comments. I'll have to think about most of it, but I > have one immediate question. > > Ruth Ivimey-Cook writes: > > > > On 13/02/2021 16:34, Stephen J. Turnbull wrote: > > > > I don't think separate booleans is a good idea, since they're > > > basically mutually exclusive states[.] > > > > While using one variable makes some sense as you say, it does > > complicate the allowed state transitions especially when per-user > > permissions as well as logic are applied to the situation. > > I don't understand how "per-user permissions" apply here. > > Regards, > Steve -- Software Manager & Engineer Tel: 01223 414180 Blog: http://www.ivimey.org/blog LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/

4 4

Rebuilding a list index fails
by Mark Dadgar Feb. 18, 2021

Feb. 18, 2021

Now that I’ve got my instance back up and running on the latest released code, I am trying to rebuild a list index. I am using Xapian via haystack, which worked beautifully before my recent list meltdown. Error messages below. rebuild_index fails with the same error. This is with django version 3.0.12. I am sure I missed reinstalling something or there’s a version mismatch. Thoughts? - Mark ----- mark(a)pdc-racing.net | 408-348-2878 —— (venv) mailman@mail:/opt/mailman/mm/bin$ ./django-admin update_index_one_list xxxxxxs(a)pdc-racing.net Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 401, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 395, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 328, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 369, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/update_index_one_list.py", line 41, in handle update_index(listname=options.get("listname")[0], File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/search_indexes.py", line 117, in update_index update_cmd.update_backend("hyperkitty", "default") File "/opt/mailman/mm/venv/lib/python3.8/site-packages/haystack/management/commands/update_index.py", line 280, in update_backend backend = haystack_connections[using].get_backend() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/haystack/utils/loading.py", line 115, in __getitem__ self.thread_local.connections[key] = load_backend( File "/opt/mailman/mm/venv/lib/python3.8/site-packages/haystack/utils/loading.py", line 61, in load_backend return import_class(full_backend_path) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/haystack/utils/loading.py", line 23, in import_class module_itself = importlib.import_module(module_path) File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 671, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 783, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/opt/mailman/mm/venv/lib/python3.8/site-packages/xapian_backend.py", line 10, in <module> from django.utils import six ImportError: cannot import name 'six' from 'django.utils' (/opt/mailman/mm/venv/lib/python3.8/site-packages/django/utils/__init__.py)

3 5

3rd Party Account is not working
by kwp.klein＠gmail.com Feb. 17, 2021

Feb. 17, 2021

I installed Mailman 3 with Postfix. I try to login with the 3rd Party Account. It is not possible, because I get this error message: Server error An error occurred while processing your request.

7 13

ham-confirm+3ee85b006eeb5897ca6f53b093cb063672f6a784@example.com
by Jörg Klein Feb. 17, 2021

Feb. 17, 2021

I want add some subscribers. When the I get this error message: I have no address ham-request(a)example.com. Do I need for every mailing list more as the mailing list email address? Final-Recipient: rfc822; ham-request(a)example.com Action: failed Status: 5.0.0 Remote-MTA: dns; mx0.example.com. (80.237.138.5, the server for the domain example.com.) Diagnostic-Code: smtp; 550 Address invalid (ID:550:1:1 (mi015.mc1.hosteurope.de)) Last-Attempt-Date: Wed, 17 Feb 2021 01:13:18 -0800 (PST)

2 3

List is down - RemovedInDjango30Warning
by Mark Dadgar Feb. 17, 2021

Feb. 17, 2021

So I did the latest mailman upgrades within my venv (per the instructions got from Brian Carpenter when he installed it for me) to the latest version. I had a strange CPU pegging issue that turned out to be mailman struggling with a malformed message but in the process of debugging that I downgraded to the previous mailman release. The resulted in a broken web interface. Today, while debugging, I did a pip install --upgrade of all the components as listed in a previous thread. Now none of the mailman3 processes will start. Doing a bin/mailman-post-update results in the error message below, which are consistent with the issues I saw earlier when trying to access the web interface. Anyone got a solution to this? I suspect it’s something simple, but django is just not my area of expertise. Thanks! - Mark ----- mark(a)pdc-racing.net | 408-348-2878 ——— (venv) mailman@mail:/opt/mailman/mm/bin$ ./mailman-post-update + '[' False == False ']' + mkdir -p /opt/mailman/mm/static + /opt/mailman/mm/bin/django-admin collectstatic --clear --noinput --verbosity 0 + /opt/mailman/mm/bin/django-admin compress Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/utils.py", line 66, in __getitem__ return self._engines[alias] KeyError: 'django' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/backends/django.py", line 121, in get_package_libraries module = import_module(entry[1]) File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1014, in _gcd_import File "<frozen importlib._bootstrap>", line 991, in _find_and_load File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 671, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 783, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/contrib/admin/templatetags/admin_static.py", line 5, in <module> from django.utils.deprecation import RemovedInDjango30Warning ImportError: cannot import name 'RemovedInDjango30Warning' from 'django.utils.deprecation' (/opt/mailman/mm/venv/lib/python3.8/site-packages/django/utils/deprecation.py) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 401, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 395, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 328, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 369, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/compressor/management/commands/compress.py", line 277, in handle self.handle_inner(**options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/compressor/management/commands/compress.py", line 300, in handle_inner offline_manifest, block_count, results = self.compress(engine, extensions, verbosity, follow_links, log) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/compressor/management/commands/compress.py", line 100, in compress if not self.get_loaders(): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/compressor/management/commands/compress.py", line 50, in get_loaders for e in engines.all(): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/utils.py", line 90, in all return [self[alias] for alias in self] File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/utils.py", line 90, in <listcomp> return [self[alias] for alias in self] File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/utils.py", line 81, in __getitem__ engine = engine_cls(params) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/backends/django.py", line 25, in __init__ options['libraries'] = self.get_templatetag_libraries(libraries) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/backends/django.py", line 43, in get_templatetag_libraries libraries = get_installed_libraries() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/backends/django.py", line 108, in get_installed_libraries for name in get_package_libraries(pkg): File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/template/backends/django.py", line 123, in get_package_libraries raise InvalidTemplateLibrary( django.template.library.InvalidTemplateLibrary: Invalid template library specified. ImportError raised when trying to load 'django.contrib.admin.templatetags.admin_static': cannot import name 'RemovedInDjango30Warning' from 'django.utils.deprecation' (/opt/mailman/mm/venv/lib/python3.8/site-packages/django/utils/deprecation.py)

2 2

Imported Digest Settings
by Brian Carpenter Feb. 17, 2021

Feb. 17, 2021

I am still seeing digest formatting issues with the import of Mailman 2 lists into Mailman 3. I am running the latest stable version of Mailman 3 core which is 3.3.3. This is what my client reported: > For the last three REDACTED digests I have been getting unusual and > unreadable characters? See example below. > >> Begin forwarded message: >> >> *From: *REDACTED >> *Subject: *REDACTED*Digest, Vol 2453, Issue 2* >> *Date: *February 13, 2021 at 12:30:24 AM PST >> *To: *REDACTED@REDACTED >> *Reply-To: *REDACTED@REDACTED >> >> �P*+]4�LaG@��[� S� XZ[ [�� \� �X�Z\��[ۜ� ‚] [� [�ܙ‚� � �X��ܚX�H ܈ >> [��X��ܚX�H �XH [XZ[ �[� H Y\��Y�H �] �X�X� ܂�� H� [ � ‚] [�\�\]Y\� >> [�ܙ‚�[�H �[� �XX� H \��ۈ X[�Y�[�� H \� ] �] [�[#<^_NSEDR_^#<ۙ\� >> [�ܙ‚�� [� �\ Z[�� X\�H Y ] [�\� �X�X� [�H �� ] \� [ܙH � X�Y�X [� �N� >> �۝ [� � و S� Y�\� �� ^I�� X�΂� K� �N� [� \� � [\ � >> �� ] >> \�B�KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKB�Y\��Y�N�B� >> ] N� �K L� �X��HL ��N�� L ��N� �� ] \� �� ] >> \�]\�X˘��O��X�X� � � S�H �N� [� \� � [\ • Έ �� [�Y[ �� [�Y[ >> ]ܙ[��K�Y O��Έ � S� H �[\ ] ^Y\�� [� \�] [ۘ[ �] �ܚˈ� [� >> [�ܙς�Y\��Y�KRQ � Q� >> � >> KM�� M� N Q �P��PL �P �] \�]\�X˘��O��۝ [� U \ N� ][ \ \� �[ \�] >> ]�N‚X��[� \�OP\ KSXZ[ M ь P�KL�L�KM ��KP�KM��̌#<^_NSEDR_^#<͌ >> L �Y\� H [�� YX�� H \� Y �[[^H [� � X� \� [�� Y] [�� Y�ܙH H Y� >> \� [� ] �Y[\� �\� Y [� �� \�H ��\ ] H ] [ � H �\� ۙH و \� � Y [� ˈ [ >> [�� ]�\�] [�� H �]�H YK �\� [� ]�Y X[ \ \�� [� �\�[ [�� X� [ۜˈ H >> �\�[ [�� X� [ۋ �H �\� �\� H [�� [\ ܝ [� [� �[ XX� H \� � H ۸�&] [�� >> H �]�H [ و \� � Y [� � H �[YH X] \�X[ ˈ ] �\� H ]X� [ܙH >> \�#<^_NSEDR_^#<ۘ[ ^�Y \ ��X� �܈ XX� � Y [� � H ��Y� \� �� ] H [� >> ܚ] [� � Y� H �]�H YH H \�� Y [� ]�[� ] � �� Y\� >> [�H ]�H � �H � � ۛ�� Y� ] \�JK ��\� �܈ �^[ۙ ] � [�� ] \��[� >> ��H ^H T ۙB� ۈ �X�L So the questions I have are: 1. Why does the formatting of digests change for some members when coming from MM2 to MM3? 2. What proble does the above example reveal? 3. What is the best approach to mitigate these issues? What I did: I had the client change the list member's digest setting from plain-text to mime. Was that the right instruction to do? -- Brian Carpenter Harmonylists.com Emwd.com

2 6

Bottom line of message footer
by Tom Stoddard Feb. 15, 2021

Feb. 15, 2021

Here's another question that I have. A regular message just came into my email from one of the lists I'm a member of and it had a 3 line footer. The first two lines are fine, they just include the list's email address and an address to send unsubscribe requests to. The third line is this: %(web_page_url)slistinfo%(cgiext)s/%(_internal_name)s It looks to me like it should be a link to the group's list info page. Is this a bug or is there something I can do to fix it? It looks like it might be missing a forward slash after the first "s".

3 2

Unknown templates being used
by Tom Stoddard Feb. 15, 2021

Feb. 15, 2021

I'm a list owner who has recently (within the last week) had my lists migrated from mailman 2 to mailman 3. The UI that we are using is Affinity. I've reviewed all of the list templates and begun to customize some of them. My issue is that I'm receiving messages that don't match any of the templates. Here is an example of one that I just received this morning. (The x's are inserted by me. The actual message provided valid addresses.) The xxxxxxxxxx(a)xxxxxxxxxx.org list has 1 moderation requests waiting. Held Subscriptions: User:xxxxxxxxxx@gmail.com Please attend to this at your earliest convenience. When I log in to review the request it appears to be a subscription request awaiting approval. I had previously modified the "Moderator Approval Subscription" template, which is what I would expect to have received in this circumstance. I administer several lists and have received some messages that do use the newly modified template so I assume I did it correctly. Any idea where the template for this message came from? Thanks!

3 5

Dealing with recipients' servers spam filtering
by Gilles Filippini Feb. 13, 2021

Feb. 13, 2021

Hi, I run a mailman3 instance with mainly private lists for which I know and trust every single member. Some of them have Hotmail email addresses, and the messages they send though our lists are rejected as being spam by most of the recipients' mail servers, while these are legitimate emails. I'd welcome any pointer to best practices / howtos regarding mailman3 / exim4 configuration to mitigate this problem. Many thanks in advance, _g.

3 5

Mailman 3 installation from latest Debian packages
by Matthew Blissett Feb. 12, 2021

Feb. 12, 2021

Hi, I've installed mailman3-full 3.3.3-1 from Debian bullseye (Debian testing). The dropdown controls on the UI for Postorius (e.g. "Subscription requests", "Mass operations" and the username button to log out) and the similar controls on Hyperkitty (e.g. "Threads by month") do not work. You can see the latter at http://newlistszm.gbif.org/mailman3/hyperkitty/list/test@newlistszm.gbif.or… I found https://lists.gem5.org/archives/list/gem5-announce@gem5.org/ which is running the same version, but presumably not using these Debian packages as the Javascript is slightly different. Could this be a problem with the Debian packaging, or perhaps my configuration -- which is very close to the defaults (i.e. Mailman and Apache configuration generated by dpkg). Has anyone set up a working installation using these packages? Thanks, Matt Blissett PS, I wrote a similar message earlier in the week to a Debian list: https://alioth-lists.debian.net/pipermail/pkg-mailman-hackers/2021-February…

4 3

Innstall and run Mailman 3 with Postfix in a Docker enviroment
by kwp.klein＠gmail.com Feb. 11, 2021

Feb. 11, 2021

## Install Mailman 3 The idea is to install Mailman 3 in ad docker container. Also I want to install Postfix in a container. All the mail which will send and receive should handled in a docker container. The reason is, that on the server only applications in a docker environment working. There is no MTA installed. On the server are Discourse as forum, wikijs, portainer, watchtower, homepage, and the NGINX Proxy Manager installed. At next I need Mailman 3. I don't know how to install and run Postfix for Mailman in a docker environment. Here is my first try. I can visit the site lists.example.com, but I can not set the Admin password. I think the reason is, that the MTA not working. I have a gitlab repo. If you like please look here: https://gitlab.com/joklein/mailman ### Configure the docker-compose.yml file ```yml version: '2' services: postfix: image: mailu/postfix restart: unless-stopped container_name: postfix volumes: - /opt/mailman/postfix:/etc/postfix/main.cf.d - /opt/mailman/core:/opt/mailman ports: - "25:25" networks: mailman: ipv4_address: 172.19.199.6 services: mailman-core: image: maxking/mailman-core:0.3 restart: unless-stopped stop_grace_period: 30s container_name: mailman-core hostname: mailman-core volumes: - /opt/mailman/core:/opt/mailman links: - database:database depends_on: - database environment: - DATABASE_URL=postgres://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=postgres - DATABASE_CLASS=mailman.database.postgresql.PostgreSQLDatabase - SMTP_HOST=172.19.199.1 - HYPERKITTY_API_KEY=ZawB3NGBUgbmQcMGhZ0kYIW0WRNw8P9osEudsGiFZWv networks: mailman: ipv4_address: 172.19.199.2 mailman-web: image: maxking/mailman-web:0.3 container_name: mailman-web restart: unless-stopped hostname: mailman-web ports: - "8000:8000" depends_on: - database links: - mailman-core:mailman-core - database:database volumes: - /opt/mailman/web:/opt/mailman-web-data environment: - DATABASE_TYPE=postgres - DATABASE_URL=postgres://mailman:mailmanpass@database/mailmandb - HYPERKITTY_API_KEY=ZawB3NGBUgbmQcMGhZ0kYIW0WRNw8P9osEudsGiFZWv - UWSGI_STATIC_MAP=/static=/opt/mailman-web-data/static - SERVE_FROM_DOMAIN=lists.example.com - MAILMAN_ADMIN_USER=admin - MAILMAN_ADMIN_EMAIL=lists(a)example.com - SECRET_KEY=mailmangeheim networks: mailman: ipv4_address: 172.19.199.3 database: image: postgres:9.6-alpine restart: unless-stopped environment: POSTGRES_DB: mailmandb POSTGRES_USER: mailman POSTGRES_PASSWORD: mailmanpass volumes: - /opt/mailman/database:/var/lib/postgresql/data networks: mailman: ipv4_address: 172.19.199.4 networks: mailman: driver: bridge ipam: driver: default config: - subnet: 172.19.199.0/24 ``` #### Build the API Key für Hyperkitty and SECRET_KEY You can build a key with `pwgen -s 128` #### Make some directorys ```sh mkdir -p /opt/mailman/core mkdir -p /opt/mailman/web mkdir -p /opt/mailman/mailman-web-data/static ``` #### Make a file in /opt/mailman/web/settings_local.py ```sh EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = '172.19.199.1' EMAIL_PORT = 25 USE_SSL = False DEFAULT_FROM_EMAIL = "<E-MAIL>" SERVER_EMAIL = "<E-MAIL>" ``` Change the `<E-MAIL>` with your server address. For example `mailman(a)lists.example.com` So that Postfix also sends your e-mails, you create the file `/opt/mailman/core/mailman-extra.cfg` with the following content: ```sh [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 172.19.199.2 lmtp_port: 8024 smtp_host: 172.19.199.1 smtp_port: 25 configuration: /etc/postfix-mailman.cfg ``` Now you are ready to start your container: ```sh sudo su - cd /root/mailman-docker docker-compose up -d ``` #### Check the mailman images ```sh docker ps -a CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES f6990a2f808f maxking/mailman-web:0.3 "docker-entrypoint.s…" 55 seconds ago Up 52 seconds 8000/tcp, 8080/tcp mailman-web a7fa6334b2b8 maxking/mailman-core:0.3 "docker-entrypoint.s…" 58 seconds ago Up 54 seconds 8001/tcp, 8024/tcp mailman-core e8812dc42663 postgres:9.6-alpine "docker-entrypoint.s…" About a minute ago Up 57 seconds 5432/tcp docker-mailman_database_1 ``` #### Check the conection ```sh curl http://172.19.199.3:8000/postorius/lists/ ```

2 2

error when starting the mailman executable from the venv
by Christian Stalberg Feb. 10, 2021

Feb. 10, 2021

I tried to access a 'held' message and got the 'Mailman REST API not available. Please start Mailman core.' error message. When I went to start the mailman executable from the venv I get this #~mailman/mm/venv/bin/mailman start Starting Mailman's master runner Generating MTA alias maps Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/mailman", line 11, in <module> load_entry_point('mailman==3.3.2', 'console_scripts', 'mailman')() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 782, in main rv = self.invoke(ctx) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman/bin/mailman.py", line 68, in invoke return super().invoke(ctx) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 1259, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click/decorators.py", line 21, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman/commands/cli_control.py", line 131, in start os.execl(*execl_args) File "/usr/lib/python3.7/os.py", line 539, in execl execv(file, args) TypeError: expected str, bytes or os.PathLike object, not NoneType Please advise. Thank you. ~Christian

2 3

Problems with web interface after upgrade
by Victoriano Giralt Feb. 10, 2021

Feb. 10, 2021

Hi, I just applied all the recipes that have been recently posted for upgrading (pip install --upgrade of all pieces, migrate, collectstatic) The compress part refuses to work "OFF_LINE", whatever that is. I tried with mailman running and stopped. I can access hte main Postorius page and the basic list information, but I cannot login nor access the archives. Operations end on two exceptions logged to the log file (and two mail messages to the owner = me). Very similar to what I get if I try to --force the "compress". I'm sure I'm missing somethning, but do not know what ... Thanks! Traceback: ERROR 2021-02-09 19:57:41,414 726 django.request Internal Server Error: /listas/accounts/login/ Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 263, in precompile mod = import_module(mod_name) File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 994, in _gcd_import File "<frozen importlib._bootstrap>", line 971, in _find_and_load File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked ModuleNotFoundError: No module named 'sassc -t compressed {infile} {outfile}' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.6/site- packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/usr/local/lib/python3.6/site- packages/django/core/handlers/base.py", line 145, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/local/lib/python3.6/site- packages/django/core/handlers/base.py", line 143, in _get_response response = response.render() File "/usr/local/lib/python3.6/site- packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/usr/local/lib/python3.6/site- packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/usr/local/lib/python3.6/site- packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 171, in render return self._render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 904, in render_annotated return self.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 904, in render_annotated return self.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "/usr/local/lib/python3.6/site- packages/django/template/base.py", line 904, in render_annotated return self.render(context) File "/usr/local/lib/python3.6/site- packages/compressor/templatetags/compress.py", line 131, in render return self.render_compressed(context, self.kind, self.mode, forced=forced) File "/usr/local/lib/python3.6/site- packages/compressor/templatetags/compress.py", line 107, in render_compressed rendered_output = compressor.output(mode, forced=forced) File "/usr/local/lib/python3.6/site-packages/compressor/css.py", line 49, in output ret.append(subnode.output(*args, **kwargs)) File "/usr/local/lib/python3.6/site-packages/compressor/css.py", line 51, in output return super(CssCompressor, self).output(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 295, in output output = '\n'.join(self.filter_input(forced)) File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 235, in filter_input for hunk in self.hunks(forced): File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 205, in hunks precompiled, value = self.precompile(value, **options) File "/usr/local/lib/python3.6/site-packages/compressor/base.py", line 268, in precompile return True, filter.input(**kwargs) File "/usr/local/lib/python3.6/site- packages/compressor/filters/base.py", line 229, in input return super(CachedCompilerFilter, self).input(**kwargs) File "/usr/local/lib/python3.6/site- packages/compressor/filters/base.py", line 196, in input raise FilterError(err) compressor.exceptions.FilterError: Error: It's not clear which file to import for '@import "../libs/bootstrap/stylesheets/bootstrap"'. Candidates: ../libs/bootstrap/stylesheets/_bootstrap.scss ../libs/bootstrap/stylesheets/bootstrap.scss Please delete or rename all but one of these files. on line 4 of static/hyperkitty/sass/hyperkitty.scss >> @import "../libs/bootstrap/stylesheets/bootstrap"; ^ -- Victoriano Giralt Innovation Director Digital Transformation Vicerectorate University of Malaga +34952131415 SPAIN ================================================================== Note: signature.asc is the electronic signature of present message A: Yes. > Q: Are you sure ? >> A: Because it reverses the logical flow of conversation. >>> Q: Why is top posting annoying in email ?

3 6

Reason for Shunting
by Brian Carpenter Feb. 9, 2021

Feb. 9, 2021

Is there a way to determine why a message keeps ending up in the shunt queue? -- Brian Carpenter Harmonylists.com Emwd.com

2 4

Running Mailman3 v3.2.1 on Devuan 10.0, getting a pid permissions error on Mailman3-web
by rainbear＠gmail.com Feb. 9, 2021

Feb. 9, 2021

# service mailman3-web stop [....] Stopping Mailman3-web uWSGI service: mailman3-webstart-stop-daemon: matching on world-writable pidfile /run/mailman3-web/mailman3-web.pid is insecure # ls -l /run/mailman3-web/mailman3-web.pid -rw-rw-rw- 1 root root 6 Feb 9 13:00 /run/mailman3-web/mailman3-web.pid # mailman info GNU Mailman 3.2.1 (La Villa Strangiato) Python 3.7.3 (default, Jul 25 2020, 13:03:44) [GCC 8.3.0] config file: /etc/mailman3/mailman.cfg db url: sqlite:////var/lib/mailman3/data/mailman.db devmode: DISABLED REST root url: http://*obscured*:8001/3.1/ REST credentials: *obscured* Any help, as always, is greatly appreciated. It's been a while, my old server died on me a few years back, and I'm finally getting around to getting a new one set up. I'd been looking forward to MM3 for *ages*! I can't wait to play! :-D Thank you in advance! If I forgot any relevant info, I'm happy to provide. Best, --Glenn

2 1

API access to Hyperkitty
by Brian Carpenter Feb. 9, 2021

Feb. 9, 2021

Is it possible to download Hyperkitty's archives to a remote server via an API? Is there documentation that explains how to accomplish this task? -- Brian Carpenter Harmonylists.com Emwd.com

3 2

Hyperkitty_import.py Error
by Brian Carpenter Feb. 9, 2021

Feb. 9, 2021

I am trying to import some old archives (going back to 2003) into a Mailman 3 list. The import job is terminating very early in the process with the following error: IndexError: string index out of range 1. Is there a way to fix a mbox file that is generating this type of error? 2. If a message is causing this error, is there a way to import the rest of the mbox file by importing messages after a certain date within the mbox file? I know the --since flag should be able to do that but I am unsure what the date/time format should be. 3. The --no-sync--mailman flag indicates the possibility of doing batch imports. What are batch imports and how do you do them? Thanks! -- Brian Carpenter Harmonylists.com Emwd.com

2 2

Implicit Destination Meaning
by Brian Carpenter Feb. 9, 2021

Feb. 9, 2021

I just migrated a MM2 list to MM3. The client had no problem sending posts to his list with MM2. However when he posted to his MM3 list, it showed up in the moderation queue: ============ Your mail to 'dogs(a)lists.redacted.org' with the subject mailing list changes Is being held until the list moderator can review it for approval. The message is being held because: Message has implicit destination Either the message will get posted to the list, or you will receive notification of the moderator's decision. =========== Is there a List Setting somewhere that needs to be adjusted to allow this sender to post without moderation? -- Brian Carpenter Harmonylists.com Emwd.com

2 1

Moderator Approval Subscription template
by Brian Carpenter Feb. 9, 2021

Feb. 9, 2021

Hey all, I am seeing a strange issue with the Moderator Approval Subscription template. 1. First problem is that this template by default does not include a URL to the list admin page of said mailing list. Mailman 2's notifications did. 2. Problem 1 can be solved by editing the template and adding the List Owner (admin) url to moderate the subscription. However in the case of long URLs, the URL is getting cut-off in Thunderbird. Not sure about other email clients. So something like: https://list.redeacted.org/admin/list/oligodendroglioma.list.redacted.org comes through to Thunderbird like: https://list.redacted.org/admin/list/oligodendroglioma.list.redact (<-- This is hyperlinked but leaves out the ed.org portion) ed.org (<--- This is not hyperlinked) -- Brian Carpenter Harmonylists.com Emwd.com

2 2

Postorius upgrade issue
by Ruth Ivimey-Cook Feb. 9, 2021

Feb. 9, 2021

Folks, I upgraded mailman-web and mailman-core to 3.3.3 in the manner suggested recently (pip install -U) and all seemed well, but have now noticed a strange bug. On the Postorius list admin page (where moderated subscriptions etc can be seen) although the top horizontal menu is present and the links exist, all the links are to that page (i.e. href="#') Is this a known issue, and how can I fix it? Pre upgrade all was well. Regards, Ruth -- Software Manager & Engineer Tel: 01223 414180 Blog: http://www.ivimey.org/blog LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/

3 5

Sync list members
by Brian Carpenter Feb. 8, 2021

Feb. 8, 2021

Hello, Outside of using the REST API, are there any other ways to sync a Mailman 3 roster with a file that contains list members? -- Brian Carpenter Harmonylists.com Emwd.com

2 2

KeyError: 'get_requests_count' after an upgrade
by Guillermo Hernandez (Oldno7) Feb. 8, 2021

Feb. 8, 2021

I've just upgrade mailman 3 installation following Mr. Sapiro advice: did a pip install --upgrade django-mailman3 hyperkitty mailman mailmanclient mailman-hyperkitty postorius I did a "python3 manage.py migrate" after, too. And all seemed to run well. All the lists showed in postorius via web, but when I try to accesss into one of them the browser shows an error. In the log you can see: *-*-*-*-*-*-* Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", line 119, in __getattr__ return self._get(name) File "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", line 86, in _get raise KeyError(key) KeyError: 'get_requests_count' ... (And after all the traceback lines) AttributeError: 'MailingList' object has no attribute 'get_requests_count' *-*-*-*-*-*-*-* The lists seem to be distributing messeages well.. but I cannot acces via web administration (django/postorius) Can anyone point me in the right direction to solve this, please?

3 11

Footer
by Eric Broens Feb. 7, 2021

Feb. 7, 2021

Hi, I have created a footer via the webUI "Templates" option, but it is not included in the mails distributed by the mailinglist. From information given in other threads, I checked the DB, and the entry for this footer is created in the template table. The uri for the footer is http://localhost:8000/postorius/api/templates/list/..., but there is no process listening on port 8000. Do I need to install/configure something additionally to get a process listening on port 8000? Thanks in advance,Eric

2 2

Clone or copy Mailman list
by w.schoener＠alp.dillingen.de Feb. 5, 2021

Feb. 5, 2021

Hi there, i am using a mailman 3.2.1, core Api 3.0, Mailman Core Python Version 3.7.3. I have to create a large number of Mailman lists, all with the simulare settings. Is there a way to clone a list with all settings an another list name? Thank you :-) Wolfgang

2 1

Module Not Found Error after update
by Brian Carpenter Feb. 5, 2021

Feb. 5, 2021

I went to upgrade Mailman 3/Hyperkitty/Postorius on a development server: |pip install --upgrade postorius hyperkitty mailman| The above was done as the user mailman in a venv. I then proceed to run the ./mailman-post-update script in the bin directory. The script through an exception with the following line saying: ModuleNotFoundError: No module named 'django_mailman3.lib.user' Please advise. -- Brian Carpenter Harmonylists.com Emwd.com

3 4

is it possible to rebuild mailman-web database please?
by Giovanni Biscuolo Jan. 30, 2021

Jan. 30, 2021

Hello, I'm pretty new to mailman3, especially it's internals. I upgraded a (running fine) mailman3 service from NixOS 20.03 https://nixos.wiki/wiki/Mailman to NixOS 20.09 https://nixos.org/manual/nixos/stable/index.html#module-services-mailman After the upgrade I got this very same issue: https://gitlab.com/mailman/hyperkitty/-/issues/328 --8<---------------cut here---------------start------------->8--- mailman mailman-web-setup-start[1832]: raise utils.IntegrityError( mailman mailman-web-setup-start[1832]: django.db.utils.IntegrityError: The row in table 'hyperkitty_attachment' with primary key '1' has an invalid foreign key: hyperkitty_attachment.email_id contains a value '7' that does not have a corresponding value in hyperkitty_email__old.id. --8<---------------cut here---------------end--------------->8--- I was not able to fix the migration issue so I recreated the mailman-web sqlite database (/var/lib/mailman-web) using the "migrate" function. After that, and after recreating the database many times, I'm getting this error when trying to access the web interface: --8<---------------cut here---------------start------------->8--- Jan 26 11:34:30 OMISSIS env[18167]: django.db.utils.OperationalError: no such table: django_site --8<---------------cut here---------------end--------------->8--- Actually the django_site table is in the database so I can't understand why of this message. Please is there a way to recreate the mailman-web database from scratch or to fix this kind of problems? Thanks! Giovanni -- Giovanni Biscuolo

2 1

So near, and yet so far (Configuring Mailman)
by j＠cklenox.earth Jan. 30, 2021

Jan. 30, 2021

Hello all, I've spent more time than I care to admit trying to configure Mailman. And I almost have it all working now, but I just can't seem to get my Mailman/Postfix combo to receive emails. When I try to send emails to lists I'm rebuffed with undelivered notices with: <testlist(a)lists.fiftyshadesof.green>: Host or domain name not found. Name service error for name=lists type=AAAA: Host not found and: <testlist(a)lists.fiftyshadesof.green>: Host or domain name not found. Name service error for name=lists.fiftyshadesof.green type=MX: Host not found, try again This to me appears to be an issue with my DNS settings, but I can't work this out either. I have an A record for lists.fiftyshadesof.green pointing at my server, and an MX record pointing at that: lists.fiftyshadesof.green. 0 IN MX 0 lists.fiftyshadesof.green. lists.fiftyshadesof.green. 0 IN A 193.37.35.191 I have driven myself mad with this and would very much appreciate any advice anyone can offer. Many thanks! Jack

5 5

API errors making member changes to one list but not others
by Stephen Willey Mats Mats Jan. 28, 2021

Jan. 28, 2021

We had an issue with the UI getting API timeouts for a single list for specific functions but not other lists or other functions. This started happening after we accidentally filled the disk partition used by most of the system including the database. There was a single person testing at the time when the disk fullness happened and it was only the single list that got ‘damaged’. After disk cleanup and restarting the docker images the single list would give API errors ("HTTP Error 400: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5)” ) on the screen and logged errors (below) when list members were either subscribed or removed. The issue was repeatable in Postorius and did not ‘heal’. Oddly the issue was resolved by making seemingingly the same API calls from the command line via curl. Making the below call to add a member succeeded and fixed being able to add members in the UI. Similarly sending a DELETE cal from curl worked where unsubscribe requests from postorius (either mass removal or picking addresses from the list member and unsubscribing selected) failed. Again, the unsubscribe from the curl DELETE call ‘healed’ the list such that subsequent unsubscribes in Postorius worked. curl --user user:password -X POST -d 'list_id=laura-test.mm3.aca-aws.s.uw.edu' -d 'subscriber=ssw(a)uw.edu' -d 'pre_verified=true' -d 'pre_confirmed=true' -d 'pre_approved=true' http://172.19.199.2:8001/3.1/members We’re running the current rolling docker images (up to date as of 25Jan2021) Obviously, people should run their servers better than letting disk partitions fill-up but it’s going to happen and mailman3 should do a better job of reporting errors and recovering when accidents happen. thanks, steve I’ve included mailman.log lines from going to the mass subscribe [26/Jan/2021:20:42:49 +0000] "GET /3.1/lists/laura-test.mm3.aca-aws.s.uw.edu HTTP/1.1" 200 434 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:42:49 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:42:49 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:43:01 +0000] "GET /3.1/lists/laura-test.mm3.aca-aws.s.uw.edu HTTP/1.1" 200 434 "-" "GNU Mailman REST client v3.3.2" Jan 26 20:43:07 2021 (48) deque: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 426, in _make_request six.raise_from(e, None) File "<string>", line 3, in raise_from File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 421, in _make_request httplib_response = conn.getresponse() File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse response.begin() File "/usr/lib/python3.8/http/client.py", line 307, in begin version, status, reason = self._read_status() File "/usr/lib/python3.8/http/client.py", line 268, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.8/socket.py", line 669, in readinto return self._sock.recv_into(b) socket.timeout: timed out During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 439, in send resp = conn.urlopen( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 724, in urlopen retries = retries.increment( File "/usr/lib/python3.8/site-packages/urllib3/util/retry.py", line 403, in increment raise six.reraise(type(error), error, _stacktrace) File "/usr/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise raise value File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 428, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 335, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 343, in _step_do_subscription self.member = self.mlist.subscribe( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/mailinglist.py", line 507, in subscribe notify(SubscriptionEvent( File "/usr/lib/python3.8/site-packages/zope/event/__init__.py", line 32, in notify subscriber(event) File "/usr/lib/python3.8/site-packages/mailman/app/membership.py", line 176, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/usr/lib/python3.8/site-packages/mailman/app/notifications.py", line 51, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 188, in get contents = getUtility(ITemplateManager).get( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 110, in get contents = protocols.get(actual_uri, **auth) File "/usr/lib/python3.8/site-packages/mailman/utilities/protocols.py", line 38, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) File "/usr/lib/python3.8/site-packages/requests/api.py", line 76, in get return request('get', url, params=params, **kwargs) File "/usr/lib/python3.8/site-packages/requests/api.py", line 61, in request return session.request(method=method, url=url, **kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 530, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 643, in send r = adapter.send(request, **kwargs) File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 529, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) [26/Jan/2021:20:43:07 +0000] "POST /3.1/members HTTP/1.1" 400 130 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:43:07 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:43:07 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" Then the results of a successful subscribe: [26/Jan/2021:20:46:20 +0000] "GET /3.1/lists/list2.mm3.aca-aws.s.uw.edu HTTP/1.1" 200 388 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:46:20 +0000] "POST /3.1/members HTTP/1.1" 201 0 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:46:20 +0000] "GET /3.1/lists/list2(a)mm3.aca-aws.s.uw.edu/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:46:20 +0000] "GET /3.1/lists/list2(a)mm3.aca-aws.s.uw.edu/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2” >

2 1

Perplexing unsubscribing notification problem
by Brian Carpenter Jan. 27, 2021

Jan. 27, 2021

Hi MM3 Users, I have a perplexing issue with one of our Mailman 3 servers. It doesn't want to send out unsubscribe notifications when a List Owner removes a list member. The server sends out welcome messages and subscription notifications fine just not unsubscribe notifications when a List Owner removes a list member. It will send out an unsubscribe notification if the list member sends an email to listname-leave@listdomain both to the List Owner and List Member. Nothing is showing in the logs as far as I can tell. -- Brian Carpenter Harmonylists.com Emwd.com

1 1

I like your style, but what is it?
by Stephen Willey Mats Mats Jan. 27, 2021

Jan. 27, 2021

How do I get a dump of list settings for each style. Thanks, steve p.s. the search on https://mailman.readthedocs.io/en/latest/README.html gives results but every link needs to have ‘projects/mailman/‘ removed from the url to work.

2 1

Problem updating mailman
by Odhiambo Washington Jan. 26, 2021

Jan. 26, 2021

I am getting this error after I did a git pull and build. (venv) [mailman3@gw ~/git]$ /opt/mailman/mm/bin/mailman-post-update + '[' False == False ']' + mkdir -p /opt/mailman/mm/static + /opt/mailman/mm/bin/django-admin collectstatic --clear --noinput --verbosity 0 +* /opt/mailman/mm/bin/django-admin compress* CommandError: An error occurred during rendering /opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4rc2-py3.7.egg/hyperkitty/templates/hyperkitty/404.html: /usr/local/lib/ruby/site_ruby/2.7/rubygems/dependency.rb:311:in `to_specs': Could not find 'sass-listen' (~> 4.0.0) among 4 total gem(s) (Gem::MissingSpecError) Checked in 'GEM_PATH=/opt/mailman/.gem/ruby/2.7:/usr/local/lib/ruby/gems/2.7', execute `gem env` for more information from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1446:in `block in activate_dependencies' from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1435:in `each' from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1435:in `activate_dependencies' from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1417:in `activate' from /usr/local/lib/ruby/site_ruby/2.7/rubygems.rb:305:in `block in activate_bin_path' from /usr/local/lib/ruby/site_ruby/2.7/rubygems.rb:304:in `synchronize' from /usr/local/lib/ruby/site_ruby/2.7/rubygems.rb:304:in `activate_bin_path' from /usr/local/bin/sass:23:in `<main>' The other output from this process is so long so I pasted it here: https://pastebin.ubuntu.com/p/tsB2CCNrQG/ Thanks -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

3 4

Language Support In Templates
by Brian Carpenter Jan. 26, 2021

Jan. 26, 2021

Hello MM3 Users, I have a question regarding the use of templates in different languages. I created a template for the unsubscribe notification in Postorius in Greek. The template shows up fine in Greek via Postorius. However the email that is sent out has a bunch of question marks where the Greek should be: ??????????? ?????????? ???????? ?????????? email ???? ???, ????? ????? ? ??????????? GNU Mailman ???? ????? $. ?????? ??? ?????? ????????? ??? ?? ????????? email $user_email ?????? ?? GNU Mailman ?????? ?? ?????????? ??? ??????? ???, ?????? ????? ?? ????????????? ?? ?????? ???. ???????? ?? ?? ?????? ????? ?????????? ?? ???? ?? ??????. ? ?? ?????? ?? ????????????? ??? ???????? ?????? - ??? ???? ?? ???????? line - ?? ??? ?????? ???? ?? $ request_email: confirm $token ????????? ??? ? ???? ???????? "?????????" ?? ???? ?? ?????? ?????? ?? ?????????? ?? ???????????? ?????????? ?????????????. ??? ??? ?????? ?? ??????????? ??? ????? ?? ????????? ???????????? ????????????, ????? ???????? ??? ??????. ??? ????????? ??? ??????????? ????????? ??? ?? ?????, ? ????? ????? ?????????, ???????? ?? ?????????????? $owner_email What does it take to get templates to send out messages in a different language then the interface itself. -- Brian Carpenter Harmonylists.com Emwd.com

2 2

How to approve moderated messages via email?
by Brian Carpenter Jan. 24, 2021

Jan. 24, 2021

What is the protocol to approve moderated messages via email? I hope I asking the question correctly. -- Brian Carpenter Harmonylists.com Emwd.com

3 5

False attachments in Outlook 2019?
by Brian Olesen Jan. 24, 2021

Jan. 24, 2021

Dear Mailman 3 users, I seriously think of upgrading from Mailman 2.1.33 to this new RC2 or the final one, when it comes out. But there is an annoying issue that I'd like to ask you about. It's the false attachments that Outlook creates for the footer. Is this still an issue when using Mailman 3, or have you made some sort of work around? I mean here in 2021 it could be nice to use html as the default mail format to be able to create nice looking mails, and due to EU regulations an unsubscription is a requirement. Best regards Brian Olesen from Denmark P.S. If this issue has been solved I will happily translate the mail templates into Danish if wanted.

2 1

Blocked by Hotmail
by Tom ＠ Gather Jan. 23, 2021

Jan. 23, 2021

I am getting rejections from Hotmail Jan 18 14:42:22 mail postfix/smtp[6571]: 046713F914: to=< helen_maryd(a)hotmail.com>, relay=hotmail-com.olc.protection.outlook.com[104.47.58.161]:25, delay=0.14, delays=0.06/0.03/0.04/0.01, dsn=5.7.1, status=bounced (host hotmail-com.olc.protection.outlook.com[104.47.58.161] said: 550 5.7.1 Unfortunately, messages from [167.99.151.239] weren't sent. Please contact your Internet service provider since part of their network is on our block list (S3140). You can also refer your provider to http://mail.live.com/mail/troubleshooting.aspx#errors. [ BN8NAM11FT014.eop-nam11.prod.protection.outlook.com] (in reply to MAIL FROM command)) I have submitted a ticket to https://support.microsoft.com/en-us/supportrequestform/8ad563e3-288e-2a61-8… Not sure why they are blocking me. Not on any other blacklists per mxtoolbox... Anyone else experienced this? How to resolve? My mail server is on Digital Ocean if that makes any difference. Thanks for any help -- Tom for the Gather Team https://info.gather.coop

5 4

django fake users
by r.woithe＠callassoftware.com Jan. 23, 2021

Jan. 23, 2021

Hello, is there a opportunity to avoid django fake users? Because of it is not stopping, further and further fake users are subscribing. Would be nice to have a possibility to stop this.

6 10

"Unsubscribe all" failed with large lists
by Alan So Jan. 21, 2021

Jan. 21, 2021

We are currently testing latest mailman suite (w/Postorius 1.3.3) and notice that that the the API call /3.1/lists/listname.domain/roster/member failed when using "Unsubscribe all" on Postorius for a large list (~15000 members). Not sure whether the issue has been already reported or not.

2 3

Unable to retrieve <800 members of Mailman list through Curl command
by Shashikanth Komandoor Jan. 20, 2021

Jan. 20, 2021

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 with PostgreSQL 11.7 version with default values. I am almost running 2000 lists with 128 GB RAM and 24 Cores on a single VM and on which all the mailman 3 components are running. It is observed for most of the lists having members more than 500 is displaying "Mailman REST API not available. Please restart Mailman Core" message on the postorius window and on running the CURL command over REST API of Mailman it is reaching the time limit 30 seconds and showing the below error. *curl: (52) Empty reply from serverNo JSON object could be decoded* The same behavior is observed on browsing the held messages for few lists either through the browser or through CURL and REST API. How to resolve this issue ? What other details I can provide to make you get an idea ? -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

Easiest way to install a new mailman3 deployment?
by ieso＠johnwillson.com Jan. 18, 2021

Jan. 18, 2021

So I've been trying for the last two weeks to get a new mailman3 server running on a virtualized server (any server), and I'm turning to this list after having failed many times and running out of holiday time. I started trying a non-docker installation on Ubuntu 18.04 (https://docs.google.com/document/d/1xIcSsoNFp2nHi7r4eQys00s9a0k2sHhu1V5Plan…) , which got me the closest. Except I had a problem with inbound email only being triggered when it came from certain accounts. But that clearly wasn't good enough for production, so after many attempts to figure out where it was failing, I decided to turn to docker as a solution that should be cleaner. A few attempts at doing a docker installation on digitalocean.com failed, which I realized might be due to it not routing private IP addresses, so I moved to AWS after checking that their VPC policy would fit mailman's docker requirements. I found a great but slightly outdated guide on how to do this (https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/) By this point I knew enough to correct a number of places where the environment had changed since the procedure was written, but postorius still failed at the curl test. The challenge for me has been the difficulty to know how to troubleshoot the different different systems and network infrastructure that are used to keep mailman3 humming. I've tried about 7 different installation walkthroughs (there are no recent ones on Youtube by the way, in case anyone wants to seize that opportunity!), and the good guides provide ways to check each stage to try to help you a bit on that front. Nonetheless, I feel stuck and thought I'd ask the simple question... for a completely basic, barebones new installation, what's the easiest way to get a mailman3 installation up-and running? (e.g. Which server provider? Which operating system and version? Docker or otherwise?) Any pointers highly appreciated. Google Groups is clearly on its way out, as it no longer allows for people to easily join groups by sending an email or clicking a link, so that should be a big opportunity for mailman3 to step up and help give those mailing list migrants a new home... which is what we're looking for. We're just not quite as smart as you guys. ;-)

15 25

Mailman 3 Installation
by bruce.dubbs＠gmail.com Jan. 17, 2021

Jan. 17, 2021

I am trying to set up Mailman 3 on a new server. So far I have run: pip3 install Django==3.1.5 pip3 install postorius pip3 install Hyperkitty pip3 install mailman pip3 install uwsgi All that went well. I've been struggling with the configuration though. I am using /etc/mailman.cfg and that seems to be explained in the documentation OK. From there I am confused. I do have sqlite installed, but the documentation discusses mysql/mariadb and postresql. What are the considerations as to why I would need one of these other DBs? I think I can follow the instructions to set up postfix. In the section 'Configure Web Frontend', it discusses setting up the administrator. As I want to put Mailman on /srv/mailman I can create that, but what should the owner/permissions be? Later the docs discuss editing Django's settings.py. Where do I find that file? I'll note here that my experience with python is quite limited and my knowledge of Django is nil. Later in the section 'Set up HyperKitty', it sends me to a page that discusses installing it. I did that with pip3. Then it says to 'Setup your django project'. What django project is that. I would appreciate advice or a pointer to where I can figure this out. Thanks. -- Bruce

4 5

New release candidates for Postorius and Hyperkitty
by Abhilash Raj Jan. 17, 2021

Jan. 17, 2021

Hey Everyone, Happy new year to everyone! I am pleased to announce new release candidates for Postorius and Hyperkitty along with new releases for Mailmanclient and Django-mailman3! These include both new features and bug fixes. Complete change log for each components: Postorius 1.3.4rc1: https://docs.mailman3.org/projects/postorius/en/latest/news.html Hyperkitty 1.3.4rc1 : https://docs.mailman3.org/projects/hyperkitty/en/latest/news.html Mailmanclient 3.3.2.: https://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclien… Django-mailman3 1.3.5: https://gitlab.com/mailman/django-mailman3/-/blob/master/README.rst These releases require Mailman Core 3.3.2 and Python 3.6+. Since these are pre-releases, you can install them using: $ pip install --pre --upgrade postorius hyperkitty Or you can also specify the exact versions: $ pip install --upgrade 'postorius==1.3.4rc1' 'hyperkitty==1.3.4rc1' Unless there is a release-blocker bug, stable versions for Postorius and Hyperkitty will be released in 2 weeks time. If you can test these releases, we encourage you to report any bugs to us on Gitlab. If you'd like to help out with translations for some of the new strings in your native language, the documentation is available here[1] on how to do that. [1]: https://docs.mailman3.org/en/latest/translation.html -- thanks, Abhilash Raj (maxking) On behalf of GNU Mailman Team

1 1

subscribing to any list is not possible
by r.woithe＠callassoftware.com Jan. 17, 2021

Jan. 17, 2021

Hello, after i solved the qcluster error with a new installation i have still an error with subscribing. It is not possible to subscribe to any list via email or web-interface. The mass subcribtion as admin via the web-interface is possible and the unsubscribing also. But i can not get any error messages in any log file, nothing. Also the django users are fine, django users can subscribe without a problem. But subscribing to any list is not possible via the web-interface, with the error message "A Server Error occured please conntact the Administrator",also subscribing via email is not possible(mail.log is fine the mail is delivered), but there is no additionally error message in any log file. System: ubuntu 20.04.01 Mailman Core Version GNU Mailman 3.2.2 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.8.5 (default, Jul 28 2020, 12:59:40) [GCC 9.3.0]

2 4

Re: New release candidates for Postorius and Hyperkitty
by Abhilash Raj Jan. 16, 2021

Jan. 16, 2021

+cc: mailman-usersmailman3.org for more visibility. On Sat, Jan 16, 2021, at 2:20 PM, Ruth Ivimey-Cook wrote: > Hi, > > Is there a recommended method for upgrading an existing, running, server > from Python 3.6 to 3.8, especially in such a way as to enable downgrade > if something breaks? It depends on how did you install Mailman. If you installed using virtualenv, you can create another virtualenv and install new versions, that use the same configuration and switch between new and old versions, > > [When I upgraded a server distribution without enough preparation, it > broke mailman3 because I lost python3.6, and getting it working again > needed a lot of work to reinstall it without zapping needed state.] > > Regards > > Ruth > > > On 16/01/2021 20:38, Abhilash Raj wrote: > > Hey Everyone, > > > > Happy new year to everyone! > > > > I am pleased to announce new release candidates for Postorius and Hyperkitty along with new releases for Mailmanclient and Django-mailman3! > > > > These include both new features and bug fixes. Complete change log for each components: > > > > Postorius 1.3.4rc1: https://docs.mailman3.org/projects/postorius/en/latest/news.html > > Hyperkitty 1.3.4rc1 : https://docs.mailman3.org/projects/hyperkitty/en/latest/news.html > > Mailmanclient 3.3.2.: https://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclien… > > Django-mailman3 1.3.5: https://gitlab.com/mailman/django-mailman3/-/blob/master/README.rst > > > > These releases require Mailman Core 3.3.2 and Python 3.6+. > > > > Since these are pre-releases, you can install them using: > > > > $ pip install --pre --upgrade postorius hyperkitty > > > > Or you can also specify the exact versions: > > > > $ pip install --upgrade 'postorius==1.3.4rc1' 'hyperkitty==1.3.4rc1' > > > > Unless there is a release-blocker bug, stable versions for Postorius and Hyperkitty will be released in 2 weeks time. If you can test these releases, we encourage you to report any bugs to us on Gitlab. > > > > If you'd like to help out with translations for some of the new strings in your native language, the documentation is available here[1] on how to do that. > > > > [1]: https://docs.mailman3.org/en/latest/translation.html > > > -- > Software Manager & Engineer > Tel: 01223 414180 > Blog: http://www.ivimey.org/blog > LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/ > > -- thanks, Abhilash Raj (maxking)

1 0

Subscription request cannot be moderated: 404 Not Found
by Eric Broens Jan. 16, 2021

Jan. 16, 2021

For one of our mailinglists we also have a problem with accepting a subscription request. When Clicking "Accept", we get a 404 Not found error. See the attached screenshot. Is there a way to solve this? Best Regards,Eric

2 8

Mailman 'requests' API call timeout when there are a number of pending members
by Alan So Jan. 15, 2021

Jan. 15, 2021

We are currently testing latest mailman suite and notice that the requests API call will timeout if there are a number of pending requests. Since the latest Postorious allow unchecking Pre confirm and Pre approved during mass subscribe, our support staff tried to add large number of email addresses to the list. We then found that we cannot click into the list from the web UI to administer it and an error message showing that "Mailman REST API not available. Please start Mailman core." Further checked that the requests API call failed to complete when we click the list on the web interface. Looks like the UI should not try to load all the pending members just for the sake of showing the number of pending requests. Of course in normal situations, there should not be that many pending requests.

2 1

Re: Mails for 1 specific mailinglist not being send and looping in out queue
by Eric Broens Jan. 14, 2021

Jan. 14, 2021

In my mailclient it looks like the LF's have been removed. I'll attach the log extracts to make them better readable. Best Regards, Eric On Saturday, January 9, 2021, 02:17:18 PM GMT+1, Eric Broens <ebroens(a)yahoo.com> wrote: ----- Forwarded Message ----- From: Eric Broens via Mailman-users <mailman-users(a)mailman3.org>To: Mailman Users <mailman-users(a)mailman3.org>Sent: Saturday, January 9, 2021, 02:14:42 PM GMT+1Subject: [MM3-users] Mails for 1 specific mailinglist not being send and looping in out queue For some reason, the mail for 1 specific mailinglist doesn't get distributed. It worked fine before, and no changes have been made.The mailman3 debug log shows that mailman keeps attempting to distribute the mail. The mailman3 error log show that there is a connection failure to port 25. A tcpdump however shows that there are *NO* further connection attempts on port 25 (postfix) to distribute this mail. Also after stopping and starting mailman3 again, no further connection attempts to the mailserver (postfix) are being made for this mail. Using qfile, the pck file of this mail looks fine. New emails on this specific mailinglist are not distributed either. For all other mailinglists on this server, and which are on the same domain, there are no problems. Does anyone know how to get this mailinglist functioning properly again, and what is causing this issue? Below are the relevant extracts from the log files for the particular case. mailman smtp.log: Jan 09 12:00:57 2021 (1571668) Peer: ('127.0.0.1', 51752)Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) handling connectionJan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'LHLO ****'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'MAIL FROM:<****@****>'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) sender: *****@*****Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'RCPT TO:<*****@*****>'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) recip: ******@********Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'DATA'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'QUIT'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) connection lost... Message has been archived properly, mailmansuite.logINFO 2021-01-09 12:01:00,277 1164814 hyperkitty.views.mailman Archived message <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> to *** mailman error.logJan 09 12:01:00 2021 (1571670) Cannot connect to SMTP server 127.0.0.1 on port 25 mailman debug.log Jan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: validate-authenticityJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: mime-deleteJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: taggerJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: member-recipientsJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: avoid-duplicatesJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: cleanseJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: cleanse-dkimJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: cook-headersJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: subject-prefixJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: rfc-2369Jan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-archiveJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-digestJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-usenetJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: after-deliveryJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: acknowledgeJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: dmarcJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: arc-signJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-outgoingJan 09 12:00:59 2021 (1571667) [IncomingRunner] starting oneloopJan 09 12:00:59 2021 (1571667) [IncomingRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571671) [PipelineRunner] finishing filebase: 1610190058.1544778+e952a743e8df115e8fff9c60f98b189d4800e7e6Jan 09 12:00:59 2021 (1571671) [PipelineRunner] doing periodicJan 09 12:00:59 2021 (1571671) [PipelineRunner] committing transactionJan 09 12:00:59 2021 (1571671) [PipelineRunner] checking short circuitJan 09 12:00:59 2021 (1571671) [PipelineRunner] ending oneloop: 1Jan 09 12:00:59 2021 (1571671) [PipelineRunner] starting oneloopJan 09 12:00:59 2021 (1571671) [PipelineRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571674) [VirginRunner] starting oneloopJan 09 12:00:59 2021 (1571674) [VirginRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571669) [NNTPRunner] starting oneloopJan 09 12:00:59 2021 (1571669) [NNTPRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571675) [DigestRunner] starting oneloopJan 09 12:00:59 2021 (1571675) [DigestRunner] ending oneloop: 0Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] starting oneloopJan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing filebase: 1610190059.1591551+dcfcb22d5156b0a4d4267eabf83c5bb68f945e41Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing onefileJan 09 12:01:00 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>Jan 09 12:01:00 2021 (1571664) [ArchiveRunner] starting oneloopJan 09 12:01:00 2021 (1571664) [ArchiveRunner] processing filebase: 1610190059.1079752+2644b9a3eab17d52203a2c2648a1db5ff146eb6dJan 09 12:01:00 2021 (1571664) [ArchiveRunner] processing onefileJan 09 12:01:00 2021 (1571666) [CommandRunner] starting oneloopJan 09 12:01:00 2021 (1571666) [CommandRunner] ending oneloop: 0Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] finishing filebase: 1610190059.1591551+dcfcb22d5156b0a4d4267eabf83c5bb68f945e41Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] doing periodicJan 09 12:01:00 2021 (1571670) [OutgoingRunner] committing transactionJan 09 12:01:00 2021 (1571670) [OutgoingRunner] checking short circuitJan 09 12:01:00 2021 (1571670) [OutgoingRunner] ending oneloop: 1Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] starting oneloopJan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing filebase: 1610190060.1351898+91420b755194277d1236a36b6e2195eff547c8b0Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing onefileJan 09 12:01:00 2021 (1571667) [IncomingRunner] starting oneloopJan 09 12:01:00 2021 (1571667) [IncomingRunner] ending oneloop: 0Jan 09 12:01:00 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>......Jan 09 14:06:30 2021 (1601275) [outgoing] <function deliver at 0x7f038df80ea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>... Thanks in advance,Eric _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

2 3

Header Filter madness
by Brian Carpenter Jan. 14, 2021

Jan. 14, 2021

I have a client whose header filters seemed to have stop working. No matter what I try, it seems none of their header filters are being applied. Other lists on the same server that use header filters, are working fine. This particular header is the subject header. I can duplicate their problem but only with their list. If I create the exact same header on a test list using the exact same subject line, the header filter does its job (moderate). Just not with this one list. -- Brian Carpenter Harmonylists.com Emwd.com

2 7

The future is here?
by ieso＠johnwillson.com Jan. 9, 2021

Jan. 9, 2021

In my quest to figure out how even us idiots can successfully install a mailman3 server, I keep looking ways to reduce the process to the simplest possible set of instructions. So far, I haven't been doing very well with that, but I've been learning a ton. In particular, while I still haven't got a fully functioning mailman3 server yet, someone pointed me, off list, to Ansible, which I wasn't aware of before and which has completely blown me away by its power and simplicity. For those who aren't aware of it, it's an agentless, multi-platform automation technology. For our purposes, it replaces "how to install mailman3" guides with a single script that aims to actually do the entire thing for you. One of the particularly interesting points is that you can write complex scripts/data structures (or 'collections') that allow for a single collection to cover a broad range of use cases, such as [this person's](https://github.com/rivimey/) exim Ansible collection, which covers 3 very different use cases from a private domain email relay up to a full multi-domain email handler with IMAP integration. I haven't quite got the mailman3 one working yet, but I've just started playing with it. Here are some pointers in case anyone else is interested in trying, and I'd be very interested in whether or not I'm actually the last person to discover this technology, and if one of these solutions succeeds in delivering mailman3 "out of the box". 1. [Install Ainsible](https://docs.ansible.com/ansible/latest/installation_guide/intro_…, make sure you're on at least version 2.9, if not 2.10. Some distributions are still on 2.7, which is not compatible with more recent collections. The "Galaxy" collection is apparently only tested on Debian 10. 2. Pick your mailman3 Ansible collection of choice and install it (https://galaxy.ansible.com/ucr/mailman3, or https://github.com/rivimey/ansible-mailman3) Command to install official collection - ansible-galaxy install ucr.mailman3 3. Write playbook.yml with key variables (mailman3 example below) _________________________ mailman3-playbook.yml _________________________ - hosts: mailman3 vars: mailman3_domain: example.com # It will install and create a certificate using certbot, its nignx plugin and http validation (Public IP required). If false, it will install a self sign cert mailman3_install_certbot: true # install and create certificate # secrets, please change them mailman3_secret_key: "change_secretkey" mailman3_rest_api_pass: "change_api_pass" mailman3_archiver_key: "change_archiver_key" mailman3_db_pass: "change_db_pass" mailman3_web_db_pass: "change_web_db_pass" mailman3_web_admin_pass: "change_web_admin_pass" roles: - ucr.mailman3

6 13

Mails for 1 specific mailinglist not being send and looping in out queue
by Eric Broens Jan. 9, 2021

Jan. 9, 2021

For some reason, the mail for 1 specific mailinglist doesn't get distributed. It worked fine before, and no changes have been made.The mailman3 debug log shows that mailman keeps attempting to distribute the mail.The mailman3 error log show that there is a connection failure to port 25.A tcpdump however shows that there are *NO* further connection attempts on port 25 (postfix) to distribute this mail.Also after stopping and starting mailman3 again, no further connection attempts to the mailserver (postfix) are being made for this mail.Using qfile, the pck file of this mail looks fine. New emails on this specific mailinglist are not distributed either.For all other mailinglists on this server, and which are on the same domain, there are no problems. Does anyone know how to get this mailinglist functioning properly again, and what is causing this issue?Below are the relevant extracts from the log files for the particular case. mailman smtp.log: Jan 09 12:00:57 2021 (1571668) Peer: ('127.0.0.1', 51752)Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) handling connectionJan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'LHLO ****'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'MAIL FROM:<****@****>'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) sender: *****@*****Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'RCPT TO:<*****@*****>'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) recip: ******@********Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'DATA'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) Data: b'QUIT'Jan 09 12:00:57 2021 (1571668) ('127.0.0.1', 51752) connection lost... Message has been archived properly, mailmansuite.logINFO 2021-01-09 12:01:00,277 1164814 hyperkitty.views.mailman Archived message <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> to *** mailman error.logJan 09 12:01:00 2021 (1571670) Cannot connect to SMTP server 127.0.0.1 on port 25 mailman debug.log Jan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: validate-authenticityJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: mime-deleteJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: taggerJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: member-recipientsJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: avoid-duplicatesJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: cleanseJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: cleanse-dkimJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: cook-headersJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: subject-prefixJan 09 12:00:58 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: rfc-2369Jan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-archiveJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-digestJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-usenetJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: after-deliveryJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: acknowledgeJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: dmarcJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: arc-signJan 09 12:00:59 2021 (1571671) <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com> pipeline default-posting-pipeline processing: to-outgoingJan 09 12:00:59 2021 (1571667) [IncomingRunner] starting oneloopJan 09 12:00:59 2021 (1571667) [IncomingRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571671) [PipelineRunner] finishing filebase: 1610190058.1544778+e952a743e8df115e8fff9c60f98b189d4800e7e6Jan 09 12:00:59 2021 (1571671) [PipelineRunner] doing periodicJan 09 12:00:59 2021 (1571671) [PipelineRunner] committing transactionJan 09 12:00:59 2021 (1571671) [PipelineRunner] checking short circuitJan 09 12:00:59 2021 (1571671) [PipelineRunner] ending oneloop: 1Jan 09 12:00:59 2021 (1571671) [PipelineRunner] starting oneloopJan 09 12:00:59 2021 (1571671) [PipelineRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571674) [VirginRunner] starting oneloopJan 09 12:00:59 2021 (1571674) [VirginRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571669) [NNTPRunner] starting oneloopJan 09 12:00:59 2021 (1571669) [NNTPRunner] ending oneloop: 0Jan 09 12:00:59 2021 (1571675) [DigestRunner] starting oneloopJan 09 12:00:59 2021 (1571675) [DigestRunner] ending oneloop: 0Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] starting oneloopJan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing filebase: 1610190059.1591551+dcfcb22d5156b0a4d4267eabf83c5bb68f945e41Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing onefileJan 09 12:01:00 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>Jan 09 12:01:00 2021 (1571664) [ArchiveRunner] starting oneloopJan 09 12:01:00 2021 (1571664) [ArchiveRunner] processing filebase: 1610190059.1079752+2644b9a3eab17d52203a2c2648a1db5ff146eb6dJan 09 12:01:00 2021 (1571664) [ArchiveRunner] processing onefileJan 09 12:01:00 2021 (1571666) [CommandRunner] starting oneloopJan 09 12:01:00 2021 (1571666) [CommandRunner] ending oneloop: 0Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] finishing filebase: 1610190059.1591551+dcfcb22d5156b0a4d4267eabf83c5bb68f945e41Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] doing periodicJan 09 12:01:00 2021 (1571670) [OutgoingRunner] committing transactionJan 09 12:01:00 2021 (1571670) [OutgoingRunner] checking short circuitJan 09 12:01:00 2021 (1571670) [OutgoingRunner] ending oneloop: 1Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] starting oneloopJan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing filebase: 1610190060.1351898+91420b755194277d1236a36b6e2195eff547c8b0Jan 09 12:01:00 2021 (1571670) [OutgoingRunner] processing onefileJan 09 12:01:00 2021 (1571667) [IncomingRunner] starting oneloopJan 09 12:01:00 2021 (1571667) [IncomingRunner] ending oneloop: 0Jan 09 12:01:00 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:41 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>...Jan 09 12:16:42 2021 (1571670) [outgoing] <function deliver at 0x7f612989dea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>......Jan 09 14:06:30 2021 (1601275) [outgoing] <function deliver at 0x7f038df80ea0>: <91B190F7-EEA3-4FA7-9808-2C35774E665A(a)gmail.com>... Thanks in advance,Eric

1 0

export and import database?
by Andreas Barth Jan. 4, 2021

Jan. 4, 2021

Hi, is there an recommended way to export and import all of the configuration in the database (so that I could change the database on import, i.e. not on database level)? Regards, Andi

2 1

required cron entries?
by Andreas Barth Jan. 2, 2021

Jan. 2, 2021

Hi together, as I found some mails in queue/shunt, I thought who should be running them. On my (standard debian) reference system, there are no cron entries for mailman3 but only for mailman3-web. Looking in the source code, there is a ./cron/crontab.in.in however references to scripts in port_me/ directory. Should I (still) install (parts of) the crontab? Or are these functions handled elsewhere? Also, who picks up mails in queue/shunt? Or are they lost somehow? (Or did I miss the documentation somewhere?) Regards, Andi

3 8

Syncing Real Name between user account and membership
by Andreas Barth Dec. 31, 2020

Dec. 31, 2020

Hi together, a user was mass-subscribed (with a wrong name) and now registered and changed his name via the web interface but the list entry is not changed. On looking further at that, I got to the following json outputs: curl -urest:pass http://localhost:8001/3.0/addresses/user@example.com/user { "created_on": "2020-11-26T15:43:24.928285", "is_server_owner": false, "self_link": "http://localhost:8001/3.0/users/123456", "user_id": 123456 "display_name": "Fixed Name", } curl -urest:pass http://localhost:8001/3.0/addresses/user@example.com { "email": "user(a)example.com", "original_email": "user(a)example.com" "registered_on": "2020-11-26T15:43:24.896405", "self_link": "http://localhost:8001/3.0/addresses/user@example.com", "display_name": "Broken Name", "verified_on": "2020-11-26T15:43:24.965784", "user": "http://localhost:8001/3.0/users/123456" } Should the fix of the name propagate? Or what would be the appropriate action here? Regards, Andi

4 9

Upgrade to 3.3.2 fails
by Joel Lord Dec. 28, 2020

Dec. 28, 2020

I've just upgraded python to 3.7, so now I can upgrade mailman from 3.3.1 to 3.3.2. Take it down, "pip install --upgrade mailman", and try a "mailman info". It fails hard, and what I think are the important parts of the stack trace are: sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1118, 'Row size too large. The maximum row size for the used table type, not counting BLOBs, is 8126. This includes storage overhead, check the manual. You have to change some columns to TEXT or BLOBs') [SQL: ALTER TABLE mailinglist ADD COLUMN archive_rendering_mode INTEGER] (Background on this error at: http://sqlalche.me/e/13/e3q8) Looks to me like the mailinglist table has been using awfully close to the default mysql max row length, and this added column pushes me over? Is there some other fix other than a terrifyingly gigantic process of dumping all my databases, changing my page size, and restoring them all? This DB server isn't serving just mailman... Thanks -- Joel Lord

3 7

WEB UI fail to reply and create new thread
by Milan P. Stanić Dec. 23, 2020

Dec. 23, 2020

Hi, Alpine Linux is testing mailman3 as system for project mailing lists. We created docker-compose which can be seen here https://gitlab.alpinelinux.org/alpine/infra/compose/mailman We installed it and run in testing system here https://lists-test.alpinelinux.org/hyperkitty/ Sending mail by mail clients works and mails are sent to subscribers properly. Most other 'things' works but we have problem with reply to posts and creating new threads using web ui. When replying to post with web ui it says that the everything is ok and post is sent but post doesn't arrive to mailing list. Same happens with creating new thread. Our debug says "KeyError: 'display_fixed'" but we are not sure what should be changed/fixed/set for this problem. Attached is excerpt from debug log. TIA, mps

4 5

Docker Core Configuration "MUST" Documentation
by James Bowery Dec. 23, 2020

Dec. 23, 2020

The docker core configuration README says: "These are the variables that you MUST change before deploying:" Does this mean: "The following variables MUST be set in /opt/mailman/core/mailman-extra.cfg (on the host) to match the values in docker-compose.yaml before deploying:" ?

2 1

Re: Equivalent Apache2 Directives for Those From the Docker Nginx Documentation?
by James Bowery Dec. 22, 2020

Dec. 22, 2020

Thanks. That configuration worked for me -- at least to the point that I got this in my apache error log, which means the proxy pass was working: [Sun Dec 20 22:45:02.548267 2020] [proxy:error] [pid 18049] (111)Connection refused: AH00957: uwsgi: attempt to connect to 172.19.199.3:8080 (172.19.199.3) failed [Sun Dec 20 22:45:02.548294 2020] [:error] [pid 18049] [client ....:59424] AH10101: failed to make connection to backend: 172.19.199.3:8080 On Mon, Dec 14, 2020 at 10:03 PM <matthew(a)alberti.us> wrote: > James, > This is what I put in my apache2 conf for the mailman virtual host: > > #Mailman3 Web Configuration > Alias /favicon.ico /opt/mailman/web/static/hyperkitty/img/favicon.ico > > Alias /static /opt/mailman/web/static > <Directory /opt/mailman/web/static> > Require all granted > </Directory> > > ProxyPassMatch ^/static ! > ProxyPassMatch ^/favicon.ico ! > ProxyPass / uwsgi://172.19.199.3:8080/ > > I don't believe I did anything to uwsgi's conf. One thing I did > notice is that the '/' on the end of the 'ProxyPass' command (last line) is > relevant. I think it didn't work right without it. > > I am interested to hear from others if that configuration is > complete. It works as far as I know. > > - Matt Alberti > > -----Original Message----- > From: James Bowery <jabowery(a)gmail.com> > Sent: Monday, December 14, 2020 8:27 PM > To: mailman-users(a)mailman3.org > Subject: [MM3-users] Equivalent Apache2 Directives for Those From the > Docker > Nginx Documentation? > > The Docker documentation at: > > https://asynchronous.in/docker-mailman/#dependencies > > I've installed and enabled proxy_uwsgi for Apache and made a rough cut at a > configuration for the lists.* subdomain in question but it's failing. > > What follows are the document's Nginx directives for which I would greatly > appreciate the Apache2 equivalents. I'm attempting to move a mailing list > off of Yahoo groups onto my hosted server using an Apache2's virtual host > on > the 'lists' subdomain: > > Setting up your web server: > > # Nginx configuration. > > location / { > # First attempt to serve request as file, then > > proxy_pass http://172.19.199.3:8000; > include uwsgi_params; > uwsgi_read_timeout 300; > proxy_set_header Host $host; > proxy_set_header X-Forwarded-For $remote_addr; > } > > uwsgi: > > # Nginx configuration. > > location / { > # First attempt to serve request as file, then > > uwsgi_pass 172.19.199.3:8080; > include uwsgi_params; > uwsgi_read_timeout 300; > } > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe > send > an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > >

3 8

Message Sent to A Re-Created List Results In Error
by matthew＠alberti.us Dec. 17, 2020

Dec. 17, 2020

I created a list in the Postorius interface, used it, and then deleted it. A week or so later, I re-created the list, and things were fine thru the creation and subscription process. But when I sent a message to the list, a "550 user unknown" error was sent back. I tried to determine if this is a known issue by searching the issues in Gitlab; but didn't find anything. But wanted to ask if this was a known issue or not? Thanks. - Matt Alberti

4 5

moderator cannot login to the list
by Gregory Edigarov Dec. 17, 2020

Dec. 17, 2020

Hello, I am using this mailman: GNU Mailman 3.2.1 (La Villa Strangiato) Python 3.7.3 (default, Jul 25 2020, 13:03:44) I've imported some lists from mailman-2.1 using 'mailman import21' command. the import went fine, I am able to login into postorius as admin, and see all imported mail list data. but login as a moderator member of a list. I tried to reset moderator password via rest api. That doesn't help. how is that supposed to be done? thank you. -- With best regards, Gregory Edigarov

3 2

Mailman automatic accept notification
by tambet.paide＠mkm.ee Dec. 16, 2020

Dec. 16, 2020

How can I configure mailman so that all the users in mailing list won't get automatic accept notification (uncaught bounce notification)? I'n mailman configure I cant find nothing about disabling bounce message. I'm using Mailman 3 and cat figure it out

4 8

Handling of (un)subscribe mails for already (un)subscribed users
by Andreas Barth Dec. 15, 2020

Dec. 15, 2020

Hi, I noticed that a mail to -subscribe for an already subscribed user doesn't get any response (about line 225 in mailman/src/mailman/app/subscriptions.py). Same but different for unsubscribe for users not on the list. I'd need these kind of mails however in hope that users complain less. Would that be generally interessting, and if so, any special requirements for submitting patches, or should I just do that locally? Regards, Andi

3 7

Equivalent Apache2 Directives for Those From the Docker Nginx Documentation?
by James Bowery Dec. 15, 2020

Dec. 15, 2020

The Docker documentation at: https://asynchronous.in/docker-mailman/#dependencies I've installed and enabled proxy_uwsgi for Apache and made a rough cut at a configuration for the lists.* subdomain in question but it's failing. What follows are the document's Nginx directives for which I would greatly appreciate the Apache2 equivalents. I'm attempting to move a mailing list off of Yahoo groups onto my hosted server using an Apache2's virtual host on the 'lists' subdomain: Setting up your web server: # Nginx configuration. location / { # First attempt to serve request as file, then proxy_pass http://172.19.199.3:8000; include uwsgi_params; uwsgi_read_timeout 300; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } uwsgi: # Nginx configuration. location / { # First attempt to serve request as file, then uwsgi_pass 172.19.199.3:8080; include uwsgi_params; uwsgi_read_timeout 300; }

2 1

Data too long for column 'data' in workflowstate
by Morris Jones Dec. 14, 2020

Dec. 14, 2020

I ran into this error attempting to add a user to a mailing list: (pymysql.err.DataError) (1406, "Data too long for column 'data' at row 1") [SQL: INSERT INTO workflowstate (token, step, data) VALUES (%(token)s, %(step)s, %(data)s)] [parameters: {'token': '7394fbf654b3faffc6a65eb95e0616eea6651b9e', 'step': 'do_confirm_verify', 'data': '{"pre_approved": false, "pre_confirmed": false, "pre_verified": false, "invitation": false, "address_key": "dorothyxxxxxxxx(a)gmail.com", "subscriber_key": 1, "user_key": "00201c01dcc443c3a0d8f6d1ea42e230", "token_owner_key": 1, "send_welcome_message": null}'}] In MySQL I see that column 'data' in workflowstate is VARCHAR(255), and the data in the query is 259 characters. If I have a moment I'll write a bug or patch ... but I'm not really current on schema migrations. Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

2 2

Permission denied for /list:member:digest:header.txt
by Eric Broens Dec. 14, 2020

Dec. 14, 2020

Hi, despite mailman is running as mailman user and the required periodic jobs have all been created in crontab for the mailman user, a permission denied exception for the digest file has been logged in mailman.log: Dec 14 11:31:42 2020 (399913) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/templates/lists/...//list:member:digest:header.txt' The subdirectories and files of the templates subdirectory got the root owner and group: drwxr-xr-x. 3 mailman mailman 4096 Dec 12 17:58 templates drwxr-xr-x. 11 root root 4096 Dec 12 19:20 lists -rw-rw----. 1 root root 16 Dec 12 19:19 list:member:digest:header.txt How can this be avoided? Best Regards,Eric

3 8

Importing config and archives only partially succeeded?
by Eric Broens Dec. 13, 2020

Dec. 13, 2020

Today I have migrated about 30 mailinglists from mailman 2.1 to mailman 3.3.2 & Hyperkitty 1.3.3. Although no error responses were given when importing the 2.1 pck files, and neither for importing the archives, for about half of the mailinglists the hyperkitty webpage doesn't show any subscribers, nor archived emails. The imported members and other settings are correctly shown in the postorius page. Is there anything that I can verify why the archive is not shown on the hyperkitty page?The hyperkitty_email database table does contain the emails. Thanks in advance,Eric

2 11

troubleshooting hyperkitty
by Morris Jones Dec. 10, 2020

Dec. 10, 2020

Working on a new installation -- lists seem to be working in terms of distributing postings. But none of the postings are appearing in an archive yet. I created a mailman-hyperkitty.cfg file in /opt/mailman/var/etc/. It has a base_url for the "hyperkitty installation," and I'm not sure where that's supposed to be. The comment says "This address will be used by Mailman to forward incoming emails to Hyperkitty for archiving." I set base_url to http://mailman.whiteoaks.com/hyperkitty (changing "localhost" from the example). It redirects to https:, I set new secret keys here and in mailman.cfg. No new posts appear, and nothing archive related shows up in mailman's log. The mailman qcluster is running. The runner=archive job is running. Can someone suggest a troubleshooting strategy? Best regards, Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

3 10

Hyperkitty Recommended mySQL Database Setup & Archive Importing
by matthew＠alberti.us Dec. 10, 2020

Dec. 10, 2020

Hi, I've been working for quite a while to setup a production mailman3. Using the docker containers, I have been pretty successful getting it to work. Part of the challenge now is that there are a lot of issues when importing archives from mailman2. This of course is more common on lists that are over 10 years old. From what I've been reading, it seems like Mailman3 expects the mysql database to use UTF8 encoding. It appears, by default, that when using the docker-mailman containers, that the character set is set to latin1. This may explain why there are lots of import errors, and maybe also why there are a lot of errors when threads are deleted in hyperkitty's UI. Is it the case that UTF8 is the preferred character set? I also saw some threads indicating that maybe utf8mb4 is more preferred. I'd like to try to change the character_set on the database, if that is advisable. Also, is Hyperkitty 1.3.4 officially released? I see that the list.org instance is using it, but the latest announce I've seen is for 1.3.3. Thanks. - Matt Alberti

3 8

Version mismatch
by Andrew Bernard Dec. 9, 2020

Dec. 9, 2020

In the annoucement mail, the new version is - Mailman Core 3.3.0 (Tom Swayer) but on my webpage I see: Mailman Core Version GNU Mailman 3.3.0 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.7.3 (default, Apr 3 2019, 05:39:12) [GCC 8.3.0] Why is the version name from the previous release? is my setup wrong? [There are so many issues I keep reporting here about Mailman that get no response that I wonder if there is something fundamentally wrong with my site.] Andrew

4 3

Message moderatin without login
by Michael Lorenzen Dec. 8, 2020

Dec. 8, 2020

Hi, are there any plans to allow message moderation without having to login to posterious? I am very pleased with the new web interface and the rest api, but i miss the ability to moderate messages either by mail, with different reply addresses to discard, reject or accept hold messages or by html links with one time codes to achieve the same. I tried to reply on the mail attachment with the confirm ... subject, but that did not seem to work (neither reject nor accept with approved: placed into the first line of the mail). Best regards, Michael

2 1

Moderated Signup with "info" box?
by chris＠zimmerman.to Dec. 8, 2020

Dec. 8, 2020

Hi all, we have a mailman deployment that we are using for a private neighborhood community board. We have the list setup for moderated approval signup. The trouble is, when someone signs up, we only get a request with their email address. I would like to be able to use the web form, but have a "notes" field that would get submitted with the signup request. the notes field would be where the user would note name/home address. So when one of our moderators get the request, they can figure out quick who the request is coming from. Can anyone provide some guidance or assistance on how to make that happen?

5 8

Spam getting in for moderated list
by Quanah Gibson-Mount Dec. 6, 2020

Dec. 6, 2020

I have a list that has the following settings: List members -> Hold: This holds the message for approval by the list moderators. Non-subscribers -> Silent discard And yet, spam emails from a spammer that signed up to the list are going straight through and being delivered. Is this a known bug in mailman 3.2.1? Example: <https://lists.openldap.org/hyperkitty/list/openldap-bugs@openldap.org/threa…> It even has this list header: X-Mailman-Rule-Hits: member-moderation and version is X-Mailman-Version: 3.2.1 I think it was sent via the web interface? User-Agent: HyperKitty on https://lists.openldap.org/ I checked the settings for this subscribed spam user, and it specifically says "list default" for moderation, so it should have been moderated. Thanks, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

2 2

mailman-suite scheduled tasks
by Eric Broens Dec. 6, 2020

Dec. 6, 2020

Hi, The documentation https://docs.mailman3.org/en/latest/config-web.html includes a section on scheduled tasks that need to be included in cron. "runjobs" seems to be available only from "manage.py". Do these scheduled tasks need to be executed from the python virtual environment?If so, is there a way to do that directly from cron, or should I create a script for these tasks which can be called from by cron? Best Regards,Eric

2 2

Server name in new account confirmation email
by Meehan, John Dec. 3, 2020

Dec. 3, 2020

Hi, when someone creates a new account (Sign Up), an email is sent to them to confirm their email address. It has the form below. Does anyone know how I can change the server name in the URL (From server.example.com to something else)? I have an SSL proxy server that I want to direct users through. Thanks. - John Hello from example.com! You're receiving this e-mail because user johndoe has given yours as an e-mail address to connect their account. To confirm this is correct, go to https://server.example.com/accounts/confirm-email/Mg:1kkdMg:i4i4ycbBdukoSMd… Thank you from example.com! example.com

3 3

mailman3 OWNERS_CAN_ENABLE_PERSONALIZATION option
by Henry S Dec. 3, 2020

Dec. 3, 2020

I am trying to change email "To" field to user's email instead of mailing list's email. e.g. "To: <user(a)gmail.com>" instead of "To: <mailman-users(a)mailman3.org>" I looked around old mailman configs they mentioned about adding OWNERS_CAN_ENABLE_PERSONALIZATION option in mm_cfg.py is this feature still available in mailman3 ? Can I do it via Postorius or REST API? Thanks.

2 2

Initial success: Mailman 3.3 integrated with Zimbra 8.8
by Morris Jones Dec. 2, 2020

Dec. 2, 2020

I have a very old existing mail server running Zimbra 6 with a mailman 2.1 instance alongside. I needed to rebuild my mail server for some compelling reasons (the old server used outdated TLS protocol, I could no longer compile clamav, nothing could really be updated). The final straw was a lack of support for my old commercial SSL certificates. I patched in a letsencrypt certificate to get through the past six months. I'm in the process of commissioning a new mail server using an 8GB Linode, Ubuntu 18, Zimbra 8.8, and Mailman 3.3. A couple of days ago I had my first successful list creation, with user confirmation working by email. I have django running with uwsgi, and am using Zimbra's installed nginx proxy to reverse proxy http traffic to Postorius and Hyperkitty. Nginx is doing the SSL layer. The mailman core mta hooks are all done using Zimbra's "local configuration" technique. In theory I should be able to do Zimbra upgrades with a minimum of hassle. I've written up a "case history" of how it came together. I have a .rst file in a gitlab project here: https://gitlab.com/MojoLA/mailman3.3-zimbra-8.8-integration I suppose this is a crazy project, but it's worthwhile to me. (Mark, thank's so much for integrating the virtual domain maps. It took me about three days to recognize that they were the solution to bounced mails to list-owner@...) Now I can spend some time migrating my email accounts (only four) from the old server to the new one, and move a dozen or so mailing lists to the new mailman3 instance. I'll have to get accustomed to a new way to manage the mail lists, and already really like what I've seen. Thank you. :) Best regards, Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

1 0

Mailmansuite.log Entries
by Brian Carpenter Dec. 2, 2020

Dec. 2, 2020

I see the following log entries in mailmansuite.log: INFO 2020-11-28 00:00:52,242 29142 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-11-28 00:01:00,600 29142 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 INFO 2020-11-29 00:00:52,135 15513 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-11-29 00:01:00,192 15513 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 INFO 2020-11-30 00:00:52,484 22622 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-11-30 00:01:00,758 22622 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 INFO 2020-12-01 00:00:50,246 11946 hyperkitty.lib.mailman 2117 emails left to refresh, checked 1000 INFO 2020-12-01 00:00:59,688 11946 hyperkitty.lib.mailman 2117 emails left to refresh, checked 2000 I assume this is a result of importing archives from a MM2 mbox file. This happen months ago however. Why are these entries still showing up? -- Brian Carpenter Harmonylists.com Emwd.com

2 3

12/24 hour clock ?
by Per Jessen Nov. 28, 2020

Nov. 28, 2020

Hi all at openSUSE we have recently migrated to mailman3, and we seem to be having a couple of teething issues: a) hyperkitty and postorius both seem to insist on using a 12 hour clock format, no matter what the user has set. Is there a way of changing it system-wide ? b) overriding the default set of footers - despite having set the template "list:member:regular:footer" to empty for a specific list, I am still getting the default footers attached. We are using version 1.3.3. thanks Per Jessen

2 2

No styling for web apps?
by Morris Jones Nov. 27, 2020

Nov. 27, 2020

I have most of a new mailman suite server built and working ... collectstatic gathered a good array of static files (uncompressed so far) nginx appears to be serving them successfully The Firefox developer tools show css and js files all being delivered But none of the postorius or hyperkitty pages exhibit any styling at all, only bare HTML elements. The Firefox inspector will show the available styles being requested and delivered (style.css, bootstrap, jquery, all the things). But if I use the inspector to look at the page, nothing has any CSS properties. I know I'm missing something simple. (Happy Thanksgiving!) Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

2 3

where is manage.py for migration?
by Dan Langille Nov. 26, 2020

Nov. 26, 2020

Hello, I am following https://docs.mailman3.org/en/latest/migration.html and I'm trying to "Migrate the list archives from Mailman 2 to Mailman 3 by running the following command": [mailman@mailman ~]$ python manage.py hyperkitty_import -l biking(a)lists.example.org /usr/local/mailman/archives/private/biking.mbox python: can't open file 'manage.py': [Errno 2] No such file or directory Is the documentation correct? I cannot locate manage.py in the code: $ git clone https://gitlab.com/mailman/mailman.git Cloning into 'mailman'... ... $ cd mailman/ $ find . -name manage.py $ Am I doing this wrong? Thank you. -- Dan Langille dan(a)langille.org

2 1

mailman 3.3.2 config file location
by Eric Broens Nov. 25, 2020

Nov. 25, 2020

Hi, I am trying to install Mailman 3.3.2 in a python virtual environment, and don't understand why the following is happening.When executing "mailman info", it shows that "the config file is located in /etc/mailman3/mailman.cfg as is intended, hence "outside" the virtual environment. However, after having started mailman, and running "mailman info" again, the default (empty) config files seems to be created in the directory where mailman has been started:config file: /opt/mailman/mailman-suite/mailman-suite_project/var/etc/mailman.cfg This happens even when mailman is started with the option "-C /etc/mailman3/mailman.cfg".Does this mean that the config file needs to be located in a subdirectory of python's virtual environment? (venv) [root@test-vps mailman-suite_project]# mailman infoGNU Mailman 3.3.2 (Tom Sawyer)Python 3.6.8 (default, Apr 16 2020, 01:36:27)[GCC 8.3.1 20191121 (Red Hat 8.3.1-5)]config file: /etc/mailman3/mailman.cfgdb url: mysql+pymysql://*****:*****@localhost/mailman?charset=utf8&use_unicode=1devmode: DISABLEDREST root url: http://localhost:8001/3.1/REST credentials: restadmin:restpass (venv) [root@test-vps mailman-suite_project]# mailman startStarting Mailman's master runnerGenerating MTA alias maps (venv) [root@test-vps mailman-suite_project]# mailman infoGNU Mailman 3.3.2 (Tom Sawyer)Python 3.6.8 (default, Apr 16 2020, 01:36:27)[GCC 8.3.1 20191121 (Red Hat 8.3.1-5)]config file: /opt/mailman/mailman-suite/mailman-suite_project/var/etc/mailman.cfgdb url: sqlite:////opt/mailman/mailman-suite/mailman-suite_project/var/data/mailman.dbdevmode: DISABLEDREST root url: http://localhost:8001/3.1/REST credentials: restadmin:restpass Thanks,Eric

2 2

Welcome Message
by brian＠emwd.com Nov. 25, 2020

Nov. 25, 2020

Is it possible for a list admin to modify the welcome message for a list via Postorius? Is the process: 1. Log into Postorious 2. Click on the Templates tab. 3. Select New Template. 4. Select "The notice sent to a member when they are subscribed to the mailing list" 5. Add your text and click the save button. Is the correct process? I am using the latest Docker release of Mailman 3.

5 25

Mailman automatic accept notification
by tambet.paide＠mkm.ee Nov. 25, 2020

Nov. 25, 2020

How can I configure mailman so that all the users in mailing list won't get automatic accept notification (uncaught bounce notification)? I'm using Mailman 3 and cat figure it out

1 0

Mailman Core 3.3.2 is now out
by Abhilash Raj Nov. 25, 2020

Nov. 25, 2020

Hi Everyone, I am pleased to announce that with a week long delay from the planned date, GNU Mailman Core 3.3.2 is now finally out. This release includes both bug fixes and some new features. Some notable changes include: - Support for inviting users to join mailing lists. - New adddmembers, delmembers and syncmembers command to manage membership from CLI. - Addition of new REST API endpoints that return the count of held messages and subscription requests of much faster page loads in Postorius. - Addition of support for filtering in some API endpoints like Members and Subscription requests. - Support for address= option in email join command to subscribe an address other then sending address. - Addition of who email command to lookup memberships. - Expose emergency field for MailingList resource in REST API. - Several bug fixes to support new major version of libraries like dnspython, flufl.* etc. You can install it using: $ pip install --upgrade mailman The tarball for the release is available at PyPI: https://pypi.org/project/mailman/ Finally, many thanks to all the contributors who have helped make this release a success! -- Abhilash Raj (maxking) on behalf of Mailman Core team

5 12

Moderation not working?
by peter＠chubb.wattle.id.au Nov. 24, 2020

Nov. 24, 2020

Hi Folks, Running a shiny new instance of mailman3, as per the Debian package (version 3.2.2) but the moderation doesn't seem to work. WE got hit by a heap of spammers overnight, even though the 'hold for moderation' bit is set for non-members (and now for members too). Emails seem just to get straight through. Any advice on how to debug this? Would upgrading to a later version using pip help? Peter C

2 3

How to strip DKIM headers on a domain level or a list level
by Stephen J. Turnbull Nov. 24, 2020

Nov. 24, 2020

Rob Jenson writes: > I need to strip DKIM headers on the inbound messages to my list or > to my domain. Why do you need to strip DKIM headers? The standard specifies that an invalid DKIM signature must be treated the same as if there were no signature at all. So an invalid DKIM signature may be treated as spammier than a message with a valid signature, but that should not be treated differently from an unsigned message (as would appear after removing those header fields). I know this feature is in demand from list admins, but I've never seen convincing evidence that it's actually effective for any of the usual suspects (Yahoo!, AOL, Gmail), only for small domains with pigheaded admins who are proud of their non-conforming configurations, and announce that they are discarding messages which have invalid DKIM signatures. > What I do not understand from the documentation for Mailman 3 Core > is whether it is possible for my hosting service to set > remove_dkim_headers just for our domain. It currently is not possible. It probably could be made possible on a per-domain or per-list basis, but it's not clear to me why it would be useful to do so. If there really are non-conforming receivers out there, it's probably a good idea to strip host-wide. > If that is not possible, then the question becomes "is there a way, > in the list configuration, to strip the DKIM headers? It is possible, but that requires changing the list's processing pipeline to add that capability. I believe this is not difficult (I haven't done similar changes with Mailman 3 yet) but it does require the assistance of the host, and possibly imposes a future maintenance burden on the host. > We are munging the text of the message in Mailman, so the DKIM > headers from the original poster are invalid. As I explained above, both DKIM and DMARC are specified so that "no signature" == "invalid signature" for the purposes of spam processing. Are you sure that Yahoo! (or any other provider used by your subscribers) is treating invalid signatures differently from absence of signatures? The person responsible for Yahoo! MTA configuration is a well-known mail security expert who participated actively in the specification of all these protocols (and she also gave me a kitten, so I may be biased). > As far as I can see, our service provider is using ARC in our > Mailman configuration, but not signing the outbound messages with > DKIM. That surprises me. ARC isn't really a substitute for the MTA's own DKIM signature, at least not yet. > Therefore the DKIM signature from the poster's mail service > provider is sent out with their DKIM header, which seems to be > problematic. It shouldn't be. > If I understand ARC correctly, it is validating the DKIM signature > from the poster, creating a new signature and metadata indicating > that what it received was properly signed. That is correct. As far as I know, Yahoo! does participate in the ARC protocol and used to have conforming implementations of DKIM and DMARC. That doesn't mean you get a free ride: they may still have your IP on a blacklist from former owners of the IP, for example. Or your posts may "look like" spam for some other reason, or your lists may need more time to build up a clean reputation. But I need evidence more convincing than "list posts are recognized as spam" to believe that removing DKIM headers will help. (For example, my employer's filters regularly recognize messages from department heads as spam, even with DKIM signatures intact. ;-)

6 9

Re: mailman 3.3.2 config file location
by Eric Broens Nov. 24, 2020

Nov. 24, 2020

Apparently I lost the "layout:" config setting which defaults to [paths.here]. Best Regards,Eric

1 0

installation
by Christian Stalberg Nov. 24, 2020

Nov. 24, 2020

I am working through installing mailman3 on Ubuntu 20.04.1 LTS / apache 2.4.41 / postfix 3.4.13 and have a couple of questions. I've installed Django, cloned the mailman-suite repo, installed and tested apache with Mod_wsgi [ according to https://tecadmin.net/install-apache-with-python-mod-wsgi-on-ubuntu-20-04/ ] and it worked fine. Now I am at 'Setting up a WSGI' server in the MM3 instructions where it says I am to configure uwsgi.ini file. Does that .ini file go in /opt/mailman/mailman where other .ini files reside? In setting up the apache virtual server [ according to https://docs.mailman3.org/projects/postorius/en/latest/deployment.html?highl ight=apache#apache-with-mod-wsgi ] I do not find a postorius.wsgi which WSGIScriptAlias points to. Thank you! ~Christian

5 9

mailman services under systemd
by Morris Jones Nov. 22, 2020

Nov. 22, 2020

First post, I'm building a new mail server as my tired old server can no longer meet security requirements. (It's long overdue.) I see where Torge Riedel is running the mailman service under systemd, but I'm having trouble doing that. I don't see a mailman option that doesn't detach as a daemon. Did I miss something? Anyone have a systemd service example I might pilfer? Mojo -- Morris Jones, Monrovia, CA [1]BridgeMojo [2]Old Town Sidewalk Astronomers [3]Mojo's Blog References 1. http://bridgemojo.com/ 2. http://otastro.org/ 3. http://mojo.whiteoaks.com/

2 1

Reply w/Email Clients - From: vs. Reply-To:
by j＠manygoodideas.com Nov. 20, 2020

Nov. 20, 2020

I'm setting up a new list, and a number of new list members are reporting a problem with replying to the thread. Their email clients seem to ignore the Reply-To: field and instead use from From: field. When they use Reply All, the email is addressed to both the From: and Reply-To:. Reading through previous threads here, I've tried a number of things: 1) DMARC mitigation action is "Replace From: with list address" 2) For Alter Messages - Set "Reply goes to list" The goal is that we want a reply to go to the list, not the person posting. Since Reply-To seems to be ignored by some clients, I'm hoping there's a way to force the "From" field to become the list address. Thanks in advance for your suggestions!

3 2

mailman-suite: Error 500 on Lists /setting/ pages
by ljsbw-it＠riseup.net Nov. 20, 2020

Nov. 20, 2020

I just installed Mailman3 (mailman-suite) on my Server following these instructions: https://lab.uberspace.de/guide_mailman-3.html and everything works fine so far. I can create lists, subscribe people and send mails through lists but when I click the settings button and get redirected to /postorius/lists/listname/settings/ i get an Error 500 message. I couldn't find anything in the logs except the uwsgi log: [pid: 20568|app: 0|req: 62/62] 100.64.115.1 () {48 vars in 1052 bytes} [Wed Nov 18 16:27:59 2020] GET /postorius/lists/listname/settings/ => generated 1102 bytes in 1438 msecs (HTTP/1.1 500) 6 headers in 209 bytes (1 switches on core 0)

3 2

Moderation for nested mailing lists
by peterbw＠gmail.com Nov. 20, 2020

Nov. 20, 2020

Hi Everyone, I have a list that has other mailing lists as members. When a non-member posts to this list I receive a moderation message. After approving the moderation message I then receive a lot of other moderation messages for the sub-lists that are members of the "top-most" list (since the non-member is not a member of any of the sub-lists). Is there any way to approve a message for moderation once and have all sub-lists automatically approve the message? Thanks for your help with this and have a nice day! Peter

2 1

How can I allow members of list A to post to List B and vice versa
by mario.mailman3＠frese.online Nov. 19, 2020

Nov. 19, 2020

Hi, I am trying to setup Mailman3 for our school. There I have several groups (teachers, parents) that have their own mailling lists. But it also should be possible that the parents can sent mails to the teachers list and vice versa. The manual management via the non-members list will be very inconvenient and the command-line options that I saw so far do not include the import of non-members (mailman syncmembers and mailman addmembers). The best option I would like to have is to enter the name of List A in the non-members of List B an vice versa. All those nonmembers should not need to be moderated. How can I manage this? I would be very glad for your ideas. Best Mario

2 1

Customising hyperkitty and postorius
by peter＠chubb.wattle.id.au Nov. 19, 2020

Nov. 19, 2020

Hi, I've put up a mailman3 instance, with hyperkitty enabled, and imported all my mailman2.1 archives -- it all seems to be working. How do I now customise the look and feel of my site? In particular, I'd like to render archived emails with a monospace font, and I'd like to change the colour scheme and styles of all the pages to match other pages on the same website. Peter C

2 1

Dealing with confirmation requests for unsubscribes
by Brian Carpenter Nov. 18, 2020

Nov. 18, 2020

Hello List, I ran into the following issue for some mailman 3 lists that I am hosting: https://gitlab.com/mailman/mailman/-/issues/768 Since there is no way for a list owner to deal with a moderation request for an unsubscription task, I assume I need to do something via the command line. This is where I need some help with. How do I deal with these moderation requests that are unable to be reviewed in an admin gui (Postorius/Affinity)? I do recommend removing such choices for Postorius for Member policy. I will be doing this for Affinity until issue 768 is resolved. Thanks! -- Brian Carpenter Harmonylists.com Emwd.com

2 2

KeyError: 'subject_prefix'
by Torge Riedel Nov. 18, 2020

Nov. 18, 2020

Hi, today I had the following error in my inbox: KeyError: 'subject_prefix' AttributeError: 'MailingList' object has no attribute 'subject_prefix' I checked the database, there is a column "subject_prefix", so I feel it is something in the code causing the error. It's mailman 3.3.1 and I don't see a fix for such an error in the Changes of 3.3.2 Kind regards Torge Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 119, in __getattr__ return self._get(name) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 86, in _get raise KeyError(key) KeyError: 'subject_prefix' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/models/mailinglist.py", line 197, in update_from_mailman value = getattr(mm_list, propname) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 124, in __getattr__ self.__class__.__name__, name)) AttributeError: 'MailingList' object has no attribute 'subject_prefix' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/django_extensions/management/commands/runjobs.py", line 36, in runjobs job().execute() File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/jobs/sync_mailman.py", line 36, in execute sync_with_mailman() File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/lib/mailman.py", line 132, in sync_with_mailman mlist.update_from_mailman() File "/opt/mailman/web/venv/lib/python3.6/site-packages/hyperkitty/models/mailinglist.py", line 199, in update_from_mailman value = mm_list.settings[propname] File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 146, in __getitem__ return self._get(key) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 88, in _get return self.rest_data[key] File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/base.py", line 74, in rest_data response, content = self._connection.call(self._url) File "/opt/mailman/web/venv/lib/python3.6/site-packages/mailmanclient/restbase/connection.py", line 112, in call error_msg, response, None) urllib.error.HTTPError: HTTP Error 500: <html> <head> <title>Internal Server Error</title> </head> <body> <h1><p>Internal Server Error</p></h1> </body> </html> ERROR OCCURED IN DAILY JOB: sync_mailman (APP: hyperkitty) START TRACEBACK: END TRACEBACK

3 6

Templates
by Odhiambo Washington Nov. 18, 2020

Nov. 18, 2020

Hello good people, So today I decided that I should be looking at MM3 to see how far it can take me. I started from the templates and created one for a footer for non-digest messages. When I sent a test mail to the list I am using for testing, the following errors popped up: --- Logging error --- Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/model/template.py", line 110, in get contents = protocols.get(actual_uri, **auth) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/utilities/protocols.py", line 39, in get response.raise_for_status() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/requests-2.24.0-py3.7.egg/requests/models.py", line 941, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://localhost:8000/mm3/mailman3/api/templates/list/kictanet-2.lists.kict… During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/logging.py", line 76, in emit msg = self.format(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 869, in format return fmt.format(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 611, in format s = self.formatMessage(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 580, in formatMessage return self._style.format(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 422, in format return self._fmt % record.__dict__ KeyError: 't' Call stack: File "/opt/mailman/mm/venv/bin/runner", line 33, in <module> sys.exit(load_entry_point('mailman==3.3.3b1', 'console_scripts', 'runner')()) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 829, in __call__ return self.main(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 782, in main rv = self.invoke(ctx) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 1066, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/core.py", line 610, in invoke return callback(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/click-7.1.2-py3.7.egg/click/decorators.py", line 21, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/bin/runner.py", line 188, in main runner.run() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/runner.py", line 134, in run filecnt = self._one_iteration() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/mta/deliver.py", line 86, in deliver refused = agent.deliver(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/mta/base.py", line 167, in deliver callback(mlist, message_copy, msgdata_copy) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/mta/decorating.py", line 32, in decorate decorator.process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/handlers/decorate.py", line 264, in process process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/handlers/decorate.py", line 89, in process footer = decorate('list:member:regular:footer', mlist, d) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/handlers/decorate.py", line 226, in decorate template = getUtility(ITemplateLoader).get(name, mlist, **extradict) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/model/template.py", line 189, in get name, lookup_context, **substitutions) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/model/template.py", line 118, in get actual_uri, auth.get('auth', '<no authorization>'))) File "/usr/local/lib/python3.7/logging/__init__.py", line 1413, in exception self.error(msg, *args, exc_info=exc_info, **kwargs) File "/usr/local/lib/python3.7/logging/__init__.py", line 1407, in error self._log(ERROR, msg, args, **kwargs) File "/usr/local/lib/python3.7/logging/__init__.py", line 1514, in _log self.handle(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 1524, in handle self.callHandlers(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 1586, in callHandlers hdlr.handle(record) File "/usr/local/lib/python3.7/logging/__init__.py", line 894, in handle self.emit(record) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/mailman-3.3.3b1-py3.7.egg/mailman/core/logging.py", line 85, in emit self.handleError(record) Message: 'Cannot retrieve template at http://localhost:8000/mm3/mailman3/api/templates/list/kictanet-2.lists.kict… (<no authorization>)' Arguments: () I am unable to guess the cause of this. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

2 3

warning: database postfix_domains.db is older than source file postfix_domains
by Torge Riedel Nov. 15, 2020

Nov. 15, 2020

Hi, I frequently get this warning mail.log. stat'ing the files give: # stat /opt/mailman/var/data/postfix_domains File: /opt/mailman/var/data/postfix_domains Size: 361 Blocks: 8 IO Block: 4096 regular file Device: 801h/2049d Inode: 1573095 Links: 1 Access: (0660/-rw-rw----) Uid: ( 1004/ mailman) Gid: ( 1002/ mailman) Access: 2020-10-24 19:52:16.887258326 +0200 Modify: 2020-10-20 07:09:48.792000000 +0200 Change: 2020-10-20 07:09:48.792000000 +0200 Birth: - # stat /opt/mailman/var/data/postfix_domains.db File: /opt/mailman/var/data/postfix_domains.db Size: 12288 Blocks: 24 IO Block: 4096 regular file Device: 801h/2049d Inode: 1583965 Links: 1 Access: (0640/-rw-r-----) Uid: ( 1004/ mailman) Gid: ( 1002/ mailman) Access: 2020-10-26 07:46:54.569935782 +0100 Modify: 2020-10-20 07:09:47.575889000 +0200 Change: 2020-10-20 07:09:47.575889000 +0200 Birth: - I do not have the feeling that this is really a problem, cause everything works well. But it is confusing and misleading and might makes me missing a problem in the future, when the database is really outdated. Could this be easily fixed in mailman? It's mailman core 3.3.1. Kind regards Torge

3 6

MIMEDefang to fix footers
by Ryan Morash Nov. 15, 2020

Nov. 15, 2020

Does anyone know how to use MIMEDefang to fix the footer as attachment issue when using Mailman3? I've seen several guides/scripts referring to its use with Mailman2, but I'm unsure of how they would match with Mailman 3. Other ways of fixing this issue are also welcome. Ryan Morash IT Support Technician Questar III BOCES Confidential Transmission This correspondence is confidential and may contain privileged materials or information. It is intended for the use of the addressee only and all others are prohibited from copying or disseminating this message or its contents. If you have received this transmission in error, delete it immediately and notify the sender.

3 2

Hyperkitty Error Curiosity
by Brian Carpenter Nov. 12, 2020

Nov. 12, 2020

Hello Everyone, There was a message sent to a list that could not be archived by Hyperkitty for the following reason: WARNING 2020-11-03 17:20:54,507 800 hyperkitty.views.mailman Could not archive the email with message-id '<67BEBD75-B3DC-45E3-9C2F-55482F811238(a)ispdomain.com>': A string literal cannot contain NUL (0x00) characters. It looks like there was a problem with the email message itself. What causes such an error? Thank you for any insight. -- Brian Carpenter Harmonylists.com Emwd.com

2 8

digest summary heavily cluttered with hrml code
by Mohsen Masoudfar Nov. 11, 2020

Nov. 11, 2020

Hi, I am running Mailman 3.1.1 on Ubuntu 18.04. The user complains that the digest summary is cluttered with HTML code. I thought, I may fix it by: Members > {user} > Member options > Delivery mode set to [Plain Text Digest]. After setting the value and clicking [save changes], I tried to check the value by getting back to Members setting for the user, it shows the value as "Regular", which was the value before I tried to update it. Question 1: How may I be sure that the value is set, if it is set? Question 2: How may set it for all members of the list? Question 3: Is there a CLI way to do this? I tried "mailman members " command. But it seems not supporting this option. Any help is much appreciated. Thanks Mohsen

2 4

members list in Postorius
by Peter Münster Nov. 10, 2020

Nov. 10, 2020

Hi, Where can I display the members list of a mailing list please? The setting of "Members List Visibility" is "Only mailing list members". So I guess that a member should be able to see the members list somewhere... I'm using Postorius 1.3.3 and Mailman 3.3.1. TIA for any help, -- Peter

2 1

Mailman3 don't work if aliases are enabled
by Massimo Zappalà Nov. 9, 2020

Nov. 9, 2020

Hi everybody, Using the following postfix configuration file, email messages and mailing lists works fine with mailman3. But if I send an email to an alias, the message is not received. My main.cf alias_maps = hash:/etc/aliases compatibility_level = 2 content_filter = amavis:[127.0.0.1]:10024 inet_protocols = ipv4 local_recipient_maps = proxy:unix:passwd.byname $alias_maps hash:/var/lib/mailman3/data/postfix_lmtp mailbox_size_limit = 0 message_size_limit = 20480000 milter_default_action = accept milter_protocol = 2 myhostname = glugct.catania.linux.it non_smtpd_milters = inet:localhost:12301 owner_request_special = no recipient_delimiter = + relay_domains = smtp_header_checks = regexp:/etc/postfix/header_checks smtp_mime_header_checks = regexp:/etc/postfix/header_checks smtp_tls_CApath = /etc/ssl/certs smtp_tls_cert_file = $smtpd_tls_cert_file smtp_tls_key_file = $smtpd_tls_key_file smtp_tls_security_level = may smtp_use_tls = yes smtpd_banner = $myhostname ESMTP smtpd_milters = inet:localhost:12301 smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_invalid_hostname, reject_non_fqdn_hostname, reject_non_fqdn_sender, reject_non_fqdn_recipient, reject_unknown_sender_domain, reject_unknown_recipient_domain, reject_unauth_destination, check_policy_service inet:[127.0.0.1]:10023, reject_rbl_client zen.spamhaus.org, reject_rbl_client bl.spamcop.net, reject_rbl_client cbl.abuseat.org, permit smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_tls_CApath = /etc/ssl/certs smtpd_tls_cert_file = /etc/letsencrypt/live/mail.catania.linux.it/fullchain.pem smtpd_tls_eecdh_grade = strong smtpd_tls_key_file = /etc/letsencrypt/live/mail.catania.linux.it/privkey.pem smtpd_tls_security_level = may tls_preempt_cipherlist = yes transport_maps = hash:/var/lib/mailman3/data/postfix_lmtp virtual_gid_maps = static:5000 virtual_mailbox_base = /var/vmail virtual_mailbox_domains = mysql:/etc/postfix/mysql_virtual_mailbox_domains.cf virtual_transport = lmtp:unix:private/dovecot-lmtp virtual_uid_maps = static:5000 #virtual_alias_maps = mysql:/etc/postfix/mysql_virtual_alias_emails.cf, mysql:/etc/postfix/mysql_virtual_alias_maps.cf #virtual_mailbox_maps = mysql:/etc/postfix/mysql_virtual_mailbox_maps.cf ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_alias_emails.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT email FROM users WHERE email='%s' ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_alias_maps.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT destination FROM aliases WHERE source='%s' ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_mailbox_domains.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT 1 FROM domains WHERE domain='%s' ----------------------------------------------------------------------------------------- My /etc/postfix/mysql_virtual_mailbox_maps.cf user = postfix password = postfixpass hosts = 127.0.0.1 dbname = postfix query = SELECT 1 FROM users WHERE email='%s' ----------------------------------------------------------------------------------------- If I try to uncomment the last two rows in main.cf virtual_alias_maps = mysql:/etc/postfix/mysql_virtual_alias_emails.cf, mysql:/etc/postfix/mysql_virtual_alias_maps.cf virtual_mailbox_maps = mysql:/etc/postfix/mysql_virtual_mailbox_maps.cf The aliases and email messeges works fine but the mailman3's mailinglist don't work. How can I solve this? Thank You in advance.

2 2

Digest Formatting
by mailman＠manygoodideas.com Nov. 7, 2020

Nov. 7, 2020

It appears that a digest is formatted as: list:member:digest:masthead 1. Thread 1 ... N. Thread N foreach thread list:member:digest:header thread list:member:digest:footer A number of my testers are complaining about the formatting: 1) it's hard to visually identify each of the threads (the TOC numbers them, but the numbers aren't shown next to each thread, for example) and 2) it's hard for a novice to know how to reply to a digest thread I'm wondering how other admins have customized their digests to make them more useful. For example, if there was a way in list:member:digest:header to display a link to the archived thread, that would be a good start. list:member:digest:header could emit a horizontal line to separate each thread, but it would be nice to be able to show the number of the thread, etc. Yahoo! Groups used to send out HTML digests that had the thread titles nicely distinguished, live links to the thread, and links to Reply to sender, Reply to All, etc. Thanks for any suggestions!

4 8

Member Issue Discovered
by Brian Carpenter Nov. 6, 2020

Nov. 6, 2020

Hi Everyone, If I subscribed to a MM3 list with barn(a)emwd.com with the name of Barn Quilter. It shows up in the member roster. So far, so good. I then unsubscribe barn(a)emwd.com. It no longer shows up in the member roster. So far so good. I then resubscribe barn(a)emwd.com with either no name or Barn User and it shows up in the member roster as barn(a)emwd.com with the name of Barn Quilter. Is this a known bug and has been fixed with the latest release? -- Brian Carpenter Harmonylists.com Emwd.com

10 52

Open Subscription Policy
by Brian Carpenter Nov. 5, 2020

Nov. 5, 2020

I have a question regarding the use of an open subscription policy. What is the reasoning behind such a policy? Is this something for an organization that runs a Mailman 3 instance on a private network? -- Brian Carpenter Harmonylists.com Emwd.com

2 1

Internal Server Error by Clicking on OrmQ Queue
by Stephan Krinetzki Nov. 4, 2020

Nov. 4, 2020

Dear list, on our Mailman 3 system we are hitting the following error by clicking a link to admin/django_q/ormq/: Server Error The Log prints: --- ERROR 2019-08-26 08:48:01,704 10311 django.request Internal Server Error: /admin/django_q/ormq/ Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 566, in get_field return self.fields_map[field_name] KeyError: 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 276, in lookup_field f = _get_non_gfk_field(opts, name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 307, in _get_non_gfk_field field = opts.get_field(name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 568, in get_field raise FieldDoesNotExist("%s has no field named '%s'" % (self.object_name, field_name)) django.core.exceptions.FieldDoesNotExist: OrmQ has no field named 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/library.py", line 214, in render _dict = self.func(*resolved_args, **resolved_kwargs) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 326, in result_list 'results': list(results(cl))} File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 302, in results yield ResultList(None, items_for_result(cl, res, None)) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 293, in __init__ super().__init__(*items) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 212, in items_for_result f, attr, value = lookup_field(field_name, result, cl.model_admin) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 289, in lookup_field value = attr() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 200, in task_id return self.task()['id'] File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 194, in task return SignedPackage.loads(self.payload) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128) ERROR 2019-08-26 08:48:01,704 10311 django.request Internal Server Error: /admin/django_q/ormq/ Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 566, in get_field return self.fields_map[field_name] KeyError: 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 276, in lookup_field f = _get_non_gfk_field(opts, name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 307, in _get_non_gfk_field field = opts.get_field(name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 568, in get_field raise FieldDoesNotExist("%s has no field named '%s'" % (self.object_name, field_name)) django.core.exceptions.FieldDoesNotExist: OrmQ has no field named 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/library.py", line 214, in render _dict = self.func(*resolved_args, **resolved_kwargs) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 326, in result_list 'results': list(results(cl))} File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 302, in results yield ResultList(None, items_for_result(cl, res, None)) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 293, in __init__ super().__init__(*items) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 212, in items_for_result f, attr, value = lookup_field(field_name, result, cl.model_admin) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 289, in lookup_field value = attr() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 200, in task_id return self.task()['id'] File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 194, in task return SignedPackage.loads(self.payload) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128) --- Any ideas how to see the complete queue an maybe delete some defunct entries?

2 1

Change Default Settings
by Dieter Leupold Nov. 3, 2020

Nov. 3, 2020

Hi Team, I want to change default settings (like "welcome message" to set to no) for the lists to create. How can i do that? Thanks a lot Dieter Leupold

2 3

Hyperkitty: usage of h2-tags
by Peter Münster Nov. 2, 2020

Nov. 2, 2020

Hi, Why does Hyperkitty use h2-tags for the last line before the signature please? Example: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… Kind regards, -- Peter

2 2

Subscription issue with ghost confirmations
by Brian Carpenter Nov. 1, 2020

Nov. 1, 2020

I have a list owner who had his subscription policy set to confirm. Apparently that was too hard for his list members to handle so he changed it to moderate only. If someone sent a subscription request that needed to be confirm, did not respond to it, and then tried subscribing again after the member policy changed to moderate, their 2nd subscription attempt still shows up in the confirmation queue. Is that normal behavior. My understanding is it is. Please let me know if I am wrong here. The real mystery here is when someone tried subscribing again (listname-subscribe@listdomain) hours after the subscription policy was changed to moderate and they still showed up in the confirm queue. How is that possible? I tested the list with two of my addresses and both showed up in the moderation queue as expected. As far as I can tell from the mailman logs, this was the person's first attempt at subscribing. -- Brian Carpenter Harmonylists.com Emwd.com

3 9

Internal Server Error on installing Mailman 3 using PIP
by Shashikanth Komandoor Oct. 28, 2020

Oct. 28, 2020

Dear Mark, As you have suggested in my earlier issue, I have implemented the latest stable version of mailman 3 through the URL https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst… . But after the installation through the above URL, when I tried running the command *elinks http://localhost:8000/postorius/lists <http://localhost:8000/postorius/lists>* or *elinks http://localhost:8000/admin <http://localhost:8000/admin>*, I got the error as *Internal Server Error*. I don't find any specific log in mailman.log or in mailmansuite.log. Is there any way to solve this issue ? -- Thanks & Regards, Shashi Kanth.K 9052671936

2 1

AttributeError: 'MailingList' object has no attribute 'get_requests_count'
by Shashikanth Komandoor Oct. 28, 2020

Oct. 28, 2020

Hi Team, I am currently running Mailman 3 with version 3.3.2rc2 and in built postfix version 2.10.1-6 on RHEL 7.5 with PostgreSQL 11.9 version with default values. As of now, we don't have any lists and just installed software components only. After the installation and configuration, I have tried creating the domains and lists. I was successful in creating them but when I tried to login and browse the lists using LDAP authentication, I am getting the "Mailman REST API not available. Restart Mailman core". I see the below trace in the mailmansuite.log. *Traceback (most recent call last): File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/mailmanclient/restbase/base.py", line 119, in __getattr__ return self._get(name) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/mailmanclient/restbase/base.py", line 86, in _get raise KeyError(key)KeyError: 'get_requests_count'During handling of the above exception, another exception occurred:Traceback (most recent call last): File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/core/handlers/base.py", line 115, in _get_response response = self.process_exception_by_middleware(e, request) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/core/handlers/base.py", line 113, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/var/lib/mailman/postorius/src/postorius/views/generic.py", line 74, in dispatch return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/views/generic/base.py", line 97, in dispatch return handler(request, *args, **kwargs) File "/var/lib/mailman/postorius/src/postorius/views/list.py", line 311, in get return render(request, 'postorius/lists/summary.html', data) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/shortcuts.py", line 19, in render content = loader.render_to_string(template_name, context, request, using=using) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 171, in render return self._render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/library.py", line 234, in render return t.render(new_context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 173, in render return self._render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 936, in render bit = node.render_annotated(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 903, in render_annotated return self.render(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 986, in render output = self.filter_expression.resolve(context) File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/django/template/base.py", line 697, in resolve new_obj = func(obj, *arg_vals) File "/var/lib/mailman/postorius/src/postorius/templatetags/nav_helpers.py", line 80, in pending_subscriptions return mlist.get_requests_count(token_owner='moderator') File "/var/lib/mailman/venv3/lib64/python3.6/site-packages/mailmanclient/restbase/base.py", line 124, in __getattr__ self.__class__.__name__, name))AttributeError: 'MailingList' object has no attribute 'get_requests_count'ERROR 2020-10-25 19:29:46,101 835 django.server "GET /postorius/lists/mailteamhyd.dlist.nic.in/ <http://mailteamhyd.dlist.nic.in/> HTTP/1.1" 500 1162* I don't see any error messages in the mailman.log. And I also executed a few curl commands in getting the details of the lists created and list info which I got their results successfully. Could you please guide where exactly I am missing or do I need to make any changes in my customizations ? -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 21

Cron error
by gordon＠dickens.com Oct. 25, 2020

Oct. 25, 2020

I recently upgraded to mailman3 on two Debian servers and I am getting a cron error periodically sent to me as depicted below. It looks like a permission problem, however, /var/lib/mailman3/locks and /var/lib/mailman3/* all have user = "list" and group = "list" and the cron job runs as user = "list" so I don't quite understand why I am getting these errors. Hopefully, someone might reply with what the problem is. Thanks, Gordon Here is some additional information: "ls -ld locks" output: drwxr-xr-x 2 list list 4096 Sep 28 08:51 locks ls -l locks" output: total 12 -rw-rw---- 1 list list 80 Sep 28 00:00 'dbcreate.lck|slc.mailhub4u.com|24435|4056142050254595815' -rw-rw---- 2 list list 77 Sep 28 2020 master.lck -rw-rw---- 2 list list 77 Sep 28 2020 'master.lck|slc.mailhub4u.com|5291|3708878559945320758' Here is the error message that is emailed to me: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 216, in lock os.link(self._claimfile, self._lockfile) FileExistsError: [Errno 17] File exists: '/var/lib/mailman3/locks/dbcreate.lck|slc.mailhub4u.com|24435|4056142050254595815' -> '/var/lib/mailman3/locks/dbcreate.lck' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/mailman", line 11, in <module> load_entry_point('mailman==3.2.1', 'console_scripts', 'mailman')() File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/core.py", line 716, in main with self.make_context(prog_name, args, **extra) as ctx: File "/usr/lib/python3/dist-packages/click/core.py", line 641, in make_context self.parse_args(ctx, args) File "/usr/lib/python3/dist-packages/click/core.py", line 1089, in parse_args rest = Command.parse_args(self, ctx, args) File "/usr/lib/python3/dist-packages/click/core.py", line 940, in parse_args value, args = param.handle_parse_result(ctx, opts, args) File "/usr/lib/python3/dist-packages/click/core.py", line 1477, in handle_parse_result self.callback, ctx, self, value) File "/usr/lib/python3/dist-packages/click/core.py", line 96, in invoke_param_callback return callback(ctx, param, value) File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 94, in initialize_config initialize(value) File "/usr/lib/python3/dist-packages/mailman/core/initialize.py", line 218, in initialize initialize_2(propagate_logs=propagate_logs) File "/usr/lib/python3/dist-packages/mailman/core/initialize.py", line 177, in initialize_2 config.db = getUtility(IDatabaseFactory, utility_name).create() File "/usr/lib/python3/dist-packages/mailman/database/factory.py", line 50, in create with Lock(os.path.join(config.LOCK_DIR, 'dbcreate.lck')): File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 334, in __enter__ self.lock() File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 248, in lock elif self._read() == self._claimfile: File "/usr/lib/python3/dist-packages/flufl/lock/_lockfile.py", line 442, in _read with open(self._lockfile) as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/locks/dbcreate.lck'

3 8

migration from 2.1 - owners and moderators
by Alex Schuilenburg Oct. 25, 2020

Oct. 25, 2020

We're migrating from 2.1 to 3.2.1 and an odd issue has popped up. It may be something different in the way mailman3 works, or a misconfiguration on my part. Most of the lists migrated so far don't have moderators, just owners. However, when these lists have messages requiring moderation, the owners dont get notified of held messages - unlike 2.1 where they did. Is this a change or is there something I am missing in the configuration? I have the minute/quarterly/hourly etc cron jobs running, although I have had to tune down the frequency of minute to hourly as it takes 6.5 minutes to run* - but I doubt this is the cause. While for the moment I have found the held messages in files in /var/lib/mailman3/messages and figured out which lists are in need of attention (and notified the owners), it seems I may have to do a bit of coding myself to walk through the lists and notify owners when their list is in need of attention. There must surely be something that does this already - or is this moderators only in mailman3? Guidance appreciated. Thanks -- Alex * From the list I realise this is because I am still using the default whoosh backend to haystack and need urgently to switch to xapian or solr, but the info on how to get this working for a noob like me is unfortunately lacking :-(

3 5

How to get Hyperkitty to show actual sender e-mail addresses?
by Hans-Martin Mosner Oct. 24, 2020

Oct. 24, 2020

Hi, I'd like to show actual sender e-mail addresses (basically to block spammers sending to a list that is used as a contact address, so it has no moderation for non-member postings). Hyperkitty just show the display name, which not very informative. Is there a setting to change this behavior? I did not find any using internet search and sifting through the various config files, but I could easily have missed something. Cheers, Hans-Martin

2 1

Alias Domains in postfix_domains wrong way around?
by Hans-Martin Mosner Oct. 24, 2020

Oct. 24, 2020

Hi, we have an "Unusual Postfix configuration" and use "Alias Domains" to work around. However, it looks like "mailman aliases" generates the postfix_domains map the wrong way around, resulting in postfix "Relay access denied" errors for mails received from outside. Didn't notice at first since I tried locally of course. Is my understanding correct that postfix_domains should have the true (externally visible) domains as keys, and values that basically don't matter, or should it have both the real domains and their alias names as keys? With such a convoluted setup, my brain twists a little. For now, I'm listing the real domains explicitly, that seems to work for the local and non-local cases. Cheers, Hans-Martin

2 1

Unsubscribe Notifications to List Owners and Members
by Brian Carpenter Oct. 22, 2020

Oct. 22, 2020

It seems that the only time an unsubscribe notification is sent to a list owner and/or list member is when a list member sends an email to lisname-unsubscribe@listdomain and that list member is not registered with Affinity/Postorius. Can anyone confirm this and if confirmed, is this considered a bug? -- Brian Carpenter Harmonylists.com Emwd.com

2 2

Re: Unsubscribe Notifications to List Owners and Members
by Brian Carpenter Oct. 22, 2020

Oct. 22, 2020

What list are you trying to unsubscribe from and how are you doing it? On 10/22/20 4:58 PM, Jerry Koutavas wrote: > > No offense but been trying to unsubscribe for months, nothing happens > > *From:*Brian Carpenter [mailto:brian_carpenter@emwd.com] > *Sent:* Thursday, October 22, 2020 4:56 PM > *To:* Mailman users <mailman-users(a)mailman3.org> > *Subject:* [MM3-users] Unsubscribe Notifications to List Owners and > Members > > It seems that the only time an unsubscribe notification is sent to a > list owner and/or list member is when a list member sends an email to > lisname-unsubscribe@listdomain <mailto:lisname-unsubscribe@listdomain> > and that list member is not registered > with Affinity/Postorius. Can anyone confirm this and if confirmed, is > this considered a bug? > > > > -- > Brian Carpenter > Harmonylists.com > Emwd.com > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > <mailto:mailman-users@mailman3.org> > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > <mailto:mailman-users-leave@mailman3.org> > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > > ------------------------------------------------------------------------ > > *Total Control Panel* > > > > Login <https://asp.reflexion.net/login?domain=ascii.com> > > To: jk(a)ascii.com > <https://asp.reflexion.net/address-properties?aID=10188568&domain=ascii.com> > > From: mailman-users-bounces+jk=ascii.com(a)mailman3.org > <mailto:mailman-users-bounces+jk=ascii.com@mailman3.org> > > > > Message Score: 70 > > > > High (60): Fail > > My Spam Blocking Level: Medium > > > > Medium (75): Pass > > > > > Low (90): Pass > > Block > <https://asp.reflexion.net/FooterAction?ver=3&bl-sender-address=1&hID=458079…> > this sender / Block > <https://asp.reflexion.net/FooterAction?ver=3&ent=1&bl-sender-address=1&hID=…> > this sender enterprise-wide > > > > Block > <https://asp.reflexion.net/FooterAction?ver=3&bl-sender-domain=1&hID=4580794…> > mailman3.org / Block > <https://asp.reflexion.net/FooterAction?ver=3&ent=1&bl-sender-domain=1&hID=4…> > mailman3.org enterprise-wide > > > > /This message was delivered because the content filter score did not > exceed your filter level./ > -- Brian Carpenter Harmonylists.com Emwd.com

1 0

Confirm and Moderate Unsubscribe Requests
by Brian Carpenter Oct. 22, 2020

Oct. 22, 2020

If you set the unsubscription policy to confirm then moderate for a list and someone unsubscribes, they receive a confirmation request. That is good. They respond to it. That is also working fine. However the list owner/moderator than gets a request to approve the unsubscribe request and well, unless I am missing something, I don't see an interface to handles such requests via Postorius. How does one handle an unsubscribe request that requires moderator approval? -- Brian Carpenter Harmonylists.com Emwd.com

3 6

UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 1: ordinal not in range(128)
by r.woithe＠callassoftware.com Oct. 21, 2020

Oct. 21, 2020

Hello, System: Mailman Core Version GNU Mailman 3.2.2 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.8.5 (default, Jul 28 2020, 12:59:40) [GCC 9.3.0] all this runs on Ubuntu 20.04. Our mailman3-web.log file is full of this error.Traceback: 00:00:17 [Q] ERROR reincarnated pusher Process-1:731365 after sudden death 00:00:17 [Q] INFO Process-1:731366 pushing tasks at 3061233 Process Process-1:731366: Traceback (most recent call last): File "/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap self.run() File "/usr/lib/python3.8/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 300, in pusher task = SignedPackage.loads(task[1]) File "/usr/lib/python3/dist-packages/django_q/signing.py", line 28, in loads return signing.loads(obj, File "/usr/lib/python3/dist-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/usr/lib/python3/dist-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 1: ordinal not in range(128) Is there a patch or workaround for this error or we are the one and only?

2 2

debian's 3.2.1 mailman package too unreliable in production - Mail held occasionally causes server errors, and unexplained queue/bad messages -
by Alex Schuilenburg Oct. 21, 2020

Oct. 21, 2020

We have an issue where a mailing list has had a message sent to it from a non-member, so the message has been held, but when the list owner or I attempt to list the held messages for the list we get a Server Error: "An error occurred while processing your request.". I see the mail being held in the mailman log with the non-subscriber reason, and followed the suggestions in https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… which worked to look at and discard that held message. The problem is, there are more and we have over 900 mailing lists FYI, we are running:Mailman Core VersionGNU Mailman 3.2.1 (La Villa Strangiato)Mailman Core API Version3.0Mailman Core Python Version3.7.3 (default, Jul 25 2020, 13:03:44) [GCC 8.3.0] So we are looking at setting up a virtualenv to run the latest mailman3 3.3.1 as the 3.2.1 package from debian is looking unstable - barely usable. For example, while poking around I found 641 messages in queue/bad , but when I inspect them they look fine. If, as mentioned elsewhere, I rename them to .pck, put them in queue/shunt, and "mailman unshunt" the mail finally gets delivered. Why work now? Some kind of transient bug? Is 3.3.1 the way to go? On that last error, I've now enabled debug and hope to catch why messages are being dropped into queue/bad instead of being delivered. Already I have found errors in the mailman log such as: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/out/1603233694.919073+d907eb9512ce11fda515c19d 723537fc4cb15da2.pck'Oct 20 23:41:35 2020 (9793) Skipping and preserving unparseable message: 1603233694.919073+d907eb9512ce11fda515c19d723537fc4cb15da2Oct 20 23:41:35 2020 (9787) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/archive/1603233694.9209244+a0c1f3aab51d3d202aa 37911ab453f094b50b450.pck'Oct 20 23:41:35 2020 (9793) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/out/1603233694.9260252+138142eeb15b16b5da16934 954d1d3aeb1331198.pck'Oct 20 23:41:35 2020 (9793) Traceback (most recent call last): File "/usr/lib/python3/dist- packages/mailman/core/runner.py", line 158, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp:PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/out/1603233694.9260252+138142eeb15b16b5da16934 954d1d3aeb1331198.pck'Oct 20 23:41:35 2020 (9790) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/in/1603233694.9129462+8be9ab12e5dfeab086a1ab8b 3917550aea313505.pck'Oct 20 23:41:35 2020 (9793) Skipping and preserving unparseable message: 1603233694.9260252+138142eeb15b16b5da16934954d1d3aeb1331198Oct 20 23:41:35 2020 (9793) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/out/1603233694.9269004+5f8572edfb07e0e28b9f0b7 928a1184b8c8048ba.pck'Oct 20 23:41:35 2020 (9793) Traceback (most recent call last): File "/usr/lib/python3/dist- packages/mailman/core/runner.py", line 158, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp:PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/out/1603233694.9269004+5f8572edfb07e0e28b9f0b7 928a1184b8c8048ba.pck'Oct 20 23:41:35 2020 (9793) Skipping and preserving unparseable message: 1603233694.9269004+5f8572edfb07e0e28b9f0b7928a1184b8c8048ba The mailman3 user, "list", owns and has full rights all the way down: # ls -ld /var/lib/mailman3/queue/*drwxrwx--- 2 list list 4096 Oct 21 01:45 /var/lib/mailman3/queue/archivedrwxrwx--- 2 list list 77824 Oct 21 00:15 /var/lib/mailman3/queue/baddrwxrwx--- 2 list list 4096 Oct 19 10:44 /var/lib/mailman3/queue/bouncesdrwxrwx--- 2 list list 4096 Oct 5 17:18 /var/lib/mailman3/queue/commanddrwxrwx--- 2 list list 4096 Oct 21 00:00 /var/lib/mailman3/queue/digestdrwxrwx--- 2 list list 4096 Oct 21 00:20 /var/lib/mailman3/queue/indrwxrwx--- 2 list list 4096 Aug 11 18:44 /var/lib/mailman3/queue/nntpdrwxrwx--- 2 list list 4096 Oct 21 01:45 /var/lib/mailman3/queue/outdrwxrwx--- 2 list list 4096 Oct 21 01:45 /var/lib/mailman3/queue/pipelinedrwxrwx--- 2 list list 4096 Aug 11 18:44 /var/lib/mailman3/queue/retrydrwxrwx--- 2 list list 69632 Oct 21 01:45 /var/lib/mailman3/queue/shuntdrwxrwx--- 2 list list 4096 Oct 21 00:20 /var/lib/mailman3/queue/virgin so I'm kinda running out of options why this particular problem is happening. Any pointers? Or just toss the mailman 3.2.1 debian package out and go for a virtualenv 3.3.1 mailman? Thanks -- Alex

2 1

Messages in var/queue/shunt
by Brian Carpenter Oct. 20, 2020

Oct. 20, 2020

I have a large number of messages in the shunt directory due to some testing done. What is the proper method of dealing with them? Is there a way to release them again to the archiver or can I safely delete them? -- Brian Carpenter Harmonylists.com Emwd.com

2 2

Mailman 3 - docker container - sync_members
by holman＠uw.edu Oct. 20, 2020

Oct. 20, 2020

I would like to populate list members via the Mailman 3 sync_members script. However, I am using Mailman 3 in docker containers and it doesn't appear to have this command. How are others completing this synchronization? Searching this list I found a reasonable approach: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… Is there a different/preferred solution?

3 2

mailman import21
by Brian Carpenter Oct. 20, 2020

Oct. 20, 2020

Does the import21 script also import custom templates? Are these custom templates contained in the config.pck file? Are there any known issues with the importing of mm2 templates into a mm3 environment? -- Brian Carpenter Harmonylists.com Emwd.com

2 4

I don't get my posts with Gmail
by blackout69 Oct. 18, 2020

Oct. 18, 2020

Hello everybody, I noticed that if I use a Gmail account to write to a Mailman3 list, the list receives my post and hyperkitty also archives the post, but I don't receive my own post. I have read that it is Gmail's will to automatically discard my post. Is there any way around this insane choice? Thank you in advance Max

5 9

Wrong info in moderation mail when held due to match of a header rule
by Torge Riedel Oct. 18, 2020

Oct. 18, 2020

Hi, today I got the first time a moderation mail for a mail which was held due to a match of a header rule: The message is being held because: Header "Yes" matched a header rule At your convenience, visit your dashboard to approve or deny the request. I think this is wrong, it should read 'Header "x-spam" matched a header rule'. Cause the header rule is configured for header "x-spam" and pattern "Yes". I haven't found a bug report for this yet on gitlab. If someone of the developers confirm this is wrong, I will file a bug on gitlab for it. Kind regards Torge

3 7

Mailman Core 3.3.2rc2 Released
by Abhilash Raj Oct. 17, 2020

Oct. 17, 2020

Hi Everyone, I am pleased to announce that Mailman Core 3.3.2rc2 is now out. This release includes both bug fixes and some new features. Some notable changes include: - Support for inviting users to join mailing lists. - New `adddmembers`, `delmembers` and `syncmembers` command to manage membership from CLI. - Addition of new REST API endpoints that return the count of held messages and subscription requests of much faster page loads in Postorius. - Addition of support for filtering in some API endpoints like Members and Subscription requests. - Support for `address=` option in email join command to subscribe an address other then sending address. - Addition of `who` email command to lookup memberships. - Expose emergency field for MailingList resource in REST API. - Several bug fixes to support new major version of libraries like dnspython, flufl.* etc. Since this is a pre-release, you can install it using: $ pip install --pre --upgrade mailman If there are no new major bugs, 3.3.2 will be released in 2 weeks time. We are now in strings freeze, so if you would like to help with translations to your native language, now is the time. We use Weblate for translations [1] and see here[2] for more documentation about i18n process in Mailman. There are a couple of new templates and more user friendly email templates & subjects for Mailman generated emails that could use translations. [1]: https://hosted.weblate.org/projects/gnu-mailman/mailman/ [2]: https://docs.mailman3.org/en/latest/translation.html -- thanks, Abhilash Raj (maxking)

1 0

Adding members to a mailman3 mailing list
by Onyeibo Oku Oct. 17, 2020

Oct. 17, 2020

Greetings I am testing mailman3 on Fedora Linux (32 and Rawhide). I installed it from the distribution's repositories and I am following the documentation at https://docs.mailman3.org/ I have created a mailing list on my instance but for I am unable to add members to it. Please, consider the following session: COMMAND: sudo -u mailman mailman3 lists OUTPUT: 1 matching mailing lists found: list(a)example.com COMMAND: sudo -u mailman mailman3 members --add members.txt list(a)example.com OUTPUT: usage: mailman members [OPTIONS] LISTSPEC Try 'mailman members -h' for help. Error: Invalid value for '--add' / '-a': Could not open file: members.txt: Permission denied When I try to use '-' instead of passing a file, I find no intuitive way to exit the standard input. What kind of permission is mailman expecting on the input file? I have tried changing ownership to the mailman user -- same output still. How does one use standard input to add members conclusively? Much regards Onyeibo

3 9

Postorius password resets
by Andrew Hodgson Oct. 16, 2020

Oct. 16, 2020

Hi, I am having an issue with our system where password resets are giving the users an email with a http://localhost:8000 URL. I have made sure settings in settings_local.py (and even settings.py) are as follows: POSTORIUS_TEMPLATE_BASE_URL = 'https://lists.hodgsonfamily.org' However emails are still coming through with the wrong URL. What have I missed? Thanks. Andrew.

2 4

Is there a way accept/discard held messages through mailman shell
by Shashikanth Komandoor Oct. 15, 2020

Oct. 15, 2020

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 with PostgreSQL 11.7 version with default values in production environment from the past 4 months almost. As of now, we are having around 1327 lists created on this. I learnt how to approve/discard/reject the held messages through the web interface and also through the CURL command line. But I wanted to know is there any other way to approve/discard/reject the held messages through "mailman shell" or any other channel ? -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

mailman3-web MailingList matching query does not exist.
by Loïc Dachary Oct. 12, 2020

Oct. 12, 2020

Hi, The logs of mailman3-web are flooded with the following error. I suspect this is because I removed some mailing lists (using the hyperkitty web interface and the delete button) and the cache still references them. Is there a job supposed to fix this at some point ? Thanks in advance for any tip you can share :-) ii python3-django-hyperkitty 1.3.2-1.1 all Web user interface to access GNU Mailman3 archives ii python3-mailman-hyperkitty 1.1.0-9 all Mailman3 plugin to archive emails with HyperKitty ii mailman3 3.2.1-1 all Mailing list management system ii mailman3-web 0+20180916-10 all Django project integrating Mailman3 Postorius and HyperKitty ii python3-django-mailman3 1.2.0-3 all Django library to help interaction with Mailman3 (Python 3 version) ii python3-mailman-hyperkitty 1.1.0-9 all Mailman3 plugin to archive emails with HyperKitty ii python3-mailmanclient 3.2.2-1 all Python bindings for Mailman3 REST API (Python 3 version) Cheers 15:53:45 [Q] INFO Process-1:8 processing [rebuild_mailinglist_cache_for_month] 15:53:45 [Q] ERROR Failed [rebuild_mailinglist_cache_for_month] - MailingList matching query does not exist. : Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/usr/lib/python3/dist-packages/hyperkitty/tasks.py", line 79, in _rebuild_mailinglist_cache_for_month mlist = MailingList.objects.get(name=mlist_name) File "/usr/lib/python3/dist-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 380, in get self.model._meta.object_name hyperkitty.models.mailinglist.DoesNotExist: MailingList matching query does not exist. -- Loïc Dachary, Artisan Logiciel Libre

2 1

Subscription Acceptance
by Brian Carpenter Oct. 11, 2020

Oct. 11, 2020

Hello MM3 Users, Is the MM2 function: "List of addresses (or regexps) whose subscriptions do not require approval." going to end up in Mailman 3 or is there no plans to include it? -- Brian Carpenter Harmonylists.com Emwd.com

2 1

Moving from forum to Mailman 3
by Jonathan M Oct. 10, 2020

Oct. 10, 2020

What ways are there to move a forum to an existing Mailman 3 list, so that each old forum message is displayed in the archive as if it had been an email? Thank you Jonathan Sent from my iPhone

4 4

persistent style
by Peter Münster Oct. 7, 2020

Oct. 7, 2020

Hi, How could I save a new style please? I've followed the instructions in https://mailman.readthedocs.io/en/latest/src/mailman/styles/docs/styles.html and after the "manager.register(...)" I typed "commit()". But later, after exiting the mailman shell, the style is not saved... Another question: Where could I find the list of all options, that can be used in a style please? I've found some of them in mailman/styles/default.py (BasicOperation, Bounces, Public, Private, Moderation, etc.), but I'll need some more. TIA for any help, -- Peter

1 0

File "/usr/lib/python2.7/httplib.py", line 1148, in getresponse raise ResponseNotReady()
by r.woithe＠callassoftware.com Oct. 7, 2020

Oct. 7, 2020

Hello, every night at 00:00 i get an email by mailman3: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/django_extensions/management/commands/runjobs.py", line 34, in runjobs job().execute() File "/usr/lib/python2.7/dist-packages/hyperkitty/jobs/sync_mailman.py", line 37, in execute sync_with_mailman() File "/usr/lib/python2.7/dist-packages/hyperkitty/lib/mailman.py", line 147, in sync_with_mailman sender.set_mailman_id() File "/usr/lib/python2.7/dist-packages/hyperkitty/models/sender.py", line 57, in set_mailman_id mm_user = client.get_user(self.address) File "/usr/lib/python2.7/dist-packages/mailmanclient/client.py", line 192, in get_user 'users/{0}'.format(address)) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/connection.py", line 99, in call response, content = Http().request(url, method, data_str, headers) File "/usr/lib/python2.7/dist-packages/httplib2/__init__.py", line 1616, in request (response, content) = self._request(conn, authority, uri, request_uri, method, body, headers, redirections, cachekey) File "/usr/lib/python2.7/dist-packages/httplib2/__init__.py", line 1358, in _request (response, content) = self._conn_request(conn, request_uri, method, body, headers) File "/usr/lib/python2.7/dist-packages/httplib2/__init__.py", line 1314, in _conn_request response = conn.getresponse() File "/usr/lib/python2.7/httplib.py", line 1148, in getresponse raise ResponseNotReady() ResponseNotReady ERROR OCCURED IN DAILY JOB: sync_mailman (APP: hyperkitty) START TRACEBACK: END TRACEBACK Mailman3 runs on Ubuntu 18.04 and is installed via the apt-get repository packages. Mailman3 is working and created lists are functional. Therefor i would like to know can i neglect this message ? Or is this message a hint for an Error i should investigate and looking for a solution ?

6 29

How to prevent members to attach executables (exe, bat, ...) to the emails sent to list
by Mohsen Masoudfar Oct. 7, 2020

Oct. 7, 2020

Hi, I am trying to find a way for content filtering to remove executables from the emails sent to the list. I found some hints under: https://mailman.readthedocs.io/en/stable/build/lib/mailman/handlers/docs/fi… but still not clear how to do it for all type of excecutables. Best regards Mohsen

3 6

Re: Removing an archive from hyperkitty
by Loïc Dachary Oct. 5, 2020

Oct. 5, 2020

Hi, It turns out to be a feature added in 1.3.1 [0]. I wonder if the MySQL instructions listed in this comment[1] are safe to use? I'm reluctant to upgrade because the machine is for production and using packages from Debian GNU/Linux buster is recommended. Cheers [0] https://gitlab.com/mailman/hyperkitty/-/issues/146 [1] https://gitlab.com/mailman/hyperkitty/-/issues/146#note_423111350 On 04/10/2020 18:16, Loïc Dachary wrote: > Hi, > > I accidentally created an archive for a non existent mailing list with a command like: > > python3 manage.py hyperkitty_import --list-address test2(a)the.re --ignore-mtime --no-sync-mailman /tmp/f.mbox > > where test2(a)the.re does not exist. It succeeded and now the web interface shows this archive that has no associated mailing list. How can I remove it ? > > Thanks in advance for any tip you may have ;-) > -- Loïc Dachary, Artisan Logiciel Libre

4 3

Hyperkitty fulltext search performances
by Loïc Dachary Oct. 4, 2020

Oct. 4, 2020

Hi, I'm in the process of importing a large number of mbox (~30,000) for a few hundred mailing lists. So far around 300,000 mails (~12GB) were imported from two mailing lists. The hyperkitty_import process took ~8 hours and created a 10GB MySQL database. The update_index_one_list for the two lists took a total of ~72 hours and created a ~2GB worth of index in /var/lib/mailman3/web/fulltext_index, which is consistent with the fact that there are lot of attachments (probably 10GB out of 12GB). When I search for one word via the full text search web interface, it takes around 30 seconds to complete (even when repeated twice) and I can see the process grow to use up to 6GB of resident memory. It is running on a recent physical machine with decent IO and a Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz. Is this consistent with other people experience? Cheers -- Loïc Dachary, Artisan Logiciel Libre

4 4

Mailman3 not delivering list mail
by Gordon Dickens Oct. 2, 2020

Oct. 2, 2020

Hello, I have a fresh mailman3 installation that I recently upgraded from mailman2 on a debian system.Â In any event, I imported some test lists and tested my installation thoroughly and everything seemed to be working fine.Â Then, today, I imported a important live working mailing list from mailman2 and everything appeared to go well both with the import of the list addresses and the archives.Â However, when I sent out the first post on Mailman3 the post was not echoed to the list members.Â Then, I subsequently discovered that the queue had lots of mail undelivered in /var/lib/mailman3/queue/bad. It appears that my mailman3 installation has stopped delivering list mail and that all of the list mail is stuck in /var/lib/mailman3/queue/bad. How do I resolve this situation?Â Can I just remove the files with "rm *" in the /var/lib/mailman3/queue/bad directory?Â Please let me know what I should do to get things working again. Thanks, Gordon

3 7

Various patches for mm3 stable 3.3.1
by Ruth Ivimey-Cook Sept. 30, 2020

Sept. 30, 2020

Folks, For my own purposes I have created some patches which apply to the current mailman pip package. The first of them is for my purposes necessary, and has been discussed here before: being able to specify the address used to listen for tcp connections independently of the address the server considers it to be accessible at. A possible change to this patch would be to check whether this address was undefined but the old hostname was defined, and use that if so. For me this is not needed, and in any case it is a trivial change to make. The second patch adds a bunch of additional logging calls to various network-related parts of the package. I wrote these into the package because I was seeking the cause of template expansion causing messages to be silently dropped. I eventually found the cause was that I had an incorrect setting of the template root URL, but I regard the lack of anything in the logs as just as much of a bug. One important part of those changes was that I added a try/catch around two parts of the 'decorate' code, which is where the silent dropping occurred. If you only take one part of this patch, I encourage you to take this part. For the third patch, I discovered that the task runner was at one point busy-waiting to the tune of 100% cpu, and the cause was the way that the runner checked to see if there was work left in the queue. I am not quite sure what was the exact problem, but I think it was that there was something to do, but it was not achievable at that time, and the result was continual retry. The third patch changes the logic slightly so that this no longer occurs - retry will happen, but somewhat more gracefully. I hope you find some use in these three. Finally, I am currently experiencing problems with templates and would appreciate any thoughts: 1. If I do not set up 'individual' or 'full' personalisation, all is well and the default footer templates are expanded as expected. However setting up personalisation causes template expansion to fail completely, and messages get sent with a blank expansion. 2. I would find the postorius UI much easier to cope with if the default template was 'populated' into the UI wherever it was non-blank, rather than the UI starting off as if no templates were defined at all. Regards, Ruth

3 3

Unable to remove non-member
by Brian Carpenter Sept. 29, 2020

Sept. 29, 2020

Hi Everyone, I ran across a strange issue today. A client reported the inability to remove a non-member in the following format: z_email/domain.org.za(a)domain.org.za The reported error from Postorius was: "The user could not be removed" I used https://verifalia.com/validate-email to validate the email address and it is syntactically correct. -- Brian Carpenter Harmonylists.com Emwd.com

2 4

Discard all mail with the subject "The resutls of your email commands"
by w.schoener＠alp.dillingen.de Sept. 29, 2020

Sept. 29, 2020

Hello, I am using mailman 3.2.1 for several mailing lists. My colleagues want me to stop all mails with the subject "The results of your email commands". I found some contributions here, but nowhere a solution for this question. Does anybody has any suggestion? Maybe I could try to handle this outside of mailman, but then I would have to pass this task on to someone I dont know .... :-( Thanks for all hints. :-) Wolfgang

3 5

New releases
by Abhilash Raj Sept. 25, 2020

Sept. 25, 2020

Hi Everyone, I am pleased to announce new stable releases for: - Postorius: 1.3.3 Changelog: https://docs.mailman3.org/projects/postorius/en/latest/news.html#id1 Download: https://pypi.org/project/postorius/1.3.3/ - Hyperkitty: 1.3.3 Changelog: https://hyperkitty.readthedocs.io/en/latest/news.html#id1 Download: https://pypi.org/project/HyperKitty/1.3.3rc1/ - Mailmanclient: 3.3.1 Changelog: https://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclien… Download: https://pypi.org/project/mailmanclient/3.3.1/ - Django-mailman3: 1.3.3 Changelog: https://gitlab.com/mailman/django-mailman3/-/blob/master/README.rst Download: https://pypi.org/project/django-mailman3/1.3.3 Python 3.6+ and Django 2.0+ is supported for all of them. Django 3.0 support for Hyperkitty requires manually upgrading a dependency (django-haystack>=3.0b2, once a stable version of this has been released, it shouldn't require manually upgrading). There are tons of bug-fixes across the board and some new features. Biggest visible change is switch to Bootstrap 4, which has been long pending for us. Bootstrap 4 completely changes the CSS grid model using the new Flexbox. There might be some small changes or breakages when using on mobile. Please report such issues to us via Gitlab! Some other notable changes are in Postorius, which includes many more list settings exposed include content filtering settings, bounce processing (which was added in the previous release of Mailman Core) settings and some other ones. Settings page is also slightly different with all the sections on the vertical menu on left instead of horizontal tabs. You can now also specify a reason when rejecting held messages. There was also a gnarly bug, which caused the name of some members to be the string "None". For the longest time, I couldn't figure out the reason for it, but it ended up being a simple fix in mailmanclient's json serialization of display_name, which would result in Python's None value being passed as string "None" to Mailman's API for subscription. There is also better support for filtering visible lists based on the current vhost, which I see a few people are already waiting for from mailman-users list. A full changelog has been added to each project in the top. -- thanks, Abhilash Raj (maxking)

5 23

My Server is unable to connect to Mailman REST API few times
by Shashikanth Komandoor Sept. 24, 2020

Sept. 24, 2020

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 with PostgreSQL 11.7 version with default values in production environment from the past 4 months almost. As of now, we are having around 1327 lists created on this. When I am trying to do some operations like creating the lists, deleting the lists or accessing the lists through the GUI, I am getting the below error. If I am trying to do the operations through API or through mailman shell, still I am not able to connect to the API. Something went wrong Mailman REST API not available. Please start Mailman core. But my mailman core was working fine in the background. At the same time I was able to do other operations on a few other lists. By the time I am getting the above error, the mailman.log recorded the below messages. *[2020-09-16 12:49:08 +0530] [2600] [CRITICAL] WORKER TIMEOUT (pid:20234)* *[2020-09-16 12:49:08 +0530] [20234] [INFO] Worker exiting (pid: 20234)* *[2020-09-16 12:49:09 +0530] [21042] [INFO] Booting worker with pid: 21042* My mailman.cfg configuration is as below. The timeout value is the default value. I did not set any customized value. *(venv3) [root@lsmgr mailman]# grep -v ^# /var/lib/mailman/mailman/var/etc/mailman.cfg* *[archiver.hyperkitty]* *class: mailman_hyperkitty.Archiver* *enable: yes* *configuration: /var/lib/mailman/mailman-hyperkitty/mailman-hyperkitty.cfg* *[mta]* *incoming: mailman.mta.postfix.LMTP* *outgoing: mailman.mta.deliver.deliver* *lmtp_host: 0.0.0.0* *lmtp_port: 8024* *smtp_host: localhost* *smtp_port: 25* *[webservice]* *workers: 10* *[database]* *class: mailman.database.postgresql.PostgreSQLDatabase* *url: postgres://<postgresdbuser>:<postgresdbpassword>@127.0.0.1/mailman <http://127.0.0.1/mailman>* Then as per the suggestion I got earlier I configured the [webservice] section in the above file as below. *[webservice]* *configuration: /var/lib/mailman/mailman/var/etc/gunicorn.cfg* * [root@lsmgr logs]# cat /var/lib/mailman/mailman/var/etc/gunicorn.cfg* *[gunicorn]* *workers = 10* *timeout = 90 * After the above configuration, I found many errors like below in mailman.log file: *sqlalchemy.exc.NoSuchColumnError: "Could not locate column in row for column 'pended.id <http://pended.id>'"* *sqlalchemy.exc.ResourceClosedError: This result object does not return rows. It has been closed automatically.* *sqlalchemy.exc.DatabaseError: (psycopg2.DatabaseError) error with status PGRES_TUPLES_OK and no message from the libpq* The above might be few of the errors. FYI, for the creation of each list, it is taking almost around 15 to 20 minutes. After multiple times of the above error messages, at some time, I am fortunately getting the list created or some other operation getting done. I found the same scenario when the workers are from default 2 to 10. I don't understand where exactly I need to focus to solve the issue. Please let me know if I have to share any other details for you to suggest to me. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 9

including a template failed
by Wolfgang Bock Sept. 24, 2020

Sept. 24, 2020

Hi, I created a new mailinglist and got during the test-process the following errormessage in my mailman.log after: ... Sep 19 22:55:08 2020 (1433) ACCEPT: <000001d68ec7$2553e6e0$6ffbb4a0$(a)domain-01.de> Errors: Sep 19 22:55:09 2020 (1436) Cannot connect to SMTP server localhost on port 25 HTTPSConnectionPool(host='webmail.domain-02.de', port=443): Max retries exceeded with url: /mailman3/postorius/api/templates/list/mylist.lists.domain-03.de/list:member :regular:footer (Caused by NewConnectionError('<urllib3.connec tion.VerifiedHTTPSConnection object at 0x7fc8380f1748>: Failed to establish a new connection: [Errno -2] Name or service not known')) ... domain02.de isn't involved in mailman3 either as a user domain nor as a list-domain. After deleting the template mailman3/postorius/api/templates/list/mylist.lists.domain-03.de/list:member: regular:footer the mail to the list is processed without problems: Sep 19 22:56:22 2020 (1436) <000001d68ec7$2553e6e0$6ffbb4a0$(a)domain-01.de> smtp to mylist(a)list.domain-03.de for 1 recips, completed in 0.21389174461364746 seconds Sep 19 22:56:22 2020 (1436) <000001d68ec7$2553e6e0$6ffbb4a0$(a)wbock.de> post to mylist(a)list.domain-03.de from user(a)domain-01.de, 1331 bytes Please help to solve this problem? Thanks and regards Wolfgang

2 3

Missing whitespace in postfix_vmap after mailman genaliases
by Wolfgang Bock Sept. 23, 2020

Sept. 23, 2020

Hi, after creating a new list I got the following errormessage: mailman aliases -> postmap: warning: /var/lib/mailman3/data/postfix_vmap, line 17: expected format: key whitespace value /var/lib/mailman3/data/postfix_vmap # AUTOMATICALLY GENERATED BY MAILMAN ON 2020-09-19 07:44:34 .... xxxxxxxxxxx(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-bounces(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-bounces(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-confirm(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-confirm(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-join(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-join(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-leave(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-leave(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-owner(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-owner(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-request(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-request(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-subscribe(a)lists.xxxxxxxxxxxxxxxx.de xxxxxxxxxxx-subscribe(a)xxxxxxxxxxxxx.de xxxxxxxxxxx-unsubscribe@lists.xxxxxxxxxxxxxxxx.dexxxxxxxxxxx-unsubscribe@xxx xxxxxxxxxx.de The last line in the left part contains 48 chars. I solved the problem by adding a whitespace in the last line and I made a new postmap for postfix_vmap. But it would be better to solve the problem by changing the genaliases process in the next update. Regards Wolfgang

2 3

Re: cc'd e-mail addresses rewritten with @invalid.domain
by Williams, Peter B Sept. 23, 2020

Sept. 23, 2020

Hi Mark, Thanks for the help with this! Other list members will also see the e-mail as coming from user(a)invalid.domain<mailto:user@invalid.domain>. I will continue testing the other scenarios and will reply back as soon as possible. Thanks again for the help with this and have a nice day! Peter On Mon, Sep 21, 2020 at 9:00 PM Mark Sapiro <mark(a)msapiro.net> wrote: On 9/21/20 10:49 AM, peterbw(a)gmail.com<mailto:peterbw@gmail.com> wrote: > Hi, > > We've recently noticed an issue where users who are cc'd in a message where a mailing list is also within the cc list are getting rewritten a user(a)invalid.domain. > > This issue looks like it may be related to Outlook and how user names are displayed specifically. Here is an example: > > To: test_user(a)gmail.com<mailto:test_user@gmail.com> > cc: listserv(a)lists.test.org<mailto:listserv@lists.test.org>; Williams, Peter; > > "Williams, Peter" maps to a user e-mail in the Outlook Global Address book. When the message is sent the list will send the message with the first name and last name separated, for example the message will appear: > > to: test_user(a)gmail.com<mailto:test_user@gmail.com> > cc: listserv(a)lists.test.org<mailto:listserv@lists.test.org>, Williams(a)invalid.domain, Peter(a)invalid.domain Because apparently Outlook is sending the message with the literal > Cc: listserv(a)lists.test.org<mailto:listserv@lists.test.org>; Williams, Peter; instead of something like > Cc: listserv(a)lists.test.org<mailto:listserv@lists.test.org>, "Williams, Peter" <peters_real_address(a)example.com<mailto:peters_real_address@example.com>> Then some MTA in the chain is seeing the unqualified addresses Williams and Peter and appending its own local domain. > This only seems to happen with users who are cc'd who are also members of the list that is being cc'd. For example in the scenario above my e-mail that is cc'd is also a member of listserv(a)lists.test.org<mailto:listserv@lists.test.org>. In this case, where do you see this? i.e., do other list members see it in the message they receive from the list? I don't know why that would be. I'm certain that Mailman is not involved in this and the Williams(a)invalid.domain and Peter(a)invalid.domain addresses are in the Cc: as received by Mailman. > This issue does not occur if the user e-mail address is listed before the mailing list in the cc field. So for example, if the cc in the scenario above contained Williams, Peter; listserv(a)lists.test.org<mailto:listserv@lists.test.org>; it would route properly. Again, I think this is Outlook. What's in the Cc: of the mail that test_user(a)gmail.com<mailto:test_user@gmail.com> receives directly? What happens if you send mail in this way with To: test_user(a)gmail.com<mailto:test_user@gmail.com> cc: other_user(a)gmail.com<mailto:other_user@gmail.com>; Williams, Peter; Again, what's in the Cc: of the mail that test_user(a)gmail.com<mailto:test_user@gmail.com> and other_user(a)gmail.com<mailto:other_user@gmail.com> receive? Also, please see <https://wiki.list.org/DOC/Mailman%20is%20not%20Listserv>. -- Mark Sapiro <mark(a)msapiro.net<mailto:mark@msapiro.net>> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org<mailto:mailman-users@mailman3.org> To unsubscribe send an email to mailman-users-leave(a)mailman3.org<mailto:mailman-users-leave@mailman3.org> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

3 4

Mails are not archived at all -- how to check if Hyperkitty is running or not?
by Franklin Weng Sept. 23, 2020

Sept. 23, 2020

Hi, I set up the mailman3 services and lists, and we can send mail to the list successfully. However in the Archive section I couldn't see anything and all the lists were "inactive" and hence were hidden by default. I confirmed that api_key set in the /etc/mailman3/mailman-hyperkitty.cfg and /etc/mailman3/mailman-web.py is the same. I also confirmed that the apache2 wsgi module has been loaded. In the mailman.cfg database is set to mysql and in the mailman-web.py database is set to sqlite3. Does it matter? I tried to search but couldn't find any further information or discussion about this. There is no systemd service for Hyperkitty. How can I check if Hyperkitty is running or not? Thanks, Franklin

6 18

API timeout for one list
by Seth Seeger Sept. 23, 2020

Sept. 23, 2020

I apologize, because I think this was talked about before, but I could not find it in the archives. For one list, the REST API times out. Doesn’t seem to matter which page I try to go to. The uwsgi-error.log entry: --- Logging error --- Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 96, in inner return func(*args, **kwargs) psycopg2.ProgrammingError: no results to fetch The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 332, in pusher task_set = broker.dequeue() File "/usr/lib/python3.8/site-packages/django_q/brokers/orm.py", line 67, in dequeue if tasks: File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 278, in __bool__ self._fetch_all() File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 1242, in _fetch_all self._result_cache = list(self._iterable_class(self)) File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 55, in __iter__ results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size) File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1175, in execute_sql return list(result) File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1554, in cursor_iter for rows in iter((lambda: cursor.fetchmany(itersize)), sentinel): File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1554, in <lambda> for rows in iter((lambda: cursor.fetchmany(itersize)), sentinel): File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 96, in inner return func(*args, **kwargs) File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 96, in inner return func(*args, **kwargs) django.db.utils.ProgrammingError: no results to fetch During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/logging/__init__.py", line 1081, in emit msg = self.format(record) File "/usr/lib/python3.8/logging/__init__.py", line 925, in format return fmt.format(record) File "/usr/lib/python3.8/logging/__init__.py", line 664, in format record.message = record.getMessage() File "/usr/lib/python3.8/logging/__init__.py", line 369, in getMessage msg = msg % self.args TypeError: not all arguments converted during string formatting Call stack: File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/lib/python3.8/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/usr/lib/python3.8/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/lib/python3.8/site-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/usr/lib/python3.8/site-packages/django/core/management/base.py", line 364, in execute output = self.handle(*args, **options) File "/usr/lib/python3.8/site-packages/django_q/management/commands/qcluster.py", line 22, in handle q.start() File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 67, in start self.sentinel.start() File "/usr/lib/python3.8/multiprocessing/process.py", line 121, in start self._popen = self._Popen(self) File "/usr/lib/python3.8/multiprocessing/context.py", line 224, in _Popen return _default_context.get_context().Process._Popen(process_obj) File "/usr/lib/python3.8/multiprocessing/context.py", line 277, in _Popen return Popen(process_obj) File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__ self._launch(process_obj) File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 75, in _launch code = process_obj._bootstrap(parent_sentinel=child_r) File "/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap self.run() File "/usr/lib/python3.8/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 157, in __init__ self.start() File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 162, in start self.guard() File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 268, in guard self.reincarnate(self.pusher) File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 210, in reincarnate self.pusher = self.spawn_pusher() File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 190, in spawn_pusher return self.spawn_process(pusher, self.task_queue, self.event_out, self.broker) File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 186, in spawn_process p.start() File "/usr/lib/python3.8/multiprocessing/process.py", line 121, in start self._popen = self._Popen(self) File "/usr/lib/python3.8/multiprocessing/context.py", line 224, in _Popen return _default_context.get_context().Process._Popen(process_obj) File "/usr/lib/python3.8/multiprocessing/context.py", line 277, in _Popen return Popen(process_obj) File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 19, in __init__ self._launch(process_obj) File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 75, in _launch code = process_obj._bootstrap(parent_sentinel=child_r) File "/usr/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap self.run() File "/usr/lib/python3.8/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 334, in pusher logger.error(e, traceback.format_exc()) Message: ProgrammingError('no results to fetch') Arguments: ('Traceback (most recent call last):\n File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 96, in inner\n return func(*args, **kwargs)\npsycopg2.ProgrammingError: no results to fetch\n \nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n File "/usr/lib/python3.8/site-packages/django_q/cluster.py", line 332, in pusher\n task_set = bro ker.dequeue()\n File "/usr/lib/python3.8/site-packages/django_q/brokers/orm.py", line 67, in dequeue\n if tasks:\n File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 278, in __bool__\n self._fetch_all()\n File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 1242, in _fetch_all\n self._result_cache = list(self._iterable_class(self))\n File "/usr/lib/python3.8/site-packa ges/django/db/models/query.py", line 55, in __iter__\n results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n File "/usr/lib/python3.8/site-packages/django/db/models/sq l/compiler.py", line 1175, in execute_sql\n return list(result)\n File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1554, in cursor_iter\n for rows in iter((lambda: cursor.fetc hmany(itersize)), sentinel):\n File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1554, in <lambda>\n for rows in iter((lambda: cursor.fetchmany(itersize)), sentinel):\n File "/us r/lib/python3.8/site-packages/django/db/utils.py", line 96, in inner\n return func(*args, **kwargs)\n File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 89, in __exit__\n raise dj_exc_value.w ith_traceback(traceback) from exc_value\n File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 96, in inner\n return func(*args, **kwargs)\ndjango.db.utils.ProgrammingError: no results to fetch\n' ,) The other lists work fine. Thank you, Seth

3 4

The message is larger than the 40 KB maximum size
by Mohsen Masoudfar Sept. 22, 2020

Sept. 22, 2020

Hi, I am trying to find how I may change this. I have an attachment of 800 KB, and when I post it to the list, I do not get any response and nothing is hold. It looks like the message is just dropped. Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

3 9

Problem with list creation
by Pawel Grzywaczewski Sept. 22, 2020

Sept. 22, 2020

Hi, We want to create thousand of lists. We use a simple curl command curl --user restadmin:restpass -X POST http://localhost:8001/3.1/lists -d fqdn_listname=nameOfTheList(a)example.com After creating ~2k of them we started getting errors in Mailman logs: ``` [2020-09-16 17:11:10 +0200] [4564] [DEBUG] POST /3.1/lists [2020-09-16 17:11:41 +0200] [1339] [CRITICAL] WORKER TIMEOUT (pid:4564) [2020-09-16 17:11:41 +0200] [4564] [INFO] Worker exiting (pid: 4564) [2020-09-16 17:11:41 +0200] [5019] [INFO] Booting worker with pid: 5019 ``` Since then creation fails in most cases. We increased timeout in mailman.cfg ``` [gunicorn] workers: 4 timeout: 900 ``` And we increased timeout in nginx ``` http { # MODIF UNICORN proxy_connect_timeout 300s; proxy_read_timeout 300s; # MODIF UNICORN ``` Where might be the problem? How to start investigating and fix it? Thanks, Paweł

4 7

cc'd e-mail addresses rewritten with @invalid.domain
by peterbw＠gmail.com Sept. 22, 2020

Sept. 22, 2020

Hi, We've recently noticed an issue where users who are cc'd in a message where a mailing list is also within the cc list are getting rewritten a user(a)invalid.domain. This issue looks like it may be related to Outlook and how user names are displayed specifically. Here is an example: To: test_user(a)gmail.com cc: listserv(a)lists.test.org; Williams, Peter; "Williams, Peter" maps to a user e-mail in the Outlook Global Address book. When the message is sent the list will send the message with the first name and last name separated, for example the message will appear: to: test_user(a)gmail.com cc: listserv(a)lists.test.org, Williams(a)invalid.domain, Peter(a)invalid.domain This only seems to happen with users who are cc'd who are also members of the list that is being cc'd. For example in the scenario above my e-mail that is cc'd is also a member of listserv(a)lists.test.org. This issue does not occur if the user e-mail address is listed before the mailing list in the cc field. So for example, if the cc in the scenario above contained Williams, Peter; listserv(a)lists.test.org; it would route properly. Do you know what may be causing this? Please let me know if there is any additional information I may provide regarding this and I will try to respond as soon as possible. Thanks and have a nice day! Peter

2 1

Template path
by Seth Seeger Sept. 21, 2020

Sept. 21, 2020

Hello everyone, I’m running Mailman from Docker containers, without much customization. (Postorius 1.3.3, Core 3.3.1, API 3.1, Python 3.8.5). I’ve created a list:user:notice:welcome template, and when I try to confirm a subscription, I get an error. I followed previous emails on this list which told me to set POSTORIUS_TEMPLATE_BASE_URL in /opt/mailman/web/settings_local.py, but that doesn’t seem to make any difference. (I set it to a different value and the error message didn’t change. I also tried setting it in /opt/mailman/core/settings_local.py to no effect. After each change, I restarted mailman-web and mailman-core containers.) From within mailman-web and mailman-core containers, I can reach “mailman-web:8000”. In the webpage, I see: Mailman REST API not available. Please start Mailman core. In /opt/mailman/core/var/logs/mailman.log, I get: [17/Sep/2020:16:23:29 +0000] "GET /3.1/lists/xxx.example.com HTTP/1.1" 200 416 "-" "GNU Mailman REST client v3.3.1" Sep 17 16:23:35 2020 (48) deque: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 426, in _make_request six.raise_from(e, None) File "<string>", line 3, in raise_from File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 421, in _make_request httplib_response = conn.getresponse() File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse response.begin() File "/usr/lib/python3.8/http/client.py", line 307, in begin version, status, reason = self._read_status() File "/usr/lib/python3.8/http/client.py", line 268, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.8/socket.py", line 669, in readinto return self._sock.recv_into(b) socket.timeout: timed out During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 439, in send resp = conn.urlopen( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 724, in urlopen retries = retries.increment( File "/usr/lib/python3.8/site-packages/urllib3/util/retry.py", line 403, in increment raise six.reraise(type(error), error, _stacktrace) File "/usr/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise raise value File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 428, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 335, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 332, in _step_do_subscription self.member = self.mlist.subscribe( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/mailinglist.py", line 505, in subscribe notify(SubscriptionEvent( File "/usr/lib/python3.8/site-packages/zope/event/__init__.py", line 32, in notify subscriber(event) File "/usr/lib/python3.8/site-packages/mailman/app/membership.py", line 176, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/usr/lib/python3.8/site-packages/mailman/app/notifications.py", line 51, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 188, in get contents = getUtility(ITemplateManager).get( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 110, in get contents = protocols.get(actual_uri, **auth) File "/usr/lib/python3.8/site-packages/mailman/utilities/protocols.py", line 38, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) File "/usr/lib/python3.8/site-packages/requests/api.py", line 76, in get return request('get', url, params=params, **kwargs) File "/usr/lib/python3.8/site-packages/requests/api.py", line 61, in request return session.request(method=method, url=url, **kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 530, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 643, in send r = adapter.send(request, **kwargs) File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 529, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) [2020-09-17 16:23:35 +0000] [48] [ERROR] Socket error processing request. Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 426, in _make_request six.raise_from(e, None) File "<string>", line 3, in raise_from File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 421, in _make_request httplib_response = conn.getresponse() File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse response.begin() File "/usr/lib/python3.8/http/client.py", line 307, in begin version, status, reason = self._read_status() File "/usr/lib/python3.8/http/client.py", line 268, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.8/socket.py", line 669, in readinto return self._sock.recv_into(b) socket.timeout: timed out Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 439, in send resp = conn.urlopen( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 724, in urlopen retries = retries.increment( File "/usr/lib/python3.8/site-packages/urllib3/util/retry.py", line 403, in increment raise six.reraise(type(error), error, _stacktrace) File "/usr/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise raise value File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 428, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 335, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/gunicorn/workers/sync.py", line 135, in handle self.handle_request(listener, req, client, addr) File "/usr/lib/python3.8/site-packages/gunicorn/workers/sync.py", line 191, in handle_request six.reraise(*sys.exc_info()) File "/usr/lib/python3.8/site-packages/gunicorn/six.py", line 625, in reraise raise value File "/usr/lib/python3.8/site-packages/gunicorn/workers/sync.py", line 176, in handle_request respiter = self.wsgi(environ, resp.start_response) File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/lib/python3.8/site-packages/mailman/rest/wsgiapp.py", line 193, in __call__ return super().__call__(environ, start_response) File "/usr/lib/python3.8/site-packages/falcon/api.py", line 269, in __call__ responder(req, resp, **params) File "/usr/lib/python3.8/site-packages/mailman/rest/sub_moderation.py", line 88, in on_post self._registrar.confirm(self._token) File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 559, in confirm list(workflow) File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 332, in _step_do_subscription self.member = self.mlist.subscribe( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/mailinglist.py", line 505, in subscribe notify(SubscriptionEvent( File "/usr/lib/python3.8/site-packages/zope/event/__init__.py", line 32, in notify subscriber(event) File "/usr/lib/python3.8/site-packages/mailman/app/membership.py", line 176, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/usr/lib/python3.8/site-packages/mailman/app/notifications.py", line 51, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 188, in get contents = getUtility(ITemplateManager).get( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 110, in get contents = protocols.get(actual_uri, **auth) File "/usr/lib/python3.8/site-packages/mailman/utilities/protocols.py", line 38, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) File "/usr/lib/python3.8/site-packages/requests/api.py", line 76, in get return request('get', url, params=params, **kwargs) File "/usr/lib/python3.8/site-packages/requests/api.py", line 61, in request return session.request(method=method, url=url, **kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 530, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 643, in send r = adapter.send(request, **kwargs) File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 529, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) What’s the next step to get templates working? Thank you, Seth

3 8

Redundant and load balanced Mailman3
by Pawel Grzywaczewski Sept. 20, 2020

Sept. 20, 2020

Hi, Can someone share some hints about how to deploy redundant and load balanced Mailman3? What are your recommendations and best practices? For example what components to put on the same VM? Can we have 2VM with Mailman core/Postorious/Hyperkitty/django-mailman/mailmanclient connecting to one (the same) database? How to load balance mail routing (incoming)? Thanks! Paweł

3 3

Bad Signature with Gmail
by Massimo Zappalà Sept. 19, 2020

Sept. 19, 2020

Hi everyone, if I write a my lists from other email address I get the correct message: opendkim[23516]: 8EEE440FFD: DKIM-Signature field added (s=mailselector, d=catania.linux.it). While if I write to a my lists from email address Gmail, on opendkim I get the following messages: opendkim[23516]: BA95241952: no signing table match for 'maszap69(a)gmail.com' opendkim[23516]: BA95241952: s=20161025 d=gmail.com SSL error:04091068:rsa routines:int_rsa_verify:bad signature opendkim[23516]: BA95241952: bad signature data The message is received regularly by all members of the list. I also receive an email at superuser: [Django] ERROR (EXTERNAL IP): Internal Server Error: /hyperkitty/api/mailman/archive Internal Server Error: /hyperkitty/api/mailman/archive OperationalError at /hyperkitty/api/mailman/archive (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\xB1\\xF0\\x9F...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") ... If I check with mail-tester I get 10/10 If I check with dmarcanalyzer I get "This seems to be a valid DKIM Record." I don't understand where the problem is. Could anyone tell me how to solve? Thank you in advance Max

2 4

Can creating too many Django accounts crash Mailman3 server?
by Mohsen Masoudfar Sept. 19, 2020

Sept. 19, 2020

Hi, It seems anybody can go to the site: https://LISTSERVNAME/mailman3/postorius/lists/ and click on the [Sign up] on the top-right corner and create an account. This can easily be automated, even though the next step, confirming the email address, being ignored. I believe it can be used as a target for a DOS attack by creating so many accounts, that eventually causes an 'out of space' error. Is this a justified concern? Is there a way to manage this feature in a secure way? Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

4 3

Office365 posts shunted (authres.core.SyntaxError)
by Bryan Loniewski Sept. 19, 2020

Sept. 19, 2020

Hi again -- Besides my compress issue described earlier today here: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… I've been dealing with another issue (and why I upgraded to the latest code) when posting messages to my test list from our schools Office365 infrastructure (OWA). The post gets shunted; mailman.log has the following error: Sep 11 11:29:44 2020 (31396) ACCEPT: <BL0PR14MB3681E636E905E9D34588C85088240(a)BL0PR14MB3681.namprd14.prod.outlook.com> Sep 11 11:29:45 2020 (31401) Uncaught runner exception: Syntax error: Expected "=" at: ; dmarc=none action=none header.from=o... Sep 11 11:29:45 2020 (31401) Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/runners/pipeline.py", line 37, in _dispose process(mlist, msg, msgdata, pipeline) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/core/pipelines.py", line 50, in process handler.process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/handlers/validate_authenticity.py", line 118, in process authenticate(msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/utilities/retry.py", line 44, in f_retry return f(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/handlers/validate_authenticity.py", line 85, in authenticate prev = trusted_auth_res(msg) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/mailman/handlers/validate_authenticity.py", line 73, in trusted_auth_res authserv_id = AuthenticationResultsHeader.parse(header).authserv_id File "/opt/mailman/mm/venv/lib/python3.6/site-packages/authres/__init__.py", line 206, in parse return authres.core.AuthenticationResultsHeader.parse(core_features(), string) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/authres/core.py", line 442, in parse return self.parse_value(feature_context, string) File "/opt/mailman/mm/venv/lib/python3.6/site-packages/authres/core.py", line 454, in parse_value header._parse() File "/opt/mailman/mm/venv/lib/python3.6/site-packages/authres/core.py", line 517, in _parse result = self._parse_resinfo() File "/opt/mailman/mm/venv/lib/python3.6/site-packages/authres/core.py", line 550, in _parse_resinfo method, version, result = self._parse_methodspec() File "/opt/mailman/mm/venv/lib/python3.6/site-packages/authres/core.py", line 573, in _parse_methodspec raise SyntaxError('Expected "="', self._parse_text) authres.core.SyntaxError: Syntax error: Expected "=" at: ; dmarc=none action=none header.from=o... Sep 11 11:29:45 2020 (31401) SHUNTING: 1599838185.4911082+9dde922f77a1d66e3511f2709ec4b436ab6a3ecc Debugging the issue further shows this header to be the problem: authentication-results: lists-test.rutgers.edu; dkim=none (message not signed) header.d=none;lists-test.rutgers.edu; dmarc=none action=none header.from=oit.rutgers.edu; What is syntactically wrong with it and/or is it more than that? Note1: If I remove that header from a copy of the message and inject directly into Mailman it will deliver as expected. Note2: Posting messages from my personal Gmail account or cmdline mail program to the same test list will also deliver as expected. ________________________ Bryan Loniewski Rutgers University OIT:EAS:Messaging and Collaboration Services System Administrator

4 8

Re-send subscription response and file permission error in queue
by accounts-mailman＠holbrook.no Sept. 15, 2020

Sept. 15, 2020

A user sent subscription request to the `..-join@` address of a list. Email domain wasn't set up properly, so response got rejected. Now, if the user tries to send another request, no reponse comes back. In the log I find a python stack trace saying subscription already pending. ``` Sep 08 10:32:44 2020 (19918) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 171, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 264, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/lib/python3/dist-packages/mailman/runners/command.py", line 196, in _dispose mlist, msg, msgdata, parts, results) File "/usr/lib/python3/dist-packages/mailman/commands/eml_membership.py", line 104, in process ISubscriptionManager(mlist).register(subscriber) File "/usr/lib/python3/dist-packages/mailman/app/subscriptions.py", line 520, in register list(workflow) File "/usr/lib/python3/dist-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3/dist-packages/mailman/app/subscriptions.py", line 227, in _step_sanity_checks raise SubscriptionPendingError(self.mlist, self.address.email) mailman.interfaces.subscriptions.SubscriptionPendingError ``` Furthermore I am getting a permission denied error in the attempt of shunting the message, which I don't quite understand because the folder has user `list` group `list` and `700` mode: ``` Sep 08 10:25:29 2020 (19918) SHUNTING: 1599553529.9889646+88be5afa0bf3111a83e68cc97ce2000723ad93fd Sep 08 10:29:49 2020 (19918) Uncaught runner exception: [Errno 13] Permission denied: '/var/lib/mailman3/queue/command/1599553789.306307+6fee74af69263553b5ffd0e73cc095ab651bd855.pck' Sep 08 10:29:49 2020 (19918) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman/core/runner.py", line 156, in _one_iteration msg, msgdata = self.switchboard.dequeue(filebase) File "/usr/lib/python3/dist-packages/mailman/core/switchboard.py", line 150, in dequeue with open(filename, 'rb') as fp: PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/queue/command/1599553789.306307+6fee74af69263553b5ffd0e73cc095ab651bd855.pck' ``` How can I remove the pending subscription, or re-send the response email? And what could be the cause of the permission error? Using mailman 3.1.1

2 4

Held Message view, JSONDecodeError: Invalid control character
by mm3＠hovo.id.au Sept. 15, 2020

Sept. 15, 2020

I am running the Debian 10 mailman3 and mailman3-web packages with mariadb. I received an email to the list from an invoicing software and now I am unable to view or accept this email from the list. All other lists seem to be still working fine. I'm guessing there is a piece of data in my database that is corrupt or unable to be decoded, but I am at a loss on how to find and fix it. Any help would be greatly appreciated ``` Sep 11 12:29:23 2020 (11577) 127.0.0.1 - - "GET /3.1/lists/redacted(a)redacted.com/held?count=0&page=1 HTTP/1.1" 200 90 Sep 11 12:29:23 2020 (11577) REST request handler error: Traceback (most recent call last): File "/usr/lib/python3.7/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/lib/python3/dist-packages/mailman/rest/wsgiapp.py", line 216, in __call__ return super().__call__(environ, start_response) File "falcon/api.py", line 215, in falcon.api.API.__call__ File "falcon/api.py", line 189, in falcon.api.API.__call__ File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 160, in on_get resource = self._make_collection(request) File "/usr/lib/python3/dist-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/lib/python3/dist-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 150, in _resource_as_dict resource = self._make_resource(request.id) File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 70, in _make_resource resource = super()._make_resource(request_id) File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 39, in _make_resource results = requests.get_request(request_id) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/requests.py", line 120, in get_request result.data_hash, expunge=False) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/pending.py", line 142, in confirm value = json.loads(keyvalue.value) File "/usr/lib/python3.7/json/__init__.py", line 348, in loads return _default_decoder.decode(s) File "/usr/lib/python3.7/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.7/json/decoder.py", line 353, in raw_decode obj, end = self.scan_once(s, idx) json.decoder.JSONDecodeError: Invalid control character at: line 1 column 21 (char 20) ```

2 2

Mailman3 throws 500 error (unicode encode) when loading held messages in Postorius
by Simon Handfield Sept. 14, 2020

Sept. 14, 2020

Hi, I have been working through other threads that indicate the same symptom (500 error when loading held_messages for a list). These include potential truncation of values in pendedkeyvalue table (don't this is our problem) and error when trying to access a message in /var/lib/mailman3/messages (ran the suggested code to loop through the stored files but no error was thrown.) Environment: Ubuntu 18.04 mailman3/bionic,now 3.1.1-9 all [installed,automatic] mailman3-full/bionic,now 3.1.1-9 all [installed] mailman3-web/bionic,now 0+20170523-14 all [installed,automatic] python-django-mailman3/bionic,now 1.1.0-4 all [installed,automatic] python-mailmanclient/bionic,now 3.1.1-5 all [installed,automatic] python3-mailman-hyperkitty/bionic,now 1.1.0-4 all [installed,automatic] Error reported in log with debug enabled: Traceback (most recent call last): File "/usr/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/lib/python3/dist-packages/mailman/rest/wsgiapp.py", line 214, in __call__ return super().__call__(environ, start_response) File "falcon/api.py", line 215, in falcon.api.API.__call__ (falcon/api.c:2872) File "falcon/api.py", line 189, in falcon.api.API.__call__ (falcon/api.c:2419) File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 167, in on_get resource = self._make_collection(request) File "/usr/lib/python3/dist-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/lib/python3/dist-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 157, in _resource_as_dict resource = self._make_resource(request.id) File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 78, in _make_resource resource['msg'] = msg.as_string() File "/usr/lib/python3.6/email/message.py", line 158, in as_string g.flatten(self, unixfrom=unixfrom) File "/usr/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/lib/python3.6/email/generator.py", line 181, in _write self._dispatch(msg) File "/usr/lib/python3.6/email/generator.py", line 214, in _dispatch meth(msg) File "/usr/lib/python3.6/email/generator.py", line 272, in _handle_multipart g.flatten(part, unixfrom=False, linesep=self._NL) File "/usr/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/lib/python3.6/email/generator.py", line 181, in _write self._dispatch(msg) File "/usr/lib/python3.6/email/generator.py", line 214, in _dispatch meth(msg) File "/usr/lib/python3.6/email/generator.py", line 243, in _handle_text msg.set_payload(payload, charset) File "/usr/lib/python3.6/email/message.py", line 315, in set_payload payload = payload.encode(charset.output_charset) UnicodeEncodeError: 'ascii' codec can't encode characters in position 8-9: ordinal not in range(128) I'm sorry if this is a query that's answered already but I have not been able to find matching thread that seems to relate to my error. Thanks for any advice on where to look next. Cheers, Simon. _ [State Library of NSW]<https://www.sl.nsw.gov.au/> Simon Handfield Desktop and Infrastructure Leader simon.handfield(a)sl.nsw.gov.au<mailto:simon.handfield@sl.nsw.gov.au> +61 2 9273 1535 Macquarie Street, Sydney NSW 2000, Australia www.sl.nsw.gov.au<https://www.sl.nsw.gov.au/> This message is intended for the addressee named and may contain confidential information. If you are not the intended recipient, please delete it and notify the sender. Views expressed in this message are those of the individual sender, and are not necessarily the views of their organisation.

3 7

How to set the original sender to the Reply-To?
by Marcel Pietschmann Sept. 12, 2020

Sept. 12, 2020

Hi everybody, I have a settings problem. Mailman adds the original sender to the Reply-To or Cc in the case where there's a reply to setting in force on the list. In my case, mailman sets the sender always to Cc. How can i change it? Greets Marcel My settings: Personalize = None Anonymous list = No Reply to list = No Munging DMARC = Munge the From: header with list adress

2 1

Failed first login
by Massimo Zappalà Sept. 11, 2020

Sept. 11, 2020

Hi everyone, i installed mailman3-full on debian 10. During installation, it asks me to enter the admin user credentials. After configuration, I restart mailman3 and mailman3-web. When I try to log in for the first time by entering the admin credentials, a message warns me that the credentials are incorrect. I looked at the mailman logs, but I find nothing. It seems that it is a django authentication problem, because even in the django admin panel I can't log in. Looking at the mailman3web db, in the auth_user table, I see the admin user. How can I see why it does not accept the credentials? Thank you in advance

2 2

Affinity and Empathy Are Now Available
by Brian Carpenter Sept. 11, 2020

Sept. 11, 2020

Dear Mailman 3 Users, We have launched Affinity and Empathy and they now are part of our shared and cloud Mailman 3 hosting services. Affinity replaces Postorius and Empathy replaces Hyperkitty. You can read more at https://mailmanhost.com Please email me off-list if you have any questions. Brian Carpenter Harmony Lists

1 0

Messages disappearing into hole??
by Ruth Ivimey-Cook Sept. 11, 2020

Sept. 11, 2020

Folks, I have been trying to set up a mailing list that is mostly for message distribution, so there is a single sender of messages and multiple receivers, but the receivers are moderated. I wouldn't mind receiver messages being explicitly rejected but that's not an issue for now. I looked around the interface and decided to set up the sender as a non-member, as that appeared to permit them to be "special" and outside of the normal access rules for the list. Before I did that I could send a message from this sender and that would be sent to me as list owner for moderation, so both incoming (from my mailserver) and outgoing (to it) can be completed. However, with a non-member who is auto-accepted the message is passed from my mailserver to mailman and then disappears. I cannot find anything in the logs to indicate what happened next. I have tried setting the default non-member policy to both 'hold' and 'default' with no change in that behaviour. The logs for the mailserver show the message being sent to mailman; mailman's "smtp.log" shows an LMTP message being received ok, and then nothing. Any ideas how to find out what is going on? I can share config if that helps but not sure what would be useful. As a side-issue, at one point I added a regex matching the sender address to the acceptable members list, but find that I cannot now delete it (using postorius): If I delete the field and Save, it returns on page refresh. Regards, Ruth -- Software Manager & Engineer Blog: http://www.ivimey.org/blog LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/

2 1

messages go to shunt queue
by Danil Smirnov Sept. 10, 2020

Sept. 10, 2020

Hi guys, I've faced weird Core behaviour after the last upgrade of the docker images. All the messages sent to a list now go straight to shunt queue with the following error in the logs: --- Sep 06 22:41:32 2020 (27) Uncaught runner exception: 0 Sep 06 22:41:32 2020 (27) Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/lib/python3.8/site-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/lib/python3.8/site-packages/mailman/runners/incoming.py", line 79, in _dispose process(mlist, msg, msgdata, start_chain) File "/usr/lib/python3.8/site-packages/mailman/core/chains.py", line 57, in process if link.rule.check(mlist, msg, msgdata): File "/usr/lib/python3.8/site-packages/mailman/rules/dmarc.py", line 314, in check if maybe_mitigate(mlist, address): File "/usr/lib/python3.8/site-packages/mailman/rules/dmarc.py", line 286, in maybe_mitigate answer = is_reject_or_quarantine( File "/usr/lib/python3.8/site-packages/mailman/rules/dmarc.py", line 217, in is_reject_or_quarantine for record in txt_rec.items[0].strings) KeyError: 0 Sep 06 22:41:32 2020 (27) SHUNTING: 1599432092.4326646+4cbb58a0dd5d9705946ca583835e63ec175536e3 I'm witnessing the same behaviour in two different installations for all the messages sent to list (with plain text body like "it's a test"). --- Any insight would be greatly appreciated! Danil Smirnov

2 2

Please help: Mailaman3 -
by Jane Anara Sept. 6, 2020

Sept. 6, 2020

Hello everyone, I hope my questions don't sound ridiculous. In my team, I have been tasked with moving our mailman installations from version 1:2.1 to the current version, mailman3. I followed the documentations online and installed all the components, created a Django project and configured settings.py and url.py. However, when I run the development server, I receive the following on the body of Postorius main page: Page not found This page either doesn't exist, or it moved somewhere else. Clicking on the "Lists" menu link, I receive the following: HTTP Error 404: <!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge"> <meta name="viewport" content="width=device-width, initial-scale=1"> <title>example.com</title> <link rel="shortcut icon" href="/static/postorius/img/favicon.ico"> <link rel="stylesheet" href="/static/postorius/libs/bootstrap/css/bootstrap.min.css"> <link rel="stylesheet" href="/static/django-mailman3/css/main.css"> <link rel="stylesheet" href="/static/postorius/css/style.css"> <link rel="stylesheet" href="/static/postorius/libs/fonts/font-awesome/css/font-awesome.min.css" type="text/css" media="all" />    </head> <body> <nav class="navbar navbar-expand-md navbar-light bg-light navbar-default"> <div class="container"> <div class="navbar-header"> <button type="button" class="navbar-toggler collapsed" data-toggle="collapse" data-target="#header-nav" aria-expanded="false"> <span class="sr-only">Toggle navigation</span> <span class="fa fa-bars"></span> </button> <a class="navbar-brand" href="/mailman3/lists/"><span><img src="/static/postorius/img/mailman_logo_small_trans.png" alt="Mailman logo"/> Postorius</span></a> </div> <div class="collapse navbar-collapse" id="header-nav"> <ul class="nav navbar-nav mr-auto"> <li class="nav-item"><a href="/mailman3/lists/" class="nav-link"> <span class="fa fa-envelope"></span> Lists </a></li> <li class="nav-item"><a href="/archives/" class="nav-link"> <span class="fa fa-comment"></span> Archives </a></li> </ul> <ul class="nav navbar-nav navbar-right"> <li class="nav-item"><a class="nav-link" href="/accounts/login/?next=/3.1/lists"> <span class="fa fa-sign-in"></span> Login </a></li> <li class="nav-item"><a class="nav-link" href="/accounts/signup/?next=/3.1/lists"> <span class="fa fa-user-plus"></span> Sign Up </a></li> </ul> </div> </div> </nav> <div class="container" role="main"> <h1>Page not found</h1> <div class="alert alert-danger">This page either doesn't exist, or it moved somewhere else.</div> </div> <footer class="footer"> <div class="container"> <p class="text-center"> <a href="https://postorius.readthedocs.org">Postorius Documentation</a> • <a href="http://list.org">GNU Mailman</a> • Postorius Version 1.3.3 • Happy Mailman Day! </p> </div> </footer> <script src="/static/postorius/libs/jquery/jquery-1.11.3.min.js"></script> <script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.11.0/umd/popper.min.js" integrity="sha384-b/U6ypiBEHpOf/4+1nzFpr53nxSS+GLCkfwBdFNTxtclqqenISfwAzpKaMNFNmj4" crossorigin="anonymous"></script> <script src="/static/postorius/libs/bootstrap/js/bootstrap.min.js"></script> <script src="/static/django-mailman3/js/main.js"></script> <script src="/static/postorius/js/script.js"></script> </body> </html> So far, the Postorious component is where there seem to be issues, all other link or component produce no errors thus far. Please advice on how I can troubleshoot this. I herein include the relevant sessions of my settings.py file and url.py which I have tweaked with various configurations to no avail. settings.py: # Application definition INSTALLED_APPS = [ # Apps added for mailman components 'hyperkitty', 'postorius', 'django_mailman3', 'mailmanclient', # Other useful apps 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', # end other useful apps 'django.contrib.sites', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.messages', 'django.contrib.staticfiles', ] url.py: urlpatterns = [ #Django admin path('admin/', admin.site.urls), path('mailman3/', include('postorius.urls')), path('archives/', include('hyperkitty.urls')), path('', include('django_mailman3.urls')), path('accounts/', include('allauth.urls')), #path('postorius', include('postorius.urls')), #path('lists/', list_index), path('search/', include('haystack.urls')), #url(r'^$', list_index), ] Note that when I uncomment the lines relating to list_index or use configurations similar to that on mailman-suit, I get: NameError: name 'list_index' is not defined. Looking forward to any help anyone can render. Thank you! Regards, Jane.

2 5

Struggling with log rotation in Docker context
by skenny＠scss.tcd.ie Sept. 5, 2020

Sept. 5, 2020

I'm running Mailman 3 via maxking's Docker implementation, and had an incident recently where something went badly wrong, and the file uwsgi-error.log filled up. As a consequence, so did the file system where that file resides,and things ground to a halt. The file is visible on the Docker host as /opt/mailman/web/logs/uwsgi-error.log. I am unsure about how to rotate this file correctly. I could use logrotate on the host, but I can't locate any documentation that describes how to signal the relevant processes inside the mailman-web container. (Maybe this should be done within the container?) I'd be grateful for any good advice on this. Stephen

2 5

mailman procesing small amount of mail, then stop process them like 30 seconds, and then loop back
by mathias.bedu＠epitech.eu Sept. 4, 2020

Sept. 4, 2020

Hi, I am currently trying to optimize my mailman installation, which is working. The only issue is that i see that mailman seems to process a few number of messages (around 50 each times), then stopping, and then processing few next messages. I spend quite some times searching for eventual parameters that could slow down. I precise that the machine itself is largely more powerful than what mailman is using. So my question is : could you give me some leads for potentials parameters or stuff like this that i could modify to optimize the installation ? Best regards, Mathias

2 2

Unsubscribe Notifications Clarification
by Brian Carpenter Sept. 3, 2020

Sept. 3, 2020

I am trying to understand how Mailman 3 handles unsubscribe notifications. From my testing I see the following behavior: 1. If list member sends email to listname-leave@listname, an unsubscribe notification is sent to both list owner and list member if list settings have them enabled. 2. If list list member is a registered user of Postorius and he uses Postorius to unsubscribe, then no notification is sent out to either list owner or list member, even if list settings has unsubscribe notifications enabled. Is this correct? Brian

2 2

adding imprint / private policy link to postorius
by Thomas Stein Sept. 3, 2020

Sept. 3, 2020

Hello one and all. Is it possible to add an imprint link to the postorius start page? I guess it is, but it would be nice if someone could me point to the right direction / documentation. Something like they have: https://lists.openrailwaymap.org/mailman3/postorius/lists/ cheers, t.

2 2

Timeout in Postorius when trying to approve or reject moderated messages
by Sebastian Hagedorn Aug. 30, 2020

Aug. 30, 2020

Hi, I just set up a new Mailman 3 Suite installation (GNU Mailman 3.3.1 (Tom Sawyer)) on CentOS 7 using the virtualenv installation guide: https://docs.mailman3.org/en/latest/install/virtualenv.html I encountered a few issues, but I was able to resolve all of them, I think. All three components of the suite are up and running. The backend is a MariaDB database, the frontend is Apache with mod_wsgi. I can send messages to the server, and they are delivered to list members. One thing that I can't figure out is why I can't approve or reject messages that are held for moderation. In case it matters, I'm trying to moderate the list using the "root" account. Discarding works, but when I try to either accept or reject a message, there is a timeout. I can't find anything in mailman.log, mailmansuite.log or even /var/log/httpd/access_log. I managed to reject and approve messages manually using mailmanclient and the REST API, so the issue appears to be somewhere between Postorius 1.3.3 and mailmancore. Any ideas? -- .:.Sebastian Hagedorn - Weyertal 121 (Gebäude 133), Zimmer 2.02.:. .:.Regionales Rechenzentrum (RRZK).:. .:.Universität zu Köln / Cologne University - ✆ +49-221-470-89578.:.

4 6

Throttle outgoing emails to a certain rate?
by arvid.teichtmann＠gmx.de Aug. 21, 2020

Aug. 21, 2020

Is there a possibility to throttle the sending of outgoing emails to a certain rate, e.g. 100 emails per hour, or to split them up into corresponding chunks? I run Mailman 2.1.33 on a hosted server and the provider only allows me to send a maximum of 100 emails per hour. The excess emails are also simply discarded and the sender and list administrator get a bunch of error emails. This is very annoying, especially because I didn't know about it and the problem only now occurs occasionally during operation... ;-( Thanks for all hints.

3 2

Spam sign ups
by Seth Seeger Aug. 21, 2020

Aug. 21, 2020

Hello all, I've suddenly started getting a slow but steady stream of fake sign ups. They fail because I'm getting a bounce back from the mail host saying that the email address they signed up with doesn't exist. I know this was asked a while back on this list, but I'm hoping there might be an update? Any way to add an am-I-human test to the sign up? Thanks, Seth

2 1