- Mailman-users - lists.mailman3.org

Bounce handling after upgrade
by David Krantz July 8, 2020

July 8, 2020

Hi, I am in the process of configuring a new mailman3 server based on my old one. This includes upgrading to the latest version of mailman and installing a database upgrade. To my surprise mailman core started by sending tens of mails and blocking the corresponding users for very old bounces. What is worse is that this happens every time I start mailman core. Now I have blocked (almost) all outgoing mail in postfix using a transport map which discards it but this is a temporary testing measure of course. When I deploy this server into production, I do not want these recipients to be blocked as the old problems have been solved since very long. My plan is to reload the database from a newer backup anyway... Would it be enough to empty the bounce table (bounceevent) or is there anything else driving this behaviour? Or is there a better way to do this via the mailman shell? For me a "delete from bounceevent" seems a lot simpler than anything via the shell but there may be dependencies in the database. Cheers // David

2 1

Crash while importing archives
by Mark Dadgar July 8, 2020

July 8, 2020

This is actually an mbox file generated by mailman3. (venv) mailman@mail:/opt/mailman/mm$ /opt/mailman/mm/bin/django-admin hyperkitty_import --since 2020-02-19 -l trackjunkies(a)pdc-racing.net /temp/archive/trackjunkies-new-1.mbox Importing from mbox file /temp/archive/trackjunkies-new-1.mbox to trackjunkies(a)pdc-racing.net \Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 364, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 327, in handle importer.from_mbox(mbfile) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 152, in from_mbox for msg in mbox: File "/usr/lib/python3.8/mailbox.py", line 109, in itervalues value = self[key] File "/usr/lib/python3.8/mailbox.py", line 73, in __getitem__ return self.get_message(key) File "/usr/lib/python3.8/mailbox.py", line 781, in get_message msg.set_from(from_line[5:].decode('ascii')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 27: ordinal not in range(128) mailman 3.3.1 / core 3.1 Easy fix? I’m missing about 10 days' worth of archives as a result of this. - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 1

Importing list archives
by Mark Dadgar July 7, 2020

July 7, 2020

So I got a shiny new instance of Mailman3 installed (thanks Brian!). I recreated my lists and I am now importing large historical list archives from an mbox file (24GB). It takes a couple of hours to run this import, so I killed the import task after about 20 minutes so I could restart it in a screen session. Now when I restart the import, it finishes almost immediately: (venv) mailman@mail:/opt/mailman/mm$ /opt/mailman/mm/bin/django-admin hyperkitty_import -l trackjunkies(a)pdc-racing.net trackjunkies.mbox Importing from mbox file trackjunkies.mbox to trackjunkies(a)pdc-racing.net Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the Django admin command with arguments 'update_index_one_list trackjunkies(a)pdc-racing.xn--net-to0a. (venv) mailman@mail:/opt/mailman/mm$ Which is clearly not correct. Anyone have an idea on how to restart this import? THanks! - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 2

Error after HyperKitty 1.3.x upgrade
by Florian Schulze July 6, 2020

July 6, 2020

Hi! After upgrading to HyperKitty 1.3.x I get the following error for qcluster: File ".../lib/python3.7/site-packages/django_q/cluster.py", line 300, in pusher task = SignedPackage.loads(task[1]) File ".../lib/python3.7/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File ".../lib/python3.7/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File ".../lib/python3.7/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) AttributeError: Can't get attribute 'process_task_result' on <module 'hyperkitty.tasks' from '.../lib/python3.7/site-packages/hyperkitty/tasks.py'> How do I recover from that? It seems like there are still persisted tasks in the qcluster queue using the old code from 1.2.x with the old locking implementation. Regards, Florian Schulze

2 4

Using external services for deliverability?
by tom＠gather.coop July 4, 2020

July 4, 2020

I have a Mailman 3 server up and running but I'm terrified to migrate to it from my existing Mailman 2 provider for fear that services like Gmail will randomly start blacklisting my IP with little I can do about it. I have SPF records set up so I'm hoping I'll be Ok but I'd like to have a backup plan. Has anyone ever tried using an external service like Mailgun or Sendgrid as a relay? I tried both but couldn't get either to work due to their sender authentication mechanism. They want all 'From:' headers to be from domains that are pre-authenticated as senders. But Mailman keeps the 'From' header from the original sender so it won't match any authenticated domains. Right? Is there anything to be done here or do I just have to migrate and pray?

3 6

Example Logrotate files for Mailman3
by Andrew Hodgson July 3, 2020

July 3, 2020

Hi, Does anyone have any usable Logrotate files for Mailman3 (especially for the web stuff)? Will look to create my own if no one comes forward but if anyone has anything they are willing to share it would be fab. Thanks. Andrew.

2 2

hidden list is hidden even to the owner
by Mohsen Masoudfar July 2, 2020

July 2, 2020

Hi, I am not sure, if it is designed this way, or I am doing something wrong. I created a list in MM3 as a hidden list, meaning: Show list on index page: NO and assigned the owner. When I login as Postorius web admin, I see the list on the list page which is listed as: (unadvertised*). This is fine. But when the owner or moderator login to Postorius they don't see the list at all. Of course if they add the list name at the end of the URL, they get to the list and as the owner can manage it too. My question is: I am just not sure, if I am missing something or this is how it is supposed to work? You could expect, that the owner or the moderator should see the list as (unadvertised*) too. Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

3 4

clarifying configuration
by trewtus+200629maitr＠gmail.com June 30, 2020

June 30, 2020

Hey Team, I'm new to Mailman and after some failed attempts to install from git on CentOS8, I have just installed it on Ubuntu 20.04 using mostly aptitude. But it's not quite working and I want to increase the log level to better understand the problem. I did see another post that suggested that I add to /etc/mailman3/mailman.cfg [logging.template] level: debug But that doesn't work for me. For example, after using that `mailman conf` doesn't list and debug values and as far as I can tell, the service, even after restarting, is not logging any more than it was. On the other hand, if I add [logging.smtp] level: debug Invoking `mailman conf` will reflect that new loglevel. This started me down the path of trying to figure out the configuration system of mailman in hope that that will save me time down the road. I have read https://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html but that doesn't seem to agree with what I'm seeing. For an additional example, my mailman.cfg file has a "logging.debian" section, but I don't see that section listed in the `mailman conf` output. Why would that be? I don't see in the documentation if `mailman conf` only sees values after the service is restarted. Nevertheless, restarting mailman hasn't helped. What guidance can you give? Context: `mailman info` produces: GNU Mailman 3.2.2 (La Villa Strangiato) Python 3.8.2 (default, Apr 27 2020, 15:53:34) [GCC 9.3.0] config file: /etc/mailman3/mailman.cfg db url: sqlite:////var/lib/mailman3/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:KI5TuWE/v.....

2 1

Moderation of posts via email is not working in mailman 3
by Shashikanth Komandoor June 30, 2020

June 30, 2020

Hi Team, In mailman 2, few of my users used to approve the held messages through the mail by writing Approved: header and the password of the list in the first line of the reply mail to the "confirm" attachment in the mail notification of the held messages. But after I started migrating my distribution lists from mailman 2 to mailman 3, my users are complaining that they could not approve the posts or the held messages through the mail as they usually do while they were browsing their lists in mailman 2. Is there any bug or limitation in mailman 3 or if I am doing any wrong at the server side? Please suggest. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 3

User settings triggers error
by Mark Dadgar June 29, 2020

June 29, 2020

If one of my users (including admin) goes to their user drop-down in the upper-right of Postorius and clicks Mailman Settings, it triggers an error: Here’s the error log: Internal Server Error: /mailman3/postorius/accounts/subscriptions/ KeyError at /postorius/accounts/subscriptions/ 'file' Request Method: GET Request URL: https://mail.pdc-racing.net/mailman3/postorius/accounts/subscriptions/ <https://mail.pdc-racing.net/mailman3/postorius/accounts/subscriptions/> Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Tue, 16 Jun 2020 10:31:56 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/contrib/auth/decorators.py" in _wrapped_view 21. return view_func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/user.py" in user_subscriptions 307. memberships = [m for m in mm_user.subscriptions] File "/usr/lib/python3/dist-packages/mailmanclient/restobjects/user.py" in subscriptions 62. for address in self.addresses: File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __iter__ 221. for entry in self.rest_data: File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 197. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 36. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 91. log_response( File "/usr/lib/python3/dist-packages/django/utils/log.py" in log_response 222. getattr(logger, level)( File "/usr/lib/python3.8/logging/__init__.py" in error 1463. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.8/logging/__init__.py" in _log 1577. self.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 1587. self.callHandlers(record) File "/usr/lib/python3.8/logging/__init__.py" in callHandlers 1649. hdlr.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 950. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 119. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.8/tempfile.py" in __getattr__ 607. file = self.__dict__['file'] Exception Type: KeyError at /postorius/accounts/subscriptions/ Exception Value: 'file' Request information: USER: admin GET: No GET data POST: No POST data FILES: No FILES data Anyone got a solution to this? - Mark ----- mark(a)pdc-racing.net | 408-348-2878

3 21