August 2023 - Mailman-users - lists.mailman3.org

Add date stamps to django (I think) logfiles?
by kjohnson＠eclypse.org 01 Sep '23

01 Sep '23

The webserver and archive part of mailman writes some logfiles on my system with entries like: 17:19:05 [Q] INFO Process-1 guarding cluster twenty-pluto-arizona-pasta 17:19:05 [Q] INFO Process-1:4 pushing tasks at 2831 17:19:05 [Q] INFO Q Cluster twenty-pluto-arizona-pasta running. These seem to match this format in settings.py: 'format': '%(levelname)s %(asctime)s %(process)d %(name)s %(message)s' except that I would expect asctime to have a date attached. A pointer to relevant documentation would be very much appreciated. Thanks. Ken

3 2

Installing Mailman3 on Debian Bullseye
by Franklin Weng 30 Aug '23

30 Aug '23

Hi, After several times attempts I finally successfully build a (reliable enough) mailman3 instance on Debian. I had a blog article describing how I did it. Maybe there were something you find it ridiculous, but they are all what I found important and may not be shown in the current documents. https://blogs.slat.org/node/1012 Hope this helps. Franklin

6 9

log rotation in maxking-docker-version
by Jens Günther 27 Aug '23

27 Aug '23

Hey there, while checking some logs I was realising that there is no log rotation and some of them piled up to 5GB over the past year(s). Does anybody know how to activate it (if it's possible) or ... Ok, I found a clue and it's still open :-) https://github.com/maxking/docker-mailman/issues/535 -> does anybody have a different approach? Regards, Jens.

2 3

Can't start mailman after reboot.
by mrl＠psfc.mit.edu 24 Aug '23

24 Aug '23

I have successful rebooted my computer server several times, and mailman has always started without a problem Now mailman won't start. See below. I tried to see if it was a problem with mysql. But I can successfully connect to the sql server using the mailman username and password, from the command line. What else can I try??? Thanks. - Mark Aug 24 12:52:17 psfcmail2 systemd[1]: Starting GNU Mailing List Manager... Aug 24 12:52:18 psfcmail2 mailman[28151]: Traceback (most recent call last): Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/bin/mailman", line 8, in <module> Aug 24 12:52:18 psfcmail2 mailman[28151]: sys.exit(main()) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1130, in __call__ Aug 24 12:52:18 psfcmail2 mailman[28151]: return self.main(*args, **kwargs) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1055, in main Aug 24 12:52:18 psfcmail2 mailman[28151]: rv = self.invoke(ctx) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/mailman/bin/mailman.py", line 69, in invoke Aug 24 12:52:18 psfcmail2 mailman[28151]: return super().invoke(ctx) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1657, in invoke Aug 24 12:52:18 psfcmail2 mailman[28151]: return _process_result(sub_ctx.command.invoke(sub_ctx)) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1404, in invoke Aug 24 12:52:18 psfcmail2 mailman[28151]: return ctx.invoke(self.callback, **ctx.params) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/click/core.py", line 760, in invoke Aug 24 12:52:18 psfcmail2 mailman[28151]: return __callback(*args, **kwargs) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func Aug 24 12:52:18 psfcmail2 mailman[28151]: return f(get_current_context(), *args, **kwargs) Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/mailman/commands/cli_control.py", line 91, in start Aug 24 12:52:18 psfcmail2 mailman[28151]: status, lock = master_state() Aug 24 12:52:18 psfcmail2 mailman[28151]: File "/opt/mailman/venv/lib/python3.10/site-packages/mailman/bin/master.py", line 104, in master_state Aug 24 12:52:18 psfcmail2 mailman[28151]: os.kill(pid, 0) Aug 24 12:52:18 psfcmail2 mailman[28151]: PermissionError: [Errno 1] Operation not permitted Aug 24 12:52:19 psfcmail2 mariadbd[22160]: 2023-08-24 12:52:19 3191 [Warning] Aborted connection 3191 to db: 'mailman' user: 'mailman' host: 'localhost' (Got an error reading communication packets)

2 3

Only allow users to subscribe from certain domains
by bob B 23 Aug '23

23 Aug '23

Does Mailman have anyway to just allow users to subscribe themselves to a list from certain domains... ie any user from test.com or test2.com I do not believe this exists, but have a list manger who is asking. I feel they will have to either, approve all requests, or have a web frontend built that could filter that out and then send the subscribe commands in the backend. Thanks

2 2

applying patch 1130
by David Newman 22 Aug '23

22 Aug '23

Please forgive a dumb question from a non-programmer: How to apply the !1130.diff patch to a venv installation? https://gitlab.com/mailman/mailman/-/merge_requests/1130 I am looking to upgrade Debian 11 to 12. The latter uses python3.11, which no longer has a dependency on importlib_resources. As a result, MM3 won't start unless all references to importlib_resources instead call importlib.resources, now part of stdlib. I tried patching all importlib.resource references by hand, and MM3 starts – but that can't be the "right" way to do this. Also, the diff references a src directory that doesn't exist under /opt/mailman. Thanks in advance for patching clues. dn

3 5

importlib_resources issue?
by Dave McGuire 21 Aug '23

21 Aug '23

Hi folks, I'm trying to test a fresh venv-based install from this procedure: https://docs.mailman3.org/en/latest/install/virtualenv.html Platform is SmartOS (Solaris 11) with Python 3.10. The installation goes fine, but initial startup bombs with: ImportError: cannot import name 'path' from 'importlib_resources' (/opt/mailman/venv/lib/python3.10/site-packages/importlib_resources/__init__.py) I assume this is related to importlib_resources moving into stdlib at some point. Is there a reasonable way around this? Thanks, -Dave -- Dave McGuire, AK4HZ New Kensington, PA

2 2

Internal Server Error: /mailman3/hyperkitty/api/mailman/archive
by Mail Person 21 Aug '23

21 Aug '23

Hello everyone. I am trying to sort out an error happening when messages are sent to the mailman server. The emails are being sent to the list but I get this error each time: Internal Server Error: /mailman3/hyperkitty/api/mailman/archive OperationalError at /hyperkitty/api/mailman/archive (1366, "Incorrect string value: '\\xF0\\x9F\\x90\\xBA\\x0A\\x0A...' for column 'content' at row 1") Request Method: POST Request URL: http://localhost/mailman3/hyperkitty/api/mailman/archive?key=7OF5IogiQItSUK… Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.10 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Thu, 17 Aug 2023 17:13:09 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in _execute 84. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 71. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 209. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 315. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 226. _mysql.connection.query(self, query) The above exception ((1366, "Incorrect string value: '\\xF0\\x9F\\x90\\xBA\\x0A\\x0A...' for column 'content' at row 1")) was the direct cause of the following exception: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/http.py" in inner 40. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in _decorator 71. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/csrf.py" in wrapped_view 54. return view_func(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in archive 117. add_to_list(mlist_fqdn, msg) File "/usr/lib/python3/dist-packages/hyperkitty/lib/incoming.py" in add_to_list 153. email.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save 740. self.save_base(using=using, force_insert=force_insert, File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save_base 777. updated = self._save_table( File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _save_table 870. result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _do_insert 907. return manager._insert([self], fields=fields, return_id=update_pk, File "/usr/lib/python3/dist-packages/django/db/models/manager.py" in manager_method 82. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py" in _insert 1186. return query.get_compiler(using=using).execute_sql(return_id) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py" in execute_sql 1375. cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 67. return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in _execute_with_wrappers 76. return executor(sql, params, many, context) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in _execute 84. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py" in __exit__ 89. raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in _execute 84. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 71. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 209. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 315. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 226. _mysql.connection.query(self, query) Exception Type: OperationalError at /hyperkitty/api/mailman/archive Exception Value: (1366, "Incorrect string value: '\\xF0\\x9F\\x90\\xBA\\x0A\\x0A...' for column 'content' at row 1") Request information: USER: AnonymousUser

2 2

Ansible role to install Mailman3
by samuel.d.darwin＠gmail.com 04 Aug '23

04 Aug '23

Hi, Before installing the Mailman Suite, I searched on https://galaxy.ansible.com/ for Ansible roles that might automate the whole process. https://github.com/galaxyproject/ansible-mailman3 turned out to be quite good. However, it was slightly out-of-date. I cloned it, made a few bug fixes, and corrected linting errors. Then, going further, added optional basic installations of Nginx, Postfix, PostgreSQL into the role. If anyone is installing Mailman they are welcome to try it out. https://github.com/cppalliance/ansible-mailman3 Now, I see there was a discussion on this very list about https://github.com/rivimey/ansible-mailman3 which was also a fork of natefoo's repo. What are the differences? As Stephen Turnbull wrote: "her (rivimey's) setup may be more complicated than most folks need (IIRC, she has a multi-homed setup with Mailman core, Postorius, and HyperKitty on three separate IPs on a separate subnet in the DMZ, while Mailman was really designed for three Mailman applications running on the same host, along with the database server and MTA)." My version of the role didn't follow the tactic of "three separate IPs on a separate subnet in the DMZ". Mainly, it adds postfix and postgres. Fixes small errors. Also, in a git branch of the repository named mailman3-core, I removed all the web code, so there is a version of the role that only installs core. We will use that while bundling the web components into another Django app, already deployed with docker. There is an open question about maintenance. Among the three roles mentioned here, which is being actively kept up-to-date? Perhaps there are no guarantees from any of them. At this instant in time, https://github.com/cppalliance/ansible-mailman3 is the most recent. Would it make sense to mention these roles in the official documentation? Not sure. Installing mailman3 is complicated and because of that, is a good fit for Ansible.

3 2