January 2020 - Mailman-users - lists.mailman3.org

Welcome Message
by brian＠emwd.com Nov. 25, 2020

Nov. 25, 2020

Is it possible for a list admin to modify the welcome message for a list via Postorius? Is the process: 1. Log into Postorious 2. Click on the Templates tab. 3. Select New Template. 4. Select "The notice sent to a member when they are subscribed to the mailing list" 5. Add your text and click the save button. Is the correct process? I am using the latest Docker release of Mailman 3.

5 25

Internal Server Error by Clicking on OrmQ Queue
by Stephan Krinetzki Nov. 4, 2020

Nov. 4, 2020

Dear list, on our Mailman 3 system we are hitting the following error by clicking a link to admin/django_q/ormq/: Server Error The Log prints: --- ERROR 2019-08-26 08:48:01,704 10311 django.request Internal Server Error: /admin/django_q/ormq/ Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 566, in get_field return self.fields_map[field_name] KeyError: 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 276, in lookup_field f = _get_non_gfk_field(opts, name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 307, in _get_non_gfk_field field = opts.get_field(name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 568, in get_field raise FieldDoesNotExist("%s has no field named '%s'" % (self.object_name, field_name)) django.core.exceptions.FieldDoesNotExist: OrmQ has no field named 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/library.py", line 214, in render _dict = self.func(*resolved_args, **resolved_kwargs) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 326, in result_list 'results': list(results(cl))} File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 302, in results yield ResultList(None, items_for_result(cl, res, None)) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 293, in __init__ super().__init__(*items) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 212, in items_for_result f, attr, value = lookup_field(field_name, result, cl.model_admin) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 289, in lookup_field value = attr() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 200, in task_id return self.task()['id'] File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 194, in task return SignedPackage.loads(self.payload) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128) ERROR 2019-08-26 08:48:01,704 10311 django.request Internal Server Error: /admin/django_q/ormq/ Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 566, in get_field return self.fields_map[field_name] KeyError: 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 276, in lookup_field f = _get_non_gfk_field(opts, name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 307, in _get_non_gfk_field field = opts.get_field(name) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/db/models/options.py", line 568, in get_field raise FieldDoesNotExist("%s has no field named '%s'" % (self.object_name, field_name)) django.core.exceptions.FieldDoesNotExist: OrmQ has no field named 'task_id' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 35, in inner response = get_response(request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 158, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = response.render() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 175, in render return self._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 155, in render return compiled_parent._render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 167, in _render return self.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/loader_tags.py", line 67, in render result = block.nodelist.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 943, in render bit = node.render_annotated(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/base.py", line 910, in render_annotated return self.render(context) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/template/library.py", line 214, in render _dict = self.func(*resolved_args, **resolved_kwargs) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 326, in result_list 'results': list(results(cl))} File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 302, in results yield ResultList(None, items_for_result(cl, res, None)) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 293, in __init__ super().__init__(*items) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/templatetags/admin_list.py", line 212, in items_for_result f, attr, value = lookup_field(field_name, result, cl.model_admin) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django/contrib/admin/utils.py", line 289, in lookup_field value = attr() File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 200, in task_id return self.task()['id'] File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/models.py", line 194, in task return SignedPackage.loads(self.payload) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File "/opt/mailman/mailman-venv/lib/python3.6/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 1: ordinal not in range(128) --- Any ideas how to see the complete queue an maybe delete some defunct entries?

2 1

Mails are not archived at all -- how to check if Hyperkitty is running or not?
by Franklin Weng Sept. 23, 2020

Sept. 23, 2020

Hi, I set up the mailman3 services and lists, and we can send mail to the list successfully. However in the Archive section I couldn't see anything and all the lists were "inactive" and hence were hidden by default. I confirmed that api_key set in the /etc/mailman3/mailman-hyperkitty.cfg and /etc/mailman3/mailman-web.py is the same. I also confirmed that the apache2 wsgi module has been loaded. In the mailman.cfg database is set to mysql and in the mailman-web.py database is set to sqlite3. Does it matter? I tried to search but couldn't find any further information or discussion about this. There is no systemd service for Hyperkitty. How can I check if Hyperkitty is running or not? Thanks, Franklin

6 18

Mailman 3.2.0 Hyperkitty fulltext index error
by Marvin Gülker July 31, 2020

July 31, 2020

Hi, I've just upgraded to Mailman 3.2.0 (finally everything Python 3 now, thanks!) and it appears to work. However, there's a repeating error message in mailman-suite's logfile for Hyperkitty that looks like this: ERROR 2018-07-12 14:28:33,895 2742 hyperkitty.lib.utils Failed to update the fulltext index: ord() expected a character, but string of length 0 found Traceback (most recent call last): File "/home/mailman/env3/lib/python3.5/site-packages/hyperkitty/lib/utils.py", line 179, in run_with_lock fn(*args, **kwargs) File "/home/mailman/env3/lib/python3.5/site-packages/hyperkitty/search_indexes.py", line 115, in update_index update_cmd.update_backend("hyperkitty", "default") File "/home/mailman/env3/lib/python3.5/site-packages/haystack/management/commands/update_index.py", line 276, in update_backend last_max_pk=max_pk) File "/home/mailman/env3/lib/python3.5/site-packages/haystack/management/commands/update_index.py", line 97, in do_update backend.update(index, current_qs, commit=commit) File "/home/mailman/env3/lib/python3.5/site-packages/haystack/backends/whoosh_backend.py", line 178, in update self.setup() File "/home/mailman/env3/lib/python3.5/site-packages/haystack/backends/whoosh_backend.py", line 126, in setup self.index = self.storage.open_index(schema=self.schema) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/filedb/filestore.py", line 176, in open_index return indexclass(self, schema=schema, indexname=indexname) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 421, in __init__ TOC.read(self.storage, self.indexname, schema=self._schema) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 632, in read check_size("int", _INT_SIZE) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 626, in check_size sz = stream.read_varint() File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/filedb/structfile.py", line 191, in read_varint return read_varint(self.read) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/util/varints.py", line 102, in read_varint b = ord(readfn(1)) TypeError: ord() expected a character, but string of length 0 found The error repeats every minute, so I suppose it comes from the minutely cronjob. This cronjob looks like this: * * * * * mailman bash -c 'cd /home/mailman && . /home/mailman/env3/bin/activate && django-admin runjobs minutely --pythonpath /home/mailman/mailman-suite/mailman-suite_project --settings settings' What's wrong here? Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

3 3

Update a member's display_name
by Nick Wynja July 8, 2020

July 8, 2020

Hi all, I want to update some list member's display_name either with mailman shell or mailmanclient. These mostly aren't users in Postorius so I only want to operate on the subscribed list member. I've tried everything I can find in the docs and am stuck. I've tried using `user_manager.get_user()` and then updating `user.display_name` followed by a `commit()` but it doesn't seem to persist the change. The `absorb_existing` flag for mailmanclient's `User.add_address()` looks promising but the docs read "It will import the existing user into the current one, not overwriting any previously set value." which in some cases, the member already has a display_name set. I haven't tried this yet. I'd appreciate any help pointing in the right direction. Thanks, Nick

5 10

Hyperkitty 403 Forbidden Error
by Phil Thompson June 25, 2020

June 25, 2020

I'm in the process of setting up mailman3. The only problem I seem to be having is getting Hyperkitty to archive messages. Rather than the authorisation problems people have previously asked about on the list, I am getting a 403 error... Aug 05 15:38:40 2019 (10229) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/urls: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Aug 05 15:38:58 2019 (10222) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/archive: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Any suggestions would be appreciated. Phil

6 16

locked files problem after reboot
by mailman3＠malevil.cc June 20, 2020

June 20, 2020

hey, I have got a problem with flufl.lock in mailman3. When my server is rebooted, locked files seems to stay and cause errors so mailman3 core wont start (it is started automatically by supervisord service): PermissionError: [Errno 1] Operation not permitted Traceback (most recent call last): File "/home/user/.local/lib/python3.6/site-packages/mailman/bin/master.py", line 146, in acquire_lock lock = acquire_lock_1(force) File "/home/user/.local/lib/python3.6/site-packages/mailman/bin/master.py", line 125, in acquire_lock_1 lock.lock(timedelta(seconds=0.1)) File "/home/user/.local/lib/python3.6/site-packages/flufl/lock/_lockfile.py", line 259, in lock raise TimeOutError('Could not acquire the lock') flufl.lock._lockfile.TimeOutError: Could not acquire the lock I have to remove the files in var/locks manually to go forward. Is there a configuration error for my setup? Or is it just a not fixed bug? Greetsn, jekyl

3 4

Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup
by Michael Sage June 17, 2020

June 17, 2020

Hi, I came across this really useful guide (posted to the list earlier). It has all gone really well and mailman 3 is installed. However, I have an issue, when I go to login using Postorius, I get the login page when I enter my credentials the page appears to hang and eventually goes to a Error 500 page. This totally hangs all of the mailman 3 web interface (but not apache). I then have to reboot the server to even get back to the login page. Any tips please? Thanks

5 10

Separating Lists by Domain
by brian＠emwd.com May 1, 2020

May 1, 2020

I have successfully setup a second domain with my Mailman3 setup. I also created a list using the second domain. So I have two domains with one list each. The issue I see at this point is all of the lists are shown via Postorius regardless of the list domain used. Is it possible to have only the lists to show that are part of the domain being used to access? For example: http://domaina.com/postorius/lists/ Only listnames(a)domaina.com show up. http://domainb.com/postorius/lists/ Only listnames(a)domainb.com show up. Right now both domaina AND domainb lists showup regardless of the domain being used to access Postorius. The same goes for Hyperkitty as well. Brian

6 11

Thread matching query does not exist
by andrew.bernard＠gmail.com March 19, 2020

March 19, 2020

Now I am seeing this in the log every few seconds: 12:12:29 [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] 12:12:29 [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7.egg/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/tasks.py", line 189, in _rebuild_thread_cache_votes thread = Thread.objects.get(id=thread_id) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. Any help? How do I identify the thread in question? I imported an archive from a Listserv list, processed into something resembling mbox format (which I now understand not to be a standard at all) and have about 100,000 messages there. I am having a lot of trouble with these sort of errors, as you will see from my flurry of posts recently. Yes, I am running all the jobs. Andrew

3 3