- Mailman-users - lists.mailman3.org

Mailman 3.2.0 Hyperkitty fulltext index error
by Marvin Gülker 31 Jul '20

31 Jul '20

Hi, I've just upgraded to Mailman 3.2.0 (finally everything Python 3 now, thanks!) and it appears to work. However, there's a repeating error message in mailman-suite's logfile for Hyperkitty that looks like this: ERROR 2018-07-12 14:28:33,895 2742 hyperkitty.lib.utils Failed to update the fulltext index: ord() expected a character, but string of length 0 found Traceback (most recent call last): File "/home/mailman/env3/lib/python3.5/site-packages/hyperkitty/lib/utils.py", line 179, in run_with_lock fn(*args, **kwargs) File "/home/mailman/env3/lib/python3.5/site-packages/hyperkitty/search_indexes.py", line 115, in update_index update_cmd.update_backend("hyperkitty", "default") File "/home/mailman/env3/lib/python3.5/site-packages/haystack/management/commands/update_index.py", line 276, in update_backend last_max_pk=max_pk) File "/home/mailman/env3/lib/python3.5/site-packages/haystack/management/commands/update_index.py", line 97, in do_update backend.update(index, current_qs, commit=commit) File "/home/mailman/env3/lib/python3.5/site-packages/haystack/backends/whoosh_backend.py", line 178, in update self.setup() File "/home/mailman/env3/lib/python3.5/site-packages/haystack/backends/whoosh_backend.py", line 126, in setup self.index = self.storage.open_index(schema=self.schema) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/filedb/filestore.py", line 176, in open_index return indexclass(self, schema=schema, indexname=indexname) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 421, in __init__ TOC.read(self.storage, self.indexname, schema=self._schema) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 632, in read check_size("int", _INT_SIZE) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/index.py", line 626, in check_size sz = stream.read_varint() File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/filedb/structfile.py", line 191, in read_varint return read_varint(self.read) File "/home/mailman/env3/lib/python3.5/site-packages/whoosh/util/varints.py", line 102, in read_varint b = ord(readfn(1)) TypeError: ord() expected a character, but string of length 0 found The error repeats every minute, so I suppose it comes from the minutely cronjob. This cronjob looks like this: * * * * * mailman bash -c 'cd /home/mailman && . /home/mailman/env3/bin/activate && django-admin runjobs minutely --pythonpath /home/mailman/mailman-suite/mailman-suite_project --settings settings' What's wrong here? Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

3 3

Owner's or Moderator's Lists
by Johnny Cison 31 Jul '20

31 Jul '20

I feel like I'm missing something obvious, but is there a page in Postorius that lists all of the lists of which the user is the owner or moderator? When I visit the /lists/ URL as an admin, I see a full list. When I visit the /lists/ URL without being logged in, I see public lists. I've heard from two people who are list owners (and confirmed they're logged in and their email is showing as verified) that they also just see the public lists on the /lists/ page. (I tried searching the archives and didn't see anything that addressed this. My apologies if I overlooked it!)

2 3

Good choice of defaults for content filtering?
by hansen＠rc.org 31 Jul '20

31 Jul '20

Hi all, I had MM2 set to the default filtering that I think came OOTB. MM3 has none such and I was wondering: a. What were those MM2 defaults (My MM2 server is long gone now). b. Is there a better set today. I know that MIME types can be faked, but they have worked. I want to avoid anything that can contain malicious code while also allowing simple text to go through. Yours, Allan

3 2

A little stuck with installation of MM3 - ModuleNotFoundError: No module named 'flufl.lock'
by Odhiambo Washington 30 Jul '20

30 Jul '20

I decided to try this again, on FreeBSD-12.1 I still decided to follow https://wiki.list.org/DOC/Mailman%203%20installation%20experience which I know is not the main documentation, but I find the process easier to follow. I am also taking notes to see if I could share if I manage to succeed. This is important for me because Python-2.7 is being removed from FreeBSD in Dec 2020. I need to bail out of mailman-2.x before that happens so I am trying my hand again om MM3. I have failed before :-) I am stuck at this step: (venv) [root@gw /opt/mailman/mm]# /opt/mailman/mm/bin/mailman-post-update + '[' False == False ']' + mkdir -p /opt/mailman/mm/static + /opt/mailman/mm/bin/django-admin collectstatic --clear --noinput --verbosity 0 Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 33, in <module> sys.exit(load_entry_point('Django==3.0.8', 'console_scripts', 'django-admin')()) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/core/management/__init__.py", line 401, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/core/management/__init__.py", line 377, in execute django.setup() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/__init__.py", line 24, in setup apps.populate(settings.INSTALLED_APPS) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/apps/registry.py", line 114, in populate app_config.import_models() File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-3.0.8-py3.7.egg/django/apps/config.py", line 211, in import_models self.models_module = import_module(models_module_name) File "/usr/local/lib/python3.7/importlib/__init__.py", line 127, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 1006, in _gcd_import File "<frozen importlib._bootstrap>", line 983, in _find_and_load File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 677, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 728, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/models/__init__.py", line 26, in <module> from .email import Attachment, Email File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/models/email.py", line 35, in <module> from .mailinglist import MailingList File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/models/mailinglist.py", line 37, in <module> from hyperkitty.lib.utils import pgsql_disable_indexscan File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4-py3.7.egg/hyperkitty/lib/utils.py", line 42, in <module> from flufl.lock import Lock *ModuleNotFoundError: No module named 'flufl.lock'* (venv) [root@gw /opt/mailman/mm]# pip install flufl.lock Requirement already satisfied: flufl.lock in ./venv/lib/python3.7/site-packages/flufl.lock-4.0-py3.7.egg (4.0) Requirement already satisfied: atpublic in ./venv/lib/python3.7/site-packages/atpublic-1.0-py3.7.egg (from flufl.lock) (1.0) Requirement already satisfied: psutil in ./venv/lib/python3.7/site-packages/psutil-5.7.2-py3.7-freebsd-12.1-RELEASE-p7-amd64.egg (from flufl.lock) (5.7.2) Even after the 'pip install flufl.lock' it still doesn't find it! I have had a similar problem earlier with installing pylibmc. It could not find libmemcache.h despite it being inside /usr/local/include somewhere and I luckily solved that with export LIBMEMCACHED=/usr/local && pip install pylibmc. I am wondering if there is an equivalent to resolve this one with flufl.lock. Thanks in advance. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

3 21

500 Internal Server Error on specific list pages
by Johnny Cison 30 Jul '20

30 Jul '20

I have a new Mailman 3 server set up and am having a strange issue with just one particular list. Accessing the list's Info page URL or it's Archiving Settings page URL returns a 500 Internal Server Error, but its other pages work correctly. Also, the Info and Archiving pages on the other lists are working correctly. When I access the info page for the problem list, I get these errors in the log: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 249, in _legacy_get_response response = self._get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 68, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/views/generic.py", line 59, in dispatch return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py", line 88, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/views/list.py", line 216, in get 'hyperkitty' in self.mailing_list.archivers and File "/usr/lib/python2.7/_abcoll.py", line 388, in __contains__ self[key] File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 151, in __getitem__ return self._get(key) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 90, in _get return self.rest_data[key] File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 76, in rest_data response, content = self._connection.call(self._url) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/connection.py", line 103, in call raise HTTPError(url, response.status, content, response, None) HTTPError: HTTP Error 500: A server error occurred. Please contact the administrator. When I access the Archiving page in Settings, I get these: Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 249, in _legacy_get_response response = self._get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/dist-packages/django/contrib/auth/decorators.py", line 23, in _wrapped_view return view_func(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/auth/decorators.py", line 39, in wrapper return fn(*args, **kwargs) File "/usr/lib/python2.7/dist-packages/postorius/views/list.py", line 719, in list_settings form = form_class(initial=initial_data, mlist=m_list) File "/usr/lib/python2.7/dist-packages/postorius/forms.py", line 303, in __init__ [(key, key) for key in sorted(self._mlist.archivers.keys())]) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 172, in keys return list(self) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 166, in __len__ return len(self.rest_data) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/base.py", line 76, in rest_data response, content = self._connection.call(self._url) File "/usr/lib/python2.7/dist-packages/mailmanclient/restbase/connection.py", line 103, in call raise HTTPError(url, response.status, content, response, None) HTTPError: HTTP Error 500: A server error occurred. Please contact the administrator. Not a python developer, which makes debugging based on the above more difficult. I've seen some other errors posted to this list that highlight specific setting or config issues, but I'm not seeing that in these. Any ideas?

2 5

The email confirming the registration of an account on postorius is not correctly translated in Italian
by Massimo Zappalà 30 Jul '20

30 Jul '20

Hi everyone, thanks to the files.po on Weblate, I have translated all Mailman-Core, Postorius, Hyperkitty and Django_mailman3. I have also translated the confirmation message to subscribe to a list. Everything works, except for this: When I register a new account on postorius, he sends me a confirmation email totally in English, except the following final block which is sent in Italian: in my /usr/lib/python3/dist-packages/allauth/locale/it/LC_MESSAGES/django.po #: templates/account/email/email_confirmation_message.txt:7 #, python-format msgid "" "Thank you from %(site_name)s!\n" "%(site_domain)s" msgstr "" "Grazie da %(site_name)s!\n" "%(site_domain)s" By carefully analyzing the same file .po, I notice that the Italian translation of the whole text already exists. Why does the confirmation email arrive in English? #: templates/account/email/email_confirmation_message.txt:1 #, fuzzy, python-format #| msgid "" #| "User %(user_display)s at %(site_name)s has given this as an email " #| "address.\n" #| "\n" #| "To confirm this is correct, go to %(activate_url)s\n" msgid "" "Hello from %(site_name)s!\n" "\n" "You're receiving this e-mail because user %(user_display)s has given yours " "as an e-mail address to connect their account.\n" "\n" "To confirm this is correct, go to %(activate_url)s\n" msgstr "" "Ciao da %(site_name)s!\n" "\n" "L'Utente %(user_display)s di %(site_name)s ha registrato questo indirizzo e-" "mail.\n" "Per confermare, clicca qui %(activate_url)s\n" Thanks Max

2 2

Change language to welcome message in mailman3
by Massimo Zappalà 30 Jul '20

30 Jul '20

Hi everyone, My Version installed on Debian buster: mailman3: 3.2.1 postorius: 1.2.4 hyperkitty: 1.2.2 All interfaces work well in Italian language, but "Welcome message" is in English. I'm trying to change the language to the "Welcome message" with mailman shell, but it doesn't work sudo mailman shell -l test(a)pratico.work >>>m.preferred_language='it' >>>commit() >>>CTRL-D This is my file /etc/mailman3/mailman-web.py LANGUAGE_CODE = 'it-IT' TIME_ZONE = 'Europe/Rome' USE_I18N = False USE_L10N = True USE_TZ = True Would anyone know how to do it? Thank you Max

2 10

Moderation of held emails vs. spam
by David Krantz 30 Jul '20

30 Jul '20

Hi, I now run Mailman 3.3.1, installed from pip. Is there now any way to prevent Mailman from forwarding the contents of the held message when notifying moderators of held messages? In my case these messages often are spam messages and if the entire contents are forwarded it triggers spam handling in the recipient address(es) which over time risks classifying all moderation emails as spam or even classifying the list domain or server as a spam source. Even my own outgoing filter classifies it as spam, which I will fix. I currently run rspamd for spam filtering, graylisting and DKIM and ARC verification/signing. Someone on this recommended it, thank you for that as it removes the need for other milters. I guess that this would be a simple change to make as a kludge but a proper implementation as a setting would be a lot better. I'd like it as a global setting but that might be too coarse. Cheers // David

2 2

Anyone integrated Single Sign On like Azure SSO with Mailman3?
by Jacob Bargery 29 Jul '20

29 Jul '20

We are looking at whether it is possible to integrate Azure Single Sign On with Mailman3 to streamline use for our users, has anyone had any luck with doing this? If so, how did you go about doing so? Thanks

3 2

mailman2 import not working
by Abhijith PA 29 Jul '20

29 Jul '20

Hello. Recently I migrated a mailman2 mailing list to mailmam3. There was one problem[1] I faced. Currently I am running Debian packaged version (3.2.2-1) which don't have this fix. But it was manually done with this[2] method. Basically this is what I did for migration: ------------------------------------------- mailman create -o <foo(a)example.com> foo-bar(a)lists.example.com mailman import 21 foo-bar(a)lists.example.com path/to/config.pck ------------------------------------------- Then imported archives with ------------------------------------------ python3 manage.py hyperkitty_import --pythonpath /usr/share/mailman3-web --settings settings -l foo-list(a)list.example.com <path to>/foo-list.mbox python3 manage.py update_index_one_list foo-list(a)example.com --pythonpath /usr/share/mailman3-web --settings settings ------------------------------------------ After everything done tried a test mail, but didn't reach any of the inbox though mail is archived. mailman.log says message is accepted ACCEPT: <FEE2E515-C054-41E6-9853-744D3312A137(a)xxxxxx.org> Nothing after this. On smtp.log we have Jul 29 16:11:52 2020 (16161) Peer: ('127.0.0.1', 54792) Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) handling connection Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'LHLO lists.xxxxxxx.in' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'MAIL FROM:<abhijith(a)xxxxxxxxx.org>' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) sender: abhijith(a)xxxxxxx.org Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'RCPT TO:<temptest(a)lists.xxxxxxxxxx.in>' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) recip: temptest(a)lists.xxxxxxxxxx.in Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'DATA' Jul 29 16:11:52 2020 (16161) ('127.0.0.1', 54792) Data: b'QUIT' Please help. Abhijith [1] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… [2] - https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…

2 3