- Mailman-users - lists.mailman3.org

Improve logging?
by Odhiambo Washington Feb. 1, 2023

Feb. 1, 2023

Some entries in the log files can be very scary, while in actual sense they are harmless. Such inconsequential, but scary entiess can mess up the well-being of a SysAdmin. I humbly request for the logs related to posts by non-members to a MM3 list to be improved a little bit :-) Here is the example in mailman.log: <cut> Jan 31 10:03:54 2023 (92481) DISCARD: < 2a1c588a6ccd47abbf57ee5fc61c9946(a)phellineconsultancy.co.ke>; ['The message is not from a list member'] [31/Jan/2023:10:04:48 +0300] "GET /3.1/users/1bad08f703fe4bc0a829f4bdce10fc8f HTTP/1.1" 200 253 "-" "GNU Mailman REST client v3.3.5" [31/Jan/2023:10:04:48 +0300] "GET /3.1/users/1bad08f703fe4bc0a829f4bdce10fc8f/addresses HTTP/1.1" 200 473 "-" "GNU Mailman REST client v3.3.5" Jan 31 10:18:09 2023 (92343) deque: do_confirm_verify Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/app/subscriptions.py", line 476, in _step_send_confirmation raise StopIteration StopIteration </cut> Is there a possibility to change the logging engine to just *fold* the last 7 lines into "The message is not from a list member. It was discarded", or something close? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 4

Fwd: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/search
by Johannes Rohr Feb. 1, 2023

Feb. 1, 2023

Hello everyone! below is a "permission denied" error I get when trying to perform a fulltext search. -------- Weitergeleitete Nachricht -------- Betreff: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/search Datum: Mon, 23 Jan 2023 10:30:14 -0000 Von: johannes(a)rohr.org An: johannes(a)rohr.org Internal Server Error: /archives/search PermissionError at /archives/search [Errno 13] Permission denied: 'fulltext_index' Request Method: GET Request URL: http://lists.*****.org/archives/search?mlist=pinnwand%40lists.*****&q=medit… Django Version: 4.1.5 Python Executable: /opt/mailman/venv/bin/uwsgi Python Version: 3.10.6 Python Path: ['.', '', '/etc/mailman3', '/usr/lib/python310.zip', '/usr/lib/python3.10', '/usr/lib/python3.10/lib-dynload', '/opt/mailman/venv/lib/python3.10/site-packages'] Server time: Mon, 23 Jan 2023 11:30:14 +0100 Installed Applications: ['hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount'] Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback (most recent call last): File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/handlers/exception.py", line 55, in inner response = get_response(request) File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/handlers/base.py", line 197, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/opt/mailman/venv/lib/python3.10/site-packages/hyperkitty/views/search.py", line 88, in search emails = paginate( File "/opt/mailman/venv/lib/python3.10/site-packages/django_mailman3/lib/paginator.py", line 71, in paginate objects = paginator.page(page_num) File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/paginator.py", line 75, in page number = self.validate_number(number) File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/paginator.py", line 53, in validate_number if number > self.num_pages: File "/opt/mailman/venv/lib/python3.10/site-packages/django/utils/functional.py", line 57, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/paginator.py", line 102, in num_pages if self.count == 0 and not self.allow_empty_first_page: File "/opt/mailman/venv/lib/python3.10/site-packages/django/utils/functional.py", line 57, in __get__ res = instance.__dict__[self.name] = self.func(instance) File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/paginator.py", line 96, in count return c() File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/query.py", line 527, in count return len(self) File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/query.py", line 82, in __len__ self._result_count = self.query.get_count() File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/backends/__init__.py", line 658, in get_count self.run() File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/backends/__init__.py", line 593, in run results = self.backend.search(final_query, **search_kwargs) File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/backends/__init__.py", line 32, in wrapper return func(obj, query_string, *args, **kwargs) File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/backends/whoosh_backend.py", line 412, in search self.setup() File "/opt/mailman/venv/lib/python3.10/site-packages/haystack/backends/whoosh_backend.py", line 133, in setup os.makedirs(self.path) File "/usr/lib/python3.10/os.py", line 225, in makedirs mkdir(name, mode) Exception Type: PermissionError at /archives/search Exception Value: [Errno 13] Permission denied: 'fulltext_index' Raised during: hyperkitty.views.search.search I don't understand what the cause for the "permission denied" could be. The directory "fulltext_index" is owned by mailman:mailman Does anyone have a hint? I did some googling for the error, but to no avail, unfortunately. Thanks! Johannes

4 19

No option 'postmap_command' in section: 'postfix'
by Odhiambo Washington Feb. 1, 2023

Feb. 1, 2023

The documentation <https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h…> says that I need to create /path/to/postfix-mailman.cfg containing: [postfix] transport_file_type: regex Then append the path to the [mta] section of mailman.cfg, viz: [mta]incoming: mailman.mta.postfix.LMTPoutgoing: mailman.mta.deliver.deliverlmtp_host: mail.example.comlmtp_port: 8024smtp_host: mail.example.comsmtp_port: 25configuration: /path/to/postfix-mailman.cfg That is exactly what I have done on my test platform, but I get the error below when creating a list. Perhaps I overlooked something? (venv) lists% mailman create mylist(a)lists.wash.lan Traceback (most recent call last): File "/usr/local/lib/python3.9/configparser.py", line 789, in get value = d[option] File "/usr/local/lib/python3.9/collections/__init__.py", line 941, in __getitem__ return self.__missing__(key) # support subclasses that define __missing__ File "/usr/local/lib/python3.9/collections/__init__.py", line 933, in __missing__ raise KeyError(key) KeyError: 'postmap_command' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/venv/bin/mailman", line 33, in <module> sys.exit(load_entry_point('mailman==3.3.8', 'console_scripts', 'mailman')()) File "/opt/mailman/venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__ return self.main(*args, **kwargs) File "/opt/mailman/venv/lib/python3.9/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) File "/opt/mailman/venv/lib/python3.9/site-packages/mailman/bin/mailman.py", line 69, in invoke return super().invoke(ctx) File "/opt/mailman/venv/lib/python3.9/site-packages/click/core.py", line 1657, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/opt/mailman/venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, **ctx.params) File "/opt/mailman/venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke return __callback(*args, **kwargs) File "/opt/mailman/venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, **kwargs) File "/opt/mailman/venv/lib/python3.9/site-packages/mailman/commands/cli_lists.py", line 188, in create mlist = create_list(fqdn_listname, owners) File "/opt/mailman/venv/lib/python3.9/site-packages/mailman/app/lifecycle.py", line 102, in create_list call_name(config.mta.incoming).create(mlist) File "/opt/mailman/venv/lib/python3.9/site-packages/mailman/utilities/modules.py", line 70, in call_name return named_callable(*args, **kws) File "/opt/mailman/venv/lib/python3.9/site-packages/mailman/mta/postfix.py", line 87, in __init__ self.postmap_command = mta_config.get('postfix', 'postmap_command') File "/usr/local/lib/python3.9/configparser.py", line 792, in get raise NoOptionError(option, section) configparser.NoOptionError: No option 'postmap_command' in section: 'postfix' -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 7

MM3 to MM3 migration
by David Newman Feb. 1, 2023

Feb. 1, 2023

I’m looking to migrate several mailing lists from one server running MM3/Django/Hyperkitty to another. Same operating system and python environment and venvs for both. Although the canonical hostnames for the two servers will differ, I can use the same hostnames for lists once I’ve got everything set up. Is this really as simple as building the new server, creating the same lists on the new server, and rsync’ing the archives from the old server? If not, how to do the migration? I checked the archives and saw many threads on MM2 -> MM3, but did not see anything on MM3 migration. Thanks in advance. dn

3 4

Must every Moderator/Admin be member of a list to be able to use Postorius?
by mm3-omf＠sh.werbittewas.de Jan. 31, 2023

Jan. 31, 2023

we're using debian/devuan with distribution-mailman3 and tried to add admin/mod for a list, but if logging in as this user, there's no item to manage the list at all. do we have to add this user as member of this list? (that wouldn't be nice, because the user doesn't want to get normal Mails from List, but only admin-Mails) regards omf

2 1

Language switch
by Massimiliano Paragnani Jan. 30, 2023

Jan. 30, 2023

Hi, I can't set other languages in MM3 web. I did it https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/model/docs… I tried to add language cose in settings_local.py and in mailman.cfg but nothing happens How can I do?

2 1

New Installation of MM3 is not archiving
by Onyeibo Oku Jan. 30, 2023

Jan. 30, 2023

Greetings, I finally completed installation of Mailman 3 following the instructions here: https://docs.mailman3.org/en/latest/install/virtualenv.html#initial-configu… I got a lot of support from this mailing-list too and I am mighty grateful for that. My new MM3 instance does not seem to be archiving. List subscribers are currently sending and receiving mails on their subscribed lists. However, none of the correspondence is showing up at https://mailing-list-site.tld/archives/. That page shows a listing of the active mailing-lists with '0 participants' and '0 discussions'. Whereas, those lists contain mails. How do I troubleshoot this?

2 1

About to Install MM3 -- Seeking clarification
by Onyeibo Oku Jan. 30, 2023

Jan. 30, 2023

Good Morning Everyone, I installed and managed mailman 2 for about two years. I am now ready to try Mailman 3. The documentation for version 2 was lucid and this forum was quite helpful in the past. Now I'd like to proceed with installating MM3 but I doubt my understanding of the docs. It seems to assume that users will know what to do. Okay, don't laugh! I just want to be sure what I am doing. Does the following sequence resemble the proper steps? 1. Download the source from a git repo (I understood that one) 2. Create a virtual environment (venv perhaps ... not stated explicitly) 3. activate the virtual environment 4. from the git project root, run: ./mailman start I know, its stupid. I had to ask. It would really build my confidence someone would confirm the above steps or counter then with something very explicit. What about process ownership? Do I need to have a unix mailman user? What else do I need to get mailman up and running before proceeding to configuration. Ahaa! I perused the config docs a bit. Where can I find the .cfg file? I hope these questions are not too annoying. Regards Onyeibo

6 46

long time user of mailman 2, new to docker-mailman and docker
by pjbondi＠systemdatabase.com Jan. 29, 2023

Jan. 29, 2023

Hello to all: I'm getting this stack trace with the following redacted settings. # ALLOWED_HOSTS * # DEBUG True # HYPERKITTY_API_KEY llllllllllllllllllllllllllllllllllllllllllllllllll # MAILMAN_ADMIN_EMAIL xxxxxxx(a)yyyyyyyyyyyyyy.com # MAILMAN_HOSTNAME mailman-web # MM_HOSTNAME yyyyyyyyyyyyyy.ca # MTA postfix # SECRET_KEY kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk # SERVE_FROM_DOMAIN yyyyyyyyyyyyyy.ca # SMTP_HOST smtp-relay.sendinblue.com # SMTP_HOST_PASSWORD pppppppppppppppp # SMTP_HOST_USER xxxxxxx(a)yyyyyyyyyyyyyy.com # SMTP_PORT 587 # SMTP_USE_TLS True # [very long startup snipped] Applying postorius.0001_initial... OK Applying postorius.0002_auto_20160210_0721... OK Applying postorius.0003_drop_addressconfirmationprofile... OK Applying postorius.0004_create_email_template... OK Applying postorius.0005_auto_20180707_1107... OK Applying postorius.0006_auto_20180711_1359... OK Applying postorius.0007_auto_20180712_0536... OK Applying postorius.0008_auto_20190310_0717... OK Applying postorius.0009_auto_20190508_1604... OK Applying postorius.0010_auto_20190821_0621... OK Applying postorius.0011_auto_20191109_1219... OK Applying postorius.0012_auto_20200420_2136... OK Applying postorius.0013_auto_20201116_0058... OK Applying sessions.0001_initial... OK Applying sites.0002_alter_domain_unique... OK Setting systemdatabase.ca as the default domain ... Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3.8/site-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) sqlite3.OperationalError: no such table: django_site The above exception was the direct cause of the following exception: Traceback (most recent call last): File "manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/lib/python3.8/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/usr/lib/python3.8/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/lib/python3.8/site-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/usr/lib/python3.8/site-packages/django/core/management/base.py", line 364, in execute output = self.handle(*args, **options) File "/usr/lib/python3.8/site-packages/django/core/management/commands/shell.py", line 86, in handle exec(options['command']) File "<string>", line 1, in <module> File "/usr/lib/python3.8/site-packages/django/db/models/query.py", line 741, in update rows = query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1471, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1142, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3.8/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3.8/site-packages/django/db/backends/sqlite3/base.py", line 383, in execute return Database.Cursor.execute(self, query, params) django.db.utils.OperationalError: no such table: django_site

1 0

Re: Fwd: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/search
by Dave Hall Jan. 29, 2023

Jan. 29, 2023

Hello, Please pardon a slightly off-topic comment, but I would like to highlight a part of Odhiambo's post. Heavily nested inline replies also reflect the issue I wish to comment on, so I'm not going to. Granted, I am a slow learner, and perhaps already so mixed up after reading > the myriad HOWTOs for > installing MM3 that are available online. I am tempted to say there are > many like me who are likely to > miss "where to obtain" other settings from. and > Is it possible to modify the documentation to somehow make it obvious (in a > language that a layman can easily understand, I have seen this with several open source projects lately. There's no big picture, just 'hundreds' of cross-linked little bits of disjointed information that almost seem like documentation for individual modules. I once joined a large commercial project for a major US computer company (sorry, I won't share details). They were quite proud of their extensive documentation. The docs for their equivalent of the kernel syscall interface, when printed (two-sided) and stacked, would easily approach 2 meters tall. Yet, every bit of it was incomprehensible unless and until you called the developer and had them explain it to you. The problem that we all have, us humans, is that when we are very familiar with something, like the code we've been working on, it is very hard to describe its purpose to somebody who knows nothing about it. ("It's obvious to me, so it should be obvious to you."). So, a challenge for us all: When writing and reviewing your documentation, imagine that you're explaining your whole project face-to-face to your grandmother, or to anybody who never learned to program. From experience I promise that it's easy once you get the hang of it. Thank you and sorry for the speech. -Dave -- Dave Hall Binghamton University On Sat, Jan 28, 2023 at 2:54 AM Odhiambo Washington <odhiambo(a)gmail.com> wrote: > On Fri, Jan 27, 2023 at 9:34 PM Mark Sapiro <mark(a)msapiro.net> wrote: > > > On 1/27/23 05:53, Odhiambo Washington wrote: > > > On Mon, Jan 23, 2023 at 11:48 PM Mark Sapiro <mark(a)msapiro.net> wrote: > > >> > > >> Note that when following > > >> https://docs.mailman3.org/en/latest/install/virtualenv.html you > create > > >> /etc/mailman3/settings.py and it contains > > >> ``` > > >> from mailman_web.settings.base import * > > >> from mailman_web.settings.mailman import * > > >> ``` > > >> to establish a base set of settings that can be augmented or > overridden > > >> in /etc/mailman3/settings.py. mailman_web.settings.mailman in turn > > contains > > >> ``` > > >> HAYSTACK_CONNECTIONS = { > > >> 'default': { > > >> 'ENGINE': 'haystack.backends.whoosh_backend.WhooshEngine', > > >> 'PATH': "fulltext_index", > > >> ``` > > >> which is a relative path for fulltext_index and may need to be set to > an > > >> absolute path. > > >> > > > > > > Mi Mark, > > > > > > I have read this page - > > > https://docs.mailman3.org/en/latest/install/virtualenv.html and > further > > - > > > > > > https://docs.mailman3.org/en/latest/install/virtualenv.html#initial-config > > > - without clicking any external links. > > > I still don't see the HAYSTACK_CONNECTIONS in the settings.py included > > on > > > that page. > > > I am missing something obvious, no? > > > > > > Please reread what I wrote above. HAYSTACK_CONNECTIONS is not in the > > suggested settings.py but it is in mailman_web.settings.mailman and is > > imported by the suggested settings.py. > > > I have reread what you wrote now and I'm beginning to get the hang of this > method. > My observation is that it can only be _obvious_ to someone very familiar > with Python config > to decipher that *additional* settings *that can be augmented or > overridden > in /etc/mailman3/settings.py* can be obtained from: > /PATH-TO/mailman_web/settings/{base|mailman}.py after they have noticed > these two lines in > the sample settings given in /etc/mailman3/settings.py: > > from mailman_web.settings.base import *from > mailman_web.settings.mailman import * > > [At first instance, it is not obvious that mailman_web.settings.base and > mailman_web.settings.mailman are > actually paths in Python - which magically translates to > mailman_web/settings/base.py and mailman_web/settings/mailman.py] > Granted, I am a slow learner, and perhaps already so mixed up after reading > the myriad HOWTOs for > installing MM3 that are available online. I am tempted to say there are > many like me who are likely to > miss "where to obtain" other settings from. > For example, my mind all along has been tuned to having a settings_local.py > for overriding the settings.py. > However, with this particular documentation, it would appear that > everything is intended to just go into /etc/mailman3/settings.py. > > Is it possible to modify the documentation to somehow make it obvious (in a > language that a layman can easily understand, > that those two "import *" _DO establish a base set of settings that can be > augmented or overridden in /etc/mailman3/settings.py_ > and that those settings are in what file(s) ? > > I am not saying @Johannes Rohr <johannes(a)rohr.org> is a layman like me, > but > I think that is what hit him. > > > -- > Best regards, > Odhiambo WASHINGTON, > Nairobi,KE > +254 7 3200 0004/+254 7 2274 3223 > "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to kdhall(a)binghamton.edu >

2 1

EMWD/Affinity/Empathy in 2023
by jaboyib556＠v3dev.com Jan. 29, 2023

Jan. 29, 2023

Hi all, We're exploring Mailman 3 and the custom interfaces provided by EMWD's Affinity and Empathy look very interesting: https://www.mailmanhost.com/affinity-mailman/ However, I saw reports of EMWD being a one-man show and the owner sadly passing away in 2021; but I've also seen threads here referring to the Affinity and Empathy projects in 2022. It wasn't clear to me if EMWD is still an active business and Affinity and Empathy are still active offerings. Does anyone here have any direct contact/relationship/experience with EMWD/Affinity/Empathy following the owner's passing? Or knowledge of any other offerings publicly available today that are similar to Affinity/Empathy? Thanks!

3 3

Can't see held messages
by Massimiliano Paragnani Jan. 27, 2023

Jan. 27, 2023

Hi everybody, I've a new installation in my own vps. Everything works if I set "Deliver immediately" but if I turn on the "hold for moderation" I can't see the mails in web interface and I can't confirm the delivery or discard. What information do you need to help me?

1 1

MM attaches mime-attachments to mail as text file since update to 3.3.8
by Stefan Bauer Jan. 25, 2023

Jan. 25, 2023

Dear Users & Developers, we're running MM3 on Ubuntu 22 and used the venv-installation method. Last week we updated via¹ to Mailman Core-Version GNU Mailman 3.3.8 (Tom Sawyer) Mailman Core API-Version 3.1 Mailman Core Python-Version 3.10.6 (main, Nov 14 2022, 16:10:14) [GCC 11.3.0] and now mailman attaches mime-attachments to email as text-files. That breaks many mails in our environment. For example: Now we have attachments like smime.p7s + ATT000001.txt as well as what looks like MM footers "mailing list --- test@domain ... To unsubscripbe send an email to ..." How can we get the "old" processing back? Thank you alot. Stefan

3 5

Localisation of web interface gone after OS upgrade
by Johannes Rohr Jan. 20, 2023

Jan. 20, 2023

Dear all, I just upgraded our server from Ubuntu 20.04 to 22.04. Mailman is installed in virtualenv, so it shouldn't be affected by the upgrade. Am I right about that? However, the strange thing is that most, albeit not all of the localisation is gone, the web interface is now mostly in English. Still, I reinstalled venv, mailman and hyperkitty, but no change. I also re-ran the four commands * mailman-web migrate * mailman-web collectstatic * mailman-web compress * mailman-web compilemessages just to be sure, but that didn't change things either. Is there something in Ubuntu 22.04 that kills the localisation? Thanks! Johannes

1 1

Updated script for checking and fixing mbox files.
by Mark Sapiro Jan. 20, 2023

Jan. 20, 2023

Mailman 2.1 has a cleanarch script for checking mbox files for unescaped `From `lines in message bodies and optionally fixing them. For some time, there has been a stand-alone python3 version of this script at https://www.msapiro.net/scripts/cleanarch3 (mirrored at https://fog.ccsf.edu/~msapiro/scripts/cleanarch3) I have just updated this script to check and optionally fix bad Date: headers. I have also added it at https://gitlab.com/mailman/hyperkitty/-/blob/master/hyperkitty/contrib/clea… for the next release. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 3

Using it with the "smtp2go" email relay service that has special deliverability rules
by golden_rock＠hotmail.com Jan. 19, 2023

Jan. 19, 2023

Hi, Smtp2Go relay service enforces a few rules for deliverability: The From: address domain has to be verified in smtp2go The sender envelope address also has to be verified in smtp2go So emails sent by mailman don't get relayed because mailman sets From: to be the original sender of the message, and it means anyone that wants to send to the list would have to approve themselves with smtp2go first, which is not workable. To make it work, I would have to have something like: Sender: bounce-address(a)lists.mailman3.org - untouched From: original.sender@gmail.com@lists.mailman3.org - change #1 having the From address to be From the list Reply-To: original.sender(a)gmail.com - change #2 - if someone replies Then smtp2go will send the email. I looked in the settings and I didn't find a readily available option to do that. I'm new to customizing mailman3 , but have been using it in production for a little more than 1 year. I've seen other software do the solution proposed above, namely DIvi contact forms set the "From" to be something @website.com and the Reply-To: as the form submitter. I am told that the standards is moving away from forging the DATA From: that doesn't have a predictable domain, and instead put the variable email address in Reply-To, for things like contact forms or automated sending. Can someone guide me on where I could start looking?

2 1

Permission Error with /var
by Tibor Molnar Jan. 19, 2023

Jan. 19, 2023

Hi guys, During the build of mailman3 I run in to few permission errors but there is one I have got stuck with, and you may be able to help me with this. I'm following this guide https://wiki.list.org/DOC/Howto_Install_Mailman3_On_Debian10. var_dir: /opt/mailman/mm/var configs: /opt/mailman/mm OS: Debian 10 I'm using virtual env When try start mailman core PermissionError: [Errno 13] Permission denied: '//var/templates' total 48 drwxrwxrwx 12 mailman mailman 4096 Jan 17 11:28 . drwxr-xr-x 7 mailman mailman 4096 Jan 17 17:19 .. drwxr-xr-x 2 mailman mailman 4096 Jan 17 11:10 archives drwxr-xr-x 2 mailman mailman 4096 Jan 17 11:10 cache drwxr-xr-x 2 mailman mailman 4096 Jan 17 11:10 data drwxr-xr-x 2 mailman mailman 4096 Jan 17 11:28 etc drwxr-xr-x 2 mailman mailman 4096 Jan 17 11:10 lists drwxr-xr-x 2 mailman mailman 4096 Jan 17 15:54 locks drwxr-xr-x 2 mailman mailman 4096 Jan 17 14:19 logs drwxr-xr-x 2 mailman mailman 4096 Jan 17 11:10 messages drwxr-xr-x 14 mailman mailman 4096 Jan 17 11:10 queue drwxr-xr-x 2 mailman mailman 4096 Jan 17 16:07 templates all owned by mailman. what are hey suppose to be owned by if not mailman? Regards, Tibor

3 4

hello， Discussion on how to subscribe to the mailing list
by 朱超 Jan. 18, 2023

Jan. 18, 2023

Hi, When I subscribe the email list in Subscription Policy is confirm, Some problems happen in here： 1.Some mail mua reject send the confirm the message, because the length of recipient is too long. for exmaple: requirements-confirm+9605556e0b35a5da280c1de0d34a3e6f770f8ea5@domain, and the mail mua reject to modify about this. 2.It is inconvenient for users to use. Many people will mistakenly think that after clicking the subscribe button, it will be successful, and they will not process the email. Regarding the discussion on the subscription method of the mailing list, should we consider optimizing the subscription method of the mailing list, for example: 1. use the method of sending a verification code to subscribe by email，When you receive the verification code sent by the mailing list and fill it in again, you can subscribe successfully。 2. use the email to send a connection to confirm the subscription，People click the link to be redirected to a confirmation page to subscribe to the email。

4 12

mailman-web causing constant 100% cpu load of mysqld
by Johannes Rohr Jan. 16, 2023

Jan. 16, 2023

Dear all, with mailmanweb running, the CPU load of mysqld constantly hovers around 100% In /var/log/mysql/errors.log I see repeatedly: 2023-01-13 17:22:42 27198 [Warning] Aborted connection 27198 to db: 'mailman_core' user: 'mailman' host: 'localhost' (Got an error reading communication packets) 2023-01-13 17:27:43 29621 [Warning] Aborted connection 29621 to db: 'mailman_core' user: 'mailman' host: 'localhost' (Got an error reading communication packets) This also seems to affect other services such as dovecot which rely on mysql and at times can't connect to it. Does anyone have a suggestion what to do about this? Cheers, Johannes

2 1

Error Logging - what changed with the New Year releases?
by Odhiambo Washington Jan. 15, 2023

Jan. 15, 2023

Apart from all the defaults in settings.py (derived from gitlab), I also have this line: LOGGING['handlers']['file']['filename'] = '/opt/mailman/mm/var/logs/mailmanweb.log' Before the New Year releases of MM3, I used to get errors written to this file. Not anymore after I updated to the New Year releases. Another thing that I have realized is that prior to the New Year releases, I would get an error logged to that file and also mailed to me. I don't think that I have changed anything in settings,py related to logging. I have been trying to get signup with Twitter working. This used to generate an error that was both logged and emailed, but that isn't happening anymore. I have enabled other social auth providers (in settings.py) which I haven't configured in the admin panel. I expect that tying to use these on Postorius would generate an error that is logged and mailed to admin, but that too is not happening. Just checking out what might have changed - or if I am going nuts :-) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 5

Moderation request reminders
by Allan Hansen Jan. 14, 2023

Jan. 14, 2023

Hi all, I and my moderators are getting daily moderation request reminders. Is there a way to set them to be weekly instead? I looked around in the UI for it but did not see it. It started with my latest server upgrade. As list owner I get 50+ of these messages every morning and my modertors each get only one, but don't like it. I still don't see a link for my moderators to see the membership lists even though the lists are set to allow it. Is that among the planned bug fixes? Yours, Allan

2 1

Cross-List and Domain based sender whitelisting ( accept_these_nonmembers )
by Patrick Brückner Jan. 13, 2023

Jan. 13, 2023

Hi everyone, one of our servers that was running a mailman2 instance just crashed this afternoon, so we decided to take the leap and migrate to 3, and I have to say it worked pretty well, the lists seem to be back. What I can't seem to find is the option to whitelist senders based on a domain AND on membership on a different list. The lists are operated for a smallish university and all the professors need to be allowed to send to the students list, without being member of that list. That was possible with mailman2 by just whitelisting the university domain. Also, in the past we allowed all members of the all-students list to post to any of the dorm-lists (this is mainly used for party announcements so it is not a must have), but I wanted to ask anyways, if there was a chance to allow this feature again. According to the docs, the accept_these_nonmembers option exists (https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/…) but none of my lists have that set after the migration - the field is not even there when accessing the REST API. Do I need to enable something? Has that feature been added just recently, and we are missing out (since we are using the apt packages from ubuntu)? Thanks in advance, Patrick

4 7

About the sender of the mailing list receiving an auto-reply email
by 朱超 Jan. 13, 2023

Jan. 13, 2023

Hi, When I use the mailing list to send emails, I receive an automatic reply email, Is there a better way to block similar automatic reply emails? From: Tom

2 1

Error from - /opt/mailman/mm/bin/django-admin runjobs hourly
by Odhiambo Washington Jan. 12, 2023

Jan. 12, 2023

I have received the following error message from the hourly cron run: <quote> /opt/mailman/mm/bin/django-admin: line 7: 7475 Killed django-admin $@ </quote> I have looked at my log files, but could not find any clue. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 1

mailman.log file owned by 'list' user
by Mike Wertheim Jan. 12, 2023

Jan. 12, 2023

I'm on Debian 11, trying to troubleshoot an installation of Mailman 3.3.3 that was done by someone else. Mailman is running as a non-privileged (non-root) user called 'xyz'. On the day that Mailman was installed, that non-privileged 'xyz' user was able to execute mailman commands successfully to create, view and modify lists. A couple of days later, when the 'xyz' user tried running those same mailman commands, they failed with this error: PermissionError: [Errno 13] Permission denied: '/var/log/mailman3/mailman.log' Doing "ls -l" on the file /var/log/mailman3/mailman.log showed this: -rw-r----- 1 list list 0 Jan 6 00:00 /var/log/mailman3/mailman.log When I did a 'ps' command, I saw that all of the mailman processes are running as user 'xyz'. No processes were running as the user 'list'. It seems that some process is rotating the mailman.log file at midnight, and the newly-created mailman.log is being owned by user 'list'. Can anyone explain why this is happening, and how to fix it?

4 3

Re: Docker or virtualenv?
by J.Schulz Jan. 10, 2023

Jan. 10, 2023

For Docker: just use the README on https://github.com/maxking/docker-mailman ; this should be enough for a basic setup. Eventually, you'll need to add some things to core/mailman-extra.cfg : ___ [mailman] site_owner: help(a)elternserver.de SMTP_MAX_RCPTS = 1 VERP_CONFIRMATIONS = Yes VERP_PASSWORD_REMINDERS = Yes VERP_PERSONALIZED_DELIVERIES = Yes VERP_DELIVERY_INTERVAL = 1 # [devmode] # enabled: yes # recipient: you(a)somewhere.com # # extra local settings for mailmen [mta] # NullMTA is just implementing the interface and thus satisfying Mailman # without doing anything fancy # outgoing: mailman.mta.null.NullMTA smtp_user: your_auth@your_MTA smtp_pass: supersecretpassword smtp_verify_hostname: yesorno smtp_secure_mode: starttls # or whatever # [logging.debug] [logging.smtp] level: warn ___ also, web/settings_local.py needs tweaking in some cases; the DJANGO_ALLOWED_HOSTS come from my docker-compose.yml ---- import os # see https://github.com/maxking/docker-mailman/issues/548 django_allowed_hosts = os.environ.get('DJANGO_ALLOWED_HOSTS') if django_allowed_hosts: ALLOWED_HOSTS = django_allowed_hosts.split(':') MAILMAN_WEB_SOCIAL_AUTH = [] SOCIALACCOUNT_PROVIDERS = { } DEBUG = False # see https://gitlab.com/mailman/mailman/-/issues/957 DEFAULT_AUTO_FIELD='django.db.models.AutoField' HAYSTACK_CONNECTIONS = { 'default': { 'ENGINE': 'xapian_backend.XapianEngine', 'PATH': "/opt/mailman-web-data/fulltext_index", }, } ----- Am 10.01.23 um 09:11 schrieb Odhiambo Washington: > Hi Jörg, > > Kindly share the link to the HOWTO, which you use to setup everything. > I just need to test. Perhaps I can use docker on Windows, no? > > On Mon, Jan 9, 2023 at 8:58 PM Jörg Schulz <info(a)joergschulz.de> wrote: > > I have a successful installation using docker, just updated to the > most > recent version - it runs along quite some other docker containers, so > there is a benefit when I want to switch machines. > > Am 07.01.23 um 12:02 schrieb Odhiambo Washington: > > On Sat, Jan 7, 2023 at 1:54 PM Johannes Rohr <johannes(a)rohr.org> > wrote: > > > >> I wanted to say "I have now chosen virtualenv". Sorry for the > confusion. > >> > > I have never tried docker, but soon I will. Just for the kicks. > > > > > > > > -- > Best regards, > Odhiambo WASHINGTON, > Nairobi,KE > +254 7 3200 0004/+254 7 2274 3223 > "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

1 0

SPF check fails for lists subdomain
by Jan Eden Jan. 9, 2023

Jan. 9, 2023

Hi, my question is not related to Mailman directly, apologies for using this list. I configured the DNS records for my base domain and my lists subdomain identically (the DMARC policy records are also identical, but not listed here): MX @ mail.eden.one TXT @ "v=spf1 mx ~all" MX lists mail.eden.one TXT lists "v=spf1 mx ~all" A mail 123.123.123.123 But both Yahoo and Google report different SPF results for the two domains: <policy_published> <domain>eden.one</domain> <adkim>s</adkim> <aspf>s</aspf> <p>quarantine</p> <pct>75</pct> </policy_published> <record> <row> <source_ip>123.123.123.123</source_ip> <count>3</count> <policy_evaluated> <disposition>none</disposition> <dkim>pass</dkim> <spf>pass</spf> </policy_evaluated> </row> <policy_published> <domain>lists.eden.one</domain> <adkim>s</adkim> <aspf>s</aspf> <p>quarantine</p> <pct>75</pct> </policy_published> <record> <row> <source_ip>123.123.123.123</source_ip> <count>2</count> <policy_evaluated> <disposition>none</disposition> <dkim>pass</dkim> <spf>fail</spf> </policy_evaluated> </row> What could possibly cause this difference? The SPF test also fails for a different base domain with the same MX and SPF records. - Jan

3 8

Out there plugin idea for tech cost sponsorship
by Steven Clift EDem Jan. 8, 2023

Jan. 8, 2023

After spending 20 years running a non-profit that hosted email lists for local communities as my day job, that's now all volunteer as I run a startup. Figuring out how to raise money to cover server costs without selling out our members with targeted social media advertising, was a continuous challenge. Anyway, today I am still involved in efforts to route around digital ad behemoths, but I a trying to help small businesses and shop for good brands gain new customers. So here is the question - do you think a Mailman add-on/plugin/module/whatever you'd call it that allowed list admins to reward their new subscribers to email lists with custom themed "for good" discounts would be of interest to many??? Normally, we (GoodCarts) reward people post-checkout with discounts in reciprocity powered circles of online stores. Stores essentially grow together by sharing customers instead of bidding against each other. The way I could see working with email list providers is basically adding an affiliate marketing style commission where purchases with post-subscription rewards would go to the partner based on results. When we go from hundreds of brand members to thousands and add in a "buy local" or brands by theme/values/impact, in theory my non-profits local online community forums could mission align by offering discounts to locally owned businesses. Our view is that exclusive discounts as rewards post transaction (purchase, email list subscription, volunteer sign-up, event registration, online petition signature, etc.) is far better than plastering ads everywhere. Anyway, I'd be curious if you think idea might have legs with Mailman list hosts/admins??? Nothing urgent, just a Saturday morning think different idea. Steven Clift

2 1

Footer broken after migration. Where can I fix it?
by Johannes Rohr Jan. 7, 2023

Jan. 7, 2023

Dear all, after importing the lists from mailman2, almost everything works great, but the footer templates appear broken. Mails sent out contain the line %(web_page_url)slistinfo/%(_internal_name)s So clearly the old templates are not getting explanded. However, when I look in the web interface unter "templates", there is nothing there. Where are these legacy footers stored? In the DB, the table "postorius_emailtemplate" is empty. Thanks! Johannes

2 2

Docker or virtualenv?
by Johannes Rohr Jan. 7, 2023

Jan. 7, 2023

Dear all, I have noticed that Ubuntu's current LTS no longer contains packages for mailman2 and its mailman3 packages are incomplete. So, prior to upgrading the server, I will have to migrate from mailman2 / distro packages to mailman3 installed either in virtualenv or docker. I have got zero experience with virtualenv and some experience with Docker. Overall, the docker method looks easier. Is docker the default method by now? Thanks! Johannes

7 13

virtual_alias_domains
by Johannes Rohr Jan. 6, 2023

Jan. 6, 2023

Dear all, I have to set up mailman3 in an environment where postfix uses virtual alias domains. This is described in https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… I don't understand, though, what I need to do to have mailman generate $PREFIX/var/data/postfix_vmap I have tried to follow the instructions at https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/model/docs… with the purpose of setting an alias domain. However, things go sideways quickly: >>> from mailman.interfaces.domain import IDomainManager >>> from zope.component import getUtility >>> manager = getUtility(IDomainManager) Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/opt/mailman/venv/lib/python3.8/site-packages/zope/component/_api.py", line 165, in getUtility raise ComponentLookupError(interface, name) zope.interface.interfaces.ComponentLookupError: (<InterfaceClass mailman.interfaces.domain.IDomainManager>, '') >>> So, something is missing. But, being a complete python layman, I do not know what and how I fix it. Can someone give me a headsup? That would be greatly appreciated! Johannes

1 1

hyperkitty installation: Unclear instructions
by Johannes Rohr Jan. 6, 2023

Jan. 6, 2023

Dear all, I just installed mailman and mailman3-web in virtualenv as described in https://docs.mailman3.org/en/latest/install/virtualenv.html Next I moved on to set up hyperkitty as described in https://docs.mailman3.org/projects/hyperkitty/en/latest/install.html. I got confused by the instructions: "Install the code Install the HyperKitty package and its dependencies with the following commands: sudo python setup.py install" Obviously this is a python script in a package that has to be downloaded from somewhere. Why? Doesn't the command pip install mailman-web mailman-hyperkitty already do the job? Apparently, there is a second way of installing hyperkitty, using virtualenv, where you have to check out the code from gitlab and install from there. However, this still doesn't look right, as hyperkitty apparently can also be installed through pip install hyperkitty But then, hyperkitty seems to be already have been pulled in by mailman-web, looking at its dependencies. If that's the case, then neither the instructions at https://docs.mailman3.org/projects/hyperkitty/en/latest/install.html nor those at https://docs.mailman3.org/projects/hyperkitty/en/latest/development.html are correct. Can someone enlighten me on what the canonical way is of installing and setting it up in virtualenv? Thanks a lot in advance! Johannes

2 6

Re: Configure MM3 with separate IMAP Mailserver
by Clemens Leider Jan. 2, 2023

Jan. 2, 2023

Hi Mark, much appreciated! This is for sending messages, right? How about the recieving part…I read different things around that i need multiple mailboxes created, postfix installed, relays, ASMTPDirect etc…can you guide me a bit here, please? I havent found that one instruction that would solve this for me until now. Would just like to avoid to have to administer my own mailserver locally, if i have a perfectly configured one with my provider. CL

2 1

Extracting mailing list users
by Jan Eden Jan. 2, 2023

Jan. 2, 2023

Hi, I would like to export users of my mailing lists including their full name (if present). The export button in Postorius creates a CSV with addresses only, and the tool bin/list_members mentioned in the [Mailman 2 FAQ] does not seem to be available in Mailman 3. I have full access to the server/database, so scraping the web interface with [Mark's script] seems unneccessary. Is there an SQL statement (or an equivalent of bin/list_members) to extract the data? Thanks, Jan [Mailman 2 FAQ]: https://wiki.list.org/DOC/How%20do%20I%20extract%20%28export%29%20a%20list%… [Mark's script]: https://www.msapiro.net/scripts/mailman-subscribers3.py

6 19

Configure MM3 with separate IMAP Mailserver
by clemens.leider＠gmail.com Jan. 2, 2023

Jan. 2, 2023

Dear all, we have managed to setup MM3 following the docker Installation concept/Tutorial. So far so good. However now i am struggeling with connecting to MTA. We are using imap server of our hosting provider.how to integrate that properly? Google was not too much of help unfortunately…looking for some tutorial or howto/step by step if possible. Thanks in advance CL

2 1

Web UI setup
by Lars Bjørndal Dec. 31, 2022

Dec. 31, 2022

Thanks a lot for all your valuable help! I've followed the guide at <https://docs.mailman3.org/en/latest/install/virtualenv.html> I need to run mailman 2 and mailman 3 in parallel until I've migrated all lists, on several domains. I created the file /etc/httpd/conf.d/mailman3.conf with the content <VirtualHost *:80> ErrorLog logs/mailman3-error_log CustomLog logs/mailman3-access_log common RewriteEngine on RewriteCond %{HTTPS} off [NC] RewriteRule ^/mailman3(/.*) https://%{HTTP_HOST}/mailman3$1 [L,R=permanent] </VirtualHost> <VirtualHost *:443> ErrorLog logs/mailman3-error_log CustomLog logs/mailman3-access_log common include conf.d/certref.inc SSLEngine on </VirtualHost> <location /mailman3> ProxyPass http://localhost:8000 </location> The idea is to prepare mailman3 for several virtual domains. When I connect to lamasti.net/mailman3, the title is example.com. How can I change that? Thanks Lars

2 1

Apache
by Lars Bjørndal Dec. 31, 2022

Dec. 31, 2022

I have already Apache installed and running for mailman2 and other resources. How do I serve mailman3 from Apache for the respective domains? Thanks in advance Lars

3 3

Early release of mailman 3.3.8 possible?
by Torge Riedel Dec. 31, 2022

Dec. 31, 2022

Dear list / devs, is it possible to release 3.3.8 early? As far as I can see it is a prereq for my planned upgrade of the server from Ubuntu LTS 20.04 to Ubunto LTS 22.04. I use MySQL in my setup (own installation in venv), so my installation is affected by #1044, which is closed in 3.3.8 Also Ubuntu LTS 22.04 comes with Python 3.10 (https://packages.ubuntu.com/search?suite=jammy&keywords=python3) where the support is also stated earliest for 3.3.8 (https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS.…) Am I right with my findings? I planned to upgrade the server until end of this year, because there is less traffic in the last days of a year. But I think unless 3.3.8 is not released, I cannot update the server. Kind regards Torge

4 5

MM2 -> MM3 Migration
by Odhiambo Washington Dec. 31, 2022

Dec. 31, 2022

I looked at my list archives and saw that the latest post was on Dec 8, 2022. Then, because I wanted to import any posts that happened from 8th to now(), I looked at two posts: 1. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… This talks about 'hyperkitty_import *--since=01.01.2022* -l mylist@mydomain my-mbox-file' 2. https://mail.python.org/pipermail/mailman-users/2018-July/083607.html Which talks about 'hyperkitty_import *--since='1990-01-01'* -l mylist@mydomain my-mbox-file' I am concerned about the implication of the date format here, especially because our species from America write their dates differently than the British, even though the British colonized us all :P Well, I haven't looked at the manpage (--help) before posting this, and I know I should, but even without that, does Mailman speak American or British English when it comes to the date format? :-) In my case, I have done this: ' hyperkitty_import --since='2022-12-08' -l mylist@mydomain my-mbox-file' After that I ran: /opt/mailman/mm/bin/django-admin update_index_one_listmylist@mydomain And I am hoping that I will have the posts since Dec 8 to Dec 29 showing up in my archives. However, I am not sure. Hope someone can explain to the audience. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 5

Twitter OAuth2
by Odhiambo Washington Dec. 31, 2022

Dec. 31, 2022

I'd like to integrate Twitter OAuth as part of the Social Accounts in my setup. I have gone through https://django-allauth.readthedocs.io/en/latest/providers.html#twitter, but cannot find the config options to add to my settings. Does someone have a config block setting for "SOCIALACCOUNT_PROVIDERS =" ? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

3 15

combine postorius and hyperkitty into one Apache vhost
by Wolfgang Rosenauer Dec. 29, 2022

Dec. 29, 2022

Hi, I'm in the process to set up a new mailman3 site. (Migrating from mailman2) There are RPMs for my distribution which integrate postorius and hyperkitty with uwsgi. The provided samples assume that both are running in different vhosts what I would like to avoid. Since I couldn't find any uwsgi examples for that I'm experimenting heavily but still having issues. I might just miss a simple thing (hopefully). My current apache config: Alias "/mailman/static" "/srv/www/webapps/mailman/postorius/static" ProxyPassMatch ^/mailman/static ! ProxyPass /mailman unix:/run/uwsgi/uwsgi-postorius.sock|uwsgi://localhost-postorius/ Alias "/archives/static" "/srv/www/webapps/mailman/hyperkitty/static" ProxyPassMatch ^/archives/static ! ProxyPass /archives unix:/run/uwsgi/uwsgi-hyperkitty.sock|uwsgi://localhost-hyperkitty/ This currently assumes that postorius just gets a mailman/ prefix and hyperkitty archives/ This setup immediately fails because of the urlpatterns filter in these components. For testing purposes I changed the patterns in urls.py slightly and I could make it work for me. BUT: This cannot be the solution, can it? Isn't there an easier way to allow these components to run under a different document root? Something slightly unrelated but causing issues in some edge cases also is that Django? does not detect the request url properly. For some functionality e.g. when I want to login to Django admin under /archives/admin (even after modifying urls.py) I get a redirect after the form which shows that my initial path was not recognized as /archives/admin but /archive//admin instead. So the last character is replaced with a / Any hints for me? Thanks, Wolfgang

3 3

hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header
by Odhiambo Washington Dec. 29, 2022

Dec. 29, 2022

I worke up to 959 such entries in my mailmanweb.log: ERROR 2022-12-27 22:49:57,732 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:49:57,784 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:50:05,746 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:50:06,022 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:50:06,183 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:50:06,273 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:50:06,353 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-12-27 22:50:06,435 82073 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. What might have been the cause of this? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 4

Internal Server Error: /mailman3/accounts/fedora/login/
by Mohsen Masoudfar Dec. 29, 2022

Dec. 29, 2022

Hi, I am getting the following errors starting some days ago. It is unclear to me what is causing this. I searched internet, there are some similar reports that mention bugs causing this. I am running mailman3 as Ubuntu 18 package and they do not provide any update for this. Internal Server Error: /mailman3/accounts/fedora/login/ ProgrammingError at /accounts/fedora/login/ relation "socialaccount_openidstore" does not exist LINE 1: SELECT COUNT(*) AS "__count" FROM "socialaccount_openidstore... ^ Request Method: GET Request URL: https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flistserv2… Django Version: 1.11.11 Python Executable: /usr/bin/uwsgi-core Python Version: 2.7.17 Python Path: ['.', '', '/usr/lib/python2.7', '/usr/lib/python2.7/plat-x86_64-linux-gnu', '/usr/lib/python2.7/lib-tk', '/usr/lib/python2.7/lib-old', '/usr/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/dist-packages', '/usr/lib/python2.7/dist-packages'] Server time: Tue, 27 Dec 2022 11:01:12 -0500 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'paintstore', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.auth.middleware.SessionAuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py" in _legacy_get_response 249. response = self._get_response(request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py" in view 68. return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/django/views/generic/base.py" in dispatch 88. return handler(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/django_mailman3/lib/auth/fedora/views.py" in get 59. return self.post(request, *args, **kwargs) File "/usr/lib/python2.7/dist-packages/django_mailman3/lib/auth/fedora/views.py" in post 72. auth_request = client.begin(form.cleaned_data['openid']) File "/usr/lib/python2.7/dist-packages/openid/consumer/consumer.py" in begin 353. return self.beginWithoutDiscovery(service, anonymous) File "/usr/lib/python2.7/dist-packages/openid/consumer/consumer.py" in beginWithoutDiscovery 376. auth_req = self.consumer.begin(service) File "/usr/lib/python2.7/dist-packages/openid/consumer/consumer.py" in begin 598. assoc = self._getAssociation(service_endpoint) File "/usr/lib/python2.7/dist-packages/openid/consumer/consumer.py" in _getAssociation 1158. assoc = self.store.getAssociation(endpoint.server_url) File "/usr/lib/python2.7/dist-packages/allauth/socialaccount/providers/openid/utils.py" in getAssociation 96. if stored_assocs.count() == 0: File "/usr/lib/python2.7/dist-packages/django/db/models/query.py" in count 364. return self.query.get_count(using=self.db) File "/usr/lib/python2.7/dist-packages/django/db/models/sql/query.py" in get_count 504. number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/lib/python2.7/dist-packages/django/db/models/sql/query.py" in get_aggregation 485. result = compiler.execute_sql(SINGLE) File "/usr/lib/python2.7/dist-packages/django/db/models/sql/compiler.py" in execute_sql 899. raise original_exception Exception Type: ProgrammingError at /accounts/fedora/login/ Exception Value: relation "socialaccount_openidstore" does not exist LINE 1: SELECT COUNT(*) AS "__count" FROM "socialaccount_openidstore... ^ Request information: USER: AnonymousUser GET: process = u'login' next = u'/mailman3/hyperkitty/list/sec_g_zoom(a)listserv2.aaas.org/message/new' POST: No POST data FILES: No FILES data COOKIES: No cookie data META: CONTEXT_DOCUMENT_ROOT = '/var/www/html' CONTEXT_PREFIX = '' DOCUMENT_ROOT = '/var/www/html' GATEWAY_INTERFACE = 'CGI/1.1' HTTPS = 'on' HTTP_ACCEPT = '*/*' HTTP_ACCEPT_ENCODING = 'gzip, deflate, br' HTTP_CONNECTION = 'keep-alive' HTTP_FROM = 'googlebot(at)googlebot.com' HTTP_HOST = 'listserv2.aaas.org' HTTP_USER_AGENT = 'Googlebot/2.1 (+https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.google.com%2Fbot.html&data=05%7C01%7Cmmasoudf%40aaas.org%7Cc767333920c94048355708dae823947a%7C2eebd8ff9ed140f0a15638e5dfb3bc56%7C0%7C0%7C638077536774767693%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8%2F5tgjkoHnu%2BWaHwrNVRzcJUh%2BcQ9%2BFUkmB3psMzKMU%3D&reserved=0)' PATH = '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin' PATH_INFO = u'/accounts/fedora/login/' QUERY_STRING = 'process=login&next=%2Fmailman3%2Fhyperkitty%2Flist%2Fsec_g_zoom%40listserv2.aaas.org%2Fmessage%2Fnew' REMOTE_ADDR = '66.249.66.53' REMOTE_PORT = '37189' REQUEST_METHOD = 'GET' REQUEST_SCHEME = 'https' REQUEST_URI = '/mailman3/accounts/fedora/login/?process=login&next=%2Fmailman3%2Fhyperkitty%2Flist%2Fsec_g_zoom%40listserv2.aaas.org%2Fmessage%2Fnew' SCRIPT_FILENAME = 'proxy:uwsgi://localhost//accounts/fedora/login/' SCRIPT_NAME = u'/mailman3' SERVER_ADDR = '172.24.9.130' SERVER_ADMIN = 'mmasoudf(a)aaas.org' SERVER_NAME = 'listserv2.aaas.org' SERVER_PORT = '443' SERVER_PROTOCOL = 'HTTP/1.1' SERVER_SIGNATURE = '<address>Apache/2.4.29 (Ubuntu) Server at listserv2.aaas.org Port 443</address>\n' SERVER_SOFTWARE = 'Apache/2.4.29 (Ubuntu)' SSL_TLS_SNI = 'listserv2.aaas.org' uwsgi.core = 0 uwsgi.node = 'listserv2' uwsgi.version = '2.0.15-debian' wsgi.errors = <open file 'wsgi_errors', mode 'w' at 0x7fdfa1c748a0> wsgi.file_wrapper = '' wsgi.input = <uwsgi._Input object at 0x7fdfa1ccc710> wsgi.multiprocess = False wsgi.multithread = True wsgi.run_once = False wsgi.url_scheme = 'https' wsgi.version = u'(1, 0)' Settings: Using settings module settings ABSOLUTE_URL_OVERRIDES = {} ACCOUNT_AUTHENTICATION_METHOD = 'username_email' ACCOUNT_DEFAULT_HTTP_PROTOCOL = 'https' ACCOUNT_EMAIL_REQUIRED = True ACCOUNT_EMAIL_VERIFICATION = 'mandatory' ACCOUNT_UNIQUE_EMAIL = True ADMINS = u"(('Mailman Suite Admin', 'mmasoudf(a)aaas.org'),)" ALLOWED_HOSTS = ['*'] APPEND_SLASH = True AUTHENTICATION_BACKENDS = u"('django.contrib.auth.backends.ModelBackend', 'allauth.account.auth_backends.AuthenticationBackend')" AUTH_PASSWORD_VALIDATORS = u'********************' AUTH_USER_MODEL = u'auth.User' BASE_DIR = '/usr/share/mailman3-web' CACHES = {u'default': {u'BACKEND': u'django.core.cache.backends.locmem.LocMemCache'}} CACHE_MIDDLEWARE_ALIAS = u'default' CACHE_MIDDLEWARE_KEY_PREFIX = u'********************' CACHE_MIDDLEWARE_SECONDS = 600 COMPRESS_CACHEABLE_PRECOMPILERS = u'()' COMPRESS_CACHE_BACKEND = u'default' COMPRESS_CACHE_KEY_FUNCTION = u'********************' COMPRESS_CLEAN_CSS_ARGUMENTS = u'' COMPRESS_CLEAN_CSS_BINARY = u'cleancss' COMPRESS_CLOSURE_COMPILER_ARGUMENTS = u'' COMPRESS_CLOSURE_COMPILER_BINARY = u'java -jar compiler.jar' COMPRESS_CSS_COMPRESSOR = u'compressor.css.CssCompressor' COMPRESS_CSS_FILTERS = [u'compressor.filters.css_default.CssAbsoluteFilter'] COMPRESS_CSS_HASHING_METHOD = u'mtime' COMPRESS_DATA_URI_MAX_SIZE = 1024 COMPRESS_DEBUG_TOGGLE = None COMPRESS_ENABLED = True COMPRESS_JINJA2_GET_ENVIRONMENT = <function JINJA2_GET_ENVIRONMENT at 0x7fdfa1de2f50> COMPRESS_JS_COMPRESSOR = u'compressor.js.JsCompressor' COMPRESS_JS_FILTERS = [u'compressor.filters.jsmin.JSMinFilter'] COMPRESS_MINT_DELAY = 30 COMPRESS_MTIME_DELAY = 10 COMPRESS_OFFLINE = False COMPRESS_OFFLINE_CONTEXT = {u'STATIC_URL': '/mailman3/static/'} COMPRESS_OFFLINE_MANIFEST = u'manifest.json' COMPRESS_OFFLINE_TIMEOUT = 31536000 COMPRESS_OUTPUT_DIR = u'CACHE' COMPRESS_PARSER = u'compressor.parser.AutoSelectParser' COMPRESS_PRECOMPILERS = u"(('text/less', 'lessc {infile} {outfile}'), ('text/x-scss', 'sass -t compressed {infile} {outfile}'), ('text/x-sass', 'sass -t compressed {infile} {outfile}'))" COMPRESS_REBUILD_TIMEOUT = 2592000 COMPRESS_ROOT = '/var/lib/mailman3/web/static' COMPRESS_STORAGE = u'compressor.storage.CompressorFileStorage' COMPRESS_TEMPLATE_FILTER_CONTEXT = {u'STATIC_URL': '/mailman3/static/'} COMPRESS_URL = '/mailman3/static/' COMPRESS_URL_PLACEHOLDER = u'/__compressor_url_placeholder__/' COMPRESS_VERBOSE = False COMPRESS_YUGLIFY_BINARY = u'yuglify' COMPRESS_YUGLIFY_CSS_ARGUMENTS = u'--terminal' COMPRESS_YUGLIFY_JS_ARGUMENTS = u'--terminal' COMPRESS_YUI_BINARY = u'java -jar yuicompressor.jar' COMPRESS_YUI_CSS_ARGUMENTS = u'' COMPRESS_YUI_JS_ARGUMENTS = u'' CSRF_COOKIE_AGE = 31449600 CSRF_COOKIE_DOMAIN = None CSRF_COOKIE_HTTPONLY = False CSRF_COOKIE_NAME = u'csrftoken' CSRF_COOKIE_PATH = u'/' CSRF_COOKIE_SECURE = False CSRF_FAILURE_VIEW = u'django.views.csrf.csrf_failure' CSRF_HEADER_NAME = u'HTTP_X_CSRFTOKEN' CSRF_TRUSTED_ORIGINS = [] CSRF_USE_SESSIONS = False DATABASES = {'default': {'ENGINE': 'django.db.backends.postgresql_psycopg2', 'AUTOCOMMIT': True, 'ATOMIC_REQUESTS': False, 'NAME': 'mailman3web', 'CONN_MAX_AGE': 0, 'TIME_ZONE': None, 'PORT': '', 'HOST': 'localhost', 'USER': 'mailman3web', 'TEST': {'COLLATION': None, 'CHARSET': None, 'NAME': None, 'MIRROR': None}, 'PASSWORD': u'********************', 'OPTIONS': {}}} DATABASE_ROUTERS = [] DATA_UPLOAD_MAX_MEMORY_SIZE = 2621440 DATA_UPLOAD_MAX_NUMBER_FIELDS = 1000 DATETIME_FORMAT = u'N j, Y, P' DATETIME_INPUT_FORMATS = [u'%Y-%m-%d %H:%M:%S', u'%Y-%m-%d %H:%M:%S.%f', u'%Y-%m-%d %H:%M', u'%Y-%m-%d', u'%m/%d/%Y %H:%M:%S', u'%m/%d/%Y %H:%M:%S.%f', u'%m/%d/%Y %H:%M', u'%m/%d/%Y', u'%m/%d/%y %H:%M:%S', u'%m/%d/%y %H:%M:%S.%f', u'%m/%d/%y %H:%M', u'%m/%d/%y'] DATE_FORMAT = u'N j, Y' DATE_INPUT_FORMATS = [u'%Y-%m-%d', u'%m/%d/%Y', u'%m/%d/%y', u'%b %d %Y', u'%b %d, %Y', u'%d %b %Y', u'%d %b, %Y', u'%B %d %Y', u'%B %d, %Y', u'%d %B %Y', u'%d %B, %Y'] DEBUG = False DEBUG_PROPAGATE_EXCEPTIONS = False DECIMAL_SEPARATOR = u'.' DEFAULT_CHARSET = u'utf-8' DEFAULT_CONTENT_TYPE = u'text/html' DEFAULT_EXCEPTION_REPORTER_FILTER = u'django.views.debug.SafeExceptionReporterFilter' DEFAULT_FILE_STORAGE = u'django.core.files.storage.FileSystemStorage' DEFAULT_FROM_EMAIL = 'postorius(a)listserv2.aaas.org' DEFAULT_INDEX_TABLESPACE = u'' DEFAULT_TABLESPACE = u'' DISALLOWED_USER_AGENTS = [] EMAILNAME = 'listserv2.aaas.org' EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = u'localhost' EMAIL_HOST_PASSWORD = u'********************' EMAIL_HOST_USER = u'' EMAIL_PORT = 25 EMAIL_SSL_CERTFILE = None EMAIL_SSL_KEYFILE = u'********************' EMAIL_SUBJECT_PREFIX = u'[Django] ' EMAIL_TIMEOUT = None EMAIL_USE_LOCALTIME = False EMAIL_USE_SSL = False EMAIL_USE_TLS = False FILE_CHARSET = u'utf-8' FILE_UPLOAD_DIRECTORY_PERMISSIONS = None FILE_UPLOAD_HANDLERS = [u'django.core.files.uploadhandler.MemoryFileUploadHandler', u'django.core.files.uploadhandler.TemporaryFileUploadHandler'] FILE_UPLOAD_MAX_MEMORY_SIZE = 2621440 FILE_UPLOAD_PERMISSIONS = None FILE_UPLOAD_TEMP_DIR = None FILTER_VHOST = False FIRST_DAY_OF_WEEK = 0 FIXTURE_DIRS = [] FORCE_SCRIPT_NAME = None FORMAT_MODULE_PATH = None FORM_RENDERER = u'django.forms.renderers.DjangoTemplates' HAYSTACK_CONNECTIONS = {'default': {'ENGINE': 'haystack.backends.whoosh_backend.WhooshEngine', 'PATH': '/var/lib/mailman3/web/fulltext_index'}} HOSTNAME = 'localhost.local' IGNORABLE_404_URLS = [] INSTALLED_APPS = u"('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'paintstore', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora')" INTERNAL_IPS = [] LANGUAGES = [(u'af', u'Afrikaans'), (u'ar', u'Arabic'), (u'ast', u'Asturian'), (u'az', u'Azerbaijani'), (u'bg', u'Bulgarian'), (u'be', u'Belarusian'), (u'bn', u'Bengali'), (u'br', u'Breton'), (u'bs', u'Bosnian'), (u'ca', u'Catalan'), (u'cs', u'Czech'), (u'cy', u'Welsh'), (u'da', u'Danish'), (u'de', u'German'), (u'dsb', u'Lower Sorbian'), (u'el', u'Greek'), (u'en', u'English'), (u'en-au', u'Australian English'), (u'en-gb', u'British English'), (u'eo', u'Esperanto'), (u'es', u'Spanish'), (u'es-ar', u'Argentinian Spanish'), (u'es-co', u'Colombian Spanish'), (u'es-mx', u'Mexican Spanish'), (u'es-ni', u'Nicaraguan Spanish'), (u'es-ve', u'Venezuelan Spanish'), (u'et', u'Estonian'), (u'eu', u'Basque'), (u'fa', u'Persian'), (u'fi', u'Finnish'), (u'fr', u'French'), (u'fy', u'Frisian'), (u'ga', u'Irish'), (u'gd', u'Scottish Gaelic'), (u'gl', u'Galician'), (u'he', u'Hebrew'), (u'hi', u'Hindi'), (u'hr', u'Croatian'), (u'hsb', u'Upper Sorbian'), (u'hu', u'Hungarian'), (u'ia', u'Interlingua'), (u'id', u'Indonesian'), (u'io', u'Ido'), (u'is', u'Icelandic'), (u'it', u'Italian'), (u'ja', u'Japanese'), (u'ka', u'Georgian'), (u'kk', u'Kazakh'), (u'km', u'Khmer'), (u'kn', u'Kannada'), (u'ko', u'Korean'), (u'lb', u'Luxembourgish'), (u'lt', u'Lithuanian'), (u'lv', u'Latvian'), (u'mk', u'Macedonian'), (u'ml', u'Malayalam'), (u'mn', u'Mongolian'), (u'mr', u'Marathi'), (u'my', u'Burmese'), (u'nb', u'Norwegian Bokm\xe5l'), (u'ne', u'Nepali'), (u'nl', u'Dutch'), (u'nn', u'Norwegian Nynorsk'), (u'os', u'Ossetic'), (u'pa', u'Punjabi'), (u'pl', u'Polish'), (u'pt', u'Portuguese'), (u'pt-br', u'Brazilian Portuguese'), (u'ro', u'Romanian'), (u'ru', u'Russian'), (u'sk', u'Slovak'), (u'sl', u'Slovenian'), (u'sq', u'Albanian'), (u'sr', u'Serbian'), (u'sr-latn', u'Serbian Latin'), (u'sv', u'Swedish'), (u'sw', u'Swahili'), (u'ta', u'Tamil'), (u'te', u'Telugu'), (u'th', u'Thai'), (u'tr', u'Turkish'), (u'tt', u'Tatar'), (u'udm', u'Udmurt'), (u'uk', u'Ukrainian'), (u'ur', u'Urdu'), (u'vi', u'Vietnamese'), (u'zh-hans', u'Simplified Chinese'), (u'zh-hant', u'Traditional Chinese')] LANGUAGES_BIDI = [u'he', u'ar', u'fa', u'ur'] LANGUAGE_CODE = 'en-us' LANGUAGE_COOKIE_AGE = None LANGUAGE_COOKIE_DOMAIN = None LANGUAGE_COOKIE_NAME = u'django_language' LANGUAGE_COOKIE_PATH = u'/' LOCALE_PATHS = [] LOGGING = {'loggers': {'django': {'handlers': ['file'], 'propagate': True, 'level': 'INFO'}, 'hyperkitty': {'handlers': ['file'], 'propagate': True, 'level': 'INFO'}, 'django.request': {'handlers': ['mail_admins', 'file'], 'propagate': True, 'level': 'INFO'}, 'postorius': {'handlers': ['file'], 'propagate': True, 'level': 'INFO'}}, 'disable_existing_loggers': False, 'handlers': {'console': {'formatter': 'simple', 'class': 'logging.StreamHandler'}, 'file': {'level': 'INFO', 'formatter': 'verbose', 'class': 'logging.handlers.RotatingFileHandler', 'filename': '/var/log/mailman3/web/mailman-web.log'}, 'mail_admins': {'class': 'django.utils.log.AdminEmailHandler', 'filters': ['require_debug_false'], 'level': 'ERROR'}}, 'formatters': {'simple': {'format': '%(levelname)s %(message)s'}, 'verbose': {'format': '%(levelname)s %(asctime)s %(process)d %(name)s %(message)s'}}, 'version': 1, 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'}}} LOGGING_CONFIG = u'logging.config.dictConfig' LOGIN_REDIRECT_URL = 'list_index' LOGIN_URL = 'account_login' LOGOUT_REDIRECT_URL = None LOGOUT_URL = 'account_logout' MAILMAN_ARCHIVER_FROM = u"('127.0.0.1', '::1')" MAILMAN_ARCHIVER_KEY = u'********************' MAILMAN_REST_API_PASS = u'********************' MAILMAN_REST_API_URL = u'********************' MAILMAN_REST_API_USER = u'********************' MANAGERS = [] MEDIA_ROOT = u'' MEDIA_URL = u'' MESSAGE_STORAGE = u'django.contrib.messages.storage.fallback.FallbackStorage' MESSAGE_TAGS = {40: 'danger'} MIDDLEWARE = None MIDDLEWARE_CLASSES = u"('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.auth.middleware.SessionAuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware')" MIGRATION_MODULES = {} MONTH_DAY_FORMAT = u'F j' NUMBER_GROUPING = 0 PASSWORD_HASHERS = u'********************' PASSWORD_RESET_TIMEOUT_DAYS = u'********************' PREPEND_WWW = False Q_CLUSTER = {'orm': 'default', 'save_limit': 100, 'timeout': 300} ROOT_URLCONF = 'urls' SECRET_KEY = u'********************' SECURE_BROWSER_XSS_FILTER = False SECURE_CONTENT_TYPE_NOSNIFF = False SECURE_HSTS_INCLUDE_SUBDOMAINS = False SECURE_HSTS_PRELOAD = False SECURE_HSTS_SECONDS = 0 SECURE_PROXY_SSL_HEADER = None SECURE_REDIRECT_EXEMPT = [] SECURE_SSL_HOST = None SECURE_SSL_REDIRECT = False SERVER_EMAIL = 'root(a)listserv2.aaas.org' SESSION_CACHE_ALIAS = u'default' SESSION_COOKIE_AGE = 1209600 SESSION_COOKIE_DOMAIN = None SESSION_COOKIE_HTTPONLY = True SESSION_COOKIE_NAME = u'sessionid' SESSION_COOKIE_PATH = u'/' SESSION_COOKIE_SECURE = False SESSION_ENGINE = u'django.contrib.sessions.backends.db' SESSION_EXPIRE_AT_BROWSER_CLOSE = False SESSION_FILE_PATH = None SESSION_SAVE_EVERY_REQUEST = False SESSION_SERIALIZER = 'django.contrib.sessions.serializers.PickleSerializer' SETTINGS_MODULE = 'settings' SHORT_DATETIME_FORMAT = u'm/d/Y P' SHORT_DATE_FORMAT = u'm/d/Y' SIGNING_BACKEND = u'django.core.signing.TimestampSigner' SILENCED_SYSTEM_CHECKS = [] SITE_ID = 1 SOCIALACCOUNT_PROVIDERS = {} STATICFILES_DIRS = u'()' STATICFILES_FINDERS = u"('django.contrib.staticfiles.finders.FileSystemFinder', 'django.contrib.staticfiles.finders.AppDirectoriesFinder', 'compressor.finders.CompressorFinder')" STATICFILES_STORAGE = u'django.contrib.staticfiles.storage.StaticFilesStorage' STATIC_ROOT = '/var/lib/mailman3/web/static' STATIC_URL = '/mailman3/static/' TEMPLATES = [{'DIRS': [], 'APP_DIRS': True, 'OPTIONS': {'context_processors': ['django.template.context_processors.debug', 'django.template.context_processors.i18n', 'django.template.context_processors.media', 'django.template.context_processors.static', 'django.template.context_processors.tz', 'django.template.context_processors.csrf', 'django.template.context_processors.request', 'django.contrib.auth.context_processors.auth', 'django.contrib.messages.context_processors.messages', 'django_mailman3.context_processors.common', 'hyperkitty.context_processors.common', 'postorius.context_processors.postorius']}, 'BACKEND': 'django.template.backends.django.DjangoTemplates'}] TEST_NON_SERIALIZED_APPS = [] TEST_RUNNER = u'django.test.runner.DiscoverRunner' THOUSAND_SEPARATOR = u',' TIME_FORMAT = u'P' TIME_INPUT_FORMATS = [u'%H:%M:%S', u'%H:%M:%S.%f', u'%H:%M'] TIME_ZONE = 'UTC' USE_ETAGS = False USE_I18N = True USE_L10N = True USE_THOUSAND_SEPARATOR = False USE_TZ = True USE_X_FORWARDED_HOST = True USE_X_FORWARDED_PORT = False WSGI_APPLICATION = 'wsgi.application' X_FRAME_OPTIONS = u'SAMEORIGIN' YEAR_MONTH_FORMAT = u'F Y' Best regards Mohsen Masoudfar

4 5

Approve an email
by Lars Bjørndal Dec. 28, 2022

Dec. 28, 2022

Hi, list! I'm on Fedora 36 with the packages mailman3-3.3.4-6.fc36.noarch and postorius-1.3.6-2.fc36.noarch installed. with the command sudo -u mailman mailman3 create <listname> I was able to create a list. I'm not able to find out how to setup and configure the postorius package. There's no mailman-web command. Hyperkitty will not installed du to a dependency conflict, but I dont need archiving for the list. Here comes my quesitons: - What's the easiest way to approve an email sent to the list? - How can I configure the list to accept messages also from non members? - How can I setup postorius to work on Fedora? I have django-admin, but I'm not sure where to go. Thanks in advance, Lars

3 4

Apache+mod_wsgi issue
by Odhiambo Washington Dec. 27, 2022

Dec. 27, 2022

Still on my MM3 learning path. I mostly have everything running without errors - even uwsgi is starting without errors after I followed the fix from the discussion at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… I have standardized all the files in /opt/mailman/mm/ because this is FreeBSD and our configs for user-installed apps are usually supposed to go to /usr/local/etc/. My VHOST configuration is the exact replica of https://wiki.list.org/DOC/Mailman%203%20installation%20experience?action=At… with the only change being the Python version from 3.6 to 3.9. My challenge now is to get Apache+mod_uwsgi to serve my pages, but I am hitting the error below which has gotten me stuck. Thanking you in advance for your advice on how to overcome this. [Thu Dec 22 14:21:22.758277 2022] [wsgi:info] [pid 4288] [remote 197.232.81.246:15107] mod_wsgi (pid=4288, process='mailman-web', application='mm3-lists.kictanet.or.ke|/mailman3'): Loading Python script file '/opt/mailman/mm/wsgi.py'. [Thu Dec 22 14:21:23.039999 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] mod_wsgi (pid=4288): Failed to exec Python script file '/opt/mailman/mm/wsgi.py'. [Thu Dec 22 14:21:23.040054 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] mod_wsgi (pid=4288): Exception occurred processing WSGI script '/opt/mailman/mm/wsgi.py'. [Thu Dec 22 14:21:23.040841 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] Traceback (most recent call last): [Thu Dec 22 14:21:23.040914 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/opt/mailman/mm/wsgi.py", line 38, in <module> [Thu Dec 22 14:21:23.040921 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] application = get_wsgi_application() [Thu Dec 22 14:21:23.040929 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/wsgi.py", line 12, in get_wsgi_application [Thu Dec 22 14:21:23.040934 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] django.setup(set_prefix=False) [Thu Dec 22 14:21:23.040941 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/__init__.py", line 19, in setup [Thu Dec 22 14:21:23.040945 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] configure_logging(settings.LOGGING_CONFIG, settings.LOGGING) [Thu Dec 22 14:21:23.040952 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/conf/__init__.py", line 92, in __getattr__ [Thu Dec 22 14:21:23.040957 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] self._setup(name) [Thu Dec 22 14:21:23.040964 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/conf/__init__.py", line 79, in _setup [Thu Dec 22 14:21:23.040968 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] self._wrapped = Settings(settings_module) [Thu Dec 22 14:21:23.040975 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/conf/__init__.py", line 190, in __init__ [Thu Dec 22 14:21:23.040979 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] mod = importlib.import_module(self.SETTINGS_MODULE) [Thu Dec 22 14:21:23.040986 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in import_module [Thu Dec 22 14:21:23.040990 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] return _bootstrap._gcd_import(name[level:], package, level) [Thu Dec 22 14:21:23.040997 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "<frozen importlib._bootstrap>", line 1030, in _gcd_import [Thu Dec 22 14:21:23.041004 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "<frozen importlib._bootstrap>", line 1007, in _find_and_load [Thu Dec 22 14:21:23.041012 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] File "<frozen importlib._bootstrap>", line 984, in _find_and_load_unlocked [Thu Dec 22 14:21:23.041064 2022] [wsgi:error] [pid 4288] [remote 197.232.81.246:15107] ModuleNotFoundError: No module named 'settings' -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

5 41

Errors while importing mm2 list archives
by Odhiambo Washington Dec. 23, 2022

Dec. 23, 2022

MM3-3.3.7, Hyperkitty-1.3.6 While importing, I encountered several of this error: <CUT> MySQLdb.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\x8A, ...' for column 'content' at row 1") The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 232, in from_mbox add_to_list(self.list_address, message) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/lib/incoming.py", line 153, in add_to_list email.save() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 812, in save self.save_base( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 863, in save_base updated = self._save_table( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 1006, in _save_table results = self._do_insert( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 1047, in _do_insert return manager._insert( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/query.py", line 1791, in _insert return query.get_compiler(using=using).execute_sql(returning_fields) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1660, in execute_sql cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers return executor(sql, params, many, context) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/utils.py", line 91, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/mysql/base.py", line 75, in execute return self.cursor.execute(query, args) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/cursors.py", line 206, in execute res = self._query(query) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/cursors.py", line 319, in _query db.query(q) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/connections.py", line 254, in query _mysql.connection.query(self, query) django.db.utils.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\x8A, ...' for column 'content' at row 1") </CUT> That occurred several times, but the import process went all the way, to 99% then came to the point below. Message 253d9d44-cc3e-fed1-144b-34da88c52b39(a)emailplus.org failed to import, skipping Computing thread structure Synchronizing properties with Mailman 904 emails left to refresh, checked 0 764 emails left to refresh, checked 0 Warming up cache Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 440, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 402, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 448, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 411, in handle call_command("hyperkitty_warm_up_cache", list_address) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 198, in call_command return command.execute(*args, **defaults) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 448, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_warm_up_cache.py", line 53, in handle self.warm_up_mlist(mlist, options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_warm_up_cache.py", line 61, in warm_up_mlist for thread in mlist.recent_threads: File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 162, in recent_threads return self.cached_values["recent_threads"]() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/common.py", line 58, in __call__ return self.get_or_set(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 317, in get_or_set return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 317, in <listcomp> return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/query.py", line 650, in get raise self.model.DoesNotExist( hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. (venv) [mailman@gw ~/mm]$ Should I take it that the import was successful, or what should I do next? PS: This is the 1st run after installing MM3 on this server and the MM3 list hasn't gone live. So if anything, I am okay with doing what needs to be done and rerun the import. TIA -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

3 12

No Archives
by Odhiambo Washington Dec. 22, 2022

Dec. 22, 2022

I am working on a migration from MM2 to MM3. My MM2 lists are domiciled at https://lists.kictanet.or.ke/ To work on the web UI for MM3, I created a subdomain - mm3-lists.kictanet.or.ke. I have mostly done everything, including importing the archives. However, when I access https://mm3-lists.kictanet.or.ke/archives/, it's all empty. However, when I visit https://mm3-lists.kictanet.or.ke/mailman3/lists/, I can see my list. In Postorius, the site name is lists.kictanet.or.ke (same with mail domain). I have SITE_ID = 3 in both settings*.py and have restarted both Apache and Gunicorn. Could this be due to the fact that I am accessing the site using a domain name different than what the actual site is? Or there is something minor I am missing? PS: I am wondering also why SITE_ID=3 when I only added one site, besides the default example.com. If need be, I am willing to blow away the whole virtualenv and start afresh. It's a good step towards mastering the installation of MM3 :-) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 2

message awaits moderator approval´
by Eggert Ehmke Dec. 21, 2022

Dec. 21, 2022

When I send a mail to a list that exceeds the max size, I get the above answer. However, the moderator of that list does not get a message, and there is no entry in the list of hold back messages. This should be a configuration problem, on another list on the same server this works fine. I cannot find any differences in the settings.

2 4

Emergency moderation and clearing out a lot of held messages
by bob B Dec. 21, 2022

Dec. 21, 2022

We had an issue where a program went rogue and sent out 30k email alerts to one of our lists, so now I have a few questions. When the issue happened I turned on emergency moderation and we have resolved the issue so.. 1. How do I easily delete 30k of held messages? It looks like the GUI only allows me to do 200 at a time? is there a way to flush all held messages easily? 2. When I enabled Emergency moderation, I expected it to stop notifying the admin on every held message, but it appears that is not the case? Also, does it reply to the sender of every held message when Emergency moderation is on? it seems like the steps are: turn on "Emergency moderation" turn OFF "Notify users of held messages" turn OFF "Admin immed notify"

6 28

SMTPNotSupportedError when requesting new password
by Eggert Ehmke Dec. 21, 2022

Dec. 21, 2022

I get this error when a user tries to use the "forgot password" function in hyperkitty. Obviously the exception is thrown when the send_mail function is called in /opt/mailman/venv/lib/python3.9/site-packages/allauth/account/adapter.py In settings.py I have: EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'localhost' EMAIL_PORT = 25 EMAIL_HOST_USER = 'valid email' EMAIL_HOST_PASSWORD = 'valid password' What can I do to debug further?

2 2