- Mailman-users - lists.mailman3.org

How to setup mailman?
by waqar.pixako＠gmail.com 17 Jul '20

17 Jul '20

Hi @all I need to maintain mailing via api. I need to setup mailman for this purpose. I don't know how to setup it & how does it works. Please help me to resolve this issue. Thanks

3 2

Also deleted website example.com
by w.schoener＠alp.dillingen.de 17 Jul '20

17 Jul '20

Hi there, i also deleted the website example.com, while I tried to configure my mailman 3 site. Now I get a Server-error, when I try to open my mailman3 sites: "An error occurred while processing your request" I tried to fix this problem by changing the SITE_ID=2 in my settings_local.py. But nothing helped, also the SITE_ID=0 did change nothing. I made a "/etc/init.d/apache2 restart" to ensure, that the settings are loaded again, but it didnt help. Is there anything I can do, besides reinstalling all django and mailman 3? Mailman Version 3.2.1, Python 2.7.16, Django 1.11.28 Thanks for any hints :-) Wolfgang

2 1

The Use of Hyperkitty as a Forum and Archiver
by Brian Carpenter 15 Jul '20

15 Jul '20

Dear Mailman 3 Users, Since Mailman 3 includes a forum feature via Hyperkitty, I would like to know the following: - Has the forum feature (Hyperkitty) of MM3 been received well by your list members or is it mostly ignored? - Do you see an increase in the use of HK as a forum from your list members? - What kind of feedback have you received from your list members considering the forum function of MM3? Positive or negative? - Do you think HK is received well by your list members as an archiver and do you think it provides a better user experience for viewing/searching archives vs Pipermail of MM2? Thank you for anything you shared. I am very curious to know the state of Hyperkitty among the Mailman 3 user community. -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

4 4

R: Re: mailman3 does not send to the members of the lists
by blackout69 13 Jul '20

13 Jul '20

Hi, my mailman.cfg [mailman] site_owner: admin(a)pratico.work noreply_address: noreply default_language: en sender_headers: from from_ reply-to sender email_commands_max_lines: 10 pending_request_life: 3d cache_life: 7d pre_hook: post_hook: layout: debian filtered_messages_are_preservable: no html_to_plain_text_command: /usr/bin/lynx -dump $filename listname_chars: [-_.0-9a-z] [shell] prompt: >>> banner: Welcome to the GNU Mailman shell use_ipython: no history_file: [paths.debian] var_dir: /var/lib/mailman3 queue_dir: $var_dir/queue bin_dir: /usr/lib/mailman3/bin list_data_dir: $var_dir/lists log_dir: /var/log/mailman3 lock_dir: $var_dir/locks data_dir: $var_dir/data cache_dir: $var_dir/cache etc_dir: /etc/mailman3 ext_dir: $var_dir/ext messages_dir: $var_dir/messages archive_dir: $var_dir/archives template_dir: $var_dir/templates pid_file: /run/mailman3/master.pid lock_file: $lock_dir/master.lck [database] class: mailman.database.mysql.MySQLDatabase url: mysql+pymysql://mailman3:dbpassword@localhost/mailman3?charset=utf8&use_unicode=1 debug: no [logging.debian] format: %(asctime)s (%(process)d) %(message)s datefmt: %b %d %H:%M:%S %Y propagate: no level: info path: mailman.log [webservice] hostname: localhost port: 8001 use_https: no show_tracebacks: yes api_version: 3.1 admin_user: rest_user admin_pass: rest_pass [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver smtp_host: localhost smtp_port: 25 smtp_user: smtp_pass: lmtp_host: 127.0.0.1 lmtp_port: 8024 configuration: python:mailman.config.postfix [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /etc/mailman3/mailman-hyperkitty.cfg

4 8

Re: Using external services for deliverability?
by Tom ＠ Gather 13 Jul '20

13 Jul '20

Thank you both for the help. I have SPF and reverse DNS setup. But I thought DKIM is no help because Mailman rewrites the email headers?

4 5

mailman3 does not send to the members of the lists
by maszap＠tin.it 12 Jul '20

12 Jul '20

Goodmorning everyone, I'm setting up a mail server to manage a mailinglist. I installed mailman3-full and configured everything. I can create a list, add members to the list, but when I create a new thread, I only get it on the email from the same domain as the list. While all the other members of the list, they do not receive the thread. I tried to check the logs, but I don't see anything significant. What can I check? Thank you in advance Max

2 7

Mail control not given from Mailman 3 to postfix
by Shashikanth Komandoor 12 Jul '20

12 Jul '20

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 in production environment from the past 2 months almost. Recently I observed a peculiar case. There is a list say testlist(a)lists.testdom.com has a non member say testuser(a)testdom.com whose Moderation attribute is set to "Accept immediately (bypass all other rules). This testuser(a)testdom.com has sent a mail to testlist(a)lists.testdom.com and postfix of my Maliman 3 received the request and handed over to Mailman at 0.0.0.0:8024 socket running on the same machine and the same is logged in /var/log/maillog. Since the user has the moderation attribute set to Accept, the /var/lib/mailman/mailman/var/logs/vette.log also displayed "ACCEPT" on searching with the same message id. At this point, to my expectations, there should be 2 entries for this message id in smtp.log one for smtp and one for post. But I don't find any log records with this message id in smtp.log and of course the mail is not delivered even. Could you please help me out if I have missed any point or improperly understood the mail flow while using the mailman 3? Please also let me know if I need to see any more log files for tracing the issue. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 4

ARC
by David Krantz 11 Jul '20

11 Jul '20

Hi, A completely different question: Is there anyone that has a working non-naive setup for ARC signing of mail list mail in mailman? I've tried both the built-in version but it was not usable in the version I tried for the case where there are several domains with different selectors and keys and where the outgoing mail also is DKIM-signed. This might be that the documentation is lacking but a very shallow look in the source gave me the impression that the implementation is limited to one domain which is not enough for my use case as I have lists in several domains. I use DKIM on outgoing mail with a setup where each domain has its own keys and selectors. As discussed here earlier, the DKIM signature should be added before the ARC signature. I have tried to use rspamd after a tip here for this but without luck so far, but this is somewhat off topic for mailman although related of course. rspamd seems very good for other purposes and solves my other problems with greylisting, DKIM-signing and spam filtering. That said, ARC seems difficult to get to work for forwarded mails there also... cheers // David

2 1

Update a member's display_name
by Nick Wynja 08 Jul '20

08 Jul '20

Hi all, I want to update some list member's display_name either with mailman shell or mailmanclient. These mostly aren't users in Postorius so I only want to operate on the subscribed list member. I've tried everything I can find in the docs and am stuck. I've tried using `user_manager.get_user()` and then updating `user.display_name` followed by a `commit()` but it doesn't seem to persist the change. The `absorb_existing` flag for mailmanclient's `User.add_address()` looks promising but the docs read "It will import the existing user into the current one, not overwriting any previously set value." which in some cases, the member already has a display_name set. I haven't tried this yet. I'd appreciate any help pointing in the right direction. Thanks, Nick

5 10

Bounce handling after upgrade
by David Krantz 08 Jul '20

08 Jul '20

Hi, I am in the process of configuring a new mailman3 server based on my old one. This includes upgrading to the latest version of mailman and installing a database upgrade. To my surprise mailman core started by sending tens of mails and blocking the corresponding users for very old bounces. What is worse is that this happens every time I start mailman core. Now I have blocked (almost) all outgoing mail in postfix using a transport map which discards it but this is a temporary testing measure of course. When I deploy this server into production, I do not want these recipients to be blocked as the old problems have been solved since very long. My plan is to reload the database from a newer backup anyway... Would it be enough to empty the bounce table (bounceevent) or is there anything else driving this behaviour? Or is there a better way to do this via the mailman shell? For me a "delete from bounceevent" seems a lot simpler than anything via the shell but there may be dependencies in the database. Cheers // David

2 1

Crash while importing archives
by Mark Dadgar 08 Jul '20

08 Jul '20

This is actually an mbox file generated by mailman3. (venv) mailman@mail:/opt/mailman/mm$ /opt/mailman/mm/bin/django-admin hyperkitty_import --since 2020-02-19 -l trackjunkies(a)pdc-racing.net /temp/archive/trackjunkies-new-1.mbox Importing from mbox file /temp/archive/trackjunkies-new-1.mbox to trackjunkies(a)pdc-racing.net \Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 381, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/__init__.py", line 375, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 323, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/core/management/base.py", line 364, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 327, in handle importer.from_mbox(mbfile) File "/opt/mailman/mm/venv/lib/python3.8/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 152, in from_mbox for msg in mbox: File "/usr/lib/python3.8/mailbox.py", line 109, in itervalues value = self[key] File "/usr/lib/python3.8/mailbox.py", line 73, in __getitem__ return self.get_message(key) File "/usr/lib/python3.8/mailbox.py", line 781, in get_message msg.set_from(from_line[5:].decode('ascii')) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 27: ordinal not in range(128) mailman 3.3.1 / core 3.1 Easy fix? I’m missing about 10 days' worth of archives as a result of this. - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 1

Importing list archives
by Mark Dadgar 07 Jul '20

07 Jul '20

So I got a shiny new instance of Mailman3 installed (thanks Brian!). I recreated my lists and I am now importing large historical list archives from an mbox file (24GB). It takes a couple of hours to run this import, so I killed the import task after about 20 minutes so I could restart it in a screen session. Now when I restart the import, it finishes almost immediately: (venv) mailman@mail:/opt/mailman/mm$ /opt/mailman/mm/bin/django-admin hyperkitty_import -l trackjunkies(a)pdc-racing.net trackjunkies.mbox Importing from mbox file trackjunkies.mbox to trackjunkies(a)pdc-racing.net Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the Django admin command with arguments 'update_index_one_list trackjunkies(a)pdc-racing.xn--net-to0a. (venv) mailman@mail:/opt/mailman/mm$ Which is clearly not correct. Anyone have an idea on how to restart this import? THanks! - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 2

Error after HyperKitty 1.3.x upgrade
by Florian Schulze 06 Jul '20

06 Jul '20

Hi! After upgrading to HyperKitty 1.3.x I get the following error for qcluster: File ".../lib/python3.7/site-packages/django_q/cluster.py", line 300, in pusher task = SignedPackage.loads(task[1]) File ".../lib/python3.7/site-packages/django_q/signing.py", line 31, in loads serializer=PickleSerializer) File ".../lib/python3.7/site-packages/django_q/core_signing.py", line 38, in loads return serializer().loads(data) File ".../lib/python3.7/site-packages/django_q/signing.py", line 44, in loads return pickle.loads(data) AttributeError: Can't get attribute 'process_task_result' on <module 'hyperkitty.tasks' from '.../lib/python3.7/site-packages/hyperkitty/tasks.py'> How do I recover from that? It seems like there are still persisted tasks in the qcluster queue using the old code from 1.2.x with the old locking implementation. Regards, Florian Schulze

2 4

Using external services for deliverability?
by tom＠gather.coop 04 Jul '20

04 Jul '20

I have a Mailman 3 server up and running but I'm terrified to migrate to it from my existing Mailman 2 provider for fear that services like Gmail will randomly start blacklisting my IP with little I can do about it. I have SPF records set up so I'm hoping I'll be Ok but I'd like to have a backup plan. Has anyone ever tried using an external service like Mailgun or Sendgrid as a relay? I tried both but couldn't get either to work due to their sender authentication mechanism. They want all 'From:' headers to be from domains that are pre-authenticated as senders. But Mailman keeps the 'From' header from the original sender so it won't match any authenticated domains. Right? Is there anything to be done here or do I just have to migrate and pray?

3 6

Example Logrotate files for Mailman3
by Andrew Hodgson 03 Jul '20

03 Jul '20

Hi, Does anyone have any usable Logrotate files for Mailman3 (especially for the web stuff)? Will look to create my own if no one comes forward but if anyone has anything they are willing to share it would be fab. Thanks. Andrew.

2 2

hidden list is hidden even to the owner
by Mohsen Masoudfar 02 Jul '20

02 Jul '20

Hi, I am not sure, if it is designed this way, or I am doing something wrong. I created a list in MM3 as a hidden list, meaning: Show list on index page: NO and assigned the owner. When I login as Postorius web admin, I see the list on the list page which is listed as: (unadvertised*). This is fine. But when the owner or moderator login to Postorius they don't see the list at all. Of course if they add the list name at the end of the URL, they get to the list and as the owner can manage it too. My question is: I am just not sure, if I am missing something or this is how it is supposed to work? You could expect, that the owner or the moderator should see the list as (unadvertised*) too. Best regards Mohsen Masoudfar Lead System Analyst, IT Operation American Association for the Advancement of Science 1200 New York Ave, NW, Washington, DC 20005 202-326-7087

3 4

clarifying configuration
by trewtus+200629maitr＠gmail.com 30 Jun '20

30 Jun '20

Hey Team, I'm new to Mailman and after some failed attempts to install from git on CentOS8, I have just installed it on Ubuntu 20.04 using mostly aptitude. But it's not quite working and I want to increase the log level to better understand the problem. I did see another post that suggested that I add to /etc/mailman3/mailman.cfg [logging.template] level: debug But that doesn't work for me. For example, after using that `mailman conf` doesn't list and debug values and as far as I can tell, the service, even after restarting, is not logging any more than it was. On the other hand, if I add [logging.smtp] level: debug Invoking `mailman conf` will reflect that new loglevel. This started me down the path of trying to figure out the configuration system of mailman in hope that that will save me time down the road. I have read https://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html but that doesn't seem to agree with what I'm seeing. For an additional example, my mailman.cfg file has a "logging.debian" section, but I don't see that section listed in the `mailman conf` output. Why would that be? I don't see in the documentation if `mailman conf` only sees values after the service is restarted. Nevertheless, restarting mailman hasn't helped. What guidance can you give? Context: `mailman info` produces: GNU Mailman 3.2.2 (La Villa Strangiato) Python 3.8.2 (default, Apr 27 2020, 15:53:34) [GCC 9.3.0] config file: /etc/mailman3/mailman.cfg db url: sqlite:////var/lib/mailman3/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:KI5TuWE/v.....

2 1

Moderation of posts via email is not working in mailman 3
by Shashikanth Komandoor 30 Jun '20

30 Jun '20

Hi Team, In mailman 2, few of my users used to approve the held messages through the mail by writing Approved: header and the password of the list in the first line of the reply mail to the "confirm" attachment in the mail notification of the held messages. But after I started migrating my distribution lists from mailman 2 to mailman 3, my users are complaining that they could not approve the posts or the held messages through the mail as they usually do while they were browsing their lists in mailman 2. Is there any bug or limitation in mailman 3 or if I am doing any wrong at the server side? Please suggest. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 3

User settings triggers error
by Mark Dadgar 29 Jun '20

29 Jun '20

If one of my users (including admin) goes to their user drop-down in the upper-right of Postorius and clicks Mailman Settings, it triggers an error: Here’s the error log: Internal Server Error: /mailman3/postorius/accounts/subscriptions/ KeyError at /postorius/accounts/subscriptions/ 'file' Request Method: GET Request URL: https://mail.pdc-racing.net/mailman3/postorius/accounts/subscriptions/ <https://mail.pdc-racing.net/mailman3/postorius/accounts/subscriptions/> Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Tue, 16 Jun 2020 10:31:56 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/contrib/auth/decorators.py" in _wrapped_view 21. return view_func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/user.py" in user_subscriptions 307. memberships = [m for m in mm_user.subscriptions] File "/usr/lib/python3/dist-packages/mailmanclient/restobjects/user.py" in subscriptions 62. for address in self.addresses: File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __iter__ 221. for entry in self.rest_data: File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 197. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 36. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 91. log_response( File "/usr/lib/python3/dist-packages/django/utils/log.py" in log_response 222. getattr(logger, level)( File "/usr/lib/python3.8/logging/__init__.py" in error 1463. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.8/logging/__init__.py" in _log 1577. self.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 1587. self.callHandlers(record) File "/usr/lib/python3.8/logging/__init__.py" in callHandlers 1649. hdlr.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 950. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 119. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.8/tempfile.py" in __getattr__ 607. file = self.__dict__['file'] Exception Type: KeyError at /postorius/accounts/subscriptions/ Exception Value: 'file' Request information: USER: admin GET: No GET data POST: No POST data FILES: No FILES data Anyone got a solution to this? - Mark ----- mark(a)pdc-racing.net | 408-348-2878

3 21

Server 500 error for just one list, just one page
by kelly.close＠lrewater.com 28 Jun '20

28 Jun '20

I am having a curious problem with just ONE list management page for ONE list on my server. Every other list I've checked, and every other management page for this affected list, seem fine. But when I go to the Subscribers page for this one list I get a Server 500 error, and I can't find anything in the apache or mailman logs to give me a clue (granted I'm not sure I know for sure where all the different logs are). So specifically this page: https://udfcd-lists.org/mailman3/postorius/lists/alarms-all.udfcd-lists.org… For a list called "alarms-all" obviously. Any ideas? I'm able to review the list, it's members, etc in the PostsgreSQL tables and I'm not seeing any members with funky characters in their address - the one thing I could think of to check. Thanks, ~Kelly

2 1

Null sender?
by tom＠gather.coop 28 Jun '20

28 Jun '20

Does Mailman generally send email with a null sender? This is what I see in the log: Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) handling connection Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'LHLO mail.example.coop' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'MAIL FROM:<>' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) sender: <> Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'RCPT TO:<techque-bounces(a)example.org>' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) recip: techque-bounces(a)example.org Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'DATA' Jun 28 02:37:45 2020 (14588) ('127.0.0.1', 52726) Data: b'QUIT' Notice the empty MAIL FROM. Sendgrid seems to be choking on that because it needs to check if sending domain has been validated. If there is no sending domain it seems to reject. Why does Mailman do this? Can it be changed? I've been trying to find the relevant section of the code to no avail.

2 3

Hyperkitty 403 Forbidden Error
by Phil Thompson 25 Jun '20

25 Jun '20

I'm in the process of setting up mailman3. The only problem I seem to be having is getting Hyperkitty to archive messages. Rather than the authorisation problems people have previously asked about on the list, I am getting a 403 error... Aug 05 15:38:40 2019 (10229) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/urls: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Aug 05 15:38:58 2019 (10222) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/archive: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Any suggestions would be appreciated. Phil

6 16

HyperKitty failure
by Gelpi Andrea 24 Jun '20

24 Jun '20

Hi, in mailman log I found: Jun 20 17:36:49 2020 (1269) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/urls: <html><title>Forbidden</title><body> <h1>Access is forbidden</h1></body></html> (403) Jun 20 17:36:49 2020 (1263) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/archive: (405) Jun 20 17:36:49 2020 (1263) Exception in the HyperKitty archiver: Jun 20 17:36:49 2020 (1263) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", line 154, in _archive_message url = self._send_message(mlist, msg) File "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", line 210, in _send_message raise ValueError(result.text) ValueError And checking archive list I notice nothing has been added. Is it a permission issue (where?) or something else? Thanks in advance. -- Gelpi ing. Andrea -------------------------------------------------------------- It took the computing power of three C-64s to fly to the Moon. It takes a 486 to run Windows 95. Something is wrong here. --------------------------------------------------------------

3 4

List archives Recent Posts problem
by Mark Dadgar 23 Jun '20

23 Jun '20

In the last day or so, hitting the Recent page in my list archives results in a spinner and an error message: Internal Server Error: /mailman3/hyperkitty/list/trackjunkies(a)pdc-racing.net <mailto:mailman3/hyperkitty/list/trackjunkies@pdc-racing.net>/recent-threads AttributeError at /hyperkitty/list/trackjunkies(a)pdc-racing.net <mailto:hyperkitty/list/trackjunkies@pdc-racing.net>/recent-threads 'NoneType' object has no attribute 'subject' Request Method: GET Request URL: https://mail.pdc-racing.net/mailman3/hyperkitty/list/trackjunkies@pdc-racin… <https://mail.pdc-racing.net/mailman3/hyperkitty/list/trackjunkies@pdc-racin…> Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Thu, 18 Jun 2020 08:58:02 -0700 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/template/base.py" in _resolve_lookup 829. current = current[bit] During handling of the above exception ('Thread' object is not subscriptable), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/lib/view_helpers.py" in inner 135. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mlist.py" in overview_recent_threads 194. return render(request, "hyperkitty/fragments/overview_threads.html", { File "/usr/lib/python3/dist-packages/django/shortcuts.py" in render 36. content = loader.render_to_string(template_name, context, request, using=using) File "/usr/lib/python3/dist-packages/django/template/loader.py" in render_to_string 62. return template.render(context, request) File "/usr/lib/python3/dist-packages/django/template/backends/django.py" in render 61. return self.template.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 171. return self._render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in _render 163. return self.nodelist.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/usr/lib/python3/dist-packages/django/template/defaulttags.py" in render 309. return nodelist.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 937. bit = node.render_annotated(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/usr/lib/python3/dist-packages/django/template/defaulttags.py" in render 209. nodelist.append(node.render_annotated(context)) File "/usr/lib/python3/dist-packages/django/template/base.py" in render_annotated 904. return self.render(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in render 987. output = self.filter_expression.resolve(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in resolve 671. obj = self.var.resolve(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in resolve 796. value = self._resolve_lookup(context) File "/usr/lib/python3/dist-packages/django/template/base.py" in _resolve_lookup 837. current = getattr(current, bit) File "/usr/lib/python3/dist-packages/hyperkitty/models/thread.py" in subject 108. return self.cached_values["subject"]() File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in __call__ 59. return self.get_or_set(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in get_or_set 55. value = self.rebuild(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/common.py" in rebuild 47. value = self.get_value(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/models/thread.py" in get_value 223. return self.instance.starting_email.subject Exception Type: AttributeError at /hyperkitty/list/trackjunkies(a)pdc-racing.net <mailto:hyperkitty/list/trackjunkies@pdc-racing.net>/recent-threads Exception Value: 'NoneType' object has no attribute 'subject' Request information: USER: admin Thoughts? Other than that I really need to migrate off the Ubuntu packages and into the latest docker image. 😁 - Mark ----- mark(a)pdc-racing.net | 408-348-2878

3 4

Relaying email from external SMTP server (office365 or Exchange)
by Waqas Ahmed Khan 23 Jun '20

23 Jun '20

Hi, I have installed mailman3 with postfix. The server is working fine. To protect the IPs from blacklisting, I want to relay all emails from postfix/mailman to external SMTP servers like O365, Gmail, or our exchange server. Could you please confirm is this possible. And how to do its configuration. Regards, *Waqas Ahmed Khan* p: +923212608044 Skype: waqas-ahmed00 <waqas.ahmed0(a)gmail.com> waqas.ahmed0(a)gmail.com [image: LinkedIn] <http://pk.linkedin.com/pub/waqas-ahmed-khan/15/96a/39a/> <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_cam…> Virus-free. www.avg.com <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_cam…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 3

Key Error when clicking on a list
by Jacob Bargery 21 Jun '20

21 Jun '20

I looked back and tried to see if this is related to the Filter_Vhost = true error. In the email log I received at the bottom where it lists settings I am seeing Filter_Vhost = false. So I am guessing it is not related I could be wrong though. I can see lists populated that have been created, but when I click to open them it immediately goes to page titled "Server Error" and reading "An error occurred while processing your request.". This is part of the email, I can include the rest with settings if that will help. Internal Server Error: /mailman3/postorius/lists/testlist.groups.smccme.edu/ KeyError at /postorius/lists/testlist.groups.smccme.edu/ 'file' Request Method: GET Request URL: http://groups.smccme.edu/mailman3/postorius/lists/testlist.groups.smccme.ed… Django Version: 2.2.12 Python Executable: /usr/bin/uwsgi-core Python Version: 3.8.2 Python Path: ['.', '', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Fri, 19 Jun 2020 15:58:55 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 115. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 113. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in view 71. return self.dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/generic.py" in dispatch 65. return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in dispatch 97. return handler(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/list.py" in get 252. 'hyperkitty' in self.mailing_list.archivers and # noqa: W504 File "/usr/lib/python3.8/_collections_abc.py" in __contains__ 666. self[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __getitem__ 151. return self._get(key) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in _get 90. return self.rest_data[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 76. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 34. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 36. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 91. log_response( File "/usr/lib/python3/dist-packages/django/utils/log.py" in log_response 222. getattr(logger, level)( File "/usr/lib/python3.8/logging/__init__.py" in error 1463. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.8/logging/__init__.py" in _log 1577. self.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 1587. self.callHandlers(record) File "/usr/lib/python3.8/logging/__init__.py" in callHandlers 1649. hdlr.handle(record) File "/usr/lib/python3.8/logging/__init__.py" in handle 950. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 119. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.8/tempfile.py" in __getattr__ 607. file = self.__dict__['file'] Exception Type: KeyError at /postorius/lists/testlist.groups.smccme.edu/ Exception Value: 'file' Request information: USER: AnonymousUser GET: No GET data POST: No POST data FILES: No FILES data COOKIES: _gcl_au = '1.1.1102478800.1589213781' _ga = 'GA1.2.1690352573.1589213781' _fbp = 'fb.1.1589213781323.923398139' _vwo_uuid_v2 = 'DFA87B9402ED2688F901371C0D8762876|62ec9e1b3ef24592591d21d8721a02f4' __unam = '9d295ea-172141ffc75-1251e599-36' csrftoken = 'Pw0mKujRHosZ9QrA92GxhGVJHNN72qQBYU5NOMkizBHbdKSDLwjHIMsHnYdsNL3C'

2 3

Does mailman2 regular_exclude_list equal mailman3 receive_list_copy ?
by sunil soprey 21 Jun '20

21 Jun '20

Question: Reduce cross-posting to multiple lists (either BCC: or To: or CC:) Use-case: User sends email ( to: their email) and ( bcc: list1, list2 ) The sender-user and target-user1 (and target-userX) have receive_list_copy = False, and receive_own = True Issue: For mailman 3.3.1, a user receives their email from To:, however target receipients receive multiple copies of the emails. This is different from mailman2 with the regular_exclude_list. Questions: * this is a configuration issue or expected behaviour ? * target-user is a "user" who is member on list1 and list2 (verified via api) * see list-config - any missing? { "acceptable_aliases": [], "accept_these_nonmembers": [], "admin_immed_notify": true, "admin_notify_mchanges": false, "administrivia": true, "advertised": true, "allow_list_posts": true, "anonymous_list": false, "archive_policy": "public", "autorespond_owner": "none", "autorespond_postings": "none", "autorespond_requests": "none", "autoresponse_grace_period": "90d", "autoresponse_owner_text": "", "autoresponse_postings_text": "", "autoresponse_request_text": "", "bounces_address": "duplicate1-bounces(a)mydomain.local", "bounce_info_stale_after": "7d", "bounce_notify_owner_on_disable": true, "bounce_notify_owner_on_removal": true, "bounce_score_threshold": 5, "bounce_you_are_disabled_warnings": 3, "bounce_you_are_disabled_warnings_interval": "7d", "collapse_alternatives": false, "convert_html_to_plaintext": false, "created_at": "2020-05-31T14:43:48", "default_member_action": "defer", "default_nonmember_action": "hold", "description": "", "digest_last_sent_at": "2020-06-04T00:41:35", "digest_send_periodic": true, "digest_size_threshold": 30.0, "digest_volume_frequency": "monthly", "digests_enabled": true, "display_name": "Duplicate1", "discard_these_nonmembers": [], "dmarc_mitigate_action": "munge_from", "dmarc_mitigate_unconditionally": true, "dmarc_moderation_notice": "", "dmarc_wrapped_message_text": "", "filter_action": "discard", "filter_content": true, "filter_extensions": [ "exe", "bat", "cmd", "com", "pif", "cpl" ], "filter_types": [], "first_strip_reply_to": false, "forward_unrecognized_bounces_to": "administrators", "fqdn_listname": "duplicate1(a)mydomain.local", "gateway_to_mail": false, "gateway_to_news": false, "hold_these_nonmembers": [], "include_rfc2369_headers": true, "info": "", "join_address": "duplicate1-join(a)mydomain.local", "last_post_at": "2020-06-04T01:17:13", "leave_address": "duplicate1-leave(a)mydomain.local", "linked_newsgroup": "", "list_name": "duplicate1", "mail_host": "mydomain.local", "max_message_size": 9990, "max_num_recipients": 10, "max_days_to_hold": 0, "member_roster_visibility": "moderators", "moderator_password": null, "newsgroup_moderation": "none", "next_digest_number": 5, "nntp_prefix_subject_too": true, "no_reply_address": "noreply(a)mydomain.local", "owner_address": "duplicate1-owner(a)mydomain.local", "pass_types": [], "pass_extensions": [], "personalize": "none", "post_id": 51, "posting_address": "duplicate1(a)mydomain.local", "posting_pipeline": "default-posting-pipeline", "preferred_language": "en", "process_bounces": true, "reject_these_nonmembers": [], "reply_goes_to_list": "point_to_list", "reply_to_address": "duplicate1(a)mydomain.local", "request_address": "duplicate1-request(a)mydomain.local", "require_explicit_destination": false, "respond_to_post_requests": true, "send_welcome_message": true, "subject_prefix": "[Duplicate1] ", "subscription_policy": "confirm", "unsubscription_policy": "confirm", "usenet_watermark": null, "volume": 1, "http_etag": "\"8ec001cb705f24c19f1a48de5b551a6a9653fcd6\"" }

3 3

Is there a "global" max_message_size?
by skenny＠scss.tcd.ie 20 Jun '20

20 Jun '20

I'm running Mailman under Docker (maxking). I've a test list with a max_message_size set to 0 (unlimited). I know it's not what anyone should be doing in production, but I still want to test this. I've sent a series of messages with increasingly larger attachments to the list. Going up in 5MB increments, I find that while a message with a 15MB attachement gets through to the list members, a 20MB one doesn't. The interesting thing is the message in the mail logs: Jun 19 11:44:50 venus postfix/lmtp[17630]: C0C7928564: to=<mj(a)lists.scss.tcd.ie>, relay=172.19.199.2[172.19.199.2]:8024, delay=109, delays=2.2/0.04/0.01/107, dsn=5.0.0, status=bounced (host 172.19.199.2[172.19.199.2] said: 552 Error: Too much mail data (in reply to end of DATA command)) So 172.19.199.2 is complaining about "Too much mail data". That's the IP address of the mailman-core container. I'm wondering why this is happening, and where the decision is being made, as it seems at odds with the fact that the mailing list has no limit on message size. Would be grateful for any insights, many thanks. Stephen Kenny

2 3

hyperkitty: "incorrect string value" for botched utf-8 encoding
by thoralf 20 Jun '20

20 Jun '20

hi, my hyperkitty installation (3.2.1 from debian buster) started to act up recently with (1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") for every new mail that is about to be archived, i'll quote the full error mail at the end of this mail. i traced the issue to a slighty smiling face (aka u+1f642) in this rather interestingly encoded email: […] Content-Type: multipart/mixed; boundary="===============2457401976140816263==" --===============2457401976140816263== Content-Type: multipart/alternative; boundary="5ecb6fd9_327b23c6_2042" --5ecb6fd9_327b23c6_2042 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline kann halt NIE am mittwoch. viel spass =F0=9F=99=82 […] --5ecb6fd9_327b23c6_2042 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline <html xmlns=3D=22http://www.w3.org/1999/xhtml=22> […] <div dir=3D=22auto=22>kann halt NIE am mittwoch. viel spass =F0=9F=99=82<= /div> --5ecb6fd9_327b23c6_2042-- […] --===============2457401976140816263==-- … which still lingers around in /var/lib/mailman3/archives/hyperkitty/spool . is this to be expected, or might it be a good idea to amend mailman3 / hyperkitty to deal with this more gracefully? thank you & with kind regards, t. --- Internal Server Error: /hyperkitty/api/mailman/archive OperationalError at /hyperkitty/api/mailman/archive (1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") Request Method: POST Request URL: https://redacted Django Version: 1.11.28 Python Executable: /usr/bin/uwsgi-core Python Version: 3.7.3 Python Path: ['.', '', '/usr/lib/python37.zip', '/usr/lib/python3.7', '/usr/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/dist-packages', '/usr/lib/python3/dist-packages'] Server time: Mon, 25 May 2020 13:26:09 +0000 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount') Installed Middleware: ('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware') Traceback: File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 101. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 250. self.errorhandler(self, exc, value) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in defaulterrorhandler 50. raise errorvalue File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 247. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 411. rowcount = self._do_query(q) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _do_query 374. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 292. _mysql.connection.query(self, query) The above exception ((1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1")) was the direct cause of the following exception: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/http.py" in inner 40. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in _decorator 69. return func(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/decorators/csrf.py" in wrapped_view 58. return view_func(*args, **kwargs) File "/usr/lib/python3/dist-packages/hyperkitty/views/mailman.py" in archive 115. add_to_list(mlist_fqdn, msg) File "/usr/lib/python3/dist-packages/hyperkitty/lib/incoming.py" in add_to_list 151. email.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save 808. force_update=force_update, update_fields=update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in save_base 838. updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _save_table 924. result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/lib/python3/dist-packages/django/db/models/base.py" in _do_insert 963. using=using, raw=raw) File "/usr/lib/python3/dist-packages/django/db/models/manager.py" in manager_method 85. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/lib/python3/dist-packages/django/db/models/query.py" in _insert 1079. return query.get_compiler(using=using).execute_sql(return_id) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py" in execute_sql 1112. cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py" in __exit__ 94. six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/lib/python3/dist-packages/django/utils/six.py" in reraise 685. raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py" in execute 64. return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py" in execute 101. return self.cursor.execute(query, args) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 250. self.errorhandler(self, exc, value) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in defaulterrorhandler 50. raise errorvalue File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in execute 247. res = self._query(query) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _query 411. rowcount = self._do_query(q) File "/usr/lib/python3/dist-packages/MySQLdb/cursors.py" in _do_query 374. db.query(q) File "/usr/lib/python3/dist-packages/MySQLdb/connections.py" in query 292. _mysql.connection.query(self, query) Exception Type: OperationalError at /hyperkitty/api/mailman/archive Exception Value: (1366, "Incorrect string value: '\\xF0\\x9F\\x99\\x82\\x0AA...' for column `mailman3web`.`hyperkitty_email`.`content` at row 1") Request information: USER: AnonymousUser GET: key = 'redacted' POST: mlist = 'redacted' FILES: message = <InMemoryUploadedFile: message.txt ()> COOKIES: No cookie data META: CONTENT_LENGTH = '6223' CONTENT_TYPE = 'multipart/form-data; boundary=4cd93acbb8c0c45d7bd46fdf1d6a31fa' CONTEXT_DOCUMENT_ROOT = '/var/www/html' CONTEXT_PREFIX = '' DOCUMENT_ROOT = '/var/www/html' GATEWAY_INTERFACE = 'CGI/1.1' HTTPS = 'on' HTTP_ACCEPT = '*/*' HTTP_ACCEPT_ENCODING = 'gzip, deflate' HTTP_CONNECTION = 'keep-alive' HTTP_HOST = 'lists.bing-bong.de' HTTP_USER_AGENT = 'python-requests/2.21.0' PATH = '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' PATH_INFO = '/hyperkitty/api/mailman/archive' QUERY_STRING = 'key=redacted' REMOTE_ADDR = '78.47.218.110' REMOTE_PORT = '36358' REQUEST_METHOD = 'POST' REQUEST_SCHEME = 'https' REQUEST_URI = 'redacted' SCRIPT_FILENAME = 'proxy:uwsgi://localhost/hyperkitty/api/mailman/archive' SCRIPT_NAME = '' SERVER_ADDR = '78.47.218.110' SERVER_ADMIN = 'admin(a)bing-bong.de' SERVER_NAME = 'lists.bing-bong.de' SERVER_PORT = '443' SERVER_PROTOCOL = 'HTTP/1.1' SERVER_SIGNATURE = '<address>Apache/2.4.38 (Debian) Server at lists.bing-bong.de Port 443</address>\n' SERVER_SOFTWARE = 'Apache/2.4.38 (Debian)' SSL_TLS_SNI = 'lists.bing-bong.de' uwsgi.core = 1 uwsgi.node = b'bing-bong' uwsgi.version = b'2.0.18-debian' wsgi.errors = <_io.TextIOWrapper name=2 mode='w' encoding='UTF-8'> wsgi.file_wrapper = '' wsgi.input = <uwsgi._Input object at 0x7f2ae6af2d68> wsgi.multiprocess = False wsgi.multithread = True wsgi.run_once = False wsgi.url_scheme = 'https' wsgi.version = '(1, 0)' Settings: Using settings module settings ABSOLUTE_URL_OVERRIDES = {} ACCOUNT_AUTHENTICATION_METHOD = 'username_email' ACCOUNT_DEFAULT_HTTP_PROTOCOL = 'https' ACCOUNT_EMAIL_REQUIRED = True ACCOUNT_EMAIL_VERIFICATION = 'mandatory' ACCOUNT_UNIQUE_EMAIL = True ADMINS = "(('Mailman Suite Admin', 'mm3admin(a)bing-bong.de'),)" ALLOWED_HOSTS = ['*'] APPEND_SLASH = True AUTHENTICATION_BACKENDS = "('django.contrib.auth.backends.ModelBackend', 'allauth.account.auth_backends.AuthenticationBackend')" AUTH_PASSWORD_VALIDATORS = '********************' AUTH_USER_MODEL = 'auth.User' BASE_DIR = '/usr/share/mailman3-web' CACHES = {'default': {'BACKEND': 'django.core.cache.backends.locmem.LocMemCache'}} CACHE_MIDDLEWARE_ALIAS = 'default' CACHE_MIDDLEWARE_KEY_PREFIX = '********************' CACHE_MIDDLEWARE_SECONDS = 600 COMPRESS_CACHEABLE_PRECOMPILERS = '()' COMPRESS_CACHE_BACKEND = 'default' COMPRESS_CACHE_KEY_FUNCTION = '********************' COMPRESS_CLEAN_CSS_ARGUMENTS = '' COMPRESS_CLEAN_CSS_BINARY = 'cleancss' COMPRESS_CLOSURE_COMPILER_ARGUMENTS = '' COMPRESS_CLOSURE_COMPILER_BINARY = 'java -jar compiler.jar' COMPRESS_CSS_COMPRESSOR = 'compressor.css.CssCompressor' COMPRESS_CSS_FILTERS = ['compressor.filters.css_default.CssAbsoluteFilter'] COMPRESS_CSS_HASHING_METHOD = 'mtime' COMPRESS_DATA_URI_MAX_SIZE = 1024 COMPRESS_DEBUG_TOGGLE = None COMPRESS_ENABLED = True COMPRESS_JINJA2_GET_ENVIRONMENT = <function CompressorConf.JINJA2_GET_ENVIRONMENT at 0x7f2ae8341f28> COMPRESS_JS_COMPRESSOR = 'compressor.js.JsCompressor' COMPRESS_JS_FILTERS = ['compressor.filters.jsmin.JSMinFilter'] COMPRESS_MINT_DELAY = 30 COMPRESS_MTIME_DELAY = 10 COMPRESS_OFFLINE = True COMPRESS_OFFLINE_CONTEXT = {'STATIC_URL': '/mailman3/static/'} COMPRESS_OFFLINE_MANIFEST = 'manifest.json' COMPRESS_OFFLINE_TIMEOUT = 31536000 COMPRESS_OUTPUT_DIR = 'CACHE' COMPRESS_PARSER = 'compressor.parser.AutoSelectParser' COMPRESS_PRECOMPILERS = "(('text/less', 'lessc {infile} {outfile}'), ('text/x-scss', 'sassc -t compressed {infile} {outfile}'), ('text/x-sass', 'sassc -t compressed {infile} {outfile}'))" COMPRESS_REBUILD_TIMEOUT = 2592000 COMPRESS_ROOT = '/var/lib/mailman3/web/static' COMPRESS_STORAGE = 'compressor.storage.CompressorFileStorage' COMPRESS_TEMPLATE_FILTER_CONTEXT = {'STATIC_URL': '/mailman3/static/'} COMPRESS_URL = '/mailman3/static/' COMPRESS_URL_PLACEHOLDER = '/__compressor_url_placeholder__/' COMPRESS_VERBOSE = False COMPRESS_YUGLIFY_BINARY = 'yuglify' COMPRESS_YUGLIFY_CSS_ARGUMENTS = '--terminal' COMPRESS_YUGLIFY_JS_ARGUMENTS = '--terminal' COMPRESS_YUI_BINARY = 'java -jar yuicompressor.jar' COMPRESS_YUI_CSS_ARGUMENTS = '' COMPRESS_YUI_JS_ARGUMENTS = '' CSRF_COOKIE_AGE = 31449600 CSRF_COOKIE_DOMAIN = None CSRF_COOKIE_HTTPONLY = False CSRF_COOKIE_NAME = 'csrftoken' CSRF_COOKIE_PATH = '/' CSRF_COOKIE_SECURE = False CSRF_FAILURE_VIEW = 'django.views.csrf.csrf_failure' CSRF_HEADER_NAME = 'HTTP_X_CSRFTOKEN' CSRF_TRUSTED_ORIGINS = [] CSRF_USE_SESSIONS = False DATABASES = {'default': {'ENGINE': 'django.db.backends.mysql', 'NAME': 'mailman3web', 'USER': 'mailman3web', 'PASSWORD': '********************', 'HOST': 'localhost', 'PORT': '', 'OPTIONS': {'init_command': "SET sql_mode='STRICT_TRANS_TABLES'"}, 'ATOMIC_REQUESTS': False, 'AUTOCOMMIT': True, 'CONN_MAX_AGE': 0, 'TIME_ZONE': None, 'TEST': {'CHARSET': None, 'COLLATION': None, 'NAME': None, 'MIRROR': None}}} DATABASE_ROUTERS = [] DATA_UPLOAD_MAX_MEMORY_SIZE = 2621440 DATA_UPLOAD_MAX_NUMBER_FIELDS = 1000 DATETIME_FORMAT = 'N j, Y, P' DATETIME_INPUT_FORMATS = ['%Y-%m-%d %H:%M:%S', '%Y-%m-%d %H:%M:%S.%f', '%Y-%m-%d %H:%M', '%Y-%m-%d', '%m/%d/%Y %H:%M:%S', '%m/%d/%Y %H:%M:%S.%f', '%m/%d/%Y %H:%M', '%m/%d/%Y', '%m/%d/%y %H:%M:%S', '%m/%d/%y %H:%M:%S.%f', '%m/%d/%y %H:%M', '%m/%d/%y'] DATE_FORMAT = 'N j, Y' DATE_INPUT_FORMATS = ['%Y-%m-%d', '%m/%d/%Y', '%m/%d/%y', '%b %d %Y', '%b %d, %Y', '%d %b %Y', '%d %b, %Y', '%B %d %Y', '%B %d, %Y', '%d %B %Y', '%d %B, %Y'] DEBUG = False DEBUG_PROPAGATE_EXCEPTIONS = False DECIMAL_SEPARATOR = '.' DEFAULT_CHARSET = 'utf-8' DEFAULT_CONTENT_TYPE = 'text/html' DEFAULT_EXCEPTION_REPORTER_FILTER = 'django.views.debug.SafeExceptionReporterFilter' DEFAULT_FILE_STORAGE = 'django.core.files.storage.FileSystemStorage' DEFAULT_FROM_EMAIL = 'postorius(a)bing-bong.de' DEFAULT_INDEX_TABLESPACE = '' DEFAULT_TABLESPACE = '' DISALLOWED_USER_AGENTS = [] EMAILNAME = 'bing-bong.de' EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'localhost' EMAIL_HOST_PASSWORD = '********************' EMAIL_HOST_USER = '' EMAIL_PORT = 25 EMAIL_SSL_CERTFILE = None EMAIL_SSL_KEYFILE = '********************' EMAIL_SUBJECT_PREFIX = '[Django] ' EMAIL_TIMEOUT = None EMAIL_USE_LOCALTIME = False EMAIL_USE_SSL = False EMAIL_USE_TLS = False FILE_CHARSET = 'utf-8' FILE_UPLOAD_DIRECTORY_PERMISSIONS = None FILE_UPLOAD_HANDLERS = ['django.core.files.uploadhandler.MemoryFileUploadHandler', 'django.core.files.uploadhandler.TemporaryFileUploadHandler'] FILE_UPLOAD_MAX_MEMORY_SIZE = 2621440 FILE_UPLOAD_PERMISSIONS = None FILE_UPLOAD_TEMP_DIR = None FILTER_VHOST = False FIRST_DAY_OF_WEEK = 0 FIXTURE_DIRS = [] FORCE_SCRIPT_NAME = None FORMAT_MODULE_PATH = None FORM_RENDERER = 'django.forms.renderers.DjangoTemplates' HAYSTACK_CONNECTIONS = {'default': {'ENGINE': 'haystack.backends.whoosh_backend.WhooshEngine', 'PATH': '/var/lib/mailman3/web/fulltext_index'}} HOSTNAME = 'localhost.local' IGNORABLE_404_URLS = [] INSTALLED_APPS = "('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount')" INTERNAL_IPS = [] LANGUAGES = [('af', 'Afrikaans'), ('ar', 'Arabic'), ('ast', 'Asturian'), ('az', 'Azerbaijani'), ('bg', 'Bulgarian'), ('be', 'Belarusian'), ('bn', 'Bengali'), ('br', 'Breton'), ('bs', 'Bosnian'), ('ca', 'Catalan'), ('cs', 'Czech'), ('cy', 'Welsh'), ('da', 'Danish'), ('de', 'German'), ('dsb', 'Lower Sorbian'), ('el', 'Greek'), ('en', 'English'), ('en-au', 'Australian English'), ('en-gb', 'British English'), ('eo', 'Esperanto'), ('es', 'Spanish'), ('es-ar', 'Argentinian Spanish'), ('es-co', 'Colombian Spanish'), ('es-mx', 'Mexican Spanish'), ('es-ni', 'Nicaraguan Spanish'), ('es-ve', 'Venezuelan Spanish'), ('et', 'Estonian'), ('eu', 'Basque'), ('fa', 'Persian'), ('fi', 'Finnish'), ('fr', 'French'), ('fy', 'Frisian'), ('ga', 'Irish'), ('gd', 'Scottish Gaelic'), ('gl', 'Galician'), ('he', 'Hebrew'), ('hi', 'Hindi'), ('hr', 'Croatian'), ('hsb', 'Upper Sorbian'), ('hu', 'Hungarian'), ('ia', 'Interlingua'), ('id', 'Indonesian'), ('io', 'Ido'), ('is', 'Icelandic'), ('it', 'Italian'), ('ja', 'Japanese'), ('ka', 'Georgian'), ('kk', 'Kazakh'), ('km', 'Khmer'), ('kn', 'Kannada'), ('ko', 'Korean'), ('lb', 'Luxembourgish'), ('lt', 'Lithuanian'), ('lv', 'Latvian'), ('mk', 'Macedonian'), ('ml', 'Malayalam'), ('mn', 'Mongolian'), ('mr', 'Marathi'), ('my', 'Burmese'), ('nb', 'Norwegian Bokmål'), ('ne', 'Nepali'), ('nl', 'Dutch'), ('nn', 'Norwegian Nynorsk'), ('os', 'Ossetic'), ('pa', 'Punjabi'), ('pl', 'Polish'), ('pt', 'Portuguese'), ('pt-br', 'Brazilian Portuguese'), ('ro', 'Romanian'), ('ru', 'Russian'), ('sk', 'Slovak'), ('sl', 'Slovenian'), ('sq', 'Albanian'), ('sr', 'Serbian'), ('sr-latn', 'Serbian Latin'), ('sv', 'Swedish'), ('sw', 'Swahili'), ('ta', 'Tamil'), ('te', 'Telugu'), ('th', 'Thai'), ('tr', 'Turkish'), ('tt', 'Tatar'), ('udm', 'Udmurt'), ('uk', 'Ukrainian'), ('ur', 'Urdu'), ('vi', 'Vietnamese'), ('zh-hans', 'Simplified Chinese'), ('zh-hant', 'Traditional Chinese')] LANGUAGES_BIDI = ['he', 'ar', 'fa', 'ur'] LANGUAGE_CODE = 'en-us' LANGUAGE_COOKIE_AGE = None LANGUAGE_COOKIE_DOMAIN = None LANGUAGE_COOKIE_NAME = 'django_language' LANGUAGE_COOKIE_PATH = '/' LOCALE_PATHS = [] LOGGING = {'version': 1, 'disable_existing_loggers': False, 'filters': {'require_debug_false': {'()': 'django.utils.log.RequireDebugFalse'}}, 'handlers': {'mail_admins': {'level': 'ERROR', 'filters': ['require_debug_false'], 'class': 'django.utils.log.AdminEmailHandler'}, 'file': {'level': 'INFO', 'class': 'logging.handlers.RotatingFileHandler', 'filename': '/var/log/mailman3/web/mailman-web.log', 'formatter': 'verbose'}, 'console': {'class': 'logging.StreamHandler', 'formatter': 'simple'}}, 'loggers': {'django.request': {'handlers': ['mail_admins', 'file'], 'level': 'INFO', 'propagate': True}, 'django': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}, 'hyperkitty': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}, 'postorius': {'handlers': ['file'], 'level': 'INFO', 'propagate': True}}, 'formatters': {'verbose': {'format': '%(levelname)s %(asctime)s %(process)d %(name)s %(message)s'}, 'simple': {'format': '%(levelname)s %(message)s'}}} LOGGING_CONFIG = 'logging.config.dictConfig' LOGIN_REDIRECT_URL = 'list_index' LOGIN_URL = 'account_login' LOGOUT_REDIRECT_URL = None LOGOUT_URL = 'account_logout' MAILMAN_ARCHIVER_FROM = "('127.0.0.1', '::1', '78.47.218.110', '2a01:4f8:c17:567::2/64')" MAILMAN_ARCHIVER_KEY = '********************' MAILMAN_REST_API_PASS = '********************' MAILMAN_REST_API_URL = '********************' MAILMAN_REST_API_USER = '********************' MANAGERS = [] MEDIA_ROOT = '' MEDIA_URL = '' MESSAGE_STORAGE = 'django.contrib.messages.storage.fallback.FallbackStorage' MESSAGE_TAGS = {40: 'danger'} MIDDLEWARE = "('django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.middleware.locale.LocaleMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware', 'django.middleware.security.SecurityMiddleware', 'django_mailman3.middleware.TimezoneMiddleware', 'postorius.middleware.PostoriusMiddleware')" MIDDLEWARE_CLASSES = ['django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware'] MIGRATION_MODULES = {} MONTH_DAY_FORMAT = 'F j' NUMBER_GROUPING = 0 PASSWORD_HASHERS = '********************' PASSWORD_RESET_TIMEOUT_DAYS = '********************' POSTORIUS_TEMPLATE_BASE_URL = 'http://lists.bing-bong.de/mailman3/' PREPEND_WWW = False Q_CLUSTER = {'timeout': 300, 'save_limit': 100, 'orm': 'default', 'poll': 5} ROOT_URLCONF = 'urls' SECRET_KEY = '********************' SECURE_BROWSER_XSS_FILTER = False SECURE_CONTENT_TYPE_NOSNIFF = False SECURE_HSTS_INCLUDE_SUBDOMAINS = False SECURE_HSTS_PRELOAD = False SECURE_HSTS_SECONDS = 0 SECURE_PROXY_SSL_HEADER = None SECURE_REDIRECT_EXEMPT = [] SECURE_SSL_HOST = None SECURE_SSL_REDIRECT = False SERVER_EMAIL = 'root(a)bing-bong.de' SESSION_CACHE_ALIAS = 'default' SESSION_COOKIE_AGE = 1209600 SESSION_COOKIE_DOMAIN = None SESSION_COOKIE_HTTPONLY = True SESSION_COOKIE_NAME = 'sessionid' SESSION_COOKIE_PATH = '/' SESSION_COOKIE_SECURE = False SESSION_ENGINE = 'django.contrib.sessions.backends.db' SESSION_EXPIRE_AT_BROWSER_CLOSE = False SESSION_FILE_PATH = None SESSION_SAVE_EVERY_REQUEST = False SESSION_SERIALIZER = 'django.contrib.sessions.serializers.PickleSerializer' SETTINGS_MODULE = 'settings' SHORT_DATETIME_FORMAT = 'm/d/Y P' SHORT_DATE_FORMAT = 'm/d/Y' SIGNING_BACKEND = 'django.core.signing.TimestampSigner' SILENCED_SYSTEM_CHECKS = [] SITE_ID = 1 SOCIALACCOUNT_PROVIDERS = {} STATICFILES_DIRS = '()' STATICFILES_FINDERS = "('django.contrib.staticfiles.finders.FileSystemFinder', 'django.contrib.staticfiles.finders.AppDirectoriesFinder', 'compressor.finders.CompressorFinder')" STATICFILES_STORAGE = 'django.contrib.staticfiles.storage.StaticFilesStorage' STATIC_ROOT = '/var/lib/mailman3/web/static' STATIC_URL = '/mailman3/static/' TEMPLATES = [{'BACKEND': 'django.template.backends.django.DjangoTemplates', 'DIRS': [], 'APP_DIRS': True, 'OPTIONS': {'context_processors': ['django.template.context_processors.debug', 'django.template.context_processors.i18n', 'django.template.context_processors.media', 'django.template.context_processors.static', 'django.template.context_processors.tz', 'django.template.context_processors.csrf', 'django.template.context_processors.request', 'django.contrib.auth.context_processors.auth', 'django.contrib.messages.context_processors.messages', 'django_mailman3.context_processors.common', 'hyperkitty.context_processors.common', 'postorius.context_processors.postorius']}}] TEST_NON_SERIALIZED_APPS = [] TEST_RUNNER = 'django.test.runner.DiscoverRunner' THOUSAND_SEPARATOR = ',' TIME_FORMAT = 'P' TIME_INPUT_FORMATS = ['%H:%M:%S', '%H:%M:%S.%f', '%H:%M'] TIME_ZONE = 'UTC' USE_ETAGS = False USE_I18N = True USE_L10N = True USE_THOUSAND_SEPARATOR = False USE_TZ = True USE_X_FORWARDED_HOST = True USE_X_FORWARDED_PORT = False WSGI_APPLICATION = 'wsgi.application' X_FRAME_OPTIONS = 'SAMEORIGIN' YEAR_MONTH_FORMAT = 'F Y'

2 3

locked files problem after reboot
by mailman3＠malevil.cc 20 Jun '20

20 Jun '20

hey, I have got a problem with flufl.lock in mailman3. When my server is rebooted, locked files seems to stay and cause errors so mailman3 core wont start (it is started automatically by supervisord service): PermissionError: [Errno 1] Operation not permitted Traceback (most recent call last): File "/home/user/.local/lib/python3.6/site-packages/mailman/bin/master.py", line 146, in acquire_lock lock = acquire_lock_1(force) File "/home/user/.local/lib/python3.6/site-packages/mailman/bin/master.py", line 125, in acquire_lock_1 lock.lock(timedelta(seconds=0.1)) File "/home/user/.local/lib/python3.6/site-packages/flufl/lock/_lockfile.py", line 259, in lock raise TimeOutError('Could not acquire the lock') flufl.lock._lockfile.TimeOutError: Could not acquire the lock I have to remove the files in var/locks manually to go forward. Is there a configuration error for my setup? Or is it just a not fixed bug? Greetsn, jekyl

3 4

Exim: is it possible to host mailman and exim on different hosts? Howto?
by Jörg Schulz 20 Jun '20

20 Jun '20

as of the documentation, https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… , exim4 (and postfix similarly) need to have access to the mailman filesystem (MM3_HOME=/opt/mailman/var). If exim and MM would be on different hosts (or different docker environments), how would we need to configure that?

3 2

What database to choose for production deployment: Postgres or MySql
by pgrzywaczewski＠gmail.com 20 Jun '20

20 Jun '20

Hi, What database is better for large deployment: Postgres or MySql? 'Large' means - around 15k mailing lists - 36k incoming messages per day - 270k outgoing messages per day distributed to recipients Is there preference from performance point of view? Or something else worth mentioning? Thanks, Paweł

4 4

how to delete a list member using the Linux command line
by Mike Wertheim 19 Jun '20

19 Jun '20

I have Mailman 3.2.1 installed (on Debian Linux), using exim4 as the MTA. I have been trying to figure out how to use the Linux command line to add members to a list and delete members from a list, but am having trouble with deleting. Here is what works for adding a list member... % echo mike(a)foo.com | mailman members --add - mylist(a)domain.org Here is what works for viewing the list members... % mailman members mylist(a)domain.org But I'm having trouble deleting a member. Here is what I have tried that didn't work... # echo mike(a)foo.com | mailman members --delete - mylist(a)domain.org Usage: mailman members [OPTIONS] LISTSPEC Try "mailman members -h" for help. Error: no such option: --delete # echo mike(a)foo.com | mailman members --delmembers - mylist(a)domain.org Usage: mailman members [OPTIONS] LISTSPEC Try "mailman members -h" for help. Error: no such option: --delmembers What is the correct command to delete the member mike(a)foo.com from the list mylist(a)domain.org? (I ran "mailman members -h", and it mentions "add" but does not mention deleting at all.)

2 3

LTMP to Postfix problem
by Brian Carpenter 19 Jun '20

19 Jun '20

On one of my mailman 3 servers, I am having a problem with Postfix failing to deliver email to Mailman. I keep seeing this in the mail.log: status=deferred (connect to 127.0.0.1[127.0.0.1]:8024: Connection refused) What is causing this and how can I fix it? -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

4 12

Mailman do not honor non-members moderation setting sometimes
by Alan So 19 Jun '20

19 Jun '20

Some of our users reported that their list do not honor the nonmembers moderation setting sometimes. We were not able to repeat the issue consistently earlier. Luckily, we found the following way to repeat the issue: 1) Create a new list with user(a)example.com as owner. (Ordinary disussion mailing list style) 2) Change the list Settings -> Message Acceptance -> Default action to take when a non-member posts to the list: Discard 3) Add a non-member user(a)example.com and change the moderation setting to Hold for Moderation 4) Send an email to the list using user(a)example.com. The message is discarded instead of being held. The above can also be repeated with the list setting Default action to take when a non-member posts to the list: Accept immediately. The message sent from user(a)example.com is accepted instead of being held. So, it looks like that the non-members moderation setting is ignored for this case. Further study indicate that the issue did not happen if the owner is set to user(a)example.com *after* adding the non-member. It looks like that we can avoid the issue during list creation. However, the issue can also be triggered through other ways such as adding the non-member as member and remove. There are also ways to resolve the issue by removing all corresponding member, non-member, owner setting and add them back in the following order: non-member, owner. However, it does not always work and so I do not go into the detail at this moment to complicate the issue.

2 2

Affinity Mailman Is Now Beta
by Brian Carpenter 18 Jun '20

18 Jun '20

Dear Mailman Admins and Users, Affinity Mailman is our new admin interface for Mailman 3 and we intend to use it to replace Postorius. It has been under development for about 3 months now and it recently reached beta. Calling For Beta Testers Now that Affinity is in beta, we are looking for list admins to help us beta test it. We are interested in getting some feedback and feature requests from beta users. If you are interested in helping us test out Affinity and get a sneak peek of the future of Mailman administration, then email me at brian_carpenter(a)emwd.com <mailto:brian_carpenter@emwd.com?subject=Affinity%20Beta&body=I%20am%20interested%20in%20Beta%20Testing%20Affinity> and I will begin the process of setting you up with an Affinity Mailman admin account and provide 2 test lists to use for beta testing purposes. While I am at it: Empathy Is Now Under Development "So what in the world is Empathy? I mean really - first Affinity and now Empathy?" That is correct. We figured if we are going to replace the default admin UI (Postorius) for Mailman 3, we might as well replace the default forum/archive UI (Hyperkitty) for Mailman 3. With Empathy, we are bringing a beautiful and user-friendly experience for those who wish to use Mailman 3 as a modern forum. We want Empathy to bring a true community like approach to the use of Mailman 3 via a browser. It will supplement the mailing list feature of Mailman 3 with an easy to use online forum. So Mailman 3 users will get the best of both worlds: a modern mailing list app AND a modern forum app. Empathy can also be used to display your list threads (archives) in an easy-to-read manner, and those threads can be categorized by tags and will be searchable. -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

2 1

mailman2 vs Mailman3 database usage
by Ralf Wiegand 18 Jun '20

18 Jun '20

Do you have a list of the information that is stored in the DB? I don’t think it is emails, so it may be an issue of the number of lists and email addresses or users that are allowed to post or moderate. Thank You, Ralf Wiegand -- Ralf K. Wiegand -- Leidos 6909 Metro Park Dr Franconia, VA 22310 469-289-7372 (mobile) ralf.wiegand(a)tena-sda.org

1 0

Exception in the HyperKitty archiver: 'utf-8' codec can't encode characters
by Gilles Filippini 18 Jun '20

18 Jun '20

Hi, I'm seeing the above error in mailman-core logs each time an email is processed. Is there something I missed in the configuration? I'm using dockerized mailman 0.3 from maxking. Thanks in advance, _g.

2 7

Mailman3 on Ubuntu 20.04 LTS - Best Installation Method?
by matthew＠alberti.us 18 Jun '20

18 Jun '20

Hi Everyone, I have been trying unsuccessfully for several weeks to install Mailman3 on a new Ubuntu 20.04 LTS server. First I tried to just use the Ubuntu packages, which is MM3 version 3.2.2. Unfortunately Ubuntu 20.04 also uses Python 3.8 which has a compatibility issue with MM 3.2.2. There is a bug submission submitted to the Ubuntu team. Next I tried to use the virtualenv method, as that was recommended for production anyway by Mailman installation documentation. I couldn't get that to work either, as there is again some known issue between one of the django packages and another python package called 'six'. Has anyone been able to get Mailman3 running stable on Ubuntu 20.04? What installation method did you use? At this point, I'm really tempted to just stay at MM2 until the Ubuntu packages get sorted out. I've also considered just closing the Gitlab repo and trying to set it up manually. But I feel like it isn't worth all the trouble. Thanks in advance for your thoughts. - Matt

3 4

Is it possible to add non-members in regex format in Mailman 3 ?
by Shashikanth Komandoor 17 Jun '20

17 Jun '20

Hi Team, In mailman 2, I was able to add the non-members in the respective privileged box even using the regex also which will be used to add the domains instead of a single mail id. But in mailman 3, I am not allowed to add the non members in the regex format. Of course it is allowing me to add individual mail ids and give permissions. But I want to add a non-member which may be something like the entire cisco.com domain on which I want to set the rule. Please help me out by suggesting over this or if mailman 3 is not providing then please hint me out with a work around at least. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 3

Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup
by Michael Sage 17 Jun '20

17 Jun '20

Hi, I came across this really useful guide (posted to the list earlier). It has all gone really well and mailman 3 is installed. However, I have an issue, when I go to login using Postorius, I get the login page when I enter my credentials the page appears to hang and eventually goes to a Error 500 page. This totally hangs all of the mailman 3 web interface (but not apache). I then have to reboot the server to even get back to the login page. Any tips please? Thanks

5 10

List invisible to moderator
by Olaf Zaplinski 16 Jun '20

16 Jun '20

I just have promoted a member to a moderator. Now when he logs in to Postorius, he gets the message "There are currently no mailing lists.". I have set "Show list on index page" to "no" before. But as a moderator, the list should be shown, right? I mean, all lists are shown to the administrator also. When I manually enter the complete URL, the moderator can see the list. I think this is a bug. Moderators should see their lists. What do you thing? Olaf

2 1

ACL on archives
by pgrzywaczewski＠gmail.com 16 Jun '20

16 Jun '20

Hello, Is it possible to define permissions who can access archives? For example members of another list, or a single user? Thanks, Paweł

2 1

Hyperkitty CSS issue
by Ryan Morash 16 Jun '20

16 Jun '20

I migrated my existing mailman3 install from using the Debian packages to a virtualenv setup. For the most part everything seems to be running fine, but I'm running into an issue where Hyperkitty 1.3.3 is referencing an incorrect CSS file. It is trying to load "/static/CACHE/css/hyperkitty.39ef00cc7454.css" which does not exist. If I replace that reference (using my browser's dev tools) with "/static/CACHE/css/output.12a071da81b1.css" everything looks fine. I've ran the collectstatic, compress, and migrate commands successfully with no change. Any ideas on how to fix this?

4 5

Removing a mail addresses and users
by Abhijith PA 15 Jun '20

15 Jun '20

Hello. I tried to remove random email address signing ups (which I signed up while testing) via admin panel. After removing I tried to sign up again, but I am getting, 'A user is already registered with this e-mail address' Combing through the database, I found auth_user table in mailman3web db still contain those mail address. How to wipe email address entirely from the db so I can signup again without the 'forget password' method --abhijith

6 9

(no subject)
by Lars Bjørndal 14 Jun '20

14 Jun '20

I'm about to set up a new list, and want to try out Mailman3. The only component available in Fedora, is the Mailman core package. With the /usr/libexec/mailman3/mailman command, I was able to create a list, and add a member throug the sub commands create and members. How can I read out the list configuration from here, and change settings? Do I then need to install/use other components, or is there other possibilities, e.g. using the shell command? If I get a message that needs moderation, can I do the decision from cli, or how do I do that? Thanks Lars

2 2

Mailman3 on Fedora
by Lars Bjørndal 14 Jun '20

14 Jun '20

Hi, list! I'm running Fedora 31. The only Mailman 3 package in the Fedora repo seems to be mailman3-3.2.0-2.fc30.noarch, which is only Mailman core. My goal was to start using Mailman 3 for a new list. It seems without the other packages, it's not trivial to configure the list, please correct me if I'm wrong. And of course I don't get the archive functionality which I don't need anyway. Does anyone know whats the plan for Fedora when it comes to implementing the other components of Mailman 3, and when they will ship a newer version of the core package? Thanks, Lars

3 3

max_message_size parameter not working in mailman 3.3.1
by Shashikanth Komandoor 13 Jun '20

13 Jun '20

Team, I am currently working on Mailman 3.3.1 in production environment. Today I faced an issue related to the mail size limit. One of our users has sent a mail with nearly 27M to one of the lists running on Mailman 3.3.1. Though I have configured the parameter related to the Maximum message size as '0' which I meant as no limit to the size of mail, I observed the mail is not accepted and rejected with the message "Message size limit exceeds". So, could anyone please help in resolving the issue or at least a work around asap ? -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

manage.py runjobs hourly
by Mark Dadgar 11 Jun '20

11 Jun '20

I have started getting this emailed to root each hour from the cron job. > From: root(a)pdc-racing.net (Cron Daemon) > Subject: Cron <www-data@mail> [ -f /usr/bin/django-admin ] && flock -n /var/run/mailman3-web/cron.hourly /usr/share/mailman3-web/manage.py runjobs hourly > Date: June 11, 2020 at 11:00:06 AM PDT > To: www-data(a)pdc-racing.net > > 18:00:03 [Q] INFO Enqueued 1350 > 18:00:03 [Q] INFO Enqueued 1351 The Enqueued numbers do increment. Anyone know what this is? - Mark ----- mark(a)pdc-racing.net | 408-348-2878

2 2

Weird hourly indexing error
by Mark Dadgar 11 Jun '20

11 Jun '20

I moved my mail server to a Digital Ocean droplet. I basically installed all the appropriate packages and then rsync’d everything that matters from my metal server up to the cloud instance. Everything more or less works fine. However, I am now getting this hourly error - see below. It is ENTIRELY possible that I was getting this error on the previous server as well, but I didn’t have www-data aliased to root so I would never have seen it. Anyone know what’s going on here? BTW, Digital Ocean is pretty awesome. If anyone wants to try it, ping me for a referral code good for $100 in credit to play with. - Mark ----- mark(a)pdc-racing.net | 408-348-2878 Begin forwarded message: From: root(a)pdc-racing.net (Cron Daemon) Subject: Cron <www-data@mail> [ -f /usr/bin/django-admin ] && flock -n /var/run/mailman3-web/cron.hourly /usr/share/mailman3-web/manage.py runjobs hourly Date: May 5, 2020 at 5:01:00 AM PDT To: www-data(a)pdc-racing.net [ERROR/MainProcess] Failed indexing 1 - 1000 (retry 5/5): Term too long (> 245): XSUBJECT95251413 (pid 36301): Term too long (> 245): XSUBJECT95251413 Traceback (most recent call last): File "/usr/lib/python3/dist-packages/haystack/management/commands/update_index.py", line 97, in do_update backend.update(index, current_qs, commit=commit) File "/usr/local/lib/python3.8/dist-packages/xapian_backend.py", line 488, in update database.replace_document(document_id, document) xapian.InvalidArgumentError: Term too long (> 245): XSUBJECT95251413

3 24