Search results for "dO" - lists.mailman3.org

[MM3-users] Re: using SSH/TLS with external MTA

by Odhiambo Washington

On Sun, Jul 28, 2024 at 4:42 PM Roland Giesler via Mailman-users < mailman-users(a)mailman3.org> wrote: > > On 2024/07/28 15:26, Roland Giesler via Mailman-users wrote: > > On 2024/07/28 00:39, Mark Sapiro wrote: > >> On 7/27/24 15:16, Roland Giesler via Mailman-users wrote: > >>> > >>> The server runs power-mailinabox, which uses Postfix indeed. All my > >>> mail, and quite a few others' mail is sent from the using SMTP-Auth > >>> on port 465. Actually, this message is sent via that server too. > >>> So it's clear to me that MM3 is not authenticating for some reason. > >> > >> What do you see in Mailman's smtp.log and in the mail.log on the mail > >> server? > > > > The smtp log is in syslog... > > I also see this in /var/log/mailman3/web/mailman-web.log > > *** Starting uWSGI 2.0.20-debian (64bit) on [Sun Jul 28 15:27:48 2024] *** > compiled with version: 11.2.0 on 21 March 2022 11:00:44 > os: Linux-5.15.108-1-pve #1 SMP PVE 5.15.108-2 (2023-07-20T10:06Z) > nodename: mailman > machine: x86_64 > clock source: unix > pcre jit disabled > detected number of CPU cores: 1 > current working directory: / > detected binary path: /usr/bin/uwsgi-core > setgid() to 33 > setuid() to 33 > chdir() to /usr/share/mailman3-web > your processes number limit is 513922 > your memory page size is 4096 bytes > detected max file descriptor number: 1024 > lock engine: pthread robust mutexes > thunder lock: disabled (you can enable it with --thunder-lock) > uwsgi socket 0 bound to UNIX address /run/mailman3-web/uwsgi.sock fd 4 > Python version: 3.10.12 (main, Mar 22 2024, 16:50:05) [GCC 11.4.0] > Python main interpreter initialized at 0x561ce813d1d0 > python threads support enabled > your server socket listen backlog is limited to 100 connections > your mercy for graceful operations on workers is 60 seconds > mapped 166752 bytes (162 KB) for 2 cores > *** Operational MODE: threaded *** > /usr/lib/python3/dist-packages/django_q/conf.py:139: UserWarning: Retry > and timeout are misconfigured. Set retry larger than timeout, > failure to do so will cause the tasks to be retriggered before > completion. > See > https://django-q.readthedocs.io/en/latest/configure.html#retry for > details. > warn( > WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter > 0x561ce813d1d0 pid: 113 (default app) > *** uWSGI is running in multiple interpreter mode *** > spawned uWSGI master process (pid: 113) > spawned uWSGI worker 1 (pid: 339, cores: 2) > [uwsgi-daemons] spawning "python3 manage.py qcluster" (uid: 33 gid: 33) > /usr/lib/python3/dist-packages/django_q/conf.py:139: UserWarning: Retry > and timeout are misconfigured. Set retry larger than timeout, > failure to do so will cause the tasks to be retriggered before > completion. > See > https://django-q.readthedocs.io/en/latest/configure.html#retry for > details. > warn( > System check identified some issues: > > WARNINGS: > django_mailman3.MailDomain: (models.W042) Auto-created primary key used > when not defining a primary key type, by default > 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > DjangoMailman3Config.default_auto_field attribute to point to a subclass > of AutoField, e.g. 'django.db.models.BigAutoField'. > django_mailman3.Profile: (models.W042) Auto-created primary key used > when not defining a primary key type, by default > 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > DjangoMailman3Config.default_auto_field attribute to point to a subclass > of AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Attachment: (models.W042) Auto-created primary key used when > not defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Email: (models.W042) Auto-created primary key used when not > defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Favorite: (models.W042) Auto-created primary key used when > not defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.LastView: (models.W042) Auto-created primary key used when > not defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.MailingList: (models.W042) Auto-created primary key used when > not defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Profile: (models.W042) Auto-created primary key used when not > defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Tag: (models.W042) Auto-created primary key used when not > defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Tagging: (models.W042) Auto-created primary key used when not > defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Thread: (models.W042) Auto-created primary key used when not > defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.ThreadCategory: (models.W042) Auto-created primary key used > when not defining a primary key type, by default > 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > hyperkitty.Vote: (models.W042) Auto-created primary key used when not > defining a primary key type, by default 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > HyperKittyConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > postorius.EmailTemplate: (models.W042) Auto-created primary key used > when not defining a primary key type, by default > 'django.db.models.AutoField'. > HINT: Configure the DEFAULT_AUTO_FIELD setting or the > PostoriusConfig.default_auto_field attribute to point to a subclass of > AutoField, e.g. 'django.db.models.BigAutoField'. > 15:27:55 [Q] INFO Q Cluster low-vermont-harry-fillet starting. > 15:27:55 [Q] INFO Process-1 guarding cluster low-vermont-harry-fillet > 15:27:55 [Q] INFO Q Cluster low-vermont-harry-fillet running. > 15:27:55 [Q] INFO Process-1:3 pushing tasks at 386 > 15:27:55 [Q] INFO Process-1:2 monitoring at 385 > 15:27:55 [Q] INFO Process-1:1 ready for work at 384 > # Asynchronous tasks # https://django-q.readthedocs.io/en/latest/configure.html Q_CLUSTER = { 'name': 'mailman3-web', 'workers': 8, 'retry': 360, 'timeout': 300, 'save_limit': 100, 'orm': 'default', } # Maintain type of autogenerated keys going forward # https://docs.djangoproject.com/en/3.2/releases/3.2/#customizing-type-of-aut… DEFAULT_AUTO_FIELD = 'django.db.models.AutoField' -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

10 months, 1 week

[MM3-users] Re: Google Summer of Docs

by Abhilash Raj

On Sun, Mar 24, 2019, at 11:58 PM, Terri Oda wrote: > > > On March 24, 2019 10:51:07 p.m. PDT, "Stephen J. Turnbull" > <turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > >Ralph Seichter writes: > > > * Mark Sapiro: > > > > >> > If you post an issue at > ><https://gitlab.com/mailman/mailman/issues>, > > > > one of our GSOC aspirants may pick it up. > > > > > > Done, although I wonder if any GSOC participant would want to write > > > documentation instead of code... ;-) > > > >For their actual, Google-supported, project, Google explicitly > >excludes documentation. > > > > They do for Google Summer of **Code** but they've just announced Google > Summer of **Docs** which sounds really neat and we might want to > participate. They are calling it Season of Docs, happening in winter I think Sept-Dec AFAIK. Yep, we should participate in that, I sent out an email earlier about this too. > > (It's my personal opinion that our docs have really suffered since I > finished my PhD and stopped using them as a warmup exercise when I was > procrastinating on writing my thesis. *grin*) > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 2 months

[MM3-users] Re: Error Logging - what changed with the New Year releases?

by Odhiambo Washington

On Sat, Jan 14, 2023 at 7:13 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 1/14/23 01:19, Odhiambo Washington wrote: > > Apart from all the defaults in settings.py (derived from gitlab), I also > > have this line: > > LOGGING['handlers']['file']['filename'] = > > '/opt/mailman/mm/var/logs/mailmanweb.log' > > > > Before the New Year releases of MM3, I used to get errors written to this > > file. > > Not anymore after I updated to the New Year releases. > > Another thing that I have realized is that prior to the New Year > releases, > > I would get an error logged to that file and also mailed to me. > > I don't think that I have changed anything in settings,py related to > > logging. > > > Nothing in those releases per se would affect this. This is Django and > django-allauth. Perhaps when you updated the Mailman packages, you also > updated these dependencies. > Which dependencies would those be? When I upgraded, the command I ran was: pip install --upgrade --force mailman mailmanclient postorius hyperkitty mailman-hyperkitty django-mailman3 And how do I find out what is suppressing the logging for the social accounts? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 years, 4 months

[MM3-users] How to set up mailman 3

by David Krantz

Hi. I have tried and failed to set up mailman 3 using the mailman_bundle. I get the mailman3 server running correctly, but the problem is the extremely sensitive web user interface... Now when I found this mail list I understand that mailman bundle is depricated and that I must restart from scratch. Is this true? This annoys me quite a lot, can someone responsible within the project please mark the deprecated package as such? Almost none of the documentation is completely correct. It is useful but very incomplete. The mailman_bundle generated configuration examples for e.g. apache simply is wrong or incomplete. That said I got it running using http only, but when I switched to HTTPS the login simply ceased working. I use password+username as the other solution is quite complicated to get running. I could of course switch to e.g. google login, but that would require at least some documentation on how to do that. So, is there any documentation on how to use mailman 3? The error I get now is "Please enter a correct username and password. Note that both fields may be case-sensitive." I know that I enter the correct password as it worked before I added HTTPS. Sorry for the rant, but I am very annoyed by this. I just need a mail list server that works and thought it would be very neat to run mailman3 after running a hoste mailman2 for many years. Best regards // David

8 years, 2 months

[MM3-users] Re: Confirm and Moderate Unsubscribe Requests

by Brian Carpenter

On 10/21/20 5:39 PM, Mark Sapiro wrote: > On 10/21/20 12:14 PM, Brian Carpenter wrote: >> >> Well I can't dictate that to my list owners and there is no confirm >> token sent with the moderation notice. Why include this option in >> Postorius when it can't be properly handled? > > Postorius is still a work in progress. The unsubscription policies are > in core and are exposed in Postorius. Certainly the ability to moderate > an unsubscription should be in Postorius, but it isn't yet. We are an > all volunteer project and there aren't that many of us, and perhaps I'm > overreacting, but the tone of some of your recent posts seems a bit > demanding. I apologize. I didn't think I was coming across demanding but I am somewhat exasperated at some of these issues. I have a list owner who is now going to get a moderated request notice everyday that he can't do anything about it. But my question still remains: why is this option in Postorius when it can't be handled properly? Surely the option can be easily removed, right? Is the ability to list (via the pending moderation notices tab) and handle (as in the List owner can decide a moderation response) an unsubscribe moderation request there in Mailman core so that I can properly address it via Affinity? -- Brian Carpenter Harmonylists.com Emwd.com

4 years, 7 months

[MM3-users] Re: Internal Server Error: /archives/

by Christian

Thank you Mark! -----Original Message----- From: Mark Sapiro <mark(a)msapiro.net> Sent: Friday, November 29, 2024 10:02 AM To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: Internal Server Error: /archives/ On 11/29/24 7:51 AM, Christian via Mailman-users wrote: > What is this error and how can I fix it please? Running Debian > 4.19.316-1 ... > Request Method: GET > Request URL: https://lists.domedoman.ie/archives/?sort=active%22%27! ... > Traceback (most recent call last): > None ... > GET: > sort = 'active"\'!' Some remote user has requested `https://lists.domedoman.ie/archives/?sort=active"'!` The `"'!` appended to the sort=active query fragment caused the error. This sort of thing happens when bots and script kiddies crawl your web site. You can find the request in your web server logs for more information about where it came from, but the bottom line is this will happen from time to time and it's not an indication that anything is broken. It would be possible to harden HyperKitty to defend against malformed URLs like this, but without a traceback it is not clear where to do it. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message/ XH5USTRI7JUHJT7UGWCGALENPDSSXWXE/ This message sent to csa(a)web-analysts.net

6 months, 1 week

[MM3-users] Re: Changing delivery mode for ALL subscribers on a SINGLE list using REST

by Abhilash Raj

On Mon, Feb 18, 2019, at 4:56 AM, Henrik Rasmussen wrote: > While in Mailman Settings a user can change delivery mode for either > Global (all subscriptions regardless of address or list), Address based > (regardless of list name) or List Based (regardless of address). > > The list admin can change a user's delivery mode setting on a single > list (affecting only that address and only that list), but only one > subscriber at the time on the list. > > Changing a user's delivery mode can also be done using REST[1], but I > asume this will affect the user's subscription on all the lists where > she subscribed using the same address. > > How do I change ALL the subscribers[2] on a _single list_ to a certain > delivery mode, using REST? You watch to PATCH the preferences of a Member object, so that you don't affect other subscriptions of that address or user. http://localhost:9001/3.0/members/1/preferences > [1] > https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/preferences.… > [2] Most likely by iterating through all subscribers, one at the time, > on the list in question. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 3 months

[MM3-users] Re: Emergency moderation and clearing out a lot of held messages

by Abhilash Raj

On 12/14/22 03:31, Mark Sapiro wrote: > On 12/13/22 10:38, Dan Caballero wrote: >> Hi Mark, >> >> I ran the commands and it took about 35 seconds for the loop to run. >> >> Here's the result. >> >>>>> count >> 4168 > > > So that's at least part of the issue. How does 35 seconds compare to the > length of time to process one moderated message through Postorius? > It seems it has to do with in-efficient lookup of the actual entry in the pendings table which needs to be purged after handling a held message. It scales linearly with how many entries are there in pendedkeyvalue and pendings tables. I was actually browsing through the perf metrics on mail.python.org and found the slowest API response from Core is handling held messages and spent some time last night trying to improve it [1]. The linked MR should significantly reduce the time, although there is more that can be done to make it even better. I haven't had a chance to benchmark my solution yet, but I am hoping it will reduce the latency quite significantly. I'll report on the linked issue [2] after deploying [1] on m.p.o. how much it helped. [1]: https://gitlab.com/mailman/mailman/-/merge_requests/1068 [2]: https://gitlab.com/mailman/mailman/-/issues/1045 -- thanks, Abhilash Raj (maxking)

2 years, 5 months

[MM3-users] Re: About to Install MM3 -- Seeking clarification

by Mark Sapiro

On 1/2/23 03:54, Onyeibo Oku wrote: > > I pulled the plugs on uwsgi and installed Gunicorn. Gunicorn gave more > mileage but something is still not right. When I visit the mailmanweb > home with a browser, I see the following: > > "Server Error. An error occurred while processing your request." > > Mailmanweb and mailman3 services are running. I perused the log file > at /opt/mailman/web/logs/mailmanweb.log and found the following: > > > raise MailmanConnectionError( > mailmanclient.restbase.connection.MailmanConnectionError: ('Could not > connect to Mailman API: ', > 'ConnectionError(MaxRetryError("HTTPConnectionPool(host=\'localhost\', > port=8001): Max retries exceeded with url: > /3.1/lists?advertised=true&count=0&page=1 (Caused by > NewConnectionError(\'<urllib3.connection.HTTPConnection object at > 0x7f7f4b128c40>: Failed to establish a new connection: [Errno 111] > 0x7f7f4b128c40>Connection refused\'))"))') Postorius is unable to connect to Mailman core's REST API. Are your settings for accessing Mailman's REST API correct? E.g., does MAILMAN_REST_API_URL = 'http://localhost:8001' MAILMAN_REST_API_USER = 'restadmin' MAILMAN_REST_API_PASS = 'restpass' match $ mailman info ... REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:restpass Note the 3.1/ in REST root url is not included in MAILMAN_REST_API_URL. What do you get from, e.g. curl -urestadmin:restpass http://localhost:8001/3.1/lists It should return JSON with information about your lists. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 5 months

[MM3-users] Re: spf/dkim/dmarc

by Christian

Ok. This is what I am getting in my mail.log: May 17 06:20:40 lists postfix/smtp[28437]: C14F8101260: to=<billb6951(a)gmail.com>, relay=gmail-smtp-in.l.google.com[142.250.114.26]:25, delay=0.45, delays=0.01/0/0.14/0.29, dsn=5.7.26, status=bounced (host gmail-smtp-in.l.google.com[142.250.114.26] said: 550-5.7.26 The MAIL FROM domain [lists.ccalternatives.org] has an SPF record 550-5.7.26 with a hard fail policy (-all) but it fails to pass SPF checks with 550-5.7.26 the ip: [192.46.218.224]. I have two SPF records in dns for the server as follows: mail v=spf1 mx -all lists v=spf1 ip4:45.79.28.18 -all please advise. Thank you! -----Original Message----- From: Jeremy Stanley <fungi(a)yuggoth.org> Sent: Wednesday, May 17, 2023 7:15 AM To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: spf/dkim/dmarc On 2023-05-17 07:07:53 -0700 (-0700), Christian via Mailman-users wrote: > Thank you for your reply. I'm being driven mad by Gmail rejecting my > SPF record, this while I get SPF record approvals everywhere else. > > I read that having two SPF records for the same server will generate > errors. Is this true? [...] I'm not an SPF expert (I don't even use it for my domains), but I do know how to query standards documents. IETF RFC 7208 "Sender Policy Framework (SPF) for Authorizing Use of Domains in Email, Version 1" states in §3.2: "A domain name MUST NOT have multiple records that would cause an authorization check to select more than one record." https://www.rfc-editor.org/rfc/rfc7208#section-3.2 Hope that helps! -- Jeremy Stanley

2 years

[MM3-users] Re: mailman3 on new Debian 12 installation, got ssl apache working on all URLs except /mailman3

by Stephen J. Turnbull

Odhiambo Washington via Mailman-users writes: > > connect to Unix domain socket */run/mailman3-web/uwsgi.sock* > > ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ > uwsgi running outside virtualenv?? I don't think that's a problem, unless also running in a chroot, which would be confusing no matter where uswgi is running. "Cannot connect" might mean - uwsgi is running chrooted, and mailman-web should be looking in /path/to/chroot/run/mailman3-web/uwsgi.sock (mentioned first only because I have chroot on the brain because Debian Postfix config) - uwsgi isn't running (this is my bet, because all the mailman-web URLs except mailman3/ were working and they all go through that socket -- I bet they're not working now!) - /run/mailman3-web/uwsgi.sock got deleted - /run/mailman3-web/uwsgi.sock got wrong permissions - the socket is actually /run/mailman3_web/uwsgi.sock or similar (with an underscore!) and mailman-web is misconfigured But as Mark said, the problem you have with "mailman3/" is urls.py. Personally, I think you *should* do the things that Mark said are unnecessary. He's right, but I strongly prefer to keep all my changes to default configuration in one place, and that's /etc/mailman3 for you if I recall correctly. The very fact that you have /etc/mailman3/urls.py screams "I have changed this file" and that's often useful. Steve

2 months, 1 week

[MM3-users] Re: Is there a way of recording bounce messages?

by Mark Sapiro

On 9/26/23 11:29, Mohsen Masoudfar wrote: > > I'm dealing with the same issue. Upon reviewing the logs, I've noticed a significant number of bounced emails for a particular mailing list. Gmail users have reported not receiving emails. > I haven't been able to locate the "munge from" information. My current setup is using Mailman 3.1.1. I read it has been introduced in 3.2. DMARC mitigations were introduced in Mailman 3.1.0. They should be available in 3.1.1. They were first exposed in Postorius 1.1.0. Where are you looking for DMARC mitigations? > The Question is what to do with Mailman 3.1.1, if the upgrade is not an option. > > I get in the logs messages like below with several Queue-ids: > > Sep 25 09:03:55 localhost postfix/smtpd[26692]: 147583E927: client=a14-93.smtp-out.amazonses.com[54.240.14.93] > Sep 25 09:03:55 localhost postfix/cleanup[26696]: 147583E927: message-id=<0100018acb94b326-fdf39193-144e-4fdc-8faf-0d3df54eb4ee-000000(a)email.amazonses.com> > Sep 25 09:03:55 localhost postfix/qmgr[1298]: 147583E927: from=<>, size=24934, nrcpt=1 (queue active) > Sep 25 09:03:55 localhost postfix/lmtp[26697]: 147583E927: to=<listname-bounces@servername>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.03, delays=0.01/0/0/0.01, dsn=2.0.0, status=sent (250 Ok) > Sep 25 09:03:55 localhost postfix/qmgr[1298]: 147583E927: removed This only says that some Amazon MTA has relayed a bounce to Mailman. It says nothing about why the message bounced. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 8 months

[MM3-users] Re: search this list searches more then just this list

by Marco van Tol

Op 24 jan 2024, om 12:24 heeft Marco van Tol <mvantol(a)ripe.net> het volgende geschreven: > Op 23 jan 2024, om 19:09 heeft Mark Sapiro <mark(a)msapiro.net <mailto:mark@msapiro.net>> het volgende geschreven: >> >> On 1/23/24 05:49, Marco van Tol wrote: >>> Small unfortunate twist, this leads to: >>> --- >>> [ERROR/MainProcess] Failed indexing 204001 - 205000 (retry 5/5): Term too long (> 245): ... >>> --- >>> I have seen comments on that from back in 2020, but what’s the latest advise on how to deal with this? >> >> This issue is discussed at <https://github.com/notanumber/xapian-haystack/pull/181>. >> There are two patches for this issue. They are somewhat different approaches, but either one is OK. One patch is the one in the above PR <https://github.com/notanumber/xapian-haystack/pull/181/files>. The other is at <https://github.com/alexsilva/xapian-haystack/commit/a53523d2d0d13929a0729d4…>. >> >> I use the one from the PR, but it requires a substitution `s/force_text/str/`. > > Hi, thanks! Just to double check, do you mean `str` or `force_str` in the substitution? > > I found a comment on this topic regarding django-4 where they advice to use force_str. > https://stackoverflow.com/questions/70382084/import-error-force-text-from-d… Hm, never mind, sorry. I now see the current file already has str() rather than force_text() in it. Marco

1 year, 4 months

[MM3-users] Re: Posting replies vs starting a thread via email

by Abhilash Raj

On Tue, Sep 3, 2019, at 9:26 PM, paul(a)arenson.org wrote: > In my tests where replies go to the list, when a person uses the email > client? So far a reply to the original message and a reply to a reply > to a reply all go in the same thread. Is this standard? Do I have to > warn users not to have endless Re re re re? Yes, the threading is implemented using a bunch of email headers, especially "In-Reply-To" and "References". If you reply to a message, it will go to the same thread. Did you expect something else to happen? > > And the other question is what happens if a user sends a message via > email with a new subject? Does the list accept it as a new thread? Like I mentioned before, the threading happens with email headers and not using the Subject. So, changing the subject will continue to keep the thread. If you want a new thread, you send in a new email to the list's posting address instead of replying to an old thread. > > This should be one of my last big questions. > > Thank you. > > Paul > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years, 9 months

[MM3-users] Re: How to create user accounts and mail addresses through CURL instead of Site Administration ?

by Shashikanth Komandoor

Thank you Mark for you response in time. On Tue, Aug 11, 2020 at 9:40 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 8/10/20 11:18 AM, Shashikanth Komandoor wrote: > > I am currently automating a few things using the CURL commands but > only > > postorius related as of now. Now I have a requirement. > > > > I need to create a lot many users and their mapping email ids through > > Site Administration almost daily. But it is becoming to do the same > through > > Graphical Interface. > > > > So, I just want to know the CURL commands that can be used to create > the > > user accounts and email ids mapped to user accounts. > > The accounts you are talking about are Django accounts. You cannot > create these via CURL to the Mailman core REST API. > > You might find > <https://www.django-rest-framework.org/tutorial/quickstart/> of interest. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Thanks & Regards, Shashi Kanth.K 9052671936

4 years, 9 months

[MM3-users] MM3 not starting

by Stephen J. Turnbull

max.diener(a)hpi.de writes: > Aug 22 09:54:12 mailman3test mailman[55146]: File "/usr/lib/python3.9/socket.py", line 953, in getaddrinfo > Aug 22 09:54:12 mailman3test mailman[55146]: for res in _socket.getaddrinfo(host, port, family, type, proto, flags): > Aug 22 09:54:12 mailman3test mailman[55146]: socket.gaierror: [Errno -2] Name or service not known This appears to be a DNS problem, probably for Mailman's host, since it occurs during startup. The following three lines aren't relevant. > Aug 22 09:55:01 mailman3test CRON[55176]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) > Aug 22 09:55:01 mailman3test CRON[55177]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) > Aug 22 09:55:01 mailman3test CRON[55176]: pam_unix(cron:session): > session closed for user root I'm not sure what timeout is referred to here. > Aug 22 09:55:34 mailman3test systemd[1]: mailman3.service: start operation timed out. Terminating. > Aug 22 09:55:35 mailman3test systemd[1]: mailman3.service: Failed with result 'timeout'. > Anybody knows whats going on and what i am doing wrong? Need more information about your configuration, but it sure looks like there's either a DNS problem or a problem binding to the LMTP port. Not sure what your Mailman is using but I think we normally use the submission port, 587, which is a port for restricted use. Perhaps there's a system security issue, eg, from SELinux. But I would check DNS twice first (unless you're definitely using enhanced security like SElinux). Steve

2 years, 9 months

[MM3-users] Re: sqlite3 Database "read only" error on mailman_sync job

by Abhilash Raj

On Thu, Sep 5, 2019, at 1:49 PM, Ugnius wrote: > > Thank You. This is very valuable information. According documentation I understood that "runserver" should run on some internal port and uwsgi just works like proxy connects to the same as runserver port and serves content to apachi. Because when I was playing with the setup without "runserver" Web interface didn't work. > Yes, I have stopped "runserver" and page still works fine. :) This didn't solve me database RO issue, but this information was important. Thank You. I am thinking what to do now... Maybe to recreate database (make initiation once again). It could take 2-3 hours. I did not noticed option to export/import lists setting. Or to try find solution how to make sqlite3 multiple > writable. I think your problem about locked database might be solved. Like I mentioned, it is possible that those two running server could be stepping over each other toes. After removing the "runserver" process, I think you shouldn't fall into anymore of those locking issues. FWIW, it is also highly recommended to not use sqlite for any production use cases. Either postgres or mysql is preferred. > SQLite version 3.16.2 2017-01-06 16:32:41 > Enter ".help" for usage hints. > > BR > Ugnius > > On 5 Sep 2019, at 23:31, Abhilash Raj <maxking(a)asynchronous.in> wrote: >> On Thu, Sep 5, 2019, at 1:15 PM, Ugnius wrote: >>> >>> I do not know... In the setup example settings was something like process number = 2. But I understand at least 1 uwsgi and 1 run server should run? >> >> No, only uwsgi needs to run. It is fine if there are two of those, since it probably forks to have 2 worker process. There shouldn't be any "python manage.py runserver" processes running at all, it is meant only for testing purposes. >> >> The doc mentions that it is "development" server[1][2]. >> >> [1]: # Run the Django's "development" server at localhost:8000 >> [2]: http://docs.mailman3.org/en/latest/prodsetup.html#setting-up-django-project >> >> Perhaps it should be more descriptive about what does it mean. >> >>> >>> On 5 Sep 2019, at 23:08, Abhilash Raj <maxking(a)asynchronous.in> wrote: >>>> 6644 ? S 0:12 /usr/bin/uwsgi --master --ini /opt/home/uwsgi.ini >>>> 6645 ? S 0:00 /usr/bin/python3 /opt/home/manage.py runserver 0:8015 >>>> 6653 ? Sl 636:28 /usr/bin/python3 /opt/home/manage.py runserver 0:8015 >>>> 6656 ? Sl 0:27 /usr/bin/uwsgi --master --ini /opt/home/uwsgi.ini >>>> >>>> This fishy, why do you have both uwsgi and "python manage.py runserver" running? >>>> >>>> You only need one of those, since they both do the exact same thing. Please remove >>>> whatever is running the "python manage.py runserver" part and only use uwsgi. >>>> >>>> On Thu, Sep 5, 2019, at 1:02 PM, Ugnius S wrote: >>>>> Thank You, Abhilash, to helping. I have checked the processes, but also I have read, that sqlite3 can run in multi writing mode. >>>>> May mailman processes are next: >>>>> >>>>> 6644 ? S 0:12 /usr/bin/uwsgi --master --ini /opt/home/uwsgi.ini >>>>> 6645 ? S 0:00 /usr/bin/python3 /opt/home/manage.py runserver 0:8015 >>>>> 6653 ? Sl 636:28 /usr/bin/python3 /opt/home/manage.py runserver 0:8015 >>>>> 6656 ? Sl 0:27 /usr/bin/uwsgi --master --ini /opt/home/uwsgi.ini >>>>> 6643 ? S 0:00 /usr/bin/python3 /usr/bin/master -C /opt/home/mailman.cfg >>>>> 659 ? S 0:46 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=in:0:1 >>>>> 6660 ? S 0:42 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=nntp:0:1 >>>>> 6661 ? S 0:42 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=digest:0:1 >>>>> 6662 ? S 0:48 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=pipeline:0:1 >>>>> 6663 ? S 0:44 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=archive:0:1 >>>>> 6664 ? S 0:41 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=command:0:1 >>>>> 6665 ? S 0:01 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=retry:0:1 >>>>> 6666 ? S 0:45 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=virgin:0:1 >>>>> 6667 ? Sl 0:16 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=lmtp:0:1 >>>>> 6668 ? Sl 1:30 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=rest:0:1 >>>>> 6669 ? S 0:42 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=bounces:0:1 >>>>> 6670 ? S 0:49 /usr/bin/python3 /usr/bin/runner -C /opt/home/mailman.cfg --runner=out:0:1 >>>>> >>>>> Looks like there are no double. Nothing more is running. >>>>> >>>>> 2019-09-05, kt, 03:16 Abhilash Raj <maxking(a)asynchronous.in> rašė: >>>>>> __ >>>>>> On Wed, Sep 4, 2019, at 2:05 PM, Ugnius S wrote: >>>>>>> >>>>>>> I have installed using documentation. My linux distribution version has no full package available. I have installed step by step: >>>>>>> $ sudo pip3 install mailman >>>>>>> $ sudo pip3 install postorius >>>>>>> $ sudo pip3 install hyperkitty >>>>>>> $ sudo pip3 install mailman-hyperkitty >>>>>>> And of course all mandatory components... Everything without errors, I can drop db files and I can download mailman-suite again and start from empty page again. But it will not guarantee that DB will not become READ ONLY again. Here should be logic. No developing support here? >>>>>> >>>>>> Could you be running two separate processes such that the database is locked by one and so other finds it as READ Only? When you find a read only database, can you check if it is open in some other process? >>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> 2019-09-03, an, 19:36 Abhilash Raj <maxking(a)asynchronous.in> rašė: >>>>>>>> >>>>>>>> >>>>>>>> On Sun, Sep 1, 2019, at 3:22 AM,ugniusviln(a)gmail.com wrote: >>>>>>>> > Hi. All the project installation is under the same user / path and >>>>>>>> > it works. Archiving working as well, (just one remark: no matter what >>>>>>>> > to set in postorius, hyperkitty shows list as public) >>>>>>>> > I have found work around - it is possible to change list as private in >>>>>>>> > "admin" page. >>>>>>>> > I started to get issues with runjobs after I have created couple of >>>>>>>> > new lists with "no archive" option. >>>>>>>> >>>>>>>> How did you install all these components. It seems there the installation is broken in weird ways. >>>>>>>> >>>>>>>> > >>>>>>>> > If as owner user from project home I run: >>>>>>>> > >>>>>>>> > django-admin mailman_sync >>>>>>>> > >>>>>>>> > Traceback (most recent call last): >>>>>>>> > File >>>>>>>> > "/home/user/.local/lib/python3.5/site-packages/django/db/backends/utils.py", >>>>>>>> > line 84, in _execute >>>>>>>> > return self.cursor.execute(sql, params) >>>>>>>> > File >>>>>>>> > "/home/user/.local/lib/python3.5/site-packages/django/db/backends/sqlite3/base.py", >>>>>>>> > line 383, in execute >>>>>>>> > return Database.Cursor.execute(self, query, params) >>>>>>>> > sqlite3.OperationalError: attempt to write a readonly database >>>>>>>> > >>>>>>>> > "django-admin runjob sync_mailman " - makes read only errors as well. >>>>>>>> > "django-admin runjob new_lists_from_mailman" >>>>>>>> > django.db.utils.OperationalError: attempt to write a readonly database >>>>>>>> > END TRACEBACK >>>>>>>> > >>>>>>>> > I did not find information how to fix this. It was worked without errors >>>>>>>> > before. >>>>>>>> > I noticed, that if I stop mailman, "django-admin mailman_sync" starts >>>>>>>> > to work. >>>>>>>> > If I start "mailman start", then "django-admin mailman_sync" failing >>>>>>>> > again. >>>>>>>> > I did not check other jobs, but I think what is related to database, >>>>>>>> > will get errors. >>>>>>>> > Seems mailman locking the database. It is not a file permissions issue. >>>>>>>> > Mailman db location is: /project_directory/var/data/mailman.db >>>>>>>> > >>>>>>>> > if to rename /project_directory/var/data/mailman.db to something, >>>>>>>> > mailman creates database file size 0, django-admin runjobs start >>>>>>>> > working, but of course postorius stops working. I did it for testing. >>>>>>>> > I have returned this database file back, postorius started to work >>>>>>>> > again, but django-admin runjobs does not work, error: "database read >>>>>>>> > only". >>>>>>>> > Please help me how to fix this issue. >>>>>>>> > _______________________________________________ >>>>>>>> > Mailman-users mailing list -- mailman-users(a)mailman3.org >>>>>>>> > To unsubscribe send an email to mailman-users-leave(a)mailman3.org >>>>>>>> > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >>>>>>>> > >>>>>>>> >>>>>>>> -- >>>>>>>> thanks, >>>>>>>> Abhilash Raj (maxking) >>>>>> >>>>>> -- >>>>>> thanks, >>>>>> Abhilash Raj (maxking) >>>>>> >>>>>> >>>> >>>> -- >>>> thanks, >>>> Abhilash Raj (maxking) >>>> >>>> >> >> -- >> thanks, >> Abhilash Raj (maxking) >> >> -- thanks, Abhilash Raj (maxking)

5 years, 9 months

[MM3-users] Re: docker mailman-core mailman3 image not responding on port 8024

by Abhilash Raj

> On Aug 18, 2021, at 1:00 PM, bob B <bader(a)cchmc.org> wrote: > > Thanks, > > but if I put SMTP_HOST: 172.25.0.1 in the docker.yaml, and then down and up (docker-compose down, docker-compose up -d) > the images then container grab a new IP range, (like 172.26.0.X). but my smtphost is 172.25.0.1, so that would break again, correct? That is correct. > What should i put for SMTP_HOST: XXXXX in doicker.yaml to keep this from happening? You can grab a static subnet and assign it to your compose file. This is what old version of the docker-compose.yaml used to do, see this for example https://github.com/maxking/docker-mailman/blob/v0.3.11/docker-compose.yaml#… You probably don’t need to assign static IPs to each container like in the compose file above, since all you need the gateway address to be static to reach SMTP_HOST. > > And are you saying my /opt/mailman/core/mailman-extra.cfg should be > > # cat /opt/mailman/core/mailman-extra.cfg > # mailman-extra.cfg > > [mailman] > # This address is the "site owner" address. Certain messages which must be > # delivered to a human, but which can't be delivered to a list owner (e.g. a > # bounce from a list owner), will be sent to this address. It should point to > # a human. > site_owner: XXXX(a)XXXX.XXXXX That is correct! -- thanks, Abhilash Raj (maxking)

3 years, 9 months

[MM3-users] Re: Trouble importing a Mailman 3 Postgres database into a new Mailman 3 instance (Docker)

by skenny＠scss.tcd.ie

Mark Sapiro wrote: > > My point was after you remove the newly minted mailmandb database and > then create a new blank one, and import into that, you should then run > manage.py migrate to apply any new migrations to the imported database. Ah, right ... ok, I've done that now, and all's good. Actually, I've noticed something related. It looks like the mailman-web container runs manage.py as part of its startup procedure in any event. After the import completes, I start up the mailman-web container and, its logs say this: mailman-web | Operations to perform: mailman-web | Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, sessions, sites, socialaccount mailman-web | Running migrations: mailman-web | Applying auth.0012_alter_user_first_name_max_length... OK mailman-web | Applying django_q.0014_schedule_cluster... OK mailman-web | Applying hyperkitty.0022_mailinglist_archive_rendering_mode... OK mailman-web | Applying postorius.0014_auto_20210329_2248... OK mailman-web | Applying postorius.0015_auto_20210619_0509... OK mailman-web | Applying postorius.0016_auto_20210810_2157... OK If the container is restarted again, it shows that there's nothing to do this time: mailman-web | Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, sessions, sites, socialaccount mailman-web | Running migrations: mailman-web | No migrations to apply. These latter diagnostics are also what I see if, at this point, I enter the mailman-web container and run "manage.py migrate" explicitly. I really appreciate the help, thanks so much.

2 years, 10 months

[MM3-users] Re: Automatic migration from Mailman 2.1 (Debian buster) to Mailman 3 (Debian bookworm)

by Odhiambo Washington

On Sat, May 25, 2024 at 5:05 PM <schaefer(a)alphanet.ch> wrote: > Hello, > > I already have some success in auto-migration from Mailman 2.1 (Debian > buster) to Mailman 3 (Debian bookworm), using a new container (not > upgrading the existing installation, which is obsolete e.g. 32 bit x86). I > am doing this using custom scripts. The idea being to be able to import > most of the existing configuration and archives, let the list > administrators test the new system, and progressively advertise this to > users. Then, the old container will be disabled. > > The basic stuff works (From: domain is OK, HTTP transport works, mail go > out, etc) > lsnip] Also, I have a question: if I import my 2.1 config for each ml, will DKIM > work-arounds work (e.g. replace This User <user@domain> by This User > user@domain <the-mailing-list>) ? Will Mailman 2.1 it required some > config changes and also I had to modify mailman using a Debian diversion, > AFAIR. > I remember that when I imported my 2.1 configs to MM3, the DKIM workarounds just worked. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year

[MM3-users]Re: mailman 2 vs. mailman 3: what happened to multipart/digest?

by Mark Sapiro

On 5/13/16 5:05 PM, Simon Hanna wrote: > On 05/12/2016 09:26 PM, Barry Warsaw wrote: >> On May 12, 2016, at 12:18 PM, Mark Sapiro wrote: >> >>> It is the intent that Postorius will eventually expose all these >>> settings. We're not there yet. At present you could possibly do this by >>> interacting with mailmanclient, although I'm not certain the settings are >>> exposed there. >> >> I'm not sure if they're exposed in mailmanclient, but they are exposed in the >> core's REST API, on the member resource. It's the `delivery_mode` attribute >> and it takes as legal values one of 'regular', 'plaintext_digests', >> 'mime_digests', and 'summary_digests' (IOW, the enum item names for the >> DeliveryMode enum). > They are exposed in mailmanclient and are used in postorius. They can be > found in the users personal subscription settings > https://lists.mailman3.org/mailman3/accounts/mailmansettings/ You are correct. When I checked this before my initial reply, I never pulled down the Delivery Mode list to see all the options. My bad. However, please correct me if I'm wrong, but there does not appear to be a way in Postorius to set a list's mime_is_default_digest attribute. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 years

[MM3-users] Re: Missing Base64 encoding from control message reply

by Mark Sapiro

On 9/23/23 02:54, Jana Berger wrote: > > I have multiple control messages, all received from my instance which > all contain the "Content-Transfer-Encoding: base64" marker, their > contents is plain text (Content-Type: text/plain; charset="utf-8"), but > they are still encoded using base64. It seems you are saying these messages are valid. I.e. they specify "Content-Transfer-Encoding: base64" and the body is in fact base64 encoded. This is as they should be. > Of course that is not proof, but an indication that it is either done by > the mail server itself or widely across MUAs. As you say, this suggests that some MTA in the path to your user or the user's MUA is responsible for decoding the base64 encoded body but leaving the "Content-Transfer-Encoding: base64" header as is. > Global "Preferred language" is "English (USA)", which is not overridden > by the list in question. I have not changed the default encoding. Is > there a surefire way to detect this? > > My mailman.cfg has no section pertaining to encoding, and all related > files also do not mention encoding. The Subject: and body of these messages should be ascii, not utf-8 unless you have something like ``` [language.en] charset: utf-8 ``` in your mailman.cfg -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 8 months

[MM3-users] Re: Single Click Unsubscribe

by Mark Sapiro

On 1/25/24 15:21, olebra(a)samfundet.no wrote: > > To me, "subscribed messages" in the above means the policy applies to > everyone sending over 5k emails daily, whether for marketing or not. > > All the best, > Ole > > [0]: https://support.google.com/a/answer/81126 > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… You can always put something like the above "To unsubscribe ..." line in the lists footer as we do. Gmail's web UI renders that as a mailto: link. Further, at least in some cases, Gmail's web UI recognizes the List-Unsubscribe header in the message and provides it's own Unsubscribe buttons in the web UI. Granted, these aren't truly "one click" as they require confirmation, but that can be avoided by setting a list's unsubscribe_policy to `open`. Also granted that Gmail is the 900 pound gorilla here, but unsubscribe links that don't require confirmation are a bad idea. Even if the link contains some kind of encrypted data to ensure it can't be spoofed, there is still a danger if I forward list mail to a 3rd party and they click my unsubscribe link. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 4 months

[MM3-users] Re: problems installing mailman3 under gentoo and upgrading mailman2 to mailman3

by Mark Sapiro

On 3/13/21 7:08 PM, John Covici wrote: > On Sat, 13 Mar 2021 16:22:59 -0500, > Abhilash Raj wrote: >> >> My guess is that you updated the database (perhaps, by invoking the mailman >> command form 3.3.3) and then tried to start 3.3.2. In this case, Mailman comes >> up and sees a new revision for the database migration added from 3.3.3 but >> can’t find the same migration in its source (because it is 3.3.2). > > That is sort of what happened, except in the opposite direction, it > was from 3.3.3 to 3.3.2. My question is therefore, do I have to > update this alembic_version when I upgrade mailman to a newer version? > That is what I was getting at. Abhilash's conjecture is that the error was due to a Mailman version accessing a database that had been previously accessed by a newer version so that the version_num in the alembic_version table didn't exist in mailman/database/alembic/versions/. This normally would not occur on an upgrade of Mailman, but if you went from a gentoo Mailman core to a version obtained by pip, it's possible that the gentoo Mailman had an alembic version that wasn't known to the pip Mailman even though the pip Mailman was newer. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Re: Installing Mailman3 on Debian Bullseye

by Andy Smith

Hi Franklin, On Sat, Aug 26, 2023 at 04:59:04PM +0800, Franklin Weng wrote: > I had a blog article describing how I did it. Maybe there were something > you find it ridiculous, but they are all what I found important and may not > be shown in the current documents. > > https://blogs.slat.org/node/1012 Having been through this process with Debian 11 last year, in addition to several of your discoveries, I found that the default Whoosh full text indexer was just not usable. It is ridiculously slow and memory-hungry, and used 6+ gigabytes of RAM and days of CPU time to try to index some of my Mailman 2 mboxes. I should think almost everyone will want to switch to Xapian instead. That is accomplished on Debian with: # apt install libxapian30 python3-xapian python3-xapian-haystack and then in mailman-web.py: HAYSTACK_CONNECTIONS = { 'default': { 'ENGINE': 'xapian_backend.XapianEngine', 'PATH': '/var/lib/mailman3/web/fulltext_xapian_index', }, } As far as I understand Xapian is not the default because although Xapian has an open source license, it is one that's not compatible with Mailman's GPL3 license. At the time I installed, Debian 12 had not yet been released, and I won't upgrade that host until necessary, but I personally would not do a new install on Debian 11 so I would want to resolve the problems you had with Mailman 3 on Debian 12. Cheers, Andy -- https://bitfolk.com/ -- No-nonsense VPS hosting

1 year, 9 months

[MM3-users] Re: Splitting hosts: mta&core vs postorius

by Mark Sapiro

On 6/22/20 12:23 PM, Ruth Ivimey-Cook wrote: > >> I agree with this, we need a setting for which interface for Gunicorn >> to listen on, and what Mailman Core sends out in the self_link >> attribute when responding to REST requests. >> > Exactly! :-) Except if there were a `bind_host` setting to specify the host to bind the REST API to and you set that to `0.0.0.0` you would have exactly what leads to the situation below, so we need to understand what's happening there (although I think I do - see below). On 6/22/20 12:21 PM, Ruth Ivimey-Cook wrote: > > I did try with the gunicorn patch Mark mentioned (host = "0.0.0.0") and > changing the cfg file hostname back to the full name of the host, and > that now works!! -- in that the problem I showed earlier is gone. > > > However I then get another issue. From the mailman.log file I now see in > the last few lines. For clarity I've numbered them like this "{1}": > > {1} [22/Jun/2020:00:58:24 +0000] "GET /3.1/domains HTTP/1.1" 200 320 "-" > "GNU Mailman REST client v3.3.1" > {2} [22/Jun/2020:00:58:24 +0000] "GET /3.1/domains/ch-bc.org.uk > HTTP/1.1" 200 215 "-" "GNU Mailman REST client v3.3.1" > {3} [22/Jun/2020:00:58:24 +0000] "GET > /3.1/domains/greyarea-web1.cam.ivimey.org/lists?advertised=true&count=0&page=1 > HTTP/1.1" 404 26 "-" "GNU Mailman REST client v3.3.1" > > At this point the browser screen reports "Something went wrong" and the > message "HTTP Error 404: {"title": "404 Not Found"}" Tracebacks would really help. You should be able to find them in the log configured as LOGGING['handlers']['file']['filename'] in your Django settings. > Previously, the process stopped at line {1}. Now that and line {2} is > executed (AFAIK) correctly, but then line {3} is isssued. I have no idea > why something is looking for "domains/greyarea-web1": > > - Only the "ch-bc.org.uk" domain is listed in the reply to line {1}, as > expected; Go to your Django admin web UI and look at your Django Mailman 3 Mail domains. This will be at a URL like https://greyarea-web1.cam.ivimey.org/admin/django_mailman3/maildomain/ Do you see this domain there? If so, delete it. > - "greyarea-web1" doesn't appear in any lists I can show with the > "mailman" cli command (and I think I tried them all); But that's looking at Mailman core which is not where Postorius is getting this list. > - "greyarea-web1" doesn't appear anywhere in the source or config other > than as the name of the host its running on or as an ALLOWED_HOST; > > - I tried using "curl -X DELETE" (from the api docs) to delete a domain > called that and it says no such list exists. Again, you're talking to core, not Django. > My only possible clue is that I think, at some point in the journey of > configuring mailman, I might have created a list called that on the > host. However since then I have wiped the install files and reinstalled. > I cannot make sense of this being the answer given the checks just listed. Did you wipe the database on greyarea-web1? > I went looking through the python source and can see that the get() > function does indeed throw a 404 exception if the domain isn't found, > but I cannot see which code is parsing the reply from the first line > > So I have two questions: > > 1) How can I fix this problem? See above. > 2) why does getting an 404 reply here cause the postorius web page to > produce a "something went wrong" /404 and nothing else, when it could > have simply reported that something had gone wrong with one specific > domain; Because the code isn't robust enough :( ... > Ideally, and this is icing on the cake, a listen address specification > should allow multiple IPs to be passed in, in which case the server > listens on all of them. I expect the python libraries already support this. We could implement a bind_address setting that would pass to gunicorns --bind parameter anything acceptable to gunicorn, although multiple values are tricky as they apparently require multiple -b/--bind options and a single -b/--bind doesn't support a list of values. But, I'm not convinced that this is something anyone needs. I'm still waiting for a response to <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: New Mailman 3 installation issues

by Mark Sapiro

On 5/19/21 1:26 PM, Sarah H wrote: > I think you've just hit the nail on the head as far as my biggest issue with this project. The documentation lays out an install method that should be roughly followable for anyone (though it needs a bit of fine tuning here and there) and then the rest of the configuration guide and documentation assumes that you have installed the software in a completely different way and doesn't work the same as the guide laid out. Because virtually all that documentation was written by different people and long before the https://docs.mailman3.org/en/latest/install/virtualenv.html was added. > The documentation should be uniform, if you want users to install it one way then write the guide and documentation so that's the "default". Sure present alternatives or notes "if you've installed via git, your commands will look like this xxx" but ultimately the biggest issue I've had with getting this deployed is inconsistent or lacking documentation. I'm not trying to make excuses. I know the docs need improvement, but we are a very small, all volunteer project doing the best we can. If you feel you can offer improvements to the documentation, we'd love to have your help. You are more than welcome to submit merge requests to update the docs. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years

[MM3-users] Re: DKIM header not added to subscribe/unsubscribe notification email

by Philip Colmer

On Fri, 19 Aug 2022 at 18:11, Stephen J. Turnbull < stephenjturnbull(a)gmail.com> wrote: > My guess is that the address Mailman uses for From in those messages > is not in OpenDKIM's SigningTable. This is probably the > $LIST-owner@$LISTDOMAIN address. You should also add the > mailman@$LISTDOMAIN address. > Thank you - it was precisely this bit (the Signing Table) that I was missing. Adding that configuration has fixed it. > Neither can we, although for a different reason. ;-) Please don't > hesitate to send full configuration files to us on the grounds of > absolute size or bandwidth. Such reports are relatively rare, they're > not actually that big, and almost everybody on our lists are admins > who know that it could be them tomorrow. Unfortunately at present I > don't think you can send it as attachments. > > If you're worried about system security, you can either redact > sensitive information such as passwords, domain names, mailboxes, and > IP addresses, or you can send it to one of the developers directly > (me, at the moment; Mark, when he gets back in a few weeks -- I > believe Mark prefers a zipfile if there are multiple files, and I know > I do) if you're willing to trust us. > Thanks, Steve. I appreciate that gesture. Thanks again for your help. Very much appreciated. Regards Philip

2 years, 9 months

[MM3-users] Re: mailman-web compress - Invalid template socialaccount/login_cancelled.html

by Jered Floyd

> Consequent upon this django-allauth issue and the previous issue > with psycopg2, how likely is it that new MM3 installations will suffer the > effects? > I am asking because I am doing my tests on a relatively vanilla system and > just following the official documentation sin any deviations. The allauth issue will happen until the allauth package is patched. Mark's patch was merged yesterday, so I suspect a new release will be imminent. I've noticed the django-allauth ecosystem seems to be somewhat prone to breaking changes. I'm sure this discussion has happened before, but it may be worth pinning "known good" dependency versions for django-mailman -- either in the project, or in your documentation. It's definitely a headache for me since I rebuild my mailman container roughly weekly, and always need to allow time for functional testing or rollback to my last image. There's not really a right answer here; either dependency versions are left open and the end user gets security updates for dependencies on their own schedule, or the Mailman maintainers have to monitor for security updates in the dependency tree and push a new mailman release. (This can also help ameliorate supply-chain attacks where an unverified update ends up in PyPI, but I'm not sure that's a realistic threat model for us.) I'm sure this is something the maintainers have considered in the past. --Jered

1 year, 7 months

[MM3-users] Re: Another interesting error...

by Mark Sapiro

On 04/23/2018 02:59 PM, Darren Smith wrote: > Well, using the mailman shell we were able to find the request that was > causing the problem - it was apparently a spam message that had some > chinese characters in it. I am trying to duplicate this issue in a test environment. I can create a message with an invalid RFC 2047 encoded subject, i.e., Subject: =?gb2312?Q?=ff=fe=de=21=a2?= and send it to a list where it gets held, but I don't get a 500 in postorius and I see the held message with a raw (not decoded) header. I think there were some recent changes that affect this. I'll look some more. > We used the shell to delete the held request... > > And postorius is still giving me an error 500. > > If I'm not mistaken the held messages are kept in .pck files - do you know > if when postorius asks for held messages through the API, does mailman go > to the database or to the .pck? I would actually suspect the latter, or > removing the request should have fixed the problem. They were held in .pck files in Mailman 2.1, but not in Mailman 3. They should just be in the database and deleting them via mailman shell should delete them as long as you quit the shell or commit(). -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 1 month

[MM3-users] Re: mass subscribers disablement!?

by Mark Sapiro

On 10/22/21 2:07 PM, Christian Stalberg via Mailman-users wrote: > I added the additional hosts to ALLOWED HOSTS in settings_local.py and > mailman is distributing mail to subscribers again. However, I then received > many emails of valid users subscriptions being disabled. What would cause > that? Did you just upgrade Mailman core from a version <=3.3.0 to one >=3.3.1? If so, see https://lists.mailman3.org/archives/list/mailman-users(a)mailman3.org/threa… > Can subscriber management be done via command line? See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/commands/d… for description of the available mailman subcommands. If you are interested in re-enabling delivery for members whose delivery is disabled by bounce, you can do this fairly easily in an interactive `mailman shell` session. See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/commands/d… Something like the following session: ``` $ bin/mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> lm = getUtility(IListManager) >>> for mlist in lm.mailing_lists: ... for member in mlist.members.members: ... if member.delivery_status == DeliveryStatus.by_bounces: ... member.preferences.delivery_status = DeliveryStatus.enabled ... print("Re-enabled delivery for bouncing member {} on list {}" ... .format(member.address.email, mlist.list_name)) ... <print output here> >>> commit() >>> exit() ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 7 months

[MM3-users] Re: Installed from Howto_Install_Mailman3_On_Debian10, web not quite working

by Mark Sapiro

On 5/7/23 10:51, Volkmar Grote wrote: > thanks for the quick reply. > I am one step closer to a solution, > "http://127.0.0.1:8000/postorius/lists/?all-lists#" seems to work now. > I get the functionality, but it looks ugly w/o any graphics, for which I > get yet another, slightly similar, error message: >> >> >> Page not found (404) >> >> Request Method: GET >> Request URL: >> http://127.0.0.1:8000/static/postorius/img/mailman_logo_small_trans.png >> >> ... > > Nginx, /etc/nginx/conf.d/me.domain.de.conf >> server { >> listen 80; >> listen [::]:80; >> >> server_name me.domain.de; >> ... >> location /static/ { >> alias /opt/mailman/mm/static/; >> } > > Again, many thanks in advance for any clue The above in nginx is correct, but you aren't getting the static files via nginx. You need to go to a URL like http://me.domain.de/postorius/lists/. Going to http://127.0.0.1:8000/postorius/lists/ goes directly to your wsgi server and doesn't involve nginx at all. You need to go to port 80 where nginx is listening and nginx then proxys requests to 127.0.0.1:8000. Do you also have location / { proxy_pass http://127.0.0.1:8000; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } in /etc/nginx/conf.d/me.domain.de.conf. You need that. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 1 month

[MM3-users] Re: MM3 Docker

by Odhiambo Washington

On Tue, 8 Jan 2019 at 16:58, <brian(a)emwd.com> wrote: > Odhiambo Washington wrote: > > So you just added: > > - stop_grace_period: 30s > > > > to the block?? > > I actually did not add it. It was already there from the docker files that > I pulled from: > > https://github.com/maxking/docker-mailman That's odd, because I also pulled the same file, but it doesn't have it. > > > > > > I don't know if that setting makes any difference. I am also > > > using the > > > included postgres database instead of mysql. > > > > > > For the mailman-web section, you need to add the following: > > > > > > - SERVE_FROM_DOMAIN=yourdomain > > > - MAILMAN_ADMIN_USER=youruser > > > - MAILMAN_ADMIN_EMAIL=youradminemailaddress > > > > > The mailman-web section has sub-sections. Under which one do I add > > these? environment?? Or networks below the IP address? > > Under the environment sub-section. > Added those now. > > > I have apache2 and nginx on the server. Apache listens on 80 and 443 > while > > nginx listens on 8080 and 8443. > > I won't be of much help here I am afraid. My server is just using nginx. > Well, I suppose https://FQDN:8443/something should lead to the MM3 web UI?? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

6 years, 5 months

[MM3-users] Re: How to modify system preferences

by Allan Hansen

The other way is to tell all your users to use gmail, as that is how they handle messages from email lists, no matter how much I and others have complained to them about it. :-) Yours, Allan Hansen hansen(a)rc.org > On Feb 19, 2021, at 9:50 , Mark Sapiro <mark(a)msapiro.net> wrote: > > On 2/19/21 5:15 AM, Jack Lenox via Mailman-users wrote: >> >> The documentation states that these are only accessible in a read-only >> format via the REST API, but presumably there is a way of modifying >> these somewhere? I can't find a way of specifying this in my config and >> can't find a relevant example in the sample schema.cfg. >> >> At this stage, all I want to do is set the default for >> "receive_own_postings" to False. Can anyone point me in the right >> direction here? > > > The defaults for settings like this are not directly configurable. You > need to patch the relevant entry in mailman/core/constants.py > > I have just filed <https://gitlab.com/mailman/mailman/-/issues/832> for > this. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

4 years, 3 months

[MM3-users] Re: Issues with cross posted emails after upgrading to mailman 3.3.6

by Simon Coggins

On 5 Nov 2021, at 6:30 am, Mark Sapiro <mark(a)msapiro.net<mailto:mark@msapiro.net>> wrote: > Yeah it’s not a great solution but it’s the quickest I could come up with that works “for us”. 99% of our lists are announcement lists only with minimal replies so while this will break some. I’m hoping it will give us enough time to wait out a proper fix. I’ve created a new issue #955 with as much detail as I think you’ll need. Let me know if you need any more. Thanks for filing the issue. I'll work on a solution. My current thinking is to add a `count` column to the message table, set the count to 1 when initially adding a message-id, increment the count when adding an existing message-id, decrement the count when deleting a message-id and only delete the entry and message when the count reaches 0. That should work well. I’m happy to do some testing of any patches you create in our test environment if you need extra testing. -- Mark Sapiro <mark(a)msapiro.net<mailto:mark@msapiro.net>> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org<mailto:mailman-users@mailman3.org> To unsubscribe send an email to mailman-users-leave(a)mailman3.org<mailto:mailman-users-leave@mailman3.org> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/<https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org> —Simon

3 years, 7 months

[MM3-users] Linking to a forum thread from a (news) website.

by Paul Arenson

I have been struggling to get this right and I think I have finally done it. I have a website with many opinion and news articles. I have linked from the article to a pre-written thread, such as from here: EXAMPLE WEBSITE ARTICLE https://www.tokyoprogressive.org/remembering-the-tsushima-maru-disaster-75-… to EXAMPLE THREAD ON LIST Title: Remembering the Tsushima Maru Disaster 75 Years Later https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… PROBLEM The problem is that this does not show the subsequent comment that was added. And SHOW REPLIES BY DATE does not do it either. SOLUTION I figured out that all replies are listed under Re:, so if the first comment does not have the Re:, then it gets cut off. So if I click https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… you will see all the subsequent posts. Since I want to post a link BEFORE anyone starts replying, I have to make my first post in the thread titled Re: EXAMPLE OF NEW POSTING STYLE Make sure the thread has a Re: in it. (Actually I made a mistake and wrote Re; and it still worked.) https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… Or: https://list.tokyoprogressive.org/hyperkitty/list/discuss@list.tokyoprogres… ----------------- QUESTION Am I correct that if I want to create a thread and link to it, but make sure the first note is included, I need to make the thread title: Re: Something? -----------------

5 years, 8 months

[MM3-users] Re: Changing default message limit (max_message_size)

by Abhilash Raj

On Mon, May 27, 2019, at 8:23 AM, Mark Sapiro wrote: > On 5/27/19 12:05 AM, roger(a)reasonal.com wrote: > > I found the field in settings that would appear to do this, but it just throws an error for whatever I give it ("An error occured**: Unknown attribute: max_message_size"). > > This should be fixed at > <https://gitlab.com/mailman/mailman/merge_requests/329>. > > Perhaps you need to update your Docker images > <https://asynchronous.in/docker-mailman/> That's right. You are probably using a new version of Postorius but not of Mailman Core. Please make sure the container images you have are updated. > > Also, see > <https://gitlab.com/mailman/postorius/issues/246#note_69323948> for a > not about changing this via `mailman shell` (withlist), but see the > subsequent comment about `quit()` > > > > PS As a suggestion, may be a good idea to indicate what units it's expecting... bytes? kB? Nybbles? > > Reported at <https://gitlab.com/mailman/postorius/issues/362>, thanks. > > > PPS ** Psst: occurred with two r's... > > Reported at <https://gitlab.com/mailman/postorius/issues/361>, thanks. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years

[MM3-users] Re: exposing Mailman3 API securely

by Abhilash Raj

On Mon, Jul 8, 2019, at 3:12 PM, dancab(a)caltech.edu wrote: > I'm working on a container based Mailman3 solution for my university. > We have a help desk tool which needs to access the API remotely for > creating and deleting Mailman lists. The API will be restricted to a > private network, behind a firewall, etc. > > What is the simplest way to expose the API to an external host? I do want to stress the fact that we wouldn't advise exposing the API to internet since there is a very basic authentication in the API an the API is an administrative API. > > At the moment, I seem to have this partially working via an Apache > virtual host configuration which simply proxies via > api.example.edu:80 to localhost:8001 on the container. > > I'm able to remotely use the mailmanclient module for the client.lists, > client.system and client.members commands. However running > client.domains generates an API connection error. So it seems unstable. Does it *always* happen when you run `client.domains`? Did you get an error traceback? > > Any thoughts or suggestions? > > Thanks. > > > ---- > Dan Caballero > Systems Administrator > Academic Computing Solutions > IMSS - Caltech > https://imss.caltech.edu > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years, 11 months

[MM3-users] Re: Exception in the HyperKitty archiver: 'utf-8' codec can't encode characters

by Gilles Filippini

Gilles Filippini a écrit le 15/06/2020 à 22:05 : > Mark Sapiro a écrit le 15/06/2020 à 21:58 : >> On 6/15/20 12:37 PM, Gilles Filippini wrote: >>> >>> There are 4 emails stored into this folder. 3 of them are spam, and the >>> last one is a legitimate email. This is annoying that such emails could >>> accumulate and stay into var/archives/hyperkitty/spool/ forever, causing >>> more and more hyperkitty errors. >>> >>> Any idea how to make their processing more error proof? >> >> >> Change the offending .encode() method to add errors='replace'. >> >> The traceback from the error should tell you where it is. >> >> You could also open an issue at >> <https://gitlab.com/mailman/hyperkitty/-/issues> for us to look at. If >> you do that, please include an error traceback if possible. If there is >> not a traceback in mailman.log associated with the error, there might be >> one in HyperKitty's log (configured in Django's settings). Also, >> including enough of a message to duplicate the issue is very helpful. > > I've now deleted the offending messages. Will open an issue with related > details the next time this error occurs. I've experienced this error again today. Filed issue #301. Thanks, _g.

4 years, 11 months

[MM3-users] Re: disable body transcoding

by Mark Sapiro

On 9/22/21 9:02 AM, Markus Schaaf wrote: > Hi, > > I have disabled all message modifications and filtering from within the > webUI, and created empty header and footer template files. Still, some > list messages get their body encoding changed to base64, breaking DKIM. > What can I do to prevent this? (I'm a newbie to mailman3, so please give > somewhat complete commands. I have read other threads with similar > questions, but did not understand some shortened configuration commands.) This is probably due to the message body charset being utf-8. The Python email library used by Mailman encodes utf-8 message bodies as base64. There are no configuration settings in Mailman to avoid this. Calling email.charset.add_charset('utf-8') at some point in Mailman's processing might avoid this. E.g. ``` --- a/src/mailman/handlers/validate_authenticity.py +++ b/src/mailman/handlers/validate_authenticity.py @@ -23,6 +23,7 @@ import logging from authheaders import authenticate_message from authres import AuthenticationResultsHeader, SyntaxError from dns.resolver import Timeout +from email.charset import add_charset from itertools import chain from mailman.config import config from mailman.core.i18n import _ @@ -121,5 +122,7 @@ class ValidateAuthenticity: def process(self, mlist, msg, msgdata): """See `IHandler`.""" + # Try to avoid base64 encoding of utf-8. + add_charset('utf-8') if config.arc_enabled: authenticate(msg, msgdata) ``` Note this is just a guess and could be a disaster so test it before trying it in production. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 8 months

[MM3-users] Re: Apache Conf

by Thomas G

Hi tried both. Same result. xxxx - - [19/Oct/2018:21:14:22 +0200] "GET /static/postorius/js/script.js HTTP/1.1" 404 4051 "-" "Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Firefox/60.0" Le ven. 19 oct. 2018 à 18:59, Mark Sapiro <mark(a)msapiro.net> a écrit : > On 10/19/18 10:29 AM, Guiseppin Thomas wrote: > > Hi, > > Currently, I use a nginx configuration for mailman. It's work perfectly. > > > > I tried to do the same with Apache, but the statics files are not > > delivered (404). > ... > > <VirtualHost *:80> > > ServerName mailing.ddd.fr > > > > ErrorLog ${APACHE_LOG_DIR}/mailing.error.log > > CustomLog ${APACHE_LOG_DIR}/mailing.access.log combined > > > > <Location /static/> > > Alias "/opt/mailman/static/" > > </Location> > > > > <Location /> > > ProxyPass http://localhost:8000/ > > ProxyPassReverse http://localhost:8000/ > > ProxyPreserveHost On > > </Location> > > </VirtualHost>/ > > > In Apache, location > <http://httpd.apache.org/docs/2.4/mod/core.html#location> is not > appropriate for resources in the file system. > > Try > > Alias /static/ /opt/mailman/static/ > > not within a location block. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >

6 years, 7 months

[MM3-users] Re: Verification Failed Error

by Odhiambo Washington

On Fri, 21 Dec 2018 at 15:00, Stephen J. Turnbull < turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > Abhilash Raj writes: > > > Exim experts would be able to help you better with this. > > I'm the one who set up the original sample Exim .conf, because (a) I > didn't want to migrate all my bots to Postfix, and (b) the one-real- > host .conf turned out to be trivial. I'm an Exim expert only for my > own configuration, which is a (pre-global-warming) glacially-moving > target. I've never seen anything like the problems described here, > sorry. Can't help. > > Since it's looking like we don't have any real Exim experts hanging > around here, perhaps we should move the sample containers and other > default configs to assume Postfix and document "Exim should work but > you're kinda on your own, we'll do what we can but it's limited." At > least Mark is maintaining such systems, and they're probably better > documented than Exim for the single-real-host configuration, though > they would probably run into similar problems with the containerized > setup. WDOT? > > Steve > > Hi Steve, I will handle the Exim bits for him! I am familiar with Exim, so I will be able to help him overcome all the errors. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

6 years, 5 months

[MM3-users] Re: MM3 Docker

by Odhiambo Washington

On Sun, 6 Jan 2019 at 18:55, Mark Sapiro <mark(a)msapiro.net> wrote: > On 1/6/19 6:54 AM, Odhiambo Washington wrote: > > > > If I could run MM3 using the apt-get install method, perhaps that would > > have made my life a bit easier, hoping that MM3 can actually be run in > > parallel with MM2.1 on the same host. Is anyone doing that already?? > > > Yes. I am on two production and one development machines. See, e.g. > <https://mail.python.org/mailman/listinfo/> and > <https://mail.python.org/mailman3/> > > One caveat here is I install both Mailman 2.1 and Mailman 3 from source > on all these machines. I don't know for example if the Debian/Ubuntu > packages play well together. > On my Ubuntu machine, I decided to install MM21 from source so I am willing to install MM3 either from source, package or docker. The sparse documentation is my undoing. > > See <https://wiki.list.org/DOC/Mailman%203%20installation%20experience> > for more on how I install MM 3. > I have seen that link, but it's missing a ton of details within the process. As I mentioned before, these virtualenv stuff are new to me too, so I thought dockernization would simplify things. If you could include the missing steps that you left out then I could possibly be able to follow the steps :-) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

6 years, 5 months

[MM3-users] Re: SMTPSenderRefused - howto enable STARTTLS for local mail drop

by Stefan Bauer

Hi Steve, thank you for your time. Thats it :) Works now. I had to set it in /etc/mailman3/mailman-web.py After first logon, django tries to send a mail to confirm email address. Nov 10 08:44:56 mal02 postfix/qmgr[2893767]: 9255C5E0BE2: from=<postorius(a)lists.mydomain.tld>, size=920, nrcpt=1 (queue active) Nov 10 08:44:56 mal02 postfix/smtpd[879486]: disconnect from localhost[::1] ehlo=2 *starttls=1* mail=1 rcpt=1 data=1 quit=1 commands=7 This now works with STARTTLS. Hoooray :) Am Di., 9. Nov. 2021 um 16:50 Uhr schrieb Stephen J. Turnbull < stephenjturnbull(a)gmail.com>: > Stefan Bauer writes: > > > No matter what i try, mailman still only connects without STARTTLS: > > Earlier you wrote: > > > SMTPSenderRefused at /accounts/login/(530, b'5.7.0 Must issue a > STARTTLS command first', 'postorius(a)lists.mydomain.tld') > > Request Method: POST > > Request URL: https://mm3.mydomain.tld/mailman3/accounts/login/ > > Django Version: 2.2.12 > > This looks like Django errors, not Postorius (Mailman). So this is > something Django is doing, not Mailman (including Postorius). I'm not > sure why Django is sending email (somebody made a password reset > request seems likely, but I'm not that familiar with Django authn > stuff). Anyway, if it's internal to Django, it would not consult > Mailman's configs. This recent StackOverflow seems relevant: > > > https://stackoverflow.com/questions/60025730/530-5-7-0-must-issue-a-starttl… > > HTH > > Steve > >

3 years, 6 months

[MM3-users] Re: Problem creating list members using REST API

by Mark Sapiro

On 1/18/22 2:11 PM, Stephen Daniel wrote: > The REST API documentation is a bit informal. As someone who is not > familiar with mailman, and who doesn't know python, they are a bit of a > slog. Agreed. I guess we sort of assume that people dealing directly with the REST API are familiar with both. > It might be worth seeing if the code can be enhanced to allow the boolean > values to be sent in using JSON booleans as well as JSON strings. I think here we only have to deal with the REST API because other uses of as_boolean are all on strings that come from config files. We can't modify as_boolean directly, as it is part of a third party dependency and is intended to be used with config files, not JSON objects, but I think something like this will do it. ``` --- a/src/mailman/rest/helpers.py +++ b/src/mailman/rest/helpers.py @@ -249,6 +249,8 @@ class GetterSetter: """ if self.decoder is None: return value + if self.decoder is as_boolean and isinstance(value, bool): + return value return self.decoder(value) ``` Perhaps you could try to test that. I just created https://gitlab.com/mailman/mailman/-/issues/970 for this. It would help me in fixing this if you could provide a small piece of your code that throws the error. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Python program to create lists and import settings from Mailman 2 to Mailman 3

by Greg Newby

Hi friends. A couple of weeks ago I asked for help with calling Mailman functions from within a Python program. This was to avoid using the web interface or shell commands to create a new list from a legacy Mailman 2.x list, and instead do it from within a Python program. Here is the program I ended up using, and I thought it would be worthwhile to get into the Mailman users list archives for future folks. Note that this is for the (recommended) venv installation of Mailman. Some things might be different for other installations. I'll paste the program and also attach it: #!/opt/mailman/venv/bin/python3 # Note: The line above should be the Python3 interpreter for your # installed version of Mailman3. It's the same as the first line in # your 'mailman' command, which might be named manage.py or something # else in your environment. # The venv version of Mailman used to develop this program is: # GNU Mailman 3.3.9 (Tom Sawyer) # Python 3.12.3 (main, Apr 10 2024, 05:33:47) [GCC 13.2.0] # About: # The multiple steps of creating a Mailman 3 list based on a legacy # Mailman 2.1 list. # gbn July 28 2024. This little program is granted to the public domain. ######################################################################## # Adjust these variables for your list, domain, MM2 and MM3 locations: lists_to_import = [ # listname, domainname ('testlist','example.org'), ('testlist2','example.org') # Add more lists as needed ] ######################################################################## # Load prerequisite functionality: from mailman.config import config # Needed for transaction.commit from mailman.core.initialize import initialize # For initialize() from mailman.app.lifecycle import create_list # For create_list import pickle # Pickle file handling from contextlib import ExitStack # Pickle file handling from mailman.commands.cli_import import _Mailman, _Bouncer # "" from mailman.utilities.modules import hacked_sys_modules # "" import subprocess # Subprocess for import21 ######################################################################## # Step 0: Initialize the environment: # Without arguments, initialize() looks in the standard locations for your .cfg def do_init(): initialize() # Alternative: Load an explicit configuration file, such as: # initialize('/etc/mailman3/mailman.cfg') ######################################################################## # Step 1: Create the list # Note: This fails silently if the list already exists or something goes wrong def do_create(new_list): try: # The list might exist or otherwise not be creatable l = create_list(new_list) except: # I did not find useful return values from create_list to diagnose print('create_list('+new_list+') failed. Trying to proceed anyway') # This saves your new list: transaction = config.db transaction.commit() ######################################################################## # Step 2: Rewrite the pickle file from the legacy list. def do_pickle(old_pickle_file, new_pickle_file): # These definitions are so the old pickle file can be parsed: with ExitStack() as resources: resources.enter_context(hacked_sys_modules('Mailman', _Mailman)) resources.enter_context( hacked_sys_modules('Mailman.Bouncer', _Bouncer)) # Input the old pickle file from MM 2.1 with open(old_pickle_file, 'rb') as fp: data = pickle.load(fp) # ban_list was a problematic value from my MM2.1 lists: # print(data['ban_list']) data['ban_list'] = [] # Any other settings you want to change? Add them here. These # variables may be seen with MM2's 'config_list' command data['require_explicit_destination']=1 # yes data['member_moderation_action']=1 # reject data['generic_nonmember_action']=2 # reject data['max_num_recipients']=2 # block cc/bcc to list fp.seek(0) # probably not needed fp.close() # ditto # Output: Rewrite the file in the current MM3 format with open(new_pickle_file,'wb') as ofp: pickle.dump(data, ofp) ofp.close() ######################################################################## # Step 3: Import the legacy settings to the newly created list def do_import(new_list, new_pickle_file): # I did not see how to call import21 directly from Python, so am using # a subprocess which basically uses the CLI syntax. # # CLI syntax: mailman import21 [OPTIONS] LISTSPEC PICKLE_FILE def import_list(listname, pickle_file): command = [ 'mailman', 'import21', listname, pickle_file ] subprocess.run(command, check=True) # print(f"List {listname} imported successfully.") # Import the list via a subprocess: import_list(new_list, new_pickle_file) # This saves your changes: transaction = config.db transaction.commit() ######################################################################## # Main process: do_init() # Loop for all lists we want to create & import: for new_listname, new_domainname in lists_to_import: new_list = new_listname+'@'+new_domainname # Adjust for wherever your old MM2 lists are: old_pickle_file = '/var/lib/mailman/lists/'+new_listname+'/config.pck' print('Starting list '+new_list) # The new pickle_file doesn't need to be saved after this program exits new_pickle_file = '/opt/mailman/'+new_listname+'-new.pck' do_create(new_list) do_pickle(old_pickle_file, new_pickle_file) do_import(new_list, new_pickle_file) print('Done with list '+new_list) # Don't forget to import and then index your list for full-text # searching. We're not doing that here because it takes awhile # (depending on the size of the archive). Use a command from the bash # shell such as: # mailman-web hyperkitty_import --since=1971-01-01 -l listname@domainnamed /var/lib/mailman/archives/private/listname.mbox/listname.mbox # followed by: # mailman-web update_index_one_list listname@domainname ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Replaced multipart/alternative part with first alternative.

9 months, 4 weeks

[MM3-users] Re: Shorted Subjects in Mailman

by Stephan Krinetzki

Victoriano Giralt wrote: > On mar, 2022-07-26 at 10:09 +0000, Stephan Krinetzki wrote: > > Hi, > > Hi, > > i tried now with a Postfix 3.x -> Mailman > > Postfix has en extremely useful setting called debug_peer_list where > you can list addresses of machines whose messages you are interested in > and the level of detail can be set with debug_peer_level. this will > result on very detailed logging of the SMTP conversation. > But, before resorting to this very invasive method, I'd put messages on > the HOLD queue and inspect them with postcat, before releasing them to > be passed to Mailman. this way, you will be able to see if the subjects > are cur "before" reaching Mailman. > > Original to Mailman: https://pastebin.com/c4BHeEkJ > > Subject: =?utf-8?q?=5BJaninsliste=5D_=5BSAV- > LINUX=5D_Notice_from_Sophos_Anti-Virus_on_server=2Eexample=2Ecom?= > > After Recieving: https://pastebin.com/JG0NKbjq > > Subject: =?utf-8?q?=5BJaninsliste=5D_=5BSAV- > LINUX=5D_Notice_from_Sophos_Anti-Virus_on_server=2Eexample=2Ecom?= > Both of then show the same Subject: header. In https://pastebin.com/c4BHeEkJ, Line 79+80 it says `Subject: [SAV-LINUX] Notice from Sophos Anti-Virus on server.example.com [DEMO1]` So this correct. in https://pastebin.com/JG0NKbjq, Line 177 its truncated `Subject: =?utf-8?q?=5BJaninsliste=5D_=5BSAV-LINUX=5D_Notice_from_Sophos_Anti-Virus_on_server=2Eexample=2Ecom?=` So my guess is, that the local Postfix on the Mailman Server is doing the QP. In the Chain there are postfix 3.x -> MS Exchange -> Postfix 2.x -> Mailman After Releasing the mail from hold Mailman -> Postfix 2.x -> Exchange Regards Stephan

2 years, 10 months

[MM3-users] 120 gmail users removed from lists !

by Stephen J. Turnbull

elemac(a)free.fr writes: > Hello, on 15th October, 120 users with gmail address where suddenly > removed from lists in mailman3, something changed in google ? Google is evil, who knew? Google decided to publish a DMARC policy of "p=none". This announces to the world that you have to decide for yourself whether to accept mail from Gmail with a broken DKIM signature from gmail.com. Gmail has decided that they will not accept such email from themselves, even though they know more about the sender than anyone else, and even have access to the original sender copy. Mark has a patch that applies your preferred DMARC mitigation to Gmail authors unconditionally. I think it's in the new version just released 3.3.9, so you can upgrade. The name of the variable is dmarc_addresses, and in Postorius it will be in the same settings group as other DMARC settings, with a similar tag. If for some reason you strongly prefer not to upgrade immediately but want this feature, it's commit #8532f751b6b8bfee3210c1327d755756f99d99ac (you can shorten that to 8532f). I do not recommend this. It probably is independent of other changes in 3.3.9 from other releases. But if not you could have issues. I think you also need the patches in Postorius, but I don't think they've been released yet. "Coming soon" as they say. The relevant commit is #770add1ebf27fd335c675607f26bb8f7cf313ddd, If you search back in the archives, I think Mark posted a link to his original patches. Steve

1 year, 7 months

[MM3-users] Re: Verification Failed Error

by Abhilash Raj

On Thu, Dec 20, 2018, at 10:25 AM, brian(a)emwd.com wrote: > I am using Exim as the MTA. I followed the instructions located at: > > https://github.com/maxking/docker-mailman > > In particular the "Setting up your MTA" > > Are you saying I need to do something with Django because your > documentation at github makes no reference to that? Where would I find > the settings.py file? I used your image to install Mailman3. FYI I am > referencing the "# To be added to Django's settings.py" instructions at The documentation at Github does makes reference to it. It might not be in the most visible manner, which I have opened an issue to fix[1] > To configure the mailman-web container to send emails, see these configuration settings. The documentation also mentions about the Django configuration file, settings_local.py (which is imported by settings.py at runtime). [3]. I have opened another issue to make that clear as well. [2] You can add all your Django related settings in `/opt/mailman/web/settings_local.py` if you using the images and docker-compose.yaml file from the above mentioned repo. [1]: https://github.com/maxking/docker-mailman/issues/277 [2]: https://github.com/maxking/docker-mailman/issues/278 [3]: https://github.com/maxking/docker-mailman#configuration > > http://docs.mailman3.org/en/latest/config-web.html#setting-up-email-required > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 5 months

[MM3-users] Re: postorius ssl-certificates for virtual hosts

by Mark Sapiro

On 11/15/19 3:45 AM, Wolfgang Bock via Mailman-users wrote: > > That doesn't solve the problem. I changed that in mailman-web.py > (MAILMAN_REST_API_URL = https://localhost:8001) and after that in > mailman.cfg (use_https: yes). But got the same errormessage on postorius > website. You posted this log excerpt: Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - "GET /3.0/lists?advertised=true&count=0&page=1 HTTP/1.1" 200 90 Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - "GET /3.0/lists?advertised=true&count=10&page=1 HTTP/1.1" 200 606 Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - "GET /3.1/domains HTTP/1.1" 200 1438 Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - code 400, message Bad HTTP/0.9 request type The first 3 GETs are a normal sequence of GETs from Postorius when you go to the Mailing Lists view. That should be followed by a GET like "GET /3.1/domains/domain.tld HTTP/1.1" where domain.tld is a configured domain. Do you have any domains configured?/0.9'? I'm not sure what the issue is. You have an older version of mailmanclient < 3.2.3a1 which uses httplib2 rather than requests. https://pypi.org/project/httplib2/ says: HTTP and HTTPS HTTPS support is only available if the socket module was compiled with SSL support. but I don't think this can be the issue because the first 3 GETs work. You might try upgrading mailmanclient to 3.3.0. I don't know if that will help, but it may. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 6 months

[MM3-users] Re: Using external services for deliverability?

by Mark Sapiro

On 6/30/20 7:03 AM, Brian Carpenter wrote: > On 6/30/20 9:56 AM, tom(a)gather.coop wrote: >> I have a Mailman 3 server up and running but I'm terrified to migrate >> to it from my existing Mailman 2 provider for fear that services like >> Gmail will randomly start blacklisting my IP with little I can do >> about it. I have SPF records set up so I'm hoping I'll be Ok but I'd >> like to have a backup plan. ... > There is no reason to be afraid if you are sending out legitimate > communications. SPF records will help. You will also need to enable > DMARC mitigation on your lists and Mailman 3 does that very well as > Mailman 2 did. It also helps if you sign your outbound mail with DKIM. > With those 3 things in place, you should have no problem sending mail. > Keep in mind AT&T will probably block you if the IP address you are > using is new. That is standard practice for them. It's easy to get that > block remove. Same goes for Comcast using their Vader RBL. You also need to ensure you have full circle DNS <https://en.wikipedia.org/wiki/Forward-confirmed_reverse_DNS>. That together with SPF and DKIM signing of outbound mail is virtually essential for deliverability. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: Strange password problem

by Eggert Ehmke

Hello Steve, my configuration is very much like the one described by Roland. Am Samstag, 23. September 2023, 13:02:46 CEST schrieb Stephen J. Turnbull: > Eggert Ehmke via Mailman-users writes: > > So for now I use the same password for all logins, and that > > works. But is that a good solution? The other option would be to > > assign multiple superusers for each domain, but they would still > > allow to log in via some other domain. > > If you own the domains, you can probably set up some sort of > trivial website on each that does nothing but admin stuff, with the > same database backend. Then you can have different passwords for > "admin" and the browser will remember them. > > Probably more tricky than it's worth. I have already URLS like lists.domain1.tld lists.domain2.tld ... not sure what you mean. > What are you doing that requires admin privileges, but you want to > authenticate separately for each domain? I ask because we've always > envisioned creating a domain-level administrator role, but until now > we've had no demand for it. I just thought it would be cleaner to have separate accounts for each list. Now I understand that the superuser has privileges on all lists. I also have a setting so that on each URL only the lists are visible that belong to that domain. Sadly I don't remember the setting, but that works. Cheers, Eggert

1 year, 8 months

[MM3-users] Clearing webserver cache - Nginx

by Odhiambo Washington

I am having an ugly-looking https://mm3-lists.kictanet.or.ke/archives/ page because of cached content: ``` 2024/08/05 17:00:31 [error] 694#694: *9562 open() "/opt/mailman/mm/static/CACHE/css/output.6dab123e4897.css" failed (2: No such file or directory), client: 172.70.111.39, server: mm3-lists.kictanet.or.ke, request: "GET /static/CACHE/css/output.6dab123e4897.css HTTP/2.0", host: " mm3-lists.kictanet.or.ke", referrer: " https://mm3-lists.kictanet.or.ke/archives/" 2024/08/05 17:00:31 [error] 694#694: *9564 open() "/opt/mailman/mm/static/CACHE/css/output.158acc288604.css" failed (2: No such file or directory), client: 162.158.159.31, server: mm3-lists.kictanet.or.ke, request: "GET /static/CACHE/css/output.158acc288604.css HTTP/2.0", host: " mm3-lists.kictanet.or.ke", referrer: " https://mm3-lists.kictanet.or.ke/archives/" 2024/08/05 17:00:31 [error] 705#705: *9566 open() "/opt/mailman/mm/static/CACHE/js/output.3aaa7705d68a.js" failed (2: No such file or directory), client: 162.158.63.166, server: mm3-lists.kictanet.or.ke, request: "GET /static/CACHE/js/output.3aaa7705d68a.js HTTP/2.0", host: " mm3-lists.kictanet.or.ke", referrer: " https://mm3-lists.kictanet.or.ke/archives/" ``` That IP address appearing there is not my actual IP, but Cloudflare's, which is acting as proxy for the site. Having cleared MM3-web cache, is there anything else I can easily do (apart from disabling CF proxying) to help deal with the above issue? Or am I barking the wrong tree? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

10 months

[MM3-users] Re: error changed after restart

by Abhilash Raj

On Sun, Feb 7, 2021, at 1:07 AM, Guillermo Hernandez (Oldno7) via Mailman-users wrote: > On 6/2/21 21:19, Abhilash Raj wrote: > > > > > > On Sat, Feb 6, 2021 at 19:44, Guillermo Hernandez (Oldno7) via > > Mailman-users <mailman-users(a)mailman3.org> wrote: > >> On 6/2/21 18:08, Abhilash Raj wrote: > >> > >> On Sat, Feb 6, 2021, at 3:04 AM, Guillermo Hernandez (Oldno7) via > >> Mailman-users wrote: > >> > >> I restarted de server and the error changed. Now the log > >> shows "KeyError: 'subscription_mode'": > >> > >> Did you also restart Mailman Core after the upgrade? > >> > >> Yes, indeed: I stopped mailman core and all the processes related. > >> Did the upgrades. Started all again. Find the errors in the web user > >> interface. Stopped all again. Looked for errors in the log. Restarted > >> the complete server. Found the second error that this second mail is > >> about to. It happens when, in the main page that shows all the lists > >> you click to see one of them. It seems to me that it has been > >> database structure changes in django that the upgrade is not aware... > >> but it's a very long shot from my side. > > `subscription_mode` was added in Mailman Core 3.3.2 and it is actually > > a derived atrribute and not stored in Database. Mailman's API should be > > returning this attribute for each Member, but for some reason it seems > > to me like it isn't doing that even though do have Mailman 3.3.3 running > > like you said. > > If you have Curl installed, can you send me the output of: > > $ curl -u <user>:<pass> http://localhost:8001/3.1/members?count=5&page=1 > > This is the output you asked for (it's the same you can see when you try > to interact with one list): > > /usr/local/mailman3 # curl -u XXXXXX:XXXXXX > http://localhost:8001/3.1/members?count=5&page=1 > /usr/local/mailman3 # <html> > <head> > <title>Internal Server Error</title> > </head> > <body> > <h1><p>Internal Server Error</p></h1> > > </body> > </html> > > No log entry has been produced... This is weird, if you have working Core, then there should be *some* json returned from the above command. Do you have the Gunicorn running? What is the output of `ps -ef | grep mailman`? Are you able to run `mailman members` command to list the members of a list? Also, how did you actually install Mailman? Abhilash. > TIA. > > > > > > It should ideally return an output that looks something like shown > > here[1]. You > > can put the username/password of Core's API server in the above command. > > [1]: > > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… > > > > Abhilash > >> I'm using sqlite as django database and mysql for mailman. > >> > >> ERROR 2021-02-06 11:47:49,015 26798 django.request Internal > >> Server Error: > >> /mailman3/mailman3/lists/name_and_domain.of.the.list > >> Traceback (most recent call last): File > >> "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", > >> line 119, in __getattr__ return self._get(name) File > >> "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", > >> line 86, in _get raise KeyError(key) KeyError: > >> 'subscription_mode' During handling of the above exception, > >> another exception occurred: Traceback (most recent call > >> last): File > >> "/usr/local/lib/python3.7/site-packages/django/core/handlers/exception.py", > >> line 34, in inner response = get_response(request) File > >> "/usr/local/lib/python3.7/site-packages/django/core/handlers/base.py", > >> line 115, in _get_response response = > >> self.process_exception_by_middleware(e, request) File > >> "/usr/local/lib/python3.7/site-packages/django/core/handlers/base.py", > >> line 113, in _get_response response = > >> wrapped_callback(request, *callback_args, **callback_kwargs) > >> File > >> "/usr/local/lib/python3.7/site-packages/django/views/generic/base.py", > >> line 71, in view return self.dispatch(request, *args, > >> **kwargs) File > >> "/usr/local/lib/python3.7/site-packages/postorius/views/generic.py", > >> line 74, in dispatch return super(MailingListView, > >> self).dispatch(request, *args, **kwargs) File > >> "/usr/local/lib/python3.7/site-packages/django/views/generic/base.py", > >> line 97, in dispatch return handler(request, *args, > >> **kwargs) File > >> "/usr/local/lib/python3.7/site-packages/postorius/views/list.py", > >> line 295, in get member.subscription_mode == File > >> "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", > >> line 124, in __getattr__ self.__class__.__name__, name)) > >> AttributeError: 'Member' object has no attribute > >> 'subscription_mode' *********************** some info about > >> the installed versions via pip list: pip list | grep django > >> django-allauth 0.44.0 > >> django-appconf 1.0.4 > >> django-compressor 2.4 > >> django-extensions 3.1.0 > >> django-gravatar2 1.4.4 > >> django-haystack 3.0 > >> django-mailman3 1.3.5 > >> django-picklefield 3.0.1 > >> django-q 1.3.4 > >> djangorestframework 3.12.2 pip list | grep mailman > >> django-mailman3 1.3.5 > >> mailman 3.3.3 > >> mailman-hyperkitty 1.1.0 > >> mailmanclient 3.3.2 pip list | grep postorius > >> postorius 1.3.4 On 6/2/21 11:12, > >> Guillermo Hernandez (Oldno7) via Mailman-users wrote: > >> > >> I've just upgrade mailman 3 installation following Mr. > >> Sapiro advice: did a pip install --upgrade > >> django-mailman3 hyperkitty mailman mailmanclient > >> mailman-hyperkitty postorius I did a "python3 manage.py > >> migrate" after, too. And all seemed to run well. All the > >> lists showed in postorius via web, but when I try to > >> accesss into one of them the browser shows an error. In > >> the log you can see: *-*-*-*-*-*-* Traceback (most recent > >> call last): File > >> "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", > >> line 119, in __getattr__ return self._get(name) > >> File > >> "/usr/local/lib/python3.7/site-packages/mailmanclient/restbase/base.py", > >> line 86, in _get raise KeyError(key) KeyError: > >> 'get_requests_count' .. (And after all the traceback > >> lines) AttributeError: 'MailingList' object has no > >> attribute 'get_requests_count' *-*-*-*-*-*-*-* The lists > >> seem to be distributing messeages well.. but I cannot > >> acces via web administration (django/postorius) Can > >> anyone point me in the right direction to solve this, > >> please? _______________________________________________ > >> Mailman-users mailing list -- mailman-users(a)mailman3.org > >> <mailto:mailman-users@mailman3.org> To unsubscribe send > >> an email to mailman-users-leave(a)mailman3.org > >> <mailto:mailman-users-leave@mailman3.org> > >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > >> <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3org/> > >> > >> > >> _______________________________________________ Mailman-users > >> mailing list -- mailman-users(a)mailman3.org > >> <mailto:mailman-users@mailman3.org> To unsubscribe send an > >> email to mailman-users-leave(a)mailman3.org > >> <mailto:mailman-users-leave@mailman3.org> > >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > >> <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3org/> > >> > >> > >> _______________________________________________ Mailman-users mailing > >> list -- mailman-users(a)mailman3.org > >> <mailto:mailman-users@mailman3.org> To unsubscribe send an email to > >> mailman-users-leave(a)mailman3.org > >> <mailto:mailman-users-leave@mailman3.org> > >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > >> <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3org/> > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

4 years, 4 months

[MM3-users] Re: Subscribe only to one thread

by Terri Oda

We've already got the code for it. It was the "dynamic sublists" project. Systers built dlists for their needs with mailman 2 and we had a student implement it on mailman 3. The problem has just been in getting the patches integrated, which was mostly on me not being able to follow through at the critical time (as opposed to there being technical reasons it wasn't done). I still don't have the volunteer time necessary to port them forward to the latest version of mailman now and do the integration, but would be happy to help answer questions if someone else is interested in working on it. Terri On May 7, 2018 12:59:32 PM PDT, Ivan Perez <ivanperezdominguez(a)gmail.com> wrote: >Dear Mailman users, > >There are many high-traffic mailing lists in which I would only be >interested in receiving messages in specific threads (not all messages, >nor >some topics, nor a daily digest). > >Is there a way of "subscribing" to individual threads only, mainly >those I >initiate, or I actively participate in, but generally not receiving any >emails from the list? > >If not, would others find this useful, and could it be implemented? (I >understand that everyone wants features; I just don't know if it's a >2-hour >patch or a 2-month project). > >Best wishes > >Ivan >_______________________________________________ >Mailman-users mailing list >mailman-users(a)mailman3.org >https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

7 years, 1 month

[MM3-users] Re: new list not working

by Mark Sapiro

On 3/9/23 15:49, Christian via Mailman-users wrote: > Mail.log > > Mar 9 22:03:30 zarathustra postfix/smtpd[27337]: connect from > box.ecovillage.cc[45.79.28.18] > Mar 9 22:03:30 zarathustra postfix/smtpd[27337]: 11516101258: > client=box.ecovillage.cc[45.79.28.18] > Mar 9 22:03:30 zarathustra postfix/cleanup[26926]: 11516101258: warning: > header Subject: fifth test message from box.ecovillage.cc[45.79.28.18]; > from=<christian(a)naturalintelligence.us> > to=<redlatinleg(a)lists.ccalternatives.org> proto=ESMTP > helo=<box.ecovillage.cc> > Mar 9 22:03:30 zarathustra postfix/cleanup[26926]: 11516101258: > message-id=<033101d952d3$0fe82730$2fb87590$(a)naturalintelligence.us> > Mar 9 22:03:30 zarathustra postfix/qmgr[9973]: 11516101258: > from=<christian(a)naturalintelligence.us>, size=3496, nrcpt=1 (queue active) > Mar 9 22:03:30 zarathustra postfix/smtpd[27337]: disconnect from > box.ecovillage.cc[45.79.28.18] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 > commands=7 > Mar 9 22:03:30 zarathustra postfix/lmtp[27338]: 11516101258: > to=<redlatinleg(a)lists.ccalternatives.org>, relay=127.0.0.1[127.0.0.1]:8024, > delay=0.02, delays=0/0.01/0/0.01, dsn=2.0.0, status=sent (250 Ok) > Mar 9 22:03:30 zarathustra postfix/qmgr[9973]: 11516101258: removed That's only the delivery of the post to Mailman. What about any log messages relating to messages from redlatinleg-bounces(a)lists.ccalternatives.org? Also, one other thing you might check. Do these non-working lists have templates defined in postorius, in particular, one for list:member:regular:footer, and if not, are there any in Mailman's var/templates/lists/redlatinleg(a)lists.ccalternatives.org/ derectory that Mailman doesn't have permission to find and read? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 2 months

[MM3-users] Re: HyperKitty misreporting statistics

by Cameron Smith

Abhilash, I think the location of the message, in the error log, is correct: in the uwsci-cron.log, the entries show that the “minutely” jobs run for 32-33 seconds, whereas the entries in the error log show the jobs as running for only 2 seconds, suggesting an error. (As an aside, what is “minutely” doing that takes 32-33 seconds?) How best can I diagnose the problem? If need be, I can simply tear down the whole system, including deleting /opt/mailman on the host, start again and see if the problem persists. I think it would, however, be more helpful if we could figure out what has gone wrong. > On 2017.08.20, at 14:34 , Abhilash Raj <maxking(a)asynchronous.in> wrote: > > On Sun, 20 Aug 2017 08:38:53 -0700 > Cameron Smith <ccsmith(a)cetsi.com> wrote: > >> Hmm… something is definitely not right. >> >> /opt/mailman/web/logs/uwsgi-cron.log has not been updated since Aug 11, which is when I installed the container images 0.1.1. However, /opt/mailman/web/logs/uwsg-error.log is being updated every minute with entries similar to this: >> >> Sun Aug 20 13:40:00 2017 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 123) >> [uwsgi-cron] command “./manage.py runjobs minutely" running with pid 123 exited after 2 second(s) > > > This seems like a bug in the uwsgi configuration, it should actually go to > uwsgi-cron.log. I have opened a new bug[1] to track this problem. > > [1]: https://github.com/maxking/docker-mailman/issues/119 > Cameron Smith

7 years, 9 months

[MM3-users] Re: Mailman3 and Exim setup

by Stephen J. Turnbull

brian(a)emwd.com writes: > Ok, since you wrote the documentation and specifically had exim > preconfigured, I was hoping for a more definitive answer than "I > think". I am not trying to be difficult here but the installation > support, both via the documentation and the forum has been less > than stellar. I got Discourse up and running with far less hassle > than Mailman3 and from what I can see, it is a more feature rich > app. Sure, but from the point of view of its network configuration I suspect Discourse is far less complex than Mailman 3. There's been a fair amount of effort put into "literate programming", so most things *are* documented, but the organization of the documentation reflects the source organization, not that of the user/admin interface. Please do keep the doc bugs coming. > Would it be easier to try get Mailman3 setup with Postfix than > Exim? Possibly if you install from source on a single host, the overall experience would be less frustrating, Postfix or Exim. Don't know if that's an option. Also, if you run into issues down the road there is relatively more expertise in Postfix here, I believe. For real MTA help, I don't know whether the upstream projects are comparable. Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

6 years, 5 months

[MM3-users] Re: Could not locate column in row for column 'user.id'

by Mark Sapiro

On 7/28/20 10:20 AM, Shashikanth Komandoor wrote: > > I tried for the command to know if any entry in the "address" table for > which 'id' is not an integer. > > But unfortunately, I could not get any command or idea how to find that. > > But out of my extra talent, I tried the below commands which, I thought, > may print the records which contain a non integer id value. ... > select id,email from address where id NOT BETWEEN 1 AND 84203; > id | email > ----+-------(0 rows) > mailman=# select id,email from address where id NOT BETWEEN 1 AND 84202; > id | emai> -------+-----------------------------> 84203 | user(a)exampl.com > > *1 and 84203 are the minimum and maximum values of the id:* > > Please see the above outputs and suggest if anything possible or please let > me know the command what should I run to find a non integer id value. > The above looks qood to determine if there is a non-integer value. > I also doubt this error as if my REST API is contacting postgresql in a > delayed manner. If possible, can you say what optimal setting I can do at > Postgresql so that faster responses would be given to REST API. I'm out of ideas. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: can't get mail into mailman3 in docker

by matthew＠alberti.us

Bob, Can you run the command "sudo docker logs mailman-core" and see what the end of that says? Another good command to run is "sudo docker ps" and make sure the mailman-core container is actually running. -----Original Message----- From: Mark Sapiro <mark(a)msapiro.net> Sent: Wednesday, August 11, 2021 1:25 AM To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: can't get mail into mailman3 in docker On 8/10/21 11:29 AM, bob B wrote: > /opt/mailman/core/mailman-extra.cfg. now has > #lmtp_host: localhost > lmtp_host: 127.0.0.1 > lmtp_port: 8024 > > But but mail log shows > 2021-08-10T14:13:28.927266-04:00@####### postfix/qmgr[37253]: > DDF5D3083EC2: from=<user(a)user.com>, size=8181, nrcpt=1 (queue active) > 2021-08-10T14:13:28.973273-04:00@####### postfix/lmtp[39368]: > DDF5D3083EC2: to=<test@.....>, relay=127.0.0.1[127.0.0.1]:8024, > delay=0.07, delays=0.04/0.02/0.01/0, dsn=4.4.2, status=deferred (lost > connection with 127.0.0.1[127.0.0.1] while receiving the initial > server greeting) > > Also to clarify the images no longer have hard coded ips so I should NOT DO this correct? > ----------------------------- > lmtp_host: 172.19.199.2 > lmtp_port: 8024 > smtp_host: 172.19.199.1 > smtp_port: 25 > ----------------------------- I think that's correct, but I'm at a loss for helping further. Hopefully @maxking will be able to help. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

3 years, 9 months

[MM3-users] Re: How to delete non-users

by Allan Hansen

Sure: >>> lm = getUtility(IListManager) >>> for l in lm: ... print(l.posting_address) ... >>> Nothing here, either. Yours, Allan On 9/17/22, 10:30 , "Mark Sapiro" <mark(a)msapiro.net> wrote: On 9/17/22 10:03, Allan Hansen wrote: > Hi Mike, > > Yes, the users can be subscribed, but they think that they can't because it seems they are until the moderator accepts them. > > I tried your script again, with nothing happening. So I tried this: > >>>> >>>> a = 1 >>>> b = 1 >>>> for l in lm: > ... print(a) > ... a = a+1 > ... for nm in l.nonmembers.members: > ... print(b) > ... b = b + 1 > ... nm.unsubscribe() > ... >>>> commit() >>>> print(a) > 1 >>>> print(b) > 1 > > > It appears that lm can't see the lists (I have 50+ of them). Did you start with lm = getUtility(IListManager) ? What if you do ``` >>> lm = getUtility(IListManager) >>> for l in lm: ... print(l.posting_address) ... ``` That should print the posting address for all the lists. What does `mailman info` show? In particular, for `config file:` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

2 years, 8 months

[MM3-users] Re: Mailman 3, postfix domains, and postgresql cannot authenticate user

by Mark Sapiro

On 7/3/24 09:22, Keith Christian via Mailman-users wrote: > --------------------------------------------------------------------------- > First issue:Postfix v3.5.8 on RHEL 8. > The below is from journalctl -xe: > --------------------------------------------------------------------------- > Jul 03 08:12:04 somehost.somedomain postfix/qmgr[947499]: error: open > database /opt/mailman3/mm/var/data/postfix_domains.db: No such file or > directory > Jul 03 08:12:42 somehost.somedomain postfix/smtpd[947510]: error: open > database /opt/mailman3/mm/var/data/postfix_domains.db: No such file or > directory > Jul 03 08:12:42 somehost.somedomain postfix/smtpd[947510]: error: open > database /opt/mailman3/mm/var/data/postfix_lmtp.db: No such file or > directory > > I manually created the var_dir: /opt/mailman3/mm/var directory > specified in the mailman.cfg file. > How do I find out how to populate the postfix_domains.db files, and > the postfix_lmtp.db file? The `mailman aliases` command generates the postfix_domains and postfix_lmtp files and calls the configured postmap_command (default /usr/sbin/postmap) to create the .db files. `mailman start` also generates these files by default. > --------------------------------------------------------------------------- > Second issue: Postgresql authentication. > PostgreSQL v10.23. > --------------------------------------------------------------------------- > I have this in the active mailman3.cfg file, where xxxxxxxxxx is the > same complex password in the mailman3 config file: > url: postgresql://mailman3:xxxxxxxxxx@localhost/mailman3/mailman3 I don't think you should have two /mailman3 at the end the form is `postgresql://user:password@host:port/database_name` The default port is 5432. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

11 months

[MM3-users] Re: Change digest frequency and default threshold

by Henrik Rasmussen

Mark Sapiro wrote: > On 9/21/18 6:21 AM, Henrik Rasmussen wrote: > > When Digest Size Threshold is not reached, mails seems to be sent > > according to digest_volume_frequency': which is set to 'monthly'. The web > > interface doesn't seem to have a setting for this. > > No. digest_volume_frequency only controls how often the digest volume > number increments (and issue number resets). > > In order to send periodic digests, you need to run 'mailman digests > --periodic' via cron. Currently I am running Mailman version 3.2.0a1 which doesn't seem to have a --periodic option. When running "docker exec mailman-core mailman digests --send --verbose -l listname(a)lists.example.com", output is "listname.lists.example.com sent volume 11, number 4" and this increases each time, but even I do approve held mails, none are sent (according to the smtp.log and docker logs posrfix). As I understand, using --sent should send a digest immediately (except when used with --dry-run). As the default Digest size threshold was 30KB, making very small digests being sent, I increased this (for test) to 5000 KB (or is it Kilo bits, as the text says "How big in Kb should a digest be before it gets sent out?"? Could Digest size threshold have any impact on why no digests are sent even I run "docker exec mailman-core mailman digests --send --verbose -l listname(a)lists.example.com" or is this an issue in the version I am using? -- Henrik Rasmussen

6 years, 8 months

[MM3-users] Re: Is it possible to add non-members in regex format in Mailman 3 ?

by Abhilash Raj

On Tue, Jun 16, 2020, at 7:09 AM, Shashikanth Komandoor wrote: > Hi Team, > > In mailman 2, I was able to add the non-members in the > respective privileged box even using the regex also which will be used to > add the domains instead of a single mail id. > > But in mailman 3, I am not allowed to add the non members in > the regex format. Of course it is allowing me to add individual mail ids > and give permissions. But I want to add a non-member which may be something > like the entire cisco.com domain on which I want to set the rule. > You can do that with Postorius 1.3.3 (which was released recently) and Mailman Core 3.3.1. > Please help me out by suggesting over this or if mailman 3 is > not providing then please hint me out with a work around at least. > > -- > Thanks & Regards, > Shashi Kanth.K > 9052671936 > > > > > <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> > Virus-free. > www.avast.com > <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> > <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

4 years, 11 months

[MM3-users] Re: Moderation of posts via email is not working in mailman 3

by Shashikanth Komandoor

Thank you Mark Sapiro for your response. After going through the discussion at the link you provided, I understood as of now, it is not possible to moderate the posts through the mails in Mailman 3. But since the user is getting the "confirm" attachment to the mail, the users are getting confused. Is there any work around to achieve this? or Is there any way to remove that "confirm" attachment so that users would not get an idea of confirming via email? <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> On Tue, Jun 30, 2020 at 2:46 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 6/29/20 12:24 AM, Shashikanth Komandoor wrote: > > > > Is there any bug or limitation in mailman 3 or if I am doing > > any wrong at the server side? Please suggest. > > > > This is a known issue in Mailman 3. See > <https://gitlab.com/mailman/mailman/-/issues/169>. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Thanks & Regards, Shashi Kanth.K 9052671936

4 years, 11 months

[MM3-users] Getting connection timed out

by blackout69

Il 22/05/21 23:52, Mark Sapiro ha scritto: > It's probably not blacklisting. It's not getting that far. Your `glugct` > is attempting to connect to port 25 at mail.simail.it and the connect is > not being answered. Normal blacklisting will not occur until after the > remote MTA answers the connect and determines the IP of the caller. And > in any case, if it is some kind of blacklisting it is your `glugct` > server that is blacklisted by mail.simail.it. > > I just did the following > ``` > $ telnet mail.simail.it 25 > Trying 217.27.113.30... > Connected to mail.simail.it. > Escape character is '^]'. > 220 mail.simail.it ESMTP ready. > quit > 221 mail.simail.it closing connection > Connection closed by foreign host. > ``` > so it did answer my connect. In any case, this is not a Mailman issue. > It is between Postfix on your server and the remote server at > mail.simail.it. Thanks Mark for the reply, I had already checked with the telnet command on port 25 and everything is fine. The suspicion of the blacklist came to me, but now, after checking https://mxtoolbox.com/blacklists.aspx I saw that the mail.simail.it server is in the SORBS SPAM blacklist. Because my lists work fine on any other mailing address. I also checked my email server reputation at https://www.mail-tester.com and I get 10/10 Apparently it doesn't depend on my postfix server. In this case, what strategy do you recommend? Thank you -- blackout69

4 years

[MM3-users] More Mailman releases!

by Abhilash Raj

Hello Everyone, I am pleased to announce several new releases for GNU Mailman project. Thanks to all the contributors for making these releases possible! 1. Postorius 1.3.10 [1] 2. Hyperkitty 1.3.8 [2] 3. Django-mailman3 1.3.10 [3] 4. Mailman-web 0.0.7 [4] All the releases are published to PyPI and you can find links to all the PyPI projects: https://docs.mailman3.org/en/latest/ A full list of change logs are available below: [1]: https://docs.mailman3.org/projects/postorius/en/latest/news.html#news-1-3-10 [2]: https://docs.mailman3.org/projects/hyperkitty/en/latest/news.html#news-1-3-8 [3]: https://gitlab.com/mailman/django-mailman3/-/blob/master/README.rst [4]: https://gitlab.com/mailman/mailman-web/-/blob/master/README.rst Do note that for Postorius, I released 1.3.9, but I forgot to update dependency metadata to require `django-mailman3>=1.3.10` (which is required for the new bootstrap 5 upgrade across packages) and so I also released Postorius 1.3.10 just after. Installation documentation is available at https://docs.mailman3.org/en/latest/install/install.html and if you are upgrading an existing virtualenv install you can refer https://docs.mailman3.org/en/latest/upgrade-3.2.html If you find any issues, you can report them at the respective bug tracker for the projects. The links to issue trackers are available at https://docs.mailman3.org/en/latest/. Finally, similar to Mailman Core, note that PyPI doesn't accept signatures anymore so each packages' release page now has the tarball uploaded to them along with the signature: Django-mailman3: https://gitlab.com/mailman/django-mailman3/-/releases/v1.3.10 Hyperkitty: https://gitlab.com/mailman/hyperkitty/-/releases/v1.3.8 Postorius: https://gitlab.com/mailman/postorius/-/releases/v1.3.10 Mailman-web: https://gitlab.com/mailman/mailman-web/-/releases/0.0.7 -- thanks, Abhilash Raj (maxking)

1 year, 7 months

[MM3-users] Legit login attempts yield, "An error occurred while processing your request."

by Greg Newby

Hi friends. Following up on my message over the weekend about getting web (Django) logins for users who were ported from MM2 to MM3, I now have some people trying to create a new username. Something broke following a system update and reboot. MM3 is installed using the venv method, and the services (mailman and mailman-web) seem to be running ok. Mailing list delivery is happening as usual. I've now come upon a few related situations where a 500 error results, "Server error. An error occurred while processing your request." My primary question is: *How can I find out what's causing this*? I've looked in all the MM and web logfiles, by "tail -f" while generating the error, and nothing is logged there. Apache logs shows something like this: x.x.y.y- - [13/Aug/2024:21:46:41 -0700] "POST /accounts/password/reset/ HTTP/1.1" 500 1448 "https://lists.pglaf.org/accounts/password/reset/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36 Edg/127.0.0.0" I've come across this error while trying to do authentication-related activities that worked before the reboot: - "Forgot password" (happens whether or not the entered email existed in MM2 or already exists in MM3) - Sign up (ditto) - Email unsubscribes gave a verification email, but then didn't unsubscribe the address (might not be the same problem) Thanks for any breadcrumbs that might guide me to the solution. ~ Greg

9 months, 3 weeks

[MM3-users] Errors while importing mm2 list archives

by Odhiambo Washington

MM3-3.3.7, Hyperkitty-1.3.6 While importing, I encountered several of this error: <CUT> MySQLdb.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\x8A, ...' for column 'content' at row 1") The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 232, in from_mbox add_to_list(self.list_address, message) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/lib/incoming.py", line 153, in add_to_list email.save() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 812, in save self.save_base( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 863, in save_base updated = self._save_table( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 1006, in _save_table results = self._do_insert( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/base.py", line 1047, in _do_insert return manager._insert( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/query.py", line 1791, in _insert return query.get_compiler(using=using).execute_sql(returning_fields) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1660, in execute_sql cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 67, in execute return self._execute_with_wrappers( File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers return executor(sql, params, many, context) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/utils.py", line 91, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 89, in _execute return self.cursor.execute(sql, params) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/backends/mysql/base.py", line 75, in execute return self.cursor.execute(query, args) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/cursors.py", line 206, in execute res = self._query(query) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/cursors.py", line 319, in _query db.query(q) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/MySQLdb/connections.py", line 254, in query _mysql.connection.query(self, query) django.db.utils.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x98\\x8A, ...' for column 'content' at row 1") </CUT> That occurred several times, but the import process went all the way, to 99% then came to the point below. Message 253d9d44-cc3e-fed1-144b-34da88c52b39(a)emailplus.org failed to import, skipping Computing thread structure Synchronizing properties with Mailman 904 emails left to refresh, checked 0 764 emails left to refresh, checked 0 Warming up cache Traceback (most recent call last): File "/opt/mailman/mm/venv/bin/django-admin", line 8, in <module> sys.exit(execute_from_command_line()) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line utility.execute() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 440, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 402, in run_from_argv self.execute(*args, **cmd_options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 448, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 411, in handle call_command("hyperkitty_warm_up_cache", list_address) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/__init__.py", line 198, in call_command return command.execute(*args, **defaults) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/core/management/base.py", line 448, in execute output = self.handle(*args, **options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_warm_up_cache.py", line 53, in handle self.warm_up_mlist(mlist, options) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/management/commands/hyperkitty_warm_up_cache.py", line 61, in warm_up_mlist for thread in mlist.recent_threads: File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 162, in recent_threads return self.cached_values["recent_threads"]() File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/common.py", line 58, in __call__ return self.get_or_set(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 317, in get_or_set return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/models/mailinglist.py", line 317, in <listcomp> return [Thread.objects.get(pk=pk) for pk in thread_ids] File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/django/db/models/query.py", line 650, in get raise self.model.DoesNotExist( hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. (venv) [mailman@gw ~/mm]$ Should I take it that the import was successful, or what should I do next? PS: This is the 1st run after installing MM3 on this server and the MM3 list hasn't gone live. So if anything, I am okay with doing what needs to be done and rerun the import. TIA -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 years, 6 months

[MM3-users]Re: Request for assistance for fresh install of Mailman 3.0.3 and Python 3.4

by Richard Shetron

On 5/30/2016 3:13 PM, Simon Hanna wrote: > On 05/30/2016 07:19 PM, Rubén Rivero Capriles wrote: >> Dear mailman team, >> >> Before installation of postfix, I would like to remove >> a cron scheduled mail from awstats that arrives every 30 minutes >> to /var/log belonging to a misconfigured, deleted awstats configuration, >> reminding me that such file does not exist. >> Still looking for the most suitable way to learn about cron. > Your OS docs should have information about what program is responsible > for handling cron entries. `man crontab` should have information on how > to read and write the cron config >> Awstats documentation informs there is statistics support >> for mail activities besides traditional website visits monitoring. >> Does mailman work along well with awstats? > I have no idea what awstats does, but it probably only reads postfix' > logs. So it actually doesn't care about mailman. There might be a way > for it to parse mailman logs directly. If there is a way it's most > probably for mailman 2 and might be incompatible with mailman 3 awstats (http://www.awstats.org/) is a logfile analyser used mostly for analysing and generating stats for websites. It can do email and other logs as well. Depending on what OS you are using determines where to find the cron files,which may or may not run as root ;)

9 years

[MM3-users] MM3 vs. Sympa

by Tom Browder

I still haven’t gotten around to getting a new MM3 service up and running, and now I’m looking at Sympa. I’ve seen a few comparisons of the two systems on the net, but the ones I’ve seen are for announcement lists only. I did see one university that did a study of list managers to replace Listproc and chose Sympa. I must admit my short-lived MM2 experience (used for my social sites for my high school and college classmates) seven years ago wasn’t the best was for two reasons: (1) no duplication of list names even for different domains and (2) it’s written in Python (instead of Perl). But, thanks to much help from Mark, I did get it runnng. I think it would be running today but it failed after about a year when Gmail (whose sntp server I was using) stopped allowing that, and I just didn’t know enough to get around the situation and had too much else to do. I waited expectantly for MM3 to come out and was ready to try again, but the separation of a formerly-integrated system into several systems was a bit daunting. Now I’m considering using Sympa: it’s coded in Perl, it’s monolithic, and it can support identical list names for different domains, so I am leaning in that direction. Before I go, I would appreciate anyone giving me a good reason to stay with MM (besides excellent support and a welcoming community—one which is a member of an unfortunately small group of such communities). Thanks so much. Best regards, -Tom

6 years, 7 months

[MM3-users] Re: HTML email sent to lists migrated from Mailman 2.1

by Mark Sapiro

On 4/15/19 8:21 AM, Nate Coraor wrote: > > I have some lists migrated from 2.1 that are stripping the HTML parts > (perhaps all attachments?) from messages despite the options to do so not > being enabled and lynx not even being installed. I'm trying to get a new > list to behave the same way so I can figure out what's going on without > spamming a production list, but have been unsuccessful: despite setting > nearly all the list options the same as the old lists, new lists pass HTML > portions and attachments just fine. > > I've verified the settings using mailing list objects directly with > `mailman withlist` on the command line and the only differences are things > that I can't imagine would be related like admin_notify_mchanges, > advertised, and archive_policy. Are there are really old options that can't > be accessed via mailing list objects obtained with `withlist` on the > command line? No, there aren't "hidden settings" The relevant settings are filter_content filter_extensions filter_types pass_extensions pass_types collapse_alternatives convert_html_to_plaintext These are exactly analogous to the MM 2.1 settings filter_content filter_filename_extensions filter_mime_types pass_mime_types pass_filename_extensions pass_mime_types collapse_alternatives convert_html_to_plaintext and should behave the same way. Note that filter_extensions, filter_types, pass_extensions and pass_types are not exposed in Postorius, but can be seen and set via withlist. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 1 month

[MM3-users] Re: A new issue with installation

by Brian Carpenter

On 2/20/21 12:35 PM, Abhilash Raj wrote: > Also, it is possible depending on your distro that packaged Rust compiler > is too old. cryptography requires a more recent version of Compiler, 1.45 > is the min supported version I think. > > FAQ:https://cryptography.io/en/latest/faq.html#installing-cryptography-fails-with-error-can-not-find-rust-compiler > > You can skip the Rust components by setting `CRYPTOGRAPHY_DONT_BUILD_RUST` > but that would work just for this release and you won't be able to > skip from the next release of cryptography. I am going to need further assistance here. It is easy enought to install the rust compiler using rustup but I am still getting the same error: =============================DEBUG ASSISTANCE============================= If you are seeing a compilation error please try the following steps to successfully install cryptography: 1) Upgrade to the latest pip and try again. This will fix errors for most users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip 2) Read https://cryptography.io/en/latest/installation.html for specific instructions for your platform. 3) Check our frequently asked questions for more information: https://cryptography.io/en/latest/faq.html 4) Ensure you have a recent Rust toolchain installed: https://cryptography.io/en/latest/installation.html#rust 5) If you are experiencing issues with Rust for *this release only* you may set the environment variable `CRYPTOGRAPHY_DONT_BUILD_RUST=1`. =============================DEBUG ASSISTANCE============================= error: Can not find Rust compiler Running root@list:/opt/mailman/mm# rustc --version returns: rustc 1.50.0 (cb75ad5db 2021-02-10) I am doing this as the mailman user using a virtual environment. -- Brian Carpenter Harmonylists.com Emwd.com

4 years, 3 months

[MM3-users] Re: Problems getting started with postorius

by Mark Sapiro

On 11/13/24 16:46, Alain D D Williams wrote: > > I eventually tracked it down. The problem was that I had signed in with an > account "addw@localhost". That, for some reason, failed validation above. > I hacked the database and changed to "addw(a)localhost.localdomain" and creating > the new domain worked. > > I could send email to addw@localhost - so at the MTA level it is correct. > > So please can the initial account creation do the same validation as does > adding a new domain. Mailman doesn't allow local, unqualified addresses, see https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/email/validate… and https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/utilities/emai… On the other hand, Account creation/validation is done by django-allauth over which we have no control. > I have looked but cannot find any documentation on postorius than > https://docs.mailman3.org/projects/postorius/en/latest/ > which is not helpful for a user or system admin. Can you point me to something > better. Unfortunately, there is not user/list owner documentation for Postorius. As I said at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… You just have to page through the settings to see what's there. Hopefully the various categories are clear enough that if you're looking for something specific, you can find it easily. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 months, 3 weeks

[MM3-users] Re: Which documentation to follow for installation

by Ruben Ibanez

Hi Abhilash, Finally we decided to install Mailman through the docker images provided by you (https://github.com/maxking/docker-mailman) The deployment was very quick, and it works flawlessly, so we will keep this solution. On the side I will try to deploy Mailman 3 through its independent modules, just for fun :) Many thanks! Cheers, R. From: "Abhilash Raj" <maxking(a)asynchronous.in> To: "Ruben Ibanez" <ribanez(a)sciops.esa.int> Cc: "mailman-users" <mailman-users(a)mailman3.org> Sent: Sunday, August 20, 2017 11:25:34 PM Subject: Re: [MM3-users] Which documentation to follow for installation On Sun, 20 Aug 2017 20:50:39 +0200 (CEST) Ruben Ibanez <ribanez(a)sciops.esa.int> wrote: > Hi Abhilash, > > Thanks for your reply. > > The point is, I think I'm missing something. I'm just a sysadmin who wants to deploy Mailman 3.x to be used for an operational environment, like any other software. Is this software actually ready for that? There are production environments running Mailman 3.1 right now if that is your questions, see https://lists.mailman3.org. Although, I guess you already saw that when subscribing to this list ;) > Of course, I'm not asking for .rpm, .deb, etc... because I understand that's > quite complex, but I tried it following all available guides, including the > Contributor's Guide, and it seems impossible to get it running at the first > time (or just to get it running) without getting crazy or fixing lots of > unexpected errors during installation. It would be helpful if you send in those errors here. It will help us debug your problem and also improve the guide for the people using it in future. One small problem about the configuration, off the top of my head, can cause some problems in the "Mailman Suite Installation" Guide[1]. I have that on my todo to fix. But, apart from that everything else should work! [1]: http://docs.mailman3.org/en/latest/prodsetup.html You would have to do some additional configuration for the web frontend to work and for the mail servers to talk to Mailman and Frontend separately, both of which is also mentioned in the documentation under "Configuring Mailman Core" and "Configure Web Frontend". Contributor's guide is not focused on deploying but just setting it up locally to play with and modify the source itself. > Have you tried to deploy Mailman 3.x strictly following the documentation? I think people have used it in past to successfully deploy Mailman 3.x, but without looking at the errors you are facing I don't have any clue as to why it doesn't work for you! > > By the way, many thanks for your hard work! > > Cheers, > RI > > > From: "Abhilash Raj" <maxking(a)asynchronous.in> > To: ribanez(a)sciops.esa.int > Cc: mailman-users(a)mailman3.org > Sent: Saturday, August 19, 2017 8:55:20 AM > Subject: Re: [MM3-users] Which documentation to follow for installation > > On Fri, 18 Aug 2017 09:40:37 -0000 > ribanez(a)sciops.esa.int wrote: > > > Hi everyone, > > > > I'm trying to deploy Mailman 3.1, but it seems there isn't a clear place to > > look for documentation. I found two different sites: > > > > https://mailman.readthedocs.io/en/latest/ > > http://docs.mailman3.org/en/latest/ > > Both of the above are actually latest documentation, > > docs.mailman3.org should be the one to look for installations guidelines for > the entire Mailman 3.x Suite, > > mailman.readthedocs.io is the documentation of Mailman 3 Core, which handles > the mail. > > http://docs.mailman3.org/en/latest/prodsetup.html > > This should be the best place to start, be sure to look at the Pre-Installation > Guide if you are new to the Python ecosystem. > > > > > Do you know which one should be followed? Both at the same time? I find it > > quite unclear... and this installation will be for an operational environment. > > > > Also, there are some (official?...) docker images, but all images are for > > mailman 3.0 but not mailman 3.1, and of course updates are not guaranteed. > > It is meant for Mailman 3.X series and is maintained by me. It currently > includes the latest releases for all the Mailman's sub-projects, also Mailman > 3.1. > > > Hope that helps! > > -- thanks, Abhilash Raj This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email.

7 years, 9 months

[MM3-users] Re: Ready to try installation: use "normal" install or docker.

by Abhilash Raj

Hi Tom, On Tue, Aug 1, 2017, at 07:54 AM, Tom Browder wrote: > The mm3 installation instructions have been somewhat fluid over the > development period, butI'm finally ready to dig in and give it a shot and > need some last-minute advice. > > I'm leaning toward installing using the docker method but I would > appreciate any recent thoughts about which method to choose. It really depends on what way you want to go, container images will be much less hassle to use right now, mostly because all the dependencies are bundled in and the moving parts are already configured to work with each other. Also, the upgrade process for container images is pretty easy and you can even setup auto-upgrades if you want using some pretty-easy-to-use tools. I do that to test each commit that goes in the Github Repo for container images. Installing from sources isn't that bad right now, but you would need some knowledge of Django and Python based ecosystem for web applications. The documentation has most of them with pointers to other things you might need to know in order to run, if you feel it is inadequate, I would encourage you to open bug reports. > Thanks so much to the MM3 dev team! > > Best, > > -Tom > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ -- thanks, Abhilash Raj

7 years, 10 months

[MM3-users] Container Images for Mailman 3.2 release

by Abhilash Raj

Hi All, I have updated and pushed releases for Container Images with 3.2 release of the suite. They are available at: docker.io/maxking/mailman-web:0.2 docker.io/maxking/mailman-core:0.2 A similar copy of both is also available at quay: quay.io/maxking/mailman-web:0.2 quay.io/maxking/mailman-core:0.2 The releases contain the following versions of components: mailman-core: - Mailman Core 3.2.0 - Mailman-hyperkitty 1.1.0 mailman-web: - Postorius 1.2.1 - Hyperkitty 1.2.0 - Django-mailman3 1.2.0 - MailmanClient 3.2.0 The upgrade process from 0.1 release should be relative painless, except for the full-text index, which needs to be rebuilt due to the migration from Python 2 to 3 of the full-text indexing library whoosh. You can run the following commands to do so, after the upgrade: $ docker exec -it mailman-web bash bash # python manage.py rebuild_index If you are not using the default docker-compose.yaml file provided in the repo, you need to add an extra environment variable for mailman-web container, POSTORIUS_TEMPLATE_BASE_URL, which defaults to `http://mailman-web:8000`. It should be the URL where your mailman-web container is listening on with HTTP (port 8000 by default). The rolling releases are not being rolled out right everyday now, because of broken build scripts. I'd recommend everyone use the new stable releases that I mentioned above. Going forward, I'll try to release stable versions more often, so that there isn't any need for rolling version, but fixing the rolling releases is on my TODO. Documentation for these images is available at: https://github.com/maxking/docker-mailman -- thanks, Abhilash Raj (maxking)

6 years, 10 months

[MM3-users] Re: Aborted connection message in log in every 5 minutes

by Mark Sapiro

On 1/31/24 10:12, andrea.janna.unipd(a)gmail.com wrote: > >>From the database debug log I guess that mailman gatenews abruptly terminates the database connections. > For instance this is the database debug log of a connection that doesn't trigger the mariadbd "[Warning] Aborted connection" log entry. > > 70759 Connect mailman3web@localhost on mailman3web using Socket > 70759 Query SET sql_mode='STRICT_TRANS_TABLES' > ... > 240131 18:54:34 70759 Quit > > There is a "Quit" at the end. > While the log entries of the connections that trigger the aborted connection warning (like the one I posted yesterday) do not have "Quit" at the end. You could try the following in `mailman shell` ``` $ mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> for mlist in getUtility(IListManager).mailing_lists: ... print(mlist.fqdn_listname) ... (here should be a list of your mailing lists) >>> ``` Does this produce the expected list of mailing lists and does it produce the error in the database debug log? If it does produce the expected list of mailing lists and the error in the database debug log, I'd say this is some issue between SQLAlchemy and MariaDB, but it seems harmless. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 4 months

[MM3-users] Re: Can't post to my own list from HyperKitty

by MegaBrutal

Mark Sapiro <mark(a)msapiro.net> ezt írta (időpont: 2025. ápr. 7., H, 19:23): > What is the exact email address that you are logging on to the web UI > with. Does it match exactly with the address of a list member or are > there mixed-case differences? You might try an interaction like this: > ``` > mailman-web shell > Python 3.12.8 (main, Dec 21 2024, 12:52:28) [GCC 9.4.0] on linux > Type "help", "copyright", "credits" or "license" for more information. > (InteractiveConsole) > >>> from django_mailman3.lib.mailman import get_mailman_client > >>> client = get_mailman_client() > >>> list_id = 'test.example.com' # your actual list_id > >>> rest_list = client.get_list(list_id) > >>> email = 'user(a)example.com' # your actual email > >>> member = rest_list.get_member(email) > >>> member > This should print something like > <Member 'user(a)example.com' on 'test.example.com' with role 'member'> > ``` > This is exactly what HyperKitty is doing except in your case > rest_list.get_member(email) is throwing a ValueError exception instead > of returning the member. I get: <Member 'megabrutal(a)gmail.com' on 'the.correct.list.address' with role 'member'> So it's even weirder – however, I'm really not sure if this is the address HyperKitty is checking for, as I have 3 attached to my account! How may I know which one it's trying to use?

2 months

[MM3-users] Re: Editing the "example.org" site

by Odhiambo Washington

On Sun, Dec 31, 2023 at 11:16 AM Stephen J. Turnbull < turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > Hi all, > > I don't know how many people will need this, but I just realized that > you can edit Django's SITE 1 and (probably, 100% untested but I'm > going on the clock so want to get this done quick :-) use that. > > When you add your first domain, there's a link in that page (not a > button, a link!) to edit the domain list. Then you can click on the > link to "example.org" in the list, and edit both display name (which I > assumed) and the domain name. > > Maybe I'm just slow, but I've been adding SITE 2 = "Whatever site > <whatever.tld>" the whole time. :-) But then you have to edit the > SITE = 1 statement in settings.py (which I often forget and hilarity > ensues). > > Of course adding a web site and editing settings.py (which you have to > do anyway for other variables) works too, but this seems cleaner to > me. > > Steve > This is interesting. However, you meant the default example.com, right? And that link also let's me DELETE the site :-) -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 5 months

[MM3-users] Re: Mailman3 via Docker and NGINX

by Abhilash Raj

On Wed, Dec 19, 2018, at 8:18 AM, Mark Sapiro wrote: > On 12/19/18 7:03 AM, brian(a)emwd.com wrote: > > I have Mailman3 installed on CentOS 7 using maxking's docker image. I believe the installation went fine and running "curl http://172.19.199.3:8000/postorius/lists/" produces the correct output. I also will be using exim and nginx with this installation. > ... > > location / { > > include uwsgi_params; > > uwsgi_pass 172.19.199.3:8000; Change this to use port 8080 instead of 8000. 8000 is for HTTP protocol and 8080 is for uwsgi protocol. See the docs[1]. [1]: https://github.com/maxking/docker-mailman#setting-up-your-web-server > > uwsgi_read_timeout 300; > > proxy_set_header Host $host; > > proxy_set_header X-Forwarded-For $remote_addr; > > } > > } > > > Since you can curl http://172.19.199.3:8000/postorius/lists/ and get the > correct output, uwsgi or whatever your wsgi process is is working at > that level, and I don't think you should be invoking uwsgi in nginx. I > think you should be using proxy_pass. > > See > <https://wiki.list.org/DOC/Mailman%203%20installation%20experience?action=At…> > for the nginx config used on lists.mailman3.org. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 5 months

[MM3-users] Re: Delayed password requests & migrating users from mm2

by Brian Carpenter

On 3/17/21 9:51 AM, Duane Raymond wrote: > With my new mm3 instance, password reset email to members are being received many hours late or not at all. They seem to be sent fine and when I trigger one to one of my addresses, it works instantly. But many users report getting it many hours later or not at all (despite looking in spam and bulk folders). > > Anyone else experience this password reset mail delay/vanishing and/or have any suggestions for diagnosing it and resolving it? > > The main reason this is problematic is that in migrating lists from mm2, I've set a 'fake' password for them in the mm3 db and instructed members to reset their password to set a new one so they can access the list and update their subscription and/or subscribe to other lists (which they can also do without an account of course - but then lose the ability to use the web interface and access archives). > > So if, as an alternative, there is another way to get list members to access their account then I'm open to it. Have you checked /var/log/mail.log for the time that the request was sent out? Have you looked in the mail queue for deferrals (# mailq)? For instance, Yahoo users will experience great delays if Yahoo starts deferring mail which it most certainly will on new IP addresses that starts sending out mail. -- Brian Carpenter Harmonylists.com Emwd.com

4 years, 2 months

[MM3-users] Re: Things I miss about mailman2

by Mark Sapiro

On 3/17/20 1:59 PM, Quanah Gibson-Mount wrote: > >> Click on the subject in the held messages list. At the bottom of the >> dialog that opens, there is a drop down to set the user's moderation. >> Normally, you would set it to 'default processing'. > > I do not see any such option. After clicking on the header the only > options available at the bottom are: > > Accept, Reject, Discard, Show Source, Show Header > > There are zero drop downs anywhere. This was implemented by <https://gitlab.com/mailman/postorius/-/merge_requests/397> and released in Postorius 1.3.0. >> This was not "removed". It just hasn't been implemented in MM 3 yet. > > So in terms of available functionality that was present in MM2, it was > removed. It may need to be re-implemented, but this was a core feature > that was present in the prior version that is no longer available. Yes, we are aware of many things that are not yet exposed/implemented in Postorius and elsewhere. There are currently 580 open issues at <https://gitlab.com/groups/mailman/-/issues>. We are working on these things as we can. We would love to have your help in fixing these. In the mean time, there are really only 2 or 3 core developers working on this and we are all volunteers, so it takes time. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 2 months

[MM3-users] Re: Postorius no connection to REST API

by Richard Rosner

Mark Sapiro wrote: > > Because those aren't the settings that matter for this. > What if anything are your settings in the mailman.cfg [webservice] > section for > hostname: > port: > admin_user: > admin_pass: > use_https: > (defaults in our distribution are localhost, 8001, restadmin, restpass > and no respectively - I don't know if Debian changes these). > These need to match the Django settings > MAILMAN_REST_API_URL = 'http://localhost:8001' > MAILMAN_REST_API_USER = 'restadmin' > MAILMAN_REST_API_PASS = 'restpass' They do match. Even the port (still on 8001). > > The REST API is apparently not listening on the host/port this is trying > to connest to. Apparently. The question is why. > > What is executing the manage.py command to start Django. Is it user list? Probably. It depends on who is calling it. I understand too little of the new architecture. But mailman3.service is run as list, mailman3-web.service as root. > > I don't use uwsgi and know little about it so I don't know what the Unix > domain socket /run/mailman3-web/uwsgi.sock connection is for, but this > appears to be some miscunfiguration between apache and uwsgi. > Normally, in an apache/uwsgi configuration, apache proxies to uwsgi via > tcp port 8000 and uwsgi is configured with > [uwsgi] > uwsgi-socket = 0.0.0.0:8000 I too have no experience in the combination ow apache and uwsgi. The only other uwsgi app I'm running is on another server and running under nginx.

3 years, 10 months

[MM3-users] Re: Hyperkitty

by Mark Sapiro

On 1/30/23 13:17, Onyeibo wrote: > > The mails don't have that header. I suspect I may have to investigate > SELinux. I think it's unlikely a SELinux issue unless you mean it's an issue writing the log, but if there are any entries at all in mailman.log, that should be OK. what does `mailman conf -s archiver.hyperkitty -k configuration` show? The default is `/etc/mailman3/mailman-hyperkitty.cfg`. Whatever it is, what's in that file. It should be something like ``` [general] base_url: http://127.0.0.1:8000/archives/ api_key: some_key ``` some_key needs to match ``` MAILMAN_ARCHIVER_KEY = 'some_key' ``` in /etc/mailman3/settings.py and the base_url setting needs to access hyperkitty. It could be as above or it could be the URL that accesses HyperKitty externally as in ``` base_url: http:://example.com/archives/ ``` Is all of that correct? To verify base_url, you can do ``` curl http://127.0.0.1:8000/archives/api/ ``` where the initial part of that is the base_url setting. That should return the html for a page of documentation. Look at https://gitlab.com/mailman/mailman-hyperkitty/-/blob/master/mailman_hyperki…. This is Mailman Core's interface to the archiver. If any of the methods there fail to connect to HyperKitty or get an appropriate response, they all log errors. In particular, the archive_message() method at line 171 is saving the message in the spool queue. Immediately before that at lines 164 and 167 it is writing log messages. You should be seeing them. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 4 months

[MM3-users] Re: Where does sender postorius@ come from?

by Odhiambo Washington

The addresses are defined in Django settings if I'm not mistaken. And callout isn't evil. On Wed, Jun 7, 2023, 23:31 Jens Günther <jens.guenther(a)posteo.de> wrote: > I just realized, that mails for registering an account and/or resetting > ones password are obviously sent from postorius@SERVE_FROM_DOMAIN. Why > are they not sent from MAILMAN_ADMIN_EMAIL? > > The problem is: > - an account is trying to register with a mailaddress from a > HostEurope-server > - HostEurope-Servers are doing Sender-Callouts (bad practise :-D) to > verify that a mailaccount exists > - mail is then bouncing, b/c those are not answered (shoud I?): > status=bounced (host [80.237.138.5] said: 550-Sender verification is > required but failed. > - bounce then can't be processed, since mailaccount does not exist :-D > status=bounced (mail for SERVE_FROM_DOMAIN loops back to myself) > > Am I missing something are shouldn't it be better to send those mails > from MAILMAN_ADMIN_EMAIL? (I don't want to mess with these sender > callouts or change anything, HostEurope has been a little bit of a pain > in the ... with mailinglists and not much help at all). > > Thanks in advance, Jens. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to odhiambo(a)gmail.com >

2 years

[MM3-users] Re: Patch/kludge suggestion and a question on adding accepted addresses

by Barry Warsaw

On Apr 23, 2017, at 10:33 PM, David Krantz wrote: >I found out that I had a broken email in one of my held messages >queues). That gave a HTTP 500 error although that should be fixed . >After some digging I found out that where the error occured. > >I'd suggest adding a catch for AttributeError similar to the one for >KeyError in _HeldMessageBase in rest/post_moderation.py. It solved my >immediate problem at least. I run the version from git with the tag >263711b3b7988c7c474e3b8952dc7e0f02f04fa2 Can you file a bug and attach either the problematic message or the traceback? >The message causing this was probably one where I had sent a minimal >email via telnet to the SMTP port and forgot the MessageID-header or >something similarily silly. But it prevented me from seeing the held >messages-list in postorius. Did you talk to your MTA's SMTP port, to Mailman's LMTP port, or some other process? It matters because LMTP is the way messages get from the upstream SMTP daemon (e.g. Postfix, Exim) into Mailman, and the LMTP server rejects any messages that don't have a Message-ID. >I have another question: In the old mailman you could add accepted >senders without adding them to the list. Is that possible in Mailman >3/Postorius? You do this by creating a "nonmember" subscription for the sender, and then setting that member's moderation_action to Action.accept. Cheers, -Barry

8 years, 1 month

[MM3-users] Re: List of "site admin" commands in Mailman 3.1 docker-mailman

by Barry Warsaw

Hi Henrik, On Jul 17, 2017, at 02:55 PM, Henrik Rasmussen wrote: >1) Should I enter the container using "docker exec -it mailman-web bash" and >run "python" in order to get a python prompt, and from there run commands >like those documented at >mailman.readthedocs.io/en/latest/src/mailman/commands/docs/control.html ?. In Mailman 3, there's a command called `mailman` which has many subcommands. if you type `mailman --help`, it will give you some sense of the commands available to you. E.g. whereas in Mailman 2 you'd use `list_lists` at the prompt, in Mailman 3 you would use `mailman lists`. You can get help on the subcommand with `mailman lists --help` of course. >2) Where do I define the what was previously known as the site admin user >and site admin e-mail? There's no real equivalent of the site list or site admin password in Mailman 3. There is a `site_owner` address you can configure in your mailman.cfg file, but it's really just a fallback in a few cases where Mailman otherwise can't reach a human. >On another note: Is it a setting in the mailman-users(a)mailman3.org list setup >that make each of my postings to the list come back with the note "This >sender failed our fraud detection checks and may not be who they appear to >be."? It's not something in Mailman. Possibly in the toolchain on mailman3.org? -Barry

7 years, 10 months

[MM3-users] Re: Mailman 3 database restore unexpected behavior

by Odhiambo Washington

Have you looked at the tables and actually seen the duplicates? SELECT COUNT... Again, restoring a database usually should drop the table before restoring. On Tue, Mar 28, 2023, 14:00 Tibor Molnar <tibor.molnar(a)waltoninstitute.ie> wrote: > Mailman3 built from source using virtual environment. > Version: > GNU Mailman 3.3.8 (Tom Sawyer) > Python 3.9.2 (default, Feb 28 2021, 17:03:44) > [GCC 10.2.1 20210110] > config file: /etc/mailman3/mailman.cfg > > Issue: > I have restored the database number of times recently and experienced that > every time after restoration (an hour after) all members getting an email > that they are unsubscribed due to bounces, however non of the users are > actually unsubscribed from any lists. It looks like there are duplicates in > database and all the duplicates are getting unsubscribed? > > Bounces message: > name(a)email.com unsubscribed from [listname] mailing list due to bounces > > Only restoring two files: mailman3 and mailman3web > > Did anyone come acroos this behavior ? > It is not right that after restoring a database all 1000 user get an email > that they are unsubscribed, but they are actually not. > I may do something wrong during the restoring process. > Please advise me. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to odhiambo(a)gmail.com >

2 years, 2 months

[MM3-users] Re: Message Sent to A Re-Created List Results In Error

by Morris Jones

Matt, I think you're describing exactly the problem that's handled by /virtual alias domains/ that were added to support this case. https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… I did an integration between Mailman3 and Zimbra which uses Postfix, and came across the same issue with domains managed by Postfix and Mailman simultaneously. I documented the case in my Zimbra - Mailman3 integration document here: https://gitlab.com/MojoLA/mailman3.3-zimbra-8.8-integration/-/blob/master/m… See if that helps ... Best regards, Mojo On 12/14/20 9:38 PM, matthew(a)alberti.us wrote: > I checked all over the mailman core logs and couldn't find a > problem. But then I noticed that the 550 error was coming from dovecot-lmtp. > I should rename this thread because the actual problem seems to be unrelated > to re-created lists. > > It seems like the actual problem seems to occur in the following > situation: > > * Using Postfix > * Using Dovecot > * /etc/postfix/virtual includes addresses with same domain as mailman > lists. > * An e-mail address subscribed to a mailman list is in the > /etc/postfix/virtual file as an alias (possibly also if destination address > for an alias). > * (Possibly related) E-mail address is also one of the list owners. > > In that environment, Postfix seems to check only 'virtual_transport' > list, which in my case is dovecot-lmtp, and when it doesn't find the mailman > listname@domain entry in there, it sends a 550 user unknown. It seems to be > that it isn't getting passed to 'transport_maps', which is mailman-lmtp. > > When I remove that one address (that is in /etc/postfix/virtual) > from the list of subscribers, I'm able to post again. Interestingly enough, > when I put it back in as a subscriber. I'm still able to post. So it seems > unsubscribing and re-subscribing that address fixed it, or adding an > additional list owner and deleting it fixed it, or some combination of > those. > > I know this might be shaping up to be a very unlikely scenario. But > basically the account is mine, an admin, doing testing before/after a > deployment.. I'll try to create a few test procedures to document the method > to reproduce the problem, and also hopefully fix it. If I can do that, I'll > open another thread. This could also be a postfix config error of some kind, > which is definitely possible if not likely. > > Thanks for reading. > > - Matt Alberti > > > > -----Original Message----- > From: Abhilash Raj <maxking(a)asynchronous.in> > Sent: Monday, December 14, 2020 11:42 PM > To: matthew(a)alberti.us; Mailman users <mailman-users(a)mailman3.org> > Subject: [MM3-users] Re: Message Sent to A Re-Created List Results In Error > > > > On Tue, Dec 15, 2020, at 10:00 AM, matthew(a)alberti.us > <mailto:matthew@alberti.us> wrote: >> I created a list in the Postorius interface, used it, and then deleted >> it. A week or so later, I re-created the list, and things were fine >> thru the creation and subscription process. But when I sent a message >> to the list, a >> "550 user unknown" error was sent back. > > Can you share more error details from the Mailman logs? If 550 error > response was sent, there must be some internal error traceback in the logs. > >> >> >> I tried to determine if this is a known issue by searching the issues >> in Gitlab; but didn't find anything. But wanted to ask if this was a >> known issue or not? > > I personally don't remember seeing such an issue, but Mark or others might > know. > >> >> >> >> Thanks. >> >> >> >> - Matt Alberti >> >> _______________________________________________ >> Mailman-users mailing list -- mailman-users(a)mailman3.org > <mailto:mailman-users@mailman3.org> To >> unsubscribe send an email to mailman-users-leave(a)mailman3.org > <mailto:mailman-users-leave@mailman3.org> >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >> > > -- > thanks, > Abhilash Raj (maxking) > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > <mailto:mailman-users@mailman3.org> To unsubscribe send an email to > mailman-users-leave(a)mailman3.org <mailto:mailman-users-leave@mailman3.org> > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com>

4 years, 5 months

[MM3-users] Mailman3-web/Postorius behind Lighttpd

by Élodie BOSSIER

Hi, I'm using Mailman 3.3.3 (Tom Sawyer) on Debian Bullseye 11.2 from packages : #dpkg -l | grep mailman ii mailman3 3.3.3-1 all Mailing list management system ii mailman3-full 3.3.3-1 all Full Mailman3 mailing list management suite (metapackage) ii mailman3-web 0+20200530-2 all Django project integrating Mailman3 Postorius and HyperKitty ii python3-django-mailman3 1.3.5-2 all Django library to help interaction with Mailman3 (Python 3 version) ii python3-mailman-hyperkitty 1.1.0-10 all Mailman3 plugin to archive emails with HyperKitty ii python3-mailmanclient 3.3.2-1 all Python bindings for Mailman3 REST API (Python 3 version) I can access from localhost to http://127.0.0.1:8000/ which move me correctly to http://127.0.0.1:8000/postorius/lists/ and all seem to be correct. But 127.0.0.1:8000 listen only in localhost : #netstat -tanpu | grep 8000 tcp 0 0 127.0.0.1:8000 0.0.0.0:* LISTEN 626175/python3 So I try to use my lighttpd as proxy as recommanded with this config : > scgi.protocol = "uwsgi" > scgi.server = ( > "/" => (( "host" => "127.0.0.1", "port" => 8000, "check-local" => > "disable" )), > ) but it's return me a "502 Bad Gateway". I see nothing on there logs : - /var/log/lighttpd/error.log - /var/log/mailman3/web/error.log - /var/log/mailman3/web/access.log But on the file : /var/log/mailman3/web/mailman-web.log I can see that : > QUERY_STRING > REQUEST_URI/postorius/lists/REDIRECT_STATUS200 > SCRIPT_NAME" 400 - I don't know what I'm doing wrong ... There is a way to solve it with lighttpd or bind the port 8000 to 0.0.0.0 instead 127.0.0.1 (which is not recommanded) ? Thank you in advance. Best regards, Elodie

3 years, 3 months

[MM3-users] Re: best pratice - set default MM settings and make them update-save

by Stefan Bauer

Thank you very much. But this is a _new_ mailman behavior. In previous versions, there was no checkbox at all and mass-subscription was done without any confirmation. Stefan Am Mo., 16. Mai 2022 um 18:35 Uhr schrieb Mark Sapiro <mark(a)msapiro.net>: > On 5/16/22 07:16, Stefan Bauer wrote: > > > > Is there also a way to have this box checked by default or do not > request a > > verifcation at all? > > Could not find any flag in base.py. > > To have the box checked by default would require a patch to Postorius > like this. > ``` > --- a/src/postorius/forms/list_forms.py > +++ b/src/postorius/forms/list_forms.py > @@ -1073,7 +1073,7 @@ class ListMassSubscription(forms.Form): > > pre_verified = forms.BooleanField( > label=_('Pre Verified'), > - initial=False, > + initial=True, > required=False, > help_text=_( > 'If checked, users will not have to verify that their ' > ``` > Not requiring verification at all would require patching Mailman core > but would be a bad idea as it could allow someone to subscribe anyone > without that person's consent. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >

3 years

[MM3-users] Re: Permission denied for fulltext_index

by Jan Eden

On 2022-11-27 08:01, Mark Sapiro wrote: > On 11/27/22 00:35, Jan Eden via Mailman-users wrote: > > > > – but the existing directory /opt/mailman/fulltext_index (and its > > contents) are readable and writeable by mailman:mailman: > > > > > drwxrwxr-x 2 mailman mailman 4096 Nov 27 08:00 fulltext_index/ > > > > > > -rw-rw-r-- 1 mailman mailman 4473 Nov 27 08:00 _MAIN_65.toc > > > -rw-rw-r-- 1 mailman mailman 15456 Nov 27 08:00 MAIN_bc0cs2aohovftat6.seg > > > -rw-rw-r-- 1 mailman mailman 15454 Nov 27 06:00 MAIN_brbo8i8edmlz0za4.seg > > > -rw-rw-r-- 1 mailman mailman 15462 Nov 27 07:00 MAIN_ewnemc7lsnodd3y7.seg > > > -rw-rw-r-- 1 mailman mailman 157324 Nov 27 04:00 MAIN_qag60g1rrumshtc2.seg > > > -rw-rw-r-- 1 mailman mailman 15459 Nov 27 05:00 MAIN_w6e0ohurasusy61d.seg > > > -rwxrwxr-x 1 mailman mailman 0 Nov 24 16:00 MAIN_WRITELOCK* > > > > I fail to see where haystack tries (and fails) to create the directory. > > FWIW, deleting threads is not a problem. > > It is uwsgi trying to do this. What user is it running as? Maybe you need to > add that user to the `mailman` group. That's what baffles me – uwsgi is run as the mailman user: mailman 3904667 1.3 0.5 129516 62188 ? Ss 18:33 0:00 /opt/mailman/venv/bin/uwsgi --ini /etc/mailman3/uwsgi.ini mailman 3904668 0.0 0.3 203248 48796 ? Sl 18:33 0:00 /opt/mailman/venv/bin/uwsgi --ini /etc/mailman3/uwsgi.ini mailman 3904670 0.8 0.6 220436 74464 ? Sl 18:33 0:00 /opt/mailman/venv/bin/uwsgi --ini /etc/mailman3/uwsgi.ini - Jan

2 years, 6 months

[MM3-users] Re: Wrong info in moderation mail when held due to match of a header rule

by Mark Sapiro

On 10/17/20 10:39 AM, Torge Riedel wrote: > > The message is being held because: > > Header "Yes" matched a header rule > > At your convenience, visit your dashboard to approve or deny the > request. > > I think this is wrong, it should read 'Header "x-spam" matched a header > rule'. Cause the header rule is configured for header "x-spam" and > pattern "Yes". The message is defined as 'Header "{}" matched a header rule' where {} is replaced with the value of the matching header. I agree it would be better if it were something like 'Header value "{}" matched a header rule for {}:' with {}s replaced with the header value and name. That would make it in your case 'Header value "Yes" matched a header rule for x-spam:' > I haven't found a bug report for this yet on gitlab. If someone of the > developers confirm this is wrong, I will file a bug on gitlab for it. Please do file a bug. It won't be fixed until after the upcoming 3.3.2 final release because we not making i18n changes between the candidate and final releases. Also, if you don't like my suggestion, feel free to suggest something else. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 7 months

[MM3-users] Urgent help needed...

by Darren Smith

Hello, This morning our Mailman 3/Hyperkitty/Postorius installation has become unresponsive. When looking at the machine, postgres is pegging all 4 CPUs on the machine. We did some digging in postgres, and here is the query that is causing problems: "SELECT hyperkitty_email.date FROM hyperkitty_email WHERE hyperkitty_email.mailinglist_id = 'fooey(a)rootsweb.com' ORDER BY hyperkitty_email.date ASC LIMIT 1;" We have found that it doesn't matter what mailinglist_id is being used. We have also found that this might be an issue with the LIMIT 1 - our investigation is showing that using LIMIT 1 in postgres makes things execute very differently than if you use a limit 2 or more, and that this is probably what is going on. Basically, every time this gets called, it pegs an entire CPU for 20-30 seconds. It appears to be called a LOT. So our users are getting 504 gateway timeouts right now. What has changed: We have been in the process of importing our 40 million archived emails from our old mailman 2 archives. Questions: 1) We have tried doing a grep in the codebase - mailman3, hyperkitty, postorius, django - basically anything that might be calling this code, but we can't find it. Does anyone know what generates this query? 2) We are positing that it might be our archive imports that are causing this problem. Does anyone know of any sort of limit/threshold that might cause this to go haywire? Any help you can give, any direction you can point us would be useful. Right now our lists are just down for our users. Thank you, Darren

7 years

[MM3-users] Re: Upgrade to 3.3.2 fails

by Joel Lord

innodb_page_size can not be increased after the fact. In order to actually make that change would involve dumping all the databases and re-initializing mysql with the new page size in place, then reloading from all the dumps. I'm not working with a dedicated database server, it's got quite a lot on it other than mailman, so that would be an enormous undertaking. -Joel On 12/27/20 3:12 AM, Torge Riedel wrote: > Am 26.12.20 um 23:00 schrieb Joel Lord: >> but now we're up and running > > Nice to hear, but I fear you could be hit by this issues again, > depending on changes in the future on the table. Either when more > columns are added or on runtime when rows are added / updated. > > I've read the following documentation, but I do not clearly understand > whether innodb_page_size can be increased later via config or not: > > https://dev.mysql.com/doc/refman/5.7/en/innodb-parameters.html#sysvar_innod… > > > @Mark: Would it be a good approach to split the table 'mailinglist'? I > see some groups of columns like "bounce_*" or "dmarc_*" which could be > managed in separate tables. > > Whereas reaching limits on upgrade is already annoying enough, > reaching limits on runtime can be fatal. I guess. > > Kind regards > Torge > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ -- Joel Lord

4 years, 5 months

[MM3-users] Re: Is it possible yet to install Mailman 3 for Ubuntu 22.04?

by Andrew Hodgson

Hi. The issue is still unresolved with the Ubuntu 22.04 packages. This is because when Ubuntu 22.04 shipped it came with Python 3.10 and the Mailman version that supports Python 3.10 3.3.8 wasn't released. Here is a bug on the Ubuntu side about this: https://bugs.launchpad.net/ubuntu/+source/mailman3/+bug/1999197 The instructions posted to this list to get Mailman running in a venv work fine with Ubuntu 22.04 and Python 3.10 and is what I am using for a couple of hosts. My own view is there are too many moving parts for the distro packages to keep track of, so I will do that myself using the venv and let the distro manage the system packages. There are newer Debian packages available in Debian testing, but they don't seem to have been migrated over to Ubuntu 22.04 yet, possibly they are in 23.04 and those versions could be used (unsure). Thanks. Andrew. -Original Message----- From: Mark London <markrlondon(a)gmail.com> Sent: Friday, April 14, 2023 8:44 PM To: mailman-users(a)mailman3.org Subject: [MM3-users] Is it possible yet to install Mailman 3 for Ubuntu 22.04? Is it possible yet to install Mailman 3 for Ubuntu 22.04? If not, will it be possible in the near future? Thanks. Mark _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… This message sent to andrew(a)hodgson.io

2 years, 1 month

[MM3-users] Re: Removing the footer from mails

by Mark Sapiro

On 10/21/2017 01:46 PM, Peter Mueller wrote: > Hi, > > mailman2 had the configuration variable "msg_footer" to edit/remove the > footer. How can I get rid of the footer in mailman3? The doc is at <http://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/decorate.…>, but it's a bit complex. First, the message footer template name is 'list:member:regular:footer' and the digest footer template name is 'list:member:digest:footer' and if you want the same template for both, the name 'list:member:generic:footer' will do. The easiest way to set these is to create a template for the desired language (probably 'en') or an empty file if you want no footer. Then, there is a 'var' directory in the Mailman installation which contains sub directories named 'archives', 'cache' 'data', 'etc', 'ext', 'lists', 'locks', 'logs', 'messages', 'queue' and 'templates'. You can put list specific templates in var/templates/lists/LIST.ID/en/, domain specific templates in var/templates/domains/DOMAIN/en/ and sitewide templates in var/templates/site/en/. For example if you put an empty file at var/templates/site/en/list:member:generic:footer and a non-empty file at var/templates/lists/list.example.com/en/list:member:regular:footer, all messages and digests will have no footer except for regular deliveries from the list.example.com list which will use it's template. list overrides domain overrides site overrides default. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 7 months

[MM3-users] Re: AttributeError: 'MailingList' object has no attribute 'get_requests_count'

by Shashikanth Komandoor

I tried this way but in this method I don't find any files to edit for my customizations like 1. Removal of social accounts, 2. Addition of SMS integration and so. If I can do my required customizations through pip installation I am fine with that. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> On Wed, Oct 28, 2020 at 12:34 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 10/27/20 11:48 PM, Shashikanth Komandoor wrote: > > Though you are for sure that the current versions as I am claiming the > > above one is perfectly without any issue, please also suggest what would > be > > the best previous version which definitely does not have that issue > because > > I even checked out the immediate previous version of mailmanclient but > > still I am getting the same error. > > > Follow this document > < > https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst… > > > and install with pip. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Thanks & Regards, Shashi Kanth.K 9052671936

4 years, 7 months

[MM3-users] Re: Postorius is not working (throws "Error 500" suddenly after changing POSTORIUS_TEMPLATE_BASE_URL and changing back)

by Odhiambo Washington

On Sun, Oct 1, 2023 at 10:46 AM Wikinaut <mail(a)tgries.de> wrote: > I could not fix the problem, apparently there is a mismatch somewhere now. > > sudo pip uninstall django-q > Found existing installation: django-q 1.3.9 > Uninstalling django-q-1.3.9: > Would remove: > /usr/local/lib/python3.9/dist-packages/CHANGELOG.md > /usr/local/lib/python3.9/dist-packages/django_q-1.3.9.dist-info/* > /usr/local/lib/python3.9/dist-packages/django_q/* > Proceed (y/n)? n > > whereas > dpkg -l | grep django-q: > > ii python3-django-q 1.2.1-1 > > /usr/lib/python3/dist-info: > 4 drwxr-xr-x 8 root root 4096 21. Jun 2022 django_q > 4 drwxr-xr-x 2 root root 4096 21. Jun 2022 django_q-1.2.1.egg-info > > sudo apt remove python3-django-q > the following packet will be REMOVED: > mailman3-full mailman3-web python3-django-hyperkitty python3-django-q > Continue [Y/n] n > > What to do? I don't want to remove mailman3, I just want to bring the > 1.2.1-1 to 1.3.9... > Maybe you can make your life a little more bearable by abandoning the use of Debian packages and embracing the virtualenv install documented at https://docs.list.org/en/latest/install/virtualenv.html#virtualenv-install and we'll find it easier to help you. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 8 months

[MM3-users] LMTP on unix socket

by Stephen J. Turnbull

Hristo Venev via Mailman-users writes: > How do I configure mailman to use a unix socket for lmtp > connections? I don't think it's currently possible. Using a Unix socket is undocumented in Mailman. Mailman's LMTP server is based on aiosmtpd, which as far as I can tell from its documentation does not support Unix sockets. > Setting > > [mta] > incoming: mailman.mta.null.NullMTA > lmtp_host: /path/to/socket That's the smtpd package's style of configuration, but I don't think it works with aiosmtpd. The underlying asyncio package does support Unix sockets, so it's *probably* not too hard to add this feature *in principle*. However, if aiosmtpd doesn't support it, somebody (preferably not us) will have to fork and go through the feature submission process, and maintain it separately for quite some time since we support fairly old Python versions. And async code is fundamentally hairy, if we have to get into any details (*probably* not, but speaking for myself I'm not going to dig into something without a reserve of time on "probably"). Also, I don't think we have any experts in this code at this time, and I'm not going to have enough time to work on it for a month, at least, and more likely around the new year. Maybe somebody else does, but I know some of our developers will be out of touch for a while. You could try the aiosmtpd package maintainer, or the upstream Python channels (python-list(a)python.org) Steve

5 years, 7 months

[MM3-users] Re: # comment allowed in a template file?

by Mark Sapiro

On 7/27/20 5:15 AM, skenny(a)scss.tcd.ie wrote: > > The effect of the template files not being readable by user "mailman" was interesting. Hundreds of lines like the following got written to mailman-core's var/log/smtp.log file at the rate of 4 per second: > > Jul 23 17:09:54 2020 (25) Using agent: <mailman.mta.bulk.BulkDelivery object at 0x7fdf9e7b5f28> > > (the hex number was different each time). That's a `debug` level log message written for every delivery. It has nothing to do with the unreadable templates except that the unreadable template causes looping in an attempt to send the message. Did you perhaps set [logging.smtp] level: debug in an effort to diagnose the template issue? > Having excessively restrictive permissions on the template files is a silly - but easy enough - mistake to make. If it were possible to add it to Mailman 3, a more descriptive logging message could point others who make it in the right direction, perhaps. I spent a long time trying to figure out why messages weren't getting sent out from Mailman core, and in the end it was luck in form of a colleague's suggestion about file permissions that got me out of the rut. There is clearly a bug in that an unreadable template should just be skipped and the fact logged. I have reported <https://gitlab.com/mailman/mailman/-/issues/745>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: REST API authorization failed

by Axel Rau

Hi Mark, thanks for your patience. > Am 10.01.2022 um 04:56 schrieb Mark Sapiro <mark(a)msapiro.net>: > > Anyway, the above is saying that restadmin:??? doesn't match what's configured in Mailman core and reported by `mailman info`. Please check carefully that these are the same in both mailman.cfg admin_pass and settings MAILMAN_REST_API_PASS. Yes, again with password disclosed: - - - (mailman_33) [root@lists5 /usr/local/mailman3]# service mailman restart Restarting the Mailman runners (mailman_33) [root@lists5 /usr/local/mailman3]# su -m www -c "curl -v -u restadmin:restpass http://localhost:8001/3.1/lists" * Trying 127.0.0.1:8001... * Connected to localhost (91.216.35.42) port 8001 (#0) * Server auth using Basic with user 'restadmin' > GET /3.1/lists HTTP/1.1 > Host: localhost:8001 > Authorization: Basic cmVzdGFkbWluOnJlc3RwYXNz > User-Agent: curl/7.80.0 > Accept: */* > * Mark bundle as not supporting multiuse < HTTP/1.1 401 Unauthorized < Server: gunicorn < Date: Mon, 10 Jan 2022 09:39:43 GMT < Connection: close * Authentication problem. Ignoring this. < www-authenticate: Basic realm="mailman3-rest",charset="utf-8" < content-type: application/json < vary: Accept < content-length: 77 < * Closing connection 0 {"title": "401 Unauthorized", "description": "REST API authorization failed“} (mailman_33) [root@lists5 /usr/local/mailman3]# (mailman_33) [root@lists5 /usr/local/mailman3]# grep REST settings.py MAILMAN_REST_API_URL = 'http://localhost:8001' MAILMAN_REST_API_USER = 'restadmin' MAILMAN_REST_API_PASS = 'restpass' (mailman_33) [root@lists5 /usr/local/mailman3]# grep admin var/etc/mailman.cfg admin_user: restadmin admin_pass: restpass (mailman_33) [root@lists5 /usr/local/mailman3]# - - - What am I doing wrong? Is something wrong with my installed python packages? pip freeze attached. clueless, Axel --- PGP-Key: CDE74120 ☀ computing @ chaos claudius

3 years, 4 months

[MM3-users] Re: Help with fresh debian install

by Mark Dadgar

On Oct 5, 2019, at 12:22 PM, Mark Sapiro <mark(a)msapiro.net> wrote: > You could just run, e.g., `sudo -u list bin/mailman import21 ...` which > will work even if 'list' can't log in. That’s what I get for being old school and just su’ing to the user. Thanks. > If you run hyperkitty_import --since=1990-01-01, that should do it. > Awesome - rerunning now. Thank you. > As far as "the archives for many months consist of just a single > identical thread", were there error messages when you ran the initial > import? Were there issues in the imported mbox that you have corrected? > Mailman 2.1's bin/cleanarch can help identify unescaped 'From ' lines > that cause problems. Yes, I ran the archive mbox through cleanarch before importing it. It’s a 24GB mbox file with 17 years of archives for a very active mailing list. > If unescaped 'From ' lines is the issue and you have fixed them, > rerunning the import should import the messages correctly, but it won't > delete the bogus threads. You can delete these threads manually in > HyperKitty if you are logged in as a Django superuser. Great - thank you. I see the occasional “table is locked” error (I am running against sqlite because I only run a couple of lists and I was having issues getting the postgres config working) so it skips the occasional message. We’ll see what happens this time. Your help is much appreciated. - Mark ----- mark(a)pdc-racing.net | 408-348-2878

5 years, 8 months

[MM3-users] Re: Monthly Password Reminders

by Stephen J. Turnbull

Odhiambo Washington writes: > On Thu, Feb 2, 2023 at 8:21 PM Mark Sapiro <mark(a)msapiro.net> wrote: > > On 2/2/23 06:29, Odhiambo Washington wrote: > > > Does MM3 send these monthly subscription reminders the way MM2 used to > > do? > > > I am looking for the setting, but can't find that in the list settings. > > > > No, it does not. > > The rationale behind the decision to toss away that feature? Security?? For the passwords, yes. It was frequently reported as a bug, in fact. Mostly the reminders generate requests to know how to shut them off. You're the first in probably a decade who's asked how to turn them on! While in theory we could protect in transit with SMTP over TLS, we can't guarantee end-to-end encryption (eg, if there's a .forward at the subscribed address), and while TLS is widely implemented, it's still not universal. And there's no way to protect unencrypted email from admins at the receiving host. Receiving encrypted email is pretty much not implemented at all, except in some specialized communities. Also, now that passwords (if they're used) are attributes of Users who may have several Addresses and worse, they may have admin privileges. So Mailman 3 passwords are generally higher value than in Mailman 2. I can imagine a use for the list of subscriptions part that a few users might like, but most folks would prefer not to get another regular mailing. Steve

2 years, 4 months

[MM3-users] Re: Migrating from old V2 server to new V3 server. Questions.

by Mark Sapiro

On 9/30/24 14:44, jkoral(a)luc.edu wrote: > That makes sense. Are there instructions on how to do this? It depends on the MTA. For Postfix you probably have a set of aliases for each of the form: mailman: "|/path/to/mail/mailman post mailman" mailman-admin: "|/path/to/mail/mailman admin mailman" mailman-bounces: "|/path/to/mail/mailman bounces mailman" mailman-confirm: "|/path/to/mail/mailman confirm mailman" mailman-join: "|/path/to/mail/mailman join mailman" mailman-leave: "|/path/to/mail/mailman leave mailman" mailman-owner: "|/path/to/mail/mailman owner mailman" mailman-request: "|/path/to/mail/mailman request mailman" mailman-subscribe: "|/path/to/mail/mailman subscribe mailman" mailman-unsubscribe: "|/path/to/mail/mailman unsubscribe mailman" You could change these, preferably in a separate aliases file so Mailman's genaliases won't overwrite them, to mailman: mailman@new_server mailman-admin: mailman-admin@new-server mailman-bounces: mailman-bounces@new-server mailman-confirm: mailman-confirm@new-server mailman-join: mailman-join@new-server mailman-leave: mailman-leave@new-server mailman-owner: mailman-owner@new-server mailman-request: mailman-request@new-server mailman-subscribe: mailman-subscribe@new-server mailman-unsubscribe: mailman-unsubscribe@new-server For exim, you would need to add another Mailman router ahead of the existing one which would match only the migrated lists and specify an smtp transport which relays to the new server. > Then once we are done migrating to the new server, then we can just change the DNS, correct? Yes -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 months, 1 week

[MM3-users] Re: How to process emails with Mailman3?

by Kyle Lahnakoski

Thank you for this answer. In both the inject case and the netcat case I must know the recipient. My complex setup looses that metadata; leaving me with only the message. I guess I will be parsing the message to find that recipient. Thanks again On 2025-03-09 10:50 p.m., Mark Sapiro wrote: > Mark Sapiro wrote: >> The issue is you are not using nc correctly. >> When you do >> >> $ nc localhost 8024 < /tmp/pbTw1oqmV1rZtHXV707Jcov264hr >> >> you are telling nc to take commands from the file >> /tmp/pbTw1oqmV1rZtHXV707Jcov264hr. You need to give it a command to send >> the file. > Actually, what I said is not correct. The issue is you are just sending the data rather than engaging in an LMTP dialog. > > You need to send LMTP commands so you might prepend the message with > ``` > LHLO mymaillist.org > MAIL FROM: <sender(a)example.com> > RCPT TO: <all-request(a)mymaillist.org> > DATA > ``` > and append to the message > ``` > . > QUIT > ``` > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to kyle(a)lahnakoski.com >

2 months, 4 weeks

[MM3-users] Re: Welcome message template errors

by Mark

On 2024-04-24 10:38, Mark Sapiro wrote: > Try the following in `mailman shell` running as user mailman > ``` > (venv) $ mailman shell > Welcome to the GNU Mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > >>>> import requests >>>> r = requests.get( > ... > 'https://LISTS.MYDOMAIN.COM/mailman3/api/templates/list/MYTESTLIST.LISTS.MYD…', > ... timeout=5) >>>> t.text > ``` > Note the URL above is all on one line. > This is exactly what Mailman core is doing to get the template > assuming the `uri` in the template` table entry is the argument of the > requests.get(). > > If this times out, try increasing the timeout= value. ************************************************ I crossed emails with you on my last post. I reset the POSTORIUS_TEMPLATE_BASE_URL (in settings.py) back to the domain name, restarted everything, created a new Welcome template (using Postorius) and ... >>> import requests >>> r = >>> requests.get('https://MYDOMAIN.COM/mailman3/api/templates/list/MYTESTLIST.MYDOMAIN.COM/li…', >>> timeout=5) >>> r.text 'Another test Welcome message for new members.' >>> ... so all well there. And mailman is running mailman core ... # cd /opt/mailman/venv/bin/ # ls -la ... -rwxr-xr-x 1 mailman mailman 230 Jan 26 04:00 gunicorn -rwxr-xr-x 1 mailman mailman 231 Jan 26 04:00 mailman -rwxr-xr-x 1 mailman mailman 230 Mar 25 22:18 mailman-web ...

1 year, 1 month

[MM3-users] Re: Problems with New MM3 Installation

by Jeff

> On May 11, 2021, at 1:18 PM, Mark Sapiro <mark(a)msapiro.net> wrote: > > > Set base_url: in /usr/local/mailman3/mailman-hyperkitty.cfg to a url > that will reliably access HyperKitty, probably the same base URL that a > user with a web browser would use. > Thanks Mark, I really appreciate your assistance. New messages are now being archived as expected, but I still have a few small remaining issues to work out with my MM3 installation: 1) some emails that arrived before I got the archive working are still sitting in: /usr/local/mailman3/mm/var/archives/prototype/[listname]@[domain]/new Strangely this includes at least one email that was archived. Should this directly be cleared as messages are archived? Is there a way to force it to be cleared? 2) Some messages that arrived while I was having other problems with the setup have been stored in: /usr/local/mailman3/mm/var/queue/shunt What should I do to get these messages processed? 3) Similar to above, some messages are in: /usr/local/mailman3/mm/var/queue/bad How can I get these messages processed? 4 Modified the template for “list:admin:action:post” through Postorious and emails that arrived after that were put in the “shunt” queue. I traced this problem to POSTORIUS_TEMPLATE_BASE_URL. By default, it is set to "http://localhost:8000 <http://localhost:8000/>” which is where uwsgi is listening. However, uwsigi is listening for uwsgi:/ not http://. Should I change POSTORIUS_TEMPLATE_BASE_URL to “uwsgi://localhost:8000 <uwsgi://localhost:8000>” or keep http but make it something else? Thanks again for any help anyone can provide. Jeff

4 years

[MM3-users] Re: How to remove a message with an invalid Message-Id?

by Mark Sapiro

On 6/14/23 15:12, McGuire, Tommy M. (MSFC-IS61)[EAST2] via Mailman-users wrote: > I have a fun problem: apparently a message sent to a mailing list has an invalid Message-Id (I think), which is causing the message parse to fail while attempting to archive the message. Unfortunately, the message seems to be trapped somewhere and resulting in error logging every few minutes. Is there any way to find and remove the message? > > Literally, the only thing I've been able to find out about it is that the Message-Id contains the text "[83c48dddbea7492e873224a5ae1c04be-JFBVALKQOJXWILKNK4YVA7CBPJ2XEZKEMV3E64DTPRCW2YLJNR6EK6DPKNWXI4A=(a)microsoft.com]>". This is https://gitlab.com/mailman/mailman/-/issues/1065 which is fixed for the next release by https://gitlab.com/mailman/mailman/-/merge_requests/1099 You will find the message queued at Mailman's var/archives/hyperkitty/spool/ directory. You can examine the pickled message object with `mailman qfile` and you can simply remove the file. If you want to "fix" it and archive it, A `mailman shell` interaction like this will do it ``` >>> import pickle >>> with open('/path/to/.pck/file', 'rb') as fp: ... msg = pickle.load(fp) ... msgdata = pickle.load(fp) ... >>> msg.replace_header('Message-ID', '<83c48dddbea7492e873224a5ae1c04be-JFBVALKQOJXWILKNK4YVA7CBPJ2XEZKEMV3E64DTPRCW2YLJNR6EK6DPKNWXI4A=(a)microsoft.com>') >>> with open('/path/to/.pck/file', 'wb') as fp: ... pickle.dump(msg, fp) ... pickle.dump(msgdata, fp) ... >>> ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Can't send emails to list users

by Stephen J. Turnbull

Rob Passalacqua writes: > I've looked on the forums and haven't found someone with the exact same issue as me. > It appears that my mailman 3 server is either only sending to the > first3 recipients on the list or only sending out mail to users > that are members in Django because only 3 recipients are getting > the emails. How many people are on each of the lists which exhibit this problem? Have you checked for unsubscriptions or disabled subscriptions? Are you sure all subscribed addresses have been validated by the subscribers? How do you know only 3 recipients are getting the emails, did someone complain they're not getting them? Is it the same person every time? Is it the poster themself? If so, is that person's email service provided by Google? (Google discards mail sent by the recipient in favor of the copy in the sent folder.) Is it a person who is also an explicit addressee, or are they on multiple lists and only receiving one copy? If so, is that person's email provided by an Exchange server? (Exchange automatically deduplicates delivered email.) > Here is my /var/log/mailman3/smtp.log: > Sep 01 08:00:04 2023 (1405) <169357680279.2857929.16011221517221650936(a)lists.mydomain.com> smtp to graduates(a)lists.mydomain.com for 4 recips, completed in 0.028921127319335938 seconds This shows delivery to FOUR recipients? Which of the log messages are relevant to your report? There are only three or four patterns there, you could have edited down to make it comprehensible. Steve

1 year, 8 months

[MM3-users] Re: Moving mm3 -> mm3 to different host

by Mark Sapiro

On 10/19/23 02:38, Axel Rau wrote: > Hi all, > > There are lots of threads for mm2 -> mm3 moves, but only one > thread mm3 -> mm3. Some time ago, I found a post from Mark, explaining > the steps, but I can't find it again. > > I have created a working mm3 installation on the new host with both > mailman and mail-web dbs imported. > hyperkitty archive seems to in the db. > > What are the next steps to complete the transfer? > > - rsyncing messages, lists and templates to new host You may want to add archives/prototype to that. Also note that the contents of the messages/ directory should correspond to the entries in the message table in the mailman db. > - Setting up DNS CNAMES to the new server > - Adapting exim to accept mails to the aliased domain > > - Can I keep the old listname, with the old domain name? As long as mail to the list at that domain gets delivered to the new server. Note that in DNS if the domain has an MX record it must point to a domain with and A record and if there is no MX record, there must be an A record. CNAMEs won't do for mail delivery. > -What else has to be done ? I think that's it. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 7 months

[MM3-users] Problems getting started with postorius

by Alain D D Williams

I am having another go with mailman3, being a long time MM2 user, but am getting increasingly frustrated. I am using on Debian 12 (Bookworm) and have installed the various Debian packages - mailman3-full does that. I have successfully started the mailman3 and mailman3-web services. I went to: http://localhost/mailman3/postorius/domains/new/ 'Add a new domain' I enter a 'Mail Host' -- a domain that does exist on this machine I choose a Web host from the drop down list -- same as Mail Host I click on 'Create Domain' and the page refreshes with the same information but under the Mail Host I see in red: {"title": "500 Internal Server Error"} I eventually tracked it down. The problem was that I had signed in with an account "addw@localhost". That, for some reason, failed validation above. I hacked the database and changed to "addw(a)localhost.localdomain" and creating the new domain worked. I could send email to addw@localhost - so at the MTA level it is correct. So please can the initial account creation do the same validation as does adding a new domain. I have looked but cannot find any documentation on postorius than https://docs.mailman3.org/projects/postorius/en/latest/ which is not helpful for a user or system admin. Can you point me to something better. Regards -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 https://www.phcomp.co.uk/ Parliament Hill Computers. Registration Information: https://www.phcomp.co.uk/Contact.html #include <std_disclaimer.h>

6 months, 3 weeks

[MM3-users] Re: mailman-web: ResponseNotReady

by Dmitry Makovey

On 10/18/2017 01:41 PM, Abhilash Raj wrote: > Hi, > > $ docker-compose rm -f mailman-web > $ docker-compose up -d mailman-web > > This will basically create a new container for Mailman-web, but, since > the state of mailman-web is stored completely in database (database > container), I am not sure how to reset *just* mailman-web without > dropping mailman-core related tables too (they share the same database > but have their own separate tables). The above command will get you a > fresh copy of code running. > > You can potentially get the list of tables and drop them, or maybe > Diango has some way to reset it's state from Django shell (python > manage.py <http://manage.py> shell, from inside mailman-web will get you > shell). I may have to look it up. > > Also, just by looking at the traceback, I am not sure about the exact > error. I may have to debug more to arrive at a better conclusion, which > I won't able to do until after this weekend. after a full remove of the DB - I still get this error. I left some of the directories intact but for the most part it's a fresh new install that gets the same error where previous didn't give us as much trouble. Something else must be messed up. logs show very little detail other than originally posted exception. I'll try to dig up some more info... -- Sr System and DevOps Engineer SoM IRT

7 years, 7 months

[MM3-users] Re: "Approved:" header from mailman2 times

by Mark Sapiro

On 04/09/2018 03:59 PM, Abhilash Raj wrote: > On Mon, Apr 9, 2018, at 3:00 PM, Dmitry Makovey wrote: >> Hi, >> >> is there any equivalent to "Approved" header that was present in MM2 in >> MM3 land? Google is not very helpful in that. > > It does exist in Mailman 3 as a carry-over from Mailman 2, but AFAIK it is broken. I don't think it is broken, but it requires setting the moderator_password attribute for the list which can be set visa REST but I think not by mailmanclient. > Also, I have been thinking of not having this as a feature in Mailman 3, mostly because of the issue of having shared passwords. No one should be sending out passwords anyway through plain emails anyway. > Agreed. This is a shared password. and would be sent in plain text as a header or body line. It would be nice though to have some feature to enable, for example, spoof proof posting to a one-way (announce only) list. One thought on how to do this would be to have a list attribute that says posts from 'authenticated' owners and moderators can be auto approved and authentication could be by PGP signing the post. This would require Mailman to have the ability to verify a PGP signature from an owner or moderator which is not currently the case. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 1 month

[MM3-users] Re: Mailman3 Issue with Sending Mail to Yahoo/AOL

by Mark Dadgar

Yes. I have been running a private motorsports community mailing list in the SF Bay Area for ~20 years and the only ISP that consistently does this is anything Yahoo touches. And there’s not much you can do about it, other than continue to follow deliverability best practices. Fortunately, most of the time the email is merely deferred semi-briefly. But it is a gigantic PITA. - Mark ----- mark(a)pdc-racing.net | 408-348-2878 > On May 12, 2021, at 8:53 AM, Apollinaris Schöll <aschoell(a)gmail.com> wrote: > > It’s not you. I am managing a neighborhood list too and yahoo flags them for many users as spam. And few times yahoo bounced messages for a day for at least 50% of subscribers. ATT has been even worse. Full bounce of all emails for a week at a time. No problems with any other provider > >> On May 12, 2021, at 8:00 AM, chris--- via Mailman-users <mailman-users(a)mailman3.org> wrote: >> >> That's the trouble ... I'm certain SPF and DKIM are correct. I've ran them thru the checker, and all appears to pass properly. So I'm really at a loss. >> _______________________________________________ >> Mailman-users mailing list -- mailman-users(a)mailman3.org >> To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

4 years

[MM3-users] Logging subscriptions and unsubscriptions

by Christian Schoepplein

Hi, I am in the process to migrate from mailman 2 to mailman 3 and currently I am setting up the new environment and do some tests and play around with the new system. I'd like to have a seperate log for list subscriptions and unsubscriptions. For that reason I added the following section to the mailman-extra.cfg file: [logging.subscribe] path: subscribe.log That created a file called subscribe.log but not everything regarding subscription / unsubscriptions is added to the file. When subscribing and unsubscribing a user via mail only the following line is shown: Aug 27 10:58:31 2021 (28) tmod(a)mm3.example.com: held subscription request from chris(a)example.com Nothing regarding the finished subscription and absolutely nothing regarding the unsubscription performed later. Also in mailman.log I can find the following lines: Aug 27 10:58:05 2021 (28) deque: do_confirm_verify Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 356, in _step_send_confirmation raise StopIteration StopIteration Aug 27 10:58:31 2021 (28) deque: subscribe_from_restored Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 326, in _step_get_moderator_approval raise StopIteration StopIteration Aug 27 10:58:33 2021 (29) OWNER: <163005471133.28.13827351997075408419@mailman-core> Is this because a higher logging level or is this an error? I can find nothing really helpfull regarding subscriptions and unsubscriptions in any logfile. Is this wanted or can this changed by any configuration setting or are this information stored in the database? Cheers, Schoepp

3 years, 9 months

[MM3-users] Re: Mailman3 / Exim4: Router fails

by Mark Sapiro

On 5/22/23 12:42, ceo(a)sartrack.nz wrote: > I found the problem with Exim4. > The Exim4 config file should contain this: > > MM3_LISTCHK=MM3_HOME/lists/${local_part}.${domain} > and NOT > MM3_LISTCHK=MM3_HOME/lists/${local_part}@${domain} > > Somewhere the documentation is wrong. The documentation at https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… has MM3_LISTCHK=MM3_HOME/lists/${local_part}.${domain} Where did you see MM3_LISTCHK=MM3_HOME/lists/${local_part}@${domain} > But I now have the next problem: > I send an email to a new mailing list called templist(a)sartrack.nz (I imported my old list members). > in /var/log/mailman3 I get an error regarding this; > The (final) error states: > PermissionError: [Errno 13] Permission denied: '/var/lib/mailman3/lists/templist.sartrack.nz/digest.mmdf' > > The file digest.mmdf does not exist there at all. Because Mailman was trying to create it and couldn't. I suspect you ran `mailman create` as root and the /var/lib/mailman3/lists/templist.sartrack.nz/ got created with user:group as root:root rather than the mailman user and group. Recent Mailman versions won't run the `mailman` command as root without a --run-as-root option for this reason. How are you installing Mailman? > The mailing server does not send out any emails for "templist" This is a separate issue from the above error, but it might also be a permissions error. What other errors do you see in /var/log/mailman3/mailman.log? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years

[MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19

by Mark Sapiro

On 6/8/19 4:33 PM, Andrew Bernard wrote: > Hi Mark, > > Thanks for your great help. But despite decades of UNIX experience, my area > is not Django (yet). The nub of my question is that I thought you have to > have a manage.py file for Django to be able to set up the various affairs, > such as making the database migrations and so on. It is that that is > eluding me. Apologies for this hopelessly newbie question. The equivalent of manage.py in what I suggested is /opt/mailman/bin/django-admin. > I was impressed with your method of installation in the page referenced, > and I have foolwed that closely. But I am puzzled about the build script. > If I run as user mailman, not root, it wanted to install under /usr. which > of course results in permission denied. I had to modify the script to say > this: > > python setup.py install --prefix /opt/mailman/mm/venv If you want to install in the virtualenv, you should just activate the virtualenv and it should work. Perhaps the issue is that the build script at <https://wiki.list.org/DOC/Mailman%203%20installation%20experience?action=At…> assumes the virtualenv is at /opt/mailman/mm/venv. You need to insure that the '. ../mm/venv/bin/activate' line is actually pointing to your 'venv/bin/activate' -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years

[MM3-users] Re: Bounce processing

by Mark Sapiro

On 4/23/20 2:27 PM, Andrew Hodgson wrote: > > When users are set to disabled after their bounce score reaches a certain threshold, I seem to recall on Mailman 2 they were sent an email with a link to reactivate their subscription. On Mailman 3 they are told to contact the list admin, I have had messages from a few subscribers regarding this asking how they can re-enable delivery. The message the user is sent in built from the list:user:notice:warning template. The next release of Postorius will offer that template as one you can edit, but the current release doesn't. You can make an edited template in the var/templates/ directory. The logged-in user can go to her settings pages in Postorius at accounts/subscriptions/ to set delivery status. The generic template can't be that specific because Mailman Core doesn't even know if you have Postorius. > I am also getting bounces that look like they are coming from Qmail (Yahoo addresses) which are being forwarded to the list owner as unrecognised bounces. Should the type of bounces that Mailman 2 was handling be handled in Mailman 3 or is the way that the addresses are extracted different? I have disabled the relevant users but do have the bounces to hand. The bounce recognition for Mailman 3 is essentially the same as Mailman 2.1. If you post one of these complete bounce messages, we'll investigate why it isn't recognized. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 1 month

[MM3-users] Re: Welcome message template errors

by Mark

On 2024-04-28 01:32, Mark Sapiro wrote: >> I also note that this timeout only occurs when it is a subscription >> via REST. I.e. subscription via email or `mailman addmembers` sends >> the proper welcome message. >> >> So it has something to do with the retrieval being done by a rest >> runner, but I still don't know what the underlying issue is. I created a text file as a custom welcome message and chowned it to mailman:mailman, then edited the database record (template.uri) from http://localhost:8000/mailman3/api/templates/list/mytestlist.mydomain.com/l… TO file:///home/mark/welcome.txt This delivered the custom welcome message to the user when subscribed via Mass Subscribe. I'm not sure what this tells me other than a call can be made to a file but not the database. > More strangeness. I've now done a test on one of the production > servers I manage, and there is no error. Both the production server > and the development server are running the identical Mailman code > installed in a venv, they both have the same version of urllib3 and > similar Python versions, 3.9.16 on the development server and 3.9.10 > on the production server. Both servers are running under Ubuntu > 20.04.6. The only other difference I see is on the production server > everything runs as user mailman and on the development server > everything runs as user mark. Mine is Debian 12 with Python 3.11.2. Could a newer Python version really cause this amount of grief?

1 year, 1 month

[MM3-users] Re: [Mailman-Users] Mailman 3 Ready?

by Stephen J. Turnbull

Allan Hansen writes: > What is the best, easiest, guaranteed-to-work way to get this > Mailman 3 up and running (OS, add-ons, options, etc.). When I tried > myself, I saw a lot of options that I really did not really care to > have because I did not know the consequences of each. I’m an > application programmer, not a systems programmer. It's email, there are no guarantees. I hate to say that, but that's the way it is. In particular, I'm concerned about the "iRedMail" integration, which may be a complete wildcard from my point of view. With respect to the relevant iRedMail components, I can say that Mailman 3 is perfectly happy with Postfix as MTA (it's the recommended configuration, although I use Exim4 for historical reasons), and I've been satisfied with a small-scale set of lists (about 10 active ones, with at most 20 subscribers total) using Apache+mod_swgi to host Postorius and HyperKitty. The problem would be if your friend (is that the Frank in the CC? hi, Frank!) really really wants to manage Mailman 3 through iRedAdmin -- that will get messy I suspect, and pragmatically speaking, we can't support it, we don't have the cycles. So he'd be on his own, especially since the iRedMail folks have their own bespoke mailing list manager. I would recommend avoiding iRedAdmin integration, and just using Postorius since the subscribers and non-site-admin moderators (if any) will need to use Postorius anyway. Ignoring the iRedAdmin issue, the absolute simplest is 1. Install any Linux distribution with a Docker package. 2. Install the distribution's Docker package. 3. Download and install Mailman Project's Mailman 3 container. 4. Upgrade the container manually (ie, download and reinstall) as appropriate. For reference, what I would recommend to my friends, who would give me hands-on access in emergencies: 1. Install the Debian distribution. (What I use.) 2. Pin the Mailman 3 packages to "experimental". The idea would be to get Mailman 3 upgrades as fast as possible, even at the risk of packaging issues. (My experience with default-to-experimental system for several years was that this happened at most once a year, and the three or four cases all got fixed within days.) 3. Install the Mailman 3 packages. 4. Adjust any dependencies that need non-"stable" versions. 5. Upgrade via apt or whatever occasionally. 6. When Mailman 3 is working well, downgrade the pins to a more stable level. Since you do have such a friend, there's probably a similar process that works for his distribution-of-choice. > The problem is that my MacOS users are getting tripped up by the > mangling, as it is hidden by the mail clients. I have instructed > them to remove previous recipients regularly from the list of such, > if they contain the ‘via list’ string. But they don’t read my > emails, and we see many embarrassing email ssent to the lists that > are meant for one-on-one communication. I guess we could provide a setting where reply-to goes *only* to author, instead of to author *and* list as we currently recommend. But that is going to make you (or list owners) the focus of user ire because their intended replies to list go only to author. What do you think? tl;dr The rest is me blowing off steam. :-) > The fact that the mangling will continue is a disappointment. It's a disappointment to the sane people at the IETF, too, including the rep from Yahoo!, who's a very smart lady (I may be biased, she gave me a kitten once. ;-) Yahoo! is violating the original concept (DMARC "p=reject" was supposed to be used *only* for "transactional" mail, i.e., direct private communication between a business and its clients), but I see her point: when you've had a hundred million or so address books hacked and sold to spammers, and the spammers are sending literally millions of "recommendation from a friend" spams per hour for days on end, you use the tools to hand. > I’m inclined to tell all my AOL and Yahoo users and others in the same > boat to find another email service. I know the feeling. I'm lucky in that respect: the Ministry of Education prohibits use of yahoo mailboxes at Japanese universities. (Which is a WTF of a different kind: yahoo.co.jp is a franchise, not controlled by yahoo.com, and doesn't use p=reject at least at the time MoE issued that policy.) Mail is just hard. It was designed for a "friendly network of users", not for today's rather hostile open Internet, and even if they had envisioned this in the 70s when the message format and SMTP mail transmission protocol were designed, the fundamental problem is that pretty much everyone has a genuine need, even if only occasional, to receive messages from untrusted and even unknown senders.

5 years, 6 months

[MM3-users] Re: Cannot start lmtp runner due to error while attempting to bind on address ('127.0.0.1', 8024): address already in use

by Stephen J. Turnbull

actionmystique(a)gmail.com writes: > Dovecot is the LMTP server > (https://doc.dovecot.org/configuration_manual/protocols/lmtp_server/) > listening on port 8024. > I thought that ```lmtp_port``` was precisely the port where to > contact the LMTP server, as described in the comments (cf. first > post). > - Are those comments wrong? In Mailman documentation, Mailman's LMTP server is *the* LMTP server. Mailman wouldn't send *to* an LMTP server, it would send to the MTA's "submission" port or to the SMTP port. > - Is mailman trying to act as a LMTP server instead? Yes. > - If so, wouldn't there be an issue with 2 LMTP servers if I choose > another port number for ```lmtp_port```? No. Apparently Dovecot made the same architectural decision that Mailman did: "I want to receive incoming mail via LMTP because all the MTAs I'm willing to talk to can do it that way so I don't have to worry about pipes and configs and sockets, oh my!" Both want to receive via LMTP. So it has to be different ports. Only the MTA and Mailman need to know Mailman's port, and ditto for MTA + Dovecot. Ie: LMTP SMTP +-----> Mailman @ 9024 -----> subscribers SMTP | (or whereever) Internet -----> MTA -+ | LMTP IMAP +-----> Dovecot @ 8024 -----> local users or whatever. (note to me: needs to be in dox) Steve

5 years, 6 months

[MM3-users] Mailman 3 centos7 installation issues

by bader＠cchmc.org

So I am working with our Linux admin to install mailman3 in centos7 following this instructions https://docs.mailman3.org/en/latest/install/virtualenv.html# (and adjusting for centos versus Debian) The install went fine with the command “pip install wheel mailman psycopg2-binary”until the config file. /etc/mailman3/mailman.cfg The /etc/mailman3 directory did not get created? Should it have? We created it and the config file But “mailman info” throws errors venv) [mailman@bmimailmandr2 var]$ mailman info Traceback (most recent call last): File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 2336, in _wrap_pool_connect return fn() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 364, in connect return _ConnectionFairy._checkout(self) File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 778, in _checkout fairy = _ConnectionRecord.checkout(pool) File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 495, in checkout rec = pool._do_get() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/impl.py", line 140, in _do_get self._dec_overflow() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ with_traceback=exc_tb, File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/util/compat.py", line 182, in raise_ raise exception File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/impl.py", line 137, in _do_get return self._create_connection() File "/opt/mailman/venv/lib64/python3.6/site-packages/sqlalchemy/pool/base.py", line 309, in _create_connection return _ConnectionRecor I suspect it is not using the config file at /etc/mailman3/mailman.cfg But we do not even see a mailman service in /etc/systemd/system/mailman3.service. Also, we are using python 3.6, will that be a major issue? or should spend the time to install 3.7 from source?

4 years, 2 months

[MM3-users] Re: Email to list owner on list creation only sent when using mailman create --notify command

by Perry Kollmorgen

Ok, thanks for the information. Regards, Perry ________________________________ From: Mark Sapiro <mark(a)msapiro.net> Sent: Monday, 10 June 2024 2:10 PM To: mailman-users(a)mailman3.org <mailman-users(a)mailman3.org> Subject: [MM3-users] Re: Email to list owner on list creation only sent when using mailman create --notify command On 6/9/24 5:26 PM, Perry Kollmorgen wrote: > Hi, > > This is only a minor issue, however as a nicety for new list owners I am hoping there is work around or something I have missed. > > I have the following file: templates/domains/<fqdn_listname/en/domain:admin:notice:new-list.txt > > When I use the mailman create command with the --notify option the new owners receives an email with the correct template info from the above file. > > However when I use mailmanclient python bindings or Postorius to create an list, there is no email sent. This is a bug. Currently only `mailman create` sends this notice, but as you note, list creation via rest should do it too. I have created https://gitlab.com/mailman/mailman/-/issues/1156 for this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… This message sent to pcjkollmorgen(a)hotmail.com

11 months, 4 weeks

[MM3-users] Re: Prototype import [was: Re: Setup Question: Disk-Layout (Migrating from Mailman 2.1)]

by Stephen J. Turnbull

Mihai Moldovan writes: > The imported messages, do have a Message-ID-Hash, but the > Archived-At and List-Archive headers are empty (literally <>). [...] > What are the proper header values for this module? Empty or omitted. See site-packages/mailman/archiving/prototype.py. If they're produced at all, I suppose that's a bug. Mailman core get the contents of those from the 'list_url' and 'permalink' callbacks defined by the archiver, which in the case of the prototype archiver return None. So Mailman should omit those headers and log an error message IMO. I believe your web-facing archive is HyperKitty. I suppose you should import those callbacks from HyperKitty (I think they're actually in the mailman_hyperkitty Python package) in order for your backup to reflect "archived message plus headers omitted by HyperKitty", (I haven't checked to see if you can actually just from mailman.archiving.prototype import Prototype from mailman_hyperkitty import Archiver class Backup(Prototype): list_url = Archiver.list_url permalink = Archiver.permalink but it that doesn't work cargo-culting the code should be straightforward. I forget if your goal was to reproduce the incoming message or the outgoing message. If the incoming message, archiving happens pretty late in the pipeline so banned attachments have been stripped and HTML-to-text conversion and the like have already been done. -- GNU Mailman consultant (installation, migration, customization) Sirus Open Source https://www.siriusopensource.com/ Software systems consulting in Europe, North America, and Japan

1 month, 2 weeks

[MM3-users] Re: Ann: Mailman Core 3.3.5 is out

by Odhiambo Washington

@Eggert, I believe you used apt to install and so you have to wait for the package maintainer to avail the upgrades via apt. On Wed, Sep 29, 2021 at 7:48 PM Eggert Ehmke via Mailman-users < mailman-users(a)mailman3.org> wrote: > Should I upgrade my Mailman 3.3.3 installed from Debian Bullseye? I would > have > to bypass the Debian installer. Or will there be Debian packages > available? > Same question for Postorius 1.3.6 > > > Am Mittwoch, 29. September 2021, 05:26:47 CEST schrieb Abhilash Raj: > > Hey Everyone, > > > > I just tagged and uploaded Mailman Core 3.3.5 release. > > > > This release includes both bug fixes and some new features. A full list > of > > changes is available here: > > > > > > > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS > . > > html#news-3-3-5 > > > > You can install this version using pip: > > > > $ pip install mailman==3.3.5 > > > > The release tarball is available on PyPI as well: > > > > https://pypi.org/project/mailman/3.3.5/#files > > > > Thanks to everyone who made this release possible! > > > > Abhilash > > > > > On Sep 19, 2021, at 11:02 AM, Abhilash Raj <maxking(a)asynchronous.in> > > > wrote: > > > > > > Hey Everyone, > > > > > > I just tagged and released Mailman Core 3.3.5rc1 release. > > > > > > This is identical to 3.3.5b1 in code, the only changes that have been > made > > > are in utility scripts and testing configuration.> > > > You can install this version using: > > > $ pip install --pre mailman==3.3.5rc1 > > > > > > If you want to download a release tarball, you can do so from here: > > > https://pypi.org/project/mailman/3.3.5rc1/#files > > > > > > This is the first (and only) planned release candidate for 3.3.5 > release. > > > The stable release is planned for next week. > > > > > > thanks, > > > Abhilash > > > > > > On 9/7/21 12:39 AM, Abhilash Raj wrote: > > >> Hello Everyone, > > >> I am pleased to announce that Mailman Core 3.3.5b1 is now out. It is a > > >> pre-release for 3.3.5, which is slated to come out in 3 weeks from > now. > > >> I am planning for a 2 week beta period, after which I'll release the > > >> first RC and then stable a week after. Right now I am not planning to > > >> release a second beta version, but if there are several changes in > Core > > >> in the next week or so, then I might. This release includes a lot of > bug > > >> fixes and some new features. It also includes a security enhancement > > >> that improves the authentication of REST API by adding resistance to > > >> some timing channel attacks. A full list of changes in this version > can > > >> be found here[1]. > > >> [1]: > > >> > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NE > > >> WS.html#news-3-3-5 We have also made improvements in the i18n workflow > > >> and now the email templates are updated from the translated messages > in > > >> the .po files that we get from Weblate. Documentation for translators > is > > >> available here[2] if you want to help translate Mailman into your > native > > >> language. [2]: https://docs.mailman3.org/en/latest/translation.html > > >> > > >> This is a pre-release version, if you want to test it with your > setup, > you can install it using: > > >> $ pip install --pre mailman==3.3.5b1 > > >> > > >> If you want to download a release tarball, you can do so from here: > > >> https://pypi.org/project/mailman/3.3.5b1/#files > > >> > > >> This release received a lot of contributions from community, which I > am > > >> really happy about! I'd like to thank everyone who made this release > > >> possible!> > > > -- > > > thanks, > > > Abhilash Raj (maxking) > > > > -- > > thanks, > > Abhilash Raj (maxking) > > > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' :-)

3 years, 8 months

[MM3-users] Re: Your Dashboard

by Mark Dadgar

On Feb 11, 2020, at 12:26 PM, Mark Sapiro <mark(a)msapiro.net> wrote: >> This is actually a regression from Mailman 2.x. That train included a link to the relevant dashboard in the email, which I miss terribly. > > > I explained above why this is the case, but you can fix it. You do so by > making a sitewide template for this message. In the case of this list, > we have a template in Mailman's var/templates/site/en/ directory (the > default directory for sitewide english templates. This template is named > list:admin:action:post.txt and its content on this site is: > >> As list administrator, your authorization is requested for the >> following mailing list posting: >> >> List: $listname >> From: $sender_email >> Subject: $subject >> >> The message is being held because: >> >> $reasons >> >> At your convenience, visit >> https://lists.mailman3.org/mailman3/lists/$list_id/held_messages > > > Of course, in your case the <https://lists.mailman3.org/mailman3/> part > of the URL will be different. > > See > <https://wiki.list.org/DOC/Mailman%203%20installation%20experience#Templates> > for the other templates I also install. > > You can also put domain specific templates in > var/templates/domains/$domain/$lc/ which override site templates for the > domain and list specific templates in var/templates/lists/$list_id/$lc/ > which override site and domain templates for the list, and you can also > set list templates via Postorius. Awesome - thank you. - Mark ----- mark(a)pdc-racing.net | 408-348-2878

5 years, 3 months

[MM3-users] Re: Postorius no connection to REST API

by Mark Sapiro

On 8/9/21 8:56 AM, Richard Rosner wrote: > Mark Sapiro wrote: > >>> The REST API is apparently not listening on the host/port this is trying >> to connest to. > > Apparently. The question is why. You are in a better position to answer that than am I. What does `sudo netstat -lntp` show? What does `ps -fwwa|grep rest` show? >>> What is executing the manage.py command to start Django. Is it user list? > > Probably. It depends on who is calling it. I understand too little of the new architecture. But mailman3.service is run as list, mailman3-web.service as root. mailman3-web.service must also run as list. >>> I don't use uwsgi and know little about it so I don't know what the Unix >> domain socket /run/mailman3-web/uwsgi.sock connection is for, but this >> appears to be some miscunfiguration between apache and uwsgi. >> Normally, in an apache/uwsgi configuration, apache proxies to uwsgi via >> tcp port 8000 and uwsgi is configured with >> [uwsgi] >> uwsgi-socket = 0.0.0.0:8000 > > I too have no experience in the combination ow apache and uwsgi. The only other uwsgi app I'm running is on another server and running under nginx. So, what do you have in your apache config for proxying to uwsgi and what's your uwsgi configuration. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 9 months

[MM3-users] Re: CPU usage when idle

by Mark Sapiro

On 5/28/25 08:27, roughnecks via Mailman-users wrote: > > It's the manage.py qcluster whatever is called. I have shut down MM for > the time being, because I'm not fully motivated to have it running, so I > can't be more accurate right now. I don't know how qcluster is configured in the Debian packages (which are out of date and possibly buggy anyway). You may be using django-q <https://django-q.readthedocs.io/en/latest/> and if so, you should migrate to django-q2 <https://django-q2.readthedocs.io/en/master/>. Both typically use memcached as a backend. Settings that control this are typically ``` # Set retry > timeout. Q_CLUSTER = { 'timeout': 300, 'retry': 360, 'save_limit': 100, 'orm': 'default', } ``` and possibly a setting like `'workers': 2,` (default is the CPU count of the system but see <https://django-q2.readthedocs.io/en/master/configure.html#f1>). ``` CACHES = { 'default': { 'BACKEND': 'django.core.cache.backends.memcached.PyLibMCCache', 'LOCATION': '127.0.0.1:11211', } } ``` although the default if not set is ``` CACHES = { "default": { "BACKEND": "django.core.cache.backends.locmem.LocMemCache", } } ``` It is the `'orm': 'default'` setting that says to use Django's CACHES. See <https://django-q2.readthedocs.io/en/master/brokers.html#django-orm>. You can get info about what qcluster is doing with `manage.py qinfo` and monitor things with `manage.py qmemory` and `manage.py qmonitor`. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 week, 4 days

[MM3-users] Re: Can't post to my own list from HyperKitty

by Mark Sapiro

On 4/5/25 13:00, megabrutal--- via Mailman-users wrote: > Hi Everyone, > > I've recently installed Mailman3 and still testing it. I tried to reply to a topic on my own list while also being a superuser from HyperKitty, but I got this error message: > > "This list is moderated, please subscribe to it before posting." Is your login a member of the list? > Then why I even see the archive of the private list? What might be wrong? You can see the private archive because you are logged in as a superuser. > One thing that might confuse the system is that I added a secondary e-mail to my account. I thought it would allow me to post from any of my addresses, but it seems like it's not the case, looks like I can only subscribe with one of the addresses. How did you add that email? When you find yourself at https://example.com/mailman3/users and click Manage, do you see the expected addresses? > It also looks like HyperKitty has trouble matching up the addresses, as it lists 4 participants for the conversation, while 2 of them is my account, the other 2 is my test address. In reality, it should list 2 posters. This is normal. Hyperkitty lists participants by address whether or not the addresses are linked to the same user. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 months

[MM3-users] Help with installing Postorius and Hyperkitty on Ubuntu 19

by andrew.bernard＠gmail.com

I'm new to Mailman. I have a Ubuntu 19 production server. I attempted to get Mailman 3 and the web components going with the system packages, but I encountered a few showstopper errors (such as indexing not working at all) which I know have been fixed in the codebase. To that end I erased my installation, and installed mailman from the gitlab source. That all works much more nicely now and I feel I have a lot more control of the layout of all the files (the various Ubuntu packages smear the parts all over the place, confusingly). Now I want to get Postorius and Hyperkitty going again, independently of Ubuntu packages. I would like to run Postorius and Hyperkitty under one Django project. So I downloaded the git source for mailman_web. I do not know if this is the right way to install. I am partially familiar with Django, but to come to the point, I have no idea once having obtained the source from git how to setup and install the project, where it lives in the filesystem, and so on. Are there any pointers to help in this area? The very nice readthedocs format files for Postorius and Hyperkitty are very silent on basic matters like this, which is not of much help! The git README files also define a new level of brevity. I need some initial hand holding here. If any help is forthcoming, such as links to more full documentation for newbies to Mailman, I would be most grateful.

6 years

[MM3-users] Re: Post-installation documentation?

by Stephen J. Turnbull

David Newman writes: > As for FQDN, is there some reason we shouldn't use the definition from > RFC 1594, section 5.2? For the definition, yes, that's fine. But there's more to it if somebody needs to figure out how Mailman uses the term. One issue is that we don't necessarily follow those definitions exactly, especially when validating. ISTR somebody got in trouble because they had a very unusual (but technically legal) character in an email address. It's a little risky to put implementation details like that in separate documentation rather than chanting "Use the Source, Luke", but on the other hand even if somebody knows where to find the source they may have difficulty reading a regular expression. And in this particular case, the regular expression used to parse the URL accepts almost anything (possibly including Chinese characters and emoji :-) in the FQDN. Another thing we might want to put in such a glossary item would be under what circumstances we query DNS to check it's valid. Doing that for *everything* would be a massive undertaking, of course, but it might be worth trying to add such items when we (core devs) get a question, rather than requiring people to search the archives to research it on their own. And for other contributors like you, if you remember having in issue with a term, eg, not recognizing its significance in an error message, you might add it to the glossary. I'm not sure this is a great idea at all, just throwing things at the wall. Steve

3 years, 6 months

[MM3-users] Re: Messages not going to held queue

by Mail Person

I have it set so that members automatically go to the moderation queue from the Postorius settings. To make sure that wasn't the issue, I also added a test subscriber account to the list and set them manually to have their messages held for moderation. I then set them to "accept immediately" to make sure Postorius settings were taking effect. When "accept immediately" was set, the messages were sent through. When they were set to be held for moderation, the user did not get a moderation email, myself as the moderator did not get a notification, and Postorius did not show them in the held messages queue. As far as logs, in var/log/mailman3 I do not see any logs other than mailman.log, plugins.log and smtp.log. In the SMTP log I can see that the message is getting to mailman: Sep 07 20:10:08 2022 (2837) ('127.0.0.1', 45958) Data: b'MAIL FROM:<test email>' Sep 07 20:10:08 2022 (2837) ('127.0.0.1', 45958) sender: test email Sep 07 20:10:08 2022 (2837) ('127.0.0.1', 45958) Data: b'RCPT TO:<test@domain>' however no action is taken after that. In the cases where the message is sent I there are two actions showing the message going out: Sep 07 20:10:09 2022 (2839) <stuff(a)mail.gmail.com> smtp to test@domain for 2 recips, completed in 0.14289569854736328 seconds Sep 07 20:10:09 2022 (2839) <stuff(a)mail.gmail.com> post to test@domain from testemail, 2969 bytes This leads me to believe the message is being discarded or for some reason not getting to the moderation queue.

2 years, 9 months

[MM3-users] Re: Finding a mailman3 installation description that works

by Abhilash Raj

On Tue, Mar 31, 2020, at 11:28 AM, Andrew Hodgson wrote: > ralf.wiegand(a)tena-sda.org wrote: > > >WE are currently using mailman2. I have the task to setup and install a maiman3 server. Postfix is installed and working. Can anybody point me to a link where the actual installation is described using RHEL 7 or RHEL 8. This will be a >hardened DISA compliant server, so I am trying to avoid installing compilers and tools that are not part of the standard RHEL 7 repos. > > Have you looked at creating a development environment using a Python3 > venv somewhere else (eg another server or container) then copying the > venv out to the production server? Python virtualenvs are really not movable because of the paths that are in there. It is tricky to get that working right, I would caution against doing that. There is a Virtualenv based installation guide at https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst… > > I found the following very useful: > https://wiki.list.org/DOC/Mailman%203%20installation%20experience > > Granted you will need RedHat packages for Python, Postfix and the web > server, but everything else can be installed in the Python virtual > environment and ran from there using the scripts on that site with > minor tweaking. > > Hope this helps. > Andrew. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years, 2 months

[MM3-users] Re: The future is here?

by Jonathan M

On 8 Jan 2021, at 04:18, Stephen J. Turnbull <turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > > Discourse is a different kettle of fish. They concentrate on the much > more straightforward (from a network and interapp communication > configuration standpoint) web service because that's what their users > expect. Mail is a lot more baroque from that standpoint. > > We shouldn't hope to successfully "encourage" hosts to do things our > way. Maybe Mail-in-a-Box is a useful comparator in terms of complexity (though it appears to be less configurable than Discourse, and the software itself is not comparable). Maybe my experience hasn’t been typical. I’ve mainly used a shared server which didn’t have Mailman installed, but of course had email set up. It was relatively easy to install Mailman 2 but impossible to install Mailman 3. I could probably install Mailman 3 on Digital Ocean or similar, but get the feeling that the mail server is the hardest part. If I ever can set aside enough time to get it working I should write the idiot’s guide that I needed. It would be great if there were a “Mailman-in-a-Box” including everything necessary to get Mailman working from scratch on a VPS (in addition to the primary, flexible way that allows experts to use Mailman 3 according to their personal preference). I will look into Abhilash’s Docker container setup. I think the first time I saw that I didn’t know he was “maxking” and assumed it was a third-party thing that would likely be abandoned. Best wishes Jonathan

4 years, 5 months

[MM3-users] Re: Can login at /admin, but cannot login at the account/login page.

by Stephen J. Turnbull

Gonzalo Cardenas writes: > Actually it doesn't let me in to the login page / sign up page (the > HTTP requests hangs until it times out). The URL I'm trying to > access is http://localhost/accounts/login/?next=/mailman3/lists/ or > http://localhost:8002/accounts/signup/?next=/mailman3/lists/ > eventually Nginx returns a "502 Gateway timeout error" The second URL appears to presume Postorius is actually running on port 8002, but this > location / { > proxy_pass http://127.0.0.1:8000; > proxy_set_header Host $host; > proxy_set_header X-Forwarded-For $remote_addr; tells nginx to proxy to port 8000. I don't use nginx or uwsgi myself (I use Apache and mod_wsgi) so I am not very confident. But you need to make sure that all of the configuration files use the same port. I don't remember if any of the webservers suffered from this, but some programs don't map 127.0.0.1 to localhost. If any of the configs specify localhost for the Postorius URI, you could try using 127.0.0.1 instead. If making all these port configurations consistent doesn't do the trick, please post your mailman-web settings.py, uswgi config, and nginx config. You can substitute fake domain names and IP addresses if you're worried about privacy of your configs, but make sure that (1) if the configs specify several IPs or several domain names, you distinguish them in your fake versions, and (2) always substitute the same fake IP/name for a given real IP/name. Steve

3 years

[MM3-users] Re: About to Install MM3 -- Seeking clarification

by Mark Sapiro

On 1/3/23 00:31, Onyeibo Oku wrote: > > (1) Mailman refuses to resolve to a preferred subdomain. If the > server's domain is "website.tld", I'd like mailman's homepage to be > at "list.website.tld". Mailman insists that I add "website.tld" to > the ALLOWED HOSTS, whereas "lists.website.tld" is already there as an > ALLOWED HOST (same VPS/IP address nonetheless). The result is that > the homepage ends up at "https://website.tld/mailman3/lists" when the > desired url is "https://lists.website.tld/mailman3/lists". This is a > conflict because the main domain is intended for another service. How > do I approach this? This is all configured in your web server. It needs to proxy requests for lists.website.tld to gunicorn and depending on the web server, may need more. E.g. see https://docs.mailman3.org/en/latest/install/virtualenv.html#nginx-configura… for nginx. > (2) See the traceback below: > ERROR 2023-01-03 07:40:32,078 27926 django.request Internal Server > Error: /mailman3/lists/ Traceback (most recent call last): ... > "/opt/mailman/venv/lib64/python3.10/site-packages/django/db/models/query.py", > line 650, in get raise self.model.DoesNotExist( > django.contrib.sites.models.Site.DoesNotExist: Site matching query does > not exist. > > It seems a migration is missing. How should I approach this? Set SITE_ID = 0 in your Django settings. Also see https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 5 months

[MM3-users] Re: Process on migrating mailman

by Odhiambo Washington

On Thu, Jan 18, 2024 at 8:49 AM Mark Labeste <marqueejen13(a)gmail.com> wrote: > Any suggestion on how to migrate mailing list and archirve with diffirent > server and domain. For the mailing list from sample.domain1.example.com > to sample.domain2.example.com > > Old Mailing list > Mailman Core Version GNU Mailman 3.3.5 (Tom Sawyer) > Mailman Core API Version 3.1 > Mailman Core Python Version 3.6.8 (default, Sep 26 2019, 11:57:09) > [GCC 4.8.5 20150623 (Red Hat 4.8.5-39)] > Domain Domain1.example.com > > New Mailing list > Mailman Core Version GNU Mailman 3.3.9 (Tom Sawyer) > Mailman Core API Version 3.1 > Mailman Core Python Version 3.9.18 (main, Sep 22 2023, 17:58:34) [GCC > 8.5.0 20210514 (Red Hat 8.5.0-20)] > Domain domain2.example.com How many lists? How big are the archives? Looking at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…, it seems like it's not a trivial exercise. However, I am wondering about the consequences of: 1. dumping the DBs and doing 's/DOMAIN1/DOMAIN2/g' in the dumps, then re-importing 2. editing settings.py and webserver config to reflect the DOMAIN2 3. reconfiguring your MTA to handle list mails using the DOMAIN2 I am imagining a virtualenv type of installation. Is there somewhere in the data where the DOMAIN1 is hardcoded in a way that it cannot be replaced by a text editor? @Mark Sapiro <mark(a)msapiro.net> ? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 4 months

[MM3-users] Re: Dealing with email bounces from web signups

by Hans-Martin Mosner

Am 17.03.22 um 03:40 schrieb Mark Sapiro: > > > The issue of more concern to me is when the subscription uses a deliverable address. The owner of that address > receives this unwanted confirmation email which is bad enough, but then sometimes reports it as spam to her ISP which > affects my server's reputation. But, so far, I don't do anything about that either. > As I'm a mail admin for a server whose users get lots of those misguided mails I'd say that the vast majority of them are not from mailing list signups but from web contact forms which automatically respond to entered contact requests with "Dear Polly liked your profile https://bit.ly/crap". I regularly report these as spam and expect website owners to disable automatic mails from such forms (I also advise our users who have their own websites to disable that, and strictly filter it on outgoing mail). I would probably also report these as spam when coming from mailing lists subscription requests, and I would likewise advise you to send subscription responses only after a moderator checks and releases the subscription request. It can still happen that you send out somethin to someone who didn't subscribe, but you should be able to reduce the numbers significantly. I know this causes extra moderator work because you don't get the automated pre-filtering for deliverable addresses, so this is something where you need to weigh pros and cons for your particular situation. Cheers, Hans-Martin

3 years, 2 months

[MM3-users] Mailman web interface / uwsgi

by Jan Eden

Hi, I followed the installation instructions at https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst…, which thankfully shielded me from configuring the Django applications for the web interface manually. All Django applications (postorius, hyperkitty, haystack etc) are loaded via mailman_web/settings/base.py, which is in turn referenced by the top-level settings file in /etc/mailman3. uwsgi is linked to mailman_web via /etc/mailman3/uwsgi.ini. So far, so good. I do not want to dive into the interaction between the various components and just want to switch from a http socket (http-socket = 0.0.0.0:8000) to a file socket (socket = /opt/mailman/mm/var/mailman.sock). After making this change in /etc/mailman3/uwsgi.ini, I applied it in the nginx proxy configuration proxy_pass http://127.0.0.1:8000; → proxy_pass http://unix:/opt/mailman/mm/var/mailman.sock; and received an error message (as expected): 2022/11/25 18:39:12 [error] 2978606#2978606: *3 upstream prematurely closed connection while reading response header from upstream, client: 37.201.155.65, server: lists.eden.one, request: "GET /mailman3/lists/ HTTP/2.0", upstream: "http://unix:/opt/mailman/mm/var/mailman.sock:/mailman3/lists/", host: "lists.eden.one" There are obviously a couple of places where the http-socket on port 8000 is referenced (e.g. mailman_web/settings/mailman.py, /opt/mailman/mm/hyperkitty.cfg). Is there an overview of the required changes when using a different (file) socket? Related question: My own (much simpler) Django applications use the following (e.g. in mysite_nginx.conf): upstream django { server unix:///private/tmp/mysite.sock; } location / { uwsgi_pass django; } instead of the "http://unix:/..." notation I tried for Mailman above. Is there any difference between the upstream/uwsgi_pass combination and the proxy_pass variant? Thanks, Jan

2 years, 6 months

[MM3-users] Re: Welcome message issue

by Mark Sapiro

On 10/22/24 13:34, Mohsen Masoudfar wrote: > Good afternoon > I have an issue with welcome message. > > A list owner is requesting to update the welcome message for only one of their lists. They are requesting to change the default text and insert additional URLs pointing to sites related to their list. > I know there is a URI field that you may include a web page. But this doesn't work and gets ignored. If you are referring to the `uri` field in the template table this should work if the `name` is `list:user:notice:welcome` and the `context` is the list_id of the target list. > - is there a mailman cli option to update the default template for a single list? There is no specific cli option. A site admin can address this by creating a custom template at Mailman's var/templates/lists/LIST_ID/LC/list:user:notice:welcome.txt where LIST_ID is the desired lists ID and LC is the preferred language. The list owner can create a custom list:user:notice:welcome template via Postorius. > > I couldn't find it in WUI. Do you mean GUI? If so, since at least Postorius 1.2.0 there has been a `Templates` choice in the second level nav in the lists view. > I reviewed all parameters and variables of the list and couldn't find one that might be related to it. > > We are running an old version of Mailman 3. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 months, 2 weeks

[MM3-users] Ann: Mailman Core 3.3.5b1 is out

by Abhilash Raj

Hello Everyone, I am pleased to announce that Mailman Core 3.3.5b1 is now out. It is a pre-release for 3.3.5, which is slated to come out in 3 weeks from now. I am planning for a 2 week beta period, after which I'll release the first RC and then stable a week after. Right now I am not planning to release a second beta version, but if there are several changes in Core in the next week or so, then I might. This release includes a lot of bug fixes and some new features. It also includes a security enhancement that improves the authentication of REST API by adding resistance to some timing channel attacks. A full list of changes in this version can be found here[1]. [1]: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS.… We have also made improvements in the i18n workflow and now the email templates are updated from the translated messages in the .po files that we get from Weblate. Documentation for translators is available here[2] if you want to help translate Mailman into your native language. [2]: https://docs.mailman3.org/en/latest/translation.html This is a pre-release version, if you want to test it with your setup, you can install it using: $ pip install --pre mailman==3.3.5b1 If you want to download a release tarball, you can do so from here: https://pypi.org/project/mailman/3.3.5b1/#files This release received a lot of contributions from community, which I am really happy about! I'd like to thank everyone who made this release possible! -- thanks, Abhilash Raj (maxking)

3 years, 9 months

[MM3-users] Re: nginx configuration on a multitasking server

by Mark Sapiro

On 12/22/21 9:22 PM, David Newman wrote: > > On my system that file lives here: > > /opt/mailman/venv/lib/python3.9/site-packages/mailman_web/urls.py It appears that you have installed following https://docs.mailman3.org/en/latest/install/virtualenv.html#virtualenv-inst… and in that case, this is the file. > But the error persists after this addition and restarting MM3 and > mailmanweb and nginx: > > url(r'^mailman/', include('postorius.urls')), > > There is this 404 error in uwsgi.log: > > [pid: 73356|app: 0|req: 3/3] 127.0.0.1 () {48 vars in 1544 bytes} [Wed > Dec 22 21:13:48 2021] GET /mailman/admindb/listname => generated 5328 > bytes in 14 msecs (HTTP/1.0 404) 6 headers in 197 bytes (1 switches on > core 0) However, that's not the issue. You originally reported and I didn't look closely enough: > Update: The above worked fine until MM3 informed a list owner of pending > subscription requests, with a URL like this: > > https://lists.example.com/mailman/admindb/listname > > and that URL returned a 404 error. That URL is from a Mailman 2.1 installation. Are you still running Mailman 2.1? If so, you need to support Mailman 2.1's CGIs. In Apache, this would be something like ScriptAlias /mailman/ /parh/to/mailman/cgi-bin/ but nginx doesn't do that. You would need something like location /mailman/ { proxy_pass <something that can serve Mailman 2.1's CGIs.> } The something could be apache or ?? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: Missing Base64 encoding from control message reply

by Mark Sapiro

On 9/22/23 09:32, Stephen J. Turnbull wrote: > > To diagnose, we really need to see that in context of the raw message > as received by the user. It was posted. The issue is the message declares Content-Transfer-Encoding: base64 but the body is not base64 encoded so the MUA tries to base64 decode it and even though that's invalid, produces the garbled output. > The only other thing I can think of is it might have something to do > with your internationalization settings. What is the default language > of the list? (This is available in Postorius.) Have you changed the > default encoding for English on your site? (I think you need to look > in mailman.cfg for this.) What is the default language of the site? I note that the message also declares Content-Type: text/plain; charset="utf-8" and Python's email package will base64 encode utf-8 message bodies. I also note that the messages Subject: is RFC 2047 encoded as utf-8. These tell me that the user's preferred_language if set or the list's preferred_language is not English or the charset for English is changed to utf-8. I tried to duplicate this in a test installation with the charset for English set to utf-8, but I get a similar response but with Subject: =?utf-8?q?The_results_of_your_email_commands?= and Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 8 months

[MM3-users] Re: [Mailman-Users] Mailman 3 on Ubuntu 18.04

by Odhiambo Washington

On Sun, 9 Dec 2018 at 22:37, Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/9/18 10:14 AM, Odhiambo Washington wrote: > > > > In my quest to run Mailman3, I obtained a VM running Ubuntu 18.04 and > > started on getting to run Mailman3. > > I found this link -> https://github.com/iomarmochtar/mailman3_ei > > It has instructions which looked fairly simple to get Mailman3 installed. > > However, I did encounter some hitches since the script is not meant for > > Ubuntu. > > > First, a more appropriate list for Mailman 3 is > mailman-users(a)mailman3.org > <https://lists.mailman3.org/mailman3/lists/mailman-users@mailman3.org/>. > I am shifting to that list, after this. > > Also, we find it very difficult to address issues arising from third > party packages and how-tos. See <https://wiki.list.org/x/12812344>. > > And, there is a Mailman 3 package for Debian/Ubuntu > > apt install mailman3-full > In all my searching, I never found this in any documentation. I must have been searching in the wild, or my FreeBSD-mindedness got me stuck to containers and VENVs. > > With a few runs and observing the logs and modifying the script at every > > step it encountered and error, I finally managed to install Mailman3. It > > seems this is what you guys call a virtual environment in the Linux > world? > > :-) > > > I think the virtual environment in this case is a Python thing, not a > Linux thing. > I agree with you on that. > <snip> > > > Much of what I snipped is specific to > <https://github.com/iomarmochtar/mailman3_ei>, the details of which I'm > not interested in learning. > That is fine. I have put it aside for now. > > > >>From this point now is where I need help - serious help in smoothening > > things up and getting to understand these venv stuff! > > > > So I did run 'service mailman3 start' but this seems to be waiting for > too > > long to drop me back into the CLI. > > I also run 'systemctl start supervisord' and that seems to work. What I > am > > not sure is whether 'systemctl stop supervisord' actually does what it is > > expected to do because after I execute it, I still see processes running > > that I think are related. > > > > So far, I have been able to access the webUI on my VM using > > https://N.N.N.N:9090 > > I created a domain. > > But when I create a test list, I get an error - and I do not have a clue > > which logfile would have the error details - nginx or mailman... (I am > 100% > > new to nginx). > > > The nginx logs generally aren't too useful. Both Mailman core and Django > write logs. Core's log is probably in var/log/mailman.log where is > defined in mailman.cfg as var_dir. Django's log is defined in Django's > settings in the LOGGING setting. > Which file contains Django's settings? > > So now, I am stuck at: > > 1. Creating the mailing list > > 2. Getting to know whether the archiver is installed and running > > 3. Knowing is there are cron jobs to be running (Mailman2 type of > thinking!) > > > See > <http://docs.mailman3.org/en/latest/config-core.html#configuring-cron-jobs > > > and > < > http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required > > > Great to see that. I'll read and see if I make heads or tails of the writeup. > > Ultimately I need to figure out: > > 1. How the mailman queue runners are started and stopped > > mailman start > Why not systemctl mailman start?? Just wondering, as that is what I am seeing is common in Ubuntu. Does this make the components start after a reboot? > > 2. Migrate s few lists from Mailman2 to this Mailman3 > > mailman import21 > <django management> hyperkitty_import > Please show me where that is documented. I have to pull my lists from an old machine to this new one. > > 3. Mailman3 should use MySQL storage and Exim4 as the MTA (I have > > configured these bits in mailman.cfg) > > > You also need to configure MySQL in Django. See the DATABASES setting in > the Django settings. > So, when you talk about Django settings, you are referring to mailman.cfg file??? :-) I have spent all my weekend till now, trying to figure all this out. Life seems a little easier with mm2.x .... Thank you. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

6 years, 5 months

[MM3-users] mailman 2.1 or 3.0 (or another MLM)

by Stephen J. Turnbull

nate writes: > It's "just worked" over the years, no issues. I have been using > Linux since 1996, not a newbie here. If so, and you're familiar with Docker (obviously not the same thing, but maybe? ;-), you might find the containerized version provided by Abhilash (which is usually quite up to date) closer to a turnkey installation. I use the venv approach myself (more because developer than out of principle), so I'm not really familiar with the container distribution, but from traffic on the list I get the impression that most of the troubles have to do with networking in containers, rather than configuring Django and WSGI hosts. I appreciate the detailed description of what you did and didn't find in the docs. The docs are weak on administration, we admit, and we we get some of those round tuits .... > Or is there a better MLM for simple use cases? I used Majordomo > back in the 90s and was happy to get onto Mailman from > that. Something similar to Mailman 2.1 in features/functionality. It's been years since we had an answer to that question. Mark might have more to say, but the last time we were challenged on this, the rival was Sympa, and the conclusion I came to was that the use cases are different. Depending on your Linux distro, and your attitude to risk, Python 2 plus Mailman 2 in a container, VM, or even a dedicated host in the DMZ or outside the firewall might be a reasonable solution. Steve

3 years, 4 months

[MM3-users] Re: Mailman3 not working following distribution upgrade from Debian 10 to 11.

by Mark Sapiro

On 2/11/22 13:32, gordon(a)dickens.com wrote: > Hi Mark, > > I think that I found a hint as to the cause of my problems. > > I changed the apache2 LogLevel to debug and the following was then generated in /var/log/apache2/ssl_error_log: > > [Fri Feb 11 15:40:18.325675 2022] [core:debug] [pid 3982011] core.c(5280): (95)Operation not supported: [remote /var/lib/mailman3/web/static/uwsgi.sock:12150] AH00139: apr_socket_opt_set(APR_TCP_NODELAY) > > Apparently, there appears to be a problem with uwsgi.sock. > > My uwsgi.ini file has the following: > > uwsgi-socket = /var/lib/mailman3/web/static/uwsgi.sock > > Also, my apache.conf for mailman3 has the followig: > > ProxyPass /mailman3 unix:/var/lib/mailman3/web/static/uwsgi.sock|uwsgi://localhost > > So do you see a problem in my configuration files that would cause the Operation Not Supported error with the uwsgi.sock file. I don't use uWSGI and have no experience with it at all, however here are some things to consider: For Apache to support uwsgi protocol you may need ``` a2enmod mod_proxy_uwsgi ``` However, I would suggest you use http rather than a unix socket. In your uwsgi.ini file instead of ``` uwsgi-socket = /var/lib/mailman3/web/static/uwsgi.sock ``` which requires Apache support for uwsgi protocol, put ``` http-socket = 0.0.0.0:8000 ``` which will tell uwsgi to listen on TCP port 8000 and in Apache, use ``` ProxyPass /mailman3 http://127.0.0.1:8000 ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: Message is received but is not sent out. Another, similar message, is processed fine.

by Allan Hansen

Thank you, Mark. I see this in mailman.log. I had looked there for her email address, but it does not appear, so I moved on to the smtp.log. In Jun 26 17:18:11 2023 (1243315) ACCEPT: ^M <CH3PR12MB82593801A1DF2E329E977046BE27A(a)CH3PR12MB8259.namprd12.prod.outlook.com> Jun 26 17:18:11 2023 (1243319) Uncaught runner exception: unknown encoding: iso-8859-8-i Jun 26 17:18:11 2023 (1243319) Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/core/runner.py", line 179, in _one_iteration self._process_one_file(msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/core/runner.py", line 272, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/runners/pipeline.py", line 37, in _dispose process(mlist, msg, msgdata, pipeline) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/core/pipelines.py", line 53, in process handler.process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/handlers/mime_delete.py", line 382, in process process(mlist, msg, msgdata) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/handlers/mime_delete.py", line 151, in process reset_payload(msg, firstalt) File "/opt/mailman/mm/venv/lib/python3.9/site-packages/mailman/handlers/mime_delete.py", line 202, in reset_payload msg.set_payload(subpart.get_payload(decode=True).decode( LookupError: unknown encoding: iso-8859-8-i Jun 26 17:18:11 2023 (1243319) SHUNTING: 1687825091.8457294+478565324778f2eb6f0fecaeccbd29596edaef53 I also see this in queue/shunt: mailman@list:~/var/queue/shunt$ ls -ltr total 88 -rw-rw---- 1 mailman mailman 7168 Feb 17 23:03 1676703781.903885+fdcba88c680f50a0799c672cd0abe82e4bfe19b3.pck -rw-rw---- 1 mailman mailman 19821 Apr 2 07:08 1680444501.0831451+e110b8c5c20ba3f87c1cea1c5f38e74a6cf8f1c5.pck -rw-rw---- 1 mailman mailman 19489 Jun 18 11:52 1687114364.41209+1684717da96ff76d1ce773a0cf39c5f8b63e9078.pck -rw-rw---- 1 mailman mailman 20274 Jun 18 19:01 1687140067.64057+7f77c1ebca490831f58ef9cfde06109081a4e7d6.pck -rw-rw---- 1 mailman mailman 20085 Jun 26 17:18 1687825091.8457294+478565324778f2eb6f0fecaeccbd29596edaef53.pck The three last entries coincide with the captured messages. Finally, in the captured message source (the last which was Cc'd to me) I do see this: Content-Type: text/plain; charset="iso-8859-8-i" Which matches the complaint in the mailman log. In the message that did get accepted, I see this: Content-Type: text/plain; charset="utf-8" Another difference: The posted message shows Content-Transfer-Encoding: base64 The shunted message shows Content-Transfer-Encoding: quoted-printable It appears that the two messages are, indeed, different, despite the similar looks when rendered. My question thus changes to: a. Should she be doing something special when sending to the lists? b. If not, is my setup in need of change? Yours, Allan On 6/26/23, 20:44, "Mark Sapiro" <mark(a)msapiro.net <mailto:mark@msapiro.net>> wrote: On 6/26/23 8:09 PM, Allan Hansen wrote: > Hi all, > > One of my subscribers is trying to send a message to a list, but it is not being posted. > The smtp.log shows that her first message was posted, but a second message (with 2 retries) was not: > > mailman@list:~/logs$ grep herName smtp.log > Jun 18 11:22:05 2023 (1243316) ('127.0.0.1', 56686) >> b'MAIL FROM:<herName(a)hotmail.com <mailto:herName@hotmail.com>> SIZE=40109' > Jun 18 11:22:05 2023 (1243316) ('127.0.0.1', 56686) sender: herName(a)hotmail.com <mailto:herName@hotmail.com> > Jun 18 11:25:01 2023 (1243318) <CH3PR12MB82593510B90D8F05177C606BBE5EA(a)CH3PR12MB8259.namprd12.prod.outlook.com <mailto:CH3PR12MB82593510B90D8F05177C606BBE5EA@CH3PR12MB8259.namprd12.prod.outlook.com>> post to theList(a)domain.tlc <mailto:theList@domain.tlc> from herName(a)hotmail.com <mailto:herName@hotmail.com>, 40061 bytes > Jun 18 11:52:42 2023 (1243316) ('127.0.0.1', 48448) >> b'MAIL FROM:<herName(a)hotmail.com <mailto:herName@hotmail.com>> SIZE=18343' > Jun 18 11:52:42 2023 (1243316) ('127.0.0.1', 48448) sender: herName(a)hotmail.com <mailto:herName@hotmail.com> > Jun 18 19:01:04 2023 (1243316) ('127.0.0.1', 59550) >> b'MAIL FROM:<herName(a)hotmail.com <mailto:herName@hotmail.com>> SIZE=19123' > Jun 18 19:01:04 2023 (1243316) ('127.0.0.1', 59550) sender: herName(a)hotmail.com <mailto:herName@hotmail.com> > Jun 26 17:18:11 2023 (1243316) ('127.0.0.1', 44732) >> b'MAIL FROM:<herName(a)hotmail.com <mailto:herName@hotmail.com>> SIZE=18930' > Jun 26 17:18:11 2023 (1243316) ('127.0.0.1', 44732) sender: herName(a)hotmail.com <mailto:herName@hotmail.com> > > At the second retry she copied me and I saw nothing untowards in her message. > She's not getting any error return messages and her subscription is OK. > Both messages were multipart/alternative and both contained Hebrew text. > > I told her I'd look at this, but I'm at a loss. smtp.log is not very useful for diagnosing things like this. It only says a message was received, not why it didn't result in a post from the list as in the first case. What's in mailman.log with those timestamps? -- Mark Sapiro <mark(a)msapiro.net <mailto:mark@msapiro.net>> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org <mailto:mailman-users@mailman3.org> To unsubscribe send an email to mailman-users-leave(a)mailman3.org <mailto:mailman-users-leave@mailman3.org> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/> Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org <mailto:mailman-users@mailman3.org>/message/F4K7HYUYSWEKF6LT35UCT3KBJX6GHY4I/ This message sent to hansen(a)rc.org <mailto:hansen@rc.org>

1 year, 11 months

[MM3-users] Re: FW: [Django] ERROR (EXTERNAL IP): Internal Server Error: /user-profile/

by Christian Stalberg

Yes, I have django_mailman3/templatetags/d_gravatar.py in my installation. -----Original Message----- From: Mark Sapiro <mark(a)msapiro.net> Sent: Wednesday, October 13, 2021 5:11 PM To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: FW: [Django] ERROR (EXTERNAL IP): Internal Server Error: /user-profile/ On 10/13/21 3:53 PM, Christian Stalberg via Mailman-users wrote: > Is this anything to be concerned about? It seems like an attempted break-in as I have no user named alekos.pantazis. First, this is a Django user, not a Mailman user. > -----Original Message----- > From: noreply(a)lists.ccalternatives.org > <noreply(a)lists.ccalternatives.org> > Sent: Tuesday, October 12, 2021 7:55 AM > To: csa(a)web-analysts.net > Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: > /user-profile/ > > Internal Server Error: /user-profile/ > > TemplateSyntaxError at /user-profile/ > 'd_gravatar' is not a registered tag library. Must be one of: The d_gravatar template tag was introduced by https://gitlab.com/mailman/django-mailman3/-/merge_requests/114 to support the `HYPERKITTY_ENABLE_GRAVATAR = False` setting for the user profile page. It should be OK. The error you see seems to say that django_mailman3/templates/django_mailman3/profile/profile.py contains {% load gravatar %} at line 3 but there is no django_mailman3/templatetags/d_gravatar.py file. Do you have the django_mailman3/templatetags/d_gravatar.py file in your installation? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

3 years, 7 months

[MM3-users] Re: Clean-up of non-members

by Odhiambo Washington

On Tue, Dec 24, 2024 at 8:39 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/24/24 08:13, Odhiambo Washington via Mailman-users wrote: > > On Mon, Dec 23, 2024 at 8:58 PM Mark Sapiro <mark(a)msapiro.net> wrote: > > > >> I saw that too. Reported > >> https://gitlab.com/mailman/mailman/-/issues/1187 and fixed > >> https://gitlab.com/mailman/mailman/-/merge_requests/1297 > > > > > > It isn't clear to me what I should do to mitigate the error. > > > Apply this patch: > ``` > --- a/src/mailman/commands/cli_members.py > +++ b/src/mailman/commands/cli_members.py > @@ -103,7 +103,12 @@ def display_members(ctx, mlist, role, regular, digest, > if nomail is not None: > if member.delivery_status not in status_types: > continue > - dn = address.display_name or member.user.display_name > + # Non-members may have empty address.display_name and > member.user can > + # be None resulting in AttributeError on member.user.display_name. > + try: > + dn = address.display_name or member.user.display_name > + except AttributeError: > + dn = '' > if email_only or not dn: > print(address.original_email, file=outfp) > else: > ``` > Thank you. Now only if you can help me reconcile the fact that Postorius tells me that I have ``` List Nonmembers (872) ``` ..while the CLI command gives me only 13 addresses. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

5 months, 2 weeks

[MM3-users] Re: From address of subscription notifications

by Abhilash Raj

On Wed, Feb 27, 2019, at 5:46 PM, worik wrote: > On 27/02/19 11:54 AM, Mark Sapiro wrote: > > On 2/26/19 2:11 PM, worik wrote: > >> When I subscribe some body to to a list I on I get a notification that > >> says it comes from changeme(a)example.com > >> > >> As far as I can tell no subscribers are getting mail with that, so this > >> is not a crises. But it is untidy and I cannot find where to change it. > >> > >> SERVE_FROM_DOMAIN is set in the mailman-web/environment section of > >> docker-compose.yaml (I am using the docker distribution...) > > You set it in your mailman.cfg. As it says in mailman/config/schema.cfg > > > > > There is no `mailman/config/schema.cfg` on my system. Should I raise a > issue over at the docker-mailman github? > > I have: > > /opt/mailman/core/mailman-extra.cfg > /opt/mailman/core/var/etc/mailman.cfg > > Should I change it in the second one? /opt/mailman/core/mailman-extra.cfg Change it in this one. > > -- > If not me then who? If not now then when? If not here then where? > So, here I stand, I can do no other > root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand) > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 3 months

[MM3-users] Re: Debian Package Install - Ownership and Permissions

by Andreas Schamanek

On Fri, 7 Apr 2023, at 12:43, Dave Hall via Mailman-users wrote: > On Fri, Apr 7, 2023 at 12:29 PM Odhiambo Washington <odhiambo(a)gmail.com> > wrote: >> On Fri, Apr 7, 2023 at 7:14 PM Dave Hall via Mailman-users < >> mailman-users(a)mailman3.org> wrote: >> It's actually not that difficult to migrate from the Debian >> packages to the virtualenv setup. > It's not an option for me today. I feel you. I am running MM2 und 3 in parallel without problems, I do have a special MTA setup though (Sendmail). Can't speak for Postfix etc.. Ownerships for Mailman 3: # ls -l /etc/mailman3/ total 36 -rw-r--r-- 1 root root 399 2019-06-07 20:03 apache.conf -rw-r----- 1 root list 756 2022-02-24 23:17 mailman-hyperkitty.cfg -rw-r----- 1 list www-data 7672 2023-04-06 13:52 mailman-web.py -rw-r----- 1 root list 11489 2022-02-24 23:16 mailman.cfg -rw-r--r-- 1 root root 2893 2019-06-07 20:03 nginx.conf -rw-r--r-- 1 root root 1511 2019-06-07 20:03 uwsgi.ini /var/log/mailman3/ is list:list 755 /var/log/mailman3/web/ is www-data:www-data 755 /var/lib/mailman3/ is list:list 755 Contents in /var/lib/mailman3/ are list:list 755 except for /var/lib/mailman3/web/ which is all www-data:www-data 755 Make sure to always run any `mailman` as user list. `mailman-web` has the `su` to www-data built-in, it's just: su -s /bin/sh -c "python3 /usr/share/mailman3-web/manage.py $*" www-data So, use mailman-web whereever the docu says manage.py or django_admin --pythonpath /usr/share/mailman3-web -- -- Andreas :-)

2 years, 2 months

[MM3-users] Re: How to fix lists with characters errors?

by Mark Sapiro

On 3/23/24 11:56, Helio Loureiro wrote: > Hi, > it is python 3.10. Problem is... some mailing lists were created long ago, > with python2 something. Most probably 2.5. And the tables on mysql were > set to latin1. This has nothing to do with the data or the charsets/collation in the database. The issue is the locale setting in your python is causing stdout output from the `mailman members` command to be encoded as `latin1` and at least some user's display name contains a `\u0142` (i.e. `ł` character. > That I know. Question now is how to fix this. Any suggestion? What is > the table? I probably can run some script for these specific lists that > have the failure, import data as latim-1, and update back to the table as > utf-8. That's not the issue. The issue is the Python in your venv has sys.stdout.encoding set to latin1, probably for locale reasons. You ca apply this patch ``` --- a/src/mailman/commands/cli_members.py +++ b/src/mailman/commands/cli_members.py @@ -17,6 +17,7 @@ """The 'members' subcommand.""" +import sys import click from mailman.core.i18n import _ @@ -30,6 +31,9 @@ from zope.component import getUtility from zope.interface import implementer +sys.stdout.reconfigure(encoding='utf-8') + + def display_members(ctx, mlist, role, regular, digest, nomail, outfp, email_only, count_only): # Which type of digest recipients should we display? ``` to mailman/commands/cli_members.py to fix the issue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 2 months

[MM3-users] Re: old usernames appearing in mailman.log

by Ken Alker

--On Monday, June 26, 2023 5:03 PM -0700 Mark Sapiro <mark(a)msapiro.net> wrote: > On 6/25/23 10:57 PM, Ken Alker wrote: >> >> I have studied the output, looked at the code lines referenced in the >> Traceback, and I can't figure out the problem (I feel like the sad guy >> on the side of the street with his hood up staring into the engine bay >> with stream pouring out and not knowing what to do next). I did some >> analyses on the log file and determined that there are 71 messages it is >> having problems processing and there are 71 messages "stuck" in >> /opt/mailman/mm/var/archives/hyperkitty/spool/ (and that it has tried to >> process each message about 20 times). > > > Each time there is a new post, it retries all the messages in the spool/ > directory. > > >> Since upgrading to V3.3.8 I've >> not seen new messages get stuck like this (although it's only been >> running smoothly for 24 hours now and there hasn't been much activity). >> But I'm suspecting there was something awry between the conversion from >> V2 to V3 in February and me installing V3.3.8 that caused this (based on >> message time stamps). It is HIGHLY likely these messages are in the >> archiving spool as a result of me unshunting the shunt queue and that >> they are copies of the messages that got delivered to the subscribers >> when I did that... but are now hung up in the archiving process. > > > Are new messages being archived OK. If so, that is a real mystery. It > says mailman-hyperkitty can talk to hyperkitty and archive new messages, > but it can't talk to hyperkitty when attempting to process a queued > message. Ahhh! I had convinced myself that new messages were being archived, but now that you ask, they ARE NOT. I may have said they were at some point, and I apologize if I did. Now I feel less confused. It appears that archiving stopped when I did the migration from "Debian package layout" to "source layout" and upgraded to V3.3.8. I'll bet I munged a config file or two. I was struggling with what to keep from Debian layout and what to bring over from the source install instructions and I haven't gone back through to clean them up. I had previously figured it could not be a configuration issue since some messages were making it into the archive and some were not, but now that I see NONE are making it, this makes the problem less daunting. >> Following is an excerpt from mailman.log. Note that the "first >> section" (from DOCTYPE at top to 404 at bottom) is repeated four times >> (maybe not identical; but similar) (so I did not include it to save >> room) before the Traceback appears. >> >> Jun 25 00:13:04 2023 (386086) No cached copy of the public suffix list >> found >> Jun 25 00:13:04 2023 (386086) ACCEPT: >> <7500f0e2-1ae1-309d-60d7-6e592c7abf7a(a)west.net> >> Jun 25 00:13:04 2023 (386090) HyperKitty failure on >> https://lists.netlojix.com/hyperkitty/api/mailman/urls: > > I just went to that URL and got a 404. This is a serious problem. > https://lists.netlojix.com/hyperkitty/api/ also returns a 404. It should > return some documentation of the API. > > https://lists.netlojix.com/archives/api/ does work and returns the > expected information. > > Your urls.py file probably contains in its urlpatterns list > ``` > re_path(r'^mailman3/', include('postorius.urls')), > re_path(r'^archives/', include('hyperkitty.urls')), > ``` > The simplest fix is to add > ``` > re_path(r'^postorius/', include('postorius.urls')), > re_path(r'^hyperkitty/', include('hyperkitty.urls')), > ``` > to that list. I see many ursl.py files all over the system, but none that appear to be where I'd expect them to be for processing by any executables. Is this a file I should have copied over and edited, or created from scratch and somehow missed? I don't see anything about it in the instructions at <https://docs.mailman3.org/en/latest/install/virtualenv.html> (although I do see a post from last July from someone stating it got missed in the instructions back then). > Another way to fix this is in your mailman-hyperkitty.cfg, you have > ``` > base_url: https://lists.netlojix.com/hyperkitty > ``` > Change that to > ``` > base_url: https://lists.netlojix.com/archives > ``` Done, and restarted both services, but I'm not seeing a difference when I go to <https://lists.netlojix.com/hyperkitty/api/> (I was getting a "Page not found", and still get that). > but it wouldn't hurt to add the `^postorius/` and `^hyperkitty/` patterns > to urls.py anyway.

1 year, 11 months

[MM3-users] Re: problem configuring mailman3 on debian bullseye

by Servizio Informatico U.I.C.I. Sezione territoriale di Brescia

Hi, Thank you. I discovered tha I removed all templates but in the db table the template was not removed. It was pointing to localhost and this was the problem. Thanks to all for help! Roberto Burceni Servizio informatico sezionale Tel. 0302209417 (lunedì e giovedì mattina dalle 9:00 alle 13:00, martedì emercoledì pomeriggio dalle 14:00 alle 18:00 E-mail: servizioinformatico(a)uicibrescia.it Sito web: https://www.uicibrescia.it Il 16/03/23 04:20, Mark Sapiro ha scritto: > On 3/15/23 09:55, Odhiambo Washington wrote: >> On Wed, Mar 15, 2023 at 7:10 PM Servizio Informatico U.I.C.I. Sezione >> territoriale di Brescia <servizioinformatico(a)uicibrescia.it> wrote: >> >>> Hi, >>> >>> I created a template but after some tests I deleted it. >>> >>> Now I created only a standard list without modifying any templates. >>> >>> So they are the standard templates coming with the distribution. I >>> did not >>> change also the language >>> >> Maybe you can start by deleting any templates in postorius_emailtemplate >> table in the DB? > > There shouldn't be any, but if the issue is with accessing postorius > templates, that might make it worse. > > If you want only the system default templates, you could do this > database query to remove any non-defaults: > > DELETE FROM templates; > > That will ensure that you aren't accessing Postorius for any templates. >

2 years, 2 months

[MM3-users] Re: Can't post to my own list from HyperKitty

by MegaBrutal

Mark Sapiro <mark(a)msapiro.net> ezt írta (időpont: 2025. ápr. 9., Sze, 4:49): > ``` > $ mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > > >>> um = getUtility(IUserManager) > >>> usr = um.get_user('user(a)example.com') # any of the three addresses > >>> usr.addresses > prints a list of the 3 addresses. These are indexed as 0, 1, 2 > >>> usr.preferred_address > prints the preferred address. If this is the one you want to delete, do > >>> usr.preferred_address = usr.addresses[n] # n is the index of one > you want > >>> del usr.addresses[n] # n is the index of the address you don't want > >>> usr.addresses.remove(n) # n is the index of the address you don't > want > >>> commit() > ``` Thanks, I successfully removed my unwanted address, so it now doesn't appear anywhere. (Looks like .remove(n) wasn't needed, it only gave an exception, and the settings were saved even without commit() – which is concerning because I would have assumed that I can cancel transactions by omitting it.) However, the problem still persists: I can't post to the list from HyperKitty. In this regard, nothing has changed since my original report. I'm subscribed to the list with my primary, preferred address, which is the GMail address right now.

1 month, 4 weeks

[MM3-users] Re: 404 on fresh install (Debian11)

by Mark Sapiro

On 3/22/23 03:42, thomas--- via Mailman-users wrote: > Hello, > very new to mailman3, I used to manage mailman2 on a Debian 10 server. > The server has been upgraded to Debian 11 and mailman2 disappear… > > I try fresh install of mailman3, prerequisite to data migration, but without success. > If some can help, I would be really greatful. > > <VirtualHost *:80> > ServerName newsletter.mydomain.tld > > Alias /static /var/lib/mailman3/web/static > Alias /favicon.ico /var/lib/mailman3/web/static/postorius/img/favicon.ico > > DocumentRoot /var/lib/mailman3/web/static > <Directory "/var/lib/mailman3/web/static"> > Require all granted You can probably fix the below error by adding options +Indexes here, but see below. > And now I have a 404 answer when consulting my http page. > > When trying to access `/static` sub-path, I get `Cannot serve directory /var/lib/mailman3/web/static/admin/: No matching DirectoryIndex found`. It is unclear to me what is doing a GET of /static/admin/ and why. GETs should by of actual files, e.g., things like /static/admin/css/base.css > I am a bit lost with that. So are we. Questions about the Debian package are better asked of Debian. See https://wiki.list.org/x/12812344 and https://mail.python.org/archives/list/mailman-users@python.org/message/T6LB… We can provide much better help and support if you install via the resources mentioned in the reply at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 2 months

[MM3-users] Re: Rejecting held emails

by Mark Sapiro

On 04/26/2018 08:43 AM, Darren Smith wrote: > > We recently had a phishing message make it through our spam filters and > arrive at a mailing list. The good news is that since it was not from a > list member it was in the held message queue. > > I was able to find the message in the var/messages directory by searching > for a keyword in the subject. However, after rejecting the message from > Postorius, the message doesn't seem to be removed from the var/messages > directory. Do you mean Reject and not Discard? Phishing/Spam should never be "rejected" for backscatter reasons. Reject should only be used for somehow inappropriate posts from known people. > Is this expected behavior? I know that infosec people won't be too happy > about a phishing email sitting around on our disk. (Infosec guys are > notoriously paranoid. :) ) > > Is there some sort of cleanup process that would remove these messages? If > not, does this pose an issue where over time disk usage will creep up? This > could be a pretty significant problem if that is the case. It's not the behavior I would "expect", but it is the way it currently works, and yes, all your concerns are valid. This is <https://gitlab.com/mailman/mailman/issues/257> which I just edited to note that in addition to not removing the pending db entry, the message isn't removed either. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 1 month

[MM3-users] New vulnerability in Hyperkitty master branch

by Abhilash Raj

Hey Everyone, A new vulnerability was reported against Hyperkitty’s git master branch branch which can expose the archives of a private Mailing List through the new Feeds API that was added to Hyperkitty recently to someone who isn't a member or logged-in. Thanks to Ngo Wei Lin for reporting this vulnerability. This bug does not affect any stable released version of Hyperkitty and only affects installations from source (1.3.5b1 version). To differentiate from the vulnerable version, I have bumped the version in master branch to 1.3.5b2, so if you have 1.3.5b1 installed, you should upgrade! The fix for this bug has been committed to master branch[1][2] less than an hour ago as of this writing. If you are using git branches to install Hyperkitty, you can upgrade using the following command: $ pip install --upgrade git+https://gitlab.com/mailman/hyperkitty@master I have also triggered a build for Mailman container images[3] with this changes, so if you are using the rolling container images (which are the only affected ones), then you should upgrade to the latest one when the build[1] finishes (approximately in next 30mins). Do note that this version of rolling release of mailman-web image also includes the fix for the vulnerability announced against Postoruis earlier today. You can verify that you have the fixed version of Hyperkitty in the image by running: $ docker run -it --entrypoint bash maxking/mailman-web:rolling bash-5.0# pip list | grep HyperKitty HyperKitty 1.3.5b2 Ensure that you get 1.3.5b2 version. [1]: https://gitlab.com/mailman/hyperkitty/-/merge_requests/362 [2]: https://gitlab.com/mailman/hyperkitty/-/commit/ed086015acbf66ba377e2af7f6e7… [3]: https://github.com/maxking/docker-mailman/runs/3519658592 -- thanks, Abhilash Raj (maxking)

3 years, 9 months

[MM3-users] Re: Using REST with CLI using curl .... help needed

by Mark Sapiro

On 2/24/22 18:21, chucka(a)blackforest-co.com wrote: > I have this working: > > #!/bin/bash > H="http://lists.mysite.org/admin.cgi/newsletter-mysite.org/members" > case $1 in > 'add') curl "$H/add?subscribees=$2&adminpw=verysecret" ;; > 'del') curl "$H/del?subscribees=$2&adminpw=verysecret" ;; > esac > > and scan the return for "Successfully [Un]subscribed" Since the above is MM 2.1 I'm assuming you are asking how to do the above in MM 3 via REST. Here are some examples: To add a single user curl -urestadmin:restpass \ --request POST \ -H 'Content-Type: application/json' \ --data-binary '{"list_id": "list.example.com", "subscriber": "user(a)example.net", "display_name": "Joe User", "pre_verified": true, "pre_confirmed": true, "pre_approved": true}' \ http://localhost:8001/3.1/members Response is empty or a JSON object describing the error. To delete a single user: curl -urestadmin:restpass \ --request DELETE \ http://localhost:8001/3.1/lists/list.example.com/member/user@example.net Response as above To delete a list of users: curl -urestadmin:restpass \ --request DELETE \ -H 'Content-Type: application/json' \ --data-binary '{"emails": ["user(a)example.net","other(a)example.org"]}' \ http://localhost:8001/3.1/lists/list.example.com/roster/member Response is a JSON object similar to {"user(a)example.net": true, "other(a)example.org": false, "http_etag": "\"...\""} where success or failure is indicated by a true or false value for each address or a JSON object describing the error if any. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: Cron Error: <mailman@gw> /opt/mailman/mm/bin/django-admin runjobs monthly

by Odhiambo Washington

On Wed, Feb 1, 2023 at 8:31 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 1/31/23 23:33, Odhiambo Washington wrote: > > Is this a race condition? > > > > <CUT> > > ERROR OCCURED IN JOB: update_and_clean_index (APP: hyperkitty) > > Traceback (most recent call last): > > File > > > "/opt/mailman/mm/venv/lib/python3.9/site-packages/django_extensions/management/commands/runjobs.py", > > line 40, in runjobs > > job().execute() > > File > > > "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/jobs/update_and_clean_index.py", > > line 37, in execute > > run_with_lock(update_index, remove=True) > > File > > > "/opt/mailman/mm/venv/lib/python3.9/site-packages/hyperkitty/lib/utils.py", > > line 181, in run_with_lock > > log.exception("Failed to update the fulltext index: %s", e) > > File > > > "/opt/mailman/mm/venv/lib/python3.9/site-packages/flufl/lock/_lockfile.py", > > line 470, in __exit__ > > self.unlock() > > File > > > "/opt/mailman/mm/venv/lib/python3.9/site-packages/flufl/lock/_lockfile.py", > > line 420, in unlock > > raise NotLockedError('Already unlocked') > > flufl.lock._lockfile.NotLockedError: Already unlocked > > <CUT> > > > Yes, it is a race between the monthly hyperkitty update_and_clean_index > job and the hourly hyperkitty update_index job > Okay. This is a bit off from my understanding. What is the cause and how do I mitigate it? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 years, 4 months

[MM3-users] Re: Sudden increase in "***UNCHECKED***" in email subjects

by Dave Clements

Hi Peter and Mark, Thanks for the insight and fixes. We (we being Nate who is also on this list) think it was a lack of virtual memory on the server. This crashed ClamAV and it could not restart. Thus our mail really was unchecked. Restarting processes and cleaning up some things has fixed this. Cheers, Dave C On Sun, Jul 19, 2020 at 4:07 PM Peter Adebahr via Mailman-users < mailman-users(a)mailman3.org> wrote: > On 7/18/20 7:46 PM, Mark Sapiro wrote: > > On 7/18/20 9:30 AM, Dave Clements wrote: > >> Hi all, > >> > >> I have just noticed a big jump in the number of emails going out with > >> "***UNCHECKED***" added to the subject line. > > > > > > This does not come from Mailman. Some milter or other process in your > > MTA or elsewhere in the delivery chain is adding this to the Subject: > > > > Hi Dave, > > I had experienced the same symptom a while ago. For me, it was amavis > doing this. This behaviour could be corrected by adding this line to > amavisd.conf: > > > # $undecipherable_subject_tag = '[UNCHECKED] '; # undef disables it > $undecipherable_subject_tag = undef; > # > > Hope it helps :) > > Best regards, > Peter > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- https://bcc2020.github.io/ https://galaxyproject.org/

4 years, 10 months

[MM3-users] Re: Hyperkitty performance problem

by monochromec

Thanks for your input and happy new year to you! The logs set debug level prove to be inconclusive: the runner is handing the message over to the archive runner which in turn forwards to the message to HyperKitty. HyperKitty, not checking if a message with the same ML name and msgid is already present in the DB forwards this to Postgres for storage. The following questions remain to further the RCA: - How to obtain additional logging information beyond the settings outlined below [1]? - Why does the archive runner forward a message to HyperKitty if it's already done this in the past (or is this another try if the message hasn't been archived successfully - how do I check this from the archive runner's perspective if the archiver only logs the entry "HyperKitty archived message <msgid> to the HyperKitty REST URL"? - Any additional insights you might be able to share (additional logging configuration, etc.) is greatly appreciated! [1] mailman.cfg excerpt: [runner.pipeline] instances: 4 [runner.out] instances: 1 [logging.smtp] #level: debug [loggging.database] #level: debug [logging.runner] #level: debug [logging.pipeline] level: debug qualname: pipeline propagate: 0 [logging.lmtp] level: debug path: lmtp.log # [logging.archiver] level: debug [logging.mischief] #level: debug [logging.plugins] #level: debug mailman-web.py excerpt: LOGGING = { 'version': 1, 'loggers': { 'hyperkitty': { 'level': 'DEBUG', 'propagate': True } } } The GitLab issue you mentioned I raised due to my incorrect configuration of the # of runner instances was due to the assumption that I suspected a single pipeline runner might not be sufficient with the load and hence my attempt at increasing this.

5 months, 1 week

[MM3-users] Re: MM3.1 templates

by Abhilash Raj

Hi Matt, On Tue, Jul 18, 2017, at 07:25 AM, Matt Richards wrote: > I've managed, to setup MM3.1 using the docker images from > http://github.com/maxking/docker-mailman. I would like to start > customizing > the templates MM3.1 uses for the footer and confirmation emails. Is there > any mailman site admin or list admin documentation on how to customize > email templates in MM3.1? Not yet, we are still working on perfecting the Installation Guide and other configuration related documentation for Mailman 3. For now, you might have to use command line to do these changes. Templates should exist inside the `$var/templates/<language_code>/` where $var is the var directory for Mailman Core. If you are using the container images, it should be at `/opt/mailman/core/var/`. The templates are named as the naming scheme mentioned in the documentation[1] and ending with a `.txt`. If you place those files there, it should be able to override the default templates that exist in the mailman. [1]: https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/templates.ht… > I've found this template doc at > https://gitlab.com/mailman/mailman/tree/master/src/mailman/rest/docs, but > I'm not clear how this works.. and it appears postorius doesn't have > template support yet? I am new to python and django.. That is correct, you can set the URI in the Postorius interface, but there is no way to actually write the templates in Postorius right now. > -- > --Matt > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ Hope that helps! -- thanks, Abhilash Raj

7 years, 10 months

[MM3-users] Re: mailman.log file owned by 'list' user

by Odhiambo Washington

On Sun, Jan 8, 2023 at 1:29 AM Mike Wertheim <mike.wertheim(a)gmail.com> wrote: > I'm on Debian 11, trying to troubleshoot an installation of Mailman 3.3.3 > that was done by someone else. > > Mailman is running as a non-privileged (non-root) user called 'xyz'. On the > day that Mailman was installed, that non-privileged 'xyz' user was able to > execute mailman commands successfully to create, view and modify lists. > > A couple of days later, when the 'xyz' user tried running those same > mailman commands, they failed with this error: PermissionError: [Errno 13] > Permission denied: '/var/log/mailman3/mailman.log' > > Doing "ls -l" on the file /var/log/mailman3/mailman.log showed this: > -rw-r----- 1 list list 0 Jan 6 00:00 /var/log/mailman3/mailman.log > > When I did a 'ps' command, I saw that all of the mailman processes are > running as user 'xyz'. No processes were running as the user 'list'. > > It seems that some process is rotating the mailman.log file at midnight, > and the newly-created mailman.log is being owned by user 'list'. > > Can anyone explain why this is happening, and how to fix it? > The easiest way to NOT FACE such problems is to run Mailman3 in a virtualenv. You will have peace after you migrate to a virtualenv. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 years, 5 months

[MM3-users] Re: 404 on fresh install (Debian11)

by Jeremy Stanley

On 2023-03-23 09:07:02 -0700 (-0700), Mark Sapiro wrote: [...] > bookworm (testing) and sid (unstable) do have current versions of > Mailman core and django-mailman3 and possibly mailman3-web > 0+20200530-2.1 has current Postorius and HyperKitty, but those are > generally not the Debian packages that most users would install. And those will also become out of date over time, because Debian is a stable server distribution so intentionally freezes the versions of software it supplies and backports only critical/security fixes to those increasingly outdated versions when warranted. Basically it's a question of whether users value stability with a bit of security support over newest versions of software and new features. The upstream Mailman packages on PyPI (and container images) cater to users who want the latest versions of the software, packages in stable server distros like Debian cater to users who want to safely go years between behavior changes in software. Both are valid choices, it just comes down to the user's specific situation. That said, when you have trouble with the packaged versions of software in Debian, the expectation is that you ask on Debian mailing lists and possibly report bugs in the Debian bug tracker, rather than burdening upstream software maintainers with details that might be specific to choices or mistakes in Debian's packages. The package maintainers in Debian generally forward bug reports upstream if they determine the issue you've encountered isn't related to how it's been packaged, isn't already fixed upstream (in which case they might backport the fix), et cetera. -- Jeremy Stanley

2 years, 2 months

[MM3-users] Re: Installing mailman 3

by Rafael Mora

my mailman.cfg file is: # AUTOMATICALLY GENERATED BY MAILMAN ON 2017-07-16 20:44:24 UTC # # This is your GNU Mailman 3 configuration file. You can edit this file to # configure Mailman to your needs, and Mailman will never overwrite it. # Additional configuration information is available here: # # http://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html # # For example, uncomment the following lines to run Mailman in developer mode. # # [devmode] # enabled: yes # recipient: your.address(a)your.domain #[mailman] #layout: fhs [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 127.0.0.1 lmtp_port: 8024 smtp_host: localhost smtp_port: 25 configuration: python:mailman.config.postfix my mailman.config.postfix file is: [postfix] transport_file_type: regex are they ok? El mar., 1 ago. 2017 a las 15:10, Mark Sapiro (<mark(a)msapiro.net>) escribió: > On 8/1/17 12:52 PM, Rafael Mora wrote: > > I made a change for test purpose on the mailman.cfg file and I got this: > > > > > > (env) [mailman@localhost etc]$ mailman restart > > Restarting the Mailman runners > > PID unreadable in: /var/lib/mailman/var/etc/var/master.pid > > [Errno 2] No such file or directory: > > '/var/lib/mailman/var/etc/var/master.pid' > > Is the master even running? > > > > How do I solve this? > > > Try > > mailman stop > mailman start > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Atentamente / Best Regards Ing. Rafael Mora

7 years, 10 months

[MM3-users] Re: Member Issue Discovered

by Stephen J. Turnbull

Victoriano Giralt writes: > El vie, 23-10-2020 a las 08:19 -0700, Mark Sapiro escribió: > > > > This would be more difficult for Postorius/Hyperkitty because those > > users are Django users, but that isn't an issue for Affinity. > > > > All of a sudden, an idea has dawned on me ... Wouldn't it be possible for > Postorius/Hyperkitty, both Django applications, to use Mailman core user > model as their User model? It is just a setting for Django > (AUTH_USER_MODEL). I find the "just a setting" claim a bit implausible. I suspect a certain amount of replumbing of Postorius and HyperKitty will be necessary to get it to work. Most important, the "AUTH_" is pretty scary. Mailman core has *no* authentication built in. It is assumed to be firewalled off from the rest of the world with only access from Postorius and HyperKitty permitted. Can you expand on how hard it would be to do this? Remember that some Mailman instances are either big targets (eg, Apple) or require good security for content reasons (lists for doctors' patient support groups, domestic violence support groups). This is not a great authn/authz model in the modern Internet, but as far as I can see changing it is going to be quite a lot of work, and none of us are authentication specialists (although Abhilash did study security, I don't think he specialized in authentication tech) -- providing reasonably reliable and secure authentication services, especially "social auth" (OpenAuth, OpenID etc) is an important reason we went with Django in the first place. Steve

4 years, 7 months

[MM3-users] Re: hyperkitty threads by month question

by Bryan Fields

On 7/25/24 7:04 PM, Mark Sapiro wrote: > On 7/25/24 11:20, Bryan Fields wrote: >> When this happens, I get an email error below. > > > This is really wierd. See below. > >> line 88, in reverse >> return resolver._reverse_with_prefix(view, prefix, *args, **kwargs) >> File >> "/opt/mailman/venv/lib/python3.10/site-packages/django/urls/resolvers.py", line 828, in _reverse_with_prefix >> raise NoReverseMatch(msg) >> >> Exception Type: NoReverseMatch at >> /archives/list/nanog(a)nanog-mm3.keekles.org/ >> Exception Value: Reverse for 'hk_archives_with_month' with keyword >> arguments '{'year': 999, 'mlist_fqdn': 'nanog(a)nanog-mm3.keekles.org', >> 'month': 12}' not found. 2 pattern(s) tried: >> ['archives/list/(?P<mlist_fqdn>[^/@]+@[^/@]+)/(?P<year>\\d{4})/(?P<month>\\d\\d?)/$', 'hyperkitty/list/(?P<mlist_fqdn>[^/@]+@[^/@]+)/(?P<year>\\d{4})/(?P<month>\\d\\d?)/$'] >> Raised during: hyperkitty.views.mlist.overview > > > It appears to be trying to get the threads for December, 999. > > What do these queries show? > > SELECT * FROM hyperkitty_thread WHERE EXTRACT(year FROM date_active) < 1000; > > SELECT id FROM hyperkitty_email WHERE EXTRACT(year FROM date) < 1000; mailman=> \c mailmanweb You are now connected to database "mailmanweb" as user "mailman". mailmanweb=> SELECT * FROM hyperkitty_thread WHERE EXTRACT(year FROM date_active) < 1000; id | thread_id | date_active | category_id | mailinglist_id | starting_email_id -------+----------------------------------+------------------------+-------------+----------------+------------------- 35670 | GHLCKUC7TDEBAI27SKRQN5PWX3TGB26Q | 0102-04-15 20:06:12+00 | | 3 | 150555 (1 row) mailmanweb=> SELECT id FROM hyperkitty_email WHERE EXTRACT(year FROM date) < 1000; id -------- 136872 150555 (2 rows) Does this mean it imported archives with an invalid date somehow? Thanks, -- Bryan Fields 727-409-1194 - Voice http://bryanfields.net

10 months, 2 weeks

[MM3-users] Re: disabling social login

by Abhilash Raj

On Mon, Nov 6, 2017, at 10:26 AM, Simon Hanna wrote: > On 11/06/2017 07:22 PM, Dmitry Makovey wrote: > > Hi, I'm trying to disable social login and running into troubles > > stepping on it's remnants all over the place. What's the proper sequence > > for disabling social login in MM3 install? > comment out 'allauth.socialaccount' and all social providers in the > INSTALLED_APPS in your settings.py This apparently doesn't work, Hyperkitty apparently depends on this to do some stuff. I haven't dug up in there, but the migrations would break if we remove this from INSTALLED_APPS. Instead, please let the 'allauth.socialaccount' be there, along with 'allauth.account' and 'allauth' and everything else related to allauth should be removed. It looks something like this: ```` INSTALLED_APPS = ( 'hyperkitty', 'postorius', 'django_mailman3', # Uncomment the next line to enable the admin: 'django.contrib.admin', # Uncomment the next line to enable admin documentation: # 'django.contrib.admindocs', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'paintstore', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', ) ``` I tested this works, see [1]. [1]: https://lists.araj.me/postorius/lists/ > They shouldn't be enabled by default in the first place I guess, since > pretty much all of them require further setup in order to work > properly... > > How are you running MM3? > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ -- Abhilash Raj maxking(a)asynchronous.in

7 years, 7 months

[MM3-users] Re: External MTA incoming mail: configuration

by Roland Giesler

On 2024/08/01 10:09, Roland Giesler via Mailman-users wrote: > > I needed to put these files at these locations: > > transport_maps = > hash:/etc/mailman3/data/postfix_lmtp > local_recipient_maps = > hash:/etc/mailman3/data/postfix_lmtp > relay_domains = > hash:/etc/mailman3/data/postfix_domains > > However, since I'm using power-mailinabox, Postfix is configured to > use sqlite already and has these lines by default: > > virtual_mailbox_domains=sqlite:/etc/postfix/virtual-mailbox-domains.cf > virtual_mailbox_maps=sqlite:/etc/postfix/virtual-mailbox-maps.cf > virtual_alias_maps=sqlite:/etc/postfix/virtual-alias-maps.cf > local_recipient_maps=$virtual_mailbox_maps > > So I have only added this line to postfix's main.cf: > > # Add postfix_domains path so mailman can add domains to it for lists > relay_domains=hash://etc/mailman3/data/postfix_domains > > The local_recipient_maps are set by power-mailinabox already, so I'm > ignoring what mailman creates. > It seems that this is a mistake. If I don't let postfix read the local_recipient_maps that mailman3 created, the incoming emails are not sent to the other host. So I have a conflict with the local_recipient_maps that postfix has (created by Power-mailinabox) and those created by mailman3. I'm hoping that if I specify local_recipient_maps more than once and then both sources will be considered. Would that work? If not, then I'm pretty much stumped, unless I go for the database option that has not been merged yet. Even if I do that, I would need to make sure that mailman3 doesn't remove the other entries in the database which, judging by what I've seen, seems to be the case. Any ideas?

10 months, 1 week

[MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup

by kelly.close＠lrewater.com

I resolved this myself with a search that turned up a 2018 post from Mark that suggested typing "mailman aliases" to create the hash/alias/lookup table/file things in /var/lib/mailman3/data (that's where they are on Ubuntu 18.04). I looked in that folder and sure enough it was empty so I typed "sudo mailman aliases" which did indeed create the 4 things that needed to be there: postfix_domans postfix_domains.db postfix_lmtp postfix_lmtp.db But, they were owned by root:root and everything else under that /ver/lib/mailman3 folder is owned by "list" so I took a guess changed the ownership on the 4 files to list:list. Seems to have worked! I was perplexed about why I had to do this though because these were created automatically last time I did this, but I figured that out too. There is a manual step with this install (mailman3-full on Ubuntu 18.04) that involves added 4 lines to the end of your postfix config file (/etc/postfix/main.cf). Those 4 lines are tricky because 2 of them are long and wrap in my documentation. I had a typo probably introduced by copy and paste, whereby 2 of the lines were on the same line and yes, those are the lines that specify where the hash tables go. So - lesson learned, follow your own instructions :-) I'm pretty sure that had i set those lines up properly the hash files would have been set up properly when mailman first tried to initialize. Maybe I'll try this again one day and see... ~Kelly

4 years, 11 months

[MM3-users] Mailman recovery test did not go as planned

by bob B

I have a test Mailman 3 environment. We are using docker, and we are running the database outside of docker in mysql. I need to perform a DR recovery test. I shut down Mailman in docker (mailman-core & mailman-web, the only docker images I have running for Mailman). While Mailman was stopped, I had our database team take a backup dump of the database. I then restarted Mailman in docker. I threw some more messages at a test list. I validated that the new messages were delivered, and showed up in the archive. I shut down Mailman again. I had the database team restore the Mailman database from the backup. I started Mailman I logged into Mailman I was expecting to see the messages in the archive prior to the backup and all the messages after the backup would be gone. When went into the list archive, I get a spinning icon and no messages showed up. I quit, restarted my browser, and logged in again, and the same thing. I then sent a test message to the list and the message was delivered to the list. Then when I went to check the archive, the spinning icon was gone and that test message was there along with all the messages before the backup was taken. Is this normal? After a restore did the new message cause a refresh of archived messages etc? Is there a way to do this without sending a message to a list after a restoration of the database? Are there better steps I should take when restoring the database? Thanks

2 years, 10 months

[MM3-users] Re: no mails to list members

by Abhijith PA

Hi. Thomas On Friday 04 January 2019 02:10 PM, Thomas Stein wrote: > On 04.01.19 05:15, Stephen J. Turnbull wrote: >> Thomas Stein writes: >> >> > Thanks for your answer. So the the file in queue/shunt contains >> > information too? I will have a look. >> >> The file in queue/shunt is the message plus some Mailman metadata, as >> a Python pickle. You can find out what is in it using "bin/mailman.py >> qfile", but probably the log and traceback will tell you (or us) >> everything needed to fix the problem. >> >> If it's a Mailman bug (somewhat unlikely), we send you a patch and you >> use "bin/mailman.py unshunt" to reinject the message into the mail >> system via Mailman. If it's a nonconforming mail message (somewhat >> more likely -- typically this happens when you have raw UTF-8 or other >> 8-bit characters in the message header), then the easiest thing to do >> is to edit a saved copy of the message and resend from your mail >> client. (It's theoretically possible to edit the pickle and use >> "unshunt", but Mailman currently does not provide that feature.) > > Turns out mailman was not able to read a specific template. That seemed to be enough to throw an exception. Maybe > i missed something else but after adjusting the permissions of that template everything worked as expected. Can you explain little bit more about this template, path and its permission ? --a

6 years, 5 months

[MM3-users] Re: Username being set to givenname for socialaccount login

by Abhilash Raj

On 9/22/21 11:22 AM, cfarley(a)iastate.edu wrote: > I have a new mailman3 install setup with Okta as a social application. This is working well for logins and data comes through as expected, but for some reason the username is being set at to a lowercase version of the given_name. The Extra data on the social users in the admin interface looks good, so I don’t think it’s a problem with the attributes coming from Okta. > > We have tried a number of variations on the below setting, but that all of them other than the default of “username” end up with the username being empty. > ACCOUNT_USER_MODEL_USERNAME_FIELD = “email” This setting actually specifies which field in your custom user model should be treated as username. From what I am seeing, you don't have a custom user model, so I don't think you want to override this field. AFAIK, the username is picked by the Okta provider in django-allauth and it is a part of that integration betweek Okta and Django. If you look at the implementation of that integration, it doesn't set the username[1], which (only some I am guessing) other providers do, Github for example[2]. You can open an issue on django-allauth's Github page[3] to ask them to update the Okta provider such that it also sets the username correctly like other providers. [1]: https://github.com/pennersr/django-allauth/blob/master/allauth/socialaccoun… [2]: https://github.com/pennersr/django-allauth/blob/master/allauth/socialaccoun… [3]: https://github.com/pennersr/django-allauth/issues -- thanks, Abhilash Raj (maxking)

3 years, 8 months

[MM3-users] Missing Base64 encoding from control message reply

by Stephen J. Turnbull

lists-mailman3(a)janaberger.de writes: > I have a setup with GNU Mailman 3.3.8 where a user tried to > subscribe. When replying to the "confirm" message, the user > received a completely garbled response, like so: > > N?z?????zf???&???j?????u?[zZ0:???v???,j?z???k?e?0 > 4D???r?^b??r?????*'???y????{ax?L?X????0:???v???,j?z???k?d?m?-???zz?rn??l]y+???-E?( > ?^N??'??M???t???Mz?????^i?????}?o?\????6sN?zf??????r??z?????????b?{h?????f?r?ne== To diagnose, we really need to see that in context of the raw message as received by the user. > The user then forwarded the .eml file to me, which clearly shows > the contents of the mail as plain text while being announced as > base64 (Content-Transfer-Encoding: base64): It also clearly doesn't show anything like the mojibake above. What is the relation between the two? While the problems could be related to Mailman, it could also be any MTA along the way or the user's mail client. I suspect that the .eml file has been significantly altered by intervening software. As far as I know, the Python email package does not MIME-encode plain ASCII text as you see in the email's subject. The only other thing I can think of is it might have something to do with your internationalization settings. What is the default language of the list? (This is available in Postorius.) Have you changed the default encoding for English on your site? (I think you need to look in mailman.cfg for this.) What is the default language of the site? Steve

1 year, 8 months

[MM3-users] Re: Display the last post time for a list or all lists.

by bryant＠sandiego.edu

> since #453 was fixed, mlist.last_post_at is None and time.ctime(None) is > the current date and time. > That too could easily be fixed like: > > import time > def last_post(mlist): > if mlist.last_post_at: > print('{}: Last post at {}'.format( > mlist.display_name, > time.ctime(mlist.last_post_at) > )) > else: > print('{}: No posts'.format(mlist.display_name)) > The trickier part is the Mailman 3 mailman withlist command has no > option to run for all lists, so you'd need to run it something like > #!/bin/sh > for list in mailman lists -q; do > mailman withlist -r last_post -l $list > done Thanks for the leg up on converting that from mailman2 to mailman3 much appreciated. I found 1 issue. When I had a list that was imported, but had not done another post after being imported, the script would fail with the following error: print('{}: Last post at {}'.format( mlist.display_name, time.ctime(mlist.last_post_at) )) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: 'datetime.datetime' object cannot be interpreted as an integer Made a final change to set the mlist.last_post_at to mlist.last_post_at.timestamp() and that cleared the problem. The final form of last_post.py is: ------------------------- import time def last_post(mlist): if mlist.last_post_at: print('{}: Last post at {}'.format( mlist.display_name, time.ctime(mlist.last_post_at.timestamp()) )) else: print('{}: No posts'.format(mlist.display_name)) ------------------------------- Don't know if this will help others, but the place I put the last_post.py file was in: /opt/mailman/venv/bin (same location as the mailman script executable). Bryan

9 months, 4 weeks

[MM3-users] Re: translating templates (was: Re: spanish localization)

by Guillermo Hernandez (Oldno7)

On 15/2/21 16:57, Mark Sapiro wrote: > Finally, although I said previously that the translated templates should > be submitted as a merge request, that can still be done, but is not > necessary. They can be translated in weblate. See > <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…> > and<https://gitlab.com/mailman/mailman/-/issues/825>. I had the templates translated now in UTF-8 coding map. I copied all of them en a new directory (es) under mailman package templates (as I can see are other languages): /usr/local/lib/python3.7/site-packages/mailman # ls templates __init__.py de es it __pycache__ en fr sk /usr/local/lib/python3.7/site-packages/mailman # ls templates/es domain:admin:notice:new-list.txt list:member:regular:header.txt help.txt list:user:action:invite.txt list:admin:action:post.txt list:user:action:subscribe.txt list:admin:action:subscribe.txt list:user:action:unsubscribe.txt list:admin:action:unsubscribe.txt list:user:notice:goodbye.txt list:admin:notice:disable.txt list:user:notice:hold.txt list:admin:notice:removal.txt list:user:notice:no-more-today.txt list:admin:notice:subscribe.txt list:user:notice:post.txt list:admin:notice:unrecognized.txt list:user:notice:probe.txt list:admin:notice:unsubscribe.txt list:user:notice:refuse.txt list:member:digest:header.txt list:user:notice:rejected.txt list:member:digest:masthead.txt list:user:notice:warning.txt list:member:generic:footer.txt list:user:notice:welcome.txt But mailman isn't aware of them (I restarted the server). May I have to execute some process as "compilemessages" to mailman be capable to use them? Now mailman is using the "en" templates for sure. After testing them I'll do both of the suggestionsyou made: a merge request AND the revision and translation via Weblate.

4 years, 3 months

[MM3-users] Re: External Mail-Server?

by Florian Schulze

Hi! But LMTP is the "Local" Mail Transfer Protocol. I only have access to IMAP, POP3 and SMTP. Outgoing seems to be simple, but what about incoming? Regards, Florian Schulze On 11 Sep 2021, at 21:21, Jörg Michael Schulz via Mailman-users wrote: > Hi, > > yes, this should be possible. > > See the parameters in your mailman.cfg: > > [mta] > # The class defining the interface to the incoming mail transport > agent. > incoming: mailman.mta.exim4.LMTP > #incoming: mailman.mta.postfix.LMTP > > # The callable implementing delivery to the outgoing mail transport > agent. > # This must accept three arguments, the mailing list, the message, and > the > # message metadata dictionary. > outgoing: mailman.mta.deliver.deliver > > smtp_host: mail.yourfavoritedomain.de > smtp_port: 25 > smtp_user: > smtp_pass: > > Am 11.09.21 um 19:53 schrieb Florian Schulze: >> Hi! >> >> Is it possible to use an external Mail-Server? Does mailman3 support >> that directly, or would I have to setup a local MTA which somehow >> fetches incoming mails from the external inbox and uses the external >> Mail-Server for delivery? >> >> Does anyone do that and have example configurations? >> >> Regards, >> Florian Schulze >> _______________________________________________ >> Mailman-users mailing list -- mailman-users(a)mailman3.org >> To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

3 years, 8 months

[MM3-users] Re: Language confusion in held mail notifications

by Mark Sapiro

On 9/24/21 12:57 AM, Stephen J. Turnbull wrote: > Mark Sapiro writes: > > On 9/22/21 2:16 AM, Henrik Rasmussen wrote: > > > > After sending a mail to the list as the moderated list user, the > > > resulting notification returned to the users email address is > > > mostly in German, but the reason indicated is in Spanish "El > > > mensaje proviene de un miembro moderado". > > > > > > I am unable to duplicate this in Mailman 3.3.5rc1. > > Is it possible that one of the message catalogs is incomplete, and > something in the environment (LANGUAGE seems like a likely candidate) > is set to a value that uses German when Spanish is unavailable or > vice-versa? Thanks for the hint Steve. There is a Spanish message catalog as evidenced by the fact that the reason was translated to Spanish, but the issue is almost certainly that there is no mailman/templates/es/list:user:notice:post.txt template so we fall back to the one for the list's language. Note that prior to Mailman 3.3.5rc1 there are lots of missing templates and in particular, the 3.3.4 Spanish templates were incorrectly named with `_` rather than `:` in the names. Templates are actually translated in the message catalogs via weblate, but these translations weren't installed in the appropriate templates/ directory. There is now a script at https://gitlab.com/mailman/mailman/-/blob/master/update_lang_templates.py to do this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 8 months

[MM3-users] Mailman3 on virtual domains (was: Re: Re: Alias for a list name)

by Lars Bjørndal

[Mark] > On 10/6/23 09:49, Lars Bjørndal wrote: > > > > To run mm 3 through Postfix, I use local_recipient_maps and > > transport_maps. > > > > What I want to achieve, is alias medlem(a)list.saf-org.no to > > saf-medlem(a)list.saf-org.no > > > > I tried to put > > > > medlem(a)list.saf-org.no: saf-medlem(a)list.saf-org.no > > > > and get the following error when running newaliases: > > > > postalias: warning: /etc/aliases, line 231: name must be local > > > > Is it possible to do this aliasing in a simple way? > > > If list.saf-org.no is a local domain, i.e. in mydestination, the alias would > be > > medlem: saf-medlem(a)list.saf-org.no > > or more simply > > medlem: saf-medlem > > If list.saf-org.no is not a local domain it needs to be a Postfix virtual > (alias or mailbox) domain and you need a virtual_alias_maps with an entry > like > > medlem(a)list.saf-org.no saf-medlem(a)list.saf-org.no Thank you. One of my other domains is a virtual domain. According to https://wiki.list.org/DEV/LMTP%20process I tried to add hash:/opt/mailman3/mm//var/data/postfix_lmtp to virtual_alias_maps in Postfix's main.cf. When sending to testliste(a)rokaden.no, I get back an Undelivered Mail Returned to Sender message with <"lmtp:[127.0.0.1]:8024"@dalen.lamasti.net> (expanded from <testliste(a)rokaden.no>): unknown user: "lmtp:[127.0.0.1]:8024" What's my problem here? Thanks, Lars

1 year, 8 months

[MM3-users] ARC

by Stephen J. Turnbull

David Krantz writes: > Is the documentation correct that ARC should be as simple to configure > in mailman 3 as to add the private DKIM key and restarting mailman? > (https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/arc_sign…) You need to enable ARC by adding the ARC section to mailman.cfg and setting "enabled = yes" in it. I've submitted a pull request to update the documents. > I've tried that without finding any effect in my so far limited tests. What do you mean by "effect"? Is the "effect" that you're not seeing the presence of ARC header fields in outgoing mail? If so, you probably haven't set the enabled flag. If the effect you're looking for is that Google and several other participants in the ARC protocol accept your mail when they didn't before, you'll have to ask them about it. > I have not found anything in logs although I might have missed looking > in one. I don't recall that anything is logged by the module under normal circumstances, there may be some error logging. What would you expect to be logged? > Are there any known limitations? Of what kind? It's a simple protocol: if there is authentication information (DKIM or ARC) in the incoming message, validate it. Then package up the validation in the ARC-AR, ARC-Signature, and ARC-Seal fields. Those are the operations the module performs. Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

5 years, 9 months

[MM3-users] Re: Welcome Message

by Mark Sapiro

On 11/6/19 9:18 AM, josh(a)caluette.com wrote: > I just setup a new Mailman 3 server using maxking/docker-mailman from GitHub. I got everything working just right including changing the footer template for messages. However, when trying to set anything in a Welcome template, I am encountering these same errors. > > I have confirmed that the mailman-core container is able to download the template via curl using the http://mailman-web:8000/ api URL and gets the correct text, but anytime I try to mass subscribe, it fails with the errors that Brian had provided and I get an HTTP 500 error. > > If I remove the Welcome template, then I can do mass subscribe just fine. > > Here are the logs: > > Nov 06 17:10:13 2019 (29) deque: > Traceback (most recent call last): > File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 384, in _make_request > six.raise_from(e, None) > File "<string>", line 2, in raise_from > File "/usr/lib/python3.6/site-packages/urllib3/connectionpool.py", line 380, in _make_request > httplib_response = conn.getresponse() > File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse > response.begin() > File "/usr/lib/python3.6/http/client.py", line 297, in begin > version, status, reason = self._read_status() > File "/usr/lib/python3.6/http/client.py", line 258, in _read_status > line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") > File "/usr/lib/python3.6/socket.py", line 586, in readinto > return self._sock.recv_into(b) > socket.timeout: timed out Have you set POSTORIUS_TEMPLATE_BASE_URL appropriately in your settings_local.py? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 7 months

[MM3-users] Re: How To Install Mailman 3 on Debian 10 (Complete Guide)

by Mark Sapiro

On 2/27/21 3:48 PM, Ruth Ivimey-Cook wrote: > > It is also possible to Alter existing databases and tables, but with one > catch: the maximum table row length is reduced, so some tables will need > to be adjusted (e.g. converting varchar(255) to varchar(230)). This is misleading. The maximum row length depends on the actual data stored in the row. The sum of the various column size limits for VARCHAR and other columns can well exceed the maximum row size as long as the sum of the lengths of the actual data stored in the row does not. The significant issue is all these limits are bytes, not characters, so in the worst case, a VARCHAR(255) column can only store 85 3-byte utf8 encoded unicodes or 63 4-byte utf8mb4 encoded unicodes, but this too is misleading an most strings contain single byte encodings with some 2 or 3 byte encodings and maybe at most one or two 4-byte encodings. Furthermore, the problem issues are essentially limited to emojis and possibly other 4-byte encoded symbols in email subject headers and bodies. Bodies are a TEXT field and the data are stored separately and do not affect the row size and subjects are defined with a maximum length of 512 bytes which should be sufficient. None of the data stored in rows is at all likely to exceed the maximum row length, even with a lot of 4-byte encodings. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 3 months

[MM3-users] Re: Database deadlock when trying to delete a member.

by Simon Coggins

> On 18 Mar 2021, at 5:05 pm, Abhilash Raj <maxking(a)asynchronous.in> wrote: > > Hi Simon, > > > On Mar 17, 2021, at 10:16 PM, Simon Coggins <s.coggins(a)cqu.edu.au> wrote: > > > > Hi, > > > > I’ve got a strange error. I migrated from mailman 2.1 to 3 using the migration guide on the website and things have been working fine. But I’m in the process of testing the new syncmembers command to replace some inhouse mailman API code we wrote. I’ve tracked my problem down to what appears to be a deadlock in the postgresql database. When trying to delete certain users the SQL query hangs and never returns. > > > > After doing some tracing and tracking it down to the database, I enabled DB logging of all queries and saw that the following query was never returning: > > > > DELETE FROM member WHERE member.id = 166814 > > > > If I try to run it manually I get the same issue, in psql it never returns. > > mailman=# explain analyze DELETE FROM member WHERE member.id = 166814; > > [… 60 seconds passes…] > > ^CCancel request sent > > ERROR: canceling statement due to user request > > CONTEXT: while deleting tuple (2998,72) in relation "member" > > I’m just wondering if there are any commands or scripts I can run to verify the database and it’s constraints to see if there is some error in the database data? Or where you’d recommend I go from here? It only impacts the user on this specific list. If I add this user to another list and remove them, everything works fine. > > Are you able to retrieve that Member object using API? > > This[1] the Python code which would try to delete a Member object and I > am assuming is being called from syncmembers command. I am not entire > sure about what would cause the database to hang, if there was some database > constraint that failed, I would imagine some error to be returned. > > [1]: https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/model/member.p… > Ok I think I’m getting closer. It appears to be an open transaction that is locking the database record. While mailman is running, if I try to execute "DELETE FROM member WHERE member.id = 166507;” on the mailman table in psql the query hangs and never returned. But if I shutdown mailman and try to run the query again, it executed immediately. So I’m pretty sure there is an open transaction that is causing the entry to be locked. > One thing you can try is see if you can unsubscribe the user using the API or > `mailman shell` command. > > You can unsubscribe from API by calling a `DELETE` method at > > http://localhost:9001/3.1/members/<member_id> > > This would give us some indication about whether there is some bug > in the implementation of syncmembers command or if there is something > else going on. > Trying via shell or via API to delete the user all fail and hang. I’m able to receive the user/membership/list data without any issue both via mailman command and via the API. > > > > This is on a test system so I can do various testing. I’m trying to find the root cause so that I can verify my production system isn’t impacted by the same thing. > > > > > > Setup Details: > > OS: Oracle Linux 7 (Redhat) > > Installed using pip via virtualenv talking to a local pgsql database on the same box. > > Data was migrated from a mailman 2.1 install into mailman3 using migration instructions on the website. > > > > PIP Modules versions: > > django-mailman3 1.3.5 > > mailman 3.3.3 > > mailman-hyperkitty 1.1.0 > > mailmanclient 3.3.2 > > postorius 1.3.4 > > psycopg2-binary 2.8.5 > > What is the version of sqlalchemy package? There is a new 1.4.0 version that came out recently > and is incompatible with Core right now. There are backwards incompatible changes which might > need some changes in Core to add support. > SQLAlchemy 1.3.19 > > > > RPM packages: > > postgresql12-12.6-1PGDG.rhel7.x86_64 > > postgresql12-server-12.6-1PGDG.rhel7.x86_64 > > postgresql12-libs-12.6-1PGDG.rhel7.x86_64 > > postgresql12-devel-12.6-1PGDG.rhel7.x86_64 > > > > > > -Simon > > > > > > _______________________________________________ > > Mailman-users mailing list -- mailman-users(a)mailman3.org > > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > > -- > thanks, > Abhilash Raj (maxking) > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ --- Simon Coggins, Principal Systems Engineer Digital Services Directorate CQUniversity, Lvl 6.14, 160 Ann Street Brisbane, QLD, 4000 Email: s.coggins(a)cqu.edu.au Web: http://www.cqu.edu.au/

4 years, 2 months

[MM3-users] Re: auto-away notices as bounces

by Mark Sapiro

On 8/29/21 10:19 PM, Andreas Barth wrote: > * Mark Sapiro (mark(a)msapiro.net) [210830 04:30]: > >> That said, bounce processing should treat even a VERPed message as >> unrecognized if it doesn't look like some kind of DSN. This may not >> be the case in MM 3. > > Thanks, that's what I also think. Looking at the returned mail, they > definitly don't look like DSNs / bounces to me. > > > Anything I should be doing re this topic? I've created https://gitlab.com/mailman/mailman/-/issues/939 for this. I think this patch will fix it. --- a/src/mailman/runners/bounce.py +++ b/src/mailman/runners/bounce.py @@ -51,13 +51,18 @@ class BounceRunner(Runner): addresses = StandardVERP().get_verp(mlist, msg) if len(addresses) > 0: # Scan the message to see if it contained permanent or temporary - # failures. We'll ignore temporary failures, but even if there - # are no permanent failures, we'll assume VERP bounces are - # permanent. + # failures. We'll ignore temporary failures, and if there + # are no permanent failures, we'll assume this is a vacation + # response or similar. temporary, permanent = all_failures(msg) if len(temporary) > 0: # This was a temporary failure, so just ignore it. return False + if len(permanent) == 0: + log.info('VERPed bounce message but not a recognized DSN: %s', + msg.get('message-id', 'n/a')) + maybe_forward(mlist, msg) + return False else: # See if this was a probe message. addresses = ProbeVERP().get_verp(mlist, msg) (Watch for wrapped lines) -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 9 months

[MM3-users] Re: Message is received but is not sent out. Another, similar message, is processed fine.

by Allan Hansen

Thank you both. Since the first message she sent was UTF-8 and the second iso-8859-8-I, I have asked her what she did diffently between the two messages. No response yet... But now being aware that this can happen when non-ASCII messages are sent, and how to find the issue when it does, is good. Yours, Allan On 6/27/23, 07:57, "Mark Sapiro" <mark(a)msapiro.net <mailto:mark@msapiro.net>> wrote: On 6/27/23 12:30 AM, Stephen J. Turnbull wrote: > > That said, if the users are unable or unwilling to use UTF-8, it would > be possible to create a codec for "iso-8859-8-i", I don't know how to > do that, and I doubt Mark does. You could ask on > python-list(a)python.org <mailto:python-list@python.org>, or file an RFE on Python's GitHub tracker. See https://github.com/python/cpython/issues/90079 <https://github.com/python/cpython/issues/90079> filed by me in Nov 2021. -- Mark Sapiro <mark(a)msapiro.net <mailto:mark@msapiro.net>> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org <mailto:mailman-users@mailman3.org> To unsubscribe send an email to mailman-users-leave(a)mailman3.org <mailto:mailman-users-leave@mailman3.org> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/> Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org <mailto:mailman-users@mailman3.org>/message/4WPWU3SKGWM2BTG5AK3LWNG7FDIBVSTP/ This message sent to hansen(a)rc.org <mailto:hansen@rc.org>

1 year, 11 months

[MM3-users] Re: Recently redeployed mailman3 and then received huge amount of subscription disabled notification emails

by Mark Sapiro

On 10/12/24 1:44 AM, francesd919--- via Mailman-users wrote: > Hi everyone, > > I recently redeployed our mailman3 server. As the owner for one of our mailing lists, I received a huge amount of subscription disabled notification emails. > These emails mentioned that the subscription was disabled due to bounce score. > Furthermore, we received a few emails from our subscribers saying that they have functioning email addresses and not sure why there were bounces and that their subsctiptions had been disabed. See https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > I have some questions: > > 1. Why do mailman mass send out subscription disabled notification emails to admins after it's been redeployed? > 2. I have "Bounce disable warnings" set to 3 and "Bounce disabled warnings interval" set to 7d. How come there are still so many emails seem to be disabled but not unsubscribed? Hence we receiving so many subscription disabled notification emails. > 3. What could have cuased functioning emails to bounce and therefore being disabled? The answer to all those is you upgraded from a Mailman core version prior to 3.3.1. Prior to that, bounces were recorded in the database but not processed. when you upgraded, they all got processed at once. See https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… which includes a `mailman shell` interaction to re-enable all the subscriptions disabled by bounce. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 months, 4 weeks

[MM3-users] Re: Mailman 3 bounce handling and DKIM mitigation

by Mark Sapiro

On 09/05/2017 01:14 PM, David Krantz wrote: > > I have a question on bounce handling. I get the impression that > bounces are just lost and neither handled nor forwarded to the list > admin. Is this a known problem? I am running mailman from git, but > about version 3.1 and use postfix. Bounce processing in Mailman 3 is currently not done. See <https://gitlab.com/mailman/mailman/issues/343>. > I find lots of things in the > bounceevents table. Is there any way to find out more on these events? > I probably can configure postfix to send listname-bounce@domain to an > admin adress. Or for that matter hack mailman to send it to the > correct admin. Your ideas are possible. Until it's fixed, you could just make postfix forward the listname-bounces address to listname-owner. I think this will then get the LMTP runner to send them to the owner. > Also the DKIM mitigation does not seem to detect DKIM domains. If I > force the mitigation for all mails it works but that of course has > annoying consequences although mostly cosmetic. This has caused quite > a number of bounces for my lists (as well as being temporarily banned > by at least Microsoft). I assume you mean DMARC mitigation. It should work for From: domains that publish DMARC policy 'reject' or 'quarantine' without setting DMARC Mitigate unconditionally. What if anything do you see in mailman.log? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 9 months

[MM3-users] Re: How to promote non-members to members?

by Mark Sapiro

On 3/17/22 10:19, Quanah Gibson-Mount wrote: > > So then I ran your code to confirm it, and it blows up with an error: ``` >>>> for token, data in pendings.find(pend_type='subscription'): > ... if data['token_owner'] != 'subscriber': > ... continue > ... if data['email'] != 'xxxxxxxx(a)xxxxx.org': > ... continue > ... sub_mgr.confirm(token) > ... > Traceback (most recent call last): > File "<console>", line 6, in <module> > File "/usr/lib/python3/dist-packages/mailman/app/subscriptions.py", > line 545, in confirm > workflow.restore() > File "/usr/lib/python3/dist-packages/mailman/app/workflow.py", line > 149, in restore > setattr(self, attr, data[attr]) > File "/usr/lib/python3/dist-packages/mailman/app/subscriptions.py", > line 119, in address_key > assert self.address is not None > AssertionError ``` This says that there is no Address object with the email xxxxxxxx(a)xxxxx.org What do you get in `mailman shell` for ``` >>> um = getUtility(IUserManager) >>> um.get_address('xxxxxxxx(a)xxxxx.org') >>> um.get_user('xxxxxxxx(a)xxxxx.org') ``` These should return an Address and a User respectively. If they don't, did you perhaps run some process to delete the user? If the user is gone, you should be able to replace ``` ... sub_mgr.confirm(token) ``` in the above with ``` ... wfm = getUtility(IWorkflowStateManager) ... pendings.confirm(token, expunge=True) ... wfm.discard(token) ``` to clear the pending subscription and workflow and then be able to mass subscribe the user. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 2 months

[MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup

by Mark Sapiro

On 4/11/19 10:02 AM, brian(a)emwd.com wrote: > I followed Kelly's guide and ran into some issues but were able to resolve most of them. It seems I have one out standing issue: Hyperkitty. When I post to a list, I am getting the following in the /var/log/mailman3/mailman.log: > > Apr 11 14:01:15 2019 (1334) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/archive: <!DOCTYPE HTML PUBLIC "-//IETF/$ > <html><head> > <title>503 Service Unavailable</title> > </head><body> > <h1>Service Unavailable</h1> > <p>The server is temporarily unable to service your > request due to maintenance downtime or capacity > problems. Please try again later.</p> > <hr> > <address>Apache/2.4.29 (Ubuntu) Server at localhost Port 80</address> > </body></html> > (503) ... > Everything else works fine. Postfix is receiving and delivery mail to Mailman3. List members are receiving the posts. I can access the list on Hyperkitty just no archived messages. What URL do you use to access HyperKitty. The problem URL above, http://localhost/mailman3/hyperkitty/api/mailman/archive is based on the base_url setting in mailman-hyperkitty.cfg which in your case is http://localhost/mailman3/hyperkitty/, byt the web server listening on localhost:80 is returning the Service Unavailable. It probably doesn't like the IP or name 'localhost'. Set base_url in mailman-hyperkitty.cfg to use an acceptable host name instead of localhost or adjust your apache config to accept localhost. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 1 month

[MM3-users] Re: Multi-domain oddities in Hyperkitty and Postorius

by Jeremy Stanley

On 2022-12-14 17:26:59 -0800 (-0800), Mark Sapiro wrote: > On 12/14/22 13:40, Jeremy Stanley wrote: > > > > Once these entries are automatically added by visiting that page, > > they're all associated with the one "web host" ("site" in Django) we > > have for the server, and now the list filtering functionality in > > Postorius breaks and any of the vhosts all display the full set of > > mailing lists on the server rather than only those associated with a > > particular vhost (note that this seems to only be confusing > > Postorius, Hyperkitty has them correctly filtered still). > > See https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > and also below. [...] While this does appear to solve the problem on my test deployments, a challenge that I'm left with is how to automate it. Our community takes an "infrastructure as code" approach to all the services we run for our projects, and we make sure that we can automatically bootstrap every system from scratch into a working state. Unfortunately, I'm not having any luck finding an API or CLI which I can use to create sites and domains rather than manually doing it in the Django admin WebUI. Does such a thing exist, or an I going to need to resort to directly performing database inserts (which I'd rather avoid since it could break if the schema changes). It appears there's a foreign key relationship involved, which could make DB manipulation like this even more fragile. -- Jeremy Stanley

2 years, 4 months

[MM3-users] Re: Mass Subscribe caused Delivery Status to become "unset"

by Odhiambo Washington

On Sat, Sep 7, 2024 at 9:45 PM chad.hays86--- via Mailman-users < mailman-users(a)mailman3.org> wrote: > One of the admins on our Mailman site said they recently performed a mass > subscribe operation on list, however they noticed that for each user they > subscribed, their "Delivery status" was unset, so they weren't receiving > email updates whenever there was new activity on the list. They had to go > in after the fact and manually set it to "Enabled" for each user that was > subscribed via the mass subscription operation. Is this behavior expected? > During the mass subscribed, pre-confirm, pre-approved, and pre-verified > checkboxes were all checked. > I do subscribe members using the same method your admin used, and I also check the option to send a welcome message as it defines things that the new user ought to know. I have just checked on the profile of one user I added 3 or so days ago and found that NO option is set on their web profile - just like your admin found out. I then checked my MTA logs for list posts (the list is active today) and found that ML posts are also being sent to their address. So what your admin is reporting is rather strange - to me. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

9 months

[MM3-users] Re: hidden list is hidden even to the owner

by Abhilash Raj

On Wed, Jul 1, 2020, at 1:31 PM, Mohsen Masoudfar wrote: > Hi, > > I am not sure, if it is designed this way, or I am doing something wrong. > > I created a list in MM3 as a hidden list, meaning: > Show list on index page: NO > and assigned the owner. When I login as Postorius web admin, I see the > list on the list page which is listed as: (unadvertised*). This is fine. > But when the owner or moderator login to Postorius they don't see the > list at all. Of course if they add the list name at the end of the URL, > they get to the list and as the owner can manage it too. > My question is: I am just not sure, if I am missing something or this > is how it is supposed to work? Which version of Postorius are you running? Newer version shows all the lists you are related to by default when you are logged-in. So, the ones you own, moderate, subscribe to. > You could expect, that the owner or the moderator should see the list > as (unadvertised*) too. > > Best regards > Mohsen Masoudfar > Lead System Analyst, IT Operation > American Association for the Advancement of Science > 1200 New York Ave, NW, Washington, DC 20005 > 202-326-7087 > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

4 years, 11 months

[MM3-users] Personalization issue when no To header?

by Alan So

We have ported a number of lists from mailman 2 to mailman 3 earlier. We cannot find any personalization setting in the mailman 3 web UI or using the mailman client. It is fine as it is not essential. However, recently we notice an issue. As the lists in the mailman 2 probably have personalization turned on, it looks like that the setting are also migrated by using "mailman import21". Recently, some users start sending mail simply with Bcc without any addresses in the To header. We notice the following error: Oct 08 11:26:03 2019 (1832) Uncaught runner exception: 'to' Oct 08 11:26:03 2019 (1832) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 173, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 266, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/deliver.py", line 86, in deliver refused = agent.deliver(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/base.py", line 163, in deliver callback(mlist, message_copy, msgdata_copy) File "/usr/local/lib/python3.6/site-packages/mailman/mta/personalized.py", line 58, in personalize_to msg.replace_header('To', formataddr((name, recipient))) File "/usr/lib64/python3.6/email/message.py", line 558, in replace_header raise KeyError(_name) KeyError: 'to' After tracing the source codes above, we suspect that the issue was caused by no To header due to personalization is turned on. Any quick suggestion of workarounds such as how to turn off personalization for all lists? We do not have much experiences with mailman shell. Thanks a lot.

5 years, 8 months

[MM3-users] Re: Finding a user to delete them

by Quanah Gibson-Mount

--On Saturday, March 14, 2020 7:03 PM +0900 "Stephen J. Turnbull" <turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > For alternatives to Postorius and the Mailman shell, Brian Carpenter > (follow Allan's subthread) is working on a new management UI (using > PHP), and I believe there's a working node.js API "out there > somewhere". Please be very considerate of Brian's time; he and EMWD > constitute a bulwark of the Mailman ecosystem and will be even busier > with the UI project. But do pass on your suggestions to him as well > as to us, he's indicated he's open to that. Thanks Steve, Generally I just found the mailman shell examples in the documentation lacking, as: * it used functions not available without loading additional modules not listed in the documentation * the steps to find accounts is lacking, since they don't work for email addresses that are not yet verified * I could find no documentation on what fields are available in the user object, so I was unable to find the account via other methods, including the actual username created by mailman3 (which seems odd, wouldn't this be a standard way to find users..?) The Django UI is the only thing that let me find the miscreated user and delete it. Hopefully the bug I filed about github user integration being badly broken will receive some priority, given the bug causes new accounts to incorrectly be created for existing users. --Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

5 years, 2 months

[MM3-users] Programmatic Creation of Users

by jciesla＠techsupportme.com

I am returning to Mailman after being away for a LONG time and I need to create 40 lists with ~350 subscribers spread across those lists. After a lot of testing I am now able to create users from the Core Shell and set (most of) the necessary values. Having jumped that hurdle I have hit a roadblock and I am hoping that the list can provide some insight and/or solutions. After a lot of research I now understand that what I am doing in the Core Shell is creating a User entity which has one or more email addresses as well as one or more roles and preferences that exist at the global level. This user entity can Subscribe to zero or more lists. If I am incorrect in the summation please let me know! Assuming that the previous information is correct that brings us to my current dilemma. Specifically, the User entity can Subscribe and interact with lists using the email commands, but they can't Login using the Postorius web interface. If I understand correctly the reason that they can't login is that the underlying Django system does not recognize their account because the account that was created in Core isn't accessible by Django. Instead the user needs to create a Django-specific account at which point the information from Core becomes available in the user's web UI. If that is in fact accurate then I want to take the next logical leap: is it possible to programmatically create an account in Django that is tied to the account that was created in Core? Any information is greatly appreciated! -John

2 years, 10 months

[MM3-users] Re: Bulk delivery status change?

by Stephen Daniel

Thanks all! I will use these pronto. On Sun, Nov 10, 2024 at 11:42 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 11/10/24 08:34, Odhiambo Washington via Mailman-users wrote: > > On Sun, Nov 10, 2024 at 7:16 PM Stephen Daniel <swd(a)pobox.com> wrote: > > > >> Mistakes were made, and for while every single outbound email bounced. > >> I've fixed the mistakes, but now in my largest and most active email > list, > >> every single user's delivery status is "Disabled by Bounces". > >> > >> Is there a way to bulk fix this? Or do I have to go into each user, > one at > >> a time, and fix them? > > > > Please see this thread: > > > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > The script in that post does all lists. For a single list see > > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > but note that the command line > ``` > $ shell -l list(a)example.com > ``` > should be > ``` > $ mailman shell -l list(a)example.com > ``` > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to swd(a)pobox.com >

6 months, 4 weeks

[MM3-users]Re: [Mailman-Users] Mailman3 administration

by Barry Warsaw

On Jun 18, 2016, at 12:10 PM, Mark Sapiro wrote: >because I want to run all the Mailman pieces from >the heads of their branches rather than what's in PyPI, but even without >that, installation is significantly more work than installing a distro's >package. My hope is that the upcoming 3.1 release will be much more solid and usable than 3.0 so that you won't have to run from the git heads. I think of it very much like Python 3.0 and 3.1 - the 3.0 release was really a stake in the ground and a major milestone so that people will start using it in anger and helping us understand the priorities for fixing and improving it. In that we've succeeded I believe (witness in addition to Mark's work on python.org, that the Fedora mailing lists have all been converted to use MM3). There are a number of interesting options for improving the turnkey installation of MM3. There are Debian folks who are waiting for 3.1 to complete the packaging work there, and there are docker/juju/etc. containerization work happening too. >I will say that once you have Mailman 3 installed and running, updating >(which I do frequently, but which doesn't need to be done unless you >want specific updates/fixes) is pretty easy. Yes, we're trying to be very serious about upgrades and backward compatibility, so that even if you bravely install 3.0 today, it should always be easy to upgrade to the next point release. Similarly, I try to keep core's git head always working so you could track that if you want. Cheers, -Barry

8 years, 11 months

Search results for query "dO"