Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: Debian Package Install - Ownership and Permissions

by Mark Sapiro

On 4/7/23 14:58, Dave Hall via Mailman-users wrote: > On Fri, Apr 7, 2023 at 5:47 PM Mark Sapiro <mark(a)msapiro.net> wrote: > >> On 4/7/23 13:43, Odhiambo Washington wrote: >>> On Fri, Apr 7, 2023 at 8:09 PM Andreas Schamanek < >>> as2020+github(a)fam.tuwien.ac.at> wrote: >>>> >>>> I am running MM2 und 3 in parallel without problems, I do have a >>>> special MTA setup though (Sendmail). Can't speak for Postfix etc.. >>>> >>> >>> Your setup can handle list1(a)domain1.name via MM2 and MM3, >> simultaneously, >>> right? :-) >> >> It is possible to have an MM2 `list1` and an MM3 `list1(a)domain1.name` >> simultaneously on the same server, but what is the MTA going to do with >> incoming mail to `list1(a)domain1.name`. I suppose it could deliver it to >> both MM2 and MM3, but I don't see any practical use case for this. >> >> I run Exim4 on my servers so I can comment from this perspective. Exim > had a concept of 'routers' which are stacked and processed in order of > appearance. There is a router for MM2 and one for MM3 that pick off > incoming mail based on whether the email address matches a list name. WIth > this setup, you could have the same list name in both MM2 and MM3, but it > would go to whichever router appears first and the second one would never > see it. So I have the MM3 router first, and as I migrate my lists from > MM3 the email for those lists no longer gets to MM2. And mail.python.org which currently has 189 Mailman 3 lists and 223 Mailman 2.1 lists does something very similar in it's Postfix configuration and also prefers Mailman 3. However, maybe I misunderstood Odiambo's question about simultaneous support for a Mailman 2.1 and Mailman 3 list of the same name. We could certainly have that on mail.python.org, and even have both MM 2.1 and MM 3 web UIs for those lists, but as soon as the MM 3 list is created during migration, mail is only delivered to the MM 3 list. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years

[MM3-users] Re: Mailman 3 Social Auth Configuration

by Mark Sapiro

On 10/12/2016 08:09 PM, emonical(a)misfitlabs.org wrote: > > I am a new Mailman 3 user and have just gotten an environment configured using the Mailman bundler. The setup is almost complete, but, there's still Persona authorization. Mailman bundler installs the latest releases from PyPI, but those are behind the latest development branches. > I was reading the your setup here from (https://wiki.list.org/DOC/Mailman%203%20installation%20experience) and was wondering if someone might have some insight as to how to remove the Persona log in to keep it locked down entirely to localized user registration. With the latest gitlab branches, you will have Django Allauth. This includes login by verified email and password, and if you choose to not use any of the supported Oauth2 providers, that will be the only method. To do this without waiting for the Mailman 3.1 release and an updated bundler, you will need to install the latest master branches from <https://gitlab.com/groups/mailman> for Mailman, Postorius, HyperKitty, MailmanClient, django-mailman3 and HyperKitty - Mailman plugin. The wiki article <https://gitlab.com/groups/mailman> will give some insight into the process, but it isn't fully current. I will be updating it. Meanwhile, ask your specific questions here and we will try to help. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 years, 6 months

[MM3-users] Re: Mailman archive issues (Hyperkitty)

by Mark Sapiro

On 6/8/21 10:50 PM, Kimmo L wrote: > Okay, i will try to explain the overall situation as far as I can understand: > Its a CentOS 7 host without any virtualenv. Mailman_suite_project git repo has been cloned to the host and after that some packages have been installed with the help of pip: > > # pip2 install django==1.10 postorius==1.1.0 hyperkitty whoosh xapian-haystack > # pip3.5 install mailman mailman-hyperkitty For current Mailman the minimum Python version is 3.6 and all components are Python 3. Nothing is Python 2. You should be installing the latest versions of everything. Do not install Django explicitly with pip. It will be installed as a dependency of Postorius and Hyperkitty. If you are going to use Xapian, you don't need whoosh. Also, you need to install Xapian itself, either from source or with yum if there is a yum package. > And now Im in trouble, what would be the right steps from here. I'm not that competent to use pip, so im confused - should i install python36 packages and try to upgrade pip2 and pip3 mailman packages after that or should i install these pip2 packages with pip3 and remove from pip2 list? There are no pip2 packages. Everything is Python >=3.6. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: [Django] ERROR (EXTERNAL IP): Internal Server Error: /hyperkitty/list/direttivo@catania.linux.it/top-threads

by Mark Sapiro

On 2/28/21 10:17 AM, blackout69 wrote: > Hello everybody,I received this error message and from that moment the > maiilan3 has stopped working.I restarted the following services mailman3 > and mailman3-web and everything started working fine.Can you tell me > what is the problem my django server has encountered? It looks to me like a race condition of some kind or possibly an incompletely deleted thread. Have you deleted any threads? I'm curious as to how you happen to be going to <https://lists.catania.linux.it/hyperkitty/list/direttivo@catania.linux.it/t…> as opposed to <https://lists.catania.linux.it/hyperkitty/list/direttivo@catania.linux.it/#…>. I know that ULS and similar ones are in HyperKitty's urls.py, but I don't see them exposed on any pages. Anyway, when you say "from that moment the maiilan3 has stopped working." (sic) exactly what stopped working. Did core stop delivering messages? Did Postorius stop working. If so, this all may be related to some underlying database issue or something like that that was fixed by the restarts. I don't see how this HyperKitty error could affect Postorius or Mailman core. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: Strange messages after upgrading Mailman3

by Mark Sapiro

On 12/5/22 08:56, Allan Hansen wrote: > Thank you, Mark, as always. > > We upgraded to the latest versions: > > Mailman Core Version GNU Mailman 3.3.7 (Tom Sawyer) > Mailman Core API Version 3.1 > Mailman Core Python Version 3.9.2 (default, Feb 28, 2021, 17:03:44) [GCC 10.2.1 20210110] > > Also, I don't have any umbrella lists. I need more information about this. As far as I know, this can only happen with messages that are cross posted to multiple lists and held for moderator approval on more than one list. This should have been fixed in Mailman 3.3.6 by <https://gitlab.com/mailman/mailman/-/merge_requests/932>. This should never happen with a post that is delivered to members without being held. Also, I think when this happens to a delivered post, the post in the archive will also have the content lost message. I would like to get as much information as possible about the circumstances when this happens. In particular, was the post held for moderation, was it posted to multiple lists, for how many lists was the content lost. Also, it may help to see the full raw message with the content lost notice. (If there are privacy concerns you can send these to me off list) -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 4 months

[MM3-users] Re: Replace "visit your dashboard" with URL link, like in Mailman 2.

by Mark Sapiro

On 5/8/23 09:52, Mark London via Mailman-users wrote: > Has anybody attempted to change the format of the emails that are sent > to the owner of a mailing list, to include a URL, instead of stating > "visit your dashboard"? The former is the behavior of Mailman 2. Many users, e.g. Jens Günther whose replied to this thread, have made custom templates to do this. > Is there any reason why this can't be done? If nobody has tried to do > so yet, I'll give it a try myself, as I'm familiar with django. Thanks. See https://gitlab.com/mailman/mailman/-/issues/901 and https://gitlab.com/mailman/mailman/-/issues/1055 Also see https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… for some documentation of templates, but note that you don't need to set URI's via REST, You can place list specific templates in Mailman's var/templates/lists/<list-id>/<lc>/ directory, domain specific templates in var/templates/domains/<domain-name>/<lc>/ and sitewide templates in var/templates/domain/site/<lc>/ or you can create list and/or domain specific templates via Postorius but see https://gitlab.com/mailman/postorius/-/issues/366 -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: Fwd: Re: Removing a mail addresses and users

by Mark Sapiro

On 6/10/20 3:33 PM, Allan Hansen wrote: > > Some dedicated and skilled developers are currently investing heavily in a replacement for Postorius, but I really believe that any work is better spent transforming Mailman Core etc. into a true account-based system. Then, and only then, will it make sense to build new and better interfaces on top, as, without a healthy core, such interface will currently may have to inherit the confusion and disconnect that currently is so aggravating. I think you misunderstand what Mailman Core currently is. I think Mailman Core's concept of User is exactly what you are talking about when you ask for a "true account-based system". The problem is that Mailman Core was intentionally designed without any web UI and a RESTful API for separate web based UIs or whatever to use to communicate with it. Then the people who developed the web based management UI (Postorius) and archive UI (HyperKitty) chose to develop those within a Django framework and Django has its own concept of User separate from Mailman Core and that is where the disconnect occurs. It's not that Mailman Core lacks what you want. It's that Django doesn't use it. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: Mailman3 don't work if aliases are enabled

by Mark Sapiro

On 10/9/20 3:37 PM, Massimo Zappalà wrote: > > If I try to uncomment the last two rows in main.cf > virtual_alias_maps = mysql:/etc/postfix/mysql_virtual_alias_emails.cf, mysql:/etc/postfix/mysql_virtual_alias_maps.cf > virtual_mailbox_maps = mysql:/etc/postfix/mysql_virtual_mailbox_maps.cf > The aliases and email messeges works fine but the mailman3's mailinglist don't work. > > How can I solve this? I'm not certain about this. The Postfix log entries for the failed delivery to Mailman may help, but I think you deed to configure an alias domain or domains for your list domain(s). The alias domain is not a real domain and is not in DNS. it is any unused domain name and will be known only to Postfix. I typically use x.example.com where example.com is the real list domain. You can set the alias domain for the real domain in the domains view in Postorius. Then you need to add `hash:/var/lib/mailman3/data/postfix_vmap` to your main.cf virtual_alias_maps setting and run Mailman's `mailman aliases` command to generate the proper /var/lib/mailman3/data/postfix_* files. See <https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h…>. You may also need to set relay_domains = hash:/var/lib/mailman3/data/postfix_domains -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 6 months

[MM3-users] Re: Set domain inactive / archive import from other domain.

by Mark Sapiro

On 09/15/2018 07:15 AM, Johannes Winter wrote: > > we've migrated a list from another domain and would like to keep the > archives. Hyperkitty doesn't recognize the emails in the mbox archive > during import due to the other domain name. I don't understand the problem. I just ran a test where I imported a mbox containing 3 messages which were not even list posts and in which I had changed all the domain names to 'example.com'. I.e., in the mbox I imported, the headers containing domain names looked like From root(a)example.com Sun Aug 26 09:12:06 2018 Return-Path: <root(a)example.com> Delivered-To: root(a)example.com Received: by example.com (Postfix, from userid 0) From: Anacron <root(a)example.com> To: root(a)example.com Message-Id: <20180826161158.F154D34010C(a)example.com> X-msapiro-MailScanner-From: root(a)example.com and the 3 messages were all added to the archive. Why do you think the domain name is an issue? Perhaps the issue is there is already one or more messages in the archive and the messages you are importing are older. If you don't specify --since to hyperkitty_import it won't import messages older than the newest message in the existing archive. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 7 months

[MM3-users] Re: non-member moderation: list default vs default processing

by Mark Sapiro

On 5/21/21 3:58 PM, dancab(a)caltech.edu wrote: > > Each time this problem has come up I've had to change the moderation setting from "List Default" to "Default Processing". > But I've also noticed that some non-members were imported and already have "Default Processing" configured. > > Can you help me understand what determines this setting in Mailman3? > > It seems this would be something addressed via the mailman import21 option I've been using to import the lists. It depends in part on the version of Mailman core as `mailman import21` has had some changes, but here's how it should work. Regexps in MM 2.1 *_these_nonmembers are imported into the corresponding MM 3 *_these_nonmembers. Addresses in MM 2.1 *_these_nonmembers are imported into MM 3 as non-members with their moderation_action set to `defer`, `hold`, 'reject` or `discard` according to which *_these_nonmembers they came from. `accept` maps to `defer` and the others to the same. Prior to Mailman 3.3.0, `accept` mapped to `accept` but `defer` is better. This can get very convoluted if the same address is both a member and in *_these_nonmembers, but in both MM 2.1 and MM 3, the member takes precedence. Is this not what you are seeing? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 11 months

[MM3-users] Re: How to store additional information about lists?

by Mark Sapiro

On 5/29/21 7:31 PM, Stephen J. Turnbull wrote: > > There won't be a membership adapter in Systers Mailman if there isn't > one in GNU Mailman, because they used the stock user database and > added fields to the User record to implement their membership > extensions. > > Membership adapter is a Mailman 2 feature that allowed use of an > external membership database (such as a corporate LDAP system). I > thought it was ported to Mailman 3 but maybe not. Actually, it's not quite that simple. Mailman 2.1 defines a MemberAdaptor class, the methods of which are used for everything to do with list members and memberships and are all documented in the base definition in Mailman/MemberAdaptor.py and all raise `NotImplementedError`. Also included in Mailman 2.1 is Mailman/OldStyleMemberships.py which subclasses MemberAdaptor and actually implements the methods, storing the data in the same config.pck pickle as the list settings. Various people have implemented various other MemberAdaptor classes for various purposes. https://bugs.launchpad.net/mailman/+bug/558106 contains several revisions of one using LDAP for the (read only) membership data. The Mailman 3 analog of this is the IMember interface defined in mailman/interfaces/member.py and implemented in mailman/model/member.py -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users]Incorrect URLs

by Mark Sapiro

There are various URLs exposed in various emails from the list, many of which are wrong. The underlying issue is there are generic replacements such as $listinfo_uri and $user_options_uri in various templates such as the welcome.txt list welcome message and the footer-generic.txt message and digest footer. Now that the Mailman 3 core engine has been separated from the web UI, the core doesn't know what these replacements should be and there is not yet an interface to get them from Postorius or whatever the web UI is. In the mean time, I have made list specific versions of welcome.txt (done before announcing the list) and footer-generic.txt (just now) with the correct URLs hard coded. The purpose of this post is two-fold. To explain the issue, and to test the footer. There are probably more of these incorrect replacements and I will fix them as I notice them or they are pointed out to me. Note that I am aware that the https URLs in the List-Subscribe: and List-Unsubscribe: headers added to posts are wrong, but I haven't got a handle on this yet. The mailto: links in those headers are correct as are the Archived-At: and List-Archive: URLs as there is an interface to get those from the archiver. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 years

[MM3-users] Re: What implications do GDPR have on Mailman, and how to requiring members to accept registration

by Mark Sapiro

On 5/17/18 3:35 AM, Henrik Rasmussen wrote: > > I am also concerned that new lists are created with a subscription policy "Confirm" as default, rather than at least "Moderate", which can cause people to be subscribed by others against there will. I'm confused. Confirm sends a confirmation request to the subscribed address which must be acted upon by the user before she is added to the list. Moderate just means approval by an owner/moderator which, it seems to me is more susceptible to a 3rd party subscribe succeeding - i.e., subscription requires membership in some organization. A subscribes B who is a member of the organization but doesn't want to be on the list. The moderator verifies that B is an organization member and approves the subscription. Granted, it may be possible for some brain-dead vacation responder to confirm a subscription request, but that's a separate issue. > Also, regardless of this setting, administrators can subscribe people without their knowledge. Granted that this can be abused, but not allowing admins to directly add members will probably create more problems than it solves. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 11 months

[MM3-users] Re: mail stuck in "out" queue

by Mark Sapiro

On 6/13/20 6:30 PM, Kareem Zidane wrote: > Hi Mark, > > Sorry to bother you! Just wanted to loop back on the above to see if you might have any thoughts on that by chance? I'm sorry, I thought I had replied, but clearly I hadn't. So as I understand it, you have multiple lists in this Mailman 3 installation, and only one list has this issue, and mail to this list gets archived, but not delivered but is queued in var/queue/out and remains there. This is hard to understand. When Mailman's out runner processes its queue, it processes messages in chronological order without regard to which list they are from, so it must be at least attempting to deliver these messages, and somehow failing and requeueing them. I do see this Jun 09 17:36:31 2020 (82) Cannot connect to SMTP server postfix on port 25 in the log excerpt you posted. What's in Mailman's smtp.log and the postfix mail.log that might be related to this? It's hard to understand how an MTA connect issue could affect only one list. If it is accepting the connict and then dropping the connection for too many invalid RCPT addresses, that's a possibility. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: Mailserver Log entries following through mailman?

by Mark Sapiro

On 11/10/23 12:39, Andreas Barth wrote: > > is there some way to find an ID to follow an email through mailman? In > the exim logfile there is only something like C="250 Ok" (whereas in > mails sent to another exim there is something like C="250 OK id=…"). > (What I sometimes need to do is to follow an mail whether it is sent > through mailman and to where.) Every message should have a unique Message-ID: header. According to my reading of https://www.exim.org/exim-html-current/doc/html/spec_html/ch-log_files.html Exim should create a => log entry with an id= field containing the Message-ID when the message is received for delivery to Mailman and another similar entry when the message is received from Mailman for delivery to one or more list members. Mailman itself logs ACCEPT:, HOLD:, DISCARD:, REJECT: and OWNER: entries in mailman.log for those events (OWNER: indicates a message to list owners). All these entries contain the Message-ID. Mailman's smtp.log contains 'post to' and 'smtp to' entries with Message-IDs for all outgoing messages. > Or should I raise an issue as whishlist request? What exactly would you wish for that Mailman can do. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 5 months

[MM3-users] Re: Mailman3 on AlmaLinux 9 - Python3.9 errors

by Mark Sapiro

On 7/1/24 12:34, willie.castillo(a)caemilusa.com wrote: > Hi, I'm trying to configure mailman3 on my AlmaLinux 9 server and when checking the mailman3 status, I get the following: ... > File "<string>", line 8, in run_migrations > File "/usr/lib/python3.9/site-packages/alembic/runtime/environment.py", line 851, in run_migrations > self.get_context().run_migrations(**kw) > File "/usr/lib/python3.9/site-packages/alembic/runtime/migration.py", line 608, in run_migrations > for step in self._migrations_fn(heads, self): > File "/usr/lib/python3.9/site-packages/alembic/command.py", line 309, in upgrade > return script._upgrade_revs(revision, rev) > File "/usr/lib/python3.9/site-packages/alembic/script/base.py", line 435, in _upgrade_revs > return [ > File "/usr/lib64/python3.9/contextlib.py", line 137, in __exit__ > self.gen.throw(typ, value, traceback) > File "/usr/lib/python3.9/site-packages/alembic/script/base.py", line 259, in _catch_revision_errors > raise util.CommandError(resolution) from re > alembic.util.exc.CommandError: Can't locate revision identified by '2156fc3f6f7d' > > > Any ideas why? It looks like your mailman/database/alembic/versions/ directory is missing 2156fc3f6f7d_add_dmarc_addresses.py. What is your mailman version? This migration was added in Mailman core 3.3.9. Possibly your Mailman version is < 3.3.9 but the alembic_version table in your mailman database points to an alembic version not in your mailman core version. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months, 3 weeks

[MM3-users] Re: 501 Message has defects

by Mark Sapiro

On 10/25/24 08:06, jgn1980--- via Mailman-users wrote: > Hi > > I'm using GNU Mailman 3.3.8 (Tom Sawyer) on debian 12, and I have this issue on a scheduled e-mail, every day: > > 2024-10-25T04:00:04.874081+01:00 XXXXXXX postfix/lmtp[29258]: CEB32100F44: to=<XXX(a)XXX.XX>, relay=localhost[127.0.0.1]:8024, delay=0.02, delays=0.01/0/0.01/0.01, dsn=5.0.0, status=bounced (host localhost[127.0.0.1] said: 501 Message has defects (in reply to end of DATA command)) Mailman's LMTP runner is parsing the incoming message and it has defects. To see what the defects are, put the raw message in a file and do the following in `mailman shell` ``` $ mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> import email >>> from mailman.email.message import Message >>> msg = email.message_from_binary_file(open('test.eml', 'rb'), Message) >>> msg.defects ``` This should display the defects. Once you know what the defects are, you may be able to adjust the process that produces the scheduled email to create a message without defects. Also see https://gitlab.com/mailman/mailman/-/issues/351 which we should fix to report and/or log the defects. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 months, 4 weeks

[MM3-users] Re: mail stuck in "out" queue

by Mark Sapiro

On 12/17/24 13:38, pdw(a)mythic-beasts.com wrote: > > I've now found the SHUNT entries and the exceptions seem related to restarting mailman (see below) so that much makes sense. > > unshunting does indeed restore them, but unfortunately they're now back in the looping state. This behavior always seems related to decorate being unable to get templates for for the message header/footer. Does this list define templates for list.member.regular.header or list.member.regular.footer in Postorius? To rule out a template retrieval issue as the cause, you could try this patch to skip decorating the message. ``` --- a/src/mailman/handlers/decorate.py +++ b/src/mailman/handlers/decorate.py @@ -40,6 +40,7 @@ alog = logging.getLogger('mailman.archiver') def process(mlist, msg, msgdata): """Decorate the message with headers and footers.""" + return # Digests and Mailman-craft messages should not get additional headers. if msgdata.get('isdigest') or msgdata.get('nodecorate'): return ``` If you apply that patch and the messages get delivered, albeit without the footer, the issue is definitely in retrieval of templates. You say you have removed the var/templates/list/LIST_ID/* templates, but is there still a var/templates/list/ and a var/templates/list/LIST_ID/ directory and are they searchable by the Mailman user? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 months

[MM3-users] Re: [Django] ERROR (EXTERNAL IP): Service Unavailable

by Mark Sapiro

On 2/22/21 5:47 PM, dancab(a)caltech.edu wrote: > I've imported a list from Mailman2 and had the owner send a message for testing purposes. > > His message are moderated per the list configuration. The message is delivered to Mailman3 and shows that it's being held. > > However if we attempt to view the message in Postorius web UI then an error is thrown. Can you see the message in the held messages view and only get the error when you click the message, or can you not see the held messages view at all? Is it only this list that has an issue? Can you visit other pages for this list? > In the web interface the error is simply "Mailman REST API not available. Please start Mailman core." > > But Mailman Core is running and we can do other functions just fine. Our superuser account receives a much more detailed message with the subject below. > > [Django] ERROR (EXTERNAL IP): Service Unavailable: /postorius/lists/cpa-announcement.caltech.edu/held_messages > > Does "Service Unavailable" mean I'm missing something in the configuration? Possibly, but I don't think so. What is the Traceback from the message Django sends to the server admin? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Re: mailman 2.1 or 3.0 (or another MLM)

by Mark Sapiro

On 1/26/22 08:49, nate wrote: > (In case the list admin/moderator sees this message I sent this email > again from the wrong FROM: address a few minutes ago, re-sending with > the right one now, please discard that bad message(have not > gotten confirmation it was held for moderation) Posts to this list from non-members are discarded without notice. > -- side note with > MM2 it gave the user the option to discard their own message if it > was held for moderation if I recall right. My very first post to > this list was held for moderation (sent from correct FROM: address), > not sure why it was held(it got through eventually), was assuming > that perhaps I triggered a bug in that the fact I am using the > text mailman in my email address maybe tripped something I don't know, > but I was seemingly unable to view the status/discard that message.) Your initial post was held because all new members are moderated by default. This is an anti-spam measure. If you post on topic, we clear your moderation. And yes, Mailman 3 doesn't (yet?) have a way for ordinary users to delete their own held posts. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 2 months

[MM3-users] Re: MASS mailing list import - 900 ezmlm lists to Mailman

by Mark Sapiro

On 4/18/23 17:41, grant(a)horizonsunlimited.com wrote: > Hi, > I hope someone can help. > I have 900-ish, mostly small lists, basically all locations round the globe where people have volunteered to help particular people passing though. Those lists have 2 to 200 people. There are about 50 lists of up to 1000 people each we use for announcements. So two different setups, and a whole lot of manual work. > I am moving from an old, now unreliable, host to a new one. Hopefully reliable, certainly cheaper, and better for privacy GDPR etc regs. > Mailman is already installed, appears to be version 82?? on cPanel 108.0.15. Ezmlm, no surprise, is not. Installing and configuring it is not something trivial, also have to install gmail etc. Yuck. First of all, cPanel Mailman is most likely 2.1.38. This list is for Mailman 3. The appropriate list for Mailman 2.1 is mailman-users(a)python.org <https://mail.python.org/mailman3/lists/mailman-users.python.org/>. This search <https://mail.python.org/archives/search?mlist=mailman-users%40python.org&q=…> finds 169 posts mentioning ezmlm. Some of those might be relevant to importing lists from ezmlm. Also see <https://wiki.list.org/DOC/Mailman%20and%20CPanel> and be aware that Mailman 2.1 is end of life. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years

[MM3-users] Re: Mailing list welcome message won't update

by Mark Sapiro

On 1/16/25 13:43, via Mailman-users wrote: > HI Mark, > > I simply tested by unsubsribing to the mailing list and then re-subscribing to receive the welcome message. > > How do you test using the mailman command with user list? sudo -u list mailman addmembers -h or in your case, you may not have that subcommand in which case see sudo -u list mailman members -h However, that is all irrelevant. I only thought you might be testing by using `mailman` commands to add a member and if so and if the command is not run as user `list`, it might not have access to read the template. If you are (un)subscribing via Postorius or via email these are handled by Mailman runner processes which should all be running as user `list` and should have access to the template. So, as I said, I don't know what the issue is unless it is something with your Debian package which is ancient. Even Debian buster has mailman core 3.2.1. Does your empty list:member:generic:footer.txt work to not add any footer to list messages? If so, I can't think of any reason why your list:user:notice:welcome.txt wouldn't be used. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 months, 1 week

[MM3-users] Re: The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header.

by Mark Sapiro

On 10/22/21 12:53 PM, Marco Marinello wrote: > Dear Mark, > > had > # pip freeze > ... > HyperKitty==1.3.5 > ... > mailman-hyperkitty==1.2.0 > ... > > and got the described behaviour. > Downgraded to > > HyperKitty @ https://gitlab.com/mailman/hyperkitty/-/archive/1.3.4/hyperkitty-1.3.4.zip > mailman-hyperkitty @ https://gitlab.com/mailman/mailman-hyperkitty/-/archive/v1.1.0/mailman-hype… > > and now archiving works. Actually, with HyperKitty==1.3.5 and mailman-hyperkitty <1.2.0, the message is not exactly as in this message's Subject:. It is 'The MAILMAN_ARCHIVER_KEY is now required to be sent over the Authorization HTTP header, you need to upgrade the mailman-hyperkitty package to 1.2.0 or newer. Perhaps you paraphrased the message. If not, that exact message was not in any version of HyperKitty leading up to 1.3.5. And with mailman-hyperkitty==1.2.0, it should work. I see what pip freeze reported, but something was wrong somewhere because that combination should work and the 'The MAILMAN_ARCHIVER_KEY ...' message would only be logged with a version of mailman-hyperkitty <1.2.0. Perhaps you did not realize you had to restart Mailman core and skipped that step. The mailman-hyperkitty module is imported by Mailman core, thus core needs to be restarted if it is changed. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 6 months

[MM3-users] Re: Starting new thread in Postorius -> disappears

by Mark Sapiro

On 11/21/2017 01:53 AM, Thor Atle Rustad wrote: > I have had this working before, so I guess it's a simple setup error. > > When I send a message from the Postorius interface, it is neither sent out > or stored. I briefly see this message: "Your reply has been sent and is > being processed.", and then nothing happens. I assume you mean HyperKitty. Postorius has no facility for posting messages to a list. > I have installed maxking's docker-mailman and copied my old setup with > basic stuff like passwords and such. The only new thing is that I'm now > running in userspace by putting in /etc/subuid and subguid: When you post from HyperKitty, HyperKitty creates a django.core.mail.EmailMessage() instance and calls it's send() method which causes Django to send the message to the list address. It then has to be received and processed by Mailman the same as any email post before it will appear in the archive. Are you running with DEBUG = True. If so, Hyperkitty won't send the mail. If DEBUG = False and normal posting is working, perhaps there is some Postfix issue in delivery of the message from Django to Mailman. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 5 months

[MM3-users] Re: Mailman runners missing - nothing in logs

by Mark Sapiro

On 1/18/20 6:13 AM, Torge Riedel wrote: > > So now back to good. I checked all the logs prior to restarting the > service in directory /opt/mailman/var/log, but I do not see any errors. > And the master was still running, I would expect that the master will > start / restart a runner in case it died? What's in /opt/mailman/var/log/mailman.log? There should be entries like Jan 18 13:51:11 2020 (11700) xxxx runner started. for each runner every time it starts and like Jan 18 13:47:31 2020 (10096) xxxx runner caught SIGTERM. Stopping. Jan 18 13:47:31 2020 (10096) xxxx runner exiting. for each runner every time it stops, but with perhaps a reason other than `caught SIGTERM` That should at least tell you when they stopped. Also, if they stopped for some reason. The master will only restart runners that exit if they exit because of SIGUSR1 or some internal error and even then, only the configured max_restarts number of times. Do you have a logrotate script for the logs in /opt/mailman/var/log, and if so, does it have a postrotate script that signals Mailman to reopen logs other than by a `mailman reopen` command, perhaps by signaling the master with other than SIGHUP? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 3 months

[MM3-users] Re: Bounce counter visibility for List Admins

by Mark Sapiro

On 5/19/21 4:10 AM, smorytko(a)gmail.com wrote: > As you may know, we use MM3 but the Affinity/Empathy flavor and we only have List Administrator using the Postorious/Affinity. Unlike many here, we have no access to any server-based files. > > Can someone tell me if Postorious gives list administrators visibility into the bounce counters? User's bounce scores are not available in REST so neither Affinity nor Postorius has access to them. > While List Admins get to set various bounce counters we have no visibility of those counters until, all of a sudden, an entire source of subscribers hits the bounce threshold and gets bounced off the list. It would be really nice to be able to see the bounce counters and possibly head off trouble before users/subscriber mail hosts. It can serve as an effective early warning system that something is wrong. > > Assuming Postorious cannot, is there another way List Admins can inspect bounce counters? Email command? In the next release of Mailman core (3.3.5), lists will have a `bounce_notify_owner_on_bounce_increment` setting which if True, will send to the list admins a notice including the triggering DSN when a user's bounce score is incremented. This setting will also be exposed in Postorius 1.3.5. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 11 months

[MM3-users] Re: [Mailman-Developers] Mailman 3.1 beta coming soon

by Mark Sapiro

On 12/02/2016 08:07 AM, Barry Warsaw wrote: > Hello Mailman 3 users and developers! > > It's been a long slog but I think we are finally ready to begin the release > process for Mailman 3.1. I am pretty happy about the state of the Core, and > Florian is going to do some more integration testing with HyperKitty and > Postorius. We still have a few issues and a merge proposal or two to address, > but I am planning to spin a beta of Core this weekend to facilitate testing. Barry, I understand you need to feel comfortable about everything going into the core and this takes time and energy to review all the MRs, but I think it is pretty important to get the DMARC mitigations into the core. If there's anything I can do to help with this, let me know. I will rebase my branch again and possibly make one minor tweak, but I think it should be OK. I can also work on Postorius. Also in this vein I have a question. Should the DMARC settings be added to the Alter Messages tab in the List Settings view or would it be better to have a separate DMARC Mitigations tab. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 years, 4 months

[MM3-users] Re: hyperkitty_import Unicode Errors

by Mark Sapiro

On 5/6/23 11:27, Dave Hall via Mailman-users wrote: > Hello. > > When running hyperkitty_import to import Mailman 2.1 archives, I frequently > get errors like > > django.db.utils.OperationalError: (1366, "Incorrect string value: > '\\xE1\\x90\\xA7\\x0A\\x0AO...' for column > `mailman3web`.`hyperkitty_email`.`content` at row 1") > > Is there a known cause for this? Is it fixed in some release more recent > than 0+20180916? I'm not sure what's going on here. My first thought is the database is MySQL or MariaDB and this is a 4-byte UTF-8 encoding and the database column charset definition is utf8 and not utf8mb4, but '\\xE1\\x90\\xA7\\x0A\\x0A' is the 3-byte UTF-8 encoding for CANADIAN SYLLABICS FINAL MIDDLE DOT ('\\xE1\\x90\\xA7') followed by two newlines. so I'm not sure what the issue is. When you encounter this error, there should also be a message like "Message <Message-ID> failed to import, skipping" or perhaps "Failed adding message <Message-ID>: <error message>". Using that Message-ID value, you should be able to find the original message in the input mbox. I would like to see that mbox message. You can remove any personal info. I only really need the message body and any Content-*: headers. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: MM3 Postfix FROM header issue

by Mark Sapiro

On 12/17/23 1:20 PM, eboltz(a)lhtservices.com wrote: > Okay, created a new Mail Host with only 'list.example.com' and no alias domain. I then created a new list and tried subscribe/unsubscribe but got the following error message in mail.log file > > Dec 17 21:14:26 mailman3 postfix/smtpd[6649]: 057E744552: client=localhost[127.0.0.1] > Dec 17 21:14:26 mailman3 postfix/cleanup[6653]: 057E744552: message-id=<170284766462.1144.7361224077829393518(a)ec2-54-172-107-21.compute-1.amazonaws.com> > Dec 17 21:14:26 mailman3 postfix/qmgr[6644]: 057E744552: from=<list_test-bounces(a)lists.example.com>, size=908, nrcpt=1 (queue active) > Dec 17 21:14:26 mailman3 postfix/smtpd[6649]: disconnect from localhost[127.0.0.1] ehlo=1 mail=1 rcpt=1 data=1 quit=1 commands=5 > Dec 17 21:14:27 mailman3 postfix/smtp[6654]: 057E744552: to=<eboltz(a)lhtservices.com>, relay=mail.smtp2go.com[45.79.114.202]:587, delay=1, delays=0.01/0.01/0.52/0.46, dsn=5.0.0, status=bounced (host mail.smtp2go.com[45.79.114.202] said: 550-From header sender domain not verified (lists.example.com) 550-On your Sending > Verified Senders page 550 verify the sender domain or email to be allowed to send. (in reply to end of DATA command)) Your relay host doesn't like lists.example.com as a sender. You need to fix this on the relay host mail.smtp2go.com. It seems to say that you need to go to the Sending > Verified Senders page on the relay host and add lists.example.com. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 4 months

[MM3-users] Re: Changes in Django admin interface are not syncing to postorius gui /database

by Mark Sapiro

On 11/11/24 04:17, Ulf R. wrote: > Now remains one question: We have a (internal) Active Directory (AD) Authentication for Mailman3. > So everyone who wants to work as an owner nor moderator must be an AD-User. > In hyperkitty I am able to assign these list rights directly to AD-Loginnames. > With the logic above I have to assign these rights in postorius too by assining the mail address of the users AD-Account? (I see no AD-Data here). You are conflating Postorius, which is simply a web management UI for Mailman core, with Mailman core itself. I suppose it's not really important, but when you think of access rights in Postorius, these are actually in mailman core. > Or would it works to assing the mail address of the users AD-Account first an then the allocation will automaticly synced to hyperkitty - maybe using the mail address as key? > What would be the best practice for owner/moderator user management? Just ensure that list owners and moderators are using the email address of their AD-Account. This will propagate to HyperKitty. You shouldn't need to manipulate HyperKitty access rights directly at all. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 months, 1 week

[MM3-users] Re: Getting an error for every post made to any list

by Mark Sapiro

On 4/22/25 1:35 PM, sun zi via Mailman-users wrote: > As mentioned in the subject, I am getting the following error after every post. Any assistance would be much appreciated: The error is from an attempt to archive a message. Since it fails, the problem message is queued in Mailman's var/archives/hyperkitty/spool/ directory and is retried with each post. The message is in a Python pickle, *.pck, file in that directory. Yoy can examine the message by giving it to `mailman qfile`. From the tracebacks you posted, it appears that the issue is that the sender's address is longer than 255 bytes. Move the .pck file out of the var/archives/hyperkitty/spool/ directory and that will stop the recurring error. If the message is spam you can ignore it. If you want to archive it you need to edit the message's sender, but you can't edit the *.pck directly. You can use `mailman shell` and do something like ``` import pickle with open('path/to/the/pickle', 'rb') as fp: msg = pickle.load(fp) # code here to edit the sender with open('path/to/the/pickle', 'wb') as fp: msg = pickle.dump(msg, fp) ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 day, 7 hours

[MM3-users] Re: very few moderation capabilities for moderators

by Mark Sapiro

On 9/18/21 1:41 AM, Guillermo Hernandez (Oldno7) via Mailman-users wrote: > > I've been trying to "translate" the python script that I made for > mailman2 to new mailman3, but obviously, I'm missing something. It seems > that mailman cannot locate the "module" needed. > > The script is named "moderar.py": > > *-*-*-*-*-*-*-*-*-* (begin of /usr/local/mailman3/moderar.py) > > /usr/local/mailman3 # cat moderar.py > #! /usr/local/bin/python3 > # > # script via withlist para moderar a pelo en mailman3 > # > > import os > import sys > > sys.path.insert(0, '/usr/local/mailman3') If /usr/local/mailman3 is not already in the path, this is too late. The rest of your script is not relevant. Here's what you need: ---------------------------------------------------- from mailman.interfaces.action import Action def moderar(mlist, member): memb = mlist.members.get_member(member) if not memb: print('{} is not a list member.'.format(member)) return memb.moderation_action = Action.hold print('{} moderation_action set to hold.'.format(member)) ---------------------------------------------------- That should be put in a moderar.py file somewhere in Mailman's path. The same directory that contains the `mailman` command is for sure good. Possibly that's /usr/local/mailman3/bin/. Then mailman withlist -r moderar -l list_to_use(a)mydomain.com address(a)moderate.com should work. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 7 months

[MM3-users] Re: Internal Server Error: Reattach this thread

by Mark Sapiro

On 10/18/22 21:38, hasimoto(a)designet.co.jp wrote: > Hi, > > In the archive, clicking "Reconnect this thread" causes an internal server error. > I received the following email, but I don't know how to solve it, please help me. How big is the archive in which you are doing this? Are you running the periodic django-admin jobs via cron? See https://gitlab.com/mailman/hyperkitty/-/blob/master/example_project/crontab I ask because I've now seen this issue in a test installation, but only with an archive containing only one message. The particular steps I followed somewhat by accident were: Start with an archive containing only two messages in separate threads. Open one thread and `Delete this thread` leaving only one thread. Open that thread and click `Reattach this thread` - this produces the error. Restore the deleted message/thread with `hyperkitty_import` Clicking `Reattach this thread` in either thread produces the error. After running the hourly and daily django-admin jobs, clicking `Reattach this thread` in either thread works as expected. That scenario with deleting and restoring a thread was somewhat accidental, but did produce the error. in other list archives on the same server, even one containing only one message, clicking `Reattach this thread` in either thread works as expected. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 5 months

[MM3-users] Re: certain msgs not archived

by Mark Sapiro

On 2/17/22 10:49, Sandor Dibuz wrote: > > Great! So valuable info. Thank you, Mark. "earlier that the oldest > message" you sure mean earlier then the oldest of already archived. Or > since= any date of the mbox messages to be imported. Will check the > hyperkitty_import for since= option format. That was a typo. I meant "earlier than". I tend to use `since=1970-1-1`. It doesn't matter how early as long as it's earlier than the oldest message to be imported. > Yet another question. Is it supposed to stop minutely/hourly/etc. > mailman3-web cron jobs during import to avoid any collisions? Or even > mailman3-web completely but probably it needs to be running. I only ask > because my last import attempt on a test maillist failed with > > [ERROR/MainProcess] Failed indexing 1 - 2 (retry 5/5): (1712, 'Index > hyperkitty_attachment is corrupted') (pid 5841): (1712, 'Index > hyperkitty_attachment is corrupted') > > Optimizing cured the hyperkitty_attachment InnoDB index corruption > problem but scared the sh.. out of me for a moment... I don't know what may have caused the index corruption. I don't bother to stop any crons or services while hyperkitty_import is running and I've never had an issue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 2 months

[MM3-users] Re: Mailman3 on virtual domains

by Mark Sapiro

On 10/7/23 09:25, Lars Bjørndal wrote: > [Mark] > > [...] > >> See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… > > Ok, so I have to create an alias_domain in Mailman. Is it possible to do that from the web interace? It has been in postorius since 1.2.0. > I find an Edit button for each domain, and then I may change name and description. But I can't find an option to add an alias_domain. As I'm blind, and using a text only browser, some information may have been missing. Or can I do it from the command line? If your Postorius is >=1.2.0, there should be 3 fields on the Edit domain page - Description, Alias Domain and Web Host. The whole page looks something like: Edit domain example.com Description Alias Domain Normally empty. Used only for unusual Postfix configs. Web Host The domain from which you want the web UI to be served from. This can be same or different from the Mail Host. You can edit the list of available web hosts here. You can also set an alias_domain in `mailman shell`. E.g., ``` >>> domain = getUtility(IDomainManager).get('example.com') >>> domain.alias_domain = 'x.example.com' >>> commit() ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 6 months

[MM3-users] Re: ARC signing outgoing mails

by Mark Sapiro

On 11/1/19 4:04 PM, Wolfgang Bock via Mailman-users wrote: > > Hello, > > in > https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/arc_sign… > I found this hint > > "It is highly recommended that Mailman maintainers configure ARC siging > of their outgoing email. ..." > > So I added in my mailman.cfg: > " > [ARC] > privkey: /path/to/private.key > " > > > But I don't understand the meaning of > > > "... and located at: > " > #{config.ARC.selector}._domainkeys.#{config.ARC.domain} –ex.– > test._domainkeys.example.com > " This doesn't seem correct. The DNS TXT record should be added to #{config.ARC.selector}._domainkey.#{config.ARC.domain} (note _domainkey, not _domainkeys) I.e., this is a normal DNS TXT record containing the public key for DKIM signing. > Where can I find this string or where do I have to place it. I am using > bind9 as dns-handler. Read the entire ARC section beginning at <https://gitlab.com/mailman/mailman/blob/master/src/mailman/config/schema.cf…>. You have to configure more than just privkey. Once you have configured enabled: yes privkey: /some/location/yourprivatekey.pem selector: test (or whatever you want) domain: your_domain.com The substitutions for #{config.ARC.selector} and #{config.ARC.domain} should be more clear. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 5 months

[MM3-users] Re: Must every Moderator/Admin be member of a list to be able to use Postorius?

by Mark Sapiro

On 1/31/23 10:25, mm3-omf(a)sh.werbittewas.de wrote: > we're using debian/devuan with distribution-mailman3 and tried to add > admin/mod for a list, but if logging in as this user, there's no item to > manage the list at all. That's strange. If the logged in user is a moderator she should see the Subscription requests and Held messages tabs and with Postorius >= 1.3.9b1 also the Members tab, and if she is an owner she should see the full admin UI without needing to be a member. Are you sure the logged in user is the same user that's an owner/moderator? Log in as a superuser and find the user in the User's view fron the top nav bar in Postorius, click Manage to see all that user's roles and web account. > do we have to add this user as member of this list? > (that wouldn't be nice, because the user doesn't want to get normal > Mails from List, but only admin-Mails) It shouldn't be necessary, but a delivery can always be disabled for a member. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 2 months

[MM3-users] Re: Sending a message to a subscription applicant when a subscription request is made

by Mark Sapiro

On 3/28/23 09:19, Allan Hansen wrote: > Mark, > > I tried doing this. > I unsubscribed myself from a list, set the policy as you suggest and re-applied. > I got no confirmation messages but as moderator I got the moderate message. How did you reapply? with the subscribe policy confirm then moderate a new subscriber should get the list:user:action:subscribe message and have to confirm before the request waits moderation? However, see below. > I then tried a bogus email and saw that a message was sent to that and no moderator message to me. > Would the server skip the verification message because I'm a moderator/admin? It's not because you are an admin. It's because you were logged in when you subscribed from the list's info page. You will need to confirm if you subscribe anonymously without logging in or subscribe via email, but if you are logged in to Postorius when you request subscription, that is sufficient confirmation that the request really comes from you, so you don't get an email confirmation. So, depending on your circumstances, this may or may not work for you. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years

[MM3-users] Re: "Cannot connect to SMTP server localhost on port 25"

by Mark Sapiro

On 9/22/19 2:11 AM, Manos Pitsidianakis wrote: > > mailman3 tries to get the template I've set via the mailman suite > interface but it assumes it is hosted locally: > 'http://localhost:8000/mailman3/api/templates/list/meli-announce.meli.delive…' > In my setup, they are separate machines. I can't find any way to change > this in the configuration. Also, can't the same template be loaded from > the master's localhost:8001 api? See <https://mailman.readthedocs.io/en/latest/build/lib/mailman/rest/docs/templa…>. There are other ways to set the URI for a template which will work in your case. When you set a template via Postorius, it sets the URI for that template to point to itself to return what it set. In your case, this URI points to localhost which is Postorius' localhost, but it is set in core and core's localhost is a different machine so it doesn't work. You could file an issue at <https://gitlab.com/mailman/postorius/issues> about this. > Haven't fiddled with python for some time, why is this exception catched > by "except socket.error"? Is it a subclass of > requests.exceptions.ConnectionError? The other way around. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 7 months

[MM3-users] Re: Setting for archiving multi email domains?

by Mark Sapiro

On 3/9/21 4:05 PM, Duane Raymond wrote: >> As I said there, Mailman is going through the roster of regular >> (non-digest) list members to find those with delivery enabled and it >> finds a member that has no associated address. Can you view the members >> of this list? > > Yes - the list has three members (test list): me and two others. For my subscription I have gone through the membership options and explicitly set them. For the others their membership options are all unselected and thus I assume defaulting to a fallback value. (not sure if that matters) What matters is at least one of those members doesn't have an associated address record. If you have access to `mailman shell` do the following: mailman shell -l LIST_ID Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the LIST_ID mailing list >>> for mbr in m.members.members: ... if mbr.address is None: ... print('user: {}, user.addresses: {}'.format( ''' mbr.user, mbr.user.addresses)) ... And see what that gives you. (At the last ... prompt just type `enter`) -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: No digest.mmdf

by Mark Sapiro

On 3/28/21 8:18 AM, Christine wrote: > I have mailman3 running now, more or less. Mailman did not send messages > to my list, giving a permiission error on the digest.mmdf file, which > was not there. I created the file and made list.list the owner, now it > sends messages. > I don't know what should have created the file or what set the > permissions to the directory, I just thought I'd let you know. Mailman core creates and writes the lists/LIST-ID/digest.mmdf file to accumulate messages for the digest. When a digest is sent the file is removed only to be recreated on the next post, and you will probably run into this issue again. The issue is the user that Mailman core is currently running as does not have permission to create that file. This usually results from having run core as root at some point in the past causing some files and directories to have been created by root and not writable by the mailman user now running core. You need to ensure that Mailman processes are always run as the Mailman user, often `mailman` but in the case of Debian/Ubuntu packages, `list`. You probably need to ``` sudo chown xxx:xxx path_to_mailman_var/ ``` where xxx is the Mailman user. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years

[MM3-users] Re: "autorespond to list owner" setting when importing from mailman2 to mailman3

by Mark Sapiro

On 2/25/22 08:32, bob B via Mailman-users wrote: > In mailman2 a list was moderated, the admin would also get an email to approve the message, our lists mainly have admins and no moderators. The admins did the moderation. > > In mailman3 it looks this is now a setting "autorespond to list owner" was this a setting in mailman 2? Yes, in MM 2.1 this was in the Auto-responder section of the admin UI, but this isn't what you wan. > Anyway, in importing email list from mailman 2 to 3, it appears that this setting is set to "No automatic response", is that right? Probably. It is =correct if that was the MM 2.1 setting. > So does this means if I import all my lists from mailman 2, then the admins will not get moderation notifications until I make that setting change on each list? No. The setting you want was Mailman 2.1's General Options -> admin_immed_notify which should be correctly imported to what Postorius shows as Settings -> Automatic Responses -> Admin immed notify and whether that is Yes or No, they should get periodic notices as long as cron is running `mailman notify`. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 1 month

[MM3-users]Re: Sass and where to find core rest logs

by Mark Sapiro

On 05/04/2016 09:45 AM, Andrew Hodgson wrote: > Anyway, I have compiled Mailman3, and the web interface is coming up. Bringing up the list of lists initially gave me an exception, and I saw a 5xx error in the mailman.log file in /opt/mailman/var/logs. I read up on this and as a result downgraded Falcon<1.0 in the Python 3.4 venv. > > I am still unable to browse the list of lists with a 500 error, only this time I am not getting an entry in the mailman.log indicating there is an issue, and I am wondering if there are more detailed logs that can be switched on? There are the web server logs and there is the mailman-web configured in LOGGING:handlers:file in (using bundler) mailman-bundler/mailman-web/production.py (or testing.py). The production default is /var/log/mailman-web/mailman-web.log; the testing default is /opt/mailman/var/mailman-web/hyperkitty.log. > The other question I have is on Sassc. I believe the default Mailman web interface has now switched to the Ruby implementation of Sass, but is this correct? The documentation on the Mailman-Bundler site seems to suggest that Sassc is still the default. I think the bundler doc is out of date on this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 years, 11 months

[MM3-users] Re: How to promote non-members to members?

by Mark Sapiro

On 3/17/22 12:25, Quanah Gibson-Mount wrote: > > I've done nothing in regard to this user. Neither command returns > anything. Well, something has deleted the user, but ... >> If the user is gone, you should be able to replace >> ``` >> ... sub_mgr.confirm(token) >> ``` >> in the above with >> ``` >> ... wfm = getUtility(IWorkflowStateManager) >> ... pendings.confirm(token, expunge=True) >> ... wfm.discard(token) >> ``` >> to clear the pending subscription and workflow and then be able to mass >> subscribe the user. > > I did this, and can confirm that they no longer show up in the list of > pending subscriptions via the mailman shell interface for that list. > > However, if I go to mass subscribe them via the interface, I get: > > HTTP Error 409: b'Subscription request already pending' I don't understand. If there is no entry for that address when you do ``` >>> for token, data in pendings.find(pend_type='subscription'): ... if data['token_owner'] != 'subscriber': ... continue ... if data['email'] != 'user(a)example.com': ... continue ... print(data['email']) ... ``` You should not be getting that 'Subscription request already pending' response. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 1 month

[MM3-users] Re: Moderation request email from a non existing user

by Mark Sapiro

On 5/31/22 02:15, David Lopez via Mailman-users wrote: > Every day mailman (MM 3.3.3 (Tom Sawyer)) sends me an email with a held unsubcription request from X user. This user is not subcribed to that list anymore but every day an email is sending to the list owner. On the web interface there's nothing pending for approval or similar. Is there anyway to avoid receiving this anoyning email every day? Thanks in advance. Postorius >=1.3.5 has an `Unsubscription Requests` choice in the `Subscription requests` pull down. This choice will list the request with and allow you to delete it. For earlier Postorius this needs to be done via the REST API or via mailman shell. For example: ``` $ bin/mailman shell -l list(a)example.com Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the list(a)example.com mailing list >>> pendingsdb = getUtility(IPendings) >>> for token, data in pendingsdb.find(m, pend_type='unsubscription'): ... if data['token_owner'] == 'moderator': ... pendingsdb.confirm(token) ... data about the request will be displayed here >>> commit() >>> ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 10 months

[MM3-users] Re: Performance issues with Mailman 3

by Mark Sapiro

On 10/6/22 15:08, Wong, Wesley wrote: > Hi, I am having some performance problems with Mailman 3 (version 3.3.5) when it sends out a lot of messages to people. We recently migrated from our old Mailman 2.1.x system to Mailman 3.x about 3 months ago. We host about 350 lists with membership counts varying between 10 to 1500 members on some of the lists. I noticed that outbound messages from Mailman to our outbound SMTP are getting delayed up to an hour when Mailman is processing a lot of messages going to lists. I suspect the difference is your Mailman 3 instance has full VERP enabled and your Mailman 2.1 instance did not. I.e., In MM 2.1, you did not override the default `VERP_DELIVERY_INTERVAL = 0` in mm_cfg.py, but in MM 3 you have `verp_delivery_interval: 1` in the `mta` section of mailman.cfg. > I was wondering if there are good performance tuning tips to be considered for Mailman 3 (i.e. OS, database and/os Mailman Core). I am running the setup on a VM. Here is my configuration for VM and OS: Search the Titles for `performance` at https://wiki.list.org/. The articles you find are all written for MM 2.1, but you're really dealing with the MTA and the issues are the same for MM 3. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 6 months

[MM3-users] Re: running a script for the mailman-shell (to discard held messages) gives errors about a package argument for relative import

by Mark Sapiro

On 6/15/24 03:10, via Mailman-users wrote: > > Now, obviously, I put these exact lines in a script, so I don't have to type it out every single time, and try to run it using > >> sudo -u list mailman shell -l testlist.our-server.de -r ./mm_discard_held.py > > but that invariably gives me ... > TypeError: the 'package' argument is required to perform a relative import for './mm_discard_held' To run a script named mm_discard_held.py in that way, the script must define a function mm_discard held. The content needs to be something like ``` from mailman.app.moderator import handle_message from mailman.config import config from mailman.interfaces.action import Action from mailman.interfaces.request import IListRequests # The above are needed. These imports are done automatically when # running mailman shell interactively, but not when running a script. def mm_discard_held(mlist) rdb = IListRequests(mlist) for req in rdb.held_requests: if req.request_type == RequestType.held_message: config.db.commit() ``` See `mailman shell --details` > I've tried moving it to the path where the mailman binary lives, as suggested. That is what you should do. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

10 months, 1 week

[MM3-users] Re: Pck files stuck in out queue

by Mark Sapiro

On 2/7/25 10:08, Lieuallen, Thomas Otis via Mailman-users wrote: > > I have a remaining issue that baffles me. With my test list, I created a template for ‘list:member:regular:header’. It just has text in it, keeping it simple. I create it and see the entries in the database tables and they are correct. However, when I send a test email, my template text is not inserted, but instead another simple text: “testing hello”. I do the same with list:member:regular:footer, and it works just fine. It is just the header that is working incorrectly. When I remove that postorius header template for the list, that ‘testing hello’ goes away. So, it’s only appearing when I have a postorius template setup for that list. What do you get from the following database queries? SELECT * FROM template WHERE name = 'list:member:regular:header'; SELECT * FROM postorius_emailtemplate WHERE name = 'list:member:regular:header'; Depending on your installation, these tables may be in separate databases, i.e., template table in mailman db and postorius_emailtemplate in mailmanweb db. And what do you get if you go to the uri in the result(s) from the first query? The context in the first results and maybe the second results should also be a clue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 months, 2 weeks

[MM3-users] Re: Log rotation

by Mark Sapiro

On 04/10/2018 03:39 PM, Abhilash Raj wrote: > Yes, this is a known thing and the reason for it is that the SIGTERM isn't delivered till the process wakes up next time. We can have the process sleep for a smaller amount of time to fix this, but then it would mean that it will be running much more often. > > It is the Retry runner, which has sleep_time set to 15m. I don't know if you want to retry very often, like 2min or 5min, but you can change it by adding the following snippet to your mailman.cfg A long time ago (in a galaxy far away) Mailman 2.1 had a global DELIVERY_RETRY_WAIT setting. This setting had been ineffective for years, relying instead on the retry runner's sleep time. In 2.1.26, for what turned out to be a probably spurious reason, I made DELIVERY_RETRY_WAIT effective again, although the retry runner still sleeps for 15 minutes. We could implement something similar in MM 3 to allow the retry runner to have a much shorter sleep time without actually retrying the delivery that often. The down side of that is even though we aren't retrying delivery each time the runner wakes up, we are dequeueing and requeueing the message each time and this would have a file system impact. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years

[MM3-users] Re: Recommended way to backup a mailman3 instance

by Mark Sapiro

On 4/13/20 3:22 AM, Andrew Hodgson wrote: > > I was working round my own backup strategy a few weeks ago as I discussed earlier on this list. One thing I found when the directory structure that Mailman Core uses is that the lists directories do not get re-created when Mailman Core starts if they don't already exist. Is this something that should happen, and when would those directories get created? Every other directory did get re-created. > > In my case I was moving from a Dockerised installation to one using venvs, and as the directories from the Docker installation were empty as there hadn't been any postings for a few days, I didn't transfer those over. I created the list directories myself and everything carried on. These var/lists/<list-id>/ directories hold the digest.mmdf files which are mailboxes containing the messages for the next digest. A list post will be added to the digest.mmdf file which will be created if necessary, but if the var/lists/<list-id>/ directory doesn't exist, the create will fail. Thus, the var/lists/<list-id>/ directories need to exist. Normally, they are created when the list is created so they need to be part of a backup. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years

[MM3-users] Re: Restore/export existing Mailman lists + hyperkitty archives on a new server

by Mark Sapiro

On 9/15/22 23:10, Kimmo L wrote: >> Those errors should result in the affected messages being saved as *.pck >> files in Mailman's var/archives/hyperkitty/spool/ directory. Possibly >> there is only one such 'bad message' which is retried each time there is >> a new post resulting in the same error. How many such files are there? >> If only one, please send me that one too. Also, these can be examined >> with mailman qfile. > There was 3 file. I used the mailman qfile command and the output was this: > [----- start pickle -----] > <----- start object 1 -----> > Traceback (most recent call last): ...> File "/usr/lib64/python3.9/email/generator.py", line 239, in _handle_text > raise TypeError('string payload expected: %s' % type(payload)) > TypeError: string payload expected: <class 'list'> These again are anonymized posts that had important headers removed because of the incorrect anonymous_list_keep_headers setting. > After i cleaned up /var/archives/hyperkitty/spool folder, mailman.log file is much cleaner and i dont see any new no "Message-ID" error at the moment. Yes. Now that you have the default anonymous_list_keep_headers setting things should be OK going forward. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 7 months

[MM3-users] Re: Is there a way of recording bounce messages?

by Mark Sapiro

On 9/27/23 06:35, Mohsen Masoudfar wrote: >>> I am interested to know more about the reasons behind these bounces, they are all handled by Postfix and deleted. ...>>> Is there a way to send them to a mailbox? Or prevent them from being deleted, so that I can look into the message body? Presumibly you have settings for Postfix like those at https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… or https://docs.mailman3.org/en/latest/install/virtualenv.html#setup-mta The simplest way is to deliver bounces to some user instead of Mailman. This will disable automated bounce processing for the list so it should be done temporarily only to see a few bounce messages and then reverted. Lets say you have a few problem lists, list1(a)example.com and list2(a)example.com. Put the following in Postfix main.cf ``` virtual_alias_domains = example.com virtual_alias_maps = regexp:/etc/postfix/temp-aliases ``` Then create /etc/postfix/temp-aliases with this content ``` list1-bounces(a)example.com user(a)example.net list2-bounces(a)example.com user(a)example.net ``` where user(a)example.net is the address that should receive the bounces. There are also ways to save copies of all mail received by Postfix. See, e.g., https://www.electricmonk.nl/log/2015/03/06/keep-an-archive-of-all-mails-goi… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 6 months

[MM3-users] Re: Weird behavior with Outlook and any MM3 List

by Mark Sapiro

On 11/1/23 09:42, Thomas Ward via Mailman-users wrote: > I'm seeing some *really* odd behavior with Mailman 3 and Microsoft Outlook clients (even Outlook Web Access). > > When messages come in with a subject prefix, of any way shape or form, Microsoft Outlook seems to *completely strip* the prefixes from any "reply" sent, which could be problematic. > > While the "In-Reply-To" header is still intact and such, Microsoft just seems to 'strip' prefixes from subject lines and that causes a problem in some cases. > > Has anyone observed this behavior before? If so, have you found any workarounds? This is a Microsoft/Outlook issue. As you note at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… this is just the way Outlook displays the message subject. I know of now way around this, but I don't use Microsoft MUAs. Does Outlook also strip the prefix from replies? This probably wouldn't matter for replies to the list as the list will add it back, but might be an issue for other direct recipients. Presumably, Outlook is looking at the [] around the prefix. You might try either dropping the brackets or using something else such as _My-List_ instead of [MyList]. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 5 months

[MM3-users] Re: Permission denied for fulltext_index

by Mark Sapiro

On 11/30/22 08:41, Jan Eden via Mailman-users wrote: > > Changing the PATH value to a full path (/opt/mailman/fulltext_index) > and restarting mailman-web generates a different error: Yes, it should be a full path. >> ERROR 2022-11-30 16:38:37,953 1028315 django.request Internal Server Error: /archives/list/testing@lists.eden.one/thread/T6MCILAVQYV5QIOGHJB3JNJ26Z7E2Z35/reattach-suggest >> Traceback (most recent call last): >> File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/handlers/exception.py", line 55, in inner >> response = get_response(request) >> File "/opt/mailman/venv/lib/python3.10/site-packages/django/core/handlers/base.py", line 197, in _get_response >> response = wrapped_callback(request, *callback_args, **callback_kwargs) >> File "/opt/mailman/venv/lib/python3.10/site-packages/hyperkitty/lib/view_helpers.py", line 137, in inner >> return func(request, *args, **kwargs) >> File "/opt/mailman/venv/lib/python3.10/site-packages/hyperkitty/views/thread.py", line 454, in reattach_suggest >> sugg_thread = msg.object.thread >> AttributeError: 'NoneType' object has no attribute 'thread' This says that searching the archive for this list for messages matching the current message subject returns None. It is probably a bug that we don't test for this, but what exactly are you doing? See the post at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… for the only way I've been able to create an error like this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 4 months

[MM3-users] Re: Strange URL in error message

by Mark Sapiro

On 7/17/24 11:47 PM, waps(a)tantalus.jena.thur.de wrote: > Hi Mark, > thanks for your patience. But now I get a little spinning wheel on the archive site, 3 "Error 500" in the Browser console and /var/log/mailman3/web/mailman-web.log shows repeatedly the error: > > ERROR 2024-07-18 08:34:38,261 1760 django.request Internal Server Error: /mailman3/hyperkitty/list/latex-team(a)latex-project.org/posted-to > Traceback (most recent call last): ...> File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 435, in get > raise self.model.DoesNotExist( > hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not exist. > > Since the archive is still quite empty and we have only one mailing lis, it would not be a big loss if it could resettet. But how I can do the, without resettinh the member data? Could it be that the Sqlite interface is not as stable as one the the "real databases"? As a superuser, you can go to /mailman3/hyperkitty/list/latex-team(a)latex-project.org/ and delete the archive. This will not delete the mailing list, and an empty archive will eventually be recreated, and new posts will be archived. Regarding the issue, see https://gitlab.com/mailman/hyperkitty/-/issues/504. Ensure that cron is running the Django hourly, daily, etc. tasks and that qcluster is running. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months

[MM3-users] Re: How to identify the exact reason behind the shunting of the mails ?

by Mark Sapiro

On 6/18/21 3:34 AM, Shashikanth Komandoor wrote: > Thank you Mark for your immediate response. > > The below are the tracebacks I could find in the mailman log. > > *Jun 17 19:04:08 2021 (8642) Uncaught runner exception: sequence item 0: > expected str instance, Header foundJun 17 19:04:08 2021 (8642) Traceback > (most recent call last): File > "/var/lib/mailman/mailman/src/mailman/core/runner.py", line 173, in > _one_iteration self._process_one_file(msg, msgdata) File > "/var/lib/mailman/mailman/src/mailman/core/runner.py", line 266, in > _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File > "/var/lib/mailman/mailman/src/mailman/runners/pipeline.py", line 37, in > _dispose process(mlist, msg, msgdata, pipeline) File > "/var/lib/mailman/mailman/src/mailman/core/pipelines.py", line 50, in > process handler.process(mlist, msg, msgdata) File > "/var/lib/mailman/mailman/src/mailman/handlers/avoid_duplicates.py", line > 59, in process addrs = getaddresses(msg.get_all(header, [])) File > "/usr/lib64/python3.6/email/utils.py", line 112, in getaddresses all = > COMMASPACE.join(fieldvalues)TypeError: sequence item 0: expected str > instance, Header foundJun 17 19:04:08 2021 (8642) SHUNTING: > 1623936848.367641+4753f8127953071ddcabfe828ebe72fcf04d0ae2* This is https://gitlab.com/mailman/mailman/-/issues/881 which is fixed by https://gitlab.com/mailman/mailman/-/merge_requests/841 which will be in Mailman 3.3.5 when it's released. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: There are currently no mailing lists!?

by Mark Sapiro

On 7/22/24 11:05, Christian via Mailman-users wrote: > I recently upgraded Debian 10 'buster' and when I logged in to Postorius in > the browser I got the ' Mailman REST API not available. Please start Mailman > core' message. So I started it up from the command line doing 'sudo -u > mailman /opt/mailman/mm/venv/bin/mailman start -f' which yielded > > Starting Mailman's master runner > Generating MTA alias maps > mailman@lists: > > Now when I do ' https://lists.ccalternatives.org/mailman3/lists/?all-lists' > in my browser I get the message ' There are currently no mailing lists.' > Meanwhile their archives exist. Are the lists actually gone or ? I suspect the lists are not gone. I suspect mailman core is not using the correct database. I also note you started mailman core with sudo -u mailman /opt/mailman/mm/venv/bin/mailman start -f Are you using the Debian packages or did you install Mailman following https://docs.mailman3.org/en/latest/install/virtualenv.html Assuming the latter, what do the following show? sudo -u mailman /opt/mailman/mm/venv/bin/mailman lists sudo -u mailman /opt/mailman/mm/venv/bin/mailman info In particular does `mailman info` report the correct path to mailman.cfg and the appropriate database? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 months, 3 weeks

[MM3-users] Re: Mailman 3 on Ubuntu 18.04

by Mark Sapiro

On 12/9/18 12:53 PM, Odhiambo Washington wrote: > On Sun, 9 Dec 2018 at 22:37, Mark Sapiro <mark(a)msapiro.net> wrote: >> >> The nginx logs generally aren't too useful. Both Mailman core and Django >> write logs. Core's log is probably in var/log/mailman.log where is >> defined in mailman.cfg as var_dir. Django's log is defined in Django's >> settings in the LOGGING setting. >> > > Which file contains Django's settings? See <http://docs.list.org/en/latest/pre-installation-guide.html#django-knowledge>. >>> Ultimately I need to figure out: >>> 1. How the mailman queue runners are started and stopped >> >> mailman start >> > > Why not systemctl mailman start?? Just wondering, as that is what I am > seeing is common in Ubuntu. > Does this make the components start after a reboot? 'mailman start' is the command that starts Mailman. When you install Mailman, you typically create an init, upstart or systemd script to enable 'systemctl mailman start'. Presumably the Ubuntu mailman3-full package installs such scripts for Mailman and other components that need to be started at boot, but I'm not that familiar with this package. >>> 2. Migrate s few lists from Mailman2 to this Mailman3 >> >> mailman import21 >> <django management> hyperkitty_import >> > > Please show me where that is documented. I have to pull my lists from an > old machine to this new one. Those commands have --help options. There is also some documentation at <https://mailman.readthedocs.io/en/latest/src/mailman/commands/docs/import.h…> and <https://hyperkitty.readthedocs.io/en/latest/install.html#importing-the-curr…>. All of our formal documentation is at <http://docs.list.org/en/latest/>. > So, when you talk about Django settings, you are referring to mailman.cfg > file??? :-) No. I am talking about a file often named settings.py and which my in turn import a file named something like settings_local.py. See my first answer above. > I have spent all my weekend till now, trying to figure all this out. Life > seems a little easier with mm2.x .... I expect some of that is just what you're familiar with, but yes, Mailman 3 is more complex than Mailman 2.1 just as Mailman 2.1 is more complex than a Bcc: list. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 4 months

[MM3-users] Re: bounce_score_threshold control

by Mark Sapiro

On 2/24/23 08:08, Tibor Molnar wrote: > > I have recently started receiving these mails from the system. First it was frighting me out that people's account got disabled, but actually nothing has happened, nobody got disabled. I however looking to figure out how can I control or change settings for this particular mechanism. Please advise me. > > emailname(a)example.it's subscription has been disabled on listname(a)domain.eu due to their bounce score > exceeding the mailing list's bounce_score_threshold. I'm not sure what you are looking at, but when you receive that message, it means the user's Delivery status has been set to Disabled by Bounces and the user will be sent `Bounce disable warnings` (default 3) warnings at intervals of `Bounce disabled warnings interval` (default 7 days) and if nothing is done the user will then be removed from the list. The notice you received, at least since Mailman 3.3.5, should contain a copy of the bounce DSN so you can determine if this user's address is actually undeliverable. Settings that control this are in the Postorius admin UI under Bounce Processing. The only other control is in mailman.cfg in the [mta] section where you can set `verp_probes: yes` See the docs at https://docs.mailman3.org/projects/mailman/en/latest/build/lib/mailman/mode… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 1 month

[MM3-users] Re: "Delete this thread" -> 'HTTP-500 -> NoneType' object has no attribute 'all'

by Mark Sapiro

On 05/28/2017 12:40 PM, Simon Liebold via Mailman-users wrote: > I didn't find a 'delete message' button. But "Delete this thread" went > straight to the 500. Both, Hyperkitty and django-mailman are up-to-date > with master. 'Delete this message' is in the 'message' view. "Delete this thread" is in the 'thread' view. > ERROR 2017-05-28 13:04:14,496 29835 django.request Internal Server > Error: > /hyperkitty/list/simsimmer@lists.simonliebold.de/thread/4I2TRZTFXMMH2XRQAS73IAEIYROFE5YM/delete > Traceback (most recent call last): > File > "/opt/mailman/venv-2.7/local/lib/python2.7/site-packages/Django-1.11rc1-py2.7.egg/django/core/handlers/exception.py", HyperKitty requires Django<1.11. The comment in the requirements in setup.py implies this is only a django-haystack requirement "Django>=1.8", # Don't upgrade to 1.11 until django-haystack supports it: # https://github.com/django-haystack/django-haystack/pull/1499 "Django<1.11", but since it works for me with Django 1.10, you might want to try that. ... > File > "/opt/mailman/venv-2.7/local/lib/python2.7/site-packages/Django-1.11rc1-py2.7.egg/django/forms/models.py", > line 1168, in __deepcopy__ > result.queryset = self.queryset.all() > AttributeError: 'NoneType' object has no attribute 'all' In particular, this looks like Django 1.11 bug <https://code.djangoproject.com/ticket/27975>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 10 months

[MM3-users] Re: Change digest frequency and default threshold

by Mark Sapiro

On 10/11/2018 03:48 AM, Henrik Rasmussen wrote: > > Before running /usr/bin/docker exec mailman-core mailman digests --periodic --verbose > > Every 2.0s: ls -l;grep "Test 20181011" digest.mmdf;tail /var/log/mailman/core/smtp.log Thu Oct 11 12:23:32 2018 > > -rw-rw---- 1 100 nogroup 103433 Oct 10 14:36 digest.1.7.mmdf > -rw-rw---- 1 100 nogroup 155540 Oct 11 11:29 digest.1.8.mmdf > -rw-rw---- 1 100 nogroup 104002 Oct 11 12:21 digest.mmdf ... > After running /usr/bin/docker exec mailman-core mailman digests --periodic --verbose > > Every 2.0s: ls -l;grep "Test 20181011" digest.mmdf;tail /var/log/mailman/core/smtp.log Thu Oct 11 12:44:45 2018 > > total 372 > -rw-rw---- 1 100 nogroup 103433 Oct 10 14:36 digest.1.7.mmdf > -rw-rw---- 1 100 nogroup 155540 Oct 11 11:29 digest.1.8.mmdf > -rw-rw---- 1 100 nogroup 104002 Oct 11 12:21 digest.1.9.mmdf The mailman digests --periodic command renames the digest.mmdf file to (in this case) digest.1.9.mmdf and then queues an entry in the digest queue for DigestRunner to actually build the digests from the digest.1.9.mmdf file, send them and remove the digest.1.9.mmdf file. Something is going wrong in this process in DigestRunner. Is DigestRunner running? Is there anything in Mailman's digest or shunt queues? Is there anything logged in Mailman's 'mailman' log? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 6 months

[MM3-users] Re: Importing users and mas settings "Moderation Action"

by Mark Sapiro

On 5/19/22 06:17, bob B via Mailman-users wrote: > I imported email lists and users to version 3 from version 2. One of my lists all the users are set to 'Hold for moderation" for "Moderation Action". I assume this is because they were set to moderation on mailman 2? Correct. > But if I mass subscribe users via the Gui in mailman 3 then their default "Moderation Action" is set to "none" so I assume it follows list default, is that a correct assumption? Yes. > I believe there is no way to import mass users and set their "Moderation Action" at the same time is this correct? Wasn't that possible in mailman 2? That's correct, and that was also the case in Mailman 2.1 . > is there a way to change all their user's "Moderation Action" for a list in bulk? You could do it with `mailman shell`, but not in Postorius. > So it looks like for any users I mass subscribe, "Moderation Action" will be set to "none" and if I want to change that I have to do it manually for each user? If you are a list owner whose only access is via Postorius, that's correct. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 11 months

[MM3-users] Re: Welcome message template errors

by Mark Sapiro

On 4/27/24 18:44, Mark wrote: > > I created a text file as a custom welcome message and chowned it to > mailman:mailman, then edited the database record (template.uri) from > > http://localhost:8000/mailman3/api/templates/list/mytestlist.mydomain.com/l… > TO > file:///home/mark/welcome.txt > > This delivered the custom welcome message to the user when subscribed > via Mass Subscribe. > > I'm not sure what this tells me other than a call can be made to a file > but not the database. The retrieval of a file does not involve calling requests.get() to retrieve the URL via http which is where the issue occurs. There's another way to set templates in the file system. If there is no entry in the template table matching the requested template name and context the file system is searched according to the algorithm described at <https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/utilities/i18n…>. $template_dir in that description is Mailman's var/templates/ directory. So for example, to create a lists specific english language welcome template for the list.example.com list you could just put the template in var/templates/lists/list.example.com/en/list:user:notice:welcome.txt or to make it sitewide, in var/templates/site/en/list:user:notice:welcome.txt -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

11 months, 3 weeks

[MM3-users] Re: Pck files stuck in out queue

by Mark Sapiro

On 2/10/25 12:09, Lieuallen, Thomas Otis via Mailman-users wrote: > > I haven’t figured out how to work with these cache files. I found some mention that a runner would clean up cache files after a week (default) and that one could use ‘cache_life’ to change that default. So, I set the following and restarted mailman. The cache files hadn’t been removed after > 4 hours, so I unset it and restarted again. > > Cache_life: 1d The setting is actually `cache_lifetime` in the `[mailman]` section of mailman.cfg, however when a file is cached, it's lifetime is saved in the database and won't be changed by changing that setting. > Without further information or direction, I’m tempted to just remove those cache files and move on with life. Removing them is OK, but a database entry will still exist pointing to them and attempt to retrieve them will return `Cache content lost`. The way to properly remove them is in Mailman shell ``` $ mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> cm = getUtility(ICacheManager) >>> cm.clear() >>> commit() >>> ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 months, 1 week

[MM3-users] Re: Link another address

by Mark Sapiro

On 5/18/20 5:13 PM, Brian Carpenter wrote: > I am thinking about incorporating the following Postorius/Django account feature into Affinity: > > Other emails: (no other email) Link another address > > However I cannot think of a serious real-world need for this. What are the developers' reasoning behind this? Was this feature highly demanded by Mailman 3 users? Just trying to find out what I am missing here. In mailman 2.1 there was no concept of user. There were only lists and list members and list members were just email addresses that had no connection to other list members even if they happened to have the same email address. In mailman 3 we have users. Users can have multiple addresses. a user or a particular user's address can be a regular member and an owner of one list, a moderator of another list and a non-member of a third list. Some other address of that user can be a digest member of the first list. All of these addresses and roles can belong to a single user and be managed from that user's one account. Sure, each address can be separate with it's own login, but isn't it more convenient if they are all linked under one login if they all belong to one individual. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: Hyperkitty "All Threads" results in error

by Mark Sapiro

On 10/14/20 11:12 AM, Mark Dadgar wrote: >> On Oct 4, 2020, at 10:34 AM, Mark Dadgar <mark(a)pdc-racing.net> wrote: >> >> So I have been wrestling with this problem for a while now. Most times, but not every time, when someone clicks on the All Threads link in hyperkitty, a 500 error is generated. Does this happen on all lists, only some lists or only one list? >> I googled it, obviously, and at first I thought it was related to this issue, but that has not proven to be the case: >> >> https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… What did you google? This query gets a lot of stuff with some hints, but nothing definitive. django render raises VariableDoesNotExist("Failed lookup for key " One thing I noted at <https://askbot.org/en/question/3095/django-error-variabledoesnotexist-faile…> was models out of date - run python manage.py syncdb and python manage.py migrate You could try that. Note that your django admin command might be something other than `python manage.py`. Also note syncdb has been removed from Django >=1.9. Currently, the above becomes `makemigrations` followed by `migrate`. I also suggest running the django admin commands `collectstatic --clear --noinput` and `compress` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 6 months

[MM3-users] Re: Mysterious Bounces Being Logged

by Mark Sapiro

On 3/26/21 11:31 AM, Brian Carpenter wrote: > I keep seeing bounces being recorded in logs/bounce.log that have no > corresponding entry in Postfix's mail.log. For instance one address had > registered about 2 dozen bounces in the past week in bounce.log and yet > every single entry for this address in mail.log has a status=sent. What > am I missing here? They are being bounced by a downstream MTA. If you want to know why, you have a few choices. You can mail the address yourself and hopefully get a DSN back. You can install this patch: ``` > diff --git a/src/mailman/runners/lmtp.py b/src/mailman/runners/lmtp.py > index 6a0bdcf5e..eca474089 100644 > --- a/src/mailman/runners/lmtp.py > +++ b/src/mailman/runners/lmtp.py > @@ -217,6 +217,8 @@ class LMTPHandler: > slog.debug('%s subaddress: %s, queue: %s', > message_id, canonical_subaddress, queue) > status.append('250 Ok') > + if queue == 'bounces': > + config.switchboards['bad'].enqueue(msg, msgdata) > except Exception: > slog.exception('Queue detection: %s', msg['message-id']) > config.db.abort() ``` which will add all received bounces as queue files in Mailman's var/queue/bad. At some point, we need to implement the attachment of the bounce DSN to the notices sent to the admin, but that isn't done yet. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years

[MM3-users] Re: Pck files stuck in out queue

by Mark Sapiro

On 2/6/25 12:42, Lieuallen, Thomas Otis via Mailman-users wrote: > Running Mailman 3.3.10 > > I have 11x pck files stuck in my out queue. There tends to always be a .bak file as well. If I run ‘ls -l’, the files are continually updated and rotated through, just as fast as I can look. Are old ones being delivered and new ones added or the same ones just being renamed? I suspect the latter and I suspect the issue in that case is probably due to the OUT runner trying to access a template file like list:member:{regular|generic}:{header|footer}.txt and not having permission. See the last two posts in the thread at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… > I believe they’re all for one list. When I use ‘strings’ on one to get a hint of what’s inside, I see the list members at the bottom (recipients). One of them consistently has ‘!’ before their email address. Not sure if that’s a clue. Just no other reason to suspect that, though. The files are python pickles and `strings` shows lots of stuff. The ! may be something in the pickle that's not part of the email address. The way to examine these files is with the `mailman qfile` command. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 months, 2 weeks

[MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup

by Mark Sapiro

On 4/11/19 12:58 PM, brian(a)emwd.com wrote: > > I have this in the apache2.conf file: > > ServerName localhost > > I can access the apache default page when using the following: > > curl http://localhost.com OK, so you can get to Apache, but can you proxy to uwsgi? Try curl http://localhost/mailman3/hyperkitty/api/mailman/archive or curl http://mailman3-lists.com/mailman3/hyperkitty/api/mailman/archive >> Set base_url in mailman-hyperkitty.cfg to use an acceptable host name >> instead of localhost or adjust your apache config to accept localhost. > > Isn't ServerName enough? It should be. The error is apparently elsewhere. > This error also appears in the apache log file when new posts are sent to the list: > > [Thu Apr 11 19:55:38.755750 2019] [:error] [pid 21370:tid 139988922513152] (32)Broken pipe: [client ::1:49574] sending data to httpd-UDS:0 failed The broken pipe is apparently from the exception in mailman-hyperkitty and the 'sending data to httpd-UDS:0 failed' is I think a normal response from uwsgi under this circumstance. I don't know what the issue is, but it is something in the Apache/uwsgi configuration. I note that the client in the above error is an IPv6 loopback address. That may be significant. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years

[MM3-users] Re: 'Failed adding message' error when migrating a list from mailman2 to mailman3

by Mark Sapiro

On 10/14/21 9:04 AM, Stephen J. Turnbull wrote: > Prasanth Nair writes: > > > *2%Failed adding message <mailman.2.1593699619.32248>: 'ascii' codec can't > > encode character '\ufffd' in position 252: ordinal not in range(128).* ... > > I ran the check_hk_import script before migrating and it was not > > giving any error. > > In order to catch this kind of error, the check script would have to > pretty much do the import but throw it away. The check_hk_import script <https://www.msapiro.net/scripts/check_hk_import> is designed to detect and report conditions which would cause the django hyperkitty_import process to abort and stop processing the mbox. It doesn't catch errors like the above, but these are non-fatal and just cause the offending message to be skipped. As Steve says, the Message-ID was reported so find it in the mbox and if you want it in the archive, extract it from the mbox, fix it and then just rerun the import with just that message as input[1] and a --since=1970-01-01 option. Note the issue could be in a header, but also could be in a body part implicitly or explicitly declared as charset="us-ascii". -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 6 months

[MM3-users] Re: question about recommended postfix configuration

by Mark Sapiro

On 10/02/2017 05:37 AM, Marc Sluiter wrote: > > I got almost everything working besides confirm mails (see my other mail), but I had to use another postfix configuration than recommended, I’m wondering why the recommended way didn’t work. Sidenote: I’m not a postfix expert. Neither am I ;) > This is recommended: > > transport_maps = > regexp:/opt/mailman/core/var/data/postfix_lmtp > local_recipient_maps = > regexp:/opt/mailman/core/var/data/postfix_lmtp > relay_domains = > regexp:/opt/mailman/core/var/data/postfix_domains > > This didn’t work, all mails to mailman were rejected. Postfix did not even check the “local_recipient_maps”. After a lot of reading that made sense to me, because when I understand it correctly, “local_recipient_maps” is only checked for domains in “mydestinations”. And there I only have localhost. On mail.python.org which is a complex Postfix environment with both Mailman 2 and Mailman 3 lists in the @python.org domain, for Mailman 3 I have just transport_maps and relay_domains as recommended (but as hash tables) I don't have anything for Mailman in local_recipient_maps, but python.org is in virtual_alias_domains (not in virtual_mailbox_domains). I think it could be either, and virtual_alias_maps (or virtual_mailbox_maps) does not require anything for Mailman because transport_maps handles it. I think the bottom line here is the list domain must be in one of mydestination or virtual_*_domains. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 6 months

[MM3-users] Re: including a template failed

by Mark Sapiro

On 9/23/20 3:03 PM, Wolfgang Bock via Mailman-users wrote: > > Dear Mark, > > Q: Can you get > https://webmail.domain-02.de/mailman3/postorius/api/templates/list/mylist.li > sts.domain-03.de/list:member:regular:footer on the Mailman machine? > > A: No > > Q: What is your setting for POSTORIUS_TEMPLATE_BASE_URL? > > A: > was: POSTORIUS_TEMPLATE_BASE_URL = 'http://localhost/mailman3/' > > Changed it to: POSTORIUS_TEMPLATE_BASE_URL = 'https://localhost/mailman3/' Can you get https://localhost/mailman3/postorius/api/templates/list/mylist.lists.domain… on the Mailman machine? > Now another problem occurs: > > Sep 23 22:51:34 2020 (13492) Cannot connect to SMTP server localhost on port > 25 > HTTPSConnectionPool ... 'localhost' doesn't match either of > 'blog.domain-04.de', 'lists.domain-04.de', 'mail.domain-04.de', > 'domain-04.de', 'www.domain-04.de'"))) The 'HTTPSConnectionPool' message has nothing to do with the 'Cannot connect' issue. > Port 25 entry results from the manual regarding the postfix configuration: > > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.ht > ml > > e.g.: > [mta] > incoming: mailman.mta.postfix.LMTP > outgoing: mailman.mta.deliver.deliver > lmtp_host: mail.example.com > lmtp_port: 8024 > smtp_host: mail.example.com > smtp_port: 25 And I wonder why it's trying to connect to localhost when smtp_host is mail.example.com. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 7 months

[MM3-users] Re: {Spam?} Server name in new account confirmation email

by Mark Sapiro

On 12/3/20 9:26 AM, Meehan, John wrote: > Hi, when someone creates a new account (Sign Up), an email is sent to them to confirm their email address. It has the form below. Does anyone know how I can change the server name in the URL (From server.example.com to something else)? I have an SSL proxy server that I want to direct users through. Thanks. - John This message comes from django_allauth. The domains come from the django_site database table. If you have Postorius >= 1.3.3 The Domains view will show you the SITE_ID for the domain and has an `Edit` link the the Django admin UI entry for that site. Otherwise, you can go to the Django admin `Sites` view and see the DOMAIN NAME and DISPLAY NAME for each defined site, and you can edit the domain name. You may also need to adjust the SITE_ID setting in your Django settings to match the site you want. The trick here is the SITE_IDs aren't displayed in the Django admin UI or in Postorius < 1.3.3, and they may not be sequential or start at 1. If you query the database with `SELECT * FROM django_site;` you'll see entries with columns id, domain and name which will tell you the SITE_ID. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 4 months

[MM3-users] Re: mm3 floods syslog

by Mark Sapiro

On 10/31/21 4:18 AM, Wolfgang Bock via Mailman-users wrote: > Dear friends, > > I got another problem: mailman floods my syslog. > > I deleted a domain/webdomain (further mentioned as deleted.org) in > postorius, django web. No entries are now in > /var/lib/mailman3/data/postfix_domains or postfix_lmtp or > /var/lib/mailman3/lists. > > > Here an extract of my syslog (anonymized): > Oct 31 10:49:02 myserver mailman3[1284]: Oct 31 10:49:02 2021 (1284) > Certificate did not match expected hostname: localhost. Certificate: > {'subject': ((('commonName', 'deleteted.org'),),), 'issuer': > ((('countryName', 'US'),), (('or > ganizationName', "Let's Encrypt"),), (('commonName', 'R3'),)), 'version': 3, > 'serialNumber': '0326A733CA7B16D13C830EE707EA614E25F9', 'notBefore': 'Oct 30 > 20:21:08 2021 GMT', 'notAfter': 'Jan 28 20:21:07 2022 GMT', > 'subjectAltName': (('DN > S', 'deleteted.org'), ('DNS', 'lists.deleteted.org'), ('DNS', > 'mail.deleteted.org'), ('DNS', 'ns.deleteted.org'), ('DNS', > 'www.deleteted.org')), 'OCSP': ('http://r3.o.lencr.org',), 'caIssuers': > ('http:/ > /r3.i.lencr.org/',)} > > This appears nonstop. Your ssl certificate is for the domain `deleted.org` with alt names `lists.deleted.org`, `ns.deleted.org`, `mail.deleted.org` and `www.deleted.org`. Django is accessing things at a URL for a different domain. Get a new certificate for the domain(s) you are actually using. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: Mailman3 doesn't send Mails to users (Debian12 with Plesk)

by Mark Sapiro

On 5/27/24 1:55 AM, marcus--- via Mailman-users wrote: > > What I also notice is that it is not yet storing anything in the archives. Could this be a setting that has changed, or an incorrect authorization (/var/lib/mailman3/archives/ belongs to list but is empty) or is the archive creation only running via a cronjob that perhaps still needs to run? There are two things stored in that directory If the prototype archiver is enabled, each list which has prototype checked as an Active archiver will have messages stored in maildir format in archives/prototype. If the hyperkitty archiver is configured and enabled, when mailman-hyperkitty fails to send a message to hyperkitty, it queues that message in archivers/hyperkitty/spool. If there no current failed messages, that directory will be empty, and if there have never been failures, that directory may not exist. Enabling archivers is done in mailman.cfg similarly to ``` [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /opt/mailman/mm/mailman-hyperkitty.cfg [archiver.prototype] enable: yes ``` > I don't need Usenet, thanks :-) Then no list should have it's Gateway to mail or Gateway to news setting = Yes. Also, you can disable nntp runner by putting ``` [runner.nntp] start: no ``` in mailman.cfg -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

10 months, 3 weeks

[MM3-users] Re: Mailman3 breaking DKIM signatures

by Mark Sapiro

On 1/21/25 4:40 AM, jefdriesen(a)hotmail.com wrote: > Hi, > > I have configured a mailman3 mailinglist to not modify the headers and body (e.g. no footer, no subject prefix, etc) to avoid breaking DKIM signatures. This worked well, until I encountered an email where the DKIM signature was still broken. After some debugging, the problem is caused by an attachment, where the mime header is changed by mailman3. ... > The Content-Type header is modified (word-wrapped), and this breaks the DKIM signature. > > How can I prevent this from happening and configure mailman to not modify the email? You could try a patch like ``` --- a/src/mailman/runners/lmtp.py +++ b/src/mailman/runners/lmtp.py @@ -186,7 +186,8 @@ class LMTPHandler: listnames = set(getUtility(IListManager).names) # Parse the message data. If there are any defects in the # message, reject it right away; it's probably spam. - msg = email.message_from_bytes(envelope.content, Message) + msg = email.message_from_bytes(envelope.content, Message, + policy=email.policy.Compat32(max_line_length=0)) msg.set_unixfrom(envelope.mail_from) except Exception: elog.exception('LMTP message parsing') ``` This should prevent folding headers, but this is problematic. It may be that the incoming message contains a folded header and this change will not fold it in the outgoing message. I think not, but I don't know for sure. You'll have to test this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 months

[MM3-users] Re: Mailing lists sometimes do not honor moderation_action of non-members

by Mark Sapiro

On 10/31/19 2:21 AM, Alan So wrote: > We notice that sometimes mailing lists do not honor moderation_action of non-members. Instead, it follows the default action of the lists. It looks like we can sometimes fix the issue by adding/removing the non-members or adding/removing them as owner in certain order but we are not sure about exactly what we have to do. So, it looks like that it is not caused by the list configuration. We have already verified from the web UI, mailman client and the DB table member that moderation_action of the corresponding non-members are set correctly. Any clues for us to provide further information to troubleshoot the issue and any recommended workaround to get around the issue? Thanks a lot. Reasons why a post From: a non-member would not be treated according to that non-members moderation_action include the following: If any address in any of the places configured in mailman -> sender_headers (default = From: header, envelope sender, Reply-To: header, Sender: header) is that of a member, that member's moderation_action will apply. If any of the addresses above matches an address or pattern in one of the lists *_these_nonmembers attributes that action will apply rather than the corresponding non-member's moderation_action. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 5 months

[MM3-users] Re: Example Logrotate files for Mailman3

by Mark Sapiro

On 6/30/20 2:10 PM, Andrew Hodgson wrote: > Hi, > > Does anyone have any usable Logrotate files for Mailman3 (especially for the web stuff)? Here are two. They differ in the name and location of the Django log. Both of them signal gunicorn to reopen its logs. If you are using uWSGI or some other WSGI support, you'll need to figure that out. In this one, all the logs including Django's are in /opt/mailman/mm/var/logs/ > /opt/mailman/mm/var/logs/*.log { > missingok > sharedscripts > su mailman mailman > postrotate > /opt/mailman/mm/bin/mailman reopen &>/dev/null || true > if [ -r /opt/mailman/mm/var/gunicorn.pid ]; then > PID=`cat /opt/mailman/mm/var/gunicorn.pid` > kill -s USR1 $PID > fi > endscript > } This one is actually two because the Django log is in /var/log/ rather than /opt/mailman/mm/var/logs/. > /opt/mailman/mm/var/logs/*.log { > missingok > sharedscripts > su mailman mailman > postrotate > /opt/mailman/mm/bin/mailman reopen &>/dev/null || true > if [ -r /opt/mailman/mm/var/gunicorn.pid ]; then > PID=`cat /opt/mailman/mm/var/gunicorn.pid` > kill -s USR1 $PID > fi > endscript > } > } > /var/log/mailman-web/*.log { > missingok > notifempty > delaycompress > su mailman mailman > } -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 9 months

[MM3-users] Re: Send MySQL data to mailman list for distribution

by Mark Sapiro

On 6/1/21 1:46 PM, Zden Pos via Mailman-users wrote: > I'm trying to connect existing MySQL data to the Mailman distribution list. > Actually, a message is sent from the web page. It remains on this page and is also stored in the MySQL table on the provider server. This is working fine. > I have also existing Mailman distribution list generated from the cPanel on the provider server as well. This list is working fine when used for a direct mailing. > > I need to link the MySQL table to the Mailman distribution list. When the message is posted on the web page and stored in the MySQL table, it is also to be sent to members as per the Mailman distribution list. I don't know where to configure it. In the phpMyAdmn page of the MySQL or in the Malman menu ? I am very confused because it appears that your Mailman list with MySQL data is a Mailman 3 list, but cPanel lists as far as I know are Mailman 2.1 only. My best guess is you want posts to the Mailman 3 list to be forwarded to thwe cPanel list. If so, just add thee cPanel list's posting address as a member of the Mailman 3 list. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: Moving from forum to Mailman 3

by Mark Sapiro

On 10/9/20 4:39 PM, jonathan.mailing.lists(a)gmail.com wrote: > > Thanks for this. I’m sure I could turn that basic information (from, date, subject) into an mbox file somehow. What else does Mailman need, eg to work out which messages are in reply to which? To properly thread messages, each message should have a unique Message-ID: header and all replies should have an In-Reply-To: header with the Massage-ID: of the message to which it's a reply. E.g. the first message in a thread has Message-ID: <some_unique_string(a)example.com> A reply to that has Message-ID: <different_unique_string(a)example.com> In-Reply-To: <some_unique_string(a)example.com> and a reply to that message has Message-ID: <third_unique_string(a)example.com> In-Reply-To: <different_unique_string(a)example.com> The angle brackets around the strings are required and every Message-ID: in the entire archive for a list must be unique. If threading is not an issue, hyperkitty_import will generate a unique Message-ID: for any message without one. References: headers are not required. > Would it be possible to add ex-forum message “emails” like this to an existing mailing list archive? Yes. When running hyperkitty_import you probably need to specify since= in this case, otherwise only messages with dates newer that the newes message in the existing archive will be imported. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 6 months

[MM3-users] Re: Fwd: [Django] ERROR (EXTERNAL IP): Internal Server Error: /mailman3/hyperkitty/api/mailman/archive

by Mark Sapiro

On 3/2/21 12:10 AM, David Partain via Mailman-users wrote: > > I'm not on the latest mailman, unfortunately. I use the bundled packages on Ubuntu 18.04, which are > > mailman3 3.1.1-9 > mailman3-doc 3.1.1-9 > mailman3-full 3.1.1-9 > mailman3-web 0+20170523-14 > >>From the mailman-web logs, it looks like it's using python2. That would explain a lot. In particular, it would explain why the .pyc files aren't located per PEP 3147 <https://www.python.org/dev/peps/pep-3147/>. But it also raise the question of how anything works at all. Python >= 3.6 is required. HyperKitty and Postorius used to run under Python 2, but haven't for some time. I'm not sure what versions are in Debian/Ubuntu 0+20170523-14 package. > Put the symlink back, and it works again. (But still without the emojis working, of course.) > > Postgres is what's in settings.py, but I assume that should be overriden by what's in settings_local.py. > > Baffling. I don't really know what to do next, but I'll keep looking. I suggest removing all the .pyc files and restarting the services. That will probably recreate .pyc files, but they should then be good. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: Subscribe to a list on a Mailman3 server without account registration

by Mark Sapiro

On 6/6/23 01:07, c.buhtz(a)posteo.jp wrote: > Hello, > I might miss something here but I'm confused about a difference between Mailman2 and 3. > > On MM2 I just subscribed a mailinglist via my EMail address. I didn't need to create an account on the MM2 server first. > But it seems on MM3 it is otherwise. For example I use MM3 on python.org. It seems I have to register first before subscribing to a mailing list. > https://mail.python.org/mailman3/lists/twisted-web.python.org/ You can subscribe without creating an account. You do need an account if you want to manage your subscription via the web UI or to visit private archives, but not to just be a list member or visit public archives. The issue with the https://mail.python.org/mailman3/lists/ lists is that the anonymous subscribe form which looks like: ----------------------------------------- You can also subscribe without creating an account. If you wish to do so, please use the form below. Your email address __________ Your name (optional) __________ ----------------------------------------- has been removed from list info page because it was being abused by people attempting to subscribe third parties. You can still subscribe without creating an account by emailing twisted-web-subscribe(a)python.org. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 10 months

[MM3-users] Re: Problems with signed messages from Apple Mail

by Mark Sapiro

On 11/12/21 6:06 AM, Rainer Herbst wrote: > Dear all, > > after upgrading his Mac to MacOS 12.0.1 Monterey, one of our users can > not send send signed messages to lists using Apple Mail v. 15.0 > (3693.20.0.1.32). > > mailman3 denys the delivery of the mail with error message: > host 172.19.0.4[172.19.0.4] said: 501 Message has defects > (in reply to end of DATA command) > > I.e. mailman does not process the message, but rejects it already in the > incoming smtp session. Is that a known issue? Incoming SMTP is relaying the message via LMTP to Mailman's LMTP runner which in turn parses the message using Python's email.message_from_bytes() method and the resultant message has defects. Rejecting such a message outright as we do may be too harsh, but it is hard to say without seeing the message and what Python's email package thinks the defects are. This could be a bug in Apple Mail or in the Python email module. If you wish to see the details, you could do the following in `mailman shell` ``` import email from mailman.email.message import Message content = b"""\ (paste the raw message here) """ msg = email.message_from_bytes(content, Message) msg.defects ``` This will show you what the defects are. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: mailman3-suite not sending confirmation emails

by Mark Sapiro

On 1/2/19 11:59 PM, ccehb(a)nus.edu.sg wrote: > Hi, > > This is my first experience using mailman. I recently downloaded and setup mailman3 suite which comes with hyperkitty. I don't really understand why the email is not working. I had an external smtp server (mymailserver.com) residing on different IP from my web server that hosts mailman stuff. > > I had modified settings.py with debug = False and added the following: > > EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' > EMAIL_HOST = 'mymailserver.com' > EMAIL_PORT = 25 These should be OK, but they are only for messages from Django, not for list mail. Also if mymailserver.com requires authentication, you may need to set EMAIL_HOST_USER and EMAIL_HOST_PASSWORD. > I also added these inside mailman.cfg > > [mta] > outgoing: mailman.mta.deliver.deliver > lmtp_host: 127.0.0.1 > lmtp_port: 8024 The above are all defaults. > smtp_host: mymailserver.com > smtp_port: 25 Again, if mymailserver.com requires authentication, you need to set smtp_user and smtp_pass. > Thanks for your help! I check the logs but there isn't anything. When I sign up, nothing happens and I can't figure out why? Is Mailman running? If so, and there's nothing in logs, it is probably using some other (default) config and logging somewhere other than where you think. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 3 months

[MM3-users] Re: Chinese characters in list name shows question mark (?)

by Mark Sapiro

On 10/23/19 7:12 AM, Franklin Weng wrote: > Hi list, > > I set up a mailman3 server and built a few lists to test. > > When I set the list name using Chinese characters, the web site shows > correctly. However in the subscribing welcome mail the list name was > shown in question marks. Screenshot is here: > > https://nextcloud.slat.org/index.php/s/CxPjpYMbQzQ6444 The name of the list from the screenshot seems to be zh-l10n(a)lists.linux.org.tw. The thing shown with ?s in the screenshot is the list's display_name (called Display name in Postorius). > The LANGUAGE_CODE settings.py (in Debian /etc/mailman3/mailman-web.py) > is set to zh-tw , and USE_I18N and USE_L10N are all set to True. These settings are all for Django and have nothing to do with how the list welcome message is sent. > Is there any other setting I should look at? The list's preferred_language setting (Postorius -> Settings -> List Identity -> Preferred Language. The list welcome message is encoded in Mailman's character set for the list's preferred_language. If this is English (USA), the character set is us-ascii. If it is set to Chinese (Taiwan), the character set is utf-8, and it should work. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 6 months

[MM3-users] Re: About to Install MM3 -- Seeking clarification

by Mark Sapiro

On 10/22/22 21:29, Onyeibo Oku wrote: > > Now Mailman starts, and stops as desired when running as mailman user (both in > virtual and non-virtual environments). However, running the service via systemd > still fails. I now get a different traceback: > > Oct 23 03:43:00 mail.server.tld mailman[19410]: Traceback (most recent call last): ... > Oct 23 03:43:00 mail.server.tld mailman[19410]: with open(self._claimfile, 'w') as fp: > Oct 23 03:43:00 mail.server.tld mailman[19410]: PermissionError: [Errno 13] Permission denied: '/opt/mailman/mm/var/locks/mailman-cfg.lck|server.tld|19410|619270043958240354' > Oct 23 03:43:00 mail.server.tld systemd[1]: mailman3.service: Control process exited, code=exited, status=1/FAILURE What are ownership and permissions on /opt/mailman/mm/var/locks/ Assuming they are drwxr-xr-x mailman mailman it must be the case that systemd is not running the `/opt/mailman/venv/bin/mailman start` command as the `mailman` user. I suspect this is a Fedora issue. I note that https://docs.fedoraproject.org/en-US/quick-docs/understanding-and-administe… does not mention User or Group. You might try replacing ``` ExecStart=/opt/mailman/venv/bin/mailman start ExecReload=/opt/mailman/venv/bin/mailman restart ExecStop=/opt/mailman/venv/bin/mailman stop with ExecStart=sudo -u mailman /opt/mailman/venv/bin/mailman start ExecReload=sudo -u mailman /opt/mailman/venv/bin/mailman restart ExecStop=sudo -u mailman /opt/mailman/venv/bin/mailman stop ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 6 months

[MM3-users] Re: Flooded non-members with "prvs=<number>=<mail>"

by Mark Sapiro

On 12/22/24 04:35, Torge Riedel via Mailman-users wrote: > > I checked the non-members list of all my mailman3 lists and found a lot > entries like "prvs=<number>=<mail>", the <mail> is always an address > from @freenet.de > > A quick research mentions something related to bouncing and that such > mails should be blocked/filtered. But no further details. > > Can you give a hint where I need to change what to block such mails and > avoid that such entries floods the non-members list? If these are in fact bounces, the mta at freenet.de is sending bounce DSNs to the list address instead of (or possibly in addition to) the list-bounces address which is the envelope sender of the mail from Mailman. This behavior is wrong, but it is beyond your control. If you can identify a pattern in the From: address that would match these and only these mails, you could probably configure the incoming MTA to discard them. E.g., for Postfix, see https://www.postfix.org/header_checks.5.html You might think of using Mailman's Header filters to discard the messages, but this won't keep the nonmembers from being created as the creation happens before any of those checks. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 months

[MM3-users] Re: Debian 12 postfix errors: "warning: connect to transport private/lmtp: Connection refused" and "status=deferred (mail transport unavailable)"

by Mark Sapiro

On 4/7/25 12:00, Philip Bondi wrote: > [mta] > incoming: mailman.mta.postfix.LMTP > outgoing: mailman.mta.deliver.deliver > lmtp_host: 127.0.0.1 > lmtp_port: 9024 Why are you setting this? Testing uses port 9024 to avoid conflicts, but the default port 8024 should be used for production. > [799] # postconf -n ... > virtual_mailbox_maps = hash:/opt/mailman/mm/var/data/postfix_lmtp Why do you have this? It may well be the issue. > ebill(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-bounces(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-confirm(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-join(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-leave(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-owner(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-request(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-subscribe(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > ebill-unsubscribe(a)systemdatabase.ca lmtp:[127.0.0.1]:9024 > > [797] # telnet localhost 9024 > Trying ::1... > Connection failed: Connection refused > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > 220 shackleton12.systemdatabase.ca GNU Mailman LMTP runner 2.0 > QUIT > 221 Bye > Connection closed by foreign host. It looks like you can connect to port 9024 in this way. However I recommend removing `lmtp_port: 9024` from your mailman.cfg and rerunning `mailman aliases` to regenerate the postfix maps. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 weeks, 2 days

[MM3-users] Re: Invalid FilterAction: discard. Treating as discard

by Mark Sapiro

On 5/7/19 6:19 AM, Henrik Rasmussen wrote: > Having set the Filter content to Yes - regardless of other setting in the "Alter Messages" tab, make a HTML message come out empty. I can replicate this on my test list. I don't understand the question? Are you asking why the log contains "invalid FilterAction: discard. Treating as discard"? If so, that's a bug. See <https://gitlab.com/mailman/mailman/issues/592>. If you are asking why the message is empty after filtering and discarded, It is presumably because it is a text/html message as opposed to a multipart/alternative message with text/plain and text/html alternative parts. > I have tried debugging by changing each setting one-by-one and sending the user's mail, but no change makes the mail come out with a content. However setting "Filter content" to "no" makes the mail come out okay. There are list attributes filter_types and pass_types (also filter_extensions and pass_extensions, but those probably aren't relevant here) which affect this and which aren't exposed in Postorius. See <https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/filterin…> for more info of content filtering. Presumably, the combination of filter_types and pass_types is not allowing text/html. You need to examine these settings in mailman shell, e.g. list(m.pass_types) -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 11 months

[MM3-users] Re: Hyperkitty Recommended mySQL Database Setup & Archive Importing

by Mark Sapiro

On 12/8/20 9:05 AM, matthew(a)alberti.us wrote: > > From what I've been reading, it seems like Mailman3 expects > the mysql database to use UTF8 encoding. It appears, by default, that when > using the docker-mailman containers, that the character set is set to > latin1. This may explain why there are lots of import errors, and maybe also > why there are a lot of errors when threads are deleted in hyperkitty's UI. > > > > Is it the case that UTF8 is the preferred character set? I > also saw some threads indicating that maybe utf8mb4 is more preferred. I'd > like to try to change the character_set on the database, if that is > advisable. You want the MySQL encoding for the Mailman database to be utf8mb4. If not, as Ruth says, you will have issues with 4-bute utf-8 encodings. See <https://gitlab.com/mailman/mailman-suite/-/blob/master/mailman-suite_projec…> > Also, is Hyperkitty 1.3.4 officially released? I see that the > list.org instance is using it, but the latest announce I've seen is for > 1.3.3. No, it is not. lists.mailman3.org and mail.python.org both run the HEADs of the GitLab branches so they are generally ahead of the latest releases. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 4 months

[MM3-users] Re: after upgrade: OperationalError: no such column: hyperkitty_mailinglist.archive_rendering_mode

by Mark Sapiro

On 1/31/24 08:02, Hans Mayer via Mailman-users wrote: > > > Dear All, > > recently I did a system os upgrade debian 11.8 -> 12.4 / bullseye -> > bookworm > > This did also upgrade Mailman3 version 3.3.3 -> 3.3.8 as a used the > packages which came with Debian OS. > > Initially after the upgrade I had some troubles with the MM3 services to > start, but I fixed this. > > Now almost everything is running. Only the Archives are not working. Issues with the Debian poackage should be reported to Debian. See <https://wiki.list.org/x/12812344>. > The browser shows a server error, when I look at the mailman-web.log I see > > ERROR 2024-01-31 15:14:14,403 2699563 django.request Internal Server > Error: /mailman3/hyperkitty/ > Traceback (most recent call last): > File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", > line 84, in _execute > return self.cursor.execute(sql, params) > File > "/usr/lib/python3/dist-packages/django/db/backends/sqlite3/base.py", > line 423, in execute > return Database.Cursor.execute(self, query, params) > > sqlite3.OperationalError: no such column: > hyperkitty_mailinglist.archive_rendering_mode You need to run the Django admin (however that's spelled in the debian mailmanweb package) `migrate` command (and probably others, e.g., `collectstatic`, `compress`, `compilemessages`). -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 2 months

[MM3-users] Re: Welcome message template errors

by Mark Sapiro

On 4/21/24 19:15, Mark wrote: > > And the site-owner receives an email with ... > > ==== > Internal Server Error: /mailman3/lists/ > DoesNotExist at /mailman3/lists/ > Site matching query does not exist. > Request Method: GET > Request URL: http://<REDACTED-PUBLIC-IPv4-ADDRESS>/mailman3/lists/ The above means you have to add <REDACTED-PUBLIC-IPv4-ADDRESS> to the list of ALLOWED_HOSTS in your Django settings, but see below. > Django Version: 4.2.11 > Python Executable: /opt/mailman/venv/bin/python3 > Python Version: 3.11.2 > ... etc ... > === > > Regarding the second line in the email - my thinking is that it should > be looking in "/opt/mailman/mm/var/lists" and not "/mailman3/lists/". It's talking about the path in the URL, not a path in the file system. > The error doesn't occur if the is no custom "Welcome message" template - > ie. the user is sent the default welcome message. I think you must be setting the custom template via Postorius and your Django setting for POSTORIUS_TEMPLATE_BASE_URL is wrong. It should be set to the scheme and host you use to access Postorius. I.e, if you normally access Postorius via something like https://example.com/mailman3 set POSTORIUS_TEMPLATE_BASE_URL = 'https://example.com' It is probably now set as POSTORIUS_TEMPLATE_BASE_URL = 'http://<REDACTED-PUBLIC-IPv4-ADDRESS>' -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year

[MM3-users] Re: templates

by Mark Sapiro

On 5/5/23 15:27, Christian via Mailman-users wrote: > Okay I sent a test message this morning and subscribers are reporting they > did not receive it. The smtp.log shows 'smtp to > degrowcali(a)lists.ccalternatives.org for 25 recips, completed in > 3276.275292634964 seconds' (see below) > I alone received it however and it is listed in the archive. Below is the > excerpt from smtp.log. Two of my 5 lists are exhibiting this behavior, while > 2 other lists are working normally. Please advise. Thank you. That message says Mailman delivered the message for 25 recipients to the outgoing MTA. If only one recipient received it, you first need to check the outgoing MTA's logs to see whether the message was delivered to the recipient's mail servers or not. Those logs should indicate that either the message was delivered to each recipient's first hop mail server or not. If not, there should be a reason why in the logs. If the message was delivered, it could have been rejected by an MTA further down stream in which case a DSN message should be returned, but possibly not for days, or it could have been delivered to the user's spam/bulk/junk/promo/whatever folder or silently discarded. Do your list's do bounce processing? If so, what's in Mailman's bounce.log? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: Problem with digests not being sent daily

by Mark Sapiro

On 6/21/24 22:04, Mark wrote: > > At ~04:50 I posted an email to the list. The message was delivered to > members and archived. > > Nothing showed up in /opt/mailman/mm/var/lists/<LISTID> Probably because (in Postorius) Settings->Digest->Enable Digests is No > Then, as "mailman", I ran "mailman digests --periodic" manually and got > the same error (as expected since there is nothing there) ... > > $ /opt/mailman/venv/bin/mailman digests --periodic > Traceback (most recent call last): ... > FileNotFoundError: [Errno 2] No such file or directory: > '/opt/mailman/mm/var/lists/<LISTID>/digest.mmdf' -> > '/opt/mailman/mm/var/lists/<LISTID>/digest.6.3.mmdf' This error should not occur if there is no digests.mmdf. It only does occur because you have set Digest size threshold to 0 under the assumption that 0 means unlimited which it doesn't. If you don't want digests sent on size, you need to set Digest size threshold to a very large number. I've created https://gitlab.com/mailman/mailman/-/issues/1158 to avoid throwing the exception, but setting the threshold to 0 is still wrong as it will cause a digest to be sent on every post. If the Enable Digests setting is Yes, then the lack of digests needs more investigation. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

10 months

[MM3-users] Re: Unknown templates being used

by Mark Sapiro

On 2/14/21 5:44 AM, Tom Stoddard wrote: > I'm a list owner who has recently (within the last week) had my lists > migrated from mailman 2 to mailman 3. The UI that we are using is > Affinity. So you should be getting your support from EMWD. > I've reviewed all of the list templates and begun to customize > some of them. My issue is that I'm receiving messages that don't match > any of the templates. Here is an example of one that I just received > this morning. (The x's are inserted by me. The actual message provided > valid addresses.) > > The xxxxxxxxxx(a)xxxxxxxxxx.org list has 1 moderation requests waiting. > > > Held Subscriptions: > User:xxxxxxxxxx@gmail.com > > Please attend to this at your earliest convenience. That message is not built from a template. It comas from the `mailman notify` command which currently says ```> def _send_notice(mlist, count, detail): > """Creates and sends the notice to the list administrators.""" > subject = _('The {} list has {} moderation requests waiting.').format( > mlist.fqdn_listname, count) > # XXX This should be a template. > text = _("""The {} list has {} moderation requests waiting. ``` I.e., we know it should be a template, but it currently isn't. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Re: Problems with New MM3 Installation

by Mark Sapiro

On 5/11/21 7:13 AM, mm3(a)steele.com wrote: > I have found work around for the settings issue but continue to have an issue with archiving new messages. New messages are stuck here; > > mailman3/mm/var/archives/prototype/[listname]@[domain]/new They aren't `stuck` there. That is where they are archived by the prototype archiver. This is separate from HyperKitty. > I have added this to my mailman.cfg: > > [archiver.hyperkitty] > class: mailman_hyperkitty.Archiver > enable: yes > configuration: /usr/local/mailman3/mailman-hyperkitty.cfg > > And created the "/usr/local/mailman3/mailman-hyperkitty.cfg” as such: > > base_url: http://localhost/archives/ > api_key: [key that matches “MAILMAN_ARCHIVER_KEY” in my settings.py] > > Some documentation says that the url should be "http://localhost/hyperkitty/ but url generates a page not found error on my setup while the archives are available at the “archives” url. > > But, now that I think about it, "localhost" doesn't make sense here because I am virtual hosts and "localhost" will probably just connect to the first virtual host rather than the mailmanweb virtual host. > > Any advice on what do do here? Set base_url: in /usr/local/mailman3/mailman-hyperkitty.cfg to a url that will reliably access HyperKitty, probably the same base URL that a user with a web browser would use. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 11 months

[MM3-users] Re: can't get mail into mailman3 in docker

by Mark Sapiro

On 8/6/21 11:28 AM, bob B wrote: > I see nothing for today when the error happens > in /opt/mailman/var/logs/smtp.log > > But the log has a bunch of these, but these stopped around the 4th > > Aug 04 19:46:04 2021 (28) Available AUTH mechanisms: LOGIN(builtin) PLAIN(builtin) > Aug 04 19:46:04 2021 (28) Peer: ('127.0.0.1', 33912) > Aug 04 19:46:04 2021 (28) ('127.0.0.1', 33912) handling connection > Aug 04 19:46:04 2021 (28) ('127.0.0.1', 33912) EOF received > Aug 04 19:46:04 2021 (28) ('127.0.0.1', 33912) Connection lost during _handle_client() > Aug 04 19:46:04 2021 (28) ('127.0.0.1', 33912) connection lost These are normal messages from the startup of Mailman's lmtp runner. If you correlate these with mailman.log, you'll probably see the server starting at these times. The fact that there is nothing in this log correlating with the Postfix message 2021-08-06T09:08:41.974225-04:00 dockerhost postfix/lmtp[109783]: D630B3083ED0: to=<test(a)mailman-docker.###.####>, relay=localhost[127.0.0.1]:8024, delay=0.11, delays=0.05/0.02/0.04/0, dsn=4.4.2, status=deferred (lost connection with localhost[127.0.0.1] while receiving the initial server greeting) seems to say that Postfix isn't really connecting to Mailman's lmtp and this is consistent with netstat -l not showing something listening on port 8024. I note you have lmtp_host: localhost in the [mta] section in mailman-extra.cfg. Try changing that to lmtp_host: 127.0.0.1 -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 8 months

[MM3-users] Re: Bulk update of members' moderation settings

by Mark Sapiro

On 11/18/21 12:37 PM, Alex King via Mailman-users wrote: > I imported a list from mailman 2.1 using > https://docs.mailman3.org/en/latest/migration.html. > > It happens that emergency moderation was set on the mailman 2.1 list, > and this has resulted in all members having Moderation set to Hold. I > now want to change that to Default Processing for all members. > > Is there a way to achieve that in bulk without clicking through the > members options for each member in Postorius? I don't understand how this happened. The mailman 2.1 list's emergency setting should hsave been imported as the emergency setting of the Mailman 3 list and should not affect individual member's moderation at all. However, to set the moderation action for all members of a list to default processing You can do something like this in mailman shell ``` bin/mailman shell -l list.example.com Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the list.example.com mailing list >>> from mailman.interfaces.action import Action >>> for member in m.members.members: ... member.moderation_action = Action.defer ... >>> commit() ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: Alias Domains in postfix_domains wrong way around?

by Mark Sapiro

On 10/24/20 10:34 AM, Hans-Martin Mosner wrote: > > Is my understanding correct that postfix_domains should have the true (externally visible) domains as keys, and values > that basically don't matter, or should it have both the real domains and their alias names as keys? With such a > convoluted setup, my brain twists a little. I'm not sure what's going on in your case. I have two separate servers that use alias domains, and for both of them, the postfix_domains file lists the alias domain as the key and the real domain as the value. This works fine with the Postfix settings ``` transport_maps = hash:/path-to-mailman/var/data/postfix_lmtp relay_domains = hash:/path-to-mailman/var/data/postfix_domains virtual_alias_maps = hash:/path-to-mailman/var/data/postfix_vmap ``` Is this what you have? Note that the address should be remapped from list@true_domain to list@alias_domain by virtual_alias_maps prior to checking relay_domains. Perhaps you have some other unusual thing in your Postfix configuration. What does `postconf -n` report? This is what I see in the mail log for a typical delivery ``` Oct 18 13:30:44 example postfix/lmtp[13745]: 108CA1F8A03: to=<list(a)x.example.org>, orig_to=<list(a)example.org>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.08, delays=0.05/0.01/0/0.02, dsn=2.0.0, status=sent (250 Ok) ``` where example.org is the true domain and x.example.org is the alias domain. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 5 months

[MM3-users] Re: Installation -- error on mailman-web migrate

by Mark Sapiro

On 9/16/21 8:43 PM, Mark Dale via Mailman-users wrote: > > ... and then at the beginning of many errors printed to screen I now have... > > /opt/mailman/venv/lib/python3.9/site-packages/django_q/conf.py:139: UserWarning: Retry and timeout are misconfigured. Set retry larger than timeout, > failure to do so will cause the tasks to be retriggered before completion. > See https://django-q.readthedocs.io/en/latest/configure.html#retry for details. The current version of mailman_web/settings/mailman.py has ``` Q_CLUSTER = { 'retry': 360, 'timeout': 300, 'save_limit': 100, 'orm': 'default', } ``` Earlier versions omitted the `'retry': 360` which is the issue. > Completely not comprehending the above doc (and being absolutely clueless about django), I blindly added "retry: 30" ... > root@mx:~# nano -c /opt/mailman/venv/lib/python3.9/site-packages/django_q/tests/settings.py > > # Django Q specific > Q_CLUSTER = { > "name": "django_q_test", > "cpu_affinity": 1, > "testing": True, > "log_level": "DEBUG", > "django_redis": "default", > "retry": 30, Make that "retry": 360, > } > > > ... but no joy. Is it me or are there some pieces missing from the documentation? > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 7 months

[MM3-users] Re: Installing mailman 3

by Mark Sapiro

On 07/21/2017 09:36 AM, Rafael Mora wrote: > > Postfix <http://www.postfix.org/>: To setup Postfix, add the following > configuration to master.cf: > > # Support the default VERP delimiter.recipient_delimiter = > +unknown_local_recipient_reject_code = 550owner_request_special = > notransport_maps = > hash:/path-to-mailman/var/data/postfix_lmtplocal_recipient_maps = > hash:/path-to-mailman/var/data/postfix_lmtprelay_domains = > hash:/path-to-mailman/var/data/postfix_domains > > > I added that config at the bottom of the master.cf file and did a 'postfix > reload' and I got this error message: > > [root@localhost ~]# postfix reload > /usr/sbin/postconf: fatal: file /etc/postfix/master.cf: line 129: bad field > count > postfix/postfix-script: fatal: cannot execute /usr/sbin/postconf! First of all, in a report such as this, it would really help if you reported what is actually in master.cf in the vicinity of line 129. However, that said, the doc is wrong. The lines should be added to main.cf, not master.cf. See <https://gitlab.com/mailman/mailman-suite-doc/issues/14>. Also, what you post above is quite garbled. It is not clear what you meant, but the lines to add should be # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no transport_maps = hash:/path-to-mailman/var/data/postfix_lmtp local_recipient_maps = hash:/path-to-mailman/var/data/postfix_lmtp relay_domains = hash:/path-to-mailman/var/data/postfix_domains and should not be wrapped as in your post. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 9 months

[MM3-users] Re: Custom templates (was: Re: Re: nginx configuration on a multitasking server)

by Mark Sapiro

On 1/14/22 6:58 PM, David Newman wrote: > > On 1/14/22 6:35 PM, Mark Sapiro wrote: >> >> The place for feature requests for Mailman core (which this is) is >> https://gitlab.com/mailman/mailman/-/issues, however, this is not >> straightforward as Mailman core doesn't know if you even have >> Postorius or some other web management UI installed or what the URL to >> access it might be. Thus it's not just a simple matter of editing >> templates. It would also require a configuration setting for the base >> URL for the web admin UI and changes in logic to provide an >> appropriate replacement depending on whether or not the base URL was >> configured. > > Understood, thanks. Although this distinction is very important for > server admins, it's likely not meaningful for many list owners and > moderators. For them, MM2.1 sent an email saying "go here" and > MM3/Django/Postorius/Hyperkitty doesn't, at least not out of the box. > > There is some pending template in use by default, just not one with a > URL included. All the templates have defaults and the defaults don't have URLs because these are unknown to core. > Is this something better handled in the venv and/or Web installation > docs? Or should I file a feature request for core, or Postorious or > someplace else? I think a feature request for core is appropriate. I'm only saying implementing this is a non-trivial change. What I do on sites I admin is put custom versions of all these domain:admin:notice:new-list.txt list:admin:action:post.txt list:admin:action:subscribe.txt list:admin:action:unsubscribe.txt list:admin:notice:pending.txt list:member:digest:footer.txt list:member:digest:masthead.txt list:member:regular:footer.txt list:user:action:invite.txt list:user:action:subscribe.txt list:user:action:unsubscribe.txt list:user:notice:post.txt list:user:notice:probe.txt list:user:notice:welcome.txt in /opt/mailman/mm/var/templates/site/en and at mail.python.org which also has German language lists, in /opt/mailman/mm/var/templates/site/de. That could be documented, but it would be preferable to be able to document just a base web management URL and then put a replacement such as $web_ui in the default templates and replace that with a URL if configured or some generic text otherwise. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: Header and footer templates in MM3

by Mark Sapiro

On 1/19/20 1:15 AM, Gila Halpern wrote: > I read the earlier message from Peter Mueller about message decoration, and > where the templates are in the file system. However, when I edit the > header and footer templates in Postorius, those templates do not appear in > the location specified. Should I be looking somewhere else? The templates created in Postorius are created in the postorius_emailtemplate table in Mailman's database and referenced via URLs like 'https://example.com/mailman3/api/templates/list/<list-id>/<template-name>'. I.e., they are not stored in the file system. > (I intend to > write a program to rotate though several headers/footers, so I need to know > where to have it write to.) If Postorius has set a template for a list, it has set the URI for that template and list to one similar to that above and that URI ultimately references the template in the database. You have choices. You can set the templates in Postorius and your program can do database queries to rotate the template text, or you can set the template URIs via Mailman's TemplateManager to file system paths or not set them and use the default paths (deleting them in Postorius will leave them unset). See <https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/templates.ht…> -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 2 months

[MM3-users] Re: Mailman3 stopped working after Upgrade to Ubuntu 21.04

by Mark Sapiro

On 8/7/21 4:35 AM, Thomas Möhle via Mailman-users wrote: > Hey, > > I have set up mailman3 with mailman3-web on my mailserver and after > upgrading to Ubuntu 21.04 my setup stopped working. In what way? Do list posts get delivered? What works and what doesn't? What are the observable symptoms for things that don't work? > I can see repeating > log entries of mailman trying to reach something within hyperkitty and > getting an error. The same constant repeating cycle of log entries is > visible in my log files. It appears from your logs that Mailman core's attempts to reach the hyperkitty api may be failing. Mailman core uses the mailman_hyperkitty module to communicate with the hyperkitty api to get the url at which a message will be stored and to deliver a message to hyperkitty. This may not be working. There are probably unarchived messages in Mailman's var/archives/hyperkitty/spool/ directory. What do you get for example if you go in a web browser with hyperkitty running to https://mail.bitkomplex.de/mailman3/hyperkitty/api/mailman/urls?mlist=landw… And please don't post secret keys and change the value of api_key: in mailman-hyperkitty.cfg and the corresponding value in MAILMAN_ARCHIVER_KEY in your Django settings. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 8 months

[MM3-users] Re: messages in queue/shunt

by Mark Sapiro

On 5/7/23 08:39, Christian via Mailman-users wrote: > Can/should old messages residing in queue/shunt be manually removed? I see > they were delivered. Is there any reason to leave them there? Thank you!! If they were delivered, they shouldn't be in queue/shunt/. Messages are shunted (placed in queue/shunt/) because of some exception in processing that caused processing to be aborted. It is possible for a message to be shunted even though it was delivered if the exception that caused it to be shunted occurred in the archive runner or the digest runner. When a message is shunted, an entry is made in mailman.log indicating the reason and giving a traceback. This information can be used to determine if there is some issue in Mailman that caused the exception, and if so, that issue can be fixed and the message's processing continued via `mailman unshunt`. Also, pointing `mailman qfile` at the shunted .pck file will not only display the raw message, but also metadata indicating which queue was being processed when the exception occurred. In any case, If the message is not going to be unshunted because it was spam or too old to be relevant or whatever, it should be removed from queue/shunt/ if for no other reason than so a future `mailman unshunt` won't requeue it. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: Uncaught runner exception

by Mark Sapiro

On 4/8/20 1:17 PM, Wolfgang Bock via Mailman-users wrote: > > Checked the ownership .... > ls -la: > /var/lib/mailman3/cache > drwxrwx--- 3 root root 4096 Nov 9 22:27 61 > drwxrwx--- 3 root root 4096 Feb 3 17:37 6c > drwxrwx--- 3 root root 4096 Nov 12 11:59 71 > drwxrwx--- 3 root root 4096 Nov 6 12:01 72 > drwxrwx--- 3 root root 4096 Feb 5 21:52 7d > drwxrwx--- 3 root root 4096 Feb 5 23:05 8b > drwxrwx--- 3 root root 4096 Nov 12 23:41 94 > drwxrwx--- 3 root root 4096 Nov 7 08:31 ae > drwxrwx--- 3 root root 4096 Nov 12 23:40 fa It seems at some point Mailman core was run as 'root' rather than 'list'. ... > Changed the ownership for /var/lib/mailman3/cache to list:list and from that point my lists are responding. > > Same problem occurs before fort he list-directory, which I corrected some days ago. > > Is the ownship misconfiguration a coincidence or did I made a mistake somewhere?? This is a Debian/Ubuntu package question. I'm guessing but all of Mailman core and Mailman web should always be run as user:group list:list in your case. It appears that at some point these were started as root. Whether this is something you did wrong or an issue with whatever init/systemd scripts run these things, I can't say. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years

[MM3-users] Re: Mails are not archived at all -- how to check if Hyperkitty is running or not?

by Mark Sapiro

On 9/23/20 4:59 AM, cristian.bianchi(a)usi.ch wrote: > I have a similar problem with mailman 3.2.1 (debian package): > > # mailman info > GNU Mailman 3.2.1 (La Villa Strangiato) > Python 3.7.3 (default, Jul 25 2020, 13:03:44) > [GCC 8.3.0] > > the messages are not archived even if the key is set and hyperkitty is checked as active archiver. > > To analyze the problem I set DEBUG = True in /etc/mailman3/mailman-web.py. > In debug mode the problem does not occur, but this second problem appears: > https://gitlab.com/mailman/hyperkitty/-/issues/84 I don't understand. https://gitlab.com/mailman/hyperkitty/-/issues/84 is supposed to be fixed. Are you saying it isn't. > How can I fix it? Start by finding all the log messages relating to this archiving failure. If there are exceptions with tracebacks, what are they? Also, are there messages in var/archives/hyperkitty/spool/? If so, there will also be ''Exception in the HyperKitty archiver:' messages with an exception logged in mailman.log for each such message every time there is a list post. Note that HyperKitty is not a service that runs like Mailman core. The only check is can you access it via the web? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 7 months

[MM3-users] Re: How to add new lists?

by Mark Sapiro

On 11/2/22 15:21, fstltna--- via Mailman-users wrote: > I have been able to get the web interface up and the default "mailman@" address is there and appears in the list of lists, but when I add a list from the command line with a command like "mailman create foo(a)ourlists.gameplayer.club" it does not return a error and using "mailman lists" lists it as existing. However there is no new entries in the /etc/aliases file and the new list doesn't appear in the web interface... I am confused. How did you install Mailman. There is no default `mailman` address and Mailman doesn't create postfix mappings in /etc/aliases. If you have set ``` configuration: python:mailman.config.postfix ``` in the [mta] section of mailman.cfg, various mappings are created in Mailman's var/data directory? Configuration for Postfix is described at https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h…. There is also information there about other MTAs. As far as your list created with `mailman create` not appearing in the web UI, is the web UI communicating with the Mailman core instance in which you created the list. What does `mailman info` show and in particular is the host and port in its `REST root url` the same as that set in `MAILMAN_REST_API_URL` in Django's settings? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 5 months

[MM3-users] Re: Templates

by Mark Sapiro

On 09/28/2017 01:56 PM, David Krantz wrote: > Hi again, > > I had the problem with getting two footers, i.e. two expansions of the > template. After some digging in the source code I found out that the > decorator made one expansion (without personalization) and that the > delivery handling made another (with personalization). So I hacked > pipelines/builtin.py with a new pipeline that excluded the decorate > step, recompiled and changed to that pipeline for my personalized > list. That worked. Nothing like a bit of shotgun debugging in > production. > > That solves my immediate problem. Is there a known and recommended way > of configuring personalized delivery so that you only get the > personalized footer? I have ideas, but I probably should share them > with the developer list instead. :-) This is clearly a bug and should be fixed. If you report this issue at <https://gitlab.com/mailman/mailman/issues>, we will try to fix it. > Of course this very nice functionality is a bit buried. I activated it > using the interactive python shell, seems less risky than changing the > database directly. There are many core settings not (yet) exposed in Postorius. This is something we need to fix, but it takes time and resources. In the mean time, 'mailman shell' is probably the best way to set them. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 6 months

[MM3-users] Re: trying to clean up the "held messages" mess

by Mark Sapiro

On 5/28/21 12:37 AM, Bjoern Franke wrote: > Hi, > > I migrated a Mailman3 installation on Debian10 yesterday evening from > Debian packages to PIP (thanks to [1]). > > I think some bugs which existed before are now cleaned out, but mailman > still threw exceptions when trying to get the "held messages". What exceptions? Note that there is a lot of cleanup in the as yet unreleased core 3.3.5. You might consider installing that. To do so, in your virtualenv as the Mailman user do ``` pip install --upgrade git+https://gitlab.com/mailman/mailman ``` > The amount of held messages is now reduced, but e.g. a list with 120 > held messages before has till 59 held messages. And now I'm confused: > where are they? The held message entries are in the _request table with `request_type` = 1. For those entries, `key` is the message-id and `data_hash` is the `token` in the pended table and the `id` in the pended table is the `pended_id` of the related entries in the pendedkeyvalue table. The message itself is stored in the file system and is pointed to by the entry in the message table with the corresponding message-id. The exceptions you see are because entries are missing from the pended, pendedkeyvalue and/or message tables. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: trying to clean up the "held messages" mess

by Mark Sapiro

On 5/28/21 11:32 AM, Bjoern Franke wrote: > > But since the upgrade from 3.2.1 to 3.3.x the list owners are spammed with > > ---- > some.listmember(a)domain.tld's subscription has been disabled on > nordwest(a)lists.ffnw.de due to their bounce score > exceeding the mailing list's bounce_score_threshold. This should really be better documented (sigh) Prior to Mailman 3.3.1, bounces were recorded but not processed. Beginning with Mailman 3.3.1, bounces are now properly processed. The issue is all those unprocessed bounces were still in the bounceevent table in the database and even though they were old and likely irrelevant, upon upgrade they were all processed resulting in many spurious disabling of delivery. This is disruptive, but is a one time thing and in your case is now done. For those who haven't yet upgraded, there are two ways to avoid this. The best way is before starting Mailman after upgrading, set ``` [mta] verp_probes: yes ``` in mailman.cfg to enable bounce probes. With probes enabled, users whose score reaches threshold are sent a probe message and their delivery is only disabled if the probe bounces which will only happen for currently undeliverable addresses. The other way is before starting Mailman after upgrading, run a database query similar to ``` UPDATE bounceevent SET processed = 1; ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: Disabled by bounce

by Mark Sapiro

On 1/31/23 22:32, Allan Hansen wrote: > Hi all, > > Apparently Google just started to get very aggressive about DKIM settings. Some hundreds of my subscribers have had their subscriptions disabled because of Google's bounces. > > I tried to 'Enable' some of them, expecting that their bounce scores would be reset, but when I list the users, the bounce scores are still 5. > > Please advise. Will enabling them without the bounce score being reset just cause the server to disable them again. Yes, Google has started enforcing a policy which is effectively DMARC p=reject even for senders whose domains don't publish DMARC p=reject or quarantine. To avoid this issue, you may need to set DMARC Mitigate unconditionally to Yes as well as DMARC mitigation action to Replace From: with list address if it isn't already. As far as enabling without resetting the bounce score is concerned, I think you are correct that they will just be disabled again on the next bounce. This is a bug and should be fixed. However, all of the above can be avoided without any DMARC changes by enabling bounce probes. in the [mta] section of mailman.cfg, set ``` verp_probes: yes ``` Since the probe is sent From: the list's domain, it should pass googles SPF and DKIM checks and not bounce. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 2 months

[MM3-users] Re: To have mailman3 start at boot, trying to configure the systemd mailman3.service unit, but having issues

by Mark Sapiro

On 6/8/24 12:17 PM, Keith Christian wrote: ------------------------------------------------------------------------> Below in line B-6, systemd thinks mailman isn't running, but with the > "/opt/mailman3/venv/bin/mailman" commands, line B-2 says it is. > I could be misinterpreting the systemd output, however. Python not > happy about some directories. All of the systemctl status mailman3.service reports through E 24 are reporting the same failure from Jun 08 09:35:57. The "PermissionError: [Errno 13] Permission denied: '//var/templates'" is what it says. It is trying to create the absolute path /var/templates and user mailman3 doesn't have permission to create a templates/ directory in /var. I'm not sure why this is. It should be trying /opt/mailman3/mm/var/templates. What does ``` /opt/mailman3/venv/bin/mailman info ``` show for config file? Is it correct? Even if it is, you might create /opt/mailman/bin/mailman with appropriate permissions and content ``` #!/bin/bash unset PYTHONSTARTUP exec /opt/mailman/venv/bin/mailman \ -C "/etc/mailman3/mailman.cfg" \ $@ ``` or whatever the correct path to mailman.cfg is and use /opt/mailman/bin/mailman in the Exec* entries in your mailman3.service file or you could just add `-C "/etc/mailman3/mailman.cfg"` to the commands. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

10 months, 2 weeks

[MM3-users] Re: email command join - problem

by Mark Sapiro

On 5/27/21 7:43 AM, sky.x--- via Mailman-users wrote: > Hi All > > Im using Mailman core 3.3.4 on Ubuntu 20.04 with python 3.8 anf have this problem with email command join. > > When send command to ml-request@ > > join address=some.email(a)domain.com > > Response is: > Confirmation email sent to 3dsome.email(a)domain.com > > It add characters 3d to email and realy sent confirmation to it. There is apparently a bug in command processing. The issue here is your join command is getting quoted-printable encoded by your MUA so it looks like ``` join address=3dsome.email(a)domain.com ``` where the `=3d` is the quoted-printable encoding of `=`. We need to ensure that commands, are properly decoded. > Also help command for join return me > join [digest=<no|mime|plain>] [address=user(a)example.com] > > But digest doesnt work as after command > > join digest=no address=some.email(a)domain.com > > i get > > join bad argument: digest=no I think this is the same issue. I also think this is fixed by the fix for https://gitlab.com/mailman/mailman/-/issues/859 at https://gitlab.com/mailman/mailman/-/merge_requests/822. This fix decodes the message body including commands in the message body. Commands in the message Subject: were already properly decoded in Mailman core 3.3.4 except possibly if the Subject: contained non-ascii. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: Mailman 3 stops delivering to a domain after too many bounces

by Mark Sapiro

On 7/12/22 12:34 AM, Julian Kippels wrote: > Hi, > > We have recently upgraded from Mailman 2 to Mailman 3. Since then I > have observed many user reports that mails to mailing lists don't reach > all members. My suspicion is that there are too many "dead" members on > those lists. This was not a problem on Mailman 2, but has become a > problem on Mailman 3. It seems to me that for example Mailman 3 sends > mails to the first 5 existing member addresses from domain A, then > encounters several (20 or so seems to be the threshold) "dead" member > addresses from domain A that generate a bounce and then does not even > attempt to reach the remaining 800 member adresses from domain A and > only sends to members on domain B and domain C. > > Is there a way to globaly ignore bounces and send out mails to all > members of a list, no matter what? Mailman's outgoing runner should not be quitting because of bounces at SMTP time. It seems like there may by some issue causing Mailman's outgoing runner to die. What's in Mailman's var/queue/shunt/ and Mailman's var/logs/mailman.log. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 9 months

[MM3-users] Re: About to Install MM3 -- Seeking clarification

by Mark Sapiro

On 1/2/23 03:54, Onyeibo Oku wrote: > > I pulled the plugs on uwsgi and installed Gunicorn. Gunicorn gave more > mileage but something is still not right. When I visit the mailmanweb > home with a browser, I see the following: > > "Server Error. An error occurred while processing your request." > > Mailmanweb and mailman3 services are running. I perused the log file > at /opt/mailman/web/logs/mailmanweb.log and found the following: > > > raise MailmanConnectionError( > mailmanclient.restbase.connection.MailmanConnectionError: ('Could not > connect to Mailman API: ', > 'ConnectionError(MaxRetryError("HTTPConnectionPool(host=\'localhost\', > port=8001): Max retries exceeded with url: > /3.1/lists?advertised=true&count=0&page=1 (Caused by > NewConnectionError(\'<urllib3.connection.HTTPConnection object at > 0x7f7f4b128c40>: Failed to establish a new connection: [Errno 111] > 0x7f7f4b128c40>Connection refused\'))"))') Postorius is unable to connect to Mailman core's REST API. Are your settings for accessing Mailman's REST API correct? E.g., does MAILMAN_REST_API_URL = 'http://localhost:8001' MAILMAN_REST_API_USER = 'restadmin' MAILMAN_REST_API_PASS = 'restpass' match $ mailman info ... REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:restpass Note the 3.1/ in REST root url is not included in MAILMAN_REST_API_URL. What do you get from, e.g. curl -urestadmin:restpass http://localhost:8001/3.1/lists It should return JSON with information about your lists. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 3 months

[MM3-users] Re: Turn off social logins?

by Mark Sapiro

On 2/14/19 11:10 PM, Stephen J. Turnbull wrote: > Torge Riedel writes: > > > - there is a way to do this now via settings_local.py, but feels > > a little bit risky if default configuration changes on update of > > mailman > > This should not be true. If it is, we need to fix that. Will check. It is more or less true. The issue is that unlike mm_cfg.py and Defaults.py in Mailman 2.1, the recommended way to set up Django in Mailman 3 is to point Django at settings.py for the default config, and the last thing in settings.py is try: from settings_local import * except ImportError: pass Thus,the only way settings_local.py can change something like INSTALLED_APPS is to redefine INSTALLED_APPS in it's entirety which leads to the possibility of INSTALLED_APPS changing in settings.py and those changes not being picked up in settings_local.py. The way around this is to remove the import of settings_local from settings.py and then put from settings import * at the beginning of settings_local.py and then point Django at settings_local rather than settings. Then you can do things like try: INSTALLED_APPS.remove('allauth.socialaccount.providers.google') except ValueError: pass in settings_local.py except there are still issues because, e.g., INSTALLED_APPS is defined as a tuple (immutable) and not a list in settings.py. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 2 months

[MM3-users] Re: Is there a way of recording bounce messages?

by Mark Sapiro

On 9/26/23 11:29, Mohsen Masoudfar wrote: > > I'm dealing with the same issue. Upon reviewing the logs, I've noticed a significant number of bounced emails for a particular mailing list. Gmail users have reported not receiving emails. > I haven't been able to locate the "munge from" information. My current setup is using Mailman 3.1.1. I read it has been introduced in 3.2. DMARC mitigations were introduced in Mailman 3.1.0. They should be available in 3.1.1. They were first exposed in Postorius 1.1.0. Where are you looking for DMARC mitigations? > The Question is what to do with Mailman 3.1.1, if the upgrade is not an option. > > I get in the logs messages like below with several Queue-ids: > > Sep 25 09:03:55 localhost postfix/smtpd[26692]: 147583E927: client=a14-93.smtp-out.amazonses.com[54.240.14.93] > Sep 25 09:03:55 localhost postfix/cleanup[26696]: 147583E927: message-id=<0100018acb94b326-fdf39193-144e-4fdc-8faf-0d3df54eb4ee-000000(a)email.amazonses.com> > Sep 25 09:03:55 localhost postfix/qmgr[1298]: 147583E927: from=<>, size=24934, nrcpt=1 (queue active) > Sep 25 09:03:55 localhost postfix/lmtp[26697]: 147583E927: to=<listname-bounces@servername>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.03, delays=0.01/0/0/0.01, dsn=2.0.0, status=sent (250 Ok) > Sep 25 09:03:55 localhost postfix/qmgr[1298]: 147583E927: removed This only says that some Amazon MTA has relayed a bounce to Mailman. It says nothing about why the message bounced. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 6 months

[MM3-users] Re: Handling of (un)subscribe mails for already (un)subscribed users

by Mark Sapiro

On 12/10/20 2:04 PM, Andreas Barth wrote: > * Mark Sapiro (mark(a)msapiro.net) [201210 22:51]: >> On 12/10/20 11:51 AM, Andreas Barth wrote: >>> Hi, >>> >>> I noticed that a mail to -subscribe for an already subscribed user >>> doesn't get any response (about line 225 in >>> mailman/src/mailman/app/subscriptions.py). Same but different for >>> unsubscribe for users not on the list. >> >> >> I tested and I see this, so there is a bug, but I don't know what the >> issue is. > > Ok, if you consider this a bug it makes sense to fix it upstream and > not just locally. > > > >> The code you point to should raise AlreadySubscribedError and >> <https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/commands/eml_m…> >> should catch it and report, but this doesn't seem to be happening.. > > Actually I don't see where it should send the mail in the code you > refered to, but I'm pretty new to mm3-code and the involved coding > guidelines. Ther code pointed to adds the error to `results` and returns ContinueProcessing.yes. The return is to mailman/runners/command.py which is ultimately responsible for returning `results` to the user in a `results of your email commands` message. The issue is the code at <https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/app/subscripti…> appears to not be executed as in my test at least, the workflow continued. > I would tend to add something along > msg = UserNotification( > self.mlist.owner_address, self.mlist.owner_address, > subject, text, self.mlist.preferred_language) > msg.send(self.mlist) > (with appropriate subject, ...) before > https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/app/subscripti… > but of course that could be the wrong approach (but as > subscriptions.py is sending out mail at other places, that's my first > idea). Aside from the fact that this wouldn't work if that code isn't executed, sending that message at that point would not be appropriate if the subscription request originated from something other than an email command. I.e., if it's a web subscribe, the error should be reported in the web response, not in an email to the user who may not even be the one originating the request. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 4 months

[MM3-users] Re: Issues with @gmail.com addresses

by Mark Sapiro

On 9/5/23 12:59, Mohsen Masoudfar wrote: > Hi, > > since 8/1/2023 I get complains from users with @gmail.com addresses, that they are not getting any emails. > I checked the logs and I see that the emails are going out: > > to=<xxxx(a)gmail.com>, relay=email-smtp.us-east-1.amazonaws.com[35.169.171.20]:587, delay=0.46, delays=0.03/0.06/0.13/0.24, dsn=2.0.0, status=sent (250 Ok xxx ) > > But it seems the users are getting email delivered to them. > I’ve advised them to check their spam, promotions, and social folders and to add the list address to their email safe-senders lists, but still no success. > Is there any way to help this list members? Even though gmail publishes a DMARC policy of none, it has recently started enforcing a stricter policy for mail From: the gmail.com domain. You need to apply DMARC mitigations to mail From: the gmail.com domain. There are two ways to do this. One way is to set DMARC Mitigations -> DMARC Mitigate unconditionally to Yes (and set DMARC mitigation action appropriately) The other way requires upgrading Postorius and Mailman core to the heads of the GitLab branches (core=3.3.9b1, postorius=1.3.9b1). Doing this enables a DMARC Addresses setting which can be set to `^.*(a)gmail\.com$` to apply DMARC mitigatations to mail From: the gmail.com domain regardless of it's published policy. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 7 months

[MM3-users] Re: Handling of Mail from non-subscribers

by Mark Sapiro

On 5/8/20 5:32 PM, Peter Adebahr via Mailman-users wrote: > > May 09 01:22:38 2020 (1235) SHUNTING: 1588980158.3151...... > > But immediately before I find the "module 'time' has no attribute > 'clock'" which I remember from a thread a couple of days ago, though I > cannot remember a solution when mm3 has not been installed from source > but via apt-get. > > My core is V 3.2.2, core python 3.8.2, by the way. That is exactly the issue. Mailman 3.2.2 is not compatible with Python 3.8. This is a Debian/Ubuntu packaging bug. What has happened is the post encountered the exception shown in the Traceback that preceded the SHUNTING message and the message that triggered the exception was placed in the shunt queue. The thread you remember is <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…> The fix is to patch your Mailman installation with the changes at <https://gitlab.com/mailman/mailman/-/merge_requests/552/diffs?commit_id=ea0…>. Or, at the very least change x = random.random() + right_now % 1.0 + time.clock() % 1.0 to x = random.random() + right_now % 1.0 + time.process_time() % 1.0 in mailman/utilities/uid.py. After doing that and restarting Mailman core you can do `mailman unshunt` to reprocess the message or if you prefer, `mailman unshunt --discard` (or just remove it from the shunt queue) to discard it. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: Moderation not working?

by Mark Sapiro

On 11/24/20 12:30 PM, peter(a)chubb.wattle.id.au wrote: > > Hi Folks, > Running a shiny new instance of mailman3, as per the Debian package > (version 3.2.2) but the moderation doesn't seem to work. WE got > hit by a heap of spammers overnight, even though the 'hold for > moderation' bit is set for non-members (and now for members too). If the action for member posts was accept ot default processing at the time, perhaps the spam spoofed a member address in one of From:, Reply-To:, Sender: or the envelope sender, > Emails seem just to get straight through. Even now with both member and non-member actions set to hold? > Any advice on how to debug this? Would upgrading to a later version > using pip help? An upgrade probably won't help. This should work in your version. For one of the mail's, check all 4 addresses, From:, Reply-To:, Sender: and the envelope sender (available in the MTA logs). Note that Reply-To: and/or Sender: may have been modified by the list. Then see if any of those addresses matches a member or a non-member and what the specific moderation action is for that address. Also check the list's accept_these_nonmembers which is probably not exposed in your version of Postorius but which you can see via `mailman shell`. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 4 months

[MM3-users] Re: Header Filter madness

by Brian Carpenter

On 1/13/21 3:05 PM, Mark Sapiro wrote: > On 1/12/21 9:57 PM, Mark Sapiro wrote: >> On 1/11/21 6:14 PM, Brian Carpenter wrote: >>> On 1/11/21 8:48 PM, Mark Sapiro wrote: >>>> On January 11, 2021 5:50:04 PM MST, Brian Carpenter >>>> <brian_carpenter(a)emwd.com> wrote: >>>>> I have a client whose header filters seemed to have stop working. No >>>>> matter what I try, it seems none of their header filters are being >>>>> applied. Other lists on the same server that use header filters, are >>>>> working fine. This particular header is the subject header. I can >>>>> duplicate their problem but only with their list. If I create the exact >>>>> same header on a test list using the exact same subject line, the >>>>> header >>>>> filter does its job (moderate). Just not with this one list. >> >> What's in the X-Mailman-Rule-* headers of the post that should be but >> isn't held? >> >> Are there other header filter rules besides the one that doesn't work? > Also, on your test list, did you copy/paste the regexp or retype it. If > the latter, there is possibly trailing whitespace that breaks it. Thanks Mark. I am currently waiting for feedback from my client. -- Brian Carpenter Harmonylists.com Emwd.com

4 years, 3 months

[MM3-users] Re: Subscription request cannot be moderated: 404 Not Found

by Mark Sapiro

On 1/16/21 9:46 AM, Eric Broens via Mailman-users wrote: > Hi Mark, > Unfortunately the provided options didn't work out either: > > Welcome to the GNU Mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > The variable 'm' is the ************* mailing list >>>> ISubscriptionManager(m).confirm('4d6b4b11266c7332684c5a492eb3f92c531f761b') > Traceback (most recent call last): > File "<console>", line 1, in <module> > File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/app/subscriptions.py", line 578, in confirm > workflow.restore() > File "/opt/mailman/venv/lib64/python3.6/site-packages/mailman/app/workflow.py", line 142, in restore > raise LookupError(self.token) > LookupError: 4d6b4b11266c7332684c5a492eb3f92c531f761b It appears that although the token was in the pended table, it wasn't in the workflowstate table. I have no clue how this happened. > I noticed that the mail address was also listed as a non-member. > After deleting it there, I could not accept the subscription either. > Next, I have rejected the subscription and added it using the mass subscription option in the WebUI. > > I'll monitor if such cases will happen again. Hopefully it won't happen again, but at least you have a workaround. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 3 months

[MM3-users] Re: Mailman3 is wrongly display name a list member

by Mark Sapiro

On 1/11/22 9:24 AM, Allan Hansen wrote: > Thank youi, Stephen. > > Oops. When I wrote below that I set the name 'B' in the account, I did describe it wrongly. Sorry. > The member just wants one name, 'A' for all her subsriptions. Somehow the 'B' got into the system when we upgraded from Mailman 2 to Mailman 3. > > I removed the address from all the lists, set the account display name to 'A' in Django, verified that she was not subscribed to any list at all, and then resubscribed her again as 'A'. In other words, no 'B' anywhere - straight 'A's. > Nevertheless, the new subscriptions still show up as 'B'. A user has a user record and one or more address records. Each of these has a display name. Removing users from lists does not remove these records. If you have recent Postorius, you should have a `users` item at the top of Postorius pages. Go there, find the user and click "Manage". You can change Display Name there. Otherwise, in `mailman shell` for example ``` >>> usr = getUtility(IUserManager).get_user('user(a)example.com') >>> usr.display_name = 'First Last' >>> for adr in usr.addresses: ... adr.display_name = 'First Last' ... >>> commit() ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: A few more MM3 questions

by Mark Sapiro

On 5/29/24 9:48 AM, Marc SCHAEFER wrote: > > May I just modify those files, and is there any way to see, in the web GUI, > where those files are referenced? Yes, you may modify them. The search algorithm for templates is described at https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/utilities/i18n… however, this is only for templates which have no entry or a mailman:/// entry in the template table in the database. Also see https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… > In the database itself, the template table is empty (as seen in the GUI) and I > did not see the text "web_page_url" in a dump of the database, so I have some > issues to understand how this is used by Mailman (except direct file access > to /var/lib/mailman3/templates?) It is by direct access following the search algorithm. If you are looking at templates in Postorius, these can be created and will place the template in the postorius_emailtemplate table in the database and an entry in the templates table with a URI beginning with the POSTORIUS_TEMPLATE_BASE_URL setting to retrieve the template via the Postorius API. The Postorius template UI should show the current value for a template not yet set in Postorius, but it doesn't. See https://gitlab.com/mailman/postorius/-/issues/366. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

10 months, 3 weeks

[MM3-users] Re: 500 error on Held Messages page

by Mark Sapiro

On 9/20/22 19:54, Dan Caballero wrote: > I'm getting an unexpected error when I try to clear all the held messages. Any ideas what could be wrong here? > ``` > (mailmanve) mailman@11f52637274a:/var/www/mailman-www$ mailman shell -l jewishlife(a)caltech.edu > Welcome to the GNU Mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > The variable 'm' is the jewishlife(a)caltech.edu mailing list >>>> from mailman.app.moderator import handle_message >>>> requestdb = IListRequests(m) >>>> for req in requestdb.held_requests: > ... if req.request_type == RequestType.held_message: > ... handle_message(m, req.id, Action.discard) > ... > Traceback (most recent call last): > File "<console>", line 3, in <module> > File "/opt/mailmanve/lib/python3.9/site-packages/mailman/app/moderator.py", line 112, in handle_message > key, msgdata = requestdb.get_request(id) > TypeError: cannot unpack non-iterable NoneType object ``` There is a corrupt request with a request id that doesn't exist. Try something like: ``` >>> from mailman.interfaces. >>> requestdb = IListRequests(m) >>> for req in requestdb.held_requests: ... if req.request_type == RequestType.held_message: ... if not requestdb.get_request(req.id): ... print(f'Bad request id: {req.id}, deleting') ... requestdb.delete_request(req.id) ... ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 7 months

[MM3-users] Re: Archives with encoding characters

by Mark Sapiro

On 3/4/20 8:55 AM, Seth Seeger wrote: > Hello everyone, > > I have a few (but not all) members complaining that their digests are full of coded characters. Two examples below were forwarded to me: > >> What I ended up doing was creating 2 "practice lines" in the centre of=20 >> our big teaching circle (I always teach new figures in a big circle) -=20 >> which each had 3 people set up in a line with generous space between,=20 >> and first=C2=A0 I walked through one of those lines myself starting first= >> =20 > > and > >> Robins pass Right=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= >> =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Larks Loop L= >> eft > > What is the cause? Is there anything I can do about it? The cause is a quoted-printable encoded message body not being decoded. This may or may not be a Mailman bug, but if as Mark Dadgar suggests, it only happens with some MUAs, the issue might be in the MUA. To understand more we'd need to see the actual raw digest message from the list, or maybe just a raw incoming message that winds up like that in the digest. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 1 month

[MM3-users] Re: Restore/export existing Mailman lists + hyperkitty archives on a new server

by Mark Sapiro

On 9/14/23 2:09 AM, Alex Schuilenburg via Mailman-users wrote: > > I am migrating from mailman 3.2.1 & mailman3-web 0+20180916-8 on Debian Buster to mailman 3.3.8 & mailman3-web 0+20200530-2.1 on Debian bookworm, have mailman3 and mailman3-web configured (and running on bookworm) from the initial install. But when I use the mailman3-web 0+20180916-8 database (after stopping mailman3 and mailman3-web) on bookworm, unfortunately migrate fails: ... > But the migrate fails at the first operation: > # mailman-web migrate > Operations to perform: > Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, sessions, sites, socialaccount > Running migrations: > Applying contenttypes.0001_initial...Traceback (most recent call last): ... > MySQLdb._exceptions.OperationalError: (1050, "Table 'django_content_type' already exists") You are attempting to apply migrations that have already been applied. Apparently the django_migrations table is inconsistent with the state of the database. > Indeed the table django_content_type already exists on 0+20180916-8 . Apart from fields changes, there are an additional 4 tables in mailman3-web 0+20200530-2.1 > > I managed to import the mailman 3.2.1 database to the mailman 3.3.8 database, and all lists, subscriptions and settings looks fine. > > So how can I upgrade my existing mailman3-web database? This appears to be a Debian package issue. I suggest you ask Debian. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 7 months

[MM3-users] Re: [Mailman-Developers] Re: Help on Gitlab

by Mark Sapiro

Plese keep the thread on the list. On 3/8/24 6:36 AM, Daniel Azubuine wrote: > Sir, I get this error > /home/daniel/Documents/repos/mailman/mailman/.tox/qa/bin/python: can't > open file '/home/daniel/Documents/repos/mailman/mailman/setup.py': > [Errno 2] No such file or directory > ERROR: invocation failed (exit code 2)/ > _______________________________________________ summary > ________________________________________________ > ERROR: qa: InvocationError for command > /home/daniel/Documents/repos/mailman/mailman/.tox/qa/bin/python > /home/daniel/Documents/repos/mailman/mailman/setup.py --name (exited > with code 2) > when i run tox -e qa. What is your tox version (tox --version)? You shouldn't need this, but adding ``` skipdist = True ``` in the [tox] section of tox.ini may help. > I also get this when i run tox -e py310-diffcov > ------------- > src/mailman/interfaces/listmanager.py (75.0%): Missing lines 37 > ------------- > Total: 4 lines > Missing: 1 line > Coverage: 75% > ------------- > > ERROR: InvocationError for command > /home/daniel/Documents/repos/mailman/mailman/.tox/py310-diffcov/bin/diff-cover coverage.xml --fail-under=100 --compare-branch origin/master (exited with code 1) This is expected output in this case. Line 37 in your src/mailman/interfaces/listmanager.py is not covered by any tests. Modifying the test_cannot_create_a_list_twice test in src/mailman/model/tests/test_listmanager.py to use assertRaisesRegex rather than assertRaises may help. See <https://docs.python.org/3/library/unittest.html#unittest.TestCase.assertRai…>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 1 month

[MM3-users] Re: config incoming email in my domain cpanel

by Rafael Mora

El jue., 3 ago. 2017 a las 15:26, Mark Sapiro (<mark(a)msapiro.net>) escribió: > On 08/03/2017 01:22 PM, Rafael Mora wrote: > > El jue., 3 ago. 2017 a las 15:18, Mark Sapiro (<mark(a)msapiro.net>) > escribió: > >> > >> You need to forward port 25 for SMTP mail delivery and if you want the > >> web UI (Postorius and HyperKitty) accessible from the outside, port 80 > >> for http and/or port 443 for https > >> < > >> > https://www.iana.org/assignments/service-names-port-numbers/service-names-p… > >>> . > >> > > > > I mean for incoming mail redirected from my hostgator hosting, because > when > > I suscribe an email address MM3 sends a confirmation email, so I have to > > reply to be suscribed to the list. > > > As I said, for mail delivery you need to forward port 25 to the Mailman > server. > Ok so I'll redirect in my zentyal firewall the port 25 to my local centos7 with postfix and MM3 with IP 192.168.1.42. Thanks Mark. > > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Atentamente / Best Regards Ing. Rafael Mora

7 years, 8 months

[MM3-users] Re: Missing Base64 encoding from control message reply

by Mark Sapiro

On 9/23/23 02:54, Jana Berger wrote: > > I have multiple control messages, all received from my instance which > all contain the "Content-Transfer-Encoding: base64" marker, their > contents is plain text (Content-Type: text/plain; charset="utf-8"), but > they are still encoded using base64. It seems you are saying these messages are valid. I.e. they specify "Content-Transfer-Encoding: base64" and the body is in fact base64 encoded. This is as they should be. > Of course that is not proof, but an indication that it is either done by > the mail server itself or widely across MUAs. As you say, this suggests that some MTA in the path to your user or the user's MUA is responsible for decoding the base64 encoded body but leaving the "Content-Transfer-Encoding: base64" header as is. > Global "Preferred language" is "English (USA)", which is not overridden > by the list in question. I have not changed the default encoding. Is > there a surefire way to detect this? > > My mailman.cfg has no section pertaining to encoding, and all related > files also do not mention encoding. The Subject: and body of these messages should be ascii, not utf-8 unless you have something like ``` [language.en] charset: utf-8 ``` in your mailman.cfg -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 7 months

[MM3-users] Re: Single Click Unsubscribe

by Mark Sapiro

On 1/25/24 15:21, olebra(a)samfundet.no wrote: > > To me, "subscribed messages" in the above means the policy applies to > everyone sending over 5k emails daily, whether for marketing or not. > > All the best, > Ole > > [0]: https://support.google.com/a/answer/81126 > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… You can always put something like the above "To unsubscribe ..." line in the lists footer as we do. Gmail's web UI renders that as a mailto: link. Further, at least in some cases, Gmail's web UI recognizes the List-Unsubscribe header in the message and provides it's own Unsubscribe buttons in the web UI. Granted, these aren't truly "one click" as they require confirmation, but that can be avoided by setting a list's unsubscribe_policy to `open`. Also granted that Gmail is the 900 pound gorilla here, but unsubscribe links that don't require confirmation are a bad idea. Even if the link contains some kind of encrypted data to ensure it can't be spoofed, there is still a danger if I forward list mail to a 3rd party and they click my unsubscribe link. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 2 months

[MM3-users] Re: Held messages: Long time waiating for response of the Mailman API

by Mark Sapiro

On 1/24/22 15:06, Mark Sapiro wrote: > On 1/18/22 06:24, Stephan Krinetzki wrote: >> Hello, >> >> We are using Mailman 3.3.5 with Hyperkitty 1.3.5. Mailman 3 is >> installed in a venv and deployed using Apache and uwsgi. This works >> quite well so far, only withheld messages cause us a problem: If we >> try to approve them via Postorius, the message is delivered to the >> list immediately, but the success message in Postorius takes a long >> time - on average the process hangs for three minutes until the >> message is no longer displayed. We have already adjusted the timeout >> in gunicorn.cfg, but this does not improve the situation. Are there >> any tips on how we can speed up the REST API? Or is it even a >> configuration error? > > > There are two steps in handling the POST for a held message. The first > step is accepting, rejecting or discarding the message. This is > happening immediately. > > The second step is handling the poster's moderation action based on the > choice from the Set member moderation dropdown in the view of the held > message. This is processed by the code at > <https://gitlab.com/mailman/postorius/-/blob/master/src/postorius/views/list…>. > If no selection has been made, the default value POSTed for > moderation_choice is `no-action` and that code is skipped. If it is one > of the choices `Hold for moderation`, `Reject (with notification)`, > `Discard (no notification)`, `Accept immediately (bypass other rules)` > or `Default processing` that is processed. So presumably a selection has > been made and processing is stuck on getting the member or setting the > member's moderation action. > > Possibly the logs of your database manager will have information. > Some additional info. By gunicorn.cfg, do you mean the file at mailman/config/gunicorn.cfg? If you are using gunicorn as a wsgi server, that is separate from the gunicorn serving the REST API and its config doesn't affect the REST API. The relevant config is mailman/config/gunicorn.cfg?. Also, I doubt the issue is with the REST API per se, but rather it is in Mailman core's processing of the particular endpoint and if that is slow, it is most likely some kind of database issue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 2 months

[MM3-users] Re: Scheduled tasks

by Mark Sapiro

On 6/7/18 9:59 AM, Darren Smith wrote: > All, > > I am looking more through the documentation of the Mailman Suite here: > > https://media.readthedocs.org/pdf/gnu-mailman/latest/gnu-mailman.pdf > > In section 3.2.5 it talks about the scheduled tasks that need to be run to > do "specific routine functions" in hyperkitty. > > I installed through the easy install script found here: > > https://github.com/iomarmochtar/mailman3_ei/ > > However, I can't find anything in THAT documentation that talks about these > cron jobs, and in fact the Mailman Suite isn't installed through that > script. That is a third party project. If you have issues with it, you should take them up with @iomarmochtar. > Can someone point me to any other documentation about the tasks that need > to be run on a continual basis? The section 3.2.5 you refer to tells you what needs to be set up in cron. For a list of the jobs tat are run, use django-admin runjobs --list . Our hyperkitty installation seems to be > bogging down more and more, and I am hoping that it will be as simple as > just running some jobs that haven't been on our radar. what do you mean by 'bogging down'? If you aren't doing so, setting up qcluster as in section 3.2.3 may help. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 10 months

[MM3-users] Re: 500 Internal Server Error on specific list pages

by Mark Sapiro

On 7/29/20 9:55 PM, Johnny Cison wrote: > I have a new Mailman 3 server set up and am having a strange issue with > just one particular list. > > Accessing the list's Info page URL or it's Archiving Settings page URL > returns a 500 Internal Server Error, but its other pages work correctly. > Also, the Info and Archiving pages on the other lists are working correctly. > > When I access the info page for the problem list, I get these errors in the > log: > > Traceback (most recent call last): > File > "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py", line > 41, in inner > response = get_response(request) ...> line 103, in call > raise HTTPError(url, response.status, content, response, None) > HTTPError: HTTP Error 500: A server error occurred. Please contact the > administrator. > > > When I access the Archiving page in Settings, I get these: > > Traceback (most recent call last): > File > "/usr/lib/python2.7/dist-packages/django/core/handlers/exception.py", line > 41, in inner ... > line 103, in call > raise HTTPError(url, response.status, content, response, None) > HTTPError: HTTP Error 500: A server error occurred. Please contact the > administrator. These messages are from Django's log. What's in Mailman's mailman.log? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 8 months

[MM3-users] Re: postfix malformed address with confirm replies

by Mark Sapiro

On 2/26/21 3:34 PM, Stephen Willey Mats Mats wrote: > > I’m getting bounces back from postfix (553 5.1.3 Error: malformed address) for my confirm replies. ... > I’m pretty sure I have all of the mailman settings in postix: > " > # Support the default VERP delimiter. > recipient_delimiter = + Yes, this is the relevant one and is correct. ... >> The mail system >> >> <matsmats-mm3-test1-confirm+d6f77a2572ef55a8b2c4ca0d77de8493fbb55856(a)mm3.aca-aws.s.uw.edu>: >> host 172.19.199.2[172.19.199.2] said: 553 5.1.3 Error: malformed address >> (in reply to RCPT TO command) >> Reporting-MTA: dns; ip-172-31-18-222.us-west-2.compute.internal >> X-Postfix-Queue-ID: E144B8BC3C5 >> X-Postfix-Sender: rfc822; stephen.s.w.matsmats(a)gmail.com >> Arrival-Date: Fri, 26 Feb 2021 14:08:54 -0800 (PST) >> >> Final-Recipient: rfc822; matsmats-mm3-test1-confirm+d6f77a2572ef55a8b2c4ca0d77de8493fbb55856(a)mm3.aca-aws.s.uw.edu >> Original-Recipient: rfc822;matsmats-mm3-test1-confirm+d6f77a2572ef55a8b2c4ca0d77de8493fbb55856(a)mm3.aca-aws.s.uw.edu >> Action: failed >> Status: 5.1.3 >> Remote-MTA: dns; 172.19.199.2 >> Diagnostic-Code: smtp; 553 5.1.3 Error: malformed address I have no idea why Postfix is saying `matsmats-mm3-test1-confirm+d6f77a2572ef55a8b2c4ca0d77de8493fbb55856(a)mm3.aca-aws.s.uw.edu` is a malformed address, but this is a Postfix issue, not Mailman. Can you successfully post to `matsmats-mm3-test1 @mm3.aca-aws.s.uw.edu` how about a `help` command to `matsmats-mm3-test1-request(a)mm3.aca-aws.s.uw.edu` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: problems installing mailman3 under gentoo and upgrading mailman2 to mailman3

by Mark Sapiro

On 3/13/21 7:08 PM, John Covici wrote: > On Sat, 13 Mar 2021 16:22:59 -0500, > Abhilash Raj wrote: >> >> My guess is that you updated the database (perhaps, by invoking the mailman >> command form 3.3.3) and then tried to start 3.3.2. In this case, Mailman comes >> up and sees a new revision for the database migration added from 3.3.3 but >> can’t find the same migration in its source (because it is 3.3.2). > > That is sort of what happened, except in the opposite direction, it > was from 3.3.3 to 3.3.2. My question is therefore, do I have to > update this alembic_version when I upgrade mailman to a newer version? > That is what I was getting at. Abhilash's conjecture is that the error was due to a Mailman version accessing a database that had been previously accessed by a newer version so that the version_num in the alembic_version table didn't exist in mailman/database/alembic/versions/. This normally would not occur on an upgrade of Mailman, but if you went from a gentoo Mailman core to a version obtained by pip, it's possible that the gentoo Mailman had an alembic version that wasn't known to the pip Mailman even though the pip Mailman was newer. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: sending messages in response to posts from non-members

by Mark Sapiro

On 2/26/22 04:26, David Bremner wrote: > > I'd like to turn off the "bounce messages" sent by mailman to > non-members. My reasoning is that most such posts are spammers, and > often use forged return-paths / From's, so I end of sending steady > stream of backscatter to amazon.com etc... > > Is this configurable (without postorius) somehow? What exactly do you want? Do you want to discard without notice any nonmember posts or do you want to hold them but not send a notice of the hold to the poster? For the former, you want to set the list's default_nonmember_action to discard. For the latter you want to set the list's respond_to_post_requests to False. To make either of these settings the default for new lists, you'd need to patch mailman/styles/base.py. To set them for all lists you could do the following in `mailman shell` ``` $ bin/mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> for mlist in getUtility(IListManager).mailing_lists: ... # Pick the appropriate one of the following. ... mlist.default_nonmember_action = Action.discard ... mlist.respond_to_post_requests = False ... >>> commit() ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 1 month

[MM3-users] Re: MM attaches mime-attachments to mail as text file since update to 3.3.8

by Mark Sapiro

On 1/17/23 23:45, Stefan Bauer wrote: > Dear Users & Developers, > > we're running MM3 on Ubuntu 22 and used the venv-installation method. > Last week we updated via¹ to > > Mailman Core-Version GNU Mailman 3.3.8 (Tom Sawyer) > Mailman Core API-Version 3.1 > Mailman Core Python-Version 3.10.6 (main, Nov 14 2022, 16:10:14) [GCC > 11.3.0] > > and now mailman attaches mime-attachments to email as text-files. That > breaks many mails in our environment. > > For example: Now we have attachments like > > smime.p7s + ATT000001.txt as well as what looks like MM footers > "mailing list --- test@domain ... To unsubscripbe send an email to ..." > > How can we get the "old" processing back? I doubt this has anything to do with the upgrade per se. It has to do with MIME multipart (in this case, signed) messages and how MM headers/footers are added. The MM 2.1 FAQ article at <https://wiki.list.org/x/4030707> has some info on this. In order to say more, I would need to see the list's settings for Filter types, Filter extensions, Pass types, Pass extensions, Collapse alternatives and Convert html to plaintext and the complete MIME structure of the incoming message. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 3 months

[MM3-users] Re: New Mailman 3 installation issues

by Mark Sapiro

On 5/19/21 1:26 PM, Sarah H wrote: > I think you've just hit the nail on the head as far as my biggest issue with this project. The documentation lays out an install method that should be roughly followable for anyone (though it needs a bit of fine tuning here and there) and then the rest of the configuration guide and documentation assumes that you have installed the software in a completely different way and doesn't work the same as the guide laid out. Because virtually all that documentation was written by different people and long before the https://docs.mailman3.org/en/latest/install/virtualenv.html was added. > The documentation should be uniform, if you want users to install it one way then write the guide and documentation so that's the "default". Sure present alternatives or notes "if you've installed via git, your commands will look like this xxx" but ultimately the biggest issue I've had with getting this deployed is inconsistent or lacking documentation. I'm not trying to make excuses. I know the docs need improvement, but we are a very small, all volunteer project doing the best we can. If you feel you can offer improvements to the documentation, we'd love to have your help. You are more than welcome to submit merge requests to update the docs. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 11 months

[MM3-users] Re: Importing archive from mm21

by Mark Sapiro

On 11/27/23 13:01, Lars Bjørndal wrote: > I imported an archive from a list created in September 2013 with the > following command: > > mailman-web hyperkitty_import -l annonsering(a)hodr.no --since 2013-09-01 <mbox file> If it's a new list with no current archive, I typically don't use --since. If there might be messages in the archive, I normally use something like `--since 1970-01-01` just to be sure I get everything. > No errors reported. And this should have imported all messages with Date: header dates >= 2013-09-01 plus any without Date: headers. > I then did > > mailman-web update_index_one_list annonsering(a)hodr.no > > No, when I go to https://hodr.no/archives/list/annonsering@hodr.no/, I > cannot choose mails earlier than January 2023. > > What's the problem, do you think? The messages are there. I went to https://hodr.no/archives/list/annonsering@hodr.no/ and only saw messages from 2023, but then I went to https://hodr.no/archives/list/annonsering@hodr.no/latest?count=200&page=2 and started seeing all the messages even at https://hodr.no/archives/list/annonsering@hodr.no/. What do you see now? I also note your pages seem to be missing the styling as the references to the styles, etc at https://hodr.no/static/* all return 404. Is the issue fixed for you now? I don't understand what caused the issue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 4 months

[MM3-users] Re: Another interesting error...

by Mark Sapiro

On 04/23/2018 02:59 PM, Darren Smith wrote: > Well, using the mailman shell we were able to find the request that was > causing the problem - it was apparently a spam message that had some > chinese characters in it. I am trying to duplicate this issue in a test environment. I can create a message with an invalid RFC 2047 encoded subject, i.e., Subject: =?gb2312?Q?=ff=fe=de=21=a2?= and send it to a list where it gets held, but I don't get a 500 in postorius and I see the held message with a raw (not decoded) header. I think there were some recent changes that affect this. I'll look some more. > We used the shell to delete the held request... > > And postorius is still giving me an error 500. > > If I'm not mistaken the held messages are kept in .pck files - do you know > if when postorius asks for held messages through the API, does mailman go > to the database or to the .pck? I would actually suspect the latter, or > removing the request should have fixed the problem. They were held in .pck files in Mailman 2.1, but not in Mailman 3. They should just be in the database and deleting them via mailman shell should delete them as long as you quit the shell or commit(). -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years

[MM3-users] Re: mass subscribers disablement!?

by Mark Sapiro

On 10/22/21 2:07 PM, Christian Stalberg via Mailman-users wrote: > I added the additional hosts to ALLOWED HOSTS in settings_local.py and > mailman is distributing mail to subscribers again. However, I then received > many emails of valid users subscriptions being disabled. What would cause > that? Did you just upgrade Mailman core from a version <=3.3.0 to one >=3.3.1? If so, see https://lists.mailman3.org/archives/list/mailman-users(a)mailman3.org/threa… > Can subscriber management be done via command line? See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/commands/d… for description of the available mailman subcommands. If you are interested in re-enabling delivery for members whose delivery is disabled by bounce, you can do this fairly easily in an interactive `mailman shell` session. See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/commands/d… Something like the following session: ``` $ bin/mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> lm = getUtility(IListManager) >>> for mlist in lm.mailing_lists: ... for member in mlist.members.members: ... if member.delivery_status == DeliveryStatus.by_bounces: ... member.preferences.delivery_status = DeliveryStatus.enabled ... print("Re-enabled delivery for bouncing member {} on list {}" ... .format(member.address.email, mlist.list_name)) ... <print output here> >>> commit() >>> exit() ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 6 months

[MM3-users] Re: Installed from Howto_Install_Mailman3_On_Debian10, web not quite working

by Mark Sapiro

On 5/7/23 10:51, Volkmar Grote wrote: > thanks for the quick reply. > I am one step closer to a solution, > "http://127.0.0.1:8000/postorius/lists/?all-lists#" seems to work now. > I get the functionality, but it looks ugly w/o any graphics, for which I > get yet another, slightly similar, error message: >> >> >> Page not found (404) >> >> Request Method: GET >> Request URL: >> http://127.0.0.1:8000/static/postorius/img/mailman_logo_small_trans.png >> >> ... > > Nginx, /etc/nginx/conf.d/me.domain.de.conf >> server { >> listen 80; >> listen [::]:80; >> >> server_name me.domain.de; >> ... >> location /static/ { >> alias /opt/mailman/mm/static/; >> } > > Again, many thanks in advance for any clue The above in nginx is correct, but you aren't getting the static files via nginx. You need to go to a URL like http://me.domain.de/postorius/lists/. Going to http://127.0.0.1:8000/postorius/lists/ goes directly to your wsgi server and doesn't involve nginx at all. You need to go to port 80 where nginx is listening and nginx then proxys requests to 127.0.0.1:8000. Do you also have location / { proxy_pass http://127.0.0.1:8000; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } in /etc/nginx/conf.d/me.domain.de.conf. You need that. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: statistics monitoring for Mailman3

by Mark Sapiro

On 3/15/21 12:39 PM, Mohsen Masoudfar wrote: > Hi Mark, > > Thanks again for the nice Python script. There is an issue with outlook.com. They add a '^M' (carriage Return) before msgid!! > Here is part of the log that shows that. This is not in every log, though. I updated the get_log_data function (please see below), I believe it is not the smartest solution, but it seems to be working for me. Does the script with your change produce a different result than the original? This has nothing to do with outlook.com per se. It only has to do with the length of the log message. Further, I do not think there are actually newlines in these log messages. I think that is just an artifact of how you are viewing the log. > Mar 14 12:53:21 2021 (11701) > <MN2PR20MB324587763E970CC56351F8C5B66D9(a)MN2PR20MB3245.namprd20.prod.outlook.com> smtp to testlist3(a)newlistserv.aaas.org for 1 recips, completed in 0.013000726699829102 seconds I suspect if you do ``` grep namprd20.prod.outlook.com /path/to/var/logs/smtp.log ``` The result will be lines like ``` > Mar 14 12:53:21 2021 (11701) <MN2PR20MB324587763E970CC56351F8C5B66D9(a)MN2PR20MB3245.namprd20.prod.outlook.com> smtp to testlist3(a)newlistserv.aaas.org for 1 recips, completed in 0.013000726699829102 seconds ``` whereas if they are really split, the result would be ``` > <MN2PR20MB324587763E970CC56351F8C5B66D9(a)MN2PR20MB3245.namprd20.prod.outlook.com> smtp to testlist3(a)newlistserv.aaas.org for 1 recips, completed in 0.013000726699829102 seconds ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: Issues with cross posted emails after upgrading to mailman 3.3.6

by Mark Sapiro

On 11/4/21 1:02 AM, Simon Coggins wrote: > > All I’m doing is literally appending a subset of a hash of the mailing list rcpt address to the front of the message-id, so that if it gets moderated, each instance of the email has a different message-id and each moderation action has it’s own copy of the email to operate on. This seems to have gotten us out of the immediate issues. But I’m eager to find a better solution that might be more permanent. As you have seen, this is new in 3.3.5. I recognize this is a problem. Previously, attempts to accept the message on the second and subsequent lists would throw an uncaught exception - see https://gitlab.com/mailman/mailman/-/issues/914 and this was a fix for that. Please file an issue for this at https://gitlab.com/mailman/mailman/-/issues and I will try to find a better solution. Your approach of munging Message-IDs will create other issues. Consider a post to a list with direct CC to userx. userx replies-all to the message received directly. the In-Reply-To of this reply is the unmunged Message-ID which will affect threading in the archives and other recipient's MUAs. I realize this is preferable to losing the message, but I hope we can do better. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: No emails distributed after mail received for a new list following https://docs.list.org/en/latest/install/virtualenv.html on new mailman3 Debian 12 installation

by Mark Sapiro

On March 26, 2025 3:28:27 AM GMT+07:00, Philip Bondi <pjbondi(a)systemdatabase.com> wrote: > >My list is named ebill. An email was received for the DL, but not distributed. Can you advise how to troubleshoot from here? > >Mar 25 15:23:04 shackleton12 postfix/smtpd[247708]: connect from smtprelay0015.hostedemail.com[216.40.44.15] >Mar 25 15:23:04 shackleton12 postfix/smtpd[247708]: Anonymous TLS connection established from smtprelay0015.hostedemail.com[216.40.44.15]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256 >Mar 25 15:23:04 shackleton12 postfix/smtpd[247708]: 3CD47189B: client=smtprelay0015.hostedemail.com[216.40.44.15] >Mar 25 15:23:04 shackleton12 postfix/cleanup[247722]: 3CD47189B: message-id=<a7aee014-f200-4bd4-bbc4-bc9f37abb6df(a)systemdatabase.com> >Mar 25 15:23:04 shackleton12 postfix/qmgr[241822]: 3CD47189B: from=<pjbondi(a)systemdatabase.com>, size=3238, nrcpt=1 (queue active) >Mar 25 15:23:04 shackleton12 postfix/smtpd[247708]: disconnect from smtprelay0015.hostedemail.com[216.40.44.15] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 >Mar 25 15:23:04 shackleton12 postfix/lmtp[247723]: 3CD47189B: to=<ebill(a)systemdatabase.ca>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.29, delays=0.06/0.03/0.02/0.19, dsn=2.0.0, status=sent (250 Ok) >Mar 25 15:23:04 shackleton12 postfix/qmgr[241822]: 3CD47189B: removed The above says the message was successfully delivered to Mailman's LMTP runner. Is it queued in one of Mailman's queue/* queued? Check mailman.log for info. -- Mark Sapiro <mark(a)msapiro.net> Sent from my Not_an_iThing with standards compliant, open source software.

4 weeks, 1 day

[MM3-users] Re: disable body transcoding

by Mark Sapiro

On 9/22/21 9:02 AM, Markus Schaaf wrote: > Hi, > > I have disabled all message modifications and filtering from within the > webUI, and created empty header and footer template files. Still, some > list messages get their body encoding changed to base64, breaking DKIM. > What can I do to prevent this? (I'm a newbie to mailman3, so please give > somewhat complete commands. I have read other threads with similar > questions, but did not understand some shortened configuration commands.) This is probably due to the message body charset being utf-8. The Python email library used by Mailman encodes utf-8 message bodies as base64. There are no configuration settings in Mailman to avoid this. Calling email.charset.add_charset('utf-8') at some point in Mailman's processing might avoid this. E.g. ``` --- a/src/mailman/handlers/validate_authenticity.py +++ b/src/mailman/handlers/validate_authenticity.py @@ -23,6 +23,7 @@ import logging from authheaders import authenticate_message from authres import AuthenticationResultsHeader, SyntaxError from dns.resolver import Timeout +from email.charset import add_charset from itertools import chain from mailman.config import config from mailman.core.i18n import _ @@ -121,5 +122,7 @@ class ValidateAuthenticity: def process(self, mlist, msg, msgdata): """See `IHandler`.""" + # Try to avoid base64 encoding of utf-8. + add_charset('utf-8') if config.arc_enabled: authenticate(msg, msgdata) ``` Note this is just a guess and could be a disaster so test it before trying it in production. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 7 months

[MM3-users] Re: Mailing Lists

by Mark Sapiro

On 12/23/21 3:09 PM, John McDonald via Mailman-users wrote: > I am responsible for the mailing list of a local church. Recently the church was moved to using Mailman for this. When a simple message is created and sent to the mailing list most email addresses received it correctly but those with an Outlook or Hotmail account received attachments and not the message. There are three attachments and one of them has to be opened to view the message. > > Am I missing some setting? First question. Is this Mailman 2.1 or Mailman 3? This list is for Mailman 3. The corresponding list for Mailman 2.1 is https://mail.python.org/mailman3/lists/mailman-users.python.org/ That said, your issue is because the list is adding a message footer (or possibly header or both) to the delivered message. This is discussed in the FAQ at https://wiki.list.org/x/4030707 That FAQ says there are Mailman configuration things you can do. Exactly what you do depends on the requirements of your list and whether this is Mailman 2.1 or Mailman 3. If you don't require that HTML or other non plain text parts be delivered, you can adjust content filtering to remove them and create a simple plain text message which won't have this problem. Or you can ensure that no message header/footer is added. How you do these things depends on your Mailman version. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Re: Mailing list welcome message won't update

by Mark Sapiro

On 1/16/25 15:14, via Mailman-users wrote: > "Does your empty list:member:generic:footer.txt work to not add any footer to list messages? If so, I can't think of any reason why your list:user:notice:welcome.txt wouldn't be used." > > Sorry, I am not sure how to chekc this. > Can I use a mailman command? > Where does that footer get added if it was not empty? > > Thanks. > > Frances > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to mark(a)msapiro.net In the above message received from the list, the footer (which is custom) is everything from the horizontal line below your name to the end of the message (and will be added again below my sig). A default footer for this list would be just ``` _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org ``` If the message is a single text/plain part, the footer is added to the body inline. If it is a MIME multipart message, the footer is attached as a separate MIME part. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 months, 1 week

[MM3-users] Re: Remove login from list subscription page

by Mark Sapiro

On 3/1/22 12:23, bob B via Mailman-users wrote: > Is there any way to easily remove the login button for the List subscription page? 99% of our list do not use archiving, and log-in just confuses users so We would like for them just to be able to sign up to be on the list. You would need to patch postorius/templates/postorius/lists/summary.html Something like this would do what I think you want. ``` --- a/src/postorius/templates/postorius/lists/summary.html +++ b/src/postorius/templates/postorius/lists/summary.html @@ -101,20 +101,9 @@ {% endif %} {% else %} <div> - <h2>{% trans 'Subscription / Unsubscription' %}</h2> - <p>{% blocktrans %} - To subscribe or unsubscribe from this list, please log in first. - If you have not previously logged in, you may need to set up an account - with the appropriate email address. - {% endblocktrans %}</p> - <p><a href="{% url LOGIN_URL %}?next={{ next|default:request.path|urlencode }}" class="btn btn-primary">{% trans 'Log In' %}</a></p> - </div> - <hr /> - <div> - <p> + <h2>{% trans 'Subscription' %}</h2> {% blocktrans %} - You can also subscribe without creating an account. - If you wish to do so, please use the form below. + To subscribe to this list, please use the form below. {% endblocktrans%} </p> <form action="{% url 'list_anonymous_subscribe' list.list_id %}" ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 1 month

[MM3-users] Re: Migration from old server to new server failed

by Helio Loureiro

Hi, This is running on the latest mailman3. Best Regards, Helio Loureiro https://helio.loureiro.eng.br https://github.com/helioloureiro https://mastodon.social/@helioloureiro On Sun, 25 Feb 2024 at 02:52, Mark Sapiro <mark(a)msapiro.net> wrote: > On 2/23/24 09:28, Mark Sapiro wrote: > > On 2/22/24 21:51, Stephen J. Turnbull wrote: > >> If I'm correct, I think you'll > >> find the offending message in $var_dir/archive/hyperkitty or some > >> subdirectory, it's a regular queuefile, and you can read it with the > >> showqfile utility to see if it's spam. Otherwise you need to edit the > >> [] out of the message ID. > > > > The directory is $var_dir/archive/hyperkitty/spool/ and the command to > > view the queue entry is `mailman qfile path/to/file`. > > > BTW, the issue with bogus [] delimited Message-IDs is "fixed" (actually > worked around) in Mailman 3.3.9 by > https://gitlab.com/mailman/mailman/-/merge_requests/1099/ > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to helio(a)loureiro.eng.br >

1 year, 1 month

[MM3-users] Re: Problem creating list members using REST API

by Mark Sapiro

On 1/18/22 2:11 PM, Stephen Daniel wrote: > The REST API documentation is a bit informal. As someone who is not > familiar with mailman, and who doesn't know python, they are a bit of a > slog. Agreed. I guess we sort of assume that people dealing directly with the REST API are familiar with both. > It might be worth seeing if the code can be enhanced to allow the boolean > values to be sent in using JSON booleans as well as JSON strings. I think here we only have to deal with the REST API because other uses of as_boolean are all on strings that come from config files. We can't modify as_boolean directly, as it is part of a third party dependency and is intended to be used with config files, not JSON objects, but I think something like this will do it. ``` --- a/src/mailman/rest/helpers.py +++ b/src/mailman/rest/helpers.py @@ -249,6 +249,8 @@ class GetterSetter: """ if self.decoder is None: return value + if self.decoder is as_boolean and isinstance(value, bool): + return value return self.decoder(value) ``` Perhaps you could try to test that. I just created https://gitlab.com/mailman/mailman/-/issues/970 for this. It would help me in fixing this if you could provide a small piece of your code that throws the error. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: Detectors and Bounces

by Mark Sapiro

On 8/5/22 14:03, summersan(a)nclack.k12.or.us wrote: > > Previously, there were `34775` files in the `/opt/mailman/mm/var/queue/bounces` directory, ranging from June 7 to August 4. For background, there's typically a time in the summer where many user accounts are purposely disabled (generally near July-August, I think). From the bounce file dates, I wonder if this bounce-related issue has been happening for longer than I first realized. The issue is that sometimes the bounce runner dies. This can be from an OOM error or some other reason, but I have observed it even on systems I admin. The master SHOULD restart it, but it doesn't. See https://gitlab.com/mailman/mailman/-/issues/898. Anyway, it appears your bounce runner died sometime on or before June 7 (if you have syslog from then it might have a clue), and you didn't stop and start Mailman core until August 4 when the bounce runner started again and began chugging through it's queue. I.e., I think everything in your installation is OK and the excessive load was just due to processing the 34775 queued bounces that should have been processed gradually over the previous 2 months. Although 500 bounces per day seems like a lot, but if you have a lot of lists, and bouncing users aren't being disabled because bounce runner isn't running, this may be normal. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 8 months

[MM3-users] Re: Mailman rewrite the Cc header incorrectly

by Mark Sapiro

On 5/26/20 12:33 AM, Alan So wrote: > Thanks. Just filed an issue: > https://gitlab.com/mailman/mailman/-/issues/725 Thank you for your "well formed" issue. I have started to work on this, but I have run into a snag. The patch at <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…> doesn't work. The problem is msg.get_all(header, []) does not parse the header and return a list of addresses. It just returns a list, the items of which are the raw values if the header instances in msg. I.e., if there is only one Cc: header, msg.get_all('cc', []) returns a list of one string which is the raw value of that header. If there were two Cc: headers in the message it would return a list of two strings with the two raw values. Thus, we would need to parse the strings returned into the individual email addresses. The simple minded way to do that is addrs = [] for hdr in msg.get_all(header, []): for addr in hdr.split(','): addrs.append(parseaddr(re.sub('[\r\n]', '', addr))) but that will fail if the header contains a quoted display name containing a comma such as "last, first" <user(a)example.com> So, I need to go back to using getaddresses, but do the unfolding first. Watch the issue for the final fix. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: List in list, mutiple reply-to addresses

by Mark Sapiro

On 11/25/21 11:00 PM, Stefan Bauer wrote: > Mother: > Anonymous list: No > First strip reply to: No > Reply goes to list: No Munging > DMARC mitigation action: Replace From: with list address > DMARC mitigate unconditionally: Yes > > > > Daughter: > Anonymous list: No > First strip reply to: Yes > Reply goes to list: No Munging > DMARC mitigation action: Replace From: with list address > DMARC mitigate unconditionally: Yes > Because of DMARC mitigation, you can't do what you want. With the settings you have the mother list puts the original From: in Reply-To: and it's own address in From:. Then regardless of what the daughter does with the incoming Reply-To:, it will add the incoming From: to Reply-To: so the Reply-To: of a message from the daughter will always contain the address of the mother. The best you can do, unless you are willing to set DMARC mitigation action: to No DMARC mitigations is what you started with which is First strip reply to: No on the daughter which will at least put the original From: to the mother in Reply-To: from the daughter along with the mother's address, but you can't remove the mother's address from the daughter's Reply-To: because DMARC mitigation will always put it there. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Re: Emergency moderation and clearing out a lot of held messages

by Mark Sapiro

On 4/28/22 10:59, bob B via Mailman-users wrote: > We had an issue where a program went rogue and sent out 30k email alerts to one of our lists, so now I have a few questions. > > When the issue happened I turned on emergency moderation and we have resolved the issue so.. > > 1. How do I easily delete 30k of held messages? It looks like the GUI only allows me to do 200 at a time? is there a way to flush all held messages easily? See https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… and the thread containing it. > 2. When I enabled Emergency moderation, I expected it to stop notifying the admin on every held message, but it appears that is not the case? Also, does it reply to the sender of every held message when Emergency moderation is on? > > it seems like the steps are: > turn on "Emergency moderation" > turn OFF "Notify users of held messages" > turn OFF "Admin immed notify" MM 2.1 didn't notify the admins of emergency holds. This is not the case in MM 3. It probably should be, but isn't. Senders are or aren't notified per "Notify users of held messages". So the steps above are correct. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 11 months

[MM3-users] Re: using SSH/TLS with external MTA

by Mark Sapiro

On 7/24/24 06:35, Roland Giesler via Mailman-users wrote: > I have managed thus far to get things working on my new install, but I > need to use a secure logon to send mail from an external MTA. I have > set up: > > /etc/mailman/mailman.cfg: > > smtp_host: box2.gtahardware.co.za > smtp_port: 465 > smtp_user: roland(a)giesler.za.net > smtp_pass: <hidden> > smtp_secure_mode: smtps > smtp_verify_cert: no > smtp_verify_hostname: no This looks OK, but > I'll get a cert installed later, for now just want to get it going. The `no` values for smtp_verify_cert and smtp_verify_hostname may be part of your issue. ... > "/usr/lib/python3/dist-packages/django/core/mail/backends/smtp.py", line > 125, in _send > self.connection.sendmail(from_email, recipients, > message.as_bytes(linesep='\r\n')) > File "/usr/lib/python3.10/smtplib.py", line 901, in sendmail > raise SMTPRecipientsRefused(senderrs) > smtplib.SMTPRecipientsRefused: {'roland(a)giesler.za.net': (454, b'4.7.1 > <roland(a)giesler.za.net>: Relay access denied')} > > However, the mailserver is in daily use and accept logon all the time. I > believe I'm missing something that should be installed to make SMTPS > (SSL) work, but what? It is the mail server at box2.gtahardware.co.za that is refusing to relay this message. I think this issue needs to be resolved in that MTA's configuration. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 months, 4 weeks

[MM3-users] Re: Error: ConnectionRefusedError at /accounts/login/

by Mark Sapiro

On 2/27/25 12:36, Kim Sunggun via Mailman-users wrote: > script: > #!/usr/bin/env python3 > import smtplib > > host = 'localhost' > port = 25 > connection = smtplib.SMTP(host=host, port=port) > connection.ehlo() > connection.quit() > > result: > Traceback (most recent call last): > File "/opt/mailman/./testone.py", line 7, in <module> > connection = smtplib.SMTP(host=host, port=port) > File "/usr/lib64/python3.9/smtplib.py", line 255, in __init__ > (code, msg) = self.connect(host, port) > File "/usr/lib64/python3.9/smtplib.py", line 341, in connect > self.sock = self._get_socket(host, port, self.timeout) > File "/usr/lib64/python3.9/smtplib.py", line 312, in _get_socket > return socket.create_connection((host, port), timeout, > File "/usr/lib64/python3.9/socket.py", line 856, in create_connection > raise err > File "/usr/lib64/python3.9/socket.py", line 844, in create_connection > sock.connect(sa) > ConnectionRefusedError: [Errno 111] Connection refused So you are doing the same thing Django allauth is doing with the same result. Do you even have an MTA listening on localhost, port 25? You need to figure out what settings you need to be able to connect to your outgoing MTA and set EMAIL_HOST EMAIL_PORT and maybe some of EMAIL_HOST_USER EMAIL_HOST_PASSWORD EMAIL_USE_TLS EMAIL_USE_SSL EMAIL_SSL_CERTFILE EMAIL_SSL_KEYFILE appropriately so you can connect to the MTA. If outgoing mail from Mailman works, look in the [mta] section in mailman.cfg for the appropriate settings. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 month, 3 weeks

[MM3-users] Re: postorius ssl-certificates for virtual hosts

by Mark Sapiro

On 11/15/19 3:45 AM, Wolfgang Bock via Mailman-users wrote: > > That doesn't solve the problem. I changed that in mailman-web.py > (MAILMAN_REST_API_URL = https://localhost:8001) and after that in > mailman.cfg (use_https: yes). But got the same errormessage on postorius > website. You posted this log excerpt: Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - "GET /3.0/lists?advertised=true&count=0&page=1 HTTP/1.1" 200 90 Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - "GET /3.0/lists?advertised=true&count=10&page=1 HTTP/1.1" 200 606 Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - "GET /3.1/domains HTTP/1.1" 200 1438 Nov 14 23:20:41 2019 (28590) 127.0.0.1 - - code 400, message Bad HTTP/0.9 request type The first 3 GETs are a normal sequence of GETs from Postorius when you go to the Mailing Lists view. That should be followed by a GET like "GET /3.1/domains/domain.tld HTTP/1.1" where domain.tld is a configured domain. Do you have any domains configured?/0.9'? I'm not sure what the issue is. You have an older version of mailmanclient < 3.2.3a1 which uses httplib2 rather than requests. https://pypi.org/project/httplib2/ says: HTTP and HTTPS HTTPS support is only available if the socket module was compiled with SSL support. but I don't think this can be the issue because the first 3 GETs work. You might try upgrading mailmanclient to 3.3.0. I don't know if that will help, but it may. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 5 months

[MM3-users] Re: Using external services for deliverability?

by Mark Sapiro

On 6/30/20 7:03 AM, Brian Carpenter wrote: > On 6/30/20 9:56 AM, tom(a)gather.coop wrote: >> I have a Mailman 3 server up and running but I'm terrified to migrate >> to it from my existing Mailman 2 provider for fear that services like >> Gmail will randomly start blacklisting my IP with little I can do >> about it. I have SPF records set up so I'm hoping I'll be Ok but I'd >> like to have a backup plan. ... > There is no reason to be afraid if you are sending out legitimate > communications. SPF records will help. You will also need to enable > DMARC mitigation on your lists and Mailman 3 does that very well as > Mailman 2 did. It also helps if you sign your outbound mail with DKIM. > With those 3 things in place, you should have no problem sending mail. > Keep in mind AT&T will probably block you if the IP address you are > using is new. That is standard practice for them. It's easy to get that > block remove. Same goes for Comcast using their Vader RBL. You also need to ensure you have full circle DNS <https://en.wikipedia.org/wiki/Forward-confirmed_reverse_DNS>. That together with SPF and DKIM signing of outbound mail is virtually essential for deliverability. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 9 months

[MM3-users] Re: Mailman stops processing....... where to start looking for root cause?

by Mark Sapiro

On 3/29/24 12:34, bob B via Mailman-users wrote: > Today was the 2nd time mailman stopped sending out mail, it receives mail but sends nothing out. To resolve the issue I restarted the mailman services and then all the incoming/queued mail was sent out... last time this happened was 21 days ago.... Before that, it has been rock solid for years. ... > So where can I look to try to determine a cause? > If it happens again, what and where can I cook to troubleshoot before restarting the service? One of the runners has died, most likely the `out` runner, but possibly another. The missing messages are stuck in a queue. Do ``` ls -laR /opt/mailman/core/var/queue ``` to see in which queue the messages are. The runner that processes that queue is gone or possibly stuck. Do ``` ps -fwwu mailman|grep runner= ``` when things are working to get a list of what runners should be there. Do it again when things aren't working to see what's missing. There also should be something in mailman.log about why the runner died, but if it was killed for some external reason, there may not be anything. Look in `syslog` for something like an out of memory (OOM) or other issue that caused the runner to die. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year

[MM3-users] Re: Error when click on mailing list: An error occurred while processing your request.

by Mark Sapiro

On 7/14/24 21:40, adam.heathcote(a)utas.edu.au wrote: > Hi Mark, > > Sorry about the delay in replying. > > You're correct, I am clicking on the list in the Mailing List view. > > Navigating to the list URL directly while not logged in produces the same error and even produces the error when a different user is logged in. Now it's my turn to apologize. I've been traveling. In your original post you wrote "I've tried removing it and reimporting it to no avail." What exactly does this mean. You removed the list how? Then you reran the import21. Was the list broken at that point, or only after removing the old owners and adding yourself? What if you try the following steps in order and try to view the list in Postorius after each step. - remove the list with `mailman remove list(a)example.com` and recreate it with `mailman create list(a)example.com` - run `mailman import21 list(a)example.com path/to/config.pck` - in Postorius, add yourself as owner. - in Postorius, delete one of the other owners. - repeat the deletion and viewing the list for the other unwanted owners one at a time. If the view throws the error at some point, after which step? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 months, 4 weeks

[MM3-users] Re: Customise Postorius templates?

by Mark Sapiro

On 2/1/22 09:47, Duane Raymond wrote: > Hi, > > I'm looking to do some radical customisation of the Postorius (and Hyperkitty) templates over the next 6 ish months and was wondering if there is a 'best practice' way to do this that will survive updates to MM3. I've searched around and not found much and also tested copying > venv/lib/python3.7/site-packages/postorius/templates/postorius/lists/summary.html > to > var/templates/lists/summary.html > > As suggested in some posts - but it didn't seem to pick up the customisation - only customisations in the venv path worked - and they get overwritten on update. The var/templates directory has a specific structure and is only for custom list specific, domain specific and sitewide templates used for notifications from Mailman core. It has nothing to do with Postorius or HyperKitty templates. > Is there a 'best' way for this? I'd also like to eventually share them with the community and maybe add them to the repo if people want that....but for now I'll start with my own experiments. (and if there is documentation I have missed for this, let me know!) I don't know about a `best` way, but the way I do this is to keep all local mods as patches to the base and apply those patches as part of the upgrade process. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 2 months

[MM3-users] Re: Problem replying via Hyperkitty

by Mark Sapiro

On 6/30/22 10:07 AM, Jeff wrote: > Hello Everyone, > > A few of my users read our mailing list through Hyperkitty. Whenever they reply through the web, their replies simply disappear. One example from today was logged as follows: > > [pid: 2287|app: 0|req: 116007/153551] xxx.xx.xx.xx () {72 vars in 1992 bytes} [Thu Jun 30 11:26:16 2022] POST /archives/list/listname(a)domainname.org/message/46WUOPZITVMKJN4TXR6CP3WMFUEAVJKD/reply => generated 3213 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 188 bytes (3 switches on core 0) This looks like the post of the reply to HyperKitty. What does the user see in response to that? There should be a brief alert popup indicating the message was sent. > A couple of basic questions: > > 1) when a users replies in this manner, does their response go to the list or to the subscriber to whom they are replying? To the list. > 2) what log files could I check to see what — if anything — happens to these emails? Mailman's var/logs/mailman.log, The MTA logs and the Django logs. > 3) Are there any settings that need to be set to make this work? There shouldn't be as long as the list and archiving work. Note, a user can select 'Use email software' when replying which should open a composition dialog in their email client to post a reply yto the list. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 9 months

[MM3-users] Re: No e-mail distribution after import of archive

by Mark Sapiro

On 11/12/24 00:52, Markus Grandpré wrote: > > In smtp.log I found: > > Nov 12 09:46:02 2024 (698087) Available AUTH mechanisms: LOGIN(builtin) > PLAIN(builtin) > Nov 12 09:46:02 2024 (698087) Peer: ('127.0.0.1', 57230) > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) handling connection > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) >> b'LHLO > mailman-app-test.kim.uni-konstanz.de' > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) >> b'MAIL > FROM:<markus.grandpre(a)uni-konstanz.de> SIZE=9649 BODY=8BITMIME' > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) sender: > markus.grandpre(a)uni-konstanz.de > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) >> b'RCPT > TO:<Import_mm3_testliste(a)mailman-test.uni-konstanz.de>' > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) recip: > Import_mm3_testliste(a)mailman-test.uni-konstanz.de > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) >> b'DATA' > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) >> b'QUIT' > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) connection lost > Nov 12 09:46:02 2024 (698087) ('127.0.0.1', 57230) Connection lost > during _handle_client() > > I have no idea why there is a "connection lost". What do you think? How > can I increase the log level? This is delivery of the message to Mailman. `connection lost` is normal and not a problem. This has nothing to do with your issue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 months, 1 week

[MM3-users] Re: Which folder should I share between pods with kubernetees persistentVolumeClaim ?

by Mark Sapiro

On 2/6/25 02:37, antoine.depoisier--- via Mailman-users wrote: > > There are all the folders in mailman > archives cache data etc lists locks logs master.pid messages queue templates Here's my opinion. archives - If the prototype archiver is enabled for a list, its posts are archived here in maildir format. This should be shared for consistency, but if you don't care about this, you can put `enable: no` in the [archiver.prototype] section of mailman.cfg to disable it. cache - you're already sharing data - doesn't need to be shared unless it contains a sqlite mailman.db that's actually used. etc - doesn't need to be shared. lists - should be shared as it contains the mailboxes (digest.mmdf) for accumulating messages for a list's digest locks - should be shared master.pid - must not be shared as it contains the pip of the master process running on that node. messages - you're already sharing which you should. queue - this is tricky. If it isn't shared once a message gets queued in virgin/ or in/ on a node, only that node's runners will process it through its queues. This may have an impact on load balancing. templates - doesn't need to be shared, but should be synced between nodes. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 months, 2 weeks

[MM3-users] Re: Mailman archive issues (Hyperkitty)

by Mark Sapiro

On 6/2/21 12:48 AM, klillipuu(a)gmail.com wrote: > Hello All! > > I hope its a right place to write my concern about Mailman Hyperkitty. I have same quite odd issues lately and since I'm less experienced with Mailman, any help is welcome. > So i have like hybrid version pip installation, where mailman v3 is using python3 and hyperkitty is using python2 (if im correct). > I also mention, that hyperkitty is a pretty old version - 1.1.4. > The main issue is that if i try to open some large-scale archived list, then i get "504 Gateway Time-out" error on webUI. > Any ideas, where could i start improving the situation - should i try to upgrade some packages or do i need to give more resources to host ? It would be good to upgrade. Current HyperKitty/Postorius/Django is Python3 which will remove your dependency on Python 2.7. Also, there have been many performance improvements in more recent versions which may solve your issue. Your gateway timeout issue is a uwsgi time limit. You can increase that in your uwsgi configuration. > Extra information: > * I have also noticed some memory violation issues which has caused by uwsgi. > * Segfaulting process - kernel: python[25870]: segfault at 24 ip 00007f9decb9a6ea sp 00007ffc413bb3d0 error 6 in libpython2.7.so.1.0[7f9decb10000+17e000] Are these coincident with the gateway timeouts or do they occur at different times? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: Migrating from old V2 server to new V3 server. Questions.

by Mark Sapiro

On 11/14/24 08:42, jkoral(a)luc.edu wrote: > joetest(a)listservnew.luc.edu is the list, but in postfix_lmtp, it is showing up as joetest(a)luc.edu. Where can I change that? I tried changing the domain and site, but it still has not changed. The list has a mail_host attribute which is set when the list is created. Presumably, you created the list as `joetest(a)luc.edu`. You have to change the mail_host attribute of the list, but it may be easier to just delete it and create a new joetest(a)listservnew.luc.edu list. Then you can ignore everything below. To change the mail_host for the list you can do a database query or use `mailman shell`. The database query is ``` UPDATE mailinglist SET mail_host = 'listservnew.luc.edu' where list_name = 'joetest'; ``` The `mailman shell interaction is ``` $ mailman shell -l joetest(a)luc.edu Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the list(a)example.com mailing list >>> m.mail_host = 'listservnew.luc.edu' >>> commit() ``` If you do either of the above to change the mail host, you probably need to do `mailman aliases` to regenerate the files for Postfix. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 months, 1 week

[MM3-users] Re: new list not working

by Mark Sapiro

On 3/9/23 15:49, Christian via Mailman-users wrote: > Mail.log > > Mar 9 22:03:30 zarathustra postfix/smtpd[27337]: connect from > box.ecovillage.cc[45.79.28.18] > Mar 9 22:03:30 zarathustra postfix/smtpd[27337]: 11516101258: > client=box.ecovillage.cc[45.79.28.18] > Mar 9 22:03:30 zarathustra postfix/cleanup[26926]: 11516101258: warning: > header Subject: fifth test message from box.ecovillage.cc[45.79.28.18]; > from=<christian(a)naturalintelligence.us> > to=<redlatinleg(a)lists.ccalternatives.org> proto=ESMTP > helo=<box.ecovillage.cc> > Mar 9 22:03:30 zarathustra postfix/cleanup[26926]: 11516101258: > message-id=<033101d952d3$0fe82730$2fb87590$(a)naturalintelligence.us> > Mar 9 22:03:30 zarathustra postfix/qmgr[9973]: 11516101258: > from=<christian(a)naturalintelligence.us>, size=3496, nrcpt=1 (queue active) > Mar 9 22:03:30 zarathustra postfix/smtpd[27337]: disconnect from > box.ecovillage.cc[45.79.28.18] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 > commands=7 > Mar 9 22:03:30 zarathustra postfix/lmtp[27338]: 11516101258: > to=<redlatinleg(a)lists.ccalternatives.org>, relay=127.0.0.1[127.0.0.1]:8024, > delay=0.02, delays=0/0.01/0/0.01, dsn=2.0.0, status=sent (250 Ok) > Mar 9 22:03:30 zarathustra postfix/qmgr[9973]: 11516101258: removed That's only the delivery of the post to Mailman. What about any log messages relating to messages from redlatinleg-bounces(a)lists.ccalternatives.org? Also, one other thing you might check. Do these non-working lists have templates defined in postorius, in particular, one for list:member:regular:footer, and if not, are there any in Mailman's var/templates/lists/redlatinleg(a)lists.ccalternatives.org/ derectory that Mailman doesn't have permission to find and read? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 1 month

[MM3-users] Re: Moving existing lists to a new domain

by Mark Sapiro

On 9/18/24 10:13, Jeremy Stanley wrote: > > Since all the lists for the given domain will be moving to the same > unused new domain on the existing server, and can move at the same > time, I suppose this could be done through (offline if necessary) > backend database update queries. Yes. For the mailing list, the only changes needed are to the mailinglist table; A query like ``` UPDATE mailinglist SET mail_host = 'new.domain' WHERE mail_host = 'old_domain'; ``` would do, but this leaves the question of list_id. According to RFC 2919, section 4, the list_id should not change, but this is problematic in that if it isn't changed, a Postorius URL like https://example.com/mailman3/lists/list_name@new.domain will retrieve the list, but https://example.com/mailman3/lists/list_name.new.domain will not work. It would need to be https://example.com/mailman3/lists/list_name.old.domain so to reduce confusion, it may be better to update the list_id values A query like the following after the above should do it ``` UPDATE mailinglist SET list_id = CONCAT(list_name, '.', mail_host) WHERE mail_host = 'new_domain'; ``` For HyperKitty, similar changes need to be made to the hyperkitty_mailinglist table. The `name` column entries need to be changed from `listname(a)old.domain` to `listname(a)new.domain` and the `list_id` column entries need to be changed from `listname.old.domain` to `listname.new.domain` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 months

[MM3-users] Re: Could not locate column in row for column 'user.id'

by Mark Sapiro

On 7/28/20 10:20 AM, Shashikanth Komandoor wrote: > > I tried for the command to know if any entry in the "address" table for > which 'id' is not an integer. > > But unfortunately, I could not get any command or idea how to find that. > > But out of my extra talent, I tried the below commands which, I thought, > may print the records which contain a non integer id value. ... > select id,email from address where id NOT BETWEEN 1 AND 84203; > id | email > ----+-------(0 rows) > mailman=# select id,email from address where id NOT BETWEEN 1 AND 84202; > id | emai> -------+-----------------------------> 84203 | user(a)exampl.com > > *1 and 84203 are the minimum and maximum values of the id:* > > Please see the above outputs and suggest if anything possible or please let > me know the command what should I run to find a non integer id value. > The above looks qood to determine if there is a non-integer value. > I also doubt this error as if my REST API is contacting postgresql in a > delayed manner. If possible, can you say what optimal setting I can do at > Postgresql so that faster responses would be given to REST API. I'm out of ideas. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 8 months

[MM3-users] Re: Docker-Setup: example.com in test mails

by Mark Sapiro

On 3/28/22 00:04, Bjoern Franke via Mailman-users wrote: > > Thanks for your reply. It seems the probes were triggered by some > rejected example.com mails and I have no idea where the example.com > mails are coming from. I think what you are seeing must be some kind of spam. If not if you could post the complete raw message of one of these probes or probe bounces, I'll look further. > Some users also reported they got some "unsubscribed due to bounces" > messages but the bounce.log contained only entries for them 7 days ago. And were they unsubscribed? In general, unsubscription does not occur until some time after bounces are recorded. At some point, bounce score reaches threshold and a probe is sent. The probe may not bounce for days if the bounce is some downstream timeout. When the probe bounce is received, the user's delivery is disabled by bounce. This starts a process where the user is sent a warning at intervals until a limit is reached and the user is finally removed. The default settings are: bounce_you_are_disabled_warnings = 3 bounce_you_are_disabled_warnings_interval = timedelta(days=7) which means the user is sent 3 warnings, one immediately, one after 7 days and one after 14 days until finally being unsubscribed after 21 days. An entry 7 days ago could be a bounce of a warning message. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years

[MM3-users] Re: Mailman 3, postfix domains, and postgresql cannot authenticate user

by Mark Sapiro

On 7/3/24 09:22, Keith Christian via Mailman-users wrote: > --------------------------------------------------------------------------- > First issue:Postfix v3.5.8 on RHEL 8. > The below is from journalctl -xe: > --------------------------------------------------------------------------- > Jul 03 08:12:04 somehost.somedomain postfix/qmgr[947499]: error: open > database /opt/mailman3/mm/var/data/postfix_domains.db: No such file or > directory > Jul 03 08:12:42 somehost.somedomain postfix/smtpd[947510]: error: open > database /opt/mailman3/mm/var/data/postfix_domains.db: No such file or > directory > Jul 03 08:12:42 somehost.somedomain postfix/smtpd[947510]: error: open > database /opt/mailman3/mm/var/data/postfix_lmtp.db: No such file or > directory > > I manually created the var_dir: /opt/mailman3/mm/var directory > specified in the mailman.cfg file. > How do I find out how to populate the postfix_domains.db files, and > the postfix_lmtp.db file? The `mailman aliases` command generates the postfix_domains and postfix_lmtp files and calls the configured postmap_command (default /usr/sbin/postmap) to create the .db files. `mailman start` also generates these files by default. > --------------------------------------------------------------------------- > Second issue: Postgresql authentication. > PostgreSQL v10.23. > --------------------------------------------------------------------------- > I have this in the active mailman3.cfg file, where xxxxxxxxxx is the > same complex password in the mailman3 config file: > url: postgresql://mailman3:xxxxxxxxxx@localhost/mailman3/mailman3 I don't think you should have two /mailman3 at the end the form is `postgresql://user:password@host:port/database_name` The default port is 5432. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months, 2 weeks

[MM3-users] Re: Dropdown problem in postorius due to bootstrap

by Mark Sapiro

On 7/9/24 1:18 PM, Greg Newby wrote: > (My first post) > > As has been observed, the Ubuntu 24.04 LTS packaging for native Mailman3 > can be challenging. I've been solving all kinds of issues, and I'm writing > here about something I've so far been unable to solve. Are you using the Debian/Ubuntu packages? If so, this may be a Debian issue. See https://wiki.list.org/x/12812344 ... > I've dug deeply into this. The relevant <script> is bootstrap.min.js. > Postorius (via django) is using version 5.3.1 via package libjs-bootstrap5: > > ** This is what django is using: > /usr/share/bootstrap-html/js/bootstrap.bundle.min.js -- version 5.3.1, > linked to: > /usr/share/javascript/bootstrap5/js/bootstrap.bundle.min.js > > /usr/share/python3-django-postorius/static/postorius/libs/bootstrap/js/bootstrap.bundle.min.js The Gnu Mailman project's postorius ships with postorius/static/postorius/libs/bootstrap/js/bootstrap.bundle.min.js version 5.1.3 ... > By temporarily replacing > /usr/share/python3-django-postorius/static/postorius/libs/bootstrap/js/bootstrap.bundle.min.js > I have tried moving back to 4.6.1 (from libjs-bootstrap4). I have also > retrieved the latest 5.3.1 from the CDN, which is slightly different but > doesn't change the error: > https://cdn.jsdelivr.net/npm/bootstrap@5.3.1/dist/js/bootstrap.bundle.min.js Try using the ones from https://gitlab.com/mailman/postorius/-/tree/master/src/postorius/static/pos… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months, 2 weeks

[MM3-users] Re: Moderation of posts via email is not working in mailman 3

by Shashikanth Komandoor

Thank you Mark Sapiro for your response. After going through the discussion at the link you provided, I understood as of now, it is not possible to moderate the posts through the mails in Mailman 3. But since the user is getting the "confirm" attachment to the mail, the users are getting confused. Is there any work around to achieve this? or Is there any way to remove that "confirm" attachment so that users would not get an idea of confirming via email? <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> On Tue, Jun 30, 2020 at 2:46 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 6/29/20 12:24 AM, Shashikanth Komandoor wrote: > > > > Is there any bug or limitation in mailman 3 or if I am doing > > any wrong at the server side? Please suggest. > > > > This is a known issue in Mailman 3. See > <https://gitlab.com/mailman/mailman/-/issues/169>. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Thanks & Regards, Shashi Kanth.K 9052671936

4 years, 9 months

[MM3-users] Re: Splitting hosts: mta&core vs postorius

by Mark Sapiro

On 6/19/20 4:34 PM, Ruth Ivimey-Cook wrote: > I'm trying to set up mailman3 on two hosts, one of which runs core + > exim, the other runs postorius (&possibly hyperkitty). > > I have I think got core set up correctly, and postorius is sort of > usable, but anything in the web ui that talks to core ends up with a > white screen. > > I think what is happening is a postorius URL ends up with the core (or > perhaps no) hostname, and as there's nothing there to answer it fails. What are your Django settings for MAILMAN_REST_API_URL, MAILMAN_REST_API_USER and MAILMAN_REST_API_PASS and do these agree with the [webservice] settings for hostname, port, use_https, admin_user and admin_pass in mailman.cfg in core and is the port open to the outside on the core machine? > I've checked the settings and I don't think I have misconfigured > postorius. Is it possible that the bad url is being passed from core to > postorius in some way and reused without changing the host? > > In the config at present, both hosts are visible to the browser, and > each host can communicate with the other. > > Any ideas on how to pin down the problem better? Do you see REST requests from the Postorius machine in core's mailman.log and access.log? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: HTML email sent to lists migrated from Mailman 2.1

by Mark Sapiro

On 4/15/19 8:21 AM, Nate Coraor wrote: > > I have some lists migrated from 2.1 that are stripping the HTML parts > (perhaps all attachments?) from messages despite the options to do so not > being enabled and lynx not even being installed. I'm trying to get a new > list to behave the same way so I can figure out what's going on without > spamming a production list, but have been unsuccessful: despite setting > nearly all the list options the same as the old lists, new lists pass HTML > portions and attachments just fine. > > I've verified the settings using mailing list objects directly with > `mailman withlist` on the command line and the only differences are things > that I can't imagine would be related like admin_notify_mchanges, > advertised, and archive_policy. Are there are really old options that can't > be accessed via mailing list objects obtained with `withlist` on the > command line? No, there aren't "hidden settings" The relevant settings are filter_content filter_extensions filter_types pass_extensions pass_types collapse_alternatives convert_html_to_plaintext These are exactly analogous to the MM 2.1 settings filter_content filter_filename_extensions filter_mime_types pass_mime_types pass_filename_extensions pass_mime_types collapse_alternatives convert_html_to_plaintext and should behave the same way. Note that filter_extensions, filter_types, pass_extensions and pass_types are not exposed in Postorius, but can be seen and set via withlist. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years

[MM3-users] Re: MM3 templates

by Mark Sapiro

On 2/15/23 08:09, Odhiambo Washington wrote: > > [18:47 ~ ]$ ls -al /opt/mailman/mm/var/templates/lists/kictanet.lists.kictanet.or.ke/en/ > total 48 > drwxr-xr-x 2 mailman mailman 512 Feb 14 08:53 . > drwxr-xr-x 3 mailman mailman 512 Feb 14 08:54 .. > -rw------- 1 mailman mailman 615 Jan 17 13:57 domain:admin:notice:new-list.txt This template is used in a domain context. It will never be accessed here. It needs to be in /opt/mailman/mm/var/templates/site/en/ or /opt/mailman/mm/var/templates/domains/lists.kictanet.or.ke/en/ > -rw------- 1 mailman mailman 341 Jan 17 13:54 list:admin:action:post.txt > -rw------- 1 mailman mailman 158 Dec 17 13:32 list:member:digest:footer.txt > -rw------- 1 mailman mailman 452 Jan 17 13:54 list:member:digest:masthead.txt > -rw------- 1 mailman mailman 137 Jan 17 13:55 list:member:generic:footer.txt The generic footer is used for both regular messages and digests if there isn't a specific regular or digest footer. In this case, you have both so the generic footer won't ever be used. > -rw------- 1 mailman mailman 1219 Dec 8 15:12 list:member:regular:footer.txt > -rw------- 1 mailman mailman 944 Jan 17 15:50 list:user:action:subscribe.txt > -rw------- 1 mailman mailman 247 Jan 17 13:56 list:user:notice:post.txt > -rw------- 1 mailman mailman 802 Jan 17 13:56 list:user:notice:probe.txt > -rw------- 1 mailman mailman 639 Jan 17 13:57 list:user:notice:welcome.txt Are the other templates such as list:member:regular:footer.txt used? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 2 months

[MM3-users] Re: Problems getting started with postorius

by Mark Sapiro

On 11/13/24 16:46, Alain D D Williams wrote: > > I eventually tracked it down. The problem was that I had signed in with an > account "addw@localhost". That, for some reason, failed validation above. > I hacked the database and changed to "addw(a)localhost.localdomain" and creating > the new domain worked. > > I could send email to addw@localhost - so at the MTA level it is correct. > > So please can the initial account creation do the same validation as does > adding a new domain. Mailman doesn't allow local, unqualified addresses, see https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/email/validate… and https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/utilities/emai… On the other hand, Account creation/validation is done by django-allauth over which we have no control. > I have looked but cannot find any documentation on postorius than > https://docs.mailman3.org/projects/postorius/en/latest/ > which is not helpful for a user or system admin. Can you point me to something > better. Unfortunately, there is not user/list owner documentation for Postorius. As I said at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… You just have to page through the settings to see what's there. Hopefully the various categories are clear enough that if you're looking for something specific, you can find it easily. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 months, 1 week

[MM3-users] Re: after last upgrade I've got a CSRF failed verification

by Mark Sapiro

On 10/26/22 04:33, Guillermo Hernandez (Oldno7) via Mailman-users wrote: > > I did it via pip and all seems to be working, but when I try to discard > or accept any message via postorius it shows a Forbidden 403 error CSRF > verification failed. > > In my settings.py I have commented out these variables: > > # Other security settings > # SECURE_SSL_REDIRECT = True > # If you set SECURE_SSL_REDIRECT to True, make sure the > SECURE_REDIRECT_EXEMPT > # contains at least this line: > # SECURE_REDIRECT_EXEMPT = [ > # "archives/api/mailman/.*", # Request from Mailman. > # ] > # SESSION_COOKIE_SECURE = True > # SECURE_CONTENT_TYPE_NOSNIFF = True > # SECURE_BROWSER_XSS_FILTER = True > # CSRF_COOKIE_SECURE = True > # CSRF_COOKIE_HTTPONLY = True > # X_FRAME_OPTIONS = 'DENY' > > I've been messing with them whith no results. It's like it lacked some > value in some template... It's not an issue with the code per se or the templates. These updates are all installed on mail.python.org and lists.mailman3.org and are working fine. After upgrading did you run django-admin collectstatic --clear django-admin compress django admin migrate If you have and it doesn't help, you probably need to add CSRF_TRUSTED_ORIGINS to your settings.py. See https://docs.djangoproject.com/en/4.1/ref/settings/#csrf-trusted-origins and note the differences between Django <4.0 and >=4.0. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 5 months

[MM3-users] Re: Aborted connection message in log in every 5 minutes

by Mark Sapiro

On 1/31/24 10:12, andrea.janna.unipd(a)gmail.com wrote: > >>From the database debug log I guess that mailman gatenews abruptly terminates the database connections. > For instance this is the database debug log of a connection that doesn't trigger the mariadbd "[Warning] Aborted connection" log entry. > > 70759 Connect mailman3web@localhost on mailman3web using Socket > 70759 Query SET sql_mode='STRICT_TRANS_TABLES' > ... > 240131 18:54:34 70759 Quit > > There is a "Quit" at the end. > While the log entries of the connections that trigger the aborted connection warning (like the one I posted yesterday) do not have "Quit" at the end. You could try the following in `mailman shell` ``` $ mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> for mlist in getUtility(IListManager).mailing_lists: ... print(mlist.fqdn_listname) ... (here should be a list of your mailing lists) >>> ``` Does this produce the expected list of mailing lists and does it produce the error in the database debug log? If it does produce the expected list of mailing lists and the error in the database debug log, I'd say this is some issue between SQLAlchemy and MariaDB, but it seems harmless. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 2 months

[MM3-users]New Mailman 3 users list

by Mark Sapiro

I'm happy to announce a new list for Mailman 3 users and others interested in Mailman 3. This list is running on a new Mailman 3 installation at lists.mailman3.org. The list's posting address is <mailman-users(a)mailman3.org>. The list's info page is <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/> and its archives are at <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/>. The top level Postorius page is <https://lists.mailman3.org/mailman3/> and the HyperKitty archiver is at <https://lists.mailman3.org/archives/>. You can subscribe by email by sending a blank message to <mailman-users-join(a)mailman3.org> and responding to the resulting confirmation request. You can also subscribe by going to the info page at <https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/>, logging in and subscribing. Log in offers three options. There are Google and Facebook OAuth2 login links on the log in page to log in with a Google or Facebook account, and there is a 'Login by email' link to login via Persona with any address you register and confirm with Persona. This is a new installation of Mailman 3 so there are still kinks to work out, and any issues can be discussed on the list or reported to the trackers at <https://gitlab.com/mailman/postorius/issues>, <https://gitlab.com/mailman/hyperkitty/issues> or <https://gitlab.com/mailman/mailman/issues> as appropriate. Enjoy! -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 years

[MM3-users] Re: [EXTERNAL] Re: Database deadlock when trying to delete a member.

by Mark Sapiro

On 3/22/21 9:53 PM, Simon Coggins wrote: > Ok after bit tracking I’ve worked out that the bouncer is dangling transactions when it’s sending warning messages. When https://gitlab.com/mailman/mailman/-/blob/3.3.4/src/mailman/model/bounce.py… is called and it get to update last_warn_sent it does the following in the DB: > > 2021-03-23 14:42:50.622 AEST [11693] LOG: statement: UPDATE member SET last_warning_sent='2021-03-23T04:42:50.622015'::timestamp, total_warnings_sent=1 WHERE member.id = 169331 > > But it never COMMITs this transaction. So all write operations are now hung waiting for the transction to be closed as the member record has been modified. As a test I added config.db.commit() after https://gitlab.com/mailman/mailman/-/blob/3.3.4/src/mailman/model/bounce.py… and restarted. And my mailman syncmembers worked perfectly and I didn’t have any hangs it correctly removed everyone it should have. In the database logs I can see the COMMIT. > > I’m pretty sure this is not the right spot for a config.db.commit() but hopefully this helps point to what might be going wrong. Thank you for all the research on this. It is extremely helpful. Instead of adding a commit after line 277 please try adding the @transactional decorator to the send_warnings_and_remove method at line 210 @transactional @dbconnection def send_warnings_and_remove(self, store): I think that is the proper fix. Let us know if that works. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: Messages hold for moderation - compared to mailman2 it appears that there are fewer options: missing option(?)

by Mark Sapiro

On 3/8/24 11:29 AM, Wikinaut wrote: > Is there a possibility to > > > - to discard the present mail ; and > - accept this sender (non-member) for further mails ? > > The reason: > - Member has sent from their office mail (= not yet known address) - mail 1 on hold and > - sent successfully mail 2 (copy of mail 1) from the known address > > So I want to discard the mail #1 (because the copy mail #2 was sent already) but I want to add his office address as member or to the whitelist. > > Can this be done in one step? It would be nice, at least. This was answered in the message to which you replied, found at <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…>. To reiterate, go to the held messages view. Click the subject of the message, pull down the `--- Set member moderation ---` dropdown and select `Default processing` or if you really want to bypass additional checks, `Accept immediately (bypass other rules)`, and click the `Discard` button. It doesn't matter that the address wasn't known beforehand. The post itself created a non-member record for the sender, and the above will set that non-member's moderation action. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 1 month

[MM3-users] Re: Hyperkitty tracebacks: possible DB corruption?

by Mark Sapiro

On 3/12/24 11:12 PM, peter--- via Mailman-users wrote: > FOr the other issue, I changed > https://gitlab.com/mailman/hyperkitty/-/blob/master/hyperkitty/views/thread… > > From: ``` > if request.user.is_authenticated: > last_view_obj, created = LastView.objects.get_or_create( > thread=thread, user=request.user) > if not created: > last_view = last_view_obj.view_date > last_view_obj.save() # update timestamp ``` > to: ``` > if request.user.is_authenticated: > try: > last_view_obj, created = LastView.objects.get_or_create( > thread=thread, user=request.user) > except LastView.MultipleObjectsReturned: > last_view_duplicate, last_view_obj = LastView.objects.filter( > thread=thread, user=request.user).order_by("view_date").all() > last_view_duplicate.delete() > created = False > > if not created: > last_view = last_view_obj.view_date > last_view_obj.save() # update timestamp ``` > > and that seems to have fixed it. Wrapping the last_view_obj, created = LastView.objects.get_or_create() in a try, except seems appropriate, but your code in the except clause assumes there will be exactly 2 objects returned. Something like ``` except LastView.MultipleObjectsReturned: last_view_objects = LastView.objects.filter( thread=thread, user=request.user).order_by("view_date").all() last_view_obj = last_view_objects[-1] for object in last_view_objects[:-1]: object.delete() ``` might be better. > I've been thinking though that it'd be better to fix duplicates in the > LastView class rather than on every get() or get_or_create() call. That might be good, but these exceptions are rare. I'm not sure how they even occur, so catching them on the get() or get_or_create() calls seems OK. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 1 month

[MM3-users] Re: Things I miss about mailman2

by Mark Sapiro

On 3/17/20 1:59 PM, Quanah Gibson-Mount wrote: > >> Click on the subject in the held messages list. At the bottom of the >> dialog that opens, there is a drop down to set the user's moderation. >> Normally, you would set it to 'default processing'. > > I do not see any such option. After clicking on the header the only > options available at the bottom are: > > Accept, Reject, Discard, Show Source, Show Header > > There are zero drop downs anywhere. This was implemented by <https://gitlab.com/mailman/postorius/-/merge_requests/397> and released in Postorius 1.3.0. >> This was not "removed". It just hasn't been implemented in MM 3 yet. > > So in terms of available functionality that was present in MM2, it was > removed. It may need to be re-implemented, but this was a core feature > that was present in the prior version that is no longer available. Yes, we are aware of many things that are not yet exposed/implemented in Postorius and elsewhere. There are currently 580 open issues at <https://gitlab.com/groups/mailman/-/issues>. We are working on these things as we can. We would love to have your help in fixing these. In the mean time, there are really only 2 or 3 core developers working on this and we are all volunteers, so it takes time. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 1 month

[MM3-users] Re: [Django] ERROR (EXTERNAL IP): Internal Server Error: /accounts/login/

by Mark Sapiro

On 5/18/21 4:06 PM, Mark Dadgar wrote: > I have a user attempting to access the list archives and he’s generating this login error. I have verified that he does have a django account. I’ve never seen this one before and I didn’t find anything relevant in the lit archives. > > Any ideas what’s going on here? ... > File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/utils.py", line 134, in _has_verified_for_login > emailaddress = EmailAddress.objects.get_for_user(user, email) > File "/opt/mailman/mm/venv/lib/python3.8/site-packages/allauth/account/managers.py", line 54, in get_for_user > ret = self.get(user=user, email__iexact=email) > File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/db/models/manager.py", line 82, in manager_method > return getattr(self.get_queryset(), name)(*args, **kwargs) > File "/opt/mailman/mm/venv/lib/python3.8/site-packages/django/db/models/query.py", line 419, in get > raise self.model.MultipleObjectsReturned( > > Exception Type: MultipleObjectsReturned at /accounts/login/ > Exception Value: get() returned more than one EmailAddress -- it returned 2! > Request information: > USER: AnonymousUser Go to the Django admin users page - something like http(s)://example.com/admin/auth/user/ - and search for the email address. This search is case-insensitive and I'm guessing it will find two users differing in case. In any event, django allauth is trying to find this user and is finding multiple EmailAddress.objects for this address or username. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 11 months

[MM3-users] Re: Hyperkitty

by Mark Sapiro

On 1/30/23 13:17, Onyeibo wrote: > > The mails don't have that header. I suspect I may have to investigate > SELinux. I think it's unlikely a SELinux issue unless you mean it's an issue writing the log, but if there are any entries at all in mailman.log, that should be OK. what does `mailman conf -s archiver.hyperkitty -k configuration` show? The default is `/etc/mailman3/mailman-hyperkitty.cfg`. Whatever it is, what's in that file. It should be something like ``` [general] base_url: http://127.0.0.1:8000/archives/ api_key: some_key ``` some_key needs to match ``` MAILMAN_ARCHIVER_KEY = 'some_key' ``` in /etc/mailman3/settings.py and the base_url setting needs to access hyperkitty. It could be as above or it could be the URL that accesses HyperKitty externally as in ``` base_url: http:://example.com/archives/ ``` Is all of that correct? To verify base_url, you can do ``` curl http://127.0.0.1:8000/archives/api/ ``` where the initial part of that is the base_url setting. That should return the html for a page of documentation. Look at https://gitlab.com/mailman/mailman-hyperkitty/-/blob/master/mailman_hyperki…. This is Mailman Core's interface to the archiver. If any of the methods there fail to connect to HyperKitty or get an appropriate response, they all log errors. In particular, the archive_message() method at line 171 is saving the message in the spool queue. Immediately before that at lines 164 and 167 it is writing log messages. You should be seeing them. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 2 months

[MM3-users] Re: troubleshooting hyperkitty

by Mark Sapiro

On 12/9/20 5:01 PM, Morris Jones wrote: > > did that as well ... > > base_url: https://mailman.whiteoaks.com/hyperkitty/ > > (Though the configuration comment on this suggests it should not be > publicly accessible, I don't see any alternative endpoint that's private.) The comments in mailman-hyperkitty/mailman-hyperkitty.cfg say in part # ... It does not need to be publicly available, in fact it's # better if it is not. but they add # However, if your Mailman installation is accessed via HTTPS, the URL needs # to match your SSL certificate (e.g. https://lists.example.com/hyperkitty) > I added both my public IP address and my domain name to > MAILMAN_ARCHIVER_FROM. > > So this part is all set, it would seem ... > > [archive.hyperkitty] > class: mailman_hyperkitty.Archiver > enable: yes > configuration: /opt/mailman/var/etc/mailman-hyperkitty.cfg > > [logging.archiver] > path: /opt/mailman/var/logs/archiver.log api_key What is api_key? Is your setting for api_key somehow garbled. Note it needs to be set in the general section of mailman-hyperkitty.cfg and not in mailman.cfg > My archiver log continues empty > > The API keys match in settings_local.py MAILMAN_ARCHIVER_FROM and > mailman-hyperkitty.cfg The key in settings_local.py is MAILMAN_ARCHIVER_KEY, not MAILMAN_ARCHIVER_FROM, a typo in your mail or ?? Anyway, in settings_local.py the key is a python string and must be quoted, but the api_key setting in mailman-hyperkitty.cfg is not quoted. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 4 months

[MM3-users] Re: Wrong info in moderation mail when held due to match of a header rule

by Mark Sapiro

On 10/17/20 10:39 AM, Torge Riedel wrote: > > The message is being held because: > > Header "Yes" matched a header rule > > At your convenience, visit your dashboard to approve or deny the > request. > > I think this is wrong, it should read 'Header "x-spam" matched a header > rule'. Cause the header rule is configured for header "x-spam" and > pattern "Yes". The message is defined as 'Header "{}" matched a header rule' where {} is replaced with the value of the matching header. I agree it would be better if it were something like 'Header value "{}" matched a header rule for {}:' with {}s replaced with the header value and name. That would make it in your case 'Header value "Yes" matched a header rule for x-spam:' > I haven't found a bug report for this yet on gitlab. If someone of the > developers confirm this is wrong, I will file a bug on gitlab for it. Please do file a bug. It won't be fixed until after the upcoming 3.3.2 final release because we not making i18n changes between the candidate and final releases. Also, if you don't like my suggestion, feel free to suggest something else. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 6 months

[MM3-users] Re: Upgrade to 3.3.2 fails

by Mark Sapiro

On 12/26/20 11:28 AM, Joel Lord wrote: > innodb_page_size of 16384 is the default, so that is what I'm working > with as well. The row size limit is half the page size minus some > overhead, so it comes out to 8126 and I bet that is yours as well. > > Yes, I am utf8mb4 at the database and table levels, and I bet you are > right. Just to confirm, between 3.2.1 and 3.2.2 the column archive_rendering_mode was added to the mailinglist table. This column is type - integer (4 bytes), but could be enough to push the row over the limit. As far as utf8mb4 vs. utf8 is concerned. There will be issues with the hyperkitty_email table subject and content columns in particular and maybe others if email messages contain 4-byte utf-8 unicodes. However, as I read the MySQL docs, for columns like VARCHAR(255) and VARCHAR(510), the difference affects only the number of characters that can be stored in the column and not the actual column width. I.e., a VARCHAR(255) column is actually up to 256 bytes wide (1 byte for length and up to 255 butes of data) and can thus hold up to 85 3-byte utf-8 encodings or up to 63 4-byte utf-8 encodings, but since any string normally contains only a few if any (probably none in the case of the mailinglist table) the actual limit is much closer to 85. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 3 months

[MM3-users] Re: Archive search failing on one list

by Mark Sapiro

On 10/9/23 22:50, Mark wrote: > > I'm still on this problem of one list's archive-search not returning > any results. I created a new list today and it also has the same > problem. > > In short, the older lists all seem fine -- their search results are up- > to-date so that tells me the cron is okay. It's just these 2 newer > lists that have the problem. > > It's taken me while to get my head around the Django admin command you > have suggested, as I kept getting an error when starting: Steve has addressed your issues with multiple Django admin commands, some of which apparently don't reference the correct settings. > The format of my final line is different to yours ... > > Mine: <MailingList: <MailingList thepost(a)example.com>> > > Yours: <MailingList listname(a)domain.com (listname.domain.com)> > > Does this (missing list_id) give any clue as to why the archive-search > isn't working, or is just that starting with "# python3 manage.py > shell" is the wrong thing to do? It is not a clue as to the problem. The format of that `representation` changed in HyperKitty 1.3.5. What is your version? What happens if you do, with the appropriate Django admin and list name, ``` python3 manage.py update_index_one_list thepost(a)example.com ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 6 months

[MM3-users] Re: Pre-approved howto

by Mark Sapiro

On 7/5/18 6:14 AM, thor.rustad(a)gmail.com wrote: > I have tried to understand the concept of pre-approved messages, but I'm spending way too much trying to figure it out. Help! There is a list attribute, moderator_password, which is not currently exposed in Postorius and therefore must be set via 'mailman shell'. Here's a sample session. > $ mailman shell -l junk(a)msapiro.net > Welcome to the GNU Mailman shell > The variable 'm' is the junk(a)msapiro.net mailing list >>>> m.moderator_password >>>> from mailman.config import config >>>> m.moderator_password = config.password_context.encrypt('xxx123').encode('us-ascii') >>>> m.moderator_password > b'$6$rounds=656000$SKMqTlPybIZSBjYB$wCga5qALCv8oobp4cDql2iKEg8T6qIgk8XEKYbkk9QXENeFQDHZ1M4AtmqfureYQDB5g.Az.nZPrWAr9N9g1N0' >>>> commit() That will set the list's moderator_password to the encrypted value of 'xxx123'. Then, if a post to the list contains Approved: xxx123 either as a header in the message (recommended if possible) or as the first non-blank line in the first text/plain part of the message, the post will be 'pre-approved'. The header can actually be any of Approve:, Approved:, X-Approve: or X-Approved: and if it is not a header, but is found in the first text/plain part of the message, it will be removed from that part and a best effort will be made to remove it from other text/* body parts in case it is also in an alternative part. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 9 months

[MM3-users] Re: Removing the footer from mails

by Mark Sapiro

On 10/21/2017 01:46 PM, Peter Mueller wrote: > Hi, > > mailman2 had the configuration variable "msg_footer" to edit/remove the > footer. How can I get rid of the footer in mailman3? The doc is at <http://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/decorate.…>, but it's a bit complex. First, the message footer template name is 'list:member:regular:footer' and the digest footer template name is 'list:member:digest:footer' and if you want the same template for both, the name 'list:member:generic:footer' will do. The easiest way to set these is to create a template for the desired language (probably 'en') or an empty file if you want no footer. Then, there is a 'var' directory in the Mailman installation which contains sub directories named 'archives', 'cache' 'data', 'etc', 'ext', 'lists', 'locks', 'logs', 'messages', 'queue' and 'templates'. You can put list specific templates in var/templates/lists/LIST.ID/en/, domain specific templates in var/templates/domains/DOMAIN/en/ and sitewide templates in var/templates/site/en/. For example if you put an empty file at var/templates/site/en/list:member:generic:footer and a non-empty file at var/templates/lists/list.example.com/en/list:member:regular:footer, all messages and digests will have no footer except for regular deliveries from the list.example.com list which will use it's template. list overrides domain overrides site overrides default. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 6 months

[MM3-users] Re: Mailman3 on Debian 10

by Mark Sapiro

On 1/30/20 9:22 AM, Bala Mutyam wrote: > Sorry one more issue, > > Mailman settings page giving me below error. > > Server error > An error occurred while processing your request. > > Error logs: > > ERROR 2020-01-30 17:20:11,331 16285 django.request Internal Server Error: /postorius/accounts/subscriptions/ > Traceback (most recent call last): > File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py", line 41, in inner > response = get_response(request) > File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 187, in _get_response > response = self.process_exception_by_middleware(e, request) > File "/usr/lib/python3/dist-packages/django/core/handlers/base.py", line 185, in _get_response > response = wrapped_callback(request, *callback_args, **callback_kwargs) > File "/usr/lib/python3/dist-packages/django/contrib/auth/decorators.py", line 23, in _wrapped_view > return view_func(request, *args, **kwargs) > File "/usr/lib/python3/dist-packages/postorius/views/user.py", line 306, in user_subscriptions > mm_user = MailmanUser.objects.get_or_create_from_django(request.user) > File "/usr/lib/python3/dist-packages/postorius/models.py", line 164, in get_or_create_from_django > return self.get(address=user.email) > File "/usr/lib/python3/dist-packages/postorius/models.py", line 86, in get > return method(*args, **kwargs) > File "/usr/lib/python3/dist-packages/mailmanclient/client.py", line 322, in get_user > return User(self._connection, content['self_link'], content) > KeyError: 'self_link' Just prior to this is a call to the REST API to GET /users/user(a)example.com (or whatever the user's address is). It appears that that user doesn't exist in core. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 2 months

[MM3-users] Re: # comment allowed in a template file?

by Mark Sapiro

On 7/27/20 5:15 AM, skenny(a)scss.tcd.ie wrote: > > The effect of the template files not being readable by user "mailman" was interesting. Hundreds of lines like the following got written to mailman-core's var/log/smtp.log file at the rate of 4 per second: > > Jul 23 17:09:54 2020 (25) Using agent: <mailman.mta.bulk.BulkDelivery object at 0x7fdf9e7b5f28> > > (the hex number was different each time). That's a `debug` level log message written for every delivery. It has nothing to do with the unreadable templates except that the unreadable template causes looping in an attempt to send the message. Did you perhaps set [logging.smtp] level: debug in an effort to diagnose the template issue? > Having excessively restrictive permissions on the template files is a silly - but easy enough - mistake to make. If it were possible to add it to Mailman 3, a more descriptive logging message could point others who make it in the right direction, perhaps. I spent a long time trying to figure out why messages weren't getting sent out from Mailman core, and in the end it was luck in form of a colleague's suggestion about file permissions that got me out of the rut. There is clearly a bug in that an unreadable template should just be skipped and the fact logged. I have reported <https://gitlab.com/mailman/mailman/-/issues/745>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 8 months

[MM3-users] Re: Mailman - delete or backup old archived messages

by Mark Sapiro

On 6/30/21 6:23 AM, Lucia Moreno wrote: > Hi Mark, > > We are facing the same issue. My postgres database is growing too fast and > I would need to do some creaning of old archives dated from 2001 and keep > only the last, lets say... 5 years. > > Could you please help us with the development of such a script? I have no > experience in python. The attached script is a rough idea. It assumes your Mailman is installed in a virtualenv at /opt/mailman/mm/venv and the django settings module is /opt/mailman/mm/settings.py. The pruned messages will be in a mbox at /opt/mailman/pruned.mbox. The age of messages to prune is defined by the days=365*5 argument in CUTOFF = datetime.datetime.today() - datetime.timedelta(days=365*5) All these things may need adjustment for your purpose. There is also a commented bit showing how you could do just one list. It's probably good to do just one list at a time since it's not clear how useful the pruned.mbox will be if it contains messages from multiple lists. I.e., run it for one list and move the pruned.mbox aside before doing the next list. Note that I've tested that this works, but it's possible that it will leave HyperKitty in a bad state. Backup your database before running this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 9 months

[MM3-users] Re: Archive download - unexpected end of file

by Mark Sapiro

On 3/1/25 13:58, Mark wrote: > > I have a MM3 list to whose archive I recently added an mbox file of > older emails. > > Viewing/searching the archive (Hyperkitty) is working fine. > > Downloading archives "for the month" or "last 30 days" delivers the > expected ".mbox.gz" file and those are fine. > > However, when I download the "Entire archive" and attempt to gunzip that > ".mbox.gz" file I get the error: " ... unexpected end of file". The process creating the zip for download times out. You can increase the timeout. If your wsgi server is Gunicorn, see https://docs.gunicorn.org/en/stable/settings.html#timeout - for uwsgi see https://uwsgi-docs-additions.readthedocs.io/en/latest/Options.html#harakiri However, it's probably easier to get it in pieces. You can prpbably get chunks bigger than a month. Look at the URL for a month, e.g. for Jun, 2005 it will be something like https://www.example.com/archives/list/<fqdn-listname>/export/<fqdn-listname>-2025-02.mbox.gz?start=2025-01-01&end=2025-02-01 The <fqdn-listname>-2025-02.mbox.gz can be any arbitrary file name. The start and end parameters determine what's included. E.g. for all of 2024 https://www.example.com/archives/list/<fqdn-listname>/export/<fqdn-listname>-2024.mbox.gz?start=2024-01-01&end=2025-01-01 Note that the end date is the first date not included, i.e. the day after the last date included. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 month, 3 weeks

Search results for query "sapiro"