Search results for "dO" - lists.mailman3.org

[MM3-users] Re: Finding a user to delete them

by Brian Carpenter

On 3/14/20 5:03 AM, Stephen J. Turnbull wrote: > The bundled administrative interface*is* Postorius. The Mailman > shell is basically a quick hack (sorry Abhilash; if you want to call > it a masterwork and say the speed of development is testimony to your > skills, I won't deny it;-) to give more convenient access to > internals to experienced Mailman hackers. More administrative > features is something we plan to work on, but the Mailman project will > focus on Postorius for the forseeable future. I do think List Admins would want an interface to help "manage" a user account on behalf of a user then what is currently available in Postorius. I see this come up with my Mailman 2 clients frequently. For instance, a mm2 list member asked their list admin to subscribe them to a list topic to limit the amount of messages they receive. The list admin was new and open up a ticket to find out how they do that in which I replied showing them how they as a list admin, can go in and change options on behalf of a list member. I don't see this functionality built into Mailman 3 nowhere near the extent that Mailman 2 has. Last night a Mailman 3 client wanted to know how they can add a real name to a list member. I said you can't, not as list admin. I directed them to instead of unsubscribe the member and mass subscribe them so they can include a real name along with the email address of the list member. > For alternatives to Postorius and the Mailman shell, Brian Carpenter > (follow Allan's subthread) is working on a new management UI (using > PHP), and I believe there's a working node.js API "out there > somewhere". Please be very considerate of Brian's time; he and EMWD > constitute a bulwark of the Mailman ecosystem and will be even busier > with the UI project. But do pass on your suggestions to him as well > as to us, he's indicated he's open to that. There were some very good suggestions that were brought out in this thread and I had already passed them on to my developer. My approach with Affinity is definite leaning very heavy on the needs of list admins atm. -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

5 years, 1 month

[MM3-users] Re: New messages not being archived

by Mark Sapiro

On 7/22/21 11:41 AM, Sarah H wrote: > here is the full error message. Nginx proxies on http. > > https://pastebin.com/raw/TUf5dYi8 Thanks for the log. It is basically just confirming what we see with this. > the curl commands above result in. > ... > (venv) [mailman@sysname sarah]$ curl -X POST http://127.0.0.1:8000/hyperkitty/api/mailman/archive > curl: (52) Empty reply from server I am at a loss to understand why HyperKitty isn't responding. Are you able to access HyperKitty normally from a web browser? Do you get a response from ``` curl http://127.0.0.1:8000/hyperkitty/ ``` If so, what? What you should get from ``` curl -X POST http://127.0.0.1:8000/hyperkitty/api/mailman/archive ``` is ``` <html><title>Auth required</title><body> <h1>Authorization Required</h1><p>Please check whether the MAILMAN_ARCHIVER_KEY is provided by you and it is correct. </p></body></html> ``` You should get the same response as a web page if you go to https://example.com/hyperkitty/api/mailman/urls. Do you? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 9 months

[MM3-users] Re: Migration failure (2.1.29 to 3.3.8 on Debian testing)

by Mark Sapiro

On 6/7/23 11:58, {16/7} wrote: > > I have both the mailman and mailman3-full packages installed on my machine and I'm following the migration guide located here: https://docs.mailman3.org/en/latest/migration.html Which is the source of at least one of your issues. The Debian packages are behind and are missing multiple bug fixes and enhancements. > Running the command { mailman import21 mylist(a)mysite.com /var/lib/mailman/lists/mylist/config.pck } completes once I create the list but states that it cannot convert the msg_footer and digest_footer mailing list attributes. (I might also point out that the { mailman create mylist(a)mysite.com } command isn't actually documented on that webpage.) import21 tries to make Mailman 3 compatible versions of your Mailman 2.1 msg_footer and digest_footer. It will put these in Mailman's var/templates/lists/<list-id>/<lc>/ directory as list:member:regular:footer.txt and list:member:digest:footer.txt respectively. You need to examine those files as they probably contain Mailman 2.1 style replacements that haven't been converted. See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… for the Mailman 3 replacements which are encoded as dollar strings, e.g. $listname gets replaced with the list's posting address. > I can't seem to find the manage.py script in my $PATH and after searching, I find it as part of the mailman3-web package. As you report in a followup, in the Debian package it's called mailman-web > Next, I changed the file's group back to list and decided to try running the manage.py script as the www-data user. This results in "/usr/lib/python3/dist-packages/django_q/conf.py:139: UserWarning: Retry and timeout are misconfigured." and "System check identified some issues:" followed by a list of "Auto-created primary key used when not defining a primary key type, by default 'django.db.models.AutoField'" warnings for a number of Django tables. Recent mailman installed following https://docs.mailman3.org/en/latest/install/virtualenv.html will include ``` DEFAULT_AUTO_FIELD = 'django.db.models.AutoField' ``` in Django's settings which will avoid that warning with Django>=3.2 > > My questions are: > > 1. How do I undo any damage (if any) my efforts may have caused? You probably didn't do any damage as the commands failed before doing anything. > 2. What's the correct way to run manage.py? I see from your follow up that you figured this out. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 10 months

[MM3-users] Re: Disabling max_message_size and send_welcome/goodbye_msg globally or by API

by Mark Sapiro

On 10/10/2017 12:04 PM, Peter Mueller wrote: > > is it possible to turn off max_message_size and send_welcome_msg / > send_goodbye_msg globally? Not for existing lists, but for new lists you can create a style with these settings and make it the default style. See <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…> for how you might do that. > If there are no global options, how can I turn off these feature using the > REST API? > In python you can do it with >>> mlist.max_message_size = 0. > If I send a PATCH request to lists/some@list/config with body > max_message_size=0, I get "Unknown attribute". Same for send_welcome_msg > and send_goodbye_msg. max_message_size and send_goodbye_msg are not currently exposed in REST. See the definition of ATTRIBUTES in mailman/rest/listconf.py for what is. You should be able to PATCH send_welcome_msg via REST. I don't know why that didn't work for you? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 6 months

[MM3-users] Re: spanish localization

by Victoriano Giralt

El sáb, 13-02-2021 a las 14:53 -0800, Mark Sapiro escribió: > What translations are those? Please give specific examples. What I am > saying is Mailman core 3.3.3 is currently up to date with weblate. There > are no Spanish translations for core done after 7 November in weblate > and weblate shows 100% completion for Spanish for Mailman core. Mark, please, how do you check when translations happened? Nov 7th is a very significant date for me (it is my wedding anniversary) and I'm 90% sure that I dedicated time to Weblate after that date... All strings related to Mailman (core, django_mailman3, postorius and hyperkitty) are translated into Spanish 100%, but the interfaces, after updating to the latest releases, are still in Englanish (more English than Spanish). This is not a fight, we want to help, but do not know how. Thanks! -- Victoriano Giralt Innovation Director Digital Transformation Vicerectorate University of Malaga +34952131415 SPAIN ================================================================== Note: signature.asc is the electronic signature of present message A: Yes. > Q: Are you sure ? >> A: Because it reverses the logical flow of conversation. >>> Q: Why is top posting annoying in email ?

4 years, 2 months

[MM3-users] Re: add / remove / set moderation bit of non-members via mailman shell

by Mark Sapiro

On 2/7/24 02:37, Zaheer Abbas wrote: > > I do the above via postorius because I couldn't find a way to do this via > mailman shell. Something like ``` mark@msapiro:~$ mailman shell -l list(a)example.com Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the list(a)example.com mailing list >>> NEW_NONMEMBERS = [('First User', 'user1(a)example.com'), ... ('Second User', 'user2(a)example.com'), ... ('Third User', 'user3(a)example.com'), ... ] >>> from mailman.app.membership import add_member >>> from mailman.interfaces.subscriptions import RequestRecord >>> for display_name, email in NEW_NONMEMBERS: ... record = RequestRecord(email, ... display_name=display_name, ... delivery_mode=None, ... ) ... member = add_member(m, record, role=MemberRole.nonmember) ... member.moderation_action = Action.accept ... >>> commit() >>> ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 2 months

[MM3-users] Re: Clearing webserver cache - Nginx

by Odhiambo Washington

On Mon, Aug 5, 2024 at 8:19 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 8/5/24 07:04, Odhiambo Washington via Mailman-users wrote: > > I am having an ugly-looking https://mm3-lists.kictanet.or.ke/archives/ > page > > because of cached content: > > > > ``` > > 2024/08/05 17:00:31 [error] 694#694: *9562 open() > > "/opt/mailman/mm/static/CACHE/css/output.6dab123e4897.css" failed (2: No > > such file or directory), client: 172.70.111.39, server: > > mm3-lists.kictanet.or.ke, request: "GET > > /static/CACHE/css/output.6dab123e4897.css HTTP/2.0", host: " > > mm3-lists.kictanet.or.ke", referrer: " > > https://mm3-lists.kictanet.or.ke/archives/" > > 2024/08/05 17:00:31 [error] 694#694: *9564 open() > ... > > That IP address appearing there is not my actual IP, but Cloudflare's, > > which is acting as proxy for the site. > > > I **think** you may have something like > > location /static/ { > alias /opt/mailman/web/static/; > } > > in nginx on cloudflare, but since cloudflare is not the Mailman server, > /opt/mailman/web/static/ doesn't exist there. > Actually, what I mean is that CF is proxying requests to the host named m3-lists.kictanet.or.ke. I do not have any configuration other than DNS proxying at CF. I can't be sure on how to configure this without knowing the details of > how requests get from cloudflare to mm3-lists.kictanet.or.ke and from > there to the wsgi server. > When you ping m3-lists.kictanet.or.ke, the IP you get is CFs, not the actual IP of the host. So when you talk to m3-lists.kictanet.or.ke via a browser, it's CF IP who you talk to and it in turn talks to the host directly. So the IP address you see in the logs is CF's IP address, not yours, not mine and CF are doing some caching. That's why they are requesting for expired files. > However, if cloudflare just proxies the request for /static/ to the > Mailman server and nginx on that server has the above `location` > directive, that may do it. > I suppose it's possible to configure Nginx to NOT ALLOW caching of content from the /static/ location. Being new to Nginx, time to say hi to uncle G again. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

8 months, 2 weeks

[MM3-users] Re: Running mailman3 on AWS and dealing with SES email verification

by Mark Sapiro

On 5/1/20 6:54 AM, Mohsen Masoudfar wrote: > Thank you Mark, this is really very helpful. I am going to work on the details. It would be breat, if there were a way to set some of this options as default, like DMARC mitigation is default to no, I changed it to unconditionally and replace From to with list address and got good results, but the default is no. How may I changed the default, do that the list owner/creator does not need to update these fields. There are two ways to do this. Both require some code modification. The simplest is just to change the lines at <https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/styles/base.py…> to: mlist.dmarc_mitigate_action = DMARCMitigateAction.munge_from mlist.dmarc_mitigate_unconditionally = True The other way is to create a new list style that has these settings and chose it when creating a list. See <https://mailman.readthedocs.io/en/latest/src/mailman/styles/docs/styles.html>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: Editing the "example.org" site

by Odhiambo Washington

On Wed, Jan 3, 2024 at 9:20 AM Stephen J. Turnbull < turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > Odhiambo Washington writes: > > > This is interesting. However, you meant the default example.com, > > right? > > Whatever it is is fine for me. I was going from memory. > > > And that link also let's me DELETE the site :-) > > Don't do that! What happens afterward is not hilarious, it's a > self-DOS unless you know exactly what you're doing. > I thought about that, because I have seen what those who deleted example.com went through. > Among other things, the next site you create is still #2. It's not > really any cleaner just because you got rid of the example site. > It's good that one can rename the example.com. Perhaps that can be documented somewhere as a footnote. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 3 months

[MM3-users] Re: Splitting hosts: mta&core vs postorius

by Ruth Ivimey-Cook

On 24/06/2020 00:20, Mark Sapiro wrote: > Go to your Django admin web UI and look at your Django Mailman 3 Mail > domains. This will be at a URL like > https://greyarea-web1.cam.ivimey.org/admin/django_mailman3/maildomain/ > > Do you see this domain there? If so, delete it. I hadn't logged in as admin before, so having done so I can now confirm that having done so this screen shows "0 mail domains" Because I could, I then visited "VIEW SITE" and see a mailing lists page, which is I think the same one I have been trying to visit, except of course now I am logged in. I do now see the correct, and only, mailing list configured on the core server. Returning to the previous "maildomain" page, that now shows the expected mailing list as well. Other admin pages seem to be working fine as well. I think, possibly, that it is now installed and working. ... But I don't know why. Ruth -- Software Manager & Engineer Tel: 01223 414180 Blog: http://www.ivimey.org/blog LinkedIn: http://uk.linkedin.com/in/ruthivimeycook/

4 years, 9 months

[MM3-users] Re: Converting non-members to members

by Abhilash Raj

On Tue, Dec 18, 2018, at 2:55 AM, Alan So wrote: > Postorius is not currently exposing non-members management. Our Mailman > 2 users are currently using accept_these_nonmembers, > hold_these_nonmembers and reject_these_nonmembers. We know that > mailman import21 will change these to nonmembers entries in Mailman 3. > Since list owners will still want to manage them, we tend to move all > of them to members and turn off delivery status for them. I have been (slowly) working on exposing non-member management in Postorius (Mailman's web ui). I am hoping to complete it soon, but there is not clear ETA for it yet. I hope that it will be done soon. > However, we met some difficulties when we try to develop using mailman > client. Can you also please share the snippet of code you used for the these operations below so that we can help you fix them? > 1) If those non-members addresses already exist as members, we will > encounter error when we subscribe for them: urllib.error.HTTPError: > HTTP Error 409: b'Member already subscribed' Do you expect something else here? Any response with non-2XX status code is raised as HTTP Error in MailmanClient. > 2) We cannot change the moderation_action: urllib.error.HTTPError: HTTP > Error 400: b'Cannot convert parameters: moderation_action' I'd need to see the code fr this one, not sure what value did you pass here. You should be able to do: >>> member1.moderation_action = 'hold' >>> member1.save() Allowed values should be: - hold - reject - discard - accept - defer = 4 > 3) We cannot change the preference: urllib.error.HTTPError: HTTP Error > 400: b'Cannot convert parameters: delivery_status' This is again depends on what you are passing as value for the parameter. Allowed values are: - enabled - by_user (disabled by user) - by_bounces (disabled due to bounces) - by_moderator (disabled due to moderator) - unknown (disabled for unknown reason > > Are there any better ways to enable the list owners to manage those > previously configured nonmembers' addresses through the web? I am working on adding the support in the web ui, so yes, there will be better ways to manage those in future. > Otherwise, we probably need to have some manual effort to overcome the > above three issues. We know that we can always do the above manually > but we got a lot of lists to migrate to Mailman 3. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 4 months

[MM3-users] update_index

by Darren Smith

Hello, If I'm reading the docs correctly, when we run manage.py update_index, it should be an incremental index of new emails that have been added since the last time update_index was run - can anyone confirm that this is the expected behavior? Or is there another command line option that I am missing? Right now we are indexing EVERYTHING every time that this is run. Probably this wouldn't be much of a problem except that we are importing all of our old archives (they go back to 1998 and comprise over 40.5 million emails) into the new system. As of now we have around 700,000 emails imported into hyperkitty, and since it is indexing everything it is taking around 1 hour and 10 minutes. Obviously we can't run that once a minute. Right now we're doing once a day, meaning that new emails won't be indexed until the next day. Fast forward to when we have all 40 million imported...the full index process will take (we estimate) around 4 days or so. So...can anyone help with how to get the update_index to do only emails added since the last time the update_index was run? Thanks! Darren

7 years

[MM3-users] Re: timezone in hyperkitty

by matthew_saunders＠harvard.edu

Mark Sapiro wrote: > On 6/29/20 12:18 PM, Marco Marinello wrote: > > I'm expirencing the same behaviour in Postorius. Is > > it possible to set a default timezone for new users? Already set it in settings_local.py > > but not having any effect, still seeing "Africa/Abidajin" in new users. > > Do you mean the users time zone as displayed in the user's profile? This > is a Django setting and the default should come from the TIME_ZONE > setting in settings_local.py, at least if USE_TZ is set True I'm seeing the same behavior on my development site, and I was even able to reproduce this when I created my account on this very site moments ago using OAuth. If you check the django_mailman3_profile table in the DB, I expect you'll see that my timezone record is blank (since I haven't touched it from the Accounts page). FWIW, it's empty... not NULL, since there's a not-null constraint on this field. Is it possible to have this set to a default (non-empty) value somehow? TIME_ZONE & USE_TZ isn't doing it.

4 years, 9 months

[MM3-users] Re: Fwd: [Django] ERROR (EXTERNAL IP): Internal Server Error: /mailman3/hyperkitty/api/mailman/archive

by Mark Sapiro

On 1/28/21 5:33 AM, David Partain via Mailman-users wrote: > I wrote: >> I have the same issue, and have changed the configuration in /etc/mailman3/mailman-web.py to: >> >> DATABASES = { >> 'default': { >> 'ENGINE': 'django.db.backends.mysql', >> 'NAME': 'mailman3web', >> 'USER': 'mailman3web', >> 'PASSWORD': 'xxxxxxxxxxxxxxxxxx', >> 'HOST': 'localhost', >> 'PORT': '', >> 'OPTIONS': { >> 'init_command': "SET sql_mode='STRICT_TRANS_TABLES'", >> 'charset': 'utf8mb4', >> }, >> } >> } >> >> and restarted stuff, but I cannot tell that it has changed anything. > > You responded: >> That should do it. I think the original message should have been saved >> as a queue entry in Mailman's var/archives/hyperkitty/spool/ directory. > > That directory has all of the messages sent to that list: > > # ls /var/lib/mailman3/archives/hyperkitty/spool/ > 1611827925.8030825+925c996b9b6020ee18e9a689ce23384855159f77.pck 1611827926.1923075+e728f3c29c1fe6eeeca641314cdba7007cb6e132.pck > 1611827925.8917305+d16b7004bdbbef98ce40fb8ee70e492715d1607d.pck 1611827926.2623458+1aac13b50d8e7f32eb14d13e6559656aa8f3bd10.pck > 1611827925.9594557+7ad2a910b5ee9142c88f0bf26c60c6df960d4262.pck 1611827926.3488555+04a540651c5f829751518433e1c54168ab63a38b.pck > 1611827926.0404096+a5e745f51a9f7d541aeb770a89604be17019f3c5.pck 1611827926.4206145+de861eec6404d0c8f9f8bdb180e29bff2de7c52b.pck > 1611827926.1167526+0aa63639a4ec102bf63522827637e75e6a2b092a.pck This is what's expected since the underlying issue isn't yet fixed. > Yes, I'm still seeing the errors. When I send mail to a list with a cute emoji, I see the following in /var/log/mailman3/web/mailman-web.log: > > ERROR 2021-01-28 10:58:45,708 16923 django.request Internal Server Error: /mailman3/hyperkitty/api/mailman/archive > (bunch of python errors omitted) > DataError: (1366, u"Incorrect string value: '\\xF0\\x9F\\x98\\x8A\\x0A\\x0A...' for column 'content' at row 1") OK. The issue is with your database it doesn't like '\xF0\x9F\x98\x8A' which is a 4-byte utf-8 encoding for a smiley face emoji. The issue is with MySQL and MariaDB which do not accept 4-byte utf-8 encodings by default. The settings you show above should be sufficient to allow 4-byte utf-8 encodings. I'm not that familiar with how the Debian/Ubuntu package sets things up. Are you sure that /etc/mailman3/mailman-web.py is the settings file used by Django, and if so does it have at the end something like ``` try: from settings_local import * except ImportError: pass ``` and if so is there something there that overrides the DATABASES setting? If all that is OK, you may need to do something like ``` ALTER DATABASE mailman3web CHARACTER SET utf8mb4; ALTER TABLE hyperkitty_email CHARACTER SET utf8mb4; ``` on the database itself. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Disabling Gravatar

by Marvin Gülker

Hi everyone, I want to make you aware of a potential privacy problem in Mailman's Hyperkitty. Under the upcoming EU General Data Protection Regulation (GDPR)[1], which will be in force as of 2018-05-25, it is illegal to transmit data to third parties without a right to do so. Without going into the details, the inclusion of third party services into one's website is usually deemed such a transmission, and unless one has explicit consent of the user (e.g., by an optional (!), unticked ticking box) this is normally illegal (if one targets EU users). The GDPR does not affect private and family use (Art. 2(2)(c) GDPR), but the exact reach of that clause is yet to be determined; it certainly does not exclude company use of Mailman. I've found it's possible to disable the social login providers quite easily (we had this discussion here on the mailinglist recently), but I don't see an option to disable Gravatar. If there is one, please enlighten me, but anyway I want to propose this as a feature request against Hyperkitty. A GDPR-compliant implementation of Gravatar in Mailman would look like this: * In order to not transmit website visitor's data (IP address, browser info, etc) to Gravatar, Hyperkitty has to request the avatar image itself and not leave that to the user's browsers to do. In other words, the HTTP GET request needs to come from the server running Hyperkitty and the user's browser then just requests the avatar from the Hyperkitty server. Most likely easiest way to do this is to pre-download the avatar when an email is archived. * In order to not transmit the subscribers' data (email address, allows Gravatar to track the subscriber) to Gravatar illegally, the retrieval of the avatar image from Gravatar has to be disabled by default. Instead, an option needs to be added to the subscriber's control panel which he has to actively enable in order to have his Gravatar downloaded and thus used (privacy-by-default rule). I'm not saying Gravatar tracks people and sells the information gathered, though I have doubts on how Automattic makes money with the service. I'm just outlining the legal duties under the upcoming GDPR for service owners, which are independant of how Automattic processes the data in this specific case. Please don't dismiss this as some side feature not needed. The fines that can be imposed on service owners due to violation of the GDPR are very high (up to 20,000,000 € [that's 20 million euros, really]). Marvin [1]: http://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1510481733260&uri=CELEX:… -- Blog: https://www.guelkerdev.de PGP/GPG ID: F1D8799FBCC8BC4F

7 years, 5 months

[MM3-users] Re: Problems with mailman core translation and other details

by Mark Sapiro

On 2/6/24 2:41 PM, celi--- via Mailman-users wrote: > It´s the case below: the pair msgid/msgstr seems to be OK, but this particular sentence is not being translated. > > #: templates/postorius/lists/summary.html:88 > #, python-format > msgid "" > "\n" > " To subscribe you can send an email with 'subscribe' in the" > "subject to\n" > " <a href=\"mailto:%(address)s?subject=Subscribe\">" > "%(address)s</a>\n" > " or use the form below:\n" > "" > msgstr "" > "\n" > " Para se inscrever você pode enviar um e-mail com o assunto" > "'subscribe' para\n" > " <a href=\"mailto:%(address)s?subject=Subscribe\">" > "%(address)s</a>\n" > " ou use o formulário abaixo:\n" > > What am I doing wrong? Or what can I do to make things suitable? Is the rest of that page translated appropriately? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 2 months

[MM3-users] Re: Error Logging - what changed with the New Year releases?

by Mark Sapiro

On 1/14/23 11:44, Odhiambo Washington wrote: > On Sat, Jan 14, 2023 at 7:13 PM Mark Sapiro <mark(a)msapiro.net> wrote: > >> Nothing in those releases per se would affect this. This is Django and >> django-allauth. Perhaps when you updated the Mailman packages, you also >> updated these dependencies. >> > > Which dependencies would those be? Django and django-allauth. > When I upgraded, the command I ran was: > > pip install --upgrade --force mailman mailmanclient postorius hyperkitty > mailman-hyperkitty django-mailman3 Do you mean --force-reinstall? pip has no --force option. I *think* --force-reinstall will upgrade dependencies. Depending on your pip version, --upgrade alone may or may not upgrade dependences. Older versions of pip will, but newer versions, at least without --force-upgrade require --upgrade-strategy eager to update dependencies. > And how do I find out what is suppressing the logging for the social > accounts? That's a django-allauth question. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 3 months

[MM3-users] Re: templates

by Mark Sapiro

On 5/4/23 11:15, Christian via Mailman-users wrote: > In March when I started troubleshooting my lists, you stated: > > "Also, one other thing you might check. Do these non-working lists have > templates defined in postorius, in particular, one for > list:member:regular:footer, and if not, are there any in Mailman's > var/templates/lists/redlatinleg(a)lists.ccalternatives.org/ derectory that > Mailman doesn't have permission to find and read?" > > There are no other templates listed in either Postorius nor in Mailman's > var/templates (as I stated, I do not even lave a 'lists' subdirectory under > Mailman's var/templates). My subscribers are not receiving message > distributions from my lists, even while some of them are listed in the > archives. See the original thread at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… (which you hijacked about 4 messages in) and particularly the message at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… Without further information, I can't say more than that. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] How to limit numbers of outgoing emails per connection

by Alain D D Williams

Exim tells me "no immediate delivery: more than 30 messages received in one connection" The emails then sit in the exim queue until a queue runner kicks in - which happens once every 30 minutes. The result is considerable delays which makes list email conversations bouncy. Question: how do I tell MM3 to send no more than 30 emails in one connection to exim (via SMTP to localhost port 25) ? If that is not possible, how do I find the number that MM3 batches outgoing emails so that I can configure exim to match (as I did with MM2) ? I see documentation pages like the following. They are useless to me, incomprehensible without a lot of learning. I program in several languages but only a little Python. What I am looking for is a setting in a config file. https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/runners/do… -- Alain Williams Linux/GNU Consultant - Mail systems, Web sites, Networking, Programmer, IT Lecturer. +44 (0) 787 668 0256 https://www.phcomp.co.uk/ Parliament Hill Computers. Registration Information: https://www.phcomp.co.uk/Contact.html #include <std_disclaimer.h>

2 months, 2 weeks

[MM3-users] Re: MM2.1 -> MM3.3 migration. To hold or not hold

by mark＠suburbia.org.au

Once again, thanks for taking time to reply. Mark Sapiro wrote: > On 11/18/24 04:12, mark(a)suburbia.org.au wrote: > This should not happen. In the message as delivered to the list what do > you see in the X-Mailman-Rule-Misses: header and the > X-Mailman-Rule-Hits: header if any? ``` X-Mailman-Version: 3.3.8 X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address X-Mailman-Rule-Hits: member-moderation ``` > What if anything is in the lists Accept these non-members setting? Default action to take when a member posts to the list: Hold for moderation Default action to take when a non-member posts to the list: Hold for moderation Emergency Moderation: No Accept these non-members: (none listed) Hold these non-members: (none listed) If you would like me to enable debugging and do another test, I'm happy to. I will admit given the odd behaviour that there's a (small, unexpected) chance that there were settings changed or made during the process by another moderator, but that is not the belief at the moment. cheers, Mark

5 months

[MM3-users] Re: Editing templates from settings

by Abhilash Raj

On Tue, Sep 3, 2019, at 9:18 PM, paul(a)arenson.org wrote: > Hello again. > > Gradually coming along thanks to the help of other members. > > One thing I want to do is edit my headers or footers to have key info > about my site. But it seems even if I skip spaces, when a message is > received the spaces disappear. Likewise, is there any way to add basic > formatting like BOLD? > > For example, if I make a footer like this... > > Skipping a space here > __/__/__/__/__/_/__/__/__/__/ > Our List > _/__/__/__/__/_/__/__/__/__/ > Skipping a space here > > > ...the centering disappears, as do the > skipped spaces, meaning the message after a header or before a footer > looks cluttered, > > Is there a fix? Not yet, there is an open issue about it[1]. [1]: https://gitlab.com/mailman/postorius/issues/301 > > Thank you. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years, 7 months

[MM3-users] Re: If you delete a list but not the HyperKitty archive

by Mark Sapiro

On 1/4/22 6:45 AM, Philip Colmer wrote: > > So ... should the archive be deleted when the list is deleted and it is a > bug that it isn't? Or is it expected that access to the archive is "frozen" > once a list is deleted? It is often desired to have a public archive available after the corresponding list has been deleted. Even for a private archive, it may be desirable for site admins to have access. Furthermore, a list might not even have a HyperKitty archive in the first place. Thus, what to do about a HyperKitty archive (or prototype archive or ...) when a list is deleted is an administrative decision and is best left up to the site admins to do it or not. As you note with a private archive, former members no longer have access when the list is gone, but unless an attempt throws some uncaught exception, that is not a bug. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: How To Install Mailman 3 on Debian 10 (Complete Guide)

by Quanah Gibson-Mount

--On Wednesday, March 3, 2021 8:28 AM +0100 Lars Schimmer <l.schimmer(a)cgv.tugraz.at> wrote: > >>> Distribution packages tend to be useful for really basic things like >>> libraries. For constantly evolving projects where you need to be >>> current, they're more of a detriment. >> >> So much this. > > You do not need a bleeding edge software on production servers. You just > need bug free, whihc is easy done with packages on distributions, if > maintainers do it well enough. If you think the versions of software provided by distributions are bug free, you're living in a very bizarre realm that doesn't mirror reality. I've been running production systems for over 20 years for anything from private educational institutions to large scale multinationals. You don't get reliable production services running the ancient bug-ridden software provided from distributions. Anyhow, that's getting way off topic for this list. --Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

4 years, 1 month

[MM3-users] Re: Apple Mail encoding again

by Stephen J. Turnbull

tlhackque via Mailman-users writes: > Not that I count, but I'm not particularly sympathetic to this > either. In fact, you do count. If we can get a working consensus that Mailman shouldn't try to make up for MUA SNAFUs, no matter how many trillion dollars the manufacturer's stock is worth, life would be easier for us. ;-) > An up-to-date Thunderbird user - the message with the > "mail-with-defect.txt" attachment, as forwarded by [MME-users] (selected > headers below for ID) displays as blank. Interestingly, the Thunderbird > error console has no error message related to this. > > So there's really no point in passing it along, unless "pass these > defects" turns into "repair these defects". That's a Thunderbird problem, though, and nonconforming to the Postel Principle. > Assuming it's an origin issue, this really seems like an issue that can > only be fixed by the sending MUA (Apple). Obviously. > Note that MailMan is encapsulating a multipart/signed message in a > multipart/mixed in order to append it's footer, and reports that it > removed the signature part of the multipart/signed. This makes the > signed message format invalid. So at least, MM3 needs to handle signed > messages better: either include the signature or remove the signature > headers (an unwrapping exercise to convert the message to > unsigned)... For the former, we already try pretty hard to include the signature. At least on this list "Pass types" is multipart message/rfc822 text application/pgp-signature application/x-pkcs7-signature application/pkcs7-signature although I see Mark just added that last one or two. Of course, "x-" tokens are deprecated except for private use, maybe we should be unsympathetic to x-pkcs7-signature, too? :-) > Note that this can be recursive where a signed message contains a > message/rfc822 part that contains a signed message, that.... > > I'm not sure it makes sense to encrypt messages to a mailing list, Of course it does. Maybe not to a public discussion list, but for a closed group's distribution list, I'm sure there are applications. > but the format issue is the same. OK. > In either case, corrupting messages is a MM issue. I disagree, in part. Although you do address this, let me use the example of this case where the signed body is multipart/alternative. I think it's perfectly reasonable for a list to configure to remove the text/html part, which will break the signature. Then there are three possible ways to go: (1a) leave the signature in place, broken, thus informing recipients it was supposed to be signed and leaving it to them to follow up, (1b) to change the multipart/signed content-type to multipart/mixed and replace the signature with a "removed" notice, and (2) to remove the signature and multipart structure, leaving recipients unaware that the message was intended to be signed. Each of those is problematic, each in its own way. Supporting all of them and the list configuration infrastructure to allow admins to choose would be an unwarranted burden on us, IMO. > multipart/signed should imply accepting the signature part (in this > case, application/x-pkcs7-signature). If signatures aren't allowed by > policy, then multipart/signed should be bounced. I find it hard to believe that anyone would want a "deny signed bodies" policy, but it's easily implemented. Put multipart/signed in "Filter types". A configuration explicitly banning signature algorithms but not multipart/signed is a user error in that case. I guess I can imagine wanting to ban certain types (eg, known exploitable algorithms), and if one has such a use case and wants the message rejected rather than simply stripping the signature as unusable, "patches welcome" -- I can't see that level of care as worth our time, though. > It's also the case that if a signed message contains an banned part > type, simply removing it will break the signature. So in that > case, the choice would either be to bounce the message, convert the > message to unsigned, or accept the banned part. (The latter might > be acceptable in some environments, but has obvious risks.) > > Clearly, the current behavior is problematic. That's not obvious, except as it's cosmetic. > (I don't think it's reasonable to expect MM admins to "know" to > configure their lists to pass signature parts if accepting signed - > after all, this list is run by experts :-) I agree with that. It's not clear that we should do something about it, though. There are two possibilities: (1) the list admin doesn't care about signatures, and simply wanted to allow multimedia mail, and (2) the list admin wants to admit signatures on purpose, for some purpose. In case (1), this is mostly a cosmetic problem, and possibly involves minor annoyance. The signature validation will fail and maybe there's a text notice about removed parts, that's cosmetic. A subscriber who cares about the signature might have to contact the author for validation, that's the annoyance. In case (2), we do not know what the requirements are. We should refuse to guess and we can assume that list admin knows [more about what] she's doing [than we possibly can] and leave it up to her. If you think that we can know a lot about a very common use case in principle, I'd like to hear about it, but for now that's my stance, Steve

3 years

[MM3-users] Lessons learned and a couple little gotcha for newbies

by William Oliver

I just finished, with great help from Mark Sapiro on the list, a new installation of mailman3. I used the instructions at https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/insta… and https://docs.mailman3.org/en/latest/install/virtualenv.html There were a couple of gotchas that I didn't see well documented. 1) I got the error django.template.library.InvalidTemplateLibrary: Invalid template library specified. ImportError raised when trying to load 'hyperkitty.templatetags.decorate': cannot import name 'escape_html' from 'mistune.scanner' (/opt/mailman/venv/lib/python3.9/site- packages/mistune/scanner.py) when I ran 'mailman-web migrate' The fix was trivial: I just added the lines: from mistune.util import escape_html from mistune.util import escape_url to /opt/mailman/venv/lib/python3.9/site-packages/mistune/scanner.py It's not hard to search for those definitions, but if someone doesn't know a smattering of python, it might not be obvious. 2) Similarly, migrate (using postgres) also gave the error: File "/opt/mailman/venv/lib/python3.9/site- packages/django/db/backends/postgresql/utils.py", line 6, in utc_tzinfo_factory raise AssertionError("database connection isn't set to UTC") I was able to find a discusson of this one at https://stackoverflow.com/questions/68024060/assertionerror-database-connec… which had me downgrade to an older version of psycopg2-binary: pip install psycopg2-binary==2.8.6 There might be a different fix, but this worked. 3) When I ran the test "uwsgi --ini /etc/mailman3/uwsgi.ini" I got the error: ModuleNotFoundError: No module named 'settings' This was also trivially fixed by adding the path: export PYTHONPATH=$PYTHONPATH:/etc/mailman3 in /opt/mailman/.bashrc 4) Sometimes when I rebooted the machine, when I ran 'systemctl start mailman3' I'd get the error that mailman wouldn't start because the lock was stll there. I never could figure out where the lock was, so I worked around it by replacing ExecStart=/opt/mailman/venv/bin/mailman start with ExecStart=/opt/mailman/venv/bin/mailman start --force in /etc/systemd/system/mailman3.service I'm sure there's something bad about doing that, but it works for me, so far. 5) I had a problem with mail to outside people not being delivered while mail to the local host was delivered. It turned out that this was because in my mailman.cfg I had "smtp_host:my.listserver.tld when it should have been localhost. The error was "relay access denied." To fix this, I had to add my.listserver.tld to "mynetworks" in /etc/postfix/main.cf, ie change: mynetworks = 127.0.0.0/8 10.0.0.0/24 to mynetworks = 127.0.0.0/8 10.0.0.0/24 111.222.333.444 <--- my ip address However, Mark Sapiro (a God) told me this was because I had changed a line in the [mta] section of mailman.cfg. I had changed smtp_host: localhost to smtp_host: mydomain.tld Here's the thing. The reason I did this was because the instructions at https://docs.mailman3.org/en/latest/config-core.html give this as their model: [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: mail.example.com lmtp_port: 8024 smtp_host: mail.example.com <---- not localhost smtp_port: 25 The instructions are good, but there are a few places where one size does not fit all, I guess. 6) A second error in delivery to outside addresses resulted in an "Access denied" error. A search on the internet revealed that this had to do with (for me) smtpd_recipient_restrictions in postfix. See, for instance: https://know.mailsbestfriend.com/postfix_error_relay_access_denied_noqueue_… Changing this fixed things. I'm not sure, but I think this shows up mostly with installations that include dovecot. 7) If you are using virtual domains in postfix, you need to use the "unusual postfix configuration" in https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… virtual_alias_maps = hash:/path-to-mailman/var/data/postfix_vmap 8) You need to manually set the local virtual host for mailman3. Somehow, I got the impression from the installation instructions that this was done automagically to the default x.mydomain.tld if your domain is mydomain.tld. It doesn't. 9) Follow the instructions verbatim, and follow them in the order provided. I installed postfix and nginx out of order, and it did OK, but once you get into the python virtual environment, it is easy to miss something if you don't do it in order. 10) Jot down lots of notes. This is one of the more complicated installations I've done, mostly because it involved configuring a zillion packages to talk to each other: Postfix, nginx, postorius, hyperkitty, django, and others (I'd never heard of "whoosh" or "sass" for instance). All of these can be unforgiving with configuration errors. The default installation instructions assumed a number of packages I'd never used. I'm an apache/dovecot/mysql kind of person, and I had to switch to nginx/postgres to use the instructions as the written defaults. I'm sure I could have used apache and mysql, but it would mean trying to figure out what didn't work without following the installations verbatim. I'd never even heard of postorius, hyperkitty, or django. So, it was easy to get confused a bit. Taking notes of changes I made was important in being able to back out of disastrous choices. Plus, once I'd installed it on one machine, I sat down and installed it on another machine, and it was very useful to have written down how I fixed an issue when it came up again -- and I didn't remember exactly what I had done. 11) Make multiple sequential backups of configuration files. I went down a couple of paths I shouldn't have gone down. For instance, with the vmap issue, I got it in my head that it was a postfix configuration issue, not a mailman issue. So I kept changing things in postfix. Once I was told that it was in *mailman* I had to set the virtual host, I needed to back out of about 8 tweaks I'd made to main.cf in /etc/postfix. If I hadn't been making main.cf.backup.01, main.cf.backup.02, etc. I would have had to spend another few hours trying to remember what inappropriate changes I had made. This is particularly true for me because I am not a great typist, and when I try to retype something to back out, there's a reasonable chance I'll mistype something and it still won't work. With these backups, I don't have both manually back out of things *and* proof my typing again and again. It's a lot easier to delete backups once things are working than to try to remember what you did late at night after a couple of bourbons. 12) Choose one set of installation instructions and follow it. Don't try to mix instructions from different tutorials unless you really know what you are doing. I didn't. For instance, there's a different set of mailman3 installation instructions at: https://wiki.list.org/DOC/Howto_Install_Mailman3_On_Debian10 It does things a little differently. It's useful to look at that when you are debugging why something's not working, but you can get into some trouble trying to do both installations at the same time -- which I found myself doing when something wasn't working. It didn't help. billo

3 years, 3 months

[MM3-users] Re: SMTPAuthenticationError at /accounts/login/

by Mohsen Masoudfar

Hi Stephen, Thank you for the hint. I was focused too much on the documentation and was looking for the answer in the wrong place. Problem fixed. My problem started with "SMTP authentication not supported" and after fixing that, which was a Postfix parameter, I got this issue and was also looking in Postfix or Django configuration for the answer. This problem is solved and I wished there was a chance to update the documentation, so that these sort of information could be added in the documentation for other people who try to use mailman3. Thanks Mohsen -----Original Message----- From: Stephen J. Turnbull <turnbull.stephen.fw(a)u.tsukuba.ac.jp> Sent: Thursday, April 9, 2020 4:06 AM To: Mohsen Masoudfar <mmasoudf(a)aaas.org> Cc: mailman-users(a)mailman3.org Subject: [MM3-users] SMTPAuthenticationError at /accounts/login/ [EXTERNAL EMAIL] mmasoudf(a)aaas.org writes: > I have setup the stack according to: > Mailman Suite Documentation. Release 3.3 PDF file. > I configured > EMAIL_HOST_USER and > EMAIL_HOST_PASSWORD > in Django settings.py. I could not find the place that I might > configure it for Postfix I think it helps to start thinking about it from the other end. That is, Postfix is the mail server for all users on a multiuser system. Therefore in "normal" configurations it will use the authentication mechanisms provided by the host operating system.[1] You need to have a user for Mailman in any case, typically called "mailman" or "list".[2] Once you've configured a user for Mailman on the Postfix side, you use that user and authentication data for Mailman core, Postorius, and HyperKitty to send mail via Postfix. > I am running the site on AWS and to be able to use AWS mail-servers > I have to define following parameter for AWS: > smtp_sasl_password_maps which points to a hash for AWS 'ACCESS KEY > ID' and 'SECRET ACCESS KEY' I don't think that has anything to do with the Mailman-to-Postfix side of things; that's for Postfix to send to AWS's mail exchanger (aka MX). Steve Footnotes: [1] It may also be possible to create Postfix-only "virtual" users who have no existence as far as the OS is concerned, but I don't know anything about that. [2] I haven't thought carefully about whether using Mailman's user in Django would be a security risk, but as long as it only has access to Mailman I don't see how it can do more harm than Mailman itself can, and I don't see why it would be more subject to exploitation than Mailman itself is. Anybody with security chops who wants to weigh in, please do.

5 years

[MM3-users] Re: Newbie hyperkitty question

by David Newman

On Jan 11, 2022, at 09:08, Stephen Daniel <swd(a)pobox.com> wrote: > > > Thanks. So yes, I'm clearly running hyperkitty. Good to know. > > What is the archiver named "prototype" that is selected in the list options page? As you saw, that one stores messages under var/archives/prototype. It captures the entire message, including all headers, and is intended for use by an external archiver. Hyperkitty saves only the message_id, subject, date, in_reply_to, and sender info. That’s fine for most use cases, but if you want to extract some other detail from metadata — say, which mail client is most popular* — you’d need a complete set of headers. *Even then, the survey might be skewed, since not every client adds a header. > See screenshot below: > > > Would also like to know how I control archiving policy -- specifically how long archived entries are saved. I’m also a newbie here, and I don’t know. From what I’ve seen, nothing gets purged by default. I imported many lists from MM2.1 with archives going back many years, and they are all present. And there was this recent discussion on this list about this about purging older entries: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… One nice thing about Hyperkitty is that it’s a searchable archive, so useful for finding hints about the care and feeding of MM3 and its friends. dn > > >> On Tue, Jan 11, 2022 at 11:51 AM David Newman <dnewman(a)networktest.com> wrote: >> > On Jan 11, 2022, at 08:28, Stephen Daniel <swd(a)pobox.com> wrote: >> > >> > Mailman users -- >> > >> > I am setting up a new mailman3 installation, and this is my first >> > experience with the suite. All of the software is up and running, but I >> > cannot tell if hyperkitty is actually running. >> > >> > When I look at my test mailing list, two archive options are available, >> > hyperkitty and "prototype", and both are enabled. I can see that my email >> > is being archived, but I think "prototype" is what is doing the archiving. >> > I see that a test message will end up in >> > /opt/mailman/mm/var/archives/prototype/<LISTNAME>@<LISTDOMAIN.org>/new/164.... >> > and nowhere else. This suggests that "prototype" is archiving, but >> > hyperkitty is not. >> > >> > So, this opens up a raft of questions on hyperkitty: >> > >> > - How do I tell if hyperkitty is actually running? >> >> Is hyperkitty enabled? In the Postorious admin panel for your list page, check under Settings/Archiving. >> >> Generically, the URL for Hyperkitty archives is something like this: >> >> https://lists.domain.tld/archives/list/listname@lists.domain.tld/ >> >> When I’m logged in (which I needed to be to check settings), I see archives at that location. >> >> Also, your mailmanweb database should have a bunch of ‘hyperkitty_*’ tables. I’m not ssh’d in to a MM3 server right now but IIRC the messages go into the hyperkitty_email table. >> >> dn >> >> >> >> > - Does hyperkitty have a web-UI for admins or users? How would I access >> > it? >> > - I can not find any documentation on hyperkitty, other than >> > installation instructions and change logs. Does documentation exist? >> > - How do I set policies on how long archives are kept? >> > - Assuming I want to back up my archives, what do I need to back up? >> > >> > Thanks for your help! >> > >> > -- Stephen Daniel >> > _______________________________________________ >> > Mailman-users mailing list -- mailman-users(a)mailman3.org >> > To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Content-Type: image/png Name: image.png Replaced multipart/alternative part with first alternative.

3 years, 3 months

[MM3-users] Re: Mailman3 on FreeBSD

by John Poltorak

I'm following the official docs:- http://docs.mailman3.org/en/latest/prodsetup.html I'm trying to get it installed, 'pip3 mailman install works' but I don't know what to do after that. I haven't done anything with 'mailman.cfg' because I don't know what to do.and then I get errors when running 'mailman info' because of a missing '_sqlite3' module. On Fri, Aug 11, 2017 at 12:58 AM, Terri Oda <terri(a)toybox.ca> wrote: > I pinged a couple of friends who might have, but I don't know the answer. > Have you tried and gotten stuck, or just curious if it's been done? Because > I'm really curious myself now! As long as you can get the right versions of > python, it probably should work but that doesn't mean it does. > > Terri > > On August 9, 2017 10:08:05 AM PDT, John Poltorak <karotlopj(a)gmail.com> > wrote: >> >> Has anyone managed to install Mailman 3 on FreeBSD? >> ------------------------------ >> >> Mailman-users mailing list >> mailman-users(a)mailman3.org >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >> >>

7 years, 8 months

[MM3-users] Hyperkitty message threading

by andrew.bernard＠gmail.com

I am seeing some anomalies with message threading. without going into detail about the symptoms, first le me ask how does Hyperkitty thread messages? Is it based on the message-id in the header, guaranteed unique, or on the subject header? I appear to have a situation where people reply to a message, and then probably thinking to start a new thread, change the subject field., and them post. The message goes to the original thread. I cant stop people doing this as it seems the vast majority of people all over just hit reply for most things anyway as they are generally too lazy to start a new mail (drives me nuts). With this situation, where the subject has apparently been changed, Hyperkitty adds a not to the top of the post "New subject ...' which is what makes me think the message id is involved. Some of my subscribers say they do this all the time on the old Listserv mailing list and a new thread is started. Any help would be appreciated. It's difficult fro me to manually ressign the incorrectly threaded replies as there is no parent message to attach them to. Andrew

5 years, 9 months

[MM3-users] Re: Running mailman shell commands in a script

by Abhilash Raj

On Tue, Sep 14, 2021, at 4:57 AM, Eggert Ehmke via Mailman-users wrote: > Hello, I understand that the mailman shell is basically interactive. I need to > run some actions as adding and deleting users in a Linux shell script, or even > from another python program. How does that work? Check out mailman members, addmembers, delmembers, syncmembers commands[1] and see if they do what you are expecting the Mailman2 commands to do or you need something more. [1]: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/commands/d… If you are using another Python program, then you can rely on mailmanclient[2] python package for operations on lists and memberships using Mailman's REST API. [1]: https://pypi.org/project/mailmanclient/ > In fact, I miss the commands that were in the bin directory of the old > mailman2 installation. Wouldn't it be nice to add them again to mailman3? > > Cheers, Eggert > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

3 years, 7 months

[MM3-users] Re: If I manually add email addresses to a list and then delete them, how do i permanent delete them from Users?

by Mark Sapiro

On 4/25/23 6:59 AM, Mark Sapiro wrote: > On 4/25/23 3:02 AM, Andrew Hodgson wrote: >> >> You may find this script useful: >> https://www.msapiro.net/scripts/clean_users.py > > I will modify the script to enable deleting Mailman users with no > memberships even if they aren't Django users and post here when it's done. The script at https://www.msapiro.net/scripts/clean_users.py has been updated. As before, it has settings to control whether Django users are deleted if there is a corresponding Mailman user with no memberships or only if there is no corresponding Mailman user, and whether or not Mailman users with no memberships are deleted. The difference is when deleting Mailman users it will now delete Mailman users with no memberships whether or not there is a corresponding Django user. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: "held for moderation" - alias domain details sought

by Greg Newby

Thanks for this. After adding to "acceptable aliases," I also needed to add an entry in /etc/aliases, and then the moderation didn't happen. That's great! If I use an alias domain, will that replace the need for entries in /etc/aliases? I'm hesitant to explore since this is my production mail server. ~ Greg On Fri, Nov 1, 2024 at 1:51 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 11/1/24 11:14, Jeremy Stanley wrote: > > On 2024-11-01 11:04:07 -0700 (-0700), Greg Newby via Mailman-users wrote: > >> Hi friends. I've viewed this old thread: > >> > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… > >> and documentation here: > >> > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… > >> (and the Postfix docs it links to). Those documents don't seem to guide > my > >> situation, or maybe I just need a more specific example. > > > The alias domain discussed at > > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… > has nothing to do with what you are doing. > > > >> The problem is that when messages are delivered to the alias domain, > they > >> are held for moderation. I.e., mail to the alias domain like > >> testlist(a)domain.tld is held for moderation, but mail from the same > >> subscribed, non-moderated user to testlist(a)lists.domain.tld is posted > >> immediately without moderation. > > [...] > > > > I manage a similar setup (though with Exim instead of Postfix), and > > when migrating from Mailman v2 to v3 kept the same basic settings > > which seemed to work: notably, under Message Acceptance I set the > > alias addresses for the list in the Acceptable aliases field. If > > memory serves, not doing that caused messages addressed to those > > aliases to be unconditionally held for moderation. > > > This is the correct solution. Just add `testlist(a)domain.tld` to the > acceptable aliases setting of the `testlist(a)lists.domain.tld` list. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to gbnewby(a)petascale.org >

5 months, 2 weeks

[MM3-users] Re: Strange password problem

by Jens Günther

I do have the exact same situation. I would love to have domain owners be able to create/manage their own lists for their respected Domain. One problem I see with giving them site ownership: when creating a new list, not only that they could pick the wrong domain by accident, they also see all the other domains present in the installation. That would be a nogo, tehrefore we have to create the lists for all associations on our side. Kind regards, Jens. Am 23.09.23 um 20:42 schrieb Stephen J. Turnbull: > And how much does it cost you? It doesn't sound like you're ready to use > the feature at this point, but that often happens when users don't know > that there's a feature they could ask for. Is there real risk that > domain owners would abuse or mistakenly use site admin privileges on the > whole site or on someone else's domains? Are you currently hoping to > devolve domain administration to other individuals (now that you know > it's probably possible with improvements to Mailman)? Do you have > candidates for those domain owners in mind?

1 year, 6 months

[MM3-users] Re: Dump/restore users (with passwords) via API

by Abhilash Raj

On Mon, Sep 17, 2018, at 12:15 PM, Dmitry Makovey wrote: > We are trying to dump/restore users using API calls and it seems that > API allows us to dump password hashes (a good thing), but then API does > not allow to insert users back using saved password hashes - only > cleartext passwords. I'd say that is intentional. You don't want people to be setting up hashes as passwords. > Aside from create_user is there any other way to > create users/change their password? Not that I know of, not using the API atleast. You could potentially use the low level API that inserts records in the database or use SQL to dump and restore that data. What do you use the Core's user/password for? Currently, the user passwords are basically just a carry-over from Mailman2 and there shouldn't be any use for it. I have been considering removing that completely have Postorius do all the authentication/authorization. Email based authentication should rely on more reliable identities like email signatures, intead of having to send cleartext passwords over email. -- thanks, Abhilash Raj (maxking)

6 years, 7 months

[MM3-users] Re: very few moderation capabilities for moderators

by Guillermo Hernandez (Oldno7)

On 16/9/21 16:40, Mark Sapiro wrote: > On 9/16/21 2:39 AM, Guillermo Hernandez (Oldno7) via Mailman-users wrote: >> Hi all: >> >> I need to provide the list moderators a way to change the moderation >> flag for users from whichever it is (normally "list default >> processing") to "hold for moderation" and viceversa (to "list >> default" or to "accept") >> >> I understand that it could be done via console script (That's the way >> I did on mailman2: I made two commands using "withlist", one to hold, >> moderar.py, and other one to accept, desmoderar.py. I show you below) > > > Are you asking what the equivalent MM 3 scripts would be? > More or less: I'm asking for a general direction here. I think I cannot use tthe "withlist" method as before, inside a python script, and I'm not sure how to do it. I've been reviewing all the command docs that I've found, but I have no clear way. I need a shell or a python script that I can pass the list and the mail address to put on hold/hold (that way the moderators can log in a special account thhat asks for the address to hold/unhold). I did it in mailman2 whith the bin/withlist command, but now whithlist seems to be an alias for shell and is interactive.Thats not my goal) > >> But I think I'm not the only one that could use as an improvement a >> way to do this on postorius/web. > > > Postorius allows a list owner or site admin to set Moderation for list > members and non members at e.g. > https://www.example.com/mailman3/lists/list.example.com/members/(non)member/. Yes, I know that. But the owner cannot be 24/7 attending the lists (as we all know), and could need a help hand from moderators. Not just from accepting mails on hold, but to put on hold a member (and be capable of reversing it) when the netiquete dissapears completely and some thread becomes a flame and all goes south. I'ts the admin capability I miss the most for moderators in mailman. > Currently, a list moderator who is not an owner cannot do this, but a > moderator can set Moderation for the sender of a held post when > handling the post. But I'm talking about a moderator can put a member mails in hold when it is marked to accept. To prevent putting more gas in the fire. > >

3 years, 7 months

[MM3-users] is it possible to rebuild mailman-web database please?

by Stephen J. Turnbull

Giovanni Biscuolo writes: > After the upgrade I got this very same issue: > https://gitlab.com/mailman/hyperkitty/-/issues/328 Looking at the discussion in that issue, I wonder if there is a bug in sqlite3. The reference to 'hyperkitty_email__old' which apparently doesn't exist in the database or in Mailman migration code suggests that this is internal to sqlite3 when you do a schema change. You could try posting to sqlite3 channels. In general, this is NOT a Mailman problem, it's a database problem. We'll do what we can to help you, but we know a lot of Mailman and Python, and a little bit of SQL. If the database gets corrupted, database internals is not our area of expertise. FWIW, Postgres is currently the recommended RDBMS. MySQL/MariaDB are also usable, but it's somewhat fragile in its default configuration (I think one Mailman issue depending on implementation dependent behavior is now fixed and there's a workaround for MySQL's default refusal to handle emoji, but OS distributions are not necessarily up to date, and MySQL's history has been one thing after another for us). sqlite3 is supported primarily so Mailman unit tests don't depend on a separate full-scale RDBMS being installed. As far as I know it works fine within its limits, but I believe there are some limits that Mailman installations occasionally run into, and the full-scale databases perform better. I'm not saying "don't use sqlite3"; you have to consider whether you are likely to run into hard limits or performance issues, and that will probably never happen if you are running a couple of low-traffic lists. However, given that that your database is currently seriously damaged and may be irreparable (see below), it might be a good time to consider switching RDBMS and starting from scratch. You probably do have Postgres or MySQL (or the MariaDB variant) installed already, as many applications pull one or the other in. > Actually the django_site table is in the database so I can't understand > why of this message. One cause of this kind of situation is that there are several copies of the database lying around, and the database you found the table in is not the database HyperKitty is using. Even if there's only one copy visible on disk: if you have a process that attached to an old database file still running, that file could be deleted (ie, removed from the directory and marked for deletion) but the data will still be preserved and used by that process until the process is terminated. I think this is unlikely: database managers usually are quite protective of the files they use both as data and as they are managed by the OS, and I would think sqlite3 would notice if its database file were removed by another process. But the general principle stands: make sure all processes have been stopped, move any database files that aren't current somewhere Mailman can't find them (eg, removable media and remove it!), and restart the Mailman system. > Please is there a way to recreate the mailman-web database from > scratch or to fix this kind of problems? That depends. If you have a user base that has interacted with the web interface, creating users, authenticating email addresses, changing their profiles, then no, you can't recreate it from scratch. You lose all their authentication and profile data, although you might be able to get a mostly complete list of users and addresses from the subscription database in Mailman core. Otherwise, I would first dump the corrupted database to an SQL script to recreate the database, then reinstall HyperKitty, then find an SQL expert to help me figure out which parts of the SQL script are relevant, which are going to cause errors (eg, trying to create tables that already exist because of the installation process), and what I need to do by hand because it is part of the data that got corrupted. Mark may have other ideas, but he seems to have covered most of the possibilities in the issue #328 already.

4 years, 2 months

[MM3-users] Re: Various patches for mm3 stable 3.3.1

by Mark Sapiro

On 9/30/20 6:57 AM, Ruth Ivimey-Cook wrote: > > 1. If I do not set up 'individual' or 'full' personalisation, all is > well and the default footer templates are expanded as expected. However > setting up personalisation causes template expansion to fail > completely, and messages get sent with a blank expansion. Your mailman-debug.patch makes changes to mailman/handlers/decorate.py including wrapping all the relevant code in a try:/except: that logs any exception. If you set the level for logging.error to debug, what do you get in the log? This issue doesn't occur in the unpatched code on my servers - personalized footers work fine - so I think the problem must be something in your patch. > 2. I would find the postorius UI much easier to cope with if the > default template was 'populated' into the UI wherever it was non-blank, > rather than the UI starting off as if no templates were defined at all. This is <https://gitlab.com/mailman/postorius/-/issues/366>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 6 months

[MM3-users] Re: Gmail emails bouncing - anybody seen this problem?

by worik

When a outbound email bounces where is the carcass? Google is asking me for all the headers, and since this email bounced I do not have a handy copy. Worik On 12/02/19 11:25 AM, worik wrote: > Friends > > On a fresh install (docker) on a fresh VPS I am getting all Mailman > messages to Gmail addresses bouncing telling me I am sending too many > messages. Has anybody else have this problem? > > I am getting the following error in mail.log: "Our system has detected > an unusual rate of 550-5.7.1 unsolicited mail originating from your IP > address. To protect our 550-5.7.1 users from spam, mail sent from your > IP address has been blocked. 550-5.7.1 Please visit 550-5.7.1 > https://support.google.com/mail/?p=UnsolicitedIPError to review our 550 > 5.7.1 Bulk Email Senders Guidelines. l26si395949wme.8 - gsmtp" > > I have been to the URL mentioned and exhausted my options there. > > Worik > -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

6 years, 2 months

[MM3-users] Re: Adding / manipulating users

by Seth Seeger

> On Nov 18, 2019, at 2:28 PM, Mark Sapiro <mark(a)msapiro.net> wrote: > > On 11/18/19 6:15 AM, Seth Seeger wrote: >> >> My next question - I have two lists from Yahoo to import. I’ve migrated them through groups.io and have a convenient export. I now have all the data in formats I can handle. (json file for members, mbox for archives.) What’s the best way to import hundreds of users, setting their mail delivery status and moderation status at the same time? (There doesn’t seem to be a command line option for adding members anymore where you can also set their delivery status.) I’ve looked at the documentation, but couldn’t figure out what to do. > > > ... > > Alternatively, you could create a script that would post the appropriate > transactions to add a member and set moderation and delivery status to > Mailman's REST API and use that to process your members. Great! I can definitely do the REST API route. If I create a script to take a CSV and push it through the API, is there a place I can post it to make it useful for others? Seth

5 years, 5 months

[MM3-users] Re: share directories between postfix and mailman 3

by Mark Sapiro

On 1/23/24 12:30, Thomas Schachtner via Mailman-users wrote: > > > Mark Sapiro wrote: >> >> Why do you think Mailman needs the contents of the postfix >> configuration file.. I don't think so. > I thought so, as mailman does not start if there's not > /etc/postfix/main.cf file is there. > > The following messages are logged: > Jan 23 21:20:35 mailman mailman3[491404]: RuntimeError: command failure: > /usr/sbin/postmap /var/lib/mailman3/data/postfix_lmtp, 1, Operation not > permitted > Jan 23 21:20:35 mailman mailman3[491404]: command failure: > /usr/sbin/postmap /var/lib/mailman3/data/postfix_domains, 1, Operation > not permitted Mailman itself is not looking for Postfix main.cf, but when Pustfix is the MTA, it invokes the postmap command to create the .db files for postfix_lmtp and postfix_domains. Apparently postmap fails if there is not a Postfix main.cf. You can avoid this by using regexp tables instead of hash tables. See <https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h…>. >>> This seemed to work pretty fine, as all files and directories seemed >>> to be available, but when starting mailman 3, the following error >>> message was shown: >>> FileExistsError: A race condition might have happened. >>> /var/lib/mailman3 actually exists and is not a directory. >>> >>> Any idea why this message is shown? >> >> Possibly because the uid and gid of /var/lib/mailman3 on the postfix >> machine do not map to the appropriate Mailman uid and gid on the >> mailman machine. > You refer to the uid and gid of the "list" user? They are both 38 (uid > and gid) on both machines. > Then that isn't the reason. I don't know then why Mailman would complain that /var/lib/mailman3 actually exists and is not a directory. This message comes from mailman.utilities.filesystem.makedirs(). The code is at <https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/utilities/file…>. makedirs() calls first_inexistent_directory() which checks if the directory exists with os.path.isdir() which apparently says it isn't a directory which makes no sense unless there is an actual race condition and you are creating the /var/lib/mailman3 directory on the mailman machine at the same time as you are starting mailman. BTW, you say you are doing sshfs root@postfix.example.com:/var/lib/mailman3 /var/lib/mailman3 on the mailman machine. Presumably on the mailman machine /var/lib/mailman3 has lots of content. How does that work? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 3 months

[MM3-users] Re: Templates

by David Krantz

Hi. Ok, checking the source helped. So I answer my own question: > mailman shell Welcome to the GNU Mailman shell >>> tm = getUtility(ITemplateManager) >>> tm.set('list:member:regular:footer','mymaillist.example.com','file:///my_absolute_path/list:member:mymaillist.example.com:footer.txt') >>> commit() // David On Sat, Sep 23, 2017 at 1:17 PM, David Krantz <gazorg(a)gmail.com> wrote: > Hi. > > How do I set a template for one specific list? I want one list to have > a special footer template. > > I have tried updating the database (template table) without effect so > apparently the database is not used for templates or some kind of > fallback is used to set it to the generic footer. Of course I also > tried to restart mailman after that operation to try to rule out any > caching-related problem. > > I want to use a file://-path as that is the least painful way of doing > it. I also would like a solution to place a file in a special > location. My current templates are in a > > .../var/templates/site/en/ > > structure with names like list:member:generic:footer.txt > > Cheers > // David

7 years, 7 months

[MM3-users] Re: Problem with redirection when entering alias without a / at the end

by Mark Sapiro

On 3/19/21 2:55 PM, Jens Günther wrote: > > When I want to get to Mailman Starting Page now I need to Enter the > following URL: https://mailman.xyz.de/mailman3/ to be directly > redirected as expected to > https://mailman.xyz.de/mailman3/postorius/lists/ -> works. > > Problem: When leave out the slash at the end and I ONLY enter the > following URL: https://mailman.xyz.de/mailman3 -> then I'm wrongly > redirected to a page, taht does not exist: > https://mailman.xyz.de/mailman/postorius/lists/ -> 404 Huh? that is the same URL as the one above that you say works. Do you mean https://mailman.xyz.de/mailman/postorius/lists without the slash or what. > Where can I change this misbehaviour? In Apache-conf everything seems as > it'S in the docs, for the vHost I do not have any other custom settings. What is the exact content of your RedirectMatch or ReweriteRule or whatebver you are using? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 1 month

[MM3-users] Re: mailman3 not working for mailman21 lists

by Diana von Bidder

Hi Stephen Stephen J. Turnbull wrote: > Diana von Bidder writes: > >> I have several entries in /var/lib/mailman3/queue/shunt/ with >> Aug 21 timestamps, > > Evidence! Preserve it! > > You can look at those using "mailman qfile <file>" [..] These files looked pretty normal... >> and several entries in /var/lib/mailman3/queue/shunt/ with >> current timestamp (i.e. everytime I ls -l there is a new timestamp >> with the current time). > > I'm not sure what's going on with that. The point of the shunt > queue is that Mailman doesn't know what to do and it's putting the > messages there to wait for human intervention. So timestamps > shouldn't be changing. I just realised that I made a mistake here while typing: it should read "in ... out ...". > You can also try the "mailman unshunt" command (which takes no > further arguments). Then "mailman unshunt" just moves all the files > in "shunt" back to the queues they came from for normal processing. As I didn't want to spam the recipients of the mailinglist with a lot of testmails (once they all would be sent out), I created a tar.gz of all the files in shunt and out, then deleted all contents and resent a single new mail (also because in the meantime a mail to another old mailinglist just worked fine, so the problem seems to be connected to a specific list and not lists imported from mailman2 in general). What then happens is the following: 1) I see the connection in /var/log/mailman3/smtp.log and a bak-file in /var/lib/mailman3/in. 2) I see an ACCEPT in /var/log/mailman3/mailman.log and the bak-file in /var/lib/mailman3/pipeline 3) I get the following error once a second in /var/log/mailman3/mailman.log ------ Aug 29 11:35:06 2022 (936) HyperKitty failure on http://localhost/mailman3/hyperkitty/api/mailman/urls: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>404 Not Found</title> </head><body> <h1>Not Found</h1> <p>The requested URL was not found on this server.</p> <hr> <address>Apache/2.4.54 (Debian) Server at localhost Port 80</address> </body></html> (404) ------ and see the bak-file and a .pck.tmp-file in /var/lib/mailman3/out (always current timestamp). The files always vanish and reoccur with new names (I assume timestamps are part of the names). Doing a mailman qfile on the .pck.tmp file shows nothing special. Do you have any idea which configuration could cause this behaviour for this specific list but not for others? Regards Diana

2 years, 7 months

[MM3-users] Re: reason for breaching max_message_size is "N/A"

by Barry Warsaw

On May 01, 2017, at 08:05 PM, David Krantz wrote: >Today I learned to things: The default max_message_size is 40kB. >Messages larger than that are blocked (expected) with the reason "N/A" >(not expected). The reason would be helpful to me as admin. This would actually be a fairly easy fix. The MaximumSize rule in mailman/rules/max_size.py really just needs to set the msgdata's 'moderation_reason' key to whatever we want the text to read. >Also: Is there any way to set a server default for this as it is a bit >of a hassle to change it from the command line for each new list. I >can of course find where in the code to change but that seems the >wrong way to me. There's no server default, but the way to do it would be to create a style based on the legacy-default style which overrides the setting of mlist.max_message_size. There should be a way of doing this as a plugin site wide, without hacking the code, but I don't have the time to write up the details of that atm. -Barry

7 years, 11 months

[MM3-users] Re: Domain Resolving Issue

by Abhilash Raj

On Thu, Mar 7, 2019, at 11:36 AM, brian(a)emwd.com wrote: > I am running a Mailman 3 server with about 5 list domains configured on > it. Most of them resolve quickly both to Postorius and HyperKitty. > However there is one domain that resolves very slowly. Once it does, > access to other pages/tasks go quickly. If you don't do anything with > that domain in the browser after about 5 minutes, it takes its time > again to resolve. What could be causing this? The webserver is Nginx. > Not sure if this is a Mailman 3 issue or not. It is unlikely that this has anything to do with Mailman. The faster access after first time is probably due to local caching of DNS entries. Try checking your DNS servers for the domains and how long they take to respond. Your browser is probably just waiting more for DNS response. Mailman should be responding with similar lag for all the domains. > > Brian > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 1 month

[MM3-users] Re: Help with fresh debian install

by Stephen J. Turnbull

Jonas Meurer writes: > > This is the issue. I don't know how the Debian packages do this, but I > > recommend having a 'mailman' user that owns everything and running > > commands as that user. > > The Debian package uses user `list` for this. It also provides a command > `mailman-wrapper` which takes care of running mailman commands as this user. > > It would be awesome if the upstream /usr/bin/mailman command could take > care of this automatically, making the wrapper command obsolete. What precisely is "this"? We already have the mailman command; are you suggesting it should be suid/sgid mailman/list/whatever? That's pretty obviously a vulnerability. If there are any RCEs *anywhere* on your host, your Mailman is pwned. If you know your installation is secure enough or you just don't care, fine, chmod it yourself. If not, how do you propose upstream "take care of it?" Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

5 years, 6 months

[MM3-users] Re: What's the difference between (purpose of) reject and ignore

by Mark Sapiro

On 6/26/22 08:07, Andy Smith wrote: > > On Sun, Jun 26, 2022 at 12:37:05PM -0000, denis.bitouze(a)univ-littoral.fr wrote: > >> Just to be sure: for this feature, is it necessary to click on the >> subject and to choose in the drop-down list “Discard (no >> notification)”, or is it enough, on the .../held_messages page, to >> select the messages and click on “Discard”? > > Doing it from the held messages page will be a one-time thing; it is > only by clicking on the individual message that you can choose an action > for future messages from that address. In case the above is not clear, selecting the message and clicking Discard will only discard that message. To automatically discard all future messages from that sender, you need to set that (non-)member's moderation action to Discard which you can do by clicking on the subject and selecting the Discard moderation action from the dropdown list. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 9 months

[MM3-users] Re: Problem creating list members using REST API

by Stephen Daniel

The REST API documentation is a bit informal. As someone who is not familiar with mailman, and who doesn't know python, they are a bit of a slog. One day it would be nice to augment the documentation with a formal and complete reference document. Something like this one <https://infosight.hpe.com/InfoSight/media/cms/active/public/pubs_REST_API_R…>. A formal reference manual needs a complete listing of every type of object, all possible operations on each object, and all required and optional parameters. Since creating a formal document like that is probably out of scope, at a minimum it would be good to specify that boolean values are passed as JSON strings, not JSON booleans. It might be worth seeing if the code can be enhanced to allow the boolean values to be sent in using JSON booleans as well as JSON strings. Thanks again for the prompt response! -- Stephen On Tue, Jan 18, 2022 at 4:25 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 1/18/22 10:53 AM, Stephen Daniel wrote: > > 2nd follow-up. Apologies for spamming this list. > > > > I went wandering through the code as suggested by the traceback. I > > discovered that thee "as_boolean" routine is expecting a string argument > > but getting a boolean argument. > > > > So, If I send the booleans as strings, with values "true" or "false", all > > is well. > > This is not what the API documentation suggests I should do. Can someone > > either fix the documentation or the code? > > > Those snippets in the documentation are doctests. That code is actually > executed by unit testing and passes. In all those snippets, dump_json is > passing the second argument as `data` to > mailman.testing.documentation.dump_json() which in turn calls > mailman.testing.documentation.call_http() which calls > mailman.testing.helpers.call_api() which ultimately calls > requests.request() with the same `data` argument. > > So basically, the issue is the difference between how requests.request() > handles that `data` dictionary in creating the POST data and whatever > you are doing. > > Possibly we could add some caveat to > < > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/docum…> > > or possibly elsewhere. Do you have a suggestion as to what? > > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >

3 years, 3 months

[MM3-users] Re: Speed/progress of update_index_one_list?

by Stephen J. Turnbull

Philip Colmer writes: > I have now switched to Xapian but, in a way, my original questions still > stand. Is there a way of monitoring the progress of > "update_index_one_list"? What can I do to the specification of the server > to make that process go (much) faster? I see you've already gone to the Xapian lists, which I think is the right place to ask. We appreciate that! But I hope everyone will feel free to ask such questions here (just don't get too upset if we suggest going to the upstream channels in lieu of providing answers ourselves :-). If you do get an answer, feel free to bring it back and ask for Mailman automation for it (as a tracker issue, please, so it doesn't get lost). As I've mentioned before, it's That Time of Year when we start to prepare for GSoC. No guarantees and eventually the students choose their own projects, but suggestions are welcome. > By the way, just in case anyone else is looking to use Xapian, > installing and setting up Xapian for HyperKitty can be boiled down > to: Thanks for the hints! Steve

3 years, 3 months

[MM3-users] Re: Trying basic install of mailman3 in docker, but how do you set allowed hosts?

by Abhilash Raj

On Thu, Jul 8, 2021, at 12:23 PM, bob B wrote: > I am starting small, My goal is just to get mailman3 running in docker > and test the website access via curl from the host, then I will move > on from there > > In the docker instructions it says > > SERVE_FROM_DOMAIN: The domain name from which Django will be served. To > be added to ALLOWED_HOSTS in django settings. Default value is not set. > This also replaces Django's default example.com SITE and becomes the > default SITE (with SITE_ID=1). Perhaps that is my English there, but what it really meant to say was you should set "SERVE_FROM_DOMAIN" in your "environment" section of the docker-compose.yaml file and it will add the value of that variable to Django's ALLOWED_HOSTS settings for you [1]. If you think it could be re-worded for clarity, please feel free to let me know or open a PR in the Github repo. [1]: https://github.com/maxking/docker-mailman/blob/main/web/mailman-web/setting… Also, "localhost" is already added to the list of ALLOWED_HOSTS, so if you are able to point to the container using that, it should work without setting the SERVE_FROM_DOMAIN. Abhilash > But where do I set the ALLOWED_HOSTS I added this to the yaml file > - ALLOWED_HOSTS=127.0.0.1 under environments > > > mailman-web: > image: maxking/mailman-web:0.3 > container_name: mailman-web > hostname: mailman-web > depends_on: > - database > links: > - mailman-core:mailman-core > - database:database > volumes: > - /opt/mailman/web:/opt/mailman-web-data > environment: > - UWSGI_STATIC_MAP=/static=/opt/mailman-web-data/static > - ALLOWED_HOSTS=127.0.0.1 > - DATABASE_TYPE=postgres > - DATABASE_URL=postgres://mailman:mailmanpass@database/mailmandb > - SECRET_KEY=333blah-blah-secret > - HYPERKITTY_API_KEY=333someapikey > ports: > - "127.0.0.1:8000:8000" # HTTP > - "127.0.0.1:8080:8080" # uwsgi > networks: > mailman: > > > > But when I try: > [docker-mailman]# curl 127.0.0.1:8000 > <h1>Bad Request (400)</h1>[root@bmimailmandr1 docker-mailman]# > [root@bmimailmandr1 docker-mailman]# > > > > I see this in the logs > > [docker-mailman]# cat /opt/mailman/web/logs/mailmanweb.log > WARNING 2021-07-08 17:40:46,979 1642 django.request Bad Request: / > ERROR 2021-07-08 19:20:58,416 1641 django.security.DisallowedHost > Invalid HTTP_HOST header: '127.0.0.1:8000'. You may need to add > '127.0.0.1' to ALLOWED_HOSTS. > WARNING 2021-07-08 19:20:59,032 1641 django.request Bad Request: / > WARNING 2021-07-08 19:20:59,032 1641 django.request Bad Request: / > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

3 years, 9 months

[MM3-users] Re: Error 500 on held_messages page

by Mark Sapiro

On 2/3/22 08:01, Stephan Krinetzki wrote: > Hello all, > > we now have at least one mailing list (there may be more affected) that generates a 500 error when calling the held_messages page. After looking at the held messages via the mailman shell, we have identified three mails that have neither a subject nor a message body. How can we remove these three mails from the database? This shouldn't be an issue, at least with Mailman core 3.3.5, unless I don't understand. Note that there are 3 tables involved. The request (IListRequests), the pendings (IPended and IPendedKeyValue), and the held message (IMessageStore). > This is the mailman shell command we used: > > mailman shell -l listname(a)lists.example.com > <removed> > Welcome to the GNU Mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > Die Variable 'm' ist die listname(a)lists.example.com Mailingliste > >>> msg_db = getUtility(IMessageStore) > >>> req_db = IListRequests(m) > >>> reqs = list(req_db.held_requests) > >>> for req in reqs: > ... print('{}: {}'.format(req.id, req.request_type)) > ... > 32598: 1 > [...] > 107656: 1 > 107737: 1 > 107758: 1 OK, you have requests. > >>> from mailman.app.moderator import handle_message > >>> handle_message(m, 107758, Action.discard) > >>> reqs = list(req_db.held_requests) > >>> for req in reqs: > ... print('{}: {}'.format(req.id, req.request_type)) > ... > 32598: 1 > [...] > 107656: 1 > 107737: 1 OK, you discarded the message held with request id 107758. > >>> handle_message(m, 92927, Action.discard) > Traceback (most recent call last): > File "<console>", line 1, in <module> > File "/opt/mailman/mailman-venv/lib64/python3.6/site-packages/mailman/app/moderator.py", line 112, in handle_message > key, msgdata = requestdb.get_request(id) > TypeError: 'NoneType' object is not iterable > >>> There is no request with id 92927. Why do you think there should be? If by remove them from the database, you mean just from the messagestore, you can do (using your above) msg_db.delete_message('the_message_id') To delete a pending request for which there is no request id, e.g. the id 92927 above, you could do ``` pendings = getUtility(IPendings) for token, data in pendings.find(pend_type='held message'): if data and data['id'] == 92927: pendings.confirm(token, expunge=True) ``` Mailman core 3.3.5 has a lot of changes to address this issue. Also see https://gitlab.com/mailman/mailman/-/issues/946 -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 2 months

[MM3-users] Re: Anyone using Rspamd with Mailman 3?

by Philip Colmer

On Wed, 22 Sept 2021 at 10:14, Bjoern Franke via Mailman-users <mailman-users(a)mailman3.org> wrote: > > Hi, > > > > > I'm having a lot of trouble getting DKIM headers rewritten by Rspamd > > after Mailman 3 has altered the subject line and added the signature > > to the body and that, in turn, seems to then be causing Rspamd to not > > add the ARC headers. > > why don't you let Mailman3 do the DMARC mitigation? That is certainly an option. My main concern with this approach is that it needs to be configured on a per-list basis, as far as I can tell. My preference is to try and find an approach that works without modifying the settings per-list. I'll do some more testing with DMARC mitigation enabled to review the Rspamd logs under that scenario and see what breaks then. I'm starting to think that there might be a bug in Rspamd so my other next step is to revert to OpenDKIM for the DKIM headers and use Rspamd for the ARC headers (since I couldn't get OpenARC to work). Regards Philip

3 years, 7 months

[MM3-users] Re: Adding user - Error 409 Subscription request already pending

by Mark Sapiro

On 6/16/22 15:46, Dan Caballero wrote: > Which database table contains these pending subscriptions? I checked the "members" and "address" tables but no luck yet. > > I'm trying to help someone clear a few hundred of these. I can try writing a Python script to use the "hex_token" values in the Python dict. But maybe doing something via MySQL would be easier. The tables are `pended`, `pendedkeyvalue` and `workflowstate`, but don't do it via MySQL. A `mailman shell` interaction like this is better. ``` $ ./mailman shell -l list.example.com Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the list.example.com mailing list >>> util = getUtility(IPendings) >>> for token, data in util.find(mlist=m, pend_type='subscription'): ... if data.token_owner == 'subscriber': ... util.confirm(token, expunge=True) ... >>> commit() >>> ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 10 months

[MM3-users] Re: GDPR - save subscriptions confirmation emails

by contact＠maadix.net

Thanks Selva for you answer. In my Mailman 3 installation there is no /var/log/mailman/subscribe I have logs about confirmations emails in mailman/var/logs/smtp.log the format is the following: Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) handling connection Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'LHLO mails.example.com' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'MAIL FROM:<contact(a)maadix.net>' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) sender: contact(a)example.net Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'RCPT TO:<prueba-confirm+7c010b0d89513b26d72cb4642e80447a2280ac86(a)list.example.org>' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) recip: prueba-confirm+7c010b0d89513b26d72cb4642e80447a2280ac86(a)list.example.org Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'DATA' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'QUIT' So, one solution that comes to my mind is to grep this log file. This is not a perfect solution and the full confirmation email is still missing. I am not sure if this would be GDPR compliant. Maddish El 03/06/18 a las 18:17, Selva Nair escribió: > Hi, > > On Sun, Jun 3, 2018 at 10:12 AM, contact(a)maadix.net <contact(a)maadix.net> wrote: >> >> Hi, >> >> I am new in the list. I have been looking for this topic in the archives >> in order to avoid duplicate, but I could not find any thread. >> >> According to the new GDPR rules, lists owners need to have a >> confirmation from subscribers, and this is easy to do with Mailman 3. >> >> What I can't figure out is how to save all the confirmation emails >> received from users. >> >> I only see the confirmations commands emails in the logs, >> >> Is there another place/way to store them? > > We have been doing this with mailman2 since Canadian Anti-Spam Law (CASL) > got enacted (2014) by independently archiving the confirmation messages. > With postfix we use recipient_bcc_maps and a script to do some extra filtering > but its clunky, and does not check that the confirmation succeeded or not. > > A feature within mailman to archive successful confirmations would be > useful. Keeping unsubscribe requests and evidence of subsequent > actions also seems necessary at least as per CASL. > > That said, we also keep the /var/log/mailman/subscribe logs (not sure > what that would be in mailman 3). Although the log has a single line > for each action, it may be enough to show (?) that a double opt-in process > was properly followed or unsub request was acted up on. > > Thanks, > > Selva > -- Maadix *MaadiX* Tu nube en tus manos https://maadix.net https://twitter.com/MaadiXnet

6 years, 10 months

[MM3-users] Sending a message to a subscription applicant when a subscription request is made

by Allan Hansen

Dear Mailman 3 wizards, Our subscription process requires that the applicant answers a few questions and sends them to the list moderator. Not having a template that gets sent on all subscribe requests, I'm using the 'list:admin:action:subscribe' template. This gets sent to the list moderator, who then sends it forward to the applicant. This is rather tedious. I would like the template to be sent directly to the applicant. There is a template, 'list:user:action:subscribe' that almost does this, but it gets sent only if the email address of the applicant is unverified. A good number of our applicants are already on our lists, so they would not get this template if we set the Subscription Policy to 'Confirm, then moderate'. Our Subscription Policy is currently: 'Moderate' for all lists. I figure that three modifications can be used to fix this: a. That we change the lines in the Python program in our installation that send 'list:admin:action:subscribe' to the list admins to instead send the template to the applying subscriber. b. That we change the lines in the Python program in our installation that send 'list:user:action:subscribe' to the subscriber with an unverified address to always do this, even when the incoming address has already been verified. c. That the current 'list:user:action:subscribe' be changed in published Mailman 3 source to 'list:user:action:confirm' and a new template ''list:user:action:subscribe' be set up to be sent when any subscribe request is made. This is more work, of course, so not likely a good thing to hack locally. It could be useful to other users. Any suggestions on how to best and most quickly do the above would be appreciated, starting with (a.) or (b.). Clearly, (a.) and (b.), if we do one of those, are hacks that will need to be applied upon Mailman updates. That's fine by me, as I'm in rush to get this done. I'd welcome pointers as to which file to change and how. Of these two options, which would be the least work? (c.) could be entered as a longer-term enhancement request. I can submit that request if you like. Yours, Allan Hansen P.S.: Thank you for the enhancement that lets moderators see the member lists. It has been a big help for us. GNU Mailman 3.3.8 (Tom Sawyer) Python 3.9.2 (default, Feb 28 2021, 17:03:44) [GCC 10.2.1 20210110] config file: /opt/mailman/mm/mailman.cfg db url: postgresql://mailman:VWy26K4pUfU4jw@localhost/mailman devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:restpass

2 years

[MM3-users] Re: migrate MM3 list from an old server to a new one

by Mark Sapiro

On 8/6/24 01:43, noc(a)iem.at wrote: > > there *is* documentation about migrating MM2 to MM3; and my understanding is that `mailman-web migrate` can be used to upgrade a given MM3 instance to a new version. No. the mailman-web migrate command will apply relevant migrations for various django projects. You do need to rin it after upgrading things like hyperkitty, postorius and django-mailman3 and other dependencies which may have defined migrations for various database schema changes, but this will do nothing for your data. For that, you need to dump the mailman and mailmanweb databases on the old server and import them on the new server. > but how can i export an entire MM3 list (including 20 years of archives) to some serialization format, and import it again in another instance? With the dump and other utilities from your database manager. Almost everything is in the database. There are some things in Mailman's var/ directory, but those can simply be moved. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 months, 2 weeks

[MM3-users] Re: [Mailman-Developers] Mailman 3.1 beta coming soon

by Barry Warsaw

On Dec 09, 2016, at 09:37 AM, Mark Sapiro wrote: >I understand you need to feel comfortable about everything going into >the core and this takes time and energy to review all the MRs, but I >think it is pretty important to get the DMARC mitigations into the core. >If there's anything I can do to help with this, let me know. > >I will rebase my branch again and possibly make one minor tweak, but I >think it should be OK. Thanks for pushing back on this Mark. Obviously, I have a high degree of trust in your work, but yeah, my compulsive behavior is showing through. ;) Please do rebase and if you can, remilestone the MR to 3.1. We'll get it in. >I can also work on Postorius. Also in this vein I have a question. >Should the DMARC settings be added to the Alter Messages tab in the List >Settings view or would it be better to have a separate DMARC Mitigations >tab. My gut reaction is to add a separate DMARC Mitigations tab, but Florian and Terri have final say I think. Cheers, -Barry

8 years, 4 months

[MM3-users] Re: Can't remove footer(s)

by Mark Sapiro

On 10/11/2018 02:04 AM, Henrik Rasmussen wrote: > Mark Sapiro wrote: >> The templates named list_member_digest_footer.txt and >> list_member_regular_footer.txt (with underscores) were created by >> import21 and set as the URIs for those templates. Had you just copied >> /dev/null (or otherwise made empty) those files and done nothing else, >> that would have done what you wanted, but since you deleted the template >> URIs for the list, the template names are now the default > > How do I make these not default? You can set them via ITemplateManager. > Or when I upgrade to V3.2.2 will I be able to just empty the templates in /postorius/lists/LISTNAME/templates? You could except Postorius won't let you set an empty value for a template and deleting a template in Postorius just reverts to using the default - e.g., 'list:member:regular:footer'. What you need to do is copy /dev/null to files in (in your case) /opt/mailman/core/var/templates/lists/[LISTNAME_FQDN]/da/ named list:member:digest:footer.txt and list:member:regular:footer.txt. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 6 months

[MM3-users] Re: Mailman 3 Privacy Policies, GDPR, etc and social logins

by Jered Floyd

This was what I was using as well, but it failed to meet their requirements for some ineffable reason. I had a few back-and-forths with someone for whom English was not their first language, and got them to accept a slightly modified version that I posted at https://www.convivian.com/mailman-privacy.html Now, the latest is that I have a new message noting that apps requesting user data (e.g. email address) must be linked to Business Profiles (text below). Django-allauth is cool, but I think it's not going to be long for this world and we'll just have to do internal auth. Disappointing from a workflow perspective, but I'm happy to dissuade subscribers to not use Facebook. Regards, --Jered P.S. The fresh hell from Facebook: You are receiving this message because Mailman List Manager is not connected to a verified Meta Business Account. On Feb 1, 2023 Meta began requiring business verification for apps that request access to data from users (for some apps this is called advanced access). Learn more about this requirement. [https://developers.facebook.com/blog/post/2023/02/01/developer-platform-req…] Here’s what a person with full control of your Business Account needs to do by Feb 2, 2024 to maintain access: Connect the app to a Business Account, if you haven't already. Complete business verification for the Business Account. Business Accounts connect your Facebook Pages, Instagram accounts and the people who work on them, so you can manage them all in one place. ----- On Sep 19, 2023, at 5:00 PM, Mark Sapiro mark(a)msapiro.net wrote: > On 9/19/23 6:22 AM, Jered Floyd wrote: >> >> This is a bit of a headache. Do we have a draft of a community Privacy Policy >> for a vanilla Mailman 3 install that meets Facebook's requirements? Is this >> going to be a constantly unraveling thread of future GDPR and Right to Be >> Forgotten troubles, since there doesn't seem to be an easy way to scrub a >> subscriber from Hyperkitty archives if they request so? How have others >> addressed this situation? > > > I use https://www.list.org/privacy.html which appears to satisfy Facebook. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to jered(a)convivian.com

1 year, 6 months

[MM3-users] Re: How to promote non-members to members?

by Quanah Gibson-Mount

--On Tuesday, March 15, 2022 10:29 PM -0700 Mark Sapiro <mark(a)msapiro.net> wrote: > On 3/15/22 11:16, Quanah Gibson-Mount wrote: >> Hello, >> >> We have a constant issue with confirmation emails for subscribers >> getting lost and then the subscriber contacting us because their posts >> to the list never show up. Is there a way I can, as an administrator, >> do the confirmation on their behalf or in some other way promote them to >> being a member from non-member? > > See this thread > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/threa > d/MJOOH23W6EKZO7GI5HRDKB4S733JEEVG/ > > If they don't have an outstanding subscription waiting user confirmation, > you can just mass subscribe them. > > If they do and your Postorius and Mailman core is reasonably up to date, > you can find the pending request at Subscription requests -> Pending > Confirmation, delete it and then mass subscribe them. Hi Mark, Thanks for the response. Unfortunately I'm currently stuck with the junk shipped by Debian. Yet another reason to move to a standalone install and avoid their broken packages. Regards, Quanah

3 years, 1 month

[MM3-users] Re: list footer web customization procedure

by Mark Sapiro

On 12/8/21 6:05 PM, Philippe B wrote: > Update: After disabling the footer on a few lists (as described here a week ago), we started seeing "Cache content lost" in most (but not all) messages from those lists. > > In some cases, that phrase is an attachment to the "real" body of the message. In others, it's the opposite (which is more problematic for responding). That seems to depend on whether the poster sent in plain text. The difference between inline and attachment has to do with how footers are added. They are only added inline if the message after content filtering is a simple text/plain message. > One puzzling aspect is that it doesn't happen consistently. One hourly automated message will have it; but exactly the same message one hour later won't have it; but will have it again 3 hours later for example. > > Is that a known problem, or would it be possible to troubleshoot? Thanks. The issue may be a bug or a race condition. What is going on is the 'empty' footer you created in Postorius is retrieved from Postorius by a URL. In order to reduce the number of http transfers to retrieve such templates, they are cached in the local file system. Now, when we want a template that is accessed via a non-mailman: URI, we call the cache managers get() method at https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/model/cache.py… to get it. This should return either None if there's no cached file or the contents of the file, but if there is an entry but no corresponding file, it returns 'Cache content lost'. This could occur if some asynchronous process expunged the entry between getting the entry and getting the file. A process that could do that is the task runner that evicts expired cache entries. Look in your mailman.log. There will be `ACCEPT: <message_id>` entries for each accepted message and there will be hourly `Task runner evicted expired cache entries` entries. Do the ACCEPTs for the affected messages occur at the same time as the evictions? One way to avoid this is to not use Postorius to set the template but rather, create an empty `templates/lists/<list_id>/en/list:member:regular:footer.txt` in mailman's var/ directory for each such list and delete the Postorius templates. Of course, this is just a work around and not a solution to the issue. A proper fix is probably to implement a lock on the get(), evict(), evict_expired() and clear() methods so they can't execute concurrently. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Re: Installing mailman 3

by Rafael Mora

Nice! Up and running! How do I start using mailman? what are the steps?? REALLY thank you all for your patience and help! Really appreciated ! El vie., 21 jul. 2017 a las 18:48, Mark Sapiro (<mark(a)msapiro.net>) escribió: > On 07/21/2017 04:43 PM, Rafael Mora wrote: > > YEEEES! At last!!! I can see the web UI. > > > > Now I´m getting this message in the web UI: > > > > Something went wrong > > Mailman REST API not available. Please start Mailman core. > > > > > > > > Where do I configure the REST API ????? > > > So I guess you figured out that ALLOWED_HOSTS is a Django setting in > settings.py or wherever your Django settings are. > > Now you have to start Mailman Core. In your Python 3 'env' where you > installed Mailman Core, run 'bin/mailman start'. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Atentamente / Best Regards Ing. Rafael Mora

7 years, 9 months

[MM3-users] Re: nginx configuration on a multitasking server

by David Newman

On 12/23/21 9:18 AM, Mark Sapiro wrote: > However, that's not the issue. You originally reported and I didn't look > closely enough: > >> Update: The above worked fine until MM3 informed a list owner of >> pending subscription requests, with a URL like this: >> >> https://lists.example.com/mailman/admindb/listname >> >> and that URL returned a 404 error. > > > That URL is from a Mailman 2.1 installation. Are you still running > Mailman 2.1? I'm not, but that, and me not looking closely, was the problem. The system doesn't run MM2.1 any more, and no longer has it installed. But I failed to notice the dates on those 'admindb' messages: They were from the day of the upgrade, about 30 minutes before decommissioning MM2.1. And the docs do say explicitly to deal with any pending tasks before doing a cutover. The task-pending message that MM3 sends to list owners and moderators just says generically to check the dashboard, without providing a URL. Can that be modified to provide an explicit URL, something like this? https://lists.example.com/mailman3/lists/listname Thanks again for spotting this. dn

3 years, 4 months

[MM3-users] Re: Can't Start Mailman3 Core on Fresh Install

by Mark Sapiro

On 7/21/22 10:09, Jonathan Green wrote: > I've triple checked the password in mailman.cfg and used the same > username/password directly in MySQL and was able to get to the mailman3 > database. I did run a test script in python3 using the PyMySQL connector > and got the same error. Is there some permissions issue I need to look for? > I ran the install as user root - perhaps the user running the python script > doesn't have access somehow? First, your primary support resource for the Debian/Ubuntu packages should be Debian. That said, the database access credentials are also configured in the DATABASES setting in your Django settings, although your OP indicates this error is in core. I'm not sure what running the install as `root` will do in the Debian/Ubuntu package, but with that package, the user that needs to access things is `list` and all the Mailman processes should run as `list`. Did your test script do pymysql.connect(user='list', ...)? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 9 months

[MM3-users] Re: Table 'mailmansuite.django_q_ormq' doesn't exist ("Delete this thread" -> 'HTTP-500 -> NoneType' object has no attribute 'all')

by Mark Sapiro

On 05/29/2017 02:16 PM, Simon Liebold via Mailman-users wrote: > > Now, I get to see the confirmation view and upon confirming I see these > (luckily different) errors like below (same with Django 1.10): > > Could not delete message P2GJLK4JPDU2K6ZKBSDUWASF2TVHCJTT: (1146, "Table > 'mailmansuite.django_q_ormq' doesn't exist") > Could not delete message 4I2TRZTFXMMH2XRQAS73IAEIYROFE5YM: (1146, "Table > 'mailmansuite.django_q_ormq' doesn't exist") > > True, this table doesn't exist in the database. It isn't created by > python manage.py migrate. > > The error is served with HTTP-200. No stack trace in mailmansuite.log. Do you have django_q in INSTALLED_APPLICATIONS in your Django config and do you have # # Asynchronous tasks # Q_CLUSTER = { 'timeout': 300, 'save_limit': 100, 'orm': 'default', } in your Django config and are you running django-admin qcluster at startup? See <https://mail.python.org/pipermail/mailman-developers/2017-May/026064.html>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 10 months

[MM3-users] Re: Moderating posts via email

by Abhilash Raj

On Thu, Oct 26, 2017, at 03:01 PM, Dmitry Makovey wrote: > On 10/26/2017 02:59 PM, Abhilash Raj wrote: > > Given how emails are not so good at being secret, I'd not advise using > > it despite it's current state. Although, if it is a feature, it should > > work regardless! > > agreed. but how do I strip that from the message sent to user since > instructions are hardcoded into chains/hold.py ? I am not sure of any easy way to do without patching the source itself. You can however modify the 'list:admin:action:post' template for the list with instructions to advise against using the "Approved" feature (regarless of what the text below/above says). I understand that it probably is going to confuse a lot of people, but I am just throwing out ideas to add a band-aid for the bug. Again, I am not sure this feature if broken, I haven't tested it. It might be worth opening issue in Core though. > > > -- > Sr System and DevOps Engineer SoM IRT > > Email had 1 attachment: > + signature.asc > 1k (application/pgp-signature) -- Abhilash Raj maxking(a)asynchronous.in

7 years, 5 months

[MM3-users] Re: uncaught bounce messages

by Mark Sapiro

On 10/26/21 8:18 AM, Seth Seeger wrote: > > I have just upgraded to 3.3.4 from 3.3.2 (via docker). > > Do we need to do anything more than reset the delivery status? I am getting (seemingly) continual emails about bounces. I keep running the recipe in the link which resets everyone's delivery status. I've grep'd one member's address out of bounce.log (see below my signature). > > Is it just catching up on old bounces? There is no significant change in bounce processing from 3.3.2 to 3.3.4 If you really upgraded from 3.3.2, I don't know what would be responsible. On the other hand, it looks like you may in fact have upgraded from Mailman < 3.3.1 in which case, those are old, previously unprocessed bounces, and your log certainly looks like that. If you think some or all users shouldn't have had delivery disabled, you can run the mailman shell seccion in the post at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… to re-enable them and let current bounce processing handle the truly undeliverable ones. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: How can I remove anything added by Mailman 3 to the forwarded email

by Mark Sapiro

On 5/9/22 06:00, gscaglia(a)ksdata.it wrote: > I need to use Mailman 3 exclusively for forwarding emails to my customers divided by type. > > The emails must arrive exactly as they are, without any additions, and the lists are managed only by me: the customer ignores that he is subscribed to a list and receives the message as if it were one to one. > > How can I remove anything added by Mailman 3 to the forwarded message, therefore also the links for managing my membership (unsubscribe and modify)? In Postorius do the following: In Templates set list:member:regular:footer empty In Settings: in List Identity set Subject prefix empty in Alter Messages set Personalize None Filter content No Anonymous list No Include RFC2369 headers No Include the list post header No First strip reply to No Reply goes to list No Munging in DMARC Mitigations set DMARC mitigation action No DMARC mitigations in Archiving set Archive policy Do not archive this list -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 11 months

[MM3-users] Re: Installing mailman 3

by Rafael Mora

This my settings.py email config: #DEFAULT_FROM_EMAIL = 'postorius(a)localhost.local' # If you enable email reporting for error messages, this is where those emails # will appear to be coming from. Make sure you set a valid domain name, # otherwise the emails may get rejected. # https://docs.djangoproject.com/en/1.8/ref/settings/#std:setting-SERVER_EMAIL # SERVER_EMAIL = 'root(a)your-domain.org' SERVER_EMAIL = 'root(a)localhost.local' # Change this when you have a real email backend # EMAIL_BACKEND = 'django.core.mail.backends.console.EmailBackend' EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'localhost' EMAIL_PORT = 25 EMAIL_HOST_USER = '' EMAIL_HOST_PASSWORD = '' EMAIL_USE_TLS = False DEFAULT_FROM_EMAIL = 'Mailing <mailing(a)labbrands.com>' El mar., 1 ago. 2017 a las 23:18, Mark Sapiro (<mark(a)msapiro.net>) escribió: > On 08/01/2017 02:40 PM, Rafael Mora wrote: > > Why isn't it sending emails? > > > > What do you think? > > > What exactly are you doing that you think should result in sent mail? > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Atentamente / Best Regards Ing. Rafael Mora

7 years, 8 months

[MM3-users] Re: Mailman not able to process "big" requests

by Mark Sapiro

On 04/24/2018 12:36 AM, Abhilash Raj wrote: > On Mon, Apr 23, 2018, at 10:41 PM, Jonas Felber wrote: >> We also have a problem with sending out emails to "large" (>50) groups, >> as they seem to not getting sent out at all. Do you have any idea what >> the problem here could be? > > Which MTA are you using? What do you see in mailman's logs and MTA's logs? > > I haven't seen this kind of problem before with Mailman 3. This very list is hosted using Mailman 3 and I believe has more than 50 subscribers. Nor have I seen this issue. This list currently has 158 non-digest members. There are several @python.org Mailman 3 lists with over 100 non-digest members including the active yt-users(a)python.org list with 301 members, and I have gotten no reports of an issue like this. Also, there are over 600 lists at <https://lists.fedoraproject.org/>, and I don't think this is an issue there either. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 11 months

[MM3-users] Re: Mailman - delete or backup old archived messages

by Mark Sapiro

On 6/17/21 1:00 AM, olenkoigetublim(a)gmail.com wrote: > > I have been using Mailman-Suite (Hyperkitty + Postorius) quite a long time now and now i was wondering if there is any way to erase or export old archived messages and back them up elsewhere (for example messages, that are older then 1 year). Didnt find any suitable option under "python3 manage.py" command and also didnt find any up to date post which related to mailman3 and python3. There isn't currently anything to do this but is shouldn't be difficult to create a script. You'd need to import the Email class from hyperkitty.models.email, set CUTOFF to a datetime.datetime instance with the cutoff date instantiate a mbox to receive the deleted messages and then do something like for email in Email.objects.filter(date<CUTOFF): msg = email.as_message() mbox.add(msg) email.delete() A lot of required housekeeping such as importing django and calling django.setup(), exception handling and reporting would need to be added to the above, but the basic loop should work. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] at the finish line of mailman3 docker, but can't sign in.

by bob B

I am trying to setup mailman3 in docker and have some questions, I can see the finish line :) i hope. I start my images and I can access the web,http://Servername.domain.com/postorius/lists/ and no list are there of course, but How do i sign in? I click the forget link and I have to enter in a email address. I put in the email address I added to the docker-compose.yaml but that does not wrok. I have these setup in the .yaml file. MAILMAN_ADMIN_USER: The username for the admin user to be created by default. MAILMAN_ADMIN_EMAIL: The email for the admin user to be created by default. I found this url http://Servername.domain.com/admin/login However I never set a password and here is no forget button, Basically once I have docker installed, and mailman3 up and no lists are available, How do I setup or/and sign in as admin? Also In docker how can I test sending mail? the command "mailman-web sendtestemail youremailid@domain" from the mailman-web container does not work. How can I make sure my containers can send and receive mail?

3 years, 8 months

[MM3-users] Re: Mailman3 not working following distribution upgrade from Debian 10 to 11.

by gordon＠dickens.com

I agree that this is a Debian packaging issue and I agree with Mark that the underlying issue is the "sed:" error message. I have only had one reply to my Debian bug report. That reply told me what I had to do make apt-get usable again (since it was stuck on the mailman3 error) but that post did not address the "sed:" bug itself and nobody else has responded to the bug report. So, it looks like I am on my own as far as my Debian mailman3 installation is concerned. So, here is what I plan to do: 1) apt-get remove mailman3 mailman3-web mailman3-full. This should not remove any configuration data or database files but I will run "apt-get --dry-run remove" first just to make sure. 2) Install mailman3 using the venv and web instructions as suggested in this thread. I plan to use mysql (mariadb) since my database was originally implemented with mysql. 3) I will poach as much of the configuration data as I can find from my original Debian mailman3 installation. Thanks to everyone for your support and replys! Gordon

3 years, 3 months

[MM3-users] Re: Phantom Email Address in Nonmember List

by Steve Brown

Mark Sapiro wrote: > The senders are defined as addresses in the headers listed in > the configuration setting sender_headers, default = from, from_ > meaning envelope sender, reply-to and sender. See > <https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/config/schema.…> This was very useful in explaining why MM3 (3.3.9) accepted the problem post and attributed it to my address, even when seeing the bounce+ address as a different sender. Thank you for taking the time to reply. > Are you saying that the bounce+... address ends up as a nonmember of > the list you are sending to. I don't think that should happen. Yes, that is what is happening, but only for messages from the steve@stevebrown address. I can send a screenshot and a .txt of the headers (of the message after sent back to me from MM3 and long!) but didn't see a way to do that on the archive page. Do I need to post from my gmail address? One clue I hadn't spotted before was a bodyhash_mismatch warning in the headers. No idea where that came from. Doesn't appear in emails from me to other addresses. Steve

7 months

[MM3-users] Using as a forum

by tokyoprogressive＠mailbox.org

Our group of 30 plus people have the perennial problem in MM II of not checking previous messages before replying. A second problem is starting a new topic rather than responding to a message in the same topic, which makes searching even harder. I previously suggested a forum or something like Stack or Flock. People had no interest in a Word Press forum yet moan about the inefficiency of a list, also it is something new and involves leaving email. Stack and Flock make it hard to require all to be a member of all topics in their free versions. Then it occurred to me, the threaded view in Mailman III looks good and could help us nudge people back on topic. Am I being too optimistic. It is a closed group only open to people we approve. I would like to migrate to MM III but lack the technical skills to fo this? Anyone who could do this for a fee? We probably do not need to bring in the old topics. (I guess there us no way like a forum to limit the topics but at least we could keep things on track). Thanks Paul Arenson Japan Association for Language Teaching Sent from my iPhone

6 years, 7 months

[MM3-users] Re: [MM3-users]Exim, Mailman3 and missing Message-ID:

by Mark Sapiro

Rob's reply in this thread was garbled due to <https://gitlab.com/mailman/mailman/issues/616>. The text of the reply is quoted below. On 7/27/19 12:54 AM, Rob Lister wrote: > > One thing that does occur to me is that my exim header fudge will > probably cause the Message-ID header to move around from its original > position, and if someone is doing hashing or actually validating (gpg > signing?) the headers haven't been tampered with, then it might > complain, since although the message-id hasn't changed, it might be in a > different place in the headers. > > Then again, mailman can make plenty of other modifications and additions > to the headers anyway, so I'm not sure it matters. > > Probably the more correct way to do it is only add a new header if it's > missing, and if it's there, leave it alone. > > This is probably possible in exim with some more variables and a lot of > nested curly braces... -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 8 months

[MM3-users] Re: Change delivery_status in bulk

by Hitashi mancho

Thanks, Mark, for the reply. The mailman shell interaction worked for me. Thanks again for your help. On Fri, Apr 4, 2025 at 8:25 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 4/3/25 19:36, Hitashi mancho via Mailman-users wrote: > > > > Now, I am unable to locate any command or an API call through which I can > > change the delivery_status back to enabled for 1000+ users. > > > > Can you please guide me on how I can do this programmatically using cli > (I > > will write a bash script) or using an API call? > > > See the post at > > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > for a mailman shell interaction to do this. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at: > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > This message sent to huhamails(a)gmail.com >

2 weeks, 6 days

[MM3-users] Re: Postorius is not working (throws "Error 500" suddenly after changing POSTORIUS_TEMPLATE_BASE_URL and changing back)

by Stephen J. Turnbull

Wikinaut writes: > I fully understand. Need to look up how to smoothly backup the > mailman3 settings and list databases in order to make that move > with losing stuff... (kinda "mailman3 backup all" and mailman3 > restore all" :-) One piece of generic Python advice: don't mix OS packages and pip (except for Python itself). Always use a venv if you need to use pip for packages that aren't in your OS distro. (Of course it's possible to do so in many cases if you *really* know what you're doing, but it's almost never worth the pain.) All of the site configuration data should be in /etc/mailman3 (except for a few template files in $var_dir/templates), and all of the domain, list configuration, and archive data is in the RDBMS (usually PostgreSQL or MySQL). The RDMBS should be backed up regularly according to its procedures, but that's completely out of scope for Mailman.[1] The RDBMS should "just work" with exactly the same Mailman-side configuration as Debian.[2] As I think Odhiambo mentioned, the Mailman side of the site configuration also does not change (for example, the RDBMS URL and authentication). What you do want to change is the file system configuration. Except for /etc/mailman3, it should be completely different -- as with pip'ing packages, you don't want to share files across a local venv and the OS version of the same package. It just leads to pain. I think among the developers the preferred root = /opt/mailman (or /opt/mailman3) for Mailman's directory hierarchy. This will be populated with subdirectories when you run `mailman info` (or start Mailman) the first time. The directories relevant to configuration are all under $root/var, and you inform Mailman about this by setting `var_dir` in mailman.cfg. If there are other file and directory configurations in mailman.cfg, they need to changed from the Debian values (probably /var/lib/mailman3/...). You may do fine by simply deleting all other directory configurations and let Mailman decide where to put them relative to the `var_dir`, You will need to fix the setting for STATIC_ROOT (I think that's the name, if not search for "static") in settings.py, and maybe in mailman-web.cfg. While it's not necessary (and may be a little inconvenient), I recommend changing the root for Mailman's log files from the Debian value (probably /var/log/mailman3) to the Mailman default of $root/var/logs, and similarly for the Django logs in settings.py. Non-Mailman settings I think you will need to change the settings for your MTA (usually Postfix or Exim4) so that it will recognize Mailman lists and route them to Mailman correctly. There will probably be mailman-related files in /etc/$MTA/conf.d (or something like that). You can edit them directly, but I recommend changing the name (paranoia so that dpkg doesn't overwrite them). The only thing I can think of for the webserver (Apache?) is the location of the static directory. I think Debian uses uwsgi by default so you may need to adjust its configuration too. I think you need to fix logrotate's configuration in /etc/logrotate.d. Not sure how many mailman-related config files are in there. I think you mentioned systemd .service files. If so that doesn't make sense to me -- Debian should provide those. You need to make sure those are disabled or deleted so that Debian Mailman services don't start on reboot. This is automatic if you delete the Debian packages, of course, but not for any files you created yourself. Probably the Debian .service files will work, but you need to make sure they refer to the venv Mailman (using the full path to the `mailman` utility in the venv's bin directory will work, and similarly for `mailman-web`). systemd does not configure the /opt hierarchy in it search path by default. I put the mailman, qcluster, and gunicorn (if you use that instead of uwsgi) .service files in /usr/local/lib/systemd/system, and that works for me. Flotsam and jetsam If you have run Mailman with any success at all, you may find some stuff in Debian's $var_dir/queue/* directories or in its $var_dir/lists/* directories. The queue/* directories contain incoming messages at various stages of processing, and the lists/* directories contain files containing multiple messages that are scheduled to be sent out as digests. You can read the queue files with `mailman qfile /path/to/queue/file.pck`, and the digests are just text files. That way you can check if there's anything important in them. If not, you can just delete them. If there is, you can just copy them to the same place in the venv $var_dir as they were in Debian's $var_dir, but you may want to ask here first before doing that. It's best to let Mailman run until all the queues are cleared (except maybe bad and shunt, but if those have any files in them you need to intervene anyway). Afterword I'm sure this sounds complicated, but in fact it's a pretty short list. When you get there we'll help you. Footnotes: [1] But not for this list. You may as well ask here, somebody probably will tell you the basics quickly. But for troubleshooting, go the the RDBMS's own channels. [2] In fact, it is possible to keep the Debian installation, copy the the mailman.cfg somewhere, edit it, stop Debian Mailman, and start up the venv Mailman. I don't recommend this -- the point is that the venv and the databases are that isolated from the rest of the system.

1 year, 6 months

[MM3-users] Re: Changing subscription address

by Allan Hansen

Hi Steve, My comments below: On 3/15/21, 21:28 , "Stephen J. Turnbull" <turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: >I don't have the Postorius knowledge to do this in a reasonable amount >of time to help your user immediately, but how about this design: < >In the 'Mailman Settings' screen, List-based Preferences' tab, You may mean the 'Subscriptions' tab. >currently each list has an active link at the list's posting address >(which links to a page with the same options carefully documented), a >plain text display of the subscribed address, and a row of options. >Suppose we > >1. Add a popup menu of addresses and attach it to the > displayed address for each subscription, >2. Add a 'select subscription' checkbox to each subscription. >3. Add an 'act on all selected subscriptions' fake subscription, > whose checkbox has the effect of select or deselect all. I guess > this should be at the top.[1] > >Does that seem like what you have in mind? Any other needs you want >to mention? (Suggestions for feature design are welcome, but "I do >this often and there's got to be a better way" is good too.) The above will work fine, Steve, as it will cover the special needs of people who have several addresses that they use for different lists. It's very flexible. For the other 99% of my users, something much simpler is needed: Under 'User profile for <name>', under the 'E-mail Addresses', add button to ensure that 'Primary E-mail' is used for all lists. Then they can 'Create account' if needed. 'Add E-mail'. 'Make Primary' the new e-mail. 'Use Primary For All Lists'. 'Remove' the old e-mail. This requires them to set up an account, but I'm OK with asking them to do that. And, indeed, new subscriptions should default to 'Use Primary.' That would be fine, but it can be even simpler, which I would much prefer: Instead of the 'Use Primary For All Lists', may I suggest a tool that lets me set all subscriptions to 'Use Primarry' where there either is no account or where the primary e-mail is already chosen as the subscription address (which together form the 99% I mentioned). In that case, the procedure becomes much easier for me to explain to them, and no new functionality needs to be added (although what you suggested is fine). 'Create account' If needed. 'Add E-mail'. 'Make Primary'. "Remove' old email. Is that possible now? Does a member have to have an account for me to set it up thus for them? Thank you for considering this, Steven. Yours, Allan

4 years, 1 month

[MM3-users] Re: # comment allowed in a template file?

by Mark Sapiro

On 7/24/20 3:19 AM, skenny(a)scss.tcd.ie wrote: > > I'm running Mailman 3 in maxking's Docker container. I'm also using Puppet to do as much configuration as possible, so I'd like to add a comment to the file that reads something like: > # This file is managed by Puppet. > > Is it ok to do this? I may not have searched the docs enough, but I couldn't find anything relating to comments. If you mean can you add a '#' line that won't be part of the actual rendered template, the answer is No. > One other observation in case it's any use: Initially, I created the template files with owner set to "root". This resulted in postings to lists getting stuck in mailman-core. It's vital that these files are owned by user "mailman". Once I changed the owner of the file to the latter, everything worked. I don't think they need to be owned by 'mailman' as long as they are readable by 'mailman' -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 8 months

[MM3-users] Re: Virtual alias + shell

by Mark Sapiro

On 5/26/23 4:36 AM, alopez(a)ac.upc.edu wrote: > Hello, > I want to have a mailman configured together with virtual alias. To do that I need to use alias_domain. > I have tried to do it with mailman shell. The domain seams to be created but when I leave the shell and enter again, the domain is not longer there. Because you are leaving mailman shell with exit() which doesn't commit changes. You deed to either explicitly commit with `commit()` or exit with control-D. Recent mailman shell will report in its banner Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. > On the other hand, If I create a domain in administrator interface, it is not listed in the shell. If I create in the web interface, which field correspond to the alias_domain : Domain Name, Display Name , Mail domain? Your Postorius is too old to support alias_domain, and your Mailman core may be too - requires core >= 3.2.0. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 10 months

[MM3-users] Basic settings for a discussion list

by paul＠arenson.org

Over the last 20 hours I have been trying to figure out setup for list members to sign up. One person has kindly helped out, though I am still unsure of the difference between the several signups. That thread is here and I welcome more advice. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… But it occurs to me that my problem is that I have not actually configured my list. So this thread is for help on that. I have found a guide for general users here: http://docs.mailman3.org/en/latest/userguide.html But I have only found a highly technical guide for administrators here: https://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclien… It is written for coders and I am looking for a guide similar to the one for users. It seems not to exist yet. WHAT I WANT Discussion only list. Ideally anyone who signs up via the various ways should be able to get the archives and post via email and the interface if they want. The list should be closed to others. In the absence of any guide, all I can do is cross check with you guys and hope I am on the right track. I am non technical, although I managed a Mailman 2 list without difficulty. 1) FIRST ANOMALY Under https://list.tokyoprogressive.org/postorius/accounts/subscriptions/ I see myself twice: List Name Subscription Address Delivery Mode Role discuss.list.tokyoprogressive.org paul(a)tokyoprogressive.org None member discuss.list.tokyoprogressive.org paul(a)tokyoprogressive.org regular owner Is this correct? I added My name in one field somewhere and this is the result. I even got a welcome message. I think it is because I subscribed to my own list.If this was not necessary, what should I do? Global based preferences are listed. Address and email based ones are not showing either enabled or disabled. 2) MANAGE LISTS For myself I have done the following in my MAILING LIST SETTINGS Subscribe to this list My email and name (Maybe that is why i am listed twice) Now I see 3) Users For now only me- I am listed as member and owner. There will be no other moderators or owners I have no idea what a non member is (if they register aren't they a member?) 4) Templates This is showing nothing at this point. Before it was. I am not sure what i did to stop it from showing. Perhaps because I made it a private list? 5) Settings a) List identity I have it set for NOT SHOWING on the Index page because I will link to it from my news magazine website as a way to comment on articles. Is this ok? Other data will be filled in later. I think I am confusing this with private list. I also will have no other list. b) AUTO RESPOND LIST OWNER-- I added a short note thanking people. Respond and Continue Processing c) AUTO RESPOND POSTER--Your message has been been received. If you are a member, it should be posted soon. Respond and Continue Processing d) AUTO RESPOND REQUESTS--No auto response OTHER THINGS DEFAULT e) URL WELCOME MESSAGE--NOT SURE. I want people to subscribe themselves but I also have 500 people from another list from DADA I will import. I want them automatically be able to post. Is it possible? If so, I hope to add them manually. DO I compose a text on my website and welcome them by adding the URL, or enter it in my list? f) NOTIFY OF MEMBERSHIP CHANGES--Yes g) ALTER MESSAGES ---I have left most things as they are. However, as this is a discussion list, I want replies ONLY to go to the list. I chose that. h) DMARC --I have left as is i) DIGEST--I have left as is 6) MASS OPERATIONS--I have left as is 7) BAN--left as is 8) MESSAGE ACCEPTANCE--I have left as is 9) HEADER FILTERS--left as is 10) ARCHIVES--Private Archives (Maybe this is why templates do not show???) 11) SUBSCRIPTION POLICY--MODERATE-- I intend to send them an email to confirm their reasons for subscribing to avoid spammers. LAST THING. My Gravity does not work. I edited it online as per instructions but it does not appear. That is all I can think of. Thanks in advance. paul

5 years, 7 months

[MM3-users] Re: how to administrate mailman3 in CLI ?

by testeur

Hi, I try to find documentation and examples to manage mailman3 with "mailman shell". By example, when i tryied just to define global configuration for all users, like in this example ( https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… ), but it changes nothing : |# mailman shell -l testlist(a)domain.tld | ||>>> from mailman.interfaces.action import Action >>> for mbr in m.members.members: mbr.moderation_action = Action.defer |||commit()| |||>>> from mailman.interfaces.action import Action |||||||>>> english = getUtility(ILanguageManager).get('en')| >>> for mbr in m.members.members: || mbr.preferences.acknowledge_posts = False mbr.preferences.delivery_mode = DeliveryMode.regular mbr.preferences.delivery_status = DeliveryStatus.enabled mbr.preferences.hide_address = False mbr.preferences.preferred_language = english mbr.preferences.receive_list_copy = False mbr.preferences.receive_own_postings = True|commit()|| Before the shell command, the web interface was with an other language (i tested with italian one) and other options preferences, but after the shell command, after a web interface refresh, it doesn't change. am i wrong somewhere ? Regards, On 16/09/2023 23:05, Stephen J. Turnbull wrote: > Hi > > testeur via Mailman-users writes: > > > I have installed mailman3 and i want to administrate it with rest > > api, > > Do you really mean REST API, or do you mean CLI? > > > i tryied with curl to manage it, i can see if there is a pending > > message with : > > > > curl --user restadmin:restpass > >http://localhost:8001/3.1/lists/ml@domain.tld/held/count|| python3 -m > > json.tool| > > This is a lot easier using "mailman shell" if you want to use CLI, or > a Python program using mailmanclient if you really want to use the > REST API for some reason. > > This is explained here: > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/model/docs… > but it's likely to be pretty rough going for you because it's really > oriented to programmers studying to be Mailman developers, not for > admins. > > > but how to delete all held messages ? is it possible in one time ? > > No, you need to fetch the list and then loop over the messages. > > > And how to select a specific message to discard /accept / defer ? > > > > do i have to use a POST ? > > This is all explained here: > https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… > > Steve > > _______________________________________________ > Mailman-users mailing list --mailman-users(a)mailman3.org > To unsubscribe send an email tomailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at:https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/mess… > > This message sent totesteur(a)starinux.org

1 year, 7 months

[MM3-users] Re: Extracting mailing list users

by Eggert Ehmke

Am Montag, 2. Januar 2023, 02:40:58 CET schrieb Mark Sapiro: > Understood, but there are a couple of things at work here. One is that > this particular task is a one-off the correct the result of a bug, but > perhaps more significantly, mailman developers (at least me) are > comfortable with `withlist` (it's been around since MM 2.1) and if I can > do it that way, it reduces the motivation to make something more > friendly for the normal admin. Unfortunately doing things easily that > way requires a lot of specialized knowledge of Mailman internals, so > most admins need help with it. Mark, I completely understand your situation as a core developer with limited time and lots of requests from all directions. Being a Python programmer myself, I would be happy with a consistent documentation of the relevant Python classes to be able to develop own applications. The isolated code snippets in the mm3 documentation are not too helpful. Such a documentation would possibly remove some of the workload you feel by constantly answering admin questions.´ When you look at the documentation of the Qt library you know what I mean. Thank you again for this great project! Cheers, Eggert

2 years, 3 months

[MM3-users] Re: Correcting name spellings in a list

by Mark Sapiro

On 2/23/21 9:40 PM, Morris Jones wrote: > I typo'd some full names in a mailing list. I want to correct them ... > > I can't see a way to do that in the Member Options, so I thought I'd try > "remove" and re-add, either from the command line or the UI. > > But the name gets readded with the typo intact. :( > > Is there a way to fix it without writing SQL? You can do it with mailman shell. The basic issue is the display name is a property of the user or the user's address, which ever is subscribed to the list. When you add a previously unknown user to a list, Mailman creates these user and address records, but they belong to the user, not the list. There are some threads around this at <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…>, <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…> and a somewhat protracted one at <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Re: Installation Questions [Installation}

by Gerald Vogt

Hi, On 04.11.24 02:06, Mark Sapiro wrote: > On 11/3/24 11:31, Arte Chambers via Mailman-users wrote: > We should probably cover this in the docs, but for /etc/mailman3, you > should do > ``` > sudo mkdir /etc/mailman3 > sudo chown mailman:mailman /etc/mailman3 > sudo chmod 755 /etc/mailman3 > ``` > Then you can create all the subordinate files as the mailman user. For > other things like the systemd service and the postfix and web server > configs, you need to do them as root (via sudo). is it really necessary that the mailman user can write that directory? For most services, directories and files in /etc/ may be readable for the service but usually not writable as you don't want the service itself change it's core configuration. On your server it looks like this: # ls -la /etc/mailman3 total 28 drwxr-xr-x. 2 root mailman 95 Oct 25 08:12 . drwxr-xr-x. 99 root root 8192 Oct 29 07:42 .. -rw-r--r--. 1 root mailman 266 Oct 25 07:37 gunicorn.conf -rw-r-----. 1 root mailman 92 Nov 21 2023 mailman-hyperkitty.cfg -rw-r-----. 1 root mailman 797 Sep 9 11:20 mailman.cfg -rw-r-----. 1 root mailman 3015 Oct 25 08:12 settings.py and it works just fine. Regards, Gerald

5 months, 2 weeks

[MM3-users] Re: Hipperkitty failing to archive messages in a list

by Guillermo Hernandez (Oldno7)

On 5/1/22 21:50, Mark Sapiro wrote: First, thanks a lot Mark for your guidance. >> >> HINT: Configure the DEFAULT_AUTO_FIELD setting or the >> SocialAccountConfig.default_auto_field attribute to point to a >> subclass of AutoField, e.g. 'django.db.models.BigAutoField'. > > This is from Django >=3.2 can be fixed by adding > > DEFAULT_AUTO_FIELD = 'django.db.models.AutoField' > > to your settings. This has been done in HyperKitty's > example_project/settings.py for the not yet released 1.3.6 version. > > These warnings are only warnings, they aren't fatal. I thought so. I've added it in the settings.py file. In the last part of your suggestions you wrote: "I suggest you do pip install --upgrade hyperkitty mailman-hyperkitty and ensure it installs hyperkitty 1.3.5 and mailman-hyperkitty 1.2.0" But this is exactly what made me fall in this mess: I realized that the versions of hiperkitty and mailman-hiperkitty in that server were outdated.. and I tried update them separately, forgetting the saying "if it works, don't touch it" (si funciona, no lo toques). In my first message I listed the versions of all the items, but to refresh it, as they are now: (from pip list) ... gunicorn 20.1.0 HyperKitty 1.3.5 ... mailman 3.3.5 mailman-hyperkitty 1.2.0 mailmanclient 3.3.3 ... mistune 2.0.1 ... mod-wsgi 4.7.1 ... postorius 1.3.6 (end of pip list) I did the upgrade of all of it. The "migration" process output the same warning as before about to doing a "makemigration" (I did not this time) Thinking that the problem in the "migrate" and "makemigration" process could be that I touched the mistune/scanner.py to add escape and escape_html imports, I deleted that two lines. Then all went bad: the postorius list page didn't show anymore. The error.log form the apache server shows django.template.library.InvalidTemplateLibrary: Invalid template library specified. ImportError raised when trying to load 'hyperkitty.templatetags.decorate': cannot import name 'escape_html' from 'mistune.scanner' (/usr/local/lib/python3.7/site-packages/mistune/scanner.py) So I tried to put them back (but I had problems with, I believe, the __pychache__). I had to reinstall mistune and write back this lines that I found in a previous thread from William Oliver last 12/28/21 I've finally came back to administering the lists via postorius. I created a new list to do the tests without disturbing the rest. And now I am at the exact same point: No message is archived and the log shows: ERROR 2022-01-06 12:38:45,574 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-01-06 12:38:45,586 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-01-06 12:38:45,801 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-01-06 12:38:45,832 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-01-06 12:38:45,847 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-01-06 12:38:45,867 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. ERROR 2022-01-06 12:38:46,075 39059 hyperkitty.views.mailman The MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. As this server has very low traffic, the emails are distributing well, and the only thing that fails is the archiving of new messages, I will wait until a more complete upgrading process is needed for mailman, postorius or hiperkitty. Thanks, again, for your support. P.S.: One thing that make me curious is the "mistune" package... I don't see it installed in the other servers that are working flawlessly with mailman3. > > ... >> Running a 'su -m mailman3 -c "python3 manage.py makemigrations" shows >> the same warning listed before and some new errors: >> >> *-*-*-*-*-*-* >> >> Migrations for 'postorius': >> /usr/local/lib/python3.7/site-packages/postorius/migrations/0017_alter_emailtemplate_name.py >> >> - Alter field name on emailtemplate >> Traceback (most recent call last): >> File "manage.py", line 10, in <module> >> execute_from_command_line(sys.argv) >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/__init__.py", >> line 419, in execute_from_command_line >> utility.execute() >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/__init__.py", >> line 413, in execute >> self.fetch_command(subcommand).run_from_argv(self.argv) >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/base.py", >> line 354, in run_from_argv >> self.execute(*args, **cmd_options) >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/base.py", >> line 398, in execute >> output = self.handle(*args, **options) >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/base.py", >> line 89, in wrapped >> res = handle_func(*args, **kwargs) >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/commands/makemigrations.py", >> line 190, in handle >> self.write_migration_files(changes) >> File >> "/usr/local/lib/python3.7/site-packages/django/core/management/commands/makemigrations.py", >> line 228, in write_migration_files >> with open(writer.path, "w", encoding='utf-8') as fh: >> PermissionError: [Errno 13] Permission denied: >> '/usr/local/lib/python3.7/site-packages/postorius/migrations/0017_alter_emailtemplate_name.py' >> >> >> *-*-*-*-*-*-* >> >> The file >> '/usr/local/lib/python3.7/site-packages/postorius/migrations/0017_alter_emailtemplate_name.py' >> does not exist at all > > > makemigrations is trying to create that migration and you don't have > permission to create the file. I don't know why it's trying to do > that. Postorius 1.3.6 has migrations through > 0016_auto_20210810_2157.py and shouldn't need more. To you have > modificationd to Postorius? > > >> Despite the error, I did a 'su -m mailman3 -c "python3 manage.py >> compress"' and the subsequent "django-admin compilemessages" in >> >> /usr/local/lib/python3.7/site-packages/postorius, ../hyperkitty and >> ../django_mailman3 >> >> And the log continues showing the same error when trying archive a >> new message. >> >> ERROR 2022-01-05 12:27:31,406 6988 hyperkitty.views.mailman The >> MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. >> ERROR 2022-01-05 12:27:31,418 6988 hyperkitty.views.mailman The >> MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. >> ERROR 2022-01-05 12:27:31,685 6988 hyperkitty.views.mailman The >> MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. >> ERROR 2022-01-05 12:27:32,045 6988 hyperkitty.views.mailman The >> MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. >> ERROR 2022-01-05 12:27:32,070 6988 hyperkitty.views.mailman The >> MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. >> ERROR 2022-01-05 12:27:32,093 6988 hyperkitty.views.mailman The >> MAILMAN_ARCHIVER_KEY was not sent as the Authorization HTTP header. > > > These messages come from some HyperKitty version between commit > b415d29d6cc59b3270c35b03ba3313dd03450271 Mon Jun 21 00:11:48 2021 > -0700 and > commit c6272f3ef8375865382d0741d3d371a0dc41508a Fri Oct 8 06:32:06 > 2021 +0000 > > They do not come from HyperKitty 1.3.5 but from something later than > 1.3.4 which makes be think your mailman-hyperkitty version is not > 1.2.0 either. > > I suggest you do > > pip install --upgrade hyperkitty mailman-hyperkitty > > and ensure it installs hyperkitty 1.3.5 and mailman-hyperkitty 1.2.0 > > -- ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Content-Type: image/png Name: firma-GHP-emails.png Replaced multipart/alternative part with first alternative.

3 years, 3 months

[MM3-users] Re: SMTPSenderRefused - howto enable STARTTLS for local mail drop

by Mark Sapiro

On 12/6/21 2:51 AM, Stefan Bauer wrote: > Need to bring this up again. Django now sends with STARTTLS, but mailman > itself, does still only drop mails in cleartext. > Dec 6 11:47:33 al01 postfix/lmtp[7598]: A6422600510: > to=<remote-party@remote>, relay=127.0.0.1[127.0.0.1]:8024, delay=0.01, > delays=0.01/0/0/0.01, dsn=2.0.0, status=sent (250 Ok) > Dec 6 11:47:33 al01 postfix/qmgr[29156]: A6422600510: removed > Dec 6 11:47:35 al01 postfix/smtpd[8092]: disconnect from localhost[::1] > ehlo=1 mail=2 rcpt=2 data=2 commands=7 > > No starttls=1 at all :( > > Does the above settings work for anyone? > > etc/mailman3/mailman.cfg > [mta] > incoming: mailman.mta.postfix.LMTP > outgoing: mailman.mta.deliver.deliver > > smtp_host: localhost > smtp_port: 25 > smtp_user: > smtp_pass: > smtp_verify_hostname: false > smtp_verify_cert: false > smtp_secure_mode: starttls This should work. What do you see in Mailman's smtp.log if you add ``` [logging.smtp] level: debug ``` to mailman.cfg. However, do you really need this. It will only affect delivery from Mailman to Postfix via the loopback interface on the localhost. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Re: spanish localization

by Mark Sapiro

On 2/12/21 3:21 AM, Victoriano Giralt wrote: > > I just wanted to make visible that the .mo files were a "bit old". For > example, Guillermo, in this thread, pointed that the Spanish > translation was quite compelte. Actualy, I spent some hours bringing > them to 100% around Christmas. But, the .mo file for es from the pip > install --update i did recently is dated November 7th. I have > definitely added a lot of translated material from then until the end > of the year. Why do you say the .mo files are old. The timestamps are all Feb 3 02:47 which is when the package was built for PyPI. > I know the translation happens outside the development community. I > tried to point that there might be some synchronisation problem, so to > say, between the translation site and the packaging of the latest > mailman release. When things are changed on weblate, we get automatically generated merge requests to update our source. We don't always merge them immediately, but we certainly do merge all the outstanding ones before making a release. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Issues with international characters (replaced by ?) when mail is send as text/html

by Michal Soltys

Hi, I have noticed that any mail send with text/html, e.g. with following headers: Content-Language: en-US-large Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit is slightly transformed by mailman3 - the body is put into its own part, but all the international letters are replaced by question marks. Having searched the list I tried: 1) adding following to mailman.cfg: [language.master] description: English (USA) charset: utf-8 enabled: yes [language.en] description: English (USA) utf8 charset: utf-8 enabled: yes 2) changing preferred language of a mailing list to something else via shell, e.g.: m.preferred_language = 'pl' 3) changed default_language to 'pl' in mailman.cfg 4) Ensured all relevant glibc locales are generated (not sure if that matters though in this case) None of this seems to have any positive result - all mails, whether under 'pl' or 'en' setting still get all non-ascii chars replaced with question marks (in html case, probably(?) in any case where it becomes multipart). Any ideas what to do so html mails are passed without filtering out their characters ? Do I have to recreate all mailing lists under new [language.en/master] settings ?

3 years, 3 months

[MM3-users] Re: MM3 not processing some mails from specific user

by Stephen J. Turnbull

Stefan Bauer writes: > thank you. Funny. All problematic mails are in the shunt-queue from one > specific user. That's good news (given that things aren't working), something in there will show us why. > the mailman-logs did not log anything helpful. I thought they should ... not your problem, I'll check and let you know if there's someplace else you should look. > What do you recommend to find the needle in the haystack? I mean, what can > cause mailman to fail processing? Most frequently the issue is a non-ASCII character in the header. A frequent cause is spam filters and virus checkers quoting non-ASCII text in their reports in the header. Nonconforming dates can cause problems for some applications (specifically those that work with list archives), but I don't think they should cause non-delivery, and the date in the sample message is conformant. You could try running "mailman unshunt", which may produce a helpful error message if for some reason it can't do so. Also check for logs that were updated at that time, which might identify a log with some useful information. Steve

2 years, 8 months

[MM3-users] Re: So near, and yet so far (Configuring Mailman)

by Mark Sapiro

On 1/29/21 3:52 PM, Jack Lenox via Mailman-users wrote: > > Good news everyone! I've got it working. It turns out my issue was with > the mynetwork IP settings in my Postfix config. Things do now appear to > be working. Good. Thanks for the update. > My only remaining issue is that the posts aren't appearing > in the archive. Hmm. If you want our help with that, tell us if you have any non-default [archiver.*] settings in mailman.cfg and what the list's Settings -> Archiving settings are. If you are expecting HyperKitty archiving, are messages remaining queued in Mailman's var/archives/hyperkitty/spool/ directory and if so, what kind of errors do you see in Django's log? Does the value for MAILMAN_ARCHIVER_KEY in your Django settings match the api_key in the [general] section of the mailman-hyperkitty.cfg (or whatever you call it), quoted in MAILMAN_ARCHIVER_KEY but not in api_key, and is the base_url setting in the [general] section of the mailman-hyperkitty.cfg a URL that can actually access hyperkitty? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] moving lists to another server

by Stephen J. Turnbull

bryan.kartzman(a)yu.edu writes: > I have both my mailman lists and django config in postgres > databases. These are Mailman 3 lists? What Django config? Do you mean Postorius and HyperKitty? Do you intend to use Postorius and HyperKitty on the new server? > If I want to move my lists to another server that is running > mailman 3, aside from copying the databases to the other server, Do you mean the other server is already actively distributing Mailman list traffic, managing users and archives? Or is it fresh instance? > what other things (perhaps all files under /var/lib/mailman3?, etc) > would I need to bring over to the other server? That's going to vary depending on the way your existing server is set up. A Mailman 3 instance is a complex system of cooperating applications. Assuming you have not patched or added any Python code, typical configuration and customizations include 1. Your webserver (Apache, nginx are most common) needs configuration to handle WSGI applications and may need modules enabled or installed for the WSGI server. This is usually installed as an OS distro package, and the configurations will live in /etc/apache2 or similar for another webserver. Depending on other content served by the two hosts you may have to edit the configuration on the new host rather than copy it from the old one. 2. The WSGI server is typically a separate application, although there is an Apache module for this. Gunicorn is a Python application usually installed via pip. I like to keep its Django configuration, which I call gunicorn.conf.py, in /etc/mailman3. (Mailman core also uses gunicorn, but that is transparent to you, it should not need custom configuration.) uwsgi is a C or C++ application normally supplied as a distro package. Don't know where it keeps its config files but since it's a distro package my first guess is /etc/uwsgi. 3. Your MTA, usually Postfix or Exim4, maybe Sendmail or qmail needs to be configured to route mail to Mailman, and apply any milters, signatures, and perhaps anti-yahoo configurations such as ARC. 4. Your database server, usually PostgreSQL or MySQL. 5. Mailman core has a single configuration file mailman.cfg, which I keep in /etc/mailman3. It also has a crontab, which in Debian- derived systems typically lives in the file /etc/cron.d/mailman3. Note that this could be implmented as a systemd timer, but I don't know if any distros do that. 6. Django, Postorius, and HyperKitty together constitute the mailman-web subsystem. I strongly recommend you use the mailmanweb Python package to manage Django and its applications. In any case I am not familiar with other organizations of those packages, so I'm going to assume it. If you are not using mailmanweb, you will need to be careful because most subpackages in the Django subsystem name their configuration files settings.py, urls.py, and views.py just like top-level, and distinguish them by using Python's attribute notation (eg, postorius.urls). a. Django application configuration for Postorius and HyperKitty goes in settings.py, which I put in /etc/mailman3. b. Django site configuration for Postorius and HyperKitty goes in urls.py (the routing configuration mapping URLs to views) and views.py (mapping views to Python code). I put these in /etc/mailmn3. c. Full-text indexing for HyperKitty. Default is Whoosh (a Python application) whose configuration goes in Django's settings.py. I prefer Xapian, which requires a separate application (Debian and Ubuntu have packages), but the needed configuration can be done in the top-level settings.py. 7. Template customization. If you have any customized templates for Mailman's email or Django's views, you'll need to copy and move them too. I haven't customized email, but Django's page templates can be kept separately with a path variable set in settings.py. I put them in a hierarchy under /etc/mailman3/templates. Maybe Mailman core has a similar setting? 8. Transient files. Aside from code and configuration, everything in Django is in the RDBMS, there are be no random files strewn around as far as I know. Mailman core is another matter. You can hope that all Mailman transient files are in its "var" hierarchy. $var_dir (the setting in mailman.cfg or inherited from schema.cfg) is the root of this hierarchy. I set var_dir=/opt/mailman/var, I think Mark may use var_dir=/opt/mailman/mm/var. I would guess that FHS-conformant distros would likely use var_dir=/var/lib/mailman3. a. The queue directories $var_dir/queue/* should be empty. Shut down the incoming mail and let mailman run until it's clear. (Normally takes < 5 seconds.) The exceptions are the shunt and bad queues, which are messages that Mailman doesn't know what to do with. With the venv active, run "mailman unshunt" to attempt to clear the shunt queue. Move anything that's left in shunt as well as any .bak or .tmp files into the bad queue for later treatment. These can be copied to the bad queue in the new instance. Use "mailman qfile <file>" to examine them to see if they can be deleted. b. I think the only stuff that ends up in the $var_dir/lists/* directories are digests being built for later distribution. Use the usual tools to send them off or copy them over to the new instance. c. There should be nothing in $var_dir/archives/hyperkitty/spool, which is temporary storage for messages to be archived. That is, it should get cleared up by the few seconds while incoming mail is stopped and outgoing messages are being processed. If there's anything still there, stash it away for later examination using "mailman qfile". (Don't put it in queue/bad or queue/archive though, this is a different process from the normal pipeline.) I think that's about it. Steve

1 year, 5 months

[MM3-users] Re: MIME Digests with posts and index inline likewise Plain Text Digests

by Mark Sapiro

On 1/18/19 5:11 AM, Henrik Rasmussen wrote: > Please correct me if I'm wrong, but as I understand, Mailman attaches posts in a MIME Digest mail intead of inline in the digest mail itself, like Plain Text Digests does. Some mail readers like Gmail eventually displays attachments inline anyway, but readers like Outlook do not. Also the digest index seems to be posted as an attachment in MIME Digests. > > Would it be possible for Mailman to send both posts and index inline in the MIME digest? The format of the MIME digest is specified by RFC 2046 which defines the multipart/digest format in section 5.1.5. This defines the MIME digest as a multipart/digest message part containing the individual messages as message/rfc822 sub-parts. It also says (after spelling corrections - ErrataID: 510): Note: Though it is possible to specify a Content-Type value for a body part in a digest which is other than "message/rfc822", such as a "text/plain" part containing a description of the material in the digest, actually doing so is undesirable. The "multipart/digest" Content-Type is intended to be used to send collections of messages. If a "text/plain" part is needed, it should be included as a separate part of a "multipart/mixed" message. The MIME format digest Mailman produces has the structure multipart/mixed text/plain the "masthead" text/plain (only if a digest header) the digest header text/plain the table of contents multipart/digest message/rfc822 the first message message/rfc822 the next message ... message/rfc822 the last message text/plain (only if a digest footer) the digest footer The only change that could be made while keeping the digest compliant would be to combine the masthead, digest header if any and table of contents in a single text/plain part. While this might solve the the issue of the table of contents being an "attachment" in some MUA's rendering, it won't address the larger issue of the messages being rendered as attachments. As you note, Gmail's web mail does an OK job of rendering the MIME digest as do other mainstream MUAs such as Thunderbird. The real solution is for those people who insist on using non-compliant MUAs to subscribe to the plain format digest. The whole point here is if you want a digest which has everything in line, that's what the plain text digest is. If you want a digest which maintains the original structure of the messages without flattening them to plain text, the messages have to be separate message/rfc822 parts. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 3 months

[MM3-users] Re: Disabled by bounce

by Stephen J. Turnbull

Jan Eden via Mailman-users writes: > To distribute messages with valid DKIM signatures, I set > > remove_dkim_headers: yes > > in /etc/mailman3/mailman.cf That should be "mailman.cfg" for a standard installation, and it may not be in "/etc/mailman3" in a shared hosting situation. Do you have evidence that removing DKIM headers helps you get mail delivered? (Not adding your own, IMO you should do that regardless of whether you strip existing ones, but removing originals.) The DKIM spec says that you shouldn't, and that consumers should treat invalid signatures no differently from missing signatures. I haven't run into a "public" host that treats an invalid signature as a problem in quite a while. On the other hand, I know of at least one postmaster who is experimenting with simple "repairs" (namely, stripping list tags and serial numbers from Subject and unwrapping simple MIME structure for Mailman lists at least -- the case where Mailman wraps the original message in multipart/mixed and adds a text/plain part to the message with the footer in it) and checking the original DKIM signature and from alignment on the "repaired" message. I don't know if they're still working on that. Steve

2 years, 2 months

[MM3-users] Re: MM3 Docker

by Odhiambo Washington

On Wed, 9 Jan 2019 at 00:16, Mark Sapiro <mark(a)msapiro.net> wrote: > On 1/8/19 10:03 AM, Odhiambo Washington wrote: > > > > Thank you for clarifying. > > So once I have a venv created, the services will just run as long as the > > startup scripts are running even when I'm logged out of the system? > > > As long as the startup scripts actually reference things in the venv. > > If you look at the samples in the Recommended Configuration section at > <https://wiki.list.org/x/17891998> for > > /opt/mailman/mm/bin/django-admin (sample) Script to run Django > management commands. > > /opt/mailman/mm/bin/mailman (sample) Script to run mailman commands. > > and > > /opt/mailman/mm/bin/gunicorn (sample) Script to start Gunicorn. > > You will see they all do things like activate the venv or run a command > from venv/bin. > > > Now that has clarified the matter for me. That even when I am logged out, the scripts do the neccessary to activate the venv to run things. I hadn't looked at the scripts at all. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

6 years, 3 months

[MM3-users] Re: LTMP to Postfix problem

by Brian Carpenter

On 6/18/20 4:09 PM, Mark Sapiro wrote: > Do you have > > lmtp_host: 127.0.0.1 > lmtp_port: 8024 > > in the [mta] section of mailman.cfg? (these are the defaults) > > $ /opt/mailman/mm/bin/mailman conf|grep lmtp > [mta] lmtp_host: 127.0.0.1 > [mta] lmtp_port: 8024 I do > Is Mailman's lmtp runner listening on port 8024? > > $ sudo netstat -lntp|grep python > tcp 0 0 127.0.0.1:8024 0.0.0.0:* > LISTEN 1867/python > tcp 0 0 127.0.0.1:8000 0.0.0.0:* > LISTEN 1199/python > tcp 0 0 127.0.0.1:8001 0.0.0.0:* > LISTEN 1871/python It is. > > Is there some firewall issue blocking access to the port even from > localhost? Let me describe the problem a little better. Mail delivery from postfix to mailman works most of the time. However in the past week or so, lmtp starts refusing connections via postfix about once a day. I have port 8024 open in the firewall (UFW). There are no errors in the smtp.log file. I think restarting Mailman core seems to get things running again. -- Please let me know if you need further assistance. Thank you for your business. We appreciate our clients. Brian Carpenter EMWD.com -- EMWD's Knowledgebase: https://clientarea.emwd.com/index.php/knowledgebase EMWD's Community Forums http://discourse.emwd.com/

4 years, 10 months

[MM3-users] Re: hooking up mailman and sendmail

by John Covici

That post does not answer my question, it applies only to mailman2 and is a big mess. I was hoping to use lmtp, which sendmail will use and mailman seems to have some facilities to use it as well. Thanks. On Sun, 14 Mar 2021 10:29:20 -0400, Stephen J. Turnbull wrote: > > John Covici writes: > > > Hi. So, I have sendmail as my mta and I want mailman to use it. So > > far, I have a local delivery agent able to send on port 8024. So, > > what do I have to tell mailman to use sendmail and listen on port 8024 > > and to send on port 25? > > As Mark wrote in > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…, > > > For sendmail, see > > <https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h…> > > Regards, > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Your life is like a penny. You're going to lose it. The question is: How do you spend it? John Covici wb2una covici(a)ccs.covici.com

4 years, 1 month

[MM3-users] Re: Mailman, etc. upgrade woes and persistent bugs

by Brian Carpenter

On 2/17/21 6:52 AM, Andreas Barth wrote: > Just from the top of my head, for example I want to differentiate > between private, member and public lists. So if a member logs in, they > see more lists than a non-member. This is currently not possible, not > too big a deal (all member lists are currently configured as private) > but of course would be nice. Also archiv access should be aligned with > these permissions. What I have done with Affinity is design everything around roles. Roles are List Owner, Moderator, and List Member. So when a registered user logs in they will see: All their lists that they have a role in and an icon assigned to each role that they play. Those lists are shown at top. Below their lists associations, public lists are shown. These they do not have a associations with for the logged in user. Here is an image in what I am referring to: https://www.mailmanhost.com/wp-content/uploads/2021/02/Screenshot_2021-02-1… Is the above image what you are thinking about? If it is then I do think that is possible with Postorius with some customization. -- Brian Carpenter Harmonylists.com Emwd.com

4 years, 2 months

[MM3-users] Re: MM3 not processing some mails from specific user

by Stefan Bauer

Hi Stephen, thank you. Funny. All problematic mails are in the shunt-queue from one specific user. the mailman-logs did not log anything helpful. What do you recommend to find the needle in the haystack? I mean, what can cause mailman to fail processing? Stefan Am Do., 11. Aug. 2022 um 14:30 Uhr schrieb Stephen J. Turnbull < stephenjturnbull(a)gmail.com>: > Stefan Bauer writes: > > > Any idea what that could be? Here are some logs: > > I don't see anything in either the MTA log or the sample message. > However the sample message is incomplete, I assume the rest is an HTML > version of the plain text MIME part. It's unlikely but possible that > there is a defect in the rest of the message. > > Have you checked the Mailman logs? Typically they end up either in > /var/log/mailman or /var/lib/mailman/log (or variations on those > appropriate for your installation) > > Also, check the shunt queue, typically in > /var/lib/mailman/queue/shunt. This is where Mailman puts messages > that contain errors that didn't prevent delivery but make processing > impossible. > > Steve > >

2 years, 8 months

[MM3-users] Re: How To Install Mailman 3 on Debian 10 (Complete Guide)

by Brian Carpenter

On 2/25/21 10:35 PM, Abhilash Raj wrote: > I think it is okay to be pick up a specific configuration and provide a > guide to installation keeping that as the target technology. As it happens > to be, the official doc uses the same set, Nginx, Postfix and PostgSQL. > > https://docs.mailman3.org/en/latest/install/virtualenv.html Thank you for pointing the above out. I will keep track of the URLs you provided in this thread and I am willing to also assist to try to make sure such links are propagated via search engine results. > I don't see anything very specific to Debian in the doc except the package > names and I think they are similar enough in Debian derivative distros that > we can write up that assumption up front in the top. > > Given that most of the installation is based off on pip, I don't think there is > going to be a *lot* of deviation for even RHEL/Fedora based distros when it > comes to Mailman itself. Some minute deviations could occur with the > behavior of certain commands, like `nano` doesn't exist, but I still expect > 95% of the doc to be the same, except obviously the package names. I agree. One of my goals was to make it easy for Mailman 3 adopters to use a different installation method other than a repo since distro packages tend to install older versions of Mailman 3 core, Postorius, and Hyperkitty. At this stage of Mailman 3 development, these new versions bring a LOT of improvements to the Mailman 3 user. I am also willing to start testing out my installation method on other distros and document the differences. If you are willing to help me, I have no problem posting installation instructions and tips to Mailman 3's official documentation. I am also more than willing to keep such documentation up to date. I am always being called upon to install Mailman 3 for someone, so I seem to be on the front-line when it comes to "surprises" such as the issue with the cryptography module. That puts me in a good position to update documentation simply because I need to know such things for the next install. > I am not that well versed in SEO, but the official website https://list.org > does point to it. Maybe not prominently enough for new users to discover? > I'll see if we can make the discovery of docs.mailman3.org better. I think the issue I found was running into outdated documentation for older versions of Mailman 3. Even doing a search for an up to date changelog or release notes are problematic. Again, I am also willing to help out with trying to get such vital pieces of information showing up prominently in search results. > I guess it is fine to be opinionated about choosing the technologies but > yet provide pointers to help people using other technologies. > > Right now, I do that using "Hints" and "Notes" and "See also" banners > through out the documentation to point to different pages where they > can lookup setup for other technologies. For example, how to setup > MySQL if official doc recommends Postgres. Are there still any outstanding issues with using MySQL? I know I ran into some when I tried to use MySQL and chose to go with PostgreSQL (which I am so glad I did). I still recall even seeing some recent issues brought to this list for someone using MySQL. I know MySQL is very popular for websites so I do believe the momentum for someone to set up a Mailman 3 server is to go with MySQL. Perhaps just putting up some heads up warnings (here there be dragons!) IF there are still issues out in the wild for those wanting to use MySQL with Mailman 3. Personally I will always steer clients to PostgreSQL when I get a chance. My own documentation reflects that bias. > Gitlab has a fairly good experience editing REsT files and you don't > necessarily > have to do much outside of a Web Browser actually. It lets you preview before > saving like wiki.list.org and you can submit it for review and merging into > main repo. > > Would you be more willing to contribute to official documentation if we > documented the Gitlab contribution process better? Absolutely. My current installation documentation was the result of a certain beautiful Mailman developer who I won't name (just protecting your privacy Mark!) providing me assistance when I decided to go with the certain installation direction. So if you scratch my back (i.e. teach me Master for I am your student!) then I will scratch yours. > Because we haven't yet gotten to updating those in the official docs, > unfortunately. And there are more things missing like Fulltext search (Xapian > recommended) and more of the Email setup like SPF and DKIM. Very much > aligned with your plans, which is why I suggested contributing updates > to docs.mailman3.org instead :) Well show me how to update the documentation and I will certainly take care of those things. I am also now comfortable in getting OpenDKIM working with Mailman 3 so I can also provide documentation there as well. I have done Xapian installations for clients but unfortunately did not document my methods so I will need to work on that. How do you feel about documentation for the use of Elasticsearch and Solr? Remember, I was a Mailman 2 host for years using cPanel. cPanel took the thinking of out a lot of things when it came to Mailman 2 hosting and I don't have that crutch anymore with Mailman 3. -- Brian Carpenter Harmonylists.com Emwd.com

4 years, 1 month

[MM3-users] Docker, Mailman 3, templates and list user accounts

by Henrik Rasmussen

I used Docker to installed Mailman 3. The top header of the web interface says "Example.Com" while linking to the correct site URL (I believe coming from SERVE_FROM_DOMAIN). In a post[1], Mark Sapiro referred to the template system in Mailman 3 by pointing out that "a custom template can be put in var/templates/site/en/welcome.txt or var/templates/domains/example.com/en/welcome.txt<http://var/templates/domains/example.com/en/welcome.txt> or var/templates/lists/listname.example.com/en/welcome.txt<http://var/templates/lists/listname.example.com/en/welcome.txt> where var is Mailman's configured var_dir". I believe this refers to the mail templates. 1) Where do I change the similar template system, for the web interface, without breaking a laver upgrade? 2) How do I change the site name in the top of the web interface on Mailman 3 to my subside and ? [1] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… The Mailman command in Mailman Core doesn't seem to have a command for listing the accounts users have created by using Sign up in the web interface, so I believe that accounts may be created in the webinterface. Is there similar commands for the web interface like the mailman commands for the Mailman core? Regards, Henrik Rasmussen

7 years, 8 months

[MM3-users] Re: Question about adding addresses using the REST API

by Mark Sapiro

On 1/15/22 10:03 AM, Stephen Daniel wrote: > > The only way I've found to create a standalone address (not linked to any > user) is to create a user with that address, unlink the address, then > delete the user. > > Is there a more straightforward way to just create an address with no user? The more straightforward way is via the IUserManager create_address method. This method is not exposed directly in REST, so you can't do it via REST. My question is why do you want to? Granted when an unknown nonmember address posts to a list we create a standalone address record, but maybe we should be creating a user too. We don't because it's tricky. Suppose User A with address A posts to a list from nonmember address B. We create the standalone address B record as a nonmember, but now user A can add address B as another address. If we also created User B, this would not be possible. But again, what is your use case for creating standalone addresses? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 3 months

[MM3-users] Re: Implementing threading [was: hyperkitty failed to create a thread]

by tlhackque

Notes inline. On 12-Feb-19 11:09, Stephen J. Turnbull wrote: > tlhackque writes: > > > I believe that for threading to work more or less reliably, the > > thing to do is to look at the 'References' header. > > > > That should give you the thread in order, and allow any message > > received out of sequence to be put in the proper location in your > > display. > > This is more difficult than it seems, since References is not defined > for mail as far as I know (it's a netnews concept originally, and RFC > 5337 is a netnews-specific RFC). Not sure why you believe this. RFC2822 3.6.4 defines References for e-mail. See https://tools.ietf.org/html/rfc2822#page-25 As I wrote in later post, the message-ID syntactically requires the <>. (just one set). msg-id = [CFWS] "<" id-left "@" id-right ">" [CFWS] Look at that for the full syntax and reference. > Although it is adopted by most mail > clients, there's no guarantee of strict conformance. I agree that conformance has traditionally been hit-or-miss with almost everything about e-mail. Sigh. I also agree that life is hard. There have been clients that use the same message-id for all messages, and it's a long-standing problem. E.g. See https://cr.yp.to/immhf/thread.html Not only do you not have a guarantee of ever getting all links, you don't have a guarantee of the order in which they arrive. So one can have gaps ( parent, reply2-delayed, reply 3 references reply 2 and parent, reply 2 might arrive - or note.) You also can have a reply that references 2 or more branches. E.g. /--R0 p/--r1 \ \ --r2 / And a reply (r3) comes that references r1 AND r2 (and the parent) - which you probably want to show as a descendant of both r1 AND r2. R4 replies to r2 - but that's also an implicit response to r1. Once you's sorted that out, r5 comes along that references R0, r4, and P. 2822 does say: Therefore, trying to form a "References:" field for a reply that has multiple parents is discouraged and how to do so is not defined in this document. But programmers are rarely discouraged - with GUIs, it's pretty easy to intuit that one might like to check the boxes on several branches of a thread and respond "Of course, you're all right - see my cat photo". :-) 5537 tries to make life easier - until you get to: If the resulting References header field would, after unfolding, exceed 998 characters in length (including its field name but not the final CRLF), it MUST be trimmed (and otherwise MAY be trimmed). Trimming means removing any number of message identifiers from its content, except that the first message identifier and the last two MUST NOT be removed. So, even if you get all the messages, you don't necessarily get all the references that you need. I'm sure glad that I'm not working on Hyperkitty! But I'm not holding my breath for when MM3 is complete enough to adopt in my environment. Yes, "In-Reply-To" is more often present (likely because it's modestly simpler for RFC-readers to understand - it's one thing, not a list.) It's less expressive (hence, informative.) One can try to use it as a fallback when no References is present (and that's what 2822 implies). The whole undertaking in the real world is an example of the halting problem. Or Parkinson's Law. The best one can do is to come up with a "good enough" approximation in the available time, and tinker with/improve it until bored. It's likely to be a bunch of heuristics. And if you're not careful, throw in the Peter principle :-( > In mail, > In-Reply-To is more reliably present, but of course asynchronicity > means you have no guarantee of a complete set of all links. Even if > all clients conform to the netnews RFC, you still need to create the > full tree (full conformance to RFC 5537 means it will be a tree), and > break ties between branches in some arbitrary way to create a total > order. It's worse if you *don't* have conformance from all clients: > you can get a DAG or even something that isn't even a DAG. So, even > today, you can't assume a well-behaved ancestry graph. > > > 'References' should be a superset of Reply-To (which is at most 1 > > Message-ID), so you only need Reply-To if there is no References - or to > > handle a client that doesn't obey the RFCs. > > I suppose HyperKitty uses References (it works for messages that have > proper Message-IDs ;-), but I don't know what algorithm it uses. > Might be worth looking into, as well as considering a more Postelian > parsing of Message-IDs. Specifically, take the field body, unfold it, > strip leading and trailing whitespace and leading "<" and trailing > ">", and whatever's left is the message ID. > > Alternatively, strip everything that's not atext or "@" (including > inside the purported Message-ID). See my other post. The left and right halves can, besides being atoms, be non-folding quotes or literals. So you have to handle that. Although I have recently seen e-mail clients that are confused when you do it. (Ran into that generating content-id for multipart/related. Yes, MIME makes plain e-mail look straightforward.) Although it has a defined syntax, the semantics are that message-id is an opaque globally-unique identifier. Attempting to parse it as anything but '<[^>]+>' is likely to be a mistake. (On receipt; generating is the other side of Postel-correctness... I commend RFC 2468 to anyone who hasn't read it.) I doubt 'striping' is worth doing - when an message-id is present, I've almost always seen it include the required <>. Until yesterday's hyperkitty bug, I've never seen <<>>. I've rarely seen the <> missing - but I'd consider that a warning that the message format is suspect. As in this case. My suggestion is that if you can't find a message-ID, keep the message in an "unthreaded" bucket. If you sort that by subject (omitting "[listtag]" and "Re:*" (case insensitive, and in multiple languages) then by date, you probably have a useful presentation. And a list of MUAs that need bug reports :-) Yes, althought 2822 says that "Re:" is the proper introducer in the subject of a reply, RE: is common, and I've seen it (incorrectly) translated in the headers.) As I said, "life is hard". > This won't break any RFC 5537-valid > Message-IDs, but might identify two different, nonconforming > Message-IDs as the same (too bad if they can't take a joke!), or > identify a nonconforming message with a conforming one (<sad_emoji />. > > Thoughts? > > Steve > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

6 years, 2 months

[MM3-users] Re: Archives with encoding characters

by Seth Seeger

I should add that they are both on Plain Text Digests. (People seemed to be unhappy with MIME digests, because they had to double click on each email to open it up. You couldn't just scroll through a long email.) Seth On Wed, Mar 4, 2020, at 4:55 PM, Seth Seeger wrote: > Hello everyone, > > I have a few (but not all) members complaining that their digests are > full of coded characters. Two examples below were forwarded to me: > > > What I ended up doing was creating 2 "practice lines" in the centre of=20 > > our big teaching circle (I always teach new figures in a big circle) -=20 > > which each had 3 people set up in a line with generous space between,=20 > > and first=C2=A0 I walked through one of those lines myself starting first= > > =20 > > and > > > Robins pass Right=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Larks Loop L= > > eft > > What is the cause? Is there anything I can do about it? > > Thanks, > Seth

5 years, 1 month

[MM3-users] Re: Don't start nntp runner by default - was: Mailman3 doesn't send Mails to users (Debian12 with Plesk)

by Mark Sapiro

On 5/24/24 3:37 PM, admin(a)bclug.ca wrote: > > Is nntp common enough these days to be a useful default runner? > > I disabled it in mine when I noticed it, but it seems (IMHO) a waste of > resources (yet another Python interpreter running) for a fairly edge > case of mailing list <--> nntp transits. You raise an interesting point. By default, the runner runs, but if there are no lists gating to usenet, its queue is always empty and it mostly sleeps between waking, finding its queue empty and going back to sleep. A more significant use of resources is every (default) 5 minutes spawning `mailman gatenews` which goes through a startup process and then looks at every list figuring out there's nothing to do. We could default mailman.cfg to contain `start: no` in the runner.nntp section so people would need to enable it if they wanted it. What do others think? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

10 months, 4 weeks

[MM3-users] Re: My email address appears in quoted test in my list. Hoot change that.

by Abhilash Raj

On Wed, Sep 4, 2019, at 5:56 PM, paul(a)arenson.org wrote: > Thank you. When you say OPTIONAL, do you mean it is up to me (in the > web interface or email client) to remove them as I have done below? Right, it totally depends on how one is replying. In the web interface, since you already seem to be using it, there is a button which adds the quoted text if needed. For email clients, the behavior varies from one client to other and there are tons of them. Some will quote by default, some won't. Then, it also depends on the users, since even if it is not the default, they can optionally add quotes. > > Abhilash Raj wrote: > > On Wed, Sep 4, 2019, at 5:41 PM, paul@-------- wrote: > > > Hi. I thought I had the settings right, but I do not > > > see one to get > > Thanks. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years, 7 months

[MM3-users] Re: Relaying email from external SMTP server (office365 or Exchange)

by Mark Sapiro

On 6/22/20 7:58 AM, Waqas Ahmed Khan wrote: > Hi, > > I have installed mailman3 with postfix. The server is working fine. To > protect the IPs from blacklisting, I want to relay all emails from > postfix/mailman to external SMTP servers like O365, Gmail, or our exchange > server. I would not recommend using O365 or Gmail as outgoing MTAs. I don't really know about )365, but I don't think Gmail likes you to send mail via a gmail server if it is not From: (or maybe envelope from or both) a gmail or googlemail address. > Could you please confirm is this possible. And how to do its configuration. It is possible and there are two ways to do it. You can configure this in Postfix to relay all outgoing mail via some other server. You can configure it in Mailman by setting in the [mta] section of mailman.cfg smtp_host: smtp_port: and presumably for authentication smtp_user: smtp_pass: Also see https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/config/schema.… and following for other relevant settings. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: If you delete a list but not the HyperKitty archive

by Philip Colmer

On Tue, 4 Jan 2022 at 18:34, Mark Sapiro <mark(a)msapiro.net> wrote: > On 1/4/22 6:45 AM, Philip Colmer wrote: > > > > So ... should the archive be deleted when the list is deleted and it is a > > bug that it isn't? Or is it expected that access to the archive is > "frozen" > > once a list is deleted? > > > It is often desired to have a public archive available after the > corresponding list has been deleted. Even for a private archive, it may > be desirable for site admins to have access. Furthermore, a list might > not even have a HyperKitty archive in the first place. Thus, what to do > about a HyperKitty archive (or prototype archive or ...) when a list is > deleted is an administrative decision and is best left up to the site > admins to do it or not. > > As you note with a private archive, former members no longer have access > when the list is gone, but unless an attempt throws some uncaught > exception, that is not a bug. > Thanks, Mark, for the clarification. Regards Philip

3 years, 3 months

[MM3-users] Re: modify subscription page by mailinglist?

by Stephen J. Turnbull

Lars Schimmer writes: > And I think I could fiddle out how it works. But in general, e.g. a > custom page per mailinglist for the "list information page" is a bit > more work than expected and I will not follow this idea. > (e.g. adding a logo per list, ...) Just adding a list-specific logo is not hard. Choose a naming convention (probably something like f"logo-{list_id}.png"), put the logo PNG in one of the static directories and add <IMG SRC="logo-{{list_id}}.png" ALT="Logo for {{list_id}} list." /> in the right place in each template (maybe even "base.html", but more likely an intermediate template specifically to allow putting such customizations in one place for list-specific pages). Adding the ability for a list admin to easily upload a file and set the logo to it would require surgery to Postorius's Python code, though. I will admit that though I think this is a cool idea, I am not interested in doing it myself. But if your interest is at the "I'd rather wait a few months than do myself", GSoC is coming up again, and you could lobby for it when the students start applying. ;-) Steve

3 years, 3 months

[MM3-users] Mailman3 not able to deliver emails sent through list, but moderation notifications

by Daniel Böhmer

Hello Mailman users, I've been using Mailman2 for 10+ years and have recently upgraded to Debian Buster with Mailman3. I've tried to setup Mailman3 similarly but it fails to deliver emails sent through a list. I do receive all moderation notifications at the same time. During startup /var/log/mailman3/mailman.log receives: > Cannot connect to SMTP server localhost on port 25 but I've made sure postfix is listening on *:25 for both IPv4 and IPv6. When sending a message to a list the same file receives: > Nov 25 11:38:14 2022 (70371) ACCEPT: <MESSAGEID@HOST> (message ID and host redacted) and nothing else happens: no more log messages, Postfix logs the email sent TO Mailman but doesn't log anything about emails sent BY Mailman. If Mailman fails to send emails via Postfix I'd expect it to log error messages but it doesn't seem to do so. I found this article stating the the SMTP error message might be misleading: https://blog.tfiu.de/mailman3-cannot-connect-to-smtp-server-localhost-on-po… How to further debug this? What could be wrong with my Mailman3 instance and how to fix it? Kind regards Daniel Böhmer

2 years, 4 months

[MM3-users] Re: Turn off social logins?

by worik

This has been a very interesting discussion. We should be mindful that it is occurring all over society. It is arguable, and I hope true, that the worm has turned regarding privacy. People are starting to realise that you always (in the general case) are paying for a service. If not with money then with something else. In some cases both (hello square space!) tl;dr The choice for or against using the big bad corporation services needs to be clear and usable. Privacy is a minority interest today but IMO the writing is on the wall and for web services it will become the wolf in the kitchen. On 14/02/19 3:42 PM, Stephen J. Turnbull wrote: > Jonas Meurer writes: > > > But still, adding so-called "social" authenticators to the mailman3 > > django application will expose users to the risk of clicking on > > those ID provider buttons. > > I can see this point for Debian users. I suspect Ubuntu users are > somewhat less paranoid. :-) > > Since that risk holds even for sites that enable explicitly (assuming > we adopt the same policy) I will take a look at making that risk hard > to realize (more distance from anything else clickable, smaller > buttons with visible and accurate boundaries. Better that it is off, or it is on for a selected group of providers. The issue is not the prominence of social login options but the presence. I disagree that accidental clicking on social login widgets is a major issue, but I have no data, so it is a opinion. > > > Personally, I consider it a major privacy issue if one central > > instance (e.g. Facebook) is able to track on which platforms and > > services you authenticate. > > Sure, but that ship has pretty well sailed AFAICT. Most users use > unconfigured versions of IE (or Edge) and Safari, which means they're > subject to all manner of webbugs. My employer just asked me to stop > using Firefox because it's too pedantic for their website development > vendors. :-( GDPR enforcement seems to primarily be an arm of the EU > trade offensive against large American services (that's the > Economist's recent opinion, not mine), while Europe-based globals are > undoubtedly doing the same crap. The ship has not sailed. We can get back what we have lost. The new generation of web developers are, in my experience, too enamoured with the cool stuff they can do, and ignore old grey beards (like myself) talk of "attack surfaces" and "chains of trust" and blithely install google fonts, load javascript from CDNs, etcetera that gives their user's data away without a thought or regret. Ten milliseconds and 20kb is considered too high a price to pay for enabling some body else's privacy. But they are starting to face push back from consumer groups who understand the value of what is being handed over. > > And to be honstes, I'm a bit irritated that those tracking features > > from big corporates like Facebook and Google, whose main business > > model is to aggregate as as much private data points as possible > > about as much users as possible are enabled by default in Mailman3 > > upstream. > > Your irritation is not our problem, though, since you can use Debian's > version, and as I mentioned earlier, as far as I know most of our > sites are happy to have social auth. I will be paying attention to > the list to see what others think. That irritation is exactly the problem. It is a problem we need much more of. > > > Besides the privacy concerns raised above, on problem with central > > authentication services is that they also create new single points > > of entry/failure. If your Facebook account gets hacked, you now > > loose control over all other services/platforms, that you used the > > Facebook authenticator service for. > > Same thing if you use a weak password. Effective and secure > authentication is not something we're good at, and we can't really > afford the effort to be good at it. These things are tradeoffs, and > the default should be something that most of our users (ie, site and > list admins, NOT subscribers) want. Hopefully their preferences in > this respect reflect those of *their* users (== subscribers). Attack surfaces. "Whataboutism" is not a valid argument against the argument that you should decrease your attack surface. But social authentication is enabled are the trackers are not loaded too. As far as I can see. If so that is a good thing. The big bad corporates only get data when some one actually uses their services. > > > I agree with Torge that those social auth providers should be > > disabled per default. IMHO, A sane default would be to list them in > > the settings.py but have them commented out. > > "Those" social auth providers? Are there social auth providers who > provide what you consider acceptable privacy guarantees (a la > Duck-Duck-Go in search engines)? If so, we could make those higher in > the list/easier to use. I disagree that they should be disabled by default. I agree they should be disabled, but it should be by choice. What is required is a configuration option in the interface not in the text configuration files. The former is for list administrators the latter is for site administrators. Currently list administrators do not have that choice. (I am new here, do I have that correct?) Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

6 years, 2 months

[MM3-users] Re: Installing Mailman3 under a Python Virtual environment running on RHEL9

by Odhiambo Washington

On Tue, May 21, 2024 at 2:44 PM Andy Macheta <andy.macheta(a)gmail.com> wrote: > Hi, > So tried, without much success, to get Postorius working on my Mailman3 > server and every internet trick& tip I tried did not work so decided to > take a new approach as recommended at > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… > > Used this reference: > https://docs.mailman3.org/en/latest/install/virtualenv.html#installing-depe… > which I know is more for Debian/Ubuntu systems but I was hoping that 90%+ > would also work with Red Hat. > Fell at the first hurdle with no packages available called "python3-dev" > or "python3-venv" > The virtualenv method should work for all OSes, not just Debian/Ubuntu. I use it on FreeBSD too. I have never touched RHEL, but Google-foo tells me that you need to do: yum install -y python3-devel Alternatively, search for the package in yum , use the following command: yum search python3 | grep devel You could also search for the venv one by: yum search python3 | grep env Whatever else you'd need to install on the base OS, just use the above search method and install it. Feel free to post questions here if you aren't sure on what to install. The documentation - https://docs.mailman3.org/en/latest/install/virtualenv.html - requires you to install the following in the base OS: 1. python3-dev python3-venv sassc lynx 2. A database server - could be PostgreSQL or MySQL. You can search for them too :) 3. An MTA - could be Postfix or Exim. Your choice. 4. A webserver - could be Apache or Nginx The challenge you're likely to face is probably to do with how to start the MM3 core and MM3 web services, but you can figure that out, no? Alternatively, just dump RHEL and use any Debian-based OS :) Is there anyone that has managed to install a running version of Mailman3 > that has a working GUI whether it is on bare metal or Python virtual > environment and if so, could they kindly let me know how they did it?? > The closest I've come is a running command line version of Mailman3 which > is fine for me of course but not for anyone else as they like access via > web browser. > Let's see if you can get this running in the next 3hrs. Do you use WhatsApp? Let's chat on +254732000004 -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

11 months

[MM3-users] Re: Enable delivery

by Mark Sapiro

On 12/9/24 17:35, Hirayama, Pat wrote: > Greetings, > > I'm finding something a bit odd with our listserv. Please see https://wiki.list.org/DOC/Mailman%20is%20not%20Listserv > Some of the members of some of the lists are reporting that they aren't receiving messages sent to the list. When I review the member options for the person in question, I see that Delivery Status shows nothing selected (i.e. neither radio button is selected for Enabled or Disabled). If you look in the MTA logs is mail being sent to them. As far as the Delivery Status showing nothing, that means the member's delivery_status is None. The ultimate delivery status is determined by checking first the member's delivery_status, then the address's delivery_status, then the user's delivery_status and finally Mailman's global preferences. The first non-None value is what's used. See https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/model/member.p… Also see the various tabs at https://www.example.com/mailman3/accounts/subscriptions/ > If I select Enabled and Save, then delivery starts working for that user. This should only happen if the users address or user based preference or the global preference is Disabled. > There are other members of the list that have neither Enabled or Disabled selected, but they are working. Which also seems to mean that when I run: > > mailman members --nomail any listname@listserv > > Nothing is returned. Because all members ultimately have delivery enabled. > If anyone has any ideas about why this might be the case, or how I might proactively identify other members who aren't receiving mail, that would be appreciated. Alternately, any thoughts on how I might force all members to Delivery Status Enabled, that would also be great. It shouldn't be necessary to do that. For one of these members, e.g. user(a)example.com, that isn't getting mail, do this in mailman shell ``` mailman shell -l list(a)example.com Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. The variable 'm' is the list(a)example.com mailing list >>> from mailman.core.constants import system_preferences >>> mbr = m.members.get_member('user(a)example.com') >>> print(mbr.delivery_status) (this will print the ultimate delivery_status, for the components do) >>> print(mbr.preferences.delivery_status) (output) >>> print(mbr.address.preferences.delivery_status) (output) >>> print(mbr.address.user.preferences.delivery_status) (output) >>> print(system_preferences.delivery_status) (output) >>> ``` The first of the (output) lines which is not None should be the same as the output from print(mbr.delivery_status). -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 months, 2 weeks

[MM3-users] Re: Restore/export existing Mailman lists + hyperkitty archives on a new server

by Stephen J. Turnbull

Kimmo L writes: > This is simple test email with content like "Test test test" to > test out this specific mailing list, which somehow does not sent > emails to the list of members. Wierd that other lists works fine, > but this one is bugged. Maybe i should try to delete it and > recreate it ? That might work. > 2) This second error seems indeed not related with that first one. > "AttributeError: 'NoneType' object has no attribute 'strip'" occurs > quite many times in mailman.log file. Should i check some specific > list settings? I don't think so. That usually indicates mal-formed mail, missing a required header field. In the case you posted earlier, the mail had no Message-ID that Mailman could find. I suspect you have a configuration where your MUA doesn't add the Message-ID header (this is common, because all internet-facing MTAs do add one if there isn't one already in the message, so many MUAs let the MTA do it), and for some reason local mail doesn't go through a proper MTA and never does get one.

2 years, 7 months

[MM3-users] Re: Disabled by bounce

by Mark Sapiro

On 9/11/24 15:21, Dan Caballero wrote: > Mark, > > Do you have any tips for scripting the setting changes via mailman shell -l somelist(a)caltech.edu or a python script to run. eg. mailman shell -r dmarcsettings.py? > > We have a number of lists that email Gmail addresses either directly or via aliases and virtual email domains using Google Workspace. If your Mailman version is >=3.3.9 you can add `^.*(a)gmail\.com` to each list's `dmarc_addresses` to apply `dmarc_mitigate_action` to any mail From: a `(a)gmail.com` address. A `mailman shell` interaction to do that and set `dmarc_mitigate_action` to munge_from for all lists is like ``` $ /opt/mailman/mm/bin/mailman shell Welcome to the GNU Mailman shell Use commit() to commit changes. Use abort() to discard changes since the last commit. Exit with ctrl+D does an implicit commit() but exit() does not. >>> for mlist in getUtility(IListManager): ... mlist.dmarc_addresses.append(r'^.*(a)gmail\.com') ... mlist.dmarc_mitigate_action = DMARCMitigateAction.munge_from ... >>> commit() ``` If your Mailman is older than 3.3.9 or you don't want to use dmarc_addresses, replace the line ``` ... m mlist.dmarc_addresses.append(r'^.*(a)gmail\.com') with ... mlist.dmarc_mitigate_unconditionally = True ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 months, 1 week

[MM3-users] Immediate notification to the administrator

by Stephen J. Turnbull

pau.baiges(a)csuc.cat writes: > When there's a message being held because it needs approval, it > automatically sends an email to the list owners. However, it also > states that it sends a daily reminder if the email remains > unapproved, but it's not doing that. Did it send the daily reminder before, and then stop? Or did it never send the daily reminder? The immediate notification is triggered by the receipt of the moderated mail. However, once that happens, the Mailman daemon no longer pays attention to it. Instead, there is a cron job that runs once a day that checks the held queue and sends daily reminders. The most likely reason is that the cron job is not running. > I'll show you how I have /etc/postfix/transport configured. I > receive the first "owner" email, but not the daily one. This is irrelevant. The same Mailman function is used to send both the immediate notification and the daily reminder, and it does not use the list-owner alias to do so. The difference is only whether it is run from the Mailman runner daemon or from a one-shot process started by cron. It consults the list configuration directly when composing the email. Steve

1 year, 5 months

[MM3-users]Re: mailman 2 vs. mailman 3: what happened to multipart/digest?

by John Hein

Mark Sapiro wrote at 12:18 -0700 on May 12, 2016: > On 5/12/16 9:16 AM, deu8yz2mpq(a)snkmail.com wrote: > > Digest delivery in mailman 2 encapsulated the individual message/rfc822 messages in a multipart/digest container. This allowed email clients to show the messages in the particular digest in a threaded view. > > > This format vs. plain text digests was a user option in Mailman 2. > > > > It seems like the various digest options that I have tried [1] in mailman 3.1.0 (as implemented for the fedora-users mailing list) no longer encapsulate messages in multipart/digest. > > > The core still supports the same plain text and MIME format digests and > the same individual subscriber and per-list default formats as did > Mailman 2. The issue is none of these things are exposed in Postorius. > > If you subscribe to digests on this list, you will receive the > 'encapsulated' MIME format because the lists mime_is_default_digest > setting is True, but currently that has to be set through the > bin/mailman shell tool. > > > > Is this intentional? Is it a bug - feature that was lost in translation from 2 to 3? Is there a delivery option I'm missing that will turn that back on? Thanks for the info - and Barry's reply as well. I understand that MIME digests are supported in Mailman 3 - that's what I'm using (and thanks, Barry, for the info that Summary Digests is the same right now). My quibble is that the multipart/digest encapsulation level is gone. Barry Warsaw wrote at 15:16 -0400 on May 12, 2016: > The MIME format of MIME digests should roughly be: > > multipart/mixed > text/plain (the digest heading) > text/plain (the TOC) > message/rfc822 > message-1 > message/rfc822 > message-2 > ... > text/plain (footer) But mm 2 had: multipart/mixed text/plain (the digest heading) text/plain (the TOC) multipart/digest <--- this is the part that's gone in mm3 message/rfc822 message-1 message/rfc822 message-2 ... text/plain (footer) So was that removal intentional, a bug or ?? Maybe you're saying there is definitely an unexposed (in Postorius) knob for that in mm3. > > It is the intent that Postorius will eventually expose all these > settings. We're not there yet. At present you could possibly do this by > interacting with mailmanclient, although I'm not certain the settings > are exposed there. You can do it via bin/mailman shell if you have > access and know what you're doing (see > <http://mailman.readthedocs.io/en/release-3.0/src/mailman/runners/docs/diges…>) > > If you file an issue at > <https://gitlab.com/mailman/postorius/issues/new>, it might help > expedite this. Okay.

8 years, 11 months

[MM3-users] Re: Installing mailman 3

by Abhilash Raj

Hi, On Tue, Aug 1, 2017, at 02:11 PM, Rafael Mora wrote: > It's ok now, but still I can't make it send the confirmation email > > This is from mailman.log: > > > [mailman@localhost logs]$ tail -f mailman.log > Aug 01 15:59:18 2017 (2327) lmtp runner started. > Aug 01 15:59:18 2017 (2333) virgin runner started. > Aug 01 15:59:18 2017 (2332) retry runner started. > Aug 01 15:59:18 2017 (2330) pipeline runner started. > Aug 01 15:59:18 2017 (2325) command runner started. > Aug 01 15:59:19 2017 (2328) nntp runner started. > Aug 01 15:59:19 2017 (2326) in runner started. > Aug 01 16:01:38 2017 (2331) 127.0.0.1 - - "GET > /3.0/lists?count=0&page=1&advertised=true HTTP/1.1" 200 90 > Aug 01 16:01:38 2017 (2331) 127.0.0.1 - - "GET > /3.0/lists?count=10&page=1&advertised=true HTTP/1.1" 200 90 > Aug 01 16:01:38 2017 (2331) 127.0.0.1 - - "GET /3.0/domains HTTP/1.1" 200 > 90 > > > > > What should I do? If you are talking about Account confirmation emails, they usually are sent out from Django and not Mailman Core itself. To configure Django you need to edit the `settings.py` file, wherever that is one your installation. If you are following the guide mentioned at http://docs.mailman3.org/en/latest/prodsetup.html, it should be at `mailman-suite/mailman-suite_project/settings.py`. To configure your Django to send emails, have a look at http://docs.mailman3.org/en/latest/config-web.html#setting-up-email-required. That documentation page has pretty much everything you need in order to have a running Web Frontend, please go through it and make sure you have everything configured. Finally, the actual emails from Mailing lists are supposed to be handled by Core. You need to configure Postorius & Mailman both to communicate. The settings are mentioned http://docs.mailman3.org/en/latest/config-core.html#configuring-mta here. Hope that helps! > > > > > > > El mar., 1 ago. 2017 a las 15:36, Mark Sapiro (<mark(a)msapiro.net>) > escribió: > > > On 8/1/17 1:14 PM, Rafael Mora wrote: > > > > > > Why does it say Address already in use? > > > > > > Because you are starting lm tp runner and it's already running. > > > > Do 'mailman stop'. Then ensure no Mailman processes are running. kill > > any if necessary. Then do 'mailman start'. > > > > -- > > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > > San Francisco Bay Area, California better use your sense - B. Dylan > > _______________________________________________ > > Mailman-users mailing list > > mailman-users(a)mailman3.org > > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > > > -- > > Atentamente / Best Regards > > Ing. Rafael Mora > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ -- thanks, Abhilash Raj

7 years, 8 months

[MM3-users] Re: Unknown attribute: max_message_size

by Abhilash Raj

On Wed, Dec 6, 2017, at 08:25 AM, Simon Hanna wrote: > On 12/06/2017 11:40 AM, Thor Atle Rustad wrote: > > If I make changes here: > > https://example.com/postorius/lists/test2.example.com/settings/message_acce…, > > I get a warning that the Maximum Message Size field at the bottom is > > mandatory. However, if I put a number in that field and save, I get > > "Unknown attribute: max_message_size". That makes sense, since Mark states > > in > > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > that max_messages_size is not exposed in REST. > It is. https://gitlab.com/mailman/mailman/merge_requests/329 I have added a backport-candidate tag to the MR and will get it out in 3.1.2 release, if that happens. > > > > > What to do? I understand that it might not be the best answer, but `rolling` tags for images do have this problem fixed, they are based on Git-heads. > > > > I have Maxking mailman-docker but can easily copy files into the image if > > necessary. > Are you sure you have up to date images? > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ -- Abhilash Raj maxking(a)asynchronous.in

7 years, 4 months

[MM3-users] Re: remove non members from a list

by Guillermo Hernandez (Oldno7)

On 6/8/21 18:37, Mark Sapiro wrote: > On 8/6/21 9:18 AM, Guillermo Hernandez (Oldno7) via Mailman-users wrote: >> Hi all: >> >> I need to remove all non members from a list. I know I can do it via >> Postorius, but it has to be done one at a time. (you can delete ALL >> suscribers but not all non members...) >> >> Anyone has a python recipe to do this? > > $ /opt/mailman/mm/bin/mailman shell -l list.example.com > Welcome to the GNU Mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > The variable 'm' is the list.example.com mailing list > >>> for nonmember in m.members.nonmembers: > ... nonmember.unsubscribe() > ... > >>> commit() > Thanks a lot for the promt response, Mark. It's not functioning. It says: "AttributeError: 'MemberRoster' object has no attribute 'nonmembers'" My system info is: Mailman Core Version GNU Mailman 3.3.3 (Tom Sawyer) Mailman Core API Version 3.1 Mailman Core Python Version 3.7.9 (default, Nov 6 2020, 21:14:59) [Clang 8.0.1 (tags/RELEASE_801/final 366581)] Postorius 1.3.4

3 years, 8 months

[MM3-users] Re: Create a mailman-web admin user

by Odhiambo Washington

On Tue, Jul 30, 2024 at 4:55 PM Roland Giesler via Mailman-users < mailman-users(a)mailman3.org> wrote: > On 2024/07/30 15:48, Roland Giesler via Mailman-users wrote: > > However, which user in the mailman user mentioned? > > > > I tried to do this as root, but login in as an admin doesn't give me > > any option to create new lists in postorius. What am I missing / > > doing wrong? > > > I seem to have solved the riddle. The "mailman-web createsuperuser" > command suggest the the mailman user is www-data, which I accepted. That > worked and I can now create a new list from Postorius. > Actually, it wasn't a riddle. You looked at documentation meant for the virtualenv <https://docs.mailman3.org/en/latest/install/virtualenv.html>installation method while your installation seems to be done from your OS package distribution. The OS package installation is fraught with pain. The virtualenv method is the officially recommended. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

8 months, 3 weeks

[MM3-users] Re: manage.py runjobs hourly

by Mark Sapiro

On 6/11/20 11:04 AM, Mark Dadgar wrote: > I have started getting this emailed to root each hour from the cron job. > >> From: root(a)pdc-racing.net (Cron Daemon) >> Subject: Cron <www-data@mail> [ -f /usr/bin/django-admin ] && flock -n /var/run/mailman3-web/cron.hourly /usr/share/mailman3-web/manage.py runjobs hourly >> Date: June 11, 2020 at 11:00:06 AM PDT >> To: www-data(a)pdc-racing.net >> >> 18:00:03 [Q] INFO Enqueued 1350 >> 18:00:03 [Q] INFO Enqueued 1351 > > The Enqueued numbers do increment. > > Anyone know what this is? The short answer is you fixed your HyperKitty indexing issue so the hyperkitty update_index job has work to do and some of those tasks get queued by Django Q. See <https://gitlab.com/mailman/hyperkitty/-/issues/295> for another discussion around this. Those messages depend on system load. Sometimes you'll see bunches of them and sometimes (at least on mail.python.org which is the most busy server I am involved with) you won't see any for up to a week or longer. Run django-admin qifno to get the current django q stats. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 10 months

[MM3-users] Re: Permission denied for fulltext_index

by Mark Sapiro

On 12/1/22 01:43, Jan Eden via Mailman-users wrote: > > There are currently 5 (test) threads in the archive. After changing the > PATH in the HAYSTACK_CONNECTIONS dict to /opt/mailman/fulltext_index, > and fixing the issue with MAILMAN_ARCHIVER_FROM above, > /opt/mailman/web/logs/mailmanweb.log does not display new error > messages, but I do not get any suggestions for reattaching threads, and > a search for a specific thread subject ("Third test") does not return > any results. By "search for a specific thread subject", do you mean searching via the search box at the top of HyperKitty pages? This relies on the search index for Haystack (Whoosh in your case). This index is updated by the HyperKitty update_index job. Assuming you have set up the cron jobs for Django <https://docs.mailman3.org/en/latest/install/virtualenv.html#cron-jobs-for-m…>, this will be run hourly and posts added to the archive in the last hour won't be indexed. > So reattachment works in principle, but the suggest/search function does > not. Reattachment suggest doesn't depend on the search index, but it does depend on loosely matching thread subjects. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 4 months

[MM3-users] Re: Rebuilding a list index fails

by Mark Dadgar

On Feb 17, 2021, at 11:06 AM, Mark Dadgar <mark(a)pdc-racing.net> wrote: > On Feb 17, 2021, at 9:58 AM, Mark Sapiro <mark(a)msapiro.net> wrote: >> On 2/16/21 9:59 PM, Mark Dadgar wrote: >>> Now that I’ve got my instance back up and running on the latest released code, I am trying to rebuild a list index. I am using Xapian via haystack, which worked beautifully before my recent list meltdown. >>> >>> Error messages below. >>> >>> rebuild_index fails with the same error. >>> >>> This is with django version 3.0.12. >> >> >> django.utils.six was removed in Django 3.0. See >> <https://pypi.org/project/django-utils-six/> for a work around >> replacement. I.e. in your venv do >> >> pip install django-utils-six > > > OK, that got me a step further. Then I needed to do a “pip install xapian-bindings” and now I am up and running. One last note on this for the next person who searches the list archives: I also ran into the “Key too long” error while re-indexing. Applying the patch linked here fixed it: https://gitlab.com/mailman/hyperkitty/-/issues/322 - Mark ----- mark(a)pdc-racing.net | 408-348-2878

4 years, 2 months

[MM3-users] Re: Moderating posts via email

by Abhilash Raj

On Thu, Oct 26, 2017, at 02:21 PM, Dmitry Makovey wrote: > Hi, > > we are trying to figure out what is that we're doing wrong as we can't > use instructions that mailman sends with information on held messages as > referenced in: > https://gitlab.com/mailman/mailman/blob/master/src/mailman/chains/hold.py#L… > > In particular - replying to the message with "Approved: listpassword" we > were not able to approve any message. Did you add it to the body/subject of the email? AFAIK, Mailman looks for "Approed" header to approve the held messages. > Since there's no place we could find in interface to change ML password > I did it through the mailmanclient: > > ml=client.get_list('mylists(a)lists.some.com') > ml.settings['moderator_password']='password123' > ml.settings.save() > > after which we've used above password trying to approve messages > following the steps outlined above. > > What are we doing wrong, or where to look for further information? > > -- > Sr System and DevOps Engineer SoM IRT > > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Email had 1 attachment: > + signature.asc > 1k (application/pgp-signature) -- Abhilash Raj maxking(a)asynchronous.in

7 years, 5 months

[MM3-users] Re: mailman3 not working for mailman21 lists

by blup＠fortytwo.ch

Stephen J. Turnbull wrote: > blup(a)fortytwo.ch writes: > > I installed mailman3 on a server where mailman21 was installed > > before. Newly created mailinglists work fine. But if I create > > mailinglists with a name that was previously used on mailman21 > > nothing works >> If I send a mail to old list list1(a)a.b and new list list2(a)a.b [..] > Your logs below show that *something* is working because Mailman 3 is > logging the incoming message. I didn't mean nothing literally, what I meant is that the mail to list1 is neither being sent out nor shown in the list archives nor ... I.e. all general stuff is working, but things specific for list1 aren't (whereas they do for list2). > > (same behaviour with and without import of old configs and > > archives; no logs). > I don't understand what you mean by "without import of old configs". > Do you mean you just create the list with the old name? Did you do > any further configuration and set up of that list? First I did create the list with the old name and imported the old configs with mailman import21. As the list did not work then, I deleted it and created it again (with the same manual configuration as for the new list that's working). If you think the problem is neither mailman3 nor postfix, the only issue could be that the first import set some wrong setting for the old list which was not removed when deleting the list. > > How can I get more info on why the mail for list1 isn't processed? > First check the queues (normally /var/lib/mailman/qfiles/*/* where the > first * is a wildcard for list names and the second is a wildcard for > message objects, the '/var/lib' part may be different in your > installation) for a "stuck" message. I don't have a qfiles directory. In /var/lib/mailman3/ there are archives cache data lists locks messages queue templates web > Second, have you checked the other Mailman logs for information? Sure -- nothing there... > Third, are both lists visible in the message header as addressees? You mean in the header of the received message via list2? Yes it is. > Is the 'outgoing' qrunner still running? (ps ax | grep outgoing) no > Are there any subscribers with delivery enabled on 'list1'? yes > Is list1 configured to accept only member posts? If so, is the sender > a member whose posts are accepted? Yes. Anyway: there should be a reaction if there is a post from a non-member (i.e. mail shown in held messages, sender and admin being informed of it). > Is there a sibling list setting that would prevent the message from > being sent to the same address if it is on both lists? I don't think so. But also if it would be that couldn't be the problem, as my previous tests all only included list1. > Are the spam filter settings the same? No clue -- where do you set them? But once more: list1 was working fine as long as mailman21 was used and stopped working when switching to mailman3. I don't expect spam filters that worked with mailman21 to stop working with mailman3. > > How can I diff the config between list1 and list2 from the command > > line? > This doesn't seem to be implemented. I need to prep for some > meetings, but here's the basic strategy I'd follow: > > Use "mailman withlist -i -l list1". This puts you in a Python > interpreter command line. > Next "attrs = dir(m)" to get the list attributes as a list. Should this give an output? I get none... > Check "attrs" for things like the roster of subscribers that > you're not interested in printing out, and delete them. How? > Open a file as 'f', then loop over attr in attrs using > "print(f'{attr}: {getattr(m, attr)}', file=f)". I have more or less no Python knowledge (i.e. I can read and understand Python but can't write it). Could you please give me detailed command by command instructions. Thanks. Regards Diana

2 years, 8 months

[MM3-users] REST Runner (and other runners) taking long time to boot up

by Dmitry Makovey

splitting this discussion into it's own thread from "MM3 occasionally chokes (?)". Re-iterating background info for posterity: we have been experiencing increasingly long boot ups from mailman-core over the past year to the point where it's at about 45min for the sequence to complete. We run couple of mailing lists (20+) that are anywhere between 100 and 10K+ members and most of them are low traffic. From what I can tell all that time is spent doing some sort of indexing operations, I'm writing from memory since I can't restart the system to confirm that. sizes of directories that containers use: 3.6G core 352M database 285M web state of my queues (as far as I understand how to evaluate them: $ for q in core/var/queue/*; do echo ${q}; ls ${q}/ | wc -l ; done core/var/queue/archive 1 core/var/queue/bad 3845 core/var/queue/bounces 0 core/var/queue/command 0 core/var/queue/digest 0 core/var/queue/in 0 core/var/queue/nntp 0 core/var/queue/out 7 core/var/queue/pipeline 0 core/var/queue/retry 1 core/var/queue/shunt 958 core/var/queue/virgin 0 what kind of tuning should we be looking into to speed up our boot-ups? -- Sr System and DevOps Engineer SoM IRT

6 years, 1 month

[MM3-users] Re: Fwd: [Django] ERROR (EXTERNAL IP): Internal Server Error: /mailman3/hyperkitty/api/mailman/archive

by Mark Sapiro

On 11/20/20 8:24 AM, Gordon Dickens wrote: > My mailman3 installation has now been up and running successfully for > several weeks without any issues and then the following error message > was emailed to me by my server. > What's up with this error message and what do I need to do? > Thanks, > Gordon > > -------- Forwarded Message -------- > Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: > /mailman3/hyperkitty/api/mailman/archive > Date: Fri, 20 Nov 2020 01:25:41 -0000 > From: [1]root(a)host2.mailhub4u.com > To: [2]gordon(a)mailhub4u.com > Internal Server Error: /mailman3/hyperkitty/api/mailman/archive > OperationalError at /hyperkitty/api/mailman/archive > (1366, "Incorrect string value: '\\xF0\\x9F\\xA4\\xA3\\xF0\\x9F...' for > column `mailman3web`.`hyperkitty_email`.`content` at row 1") '\xF0\x9F\xA4\xA3' is a utf-8 encoding for the emoji '🤣'. For MySQL and MariaDB, 4-byte encodings require the database allow utf8mb4. If your Django database settings use the mysql database engine as in ``` DATABASES = { 'default': { 'ENGINE': 'django.db.backends.mysql', ``` You need to add ``` 'OPTIONS': {'charset': 'utf8mb4'} ``` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 5 months

[MM3-users] Re: How to delete an archive

by Abhilash Raj

On Wed, Sep 4, 2019, at 6:06 PM, Andrew Bernard wrote: > I deleted a list but I want to delete the archive as well. > > How do you do that? I know this is a big pain point for many people, but this doesn't work right now on MySQL, which is why I haven't been able to commit my fix for this yet :( > > Also, I had a list called Test. I deleted it. I made a new list called > Testing, with a different email address, bu the archive points to the > test list. This seems to be messed up. Why? I am sorry to say I have > had continuous trouble with many aspects of Hyperkitty from the > beginning several months ago. I know that is not helpful, but I am > starting to wonder about all this. Deleting a list doesn't delete the archives. This the default behavior and perhaps the user interface can be improved by optionally allowing deletion of archives. I created: https://gitlab.com/mailman/postorius/issues/382 > > Andrew > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years, 7 months

[MM3-users] Turned on archiving and it is not working

by bob B

I normally have archives not enabled on all my lists and I do not even have hyperkitty enabled for them. but I need to turn on archiving for one list and it is not working. I made sure hyper kitty is enabled for the list, and I have private archives enabled. I even restarted my environment (more on that in a moment) and still the list works but nothing gets archived. my mail log shows Jun 09 18:49:10 2022 (28) Exception in the HyperKitty archiver: <html><title>Auth required</title><body> <h1>Authorization Required</h1><p>The archiver key is now File "/usr/lib/python3.8/site-packages/mailman_hyperkitty/__init__.py", line 154, in _archive_message <h1>Authorization Required</h1><p>The archiver key is now <h1>Authorization Required</h1><p>The archiver key is now I am running in docker: my HYPERKITTY_API_KEY is the same in my docker yaml file for mailman-core & mailman-web (I am using an external database) mailman info GNU Mailman 3.3.5 (Tom Sawyer) Python 3.8.10 (default, May 6 2021, 06:30:44) [GCC 9.3.0] Hyperkitty web interface is working and I can log in so it is up HyperKitty version 1.3.5. This used to work when I initially installed, so not sure why it is broken now. Any thoughts on what to do next?

2 years, 10 months

[MM3-users] Re: Log rotation

by Abhilash Raj

On Tue, Apr 10, 2018, at 3:04 PM, Darren Smith wrote: > Hey everyone, > > So I have a question about log rotation... > > Our mailman.log has grown to over 5 gigs. It's time to add this to log > rotation. We added what we thought might work to the > /etc/logrotate.d/mailman script, but when we ran it with a -f, we learned > that the -f flag doesn't keep old logs. > > That in itself is fine - a normal scheduled log rotation won't have that > problem. > > My problem is that doing the rotation caused the mailman not to be able to > write to the log anymore. It appears that it no longer has a handle to the > file. You can send a SIGHUP to mailman's master process and it will reload all the log files. The PID of the master process is stored in "var/data/master.pid". > To overcome this with, say, nginx, there is a command in logrotate that you > can add that restarts the service. > > I have found, however, that restarting the mailman service can be VERY > problematic. There is so much going on that it takes a very long time to > stop, and I have seen several instances where the service never shuts down > cleanly - even after 3-4 minutes. The service thinks it is shut down, but > there are several threads that haven't yet completed. If they are killed, > then you have to go clean up the master.lck files etc. It seems like a bad > way of doing things and a good way to somehow corrupt data. Yes, this is a known thing and the reason for it is that the SIGTERM isn't delivered till the process wakes up next time. We can have the process sleep for a smaller amount of time to fix this, but then it would mean that it will be running much more often. It is the Retry runner, which has sleep_time set to 15m. I don't know if you want to retry very often, like 2min or 5min, but you can change it by adding the following snippet to your mailman.cfg [runner.retry] class: mailman.runners.retry.RetryRunner sleep_time: 5m > > Anyway - after rambling... > > 1) Has anyone come up with a good log rotation strategy that doesn't > necessitate a restart of the service? Manually SIGHUP the master runner is what I can think of the top of my head. A better solution would be to implement a "mailman logrotate" (or similar) command to do it, please free free to open an issue for it. > 2) Has anyone seen problems stopping and restarting the service? Is there a > way to help with this problem? Hope this is answered above. -- Abhilash Raj maxking(a)asynchronous.in

7 years

[MM3-users] Mailman 3 Installation

by bruce.dubbs＠gmail.com

I am trying to set up Mailman 3 on a new server. So far I have run: pip3 install Django==3.1.5 pip3 install postorius pip3 install Hyperkitty pip3 install mailman pip3 install uwsgi All that went well. I've been struggling with the configuration though. I am using /etc/mailman.cfg and that seems to be explained in the documentation OK. From there I am confused. I do have sqlite installed, but the documentation discusses mysql/mariadb and postresql. What are the considerations as to why I would need one of these other DBs? I think I can follow the instructions to set up postfix. In the section 'Configure Web Frontend', it discusses setting up the administrator. As I want to put Mailman on /srv/mailman I can create that, but what should the owner/permissions be? Later the docs discuss editing Django's settings.py. Where do I find that file? I'll note here that my experience with python is quite limited and my knowledge of Django is nil. Later in the section 'Set up HyperKitty', it sends me to a page that discusses installing it. I did that with pip3. Then it says to 'Setup your django project'. What django project is that. I would appreciate advice or a pointer to where I can figure this out. Thanks. -- Bruce

4 years, 3 months

[MM3-users] Re: very few moderation capabilities for moderators

by Mark Sapiro

On 9/16/21 2:39 AM, Guillermo Hernandez (Oldno7) via Mailman-users wrote: > Hi all: > > I need to provide the list moderators a way to change the moderation > flag for users from whichever it is (normally "list default processing") > to "hold for moderation" and viceversa (to "list default" or to "accept") > > I understand that it could be done via console script (That's the way I > did on mailman2: I made two commands using "withlist", one to hold, > moderar.py, and other one to accept, desmoderar.py. I show you below) Are you asking what the equivalent MM 3 scripts would be? > But I think I'm not the only one that could use as an improvement a way > to do this on postorius/web. Postorius allows a list owner or site admin to set Moderation for list members and non members at e.g. https://www.example.com/mailman3/lists/list.example.com/members/(non)member/. Currently, a list moderator who is not an owner cannot do this, but a moderator can set Moderation for the sender of a held post when handling the post. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 7 months

[MM3-users] Re: hello， Discussion on how to subscribe to the mailing list

by 朱超

At 2023-01-17 15:56:35, "Stephen J. Turnbull" <stephenjturnbull(a)gmail.com> wrote: >Mark Sapiro writes: > > > On 1/16/23 18:55, 朱超 wrote: > > > Hi, When I subscribe the email list in Subscription Policy is > > > confirm, Some problems happen in here： > > > 1.Some mail mua reject send the confirm the message, because the > > > length of recipient is too long. for exmaple: > > > requirements-confirm+9605556e0b35a5da280c1de0d34a3e6f770f8ea5@domain, > > > and the mail mua reject to modify about this. > > > > The default English template says in part: > > > > Before you can start using GNU Mailman at this site, you must first > > confirm that this is your email address. You can do this by replying to > > this message. > > > > Or you should include the following line -- and only the following > > line -- in a message to $request_email: > > > > confirm $token > > > > I.e. It gives an alternative method if `reply` doesn't work. You can > > provide a custom version of this template with different wording if you > > think you can improve it. > >The problem is the reply address, though. Changing the template to >suggest only the "confirm $token" in body method doesn't help people >who hit R expecting that should work, especially since many "user >fiendly" (misspelling intentional) MUAs don't display the address. >Avoiding that requires code changes, I guess? Yes, You got it. It is too cumbersome to ask the user to write a reply email for email confirmation. > > > > 2.It is inconvenient for users to use. Many people will > > > mistakenly think that after clicking the subscribe button, it > > > will be successful, and they will not process the email. > > > step, you can set Subscription Policy to Open, but then anyone can > > maliciously subscribe third parties to the list. > >*Please* do not do this if your server is exposed to the Internet. >There are bots that search for such servers, and sell lists of them to >people who want to DOS mailboxes. You may find yourself banned across >the Internet. > Yes.For service security, we will not set the Subscription Policy to open >The only real alternative to confirmation is approval by moderators. >I believe Mailman 3 offers that alternative as Mailman 2 did, can't >check at the moment. > > > > Regarding the discussion on the subscription method of the > > > mailing list, should we consider optimizing the subscription > > > method of the mailing list, for example: > > > 1. use the method of sending a verification code to subscribe by > > > email，When you receive the verification code sent by the > > > mailing list and fill it in again, you can subscribe > > > successfully。 > > > > How is this different from the present method. > >Just wording. I think they are thinking of the "invite" option that >was provided in Mailman 2 mass subscribe (again, I think Mailman 3 >retains it but I never ever used it so I don't recall for sure). But >it doesn't make sense for a user-initiated interaction. > > > If you want, you can make > > a custom template and include something like: > > > > Alternatively, you can confirm by going to the URL > > > > https://www.example.com/mailman3/lists/$list_id/confirm/?token=$token > >If I understand the OP's PoV correctly, I think I would change the >list information page to say "Send a personal invitation to join the >list to [email address here]. If you aren't a subscriber, you can >invite yourself." And change the word "confirm" in the confirmation >template to "subscribe". Why do you need to modify the mailman-core service， I suggest we should modify the code of the postorius, We can refer to postorius to reset the user password process， Detail, through the postorius to send email to user, and user click the url in email to confirm subscribe the email，Currently I have achieved it this way。 > > We don't include that in the default template because Mailman core > > doesn't know if you even have a web UI or how to access it if you > > do. > >We should fix that, at least if the web interface is Postorius >(wishlist, assigned to me): >https://gitlab.com/mailman/mailman/-/issues/1055 > >@mark >https://gitlab.com/mailman/mailman/-/issues/901 >Maybe we can close this? I'm not sure why it was left open since >there's no action proposed for Mailman improvement. > > > > 2. use the email to send a connection to confirm the > > > subscription，People click the link to be redirected to a > > > confirmation page to subscribe to the email。 > > > > See above. > >Indeed, AFAICS almost everything the OP is suggesting amounts to an >identical procedure as far as the Mailman server is concerned, it's >just described to the subscriber differently. The one exception is >the suggestion to eliminate the confirmation step, and while that is >supported, it's quite likely to cause problems for third parties and >eventually for the Mailman site unless you have an alternative ground >source of truth such as an employee database. > >Steve >_______________________________________________ >Mailman-users mailing list -- mailman-users(a)mailman3.org >To unsubscribe send an email to mailman-users-leave(a)mailman3.org >https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >Archived at: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > >This message sent to tom_toworld(a)163.com

2 years, 3 months

[MM3-users] Re: Configuring ARC with multiple domains in Mailman3

by Stephen J. Turnbull

Lance A. Brown writes: > I found a ... a dedicated service which handles the ARC sealing. > It's working nicely! Great! That's a perfectly acceptable solution, and you have access to the ARC-Authentication-Results which can be checked in Mailman's "Header Filter" configuration section with Header | Pattern | Action ARC-Authentication-Results | authserv-id=$SERVICE.*(arc|dkim)=fail | Hold where $SERVICE is a token provided by your service, I definitely recommend holding and checking the message if ARC failed. There's no safe reason for that to happen that I know of. DKIM and especially DMARC do fail for various reasons, so you have to judge if there are too many false positives. You can remove the "|dkim" part or add additional protocols with "|spf" (for example) inside the parentheses. > I was even able to turn off the DMARC munging on my test list > without problems. Be careful about this in production. Monitor your bounces and the RBLs, this is the kind of change that warrants a period of heightened attention. There are free "pull" services for multiple RBLs that you have to check, and of course you can pay for "push" services that do the monitoring and notify you of events. Steve

2 months, 2 weeks

[MM3-users] Re: mailman 3 adding extraneous /var/ to pid path?

by Barry Warsaw

On Sep 21, 2017, at 18:35, Abhilash Raj <maxking(a)asynchronous.in> wrote: > > On Thu, Sep 21, 2017, at 02:42 PM, Mark Sapiro wrote: >> On 09/21/2017 01:29 PM, Andrew Hodder wrote: >>> >>> I keep getting around this by creating symlinks to the pid file and then >>> the stop works, but it's getting silly. It seems like mailman just assumes >>> CWD + /var/ + master.pid must be the location. Once I realized this, I >>> found I can do "mailman stop" so long as I'm only in /opt/mailman/ (since >>> it'd then add /var/master.pid). But that seems a little nonsensical. >> >> That is the normal expected behavior if devmode is enabled. Check your >> configs for this. > > I don't think `devmode` has anything to do with this, it only disables > sending out emails by accident and routes all emails to a pre-defined > address. Haven't looked at the relevant portion of the source so I might > be wrong. That’s correct. The [paths.*] sections are what control the file system layout, and [mailman]layout is what defines which of the [paths.*] sections to use. Cheers, -Barry

7 years, 7 months

[MM3-users] Re: Setting archive_policy "private" using REST changes web UI setting Archive policy, but does not hide archive until UI Save

by Mark Sapiro

On 8/14/24 01:15, Henrik Rasmussen wrote: > I am working on disabling a list removing all members using REST and then setting archive_policy to "private" also using REST. This changes the UI Archive policy setting to Private archives as I would expect, but I just discovered that the (now previous) member, still logged in, and alså public (not logged in), still have access to the archive. It is not browser cache. > > At the moment I click Save in the UI settings/archiving, both logged in user and not logged in user (other browser) changed to "This mailing list is private. You must be subscribed to view the archives." on page reload. > > It seems that i need to click Save on every list having been changed, before the archive is hidden. Is that a bug? The daily Django hyperkitty sync_mailman job will probably do it. Or, you can figure out what REST calls saving the settings in Postorius does and do that. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 months, 1 week

[MM3-users] Re: Emergency moderation and clearing out a lot of held messages

by Mark Sapiro

On 4/28/22 13:09, bob B via Mailman-users wrote: > Mark, > Thanks for the Assistance but a little lost in the interpreter, and no luck googling. How do Iget back to the >>> prompt? > > I enter > > bash-5.0$ mailman shell -l maillistappha(a)XXXXX.org > Welcome to the GNU Mailman shell > Use commit() to commit changes. > Use abort() to discard changes since the last commit. > Exit with ctrl+D does an implicit commit() but exit() does not. > The variable 'm' is the maillistappha(a)XXXXX.org mailing list >>>> from mailman.app.moderator import handle_message >>>> requestdb = IListRequests(m) >>>> for req in requestdb.held_requests: > ... if req.request_type == RequestType.held_message: > ... handle_message(m, req.id, Action.discard) > ... > ********* This is where I am stuck ********** I hit return it takes me to a new line with no characters? how do i get back up a level to the >>> prompt to enter commit() You wait until it finishes processing the 30K messages and then you'll get the >>> prompt. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 11 months

[MM3-users] Re: list footer web customization procedure

by Mark Sapiro

On 12/10/21 3:45 PM, dancab(a)caltech.edu wrote: > Thanks Mark. We're using https:// for the URLs. Mailman 3.3.5 is what we're running. > > (mailmanve) mailman@14ea21f6d4b1:/var/www/mailman-www$ mailman conf |grep tasks > [mailman] run_tasks_every: 1h > > We're using two containers behind a load balancer for Mailman so I suspect this is where the lost cache comes into play. Yes. The cache entry is stored in the database which presumably is shared, but the actual cached data may only be stored in the file system of the server that cached it so the other server will think it's lost. Are you sharing Mailman's var/ directory between the two servers? I think you need to do that. > Would it be safe to increase the task frequency to every 15 minutes via the setting below? > > run_tasks_every: 15m I don't think that will do what you hope. It won't hurt, but the task runner only evicts expired entries, and they have a life set by cache_life in the [mailman] section of mailman.cfg (not to be confused with cache_lifetime set in the [dmarc] section) with a default of 7 days. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Re: Dump/restore users (with passwords) via API Update

by Simon Hanna

Please note that for authentication the frontend keeps it's own database. So the used usernames/passwords are not available in core and need to be restored from the frontend's database. So to migrate a mailman3 instance you need to migrate the data stored in core _and_ the data stored in the frontend/django. It looks like you are doing fine with the core stuff. I would recommend using django's builtin methods to do the rest. You are looking for dumpdata/loaddata. https://docs.djangoproject.com/en/2.1/ref/django-admin/#dumpdata Note the warning about the permissions and content-type tables. https://docs.djangoproject.com/en/2.1/ref/django-admin/#cmdoption-dumpdata-… If you haven't changed anything in these tables (You probably haven't) You can safely ignore these tables using the --exclude option during dumping. A manual method to restore Users can be found inline in this reply. On 9/26/18 12:20 AM, Conrad Holmberg wrote: > Hello: > Just an update and review on a previous thread and some progress. > > I'm trying to write a Python script to do the following: > > - Dump all the members from a email list within mailman instance > A. This includes the display name, email, password hash, and all the > preferences. The output is a json file. > > - Then we read this json file and create the user, membership to > the email list, and the preferences into mailman instance B. > > The problem is that we are trying to insert the members with the > password hash and NOT a new plain text password. > > A simple json dump example: > > { > "password":"$6$rounds=656000$QhEAT7XCQ9tyUmJV$cj2xv3GKd8UXdSSasMZdqe0NjUL4T751nBEkdubog55jzIY1iZ5AQ4aRVeJIi1jnS1CKHHJn6nVnW.Hz91Xvk.", > > "list_fqdn": "helpme(a)confused.com", > "display_name": "Bob Nobody", > "email": "nobody(a)nowhere.com", > "preferences": { > "receive_list_copy": false, > "hide_address": false, > "preferred_language": "en", > "delivery_mode": "regular", > "receive_own_postings": true, > "acknowledge_posts": false, > "delivery_status": "enabled" > } > } > > > The code for this within the mailman client API is pretty straight > forward. However, the method for create_member will not work for our > situation because the argument requires the password to be in plain > text to be encrypted later. The rest of the tasks (subscribing, > preferences) can be done with the mailman client with this single > exception. > > Now my question is irf someone can send a single piece of code example > or where to look to accomplish this. > > I see two options: > > Using the mainman core. I believe the modified code would be > something like this: > > user_manager = getUtility(IUserManager) > #with transaction(): > new_user = user_manager.create_user( > 'nobody(a)where.com', 'Bob Nobody') > new_user.password = config.password_context.encrypt('abc123') > #replace with hash > new_user.password = '$6$rounds=656000$tS8sTX' > > > So the password is set with the hash instead of the encryption method. > > Original code: new_user.password = > config.password_context.encrypt('abc123') As mentioned in a previous thread, the password that is stored in core, isn't being used anywhere. So saving/restoring it is of no use. > > > The other possible method is through django. However, I'm not really > sure where to being on this on as I've been looking over the > django-mailman3 and this is the only example I can find in > test_delete_account.py: That is the correct password to save/restore. the create_user method takes a plaintext password and hashes it. So you would need to do something like this: user = User() user.username = 'username' user.email = 'email(a)example.com' user.password = 'password-hash' user.save() Setting the password like this bypasses the hashing, which is what you want. > > def setUp(self): > self.mm_user = Mock() > self.mm_user.user_id = "dummy" > self.mailman_client.get_user.side_effect = lambda e: self.mm_user > self.user = User.objects.create_user( > 'testuser', 'test(a)example.com', 'testPass', > first_name="firstname", last_name="lastname", > ) > > self.client.login(username='testuser', password='testPass') > > Again, it appears that the password is encrypted somewhere else before > encrypted. > > Any help on this is greatly appreciated. > > > Thanks > > Conrad > > > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

6 years, 6 months

[MM3-users] Occasionally "The content of this message was lost."

by Frank Richter

Hello, occasionally we face the problem "The content of this message was lost." when handling a message on hold. We use the mailman3 packages on Debian 12: 3.3.8-2~deb12u2 GNU Mailman 3.3.8 (Tom Sawyer) Python 3.11.2 (main, Nov 30 2024, 21:22:50) [GCC 12.2.0] with postgresql, exim and Apache httpd on the same machine. To get closer to this problem we made 2 changes: /usr/lib/python3/dist-packages/mailman/app/moderator.py def _lost_message(mlist, subject, sender, message_id): # Create a substitute for a message not found in the message store. text = _("""\ The content of this message was lost. It was probably cross-posted to multiple lists and previously handled on another list. """) + # Don’t send an empty message to all members in case this event occurs. + # raise an exception instead: + raise Exception("_lost_message",subject, sender, message_id) /usr/lib/python3/dist-packages/mailman/runners/task.py def _evict_pendings(self): … messages = getUtility(IMessageStore) for msg in messages.messages: # msg can be None if file is already removed. if msg is not None: mid = msg.get('message-id') if mid not in mids: messages.delete_message(mid) # 2024-12-11 fri: Debug inserted + tlog.debug('Task runner deleted message %s', mid) count += 1 tlog.info('Task runner deleted %d orphaned messages', count) So let’s see what happens: A message sent to one list is set on hold: exim mainlog: 2025-01-28 14:10:23 1tclMF-00H6cW-1s <= user(a)s2024.tu-chemnitz.de H=vittal.hrz.tu-chemnitz.de (mail.tu-chemnitz.de) [2001:638:911:b01:134:109:133:32] P=esmtps X=TLS1.3:ECDHE_SECP256R1__RSA_PSS_RSAE_SHA256__AES_256_GCM:256 CV=no K S=9058 id=2f972b-6798d700-9f-5b841500@14907502 2025-01-28 14:10:23 1tclMF-00H6cW-1s => fsr-hsw(a)lists.tu-chemnitz.de R=lists_mailman T=mailman3_transport H=localhost [::1] C="250 Ok" 2025-01-28 14:10:23 1tclMF-00H6cW-1s Completed vette.log Jan 28 14:10:24 2025 (2602) HOLD: fsr-hsw(a)lists.tu-chemnitz.de post from user(a)s2024.tu-chemnitz.de held, message-id=<2f972b-6798d700-9f-5b841500@14907502>: The message is not from a list member A task runner deleted the message 5 seconds later: task.log Jan 28 14:10:29 2025 (2609) Task runner deleted message <2f972b-6798d700-9f-5b841500@14907502> Jan 28 14:10:29 2025 (2609) Task runner deleted 1 orphaned messages Later an owner/moderator want to do a moderation action: mailman.log: 2025-01-28 17:40:54 [FALCON] [ERROR] POST /3.1/lists/fsr-hsw(a)lists.tu-chemnitz.de/held/7544 => Traceback (most recent call last): File "falcon/app.py", line 365, in falcon.app.App.__call__ File "/usr/lib/python3/dist-packages/mailman/rest/post_moderation.py", line 155, in on_post handle_message(self._mlist, request_id, **arguments) File "/usr/lib/python3/dist-packages/mailman/app/moderator.py", line 144, in handle_message msg = _lost_message(mlist, subject, sender, message_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/mailman/app/moderator.py", line 104, in _lost_message raise Exception("_lost_message",subject, sender, message_id) Exception: ('_lost_message', 'Re: [Fsr-hsw] ...', 'user(a)s2024.tu-chemnitz.de', '<2f972b-6798d700-9f-5b841500@14907502>') Do you have any suggestions what we can do to find the reason, why the task runner deletes the message? Or any other hints … Thanks and kind regards Frank -- Frank Richter, Chemnitz University of Technology, Germany

2 months, 3 weeks

[MM3-users] Re: Running customized version of Mailman 3

by tlhackque

On 28-Feb-20 16:46, Alan Kelm wrote: > Since 2005, our organization has been running a customized version of > Mailman 2 with extensions that meet our particular needs. The main > novelty is support for /fixed subscription lists/, in which the list > members are predetermined (corresponding to a "committee"). Fixed list > subscribers are not offered the opportunity to unsubscribe, nor can > others add themselves to the list. A further enhancement is /hybrid > lists/ which, for example, have both a fixed and opt-in part. (This is > implemented as a fixed list residing within an opt-in one in a way which > is transparent to users). Our customizations consist of code > adjustments (patches) to 23 files. > > We are considering moving to Mailman 3 and would like to do this in a > way which makes it possible to periodically upgrade our installation to > the newest Mailman version, without clobbering our customizations. > Thus, I do not think that installing via "pip" is the right approach for > us. While I'm relatively new to git and GitLab, they seem to be ideally > suited to this situation. If I understand the developer documentation > correctly, I start out by creating a "fork" and can later "fetch" > changes from the master branch and "rebase" to bring them into our branch. > > I would welcome comments on what we are doing. I also wonder whether > others might be interested in support for "fixed lists", if they are > done in a way which can be "contributed" back into Mailman. > > I extend our "thank you" to the developers of Mailman who have provided > the robust system which has served us well for 15 years and provides the > possibility to extend this into the future. > > -Alan > FWIW: When I had similar requirements (MM2), I found it most convenient to populate the "fixed" list with a distribution list name. The distribution list was sourced from an LDAP group. That allowed the distribution to be populated based on job title, reporting relationship, committee membership - whatever. On the Mailman side, it's only one member (the distribution list) that had special treatment. Opt-in would be moderator approval, as was unsubscribe. But the moderator only had to remember the one "can't unsubscribe" name. That, or a variant might work for you - and probably can be done modifying fewer files... In minimal form, if you don't want to rely on a human, it seems like the minimal implementation is a "can't unsubscribe" bit for users and an admin interface to set it. You could also cause that user to have a different "language" - e.g. en-ZZ; then adjust the templates for that "language" to remove references to "unsubscribe". That's not functionally necessary - but prettier.

5 years, 1 month

[MM3-users] Re: How to get rid of footer (Mailman3)

by Mark Sapiro

On 2/11/20 11:31 PM, tarmokumar(a)gmail.com wrote: > Hi, I have read multiple posts in this forum that you should be able to get rid of the footer completely but I am unable to. > I have tried: > - adding the footer template to a list and not adding any "Data" to it. Result was a attachment with some "dfgdfgdfgdfg" text in it. Did you add this via Postorius. If so, it would seem to be a Postorius issue. > - adding/creating a blank "list:member:generic:footer" document to /var/templates/site/en, var/templates/lists/LIST.ID/en/ and var/templates/domains/DOMAIN/en/. Result is that the sent e-mail still has the original unsubscribe text in the footer (as an attachment) Did you name the file list:member:generic:footer.txt (with the .txt extension)? Putting a zero-length file of that name in any of those places should work. > - removing all the files from /mailman/src/mailman/templates/en, still no change If you restarted Mailman after doing this, this indicates something (Postorius?) may have set a URI for this template. What do you get from curl -urestadmin:restpass \ http://localhost:8001/3.1/lists/LIST.ID/uris -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 2 months

[MM3-users] Add domain to Mailman, can't create list with that new domain

by Andy Matthews

I'm testing locally to try and support additional domains. I can add new mailing lists with a domain: announce-123(a)mydomain.com I can't add a new mailing list with an alternate domain: announce-123(a)testing.com Following the documentation for domains I'm able to successfully add the new domain (locally) with the following steps: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/model/docs… 1. Shell into the mailman server 2. Shell into the mailman Python environment: mailman shell 3. Add a new mailing list. from mailman.interfaces.domain import IDomainManager from zope.component import getUtility manager = getUtility(IDomainManager) manager.add('testing.com') show_domains() # with method from the above documentation URL <Domain testing.com> <Domain mydomain.com> But then when I run a cURL command (from the mailman server) to add a list with that new domain I get an error: $ curl -k -u restadmin:restpass -X POST -H "Content-Type: application/json" --data '{"fqdn_listname": "new-list(a)testing.com"}' https://0.0.0.0:8001/3.1/lists {"title": "400 Bad Request", "description": "Domain does not exist: testing.com"} Am I doing something wrong, or missing a step? If not, how do I add support for additional domains such that I can provide mailing list support for that domain?

6 months

[MM3-users] Timeouts

by tlhackque

On 25-Apr-21 18:08, Mark Sapiro wrote: > On 4/25/21 2:20 PM, Andrew Hodgson wrote: >> Hi, >> >> Hyperkitty 1.3.4. >> >> I am trying to download a complete list mbox by going to all threads view >> and using the download option. I have tried a couple of tools (Gunzip and >> Winrar) and both are giving me an unexpected end of file when trying to decompress the gz file. >> >> Here is the list URL I am using: https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil… > Depending in the web server configuration, timeouts can occur when > downloading large archive mboxes. instead of downloading the entire mbox > with > <https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil…>, > do it in pieces by adjusting start and end. e.g. > > <https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil…> > > <https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil…> > > <https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil…> > > > Although, I don't think timing out is the issue, and I'm not sure what > is, but I think it has something to do with messages in the archive. If > I try to get the 3 pieces as above, the first piece with > start=2008-02-19&end=2012-12-31 works but the others don't and even the > smaller > > <https://lists.hodgsonfamily.org/hyperkitty/list/plextalk@lists.hodgsonfamil…> > > fails the same way. > > If I try to get 2013 month by month, all work except December which > gives me an internal server error. What's the traceback from that error. > The described timeouts are something that hyperkitty ought to be able to avoid. For apache, the timeout is idle time between blocks of output. Hyperkitty can avoid this by generating the archive in segments (based on size, or elapsed time), flushing its output buffer, generating a multi-file archive, and/or using Transfer-Encoding: chunked (chunked doesn't work for http/2). It ought to be able to break the work into blocks of "n" messages & do something to generate output. Besides avoiding timeouts, working in segments allows the GUI to display meaningful progress (e.g. if you're loading with XMLHttpRequest, "onprogress") It really oughtn't be up to the user to break up the request. Until then: the apache directive is "TimeOut" (or "ProxyTimeout"), with a default value of 60 (seconds). It's a server config/virtual host parameter, so if you're running in an environment where you only have .htaccess, you need admin help or you're out of luck. Other webservers (especially those with accelerators) may have more granular timeouts.

3 years, 11 months

[MM3-users] Re: Filter who can send on mailman3 list?

by Mark Sapiro

On 4/7/21 11:27 PM, Marcus Granath wrote: > It seems like the version used is: Postorius Version 1.1.2 Current Postorius is 1.3.4. If you can't upgrade, someone with shell access to the server can do this with `mailman shell` > What I basically want to achieve is that my "sendmail" script (executed from linux) will send announce-mails to this mailing list - and will set an "pseudo-address" (not my own name and address) as sender of this e-mail, i.e "ABC Announcement <no-reply(a)abc.com>" - and to get this "pseudo-mail" to be one of the accepted users (together with me and some team mates with real addresses) to send on the list - one option I understood was to use the "non-member" user for this "ABC Announcement <no-reply(a)abc.com>". > > But in my web-interface (as described above), I cannot find where to add and manage such user (non-member). > Or can I use some other API (then the web-page) to do that kind of operation? ;-) Just add the no-reply(a)abc.com address as a member and set its delivery status to disabled. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years

[MM3-users] Re: Mailman 3 Keeps Forgettings Imported Lists

by Ryan McClung

That explains a lot. Is there any documentation you can provide to show me where I can set a static config/db? On Tue, Jul 31, 2018, 4:22 PM Mark Sapiro, <mark(a)msapiro.net> wrote: > On 07/31/2018 12:39 PM, Ryan McClung wrote: > > I do see the output of the script and it shows the mailing lists being > > created. If you put "${VARIABLE}"@domain.com it outputs correctly. > > > > Also, to that end, the output of lists changes depending on which > directory > > I am in which makes 0 sense. > > > That is the problem. Either your mailman.cfg does not specify a fixed > directory for var_dir or the mailman command(s) you run do not specify a > fixed mailman.cfg. > > If you look, you will probably see a var/ directory is every directory > in which you ran a 'mailman' command and they will all have different > databases, etc. > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >

6 years, 8 months

[MM3-users] Re: Updating from Ubuntu-20.04 LTE installation

by Abhilash Raj

On Sat, May 23, 2020, at 8:28 PM, Mark Sapiro wrote: > On 5/23/20 7:02 PM, Peter Adebahr via Mailman-users wrote: > > > > Our installation was done by "apt-get install" in Ubuntu 20, thus still > > running MM 3.2.2 (and python 3.8.2). > > > > Do you have any advise, how to upgrade from there to your current > > version? I know this might be a bit dangerous, but with today's VMs the > > risk is much less than it used to be: > > > It shouldn't be difficult, but I can't give you details because I don't > know exactly how the Debian/Ubuntu package installs things. Also I don't > know whether "current version" refers to the 3.3.1 release or the head > of the https://gitlab.com/mailman/mailman master branch. > > > > Do you think it would be possible, just to replace the code and library > > parts, keeping the database and config files as is? > > > Yes. It should be fairly straightforward. You first need to find where > the Mailman Core package is. You should be able to just replace the > contents of the `mailman` package directory with ours. You may be able > to do this via pip > > pip install --upgrade mailman > > globally or within Mailman's virtualenv if it is installed in a virtualenv. This is probably not a good idea, global install quite often breaks a lot of stuff (Like I broke Yum on my work computer since I wanted something newer than 10yo python packages). A better idea would be to install Mailman from scratch inside a virtualenv somewhere in /opt/mailman and then letting it consume the same configurations. I think Ubuntu/Debian have their configurations in `/etc/mailman3/` and Mailman Core installed anywhere should just pick that up without any special work. Same goes for Postorius/Django stuff. You can switch to a different Django project and just point to Debian/Ubuntu's settings.py (location of which should be in README.debian of the Debian package I presume). > However, there are caveats. There are Debian patches at > <https://sources.debian.org/patches/mailman3/3.2.2-1/>. The big `0002` > patch replaces importlib_resources with importlib.resources because > importlib_resources is not available in Debian. Most of the patches > apply to tests, and for the actual working code, we fixed this > differently as of Mailman 3.3.1, so I don't think you need the Debian > patches. > > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

4 years, 10 months

[MM3-users] Re: Implementing threading [was: hyperkitty failed to create a thread]

by Stephen J. Turnbull

tlhackque writes: > No. It's not an address. "local part" has to do with an address. in a > Message-ID, It's syntactically a local-part or other stuff. RFC 5322: 4.5.4. Obsolete Identification Fields The obsolete "In-Reply-To:" and "References:" fields differ from the current syntax in that they allow phrase (words or quoted strings) to appear. The obsolete forms of the left and right sides of msg-id allow interspersed CFWS, making them syntactically identical to local-part and domain, respectively. > It's in "id-left", which is a supposed to be something generated by the > host that makes the message unique within the namespace defined by > "id-right". Right, those are the *semantics recommended to implementers*, for the reasons which you summarize accurately. But a validating parser doesn't care about that. > Treat the whole thing as an opaque string. Nothing else is safe. s/else// and I'll agree with you. But safety is not an issue in threading (except for DoS if the procedure might be non-terminating; I suppose you could argue DoS if a user misses an out-of-order mail from their boss and gets fired :-). > Yes, but did you fix the References header to match? Of course I did. :-) That was long before I was a Mailman developer and started reading the RFCs, also of course. > Yes, but you brought up the news RFCs, IIRC in saying that they defined > threading. Actually you brought up the news RFCs. I was wondering why. I guess it was to argue (implicitly) that there's a bug in the 2822 (and 5322) spec, and that 5537's solution tends to muck things up? > My quote was verbatim. 5537 does say you must trim. The point is that > the news rfcs may have introduced References, but they have different > obstacles to reconstructing threading. I don't think that's right, because mail suffers from the same line length restriction, with no exception for References. Mail just has strictly more specification bugs. :-( > I haven't looked at that. Given the trimming in 3.4.4 of 5337, I don't > see how this can be produce the whole thread, unless you are guaranteed > to have the complete thread to fill the gaps. It can't because you aren't. But it seems unlikely that anybody is producing msg-ids longer than 74 characters, so 998/(74+1) - 1 = 12 is a long enough gap that you probably don't care that they're the same thread. At least not in any forum I participate in! It's true that an MUA that doesn't produce either References or In-Reply-To will necessarily break threading, and that "enough" missing messages can do so. But both are pretty uncommon in my experience. Even AppleMail gets those right AFAICT. ;-) > Plus, you can lose messages for strange reasons: The moderator > deleted one for inappropriate content. A message was copied to the > list and the poster. The response to the list is lost. But a > reply from the poster happens later. So the response in question > is never seen by the server, though the reference is. Life is hard > :-) > Sure, but Jamie's algorithm *will get that right*. What remains is a UI question: missing message placeholder, to display or not to display? > Heuristics are fine. Guaranteeing that the resulting algorithm > terminates is important. But real life doesn't get you to "enough > messages" 100% of the time. 100% isn't necessary. If the thread is sufficiently broken that Jamie's msd-id-based procedure doesn't work, his full algorithm falls back to your idea of collecting the singletons by subject and sorting. (He doesn't specify the ordering criteria, rather what objects (= subthreads of the same parent) are to be compared. Your suggestion of date seems most appropriate for the leftovers.) > > > See my other post. The left and right halves can, besides being atoms, > > > be non-folding quotes or literals. So you have to handle that. > > > > Of course, but that's just a SMOP. The harder problem is figuring out > > what to do about non-conforming input. > And, as I've noted: lost input. Lost input does not prevent thread reconstruction as long as (1) all messages have a Message-ID, (2) "enough" messages have a non-empty References containing "enough" msg-ids, (3) those References do not misorder the msg-ids or introduce msg-ids corresponding to messages not in the thread. It should be obvious why I don't want to define "enough" (except in terms like "enough means Jamie's algorithm can reconstruct the thread" ;-), but in particular losing *one* message will certainly not prevent reconstruction. > When they don't, trying to guess at the semantics of an opaque ID will > seem to work for a while. But it amounts to the halting problem. There > are lots of variants of "generate a globally unique ID with an '@' in > the middle". I may have created a new one today :-) The problem I'm trying to address with the "stripping" is incorrect copying of msg-ids by MUAs that try to parse them, as we saw here. Apparently the bug was in Mailman itself, so it's not required, I guess. > Yes. But if they're well-formed, the <> are there, so stripping them > only saves a couple of bytes. > > If they're not, all bets are off. <two<three(a)example.net> - stripping > the outer <>s doesn't help. > > <"two<three"@example.net> is a valid message-Id, > and distinct from <"twothree"@example.net. Sure. Is it likely? > <twothree(a)example.net> distinct from <"twothree"@example.net>? > (unnecessary quoting, or a distinct message-ID) If you treat it as > opaque, you don't care. Take the whole thing, <@> included, as given > and look for it in the other fields. The most you might do is remove > quotes (and escapes) and use the left and right parts as your key. Which is basically what my stripping and cleaning procedure would do. The question is "does it help or hurt, on net?" If there was a widely distributed MUA out there that doubled the delimiters, it would help. Since it was Mailman doing that, it's a bad idea. > You could also fingerprint the user agent (e.g. by the order of headers, > format of message-ID), and correct for its bugs. But I'm inclined to > report client bugs and get them fixed. Meantime, their messages are > unthreaded (but not lost). It's just not worth working around other > people's bugs - there are better uses for your time. That's not my experience. See Reply-To munging. Depends on the bug, of course, but all too often people think it's our job to help them deal with bad MUA design. > Yes. A message ID should exist. These days I think all MTAs will assign > one if the client doesn't. > What I tried to say was that there will be times where you can't figure > out where to put a message into the thread graph (or forest). Because it > references message that you can't find, or it doesn't have a references > or reply-to, or those fields are corrupt. None of those prevent you from threading that message. The only reasons you won't be able to thread a message at all are when no other available message references it (eg, if several MUAs in a row supply In-Reply-To but not References, and the middle messages are missing or their identification fields are corrupt), and when there are References that have conflicting opinions on where that message belongs. Of course if a message lacks References and In-Reply-To it will be identified as a thread root (unless some descendent manually corrects References ;-). Even then it could be grafted into the tree more or less correctly using your sort on subject and date procedure. > These are heuristics - you might come up with better ones. Yours are already implemented in Pipermail, I believe, I'm not sure about HyperKitty. I don't think Jamie's algorithm messed with [name] and [serial number] because they weren't common at that time, but he stripped Re: and its nonconforming variants, as well as "Fwd:". > At least with an orphans bucket, you don't end up with "invisible" > messages. Nothing I suggested produces invisible messages, just a different set of orphans or occasionally a misthreaded message that seems to be a duplicate if different msg-ids are munged to the same string. At least not in Jamie's algorithm. I don't know exactly what algorithms are used in Pipermail and HyperKitty. Interesting discussion, but I've reached the point of diminishing returns. I will be checking to see if any of your suggestions are improvements over what HyperKitty currently does.

6 years, 2 months

[MM3-users] Re: Installing mailman 3

by Rafael Mora

Hi Abhilash, I started to setup Postfix (I don't know if that is the suggested and easy to use mail server) doing the steps on the website http://docs.mailman3.org/en/latest/config-core.html which tells: Postfix <http://www.postfix.org/>: To setup Postfix, add the following configuration to master.cf: # Support the default VERP delimiter.recipient_delimiter = +unknown_local_recipient_reject_code = 550owner_request_special = notransport_maps = hash:/path-to-mailman/var/data/postfix_lmtplocal_recipient_maps = hash:/path-to-mailman/var/data/postfix_lmtprelay_domains = hash:/path-to-mailman/var/data/postfix_domains I added that config at the bottom of the master.cf file and did a 'postfix reload' and I got this error message: [root@localhost ~]# postfix reload /usr/sbin/postconf: fatal: file /etc/postfix/master.cf: line 129: bad field count postfix/postfix-script: fatal: cannot execute /usr/sbin/postconf! What do you suggest??? Thank you El jue., 20 jul. 2017 a las 14:09, Abhilash Raj (<raj.abhilash1(a)gmail.com>) escribió: > Hi Rafael, > > On Wed, Jul 19, 2017, at 01:49 PM, Rafael Mora wrote: > > Hello, > > > > What are the suggested steps in order to install the web UI ?? > > I haven't read through this entire thread but I understand that you are > having problems with multiple configuration files for Core and setting > up the Web UI. > > The installation guide at docs.mailman3.org should now have a > "Pre-Installation Guide" and another new section called "Configuring > Mailman 3". Please make sure than you read both of them along with the > "Installation Guide" They have more information about how to setup > Mailman 3 after you have installed them so that it becomes function. > > Also, your original question's answer can be found there. It has > instructions about how to setup your Django project, which is the what > the Web frontend for Mailman 3 is based on. > > > > > Thanks > > > > El sáb., 15 jul. 2017 a las 19:28, Kyle Richardson (< > > kylerichardson2(a)gmail.com>) escribió: > > > > > There must be another config file being picked up. Have a look at the > > > mailman.cfg search order explained here [1]. > > > > > > My guess is that /etc/mailman.cfg exists. Do a 'find / -name > mailman.cfg' > > > to be sure. You'll want to delete any in the search path and then rerun > > > 'mailman info'. > > > > > > [1] > > > > http://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html > > > > > > -Kyle > > > > > > -- > > > > Atentamente / Best Regards > > > > Ing. Rafael Mora > > _______________________________________________ > > Mailman-users mailing list > > mailman-users(a)mailman3.org > > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > > > -- > thanks, > Abhilash Raj > -- Atentamente / Best Regards Ing. Rafael Mora

7 years, 9 months

[MM3-users] Re: Auth question

by David Krantz

On Fri, Mar 31, 2017 at 9:29 AM, Simon Hanna <simon.hanna(a)serve-me.info> wrote: > On 03/31/2017 08:10 AM, David Krantz wrote: >> I think that would correspond to this line in urls.py >> >> url(r'^$', RedirectView.as_view(url=reverse_lazy('hyperkitty.views.index.index'))), > Yes, that's the culprit. Replace it with the following: > > url(r'^$', RedirectView.as_view(url=reverse_lazy('hk_root'))), > You can also update whatever guide you were using... Great, will try that! I don't know whether I can update the guide. It's the one referenced earlier in this thread named something like setup experience of mailman 3 in production. >> Then I of course have things to do on getting social logins to work. I >> currently get "DoesNotExist: SocialApp matching query does not exist." >> if trying to connect an account to google (which I started with). Not >> a showstopper as passwords do work. > Did you follow django-allauth's guide on setting them up? No, I haven't found that yet, I just followed the config examples as those seemed reasonable (although my knowledge of Django is quite limited so I am not a good judge of that of course). Will try that as well. Any particular known to work nice with the django setup used for mailman applications? // David

8 years

[MM3-users] Re: clicking on a username when viewing a thread results in "Page not found"

by Mark Sapiro

On 6/26/23 9:26 PM, Ken Alker wrote: > Mark Sapiro wrote: >> This is a problem. That link goes to, e.g., >> https://example.com/archives/users/<user_id>/. What do you get if you >> strip the user_id and just go to what >> https://example.com/archives/users/ translates to on your system? >> You should get a page saying >> Not implemented >> >> This feature has not been implemented yet, sorry. >> >> If you get a 404, there is an issue with your web server configuration >> or maybe your top level urls.py. > > I get "Not implemented". I do not get a 404 error. That indicates there is some corruption somewhere. I need to research it to figure out where, but the issue is the <user_id> in https://example.com/archives/users/<user_id>/ doesn't exist. Are the crons - https://docs.mailman3.org/en/latest/install/virtualenv.html#cron-jobs-for-m… running? If they are, the hyperkitty sync_mailman job should run daily and might fix this. You can also run `mailman_web mailman_sync` manually. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 9 months

[MM3-users] Re: configuring postfix local recipient table

by Mark Sapiro

On 4/23/25 9:25 AM, Stephen J. Turnbull wrote: > Alexander Inzinger-Zrock via Mailman-users writes: > > and then i just found out that my postfix_lmpt file was empty > > 1. What database are you using?[1] Is it running? If not, yes, that > file is going to be empty. > 2. Do you have any lists configured for your Mailman 3 instance? If > not, that file will be empty. > 3. Is Mailman running? (This probably isn't necessary, just > checking.) > 4. Is there a postfix_lmtp.db file in the same place? (Postfix will > not read the plaintext version, it must be a .db file.) If you haven't set `incoming` in the `mta` section of mailman.cfg to other than the default `mailman.mta.postfix.LMTP`, the `mailman aliases` command will at least write ``` # AUTOMATICALLY GENERATED BY MAILMAN ON {} # # This file is generated by Mailman, and is kept in sync with the binary hash # file. YOU SHOULD NOT MANUALLY EDIT THIS FILE unless you know what you're # doing, and can keep the two files properly in sync. If you screw it up, # you're on your own. ``` to the postfix_lmtp file. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

21 hours, 5 minutes

[MM3-users] Re: I don't get my posts with Gmail

by Stephen J. Turnbull

Allan Hansen writes: > I was pleased to see the advice below on how to get your own list > messages sent from a Google client, as my subscribers complain > about their messages going AWOL all the time. > Do those messages really show up in the spam folder without this > filter? (I don’t use Gmail). No. They don't show up *at all*. GMail puts a copy of the sent mail in the sent folder, not in the INBOX. Because it has not left the MUA, it has no trace header fields at all, only the fields required by RFC 822 plus any fields the user has populated. This makes it completely useless for debugging mail problems. It then discards the post returned from the mailing list. > If so, then the server is, indeed, sending the message to the mail > client, I'm not sure what you mean by the server. If you mean the Mailman list, yes, it is sending the message in the case in point. > and the mail client is doing the message ID linking locally, > discarding the incoming duplicate. "Mail client" is ambiguous here. There are a large number of roles involved, any of which may be implemented as a separate program (and the user is always a separate program ;-). 1. User == you. 2. Message user agent (MUA), which fetches messages from a message store (file, maildir, POP server, IMAP server), displays it to the user, and provides commands for the user to manipulate the message in various ways. 3. Message store, which keeps a database of messages received from the message delivery agent. 4. Message delivery agent (MDA), which accepts messages from the message transfer agent, and delivers them to applications such as message stores. 5. Message transfer agent (MTA), which accepts messages from the Internet, and delivers them to the MDA. Duplicate handling (which is a special case of filtering) can be implemented in any of those roles, but we can assume the user is not doing it. If she were, we'd just tell her to stop. > Would a change in mail client solve that? No, the issue is that users want to use a particular client, Gmail. Even if they're willing to change: > If so, then problem solved by a work-around. > If not, then how can the filter above work? If user-defined filters are implemented in the same program as deduplication, then they're just alternative targets for delivery, where deduplication uses the target /dev/null. If the user says "send those messages to a particular folder," that should override the program's defaults. What seems possible here is that Google implements message filters in the message store, and deduplication in the MDA. In that case the filter can't work. But you'd have to ask Google to be sure. Steve

4 years, 6 months

[MM3-users] Re: How to store additional information about lists?

by jonathan.mailing.lists＠gmail.com

Andreas Barth wrote: > I need to add custom attributes to the mailing lists: > "responsible department": Free text field who is responsible from an > organisational pov (not a person but an entity) > ... > Any hints how to do that best? Is it possible to store custom > attributes, or should that be stored elsewhere? It's possible to do something similar with Mailman 2 - see "Bob's Unofficial Mailman Tricks & Tips" at http://nleaudio.com/bnotes/mailman.htm - I've been using it for years. In my case it's like the Systers subscription page that Steve mentioned - something to help me decide whether to accept the subscription request, rather than something that I need to store in a database. When I looked at Mailman 3 last year I made a short custom subscription form which included a custom field, and a script to email it to me then send an email to the listname-subscribe email address. (I think I must have edited the MM3 confirmation link too because I've found a script that takes URL parameters, and sends a confirmation email to an address created from listname-confirm+ and the relevant token. I can't remember whether that was linked to having the custom field script.) Best wishes Jonathan

3 years, 11 months

[MM3-users] Re: Docker or virtualenv?

by Andrew Hodgson

Tim Cutts <tim(a)thecutts.org> wrote: >I’ve used docker on my setup. I have been wondering about this though, it causes me to need to run an AWS VM continuously to run my mailing lists, and that probably isn’t really necessary. I do sometimes wonder whether docker might be a better approach and run it under ECS, so I no longer have to >look after a VM. >Even better, MM3 is just a bunch of python functions at the end of the day, and it doesn’t *need* to be running continuously. Mailing lists are, more or less by definition, event driven. Has anyone considered whether it’s feasible to turn it into a bunch of Lambda functions with a serverless database behind >it? I actually moved from Docker to Virtualenv on my machine as I wanted to use the same larger VM to run a Cloudron instance which takes over Docker. Overall I have been more happier with the virtualenv approach as it allows me to customise the install more easier. I did look at running Mailman using Azure Container instances. The main thing here is we need to get the MTA integrated, and the MTA needs to send out emails from a static IP address with reverse DNS etc setup. This isn't easy to do on anything other than a VM. Thanks. Andrew.

2 years, 3 months

[MM3-users] Re: Mailman sends Welcome emails, but does not send [List] postings emails

by justfixit＠marilynstrother.com

Very interestng! Upon restarting the system (down momentarily for taking a snapshot) and starting Mailman again, all of these missing [List] messages emerged from their timewarp and were delivered to the members / subscribers. Just before shutting down the system I discovered that the apache2 webserver had been off the air due to a module not being enabled yet. As of yet, I was unaware of any requirement for a web server to be online (beyond possibly gunicorn) in order for Mailman to run its lists. Does that speculation have a factual basis? Or do I risk starting a vicious rumor amongst the impatient readers who are not still here once we deduce this pair of observations were merely correlated in time, with no cause-and-effect relationship? Before this situation healed itself, the thought had crossed my mind to peek and see if anything was stuck in the queues: https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… While that could have provided peace of mind that email messages were merely delayed instead of vanished, even in hindsight I do not see how that would have led to repairing the situation. In the absence of a hypothetical command: mailman status --verbose about which diagnostic tools or clues should I learn?

1 year, 10 months

[MM3-users] Re: Loops back to myself

by Stephen J. Turnbull

simonjwiles(a)gmail.com writes: > Grateful for any insight you can offer! Thanks! Have you asked Postfix channels? I don't think this is a Mailman problem, and they would recognize the issue faster than we do. The first thing I would do is grep /path/to/mailman/var/data/postfix_lmtp for the looping address. If it's not in there, then Mailman is not involved in the loop. I'm pretty sure that what's happening is the domain is recognized because it's in relay_domains, the transport maps are consulted, the address lookup fails, the transport defaults to relay_transport, which defaults to relay, which is in fact smptd, which recognizes a loop because the source and next-hop are both self. Voila! From the ADDRESS_CLASS_README: Valid recipient addresses for [relay_domains] are listed with the relay_recipient_maps parameter. The Postfix SMTP server rejects invalid recipients with "User unknown in relay recipient table". If this parameter value is empty, the Postfix SMTP server accepts all recipients for domains listed with the relay_domains parameter. [Ie, you're an MX for those domains.] I guess relay_recipient_maps = hash:/path/to/mailman/var/data/postfix_lmtp will fix this problem assuming the error message above is acceptable. I can't guarantee it won't cause other problems, though, depending on whether your host provides other services to those domains. Steve

1 year, 3 months

[MM3-users] Re: how do I bulk-remove users from ML in MM3?

by tlhackque

On 25-Oct-17 12:05, Simon Hanna wrote: > Postorius is currently using this to mass unsubscribe. > AFAIK there is an open issue in core to add such functionality Yes, see https://gitlab.com/mailman/mailman/issues/419 Yes, the current API has a number of scaling issues. Delete is bad, but other operations can require multiple API calls... (e.g. get state to conditionally create; create+patch; create user+create subscription, ...) https://gitlab.com/mailman/mailman/issues/367 (and others) Mass modify is also missing - https://gitlab.com/mailman/mailman/issues/241 notes one such case. > On October 25, 2017 5:59:46 PM GMT+02:00, Dmitry Makovey <dmakovey(a)stanford.edu> wrote: >> On 10/25/2017 07:35 AM, Barry Warsaw wrote: >>> On Oct 25, 2017, at 03:08, Dmitry Makovey <dmakovey(a)stanford.edu> >> wrote: >>>> I just realized that "mailman members" only offers to "add members" >> via >>>> "-a filename" but I see no remove option. >>> It’s true, `mailman members` doesn’t currently have a —remove option. >> I found Rest API call for single user removal but I am questioning it's >> effectiveness given that I need to use this operation to potentially >> remove 1500 members >> >> -- >> Sr System and DevOps Engineer SoM IRT

7 years, 5 months

[MM3-users] Re: mailman3 auto-disabling of subscriptions

by Mark Sapiro

On 6/16/23 22:14, Stephen J. Turnbull wrote: > > @Mark > I've been seeing an unusual number of disabled subscriptions on > python.org and mailman3.org lists recently. Maybe we should look into > this. If you haven't seen this O365 breakage, I can send you some > samples. I haven't noticed this. I do receive notices when delivery is disabled, and I generally look at the attached DSN, and I don't recall any that have this issue. We do have an issue with mailman-users(a)mailman3.org messages for five users in the outlook.com, msn.com and hotmail.es domains. These are all since the server was moved last month and are all for the reason 550 5.7.1 Unfortunately, messages from [165.227.190.41] weren't sent. Please contact your Internet service provider since part of their network is on our block list (S3140). You can also refer your provider to http://mail.live.com/mail/troubleshooting.aspx#errors. [VI1EUR05FT020.eop-eur05.prod.protection.outlook.com 2023-06-17T05:14:54.401Z 08DB6E025E06C828] with differences only in the bracketed part at the end. The same five addresses keep getting disabled because I keep re-enabling them, and I have contacted Microsoft about this, so far with no results. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 10 months

[MM3-users] Re: How to identify the exact reason behind the shunting of the mails ?

by Mark Sapiro

On 6/18/21 6:48 AM, Shashikanth Komandoor wrote: > Dear Mark, > > FYI, I observed this issue with the postfix that receives the > mails from the previous MTA and hands it over to the mailman. But I fixed > at postfix by upgrading it to the version postfix 3. > > But still Mailman is not able to understand Hindi (Indian local > language) in which language the display names of the email ids are there. > > So, now what to do at Mailman so that it can also understand > local languages or any work around or other alternate solutions for these > sort of cases. As noted in my reply at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… the issue is a Mailman bug which is fixed in the next release. It has to do with the fact that the display names are RFC 2047 encoded and not the particular encoding. Actually, the fix at https://gitlab.com/mailman/mailman/-/merge_requests/841 depends on https://gitlab.com/mailman/mailman/-/merge_requests/652 which was released in Mailman 3.3.2. A complete patch for versions < 3.3.2 is attached. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 10 months

[MM3-users] Re: Hacking attempts?

by Stephen J. Turnbull

Lists via Mailman-users writes: > No, we’re nothing to do with Fedora, we just run a few low volume > mailing lists for our members. I would disable the fedora auth application as described in my previous mail, then. I wouldn't worry too much about the possibility that there are users of the feature, if there are people with Fedora accounts, they are sophisticated users who know how to request it be reenabled. > Happy to send you example error emails, I received 1,987 in the > past 24 hours. They seem to come in waves, it’s particularly bad > right now, but it will die off to a lower level for a while, then > hit a peak again in a week or so. This is how it would behave if web crawlers are the problem. Do you have a robots.txt file? If so, is your Django site protected? https://developers.google.com/search/docs/advanced/robots/intro https://robotstxt.org/ Note that if you decide to adopt Tim's suggestion of fail2ban, you probably need a robots.txt file, if there's *anything* on your site that you want indexed, you don't want the crawlers banned. > Let me know how many examples you want and I will send them direct > to your email. OK, but first let's try the low hanging fruit. Steve

2 years, 9 months

[MM3-users] Re: Deleting A List

by Odhiambo Washington

On Fri, May 3, 2024 at 11:48 PM Mark Sapiro <mark(a)msapiro.net> wrote: > Mark Sapiro wrote: > > > update hyperkitty_email set mailinglist_id = 2 where mailinglist_id = 13; > > update hyperkitty_mailinglist_owners set mailinglist_id = 2 where > > mailinglist_id = 13; > > update hyperkitty_mailinglist_moderators set mailinglist_id = 2 where > > mailinglist_id = 13; > > update hyperkitty_thread set mailinglist_id = 2 where mailinglist_id = > 13; > > delete from hyperkitty_mailinglist where id = 13; > > update hyperkitty_mailinglist set name = 'list(a)lists.nog.ke', list_id = > > 'list.lists.nog.ke' where id = 2; > > Or instead of that you could just go to the new list(a)lists.nog.ke > archive in HyperKitty and delete it and then just do the > ``` > update hyperkitty_mailinglist set name = 'list(a)lists.nog.ke', list_id = > 'list.lists.nog.ke' where id = 2; > ``` > I went with this approach and worked super! Thank you. So, seeing as deleting a list retains its archives, if I want to delete a list together with its archives, do I first delete the archives, then follow with the list? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

11 months, 2 weeks

[MM3-users] Re: bulk deletion of messages from Hyperkitty

by Ron

On 2024-07-10 12:05, Danil Smirnov via Mailman-users wrote: > After importing from Mailman 2, thousands of badly compiled messages > from the past appeared with empty content on the same date (date of > import). > > Is there a safe way to delete them all? If we delete them from the > database - hyperkitty_email table - do we need to do some clean-up > of hyperkitty_thread table as well? Per https://docs.mailman3.org/en/latest/migration.html, there's a tool with mailman2 that can clean messages *prior* to import: > all mailboxes should be checked for defects before importing. Certain > defects such as missing Message-ID: headers or missing or unparseable > Date: headers will be corrected or ignored by the import process. The > one defect that will definitely cause problems is lines beginning > with From in message bodies. These will be seen as the start of a new > message. There is a Mailman 2 script at $prefix/bin/cleanarch. I'd try deleting the corrupt list, running `cleanarch` on the old list, and re-importing. If the new list has messages that are not in the old list (i.e. it's in live production), then I'm not sure of how to proceed. Note the linked page also mentions a tool called check_hk_import script in hyperkitty/contrib folder.

9 months, 1 week

[MM3-users] eccentric setup question

by Jeff Berry

Good morning all, we've got a somewhat eccentric setup for our mailman installation, and we're having difficulty getting some of the settings to work properly, so I'm hoping some one has some insight. Our server machine is hidden behind our firewall, with the actual machine name not availble via external DNS) and all the mail is being routed through an Exchange server. So mail to list(a)domain.com hits our exchange server, which sends it on to lists(a)listserver.domain.com The problem we're having is that if the mailman domain of the list is listserver.domain.com then spamfilters start to flag the mail since it looks like spoofing/malformed headers and so on. If the mailman domain is just domain.com then postfix rejects it with an unknown local recipient error. I though I might be able to just tweak the incoming mail headers in postfix via header_checks but that's not working, either because I've got the wrong check or it's the wrong approach, or both. postfix relay_domains might do it, I think, but if it maps listserver.domain.com to domain.com that would break the listserver domain mailing lists (I think). Is there a canonical way to do this and/or have I missed some obvious configuration option in either mailman or postfix? Kind regards, Jeff Berry jeff.berry(a)mrc-cbu.cam.ac.uk

2 years, 1 month

[MM3-users] Digest Formatting

by Stephen J. Turnbull

mailman(a)manygoodideas.com writes: > I'm wondering how other admins have customized their digests to > make them more useful. It sounds like you have the digest format set to "plain". If you set it to "MIME", many email clients will format the display in such a way that you can click on individual messages. This is also possible with the plain format, but in my experience fewer clients implement that, because it's more fragile and painstaking to do. That might help. In general, this problem is really hard to address because the capabilities of clients vary so greatly. Perhaps your subscribers would be better off with single-message mode rather than digest mode. I'm not really clear on why anybody subscribes in digest mode any more. Digests still make sense for individual collections of messages, eg, "Your Honor, here are all the emails in which the defendent libeled my client." But for an ongoing stream such as a mailing list, I would think you would be much better off to receive the individual messages and let your modern client do its own thing with grouping threads and folders, and threading and ordering posts. Obviously, people like their own ways of doing things, but that suggestion might be useful for some of your subscribers. I hate to ask you to ask your subscribers to learn how to use their clients, as that frequently doesn't go over well, and they'll probably ask you to teach them with a client you've never used yourself :-/. However, if that's an option, most email clients provide a way to "burst" the digest into individual messages, which will then be threaded in the normal way for that client. This provides the user with the "download all the recent messages periodically" benefits of the digest, as well as the threading capability of the client. Also, a *good* email client will provide a way to view a digest "as a folder", without bursting it into individual messages. The latter is closest to what your users want, I think. (I still think that for most of them switching to regular mode is best.) > Yahoo! Groups used to send out HTML digests that had the thread > titles nicely distinguished, live links to the thread, and links to > Reply to sender, Reply to All, etc. Dealing with HTML email requires the resources of a billion-dollar company, unfortunately. It's a real mess. (For us old-timers, our favorite Mailman options are "strip HTML parts" and "convert HTML to plain text." ;-) For a small organization like Mailman, it's a "throw up your hands in distress" size problem. On the other hand, if you use a MIME-format digest, it's quite easy (but unfortunately not universal) for the client to implement that formatting itself. So that's the route we had to take. Hope this helps. If it inspires more questions, please ask! Steve

4 years, 5 months

[MM3-users] Re: Mail configuration

by Mark Sapiro

On 03/27/2018 03:43 PM, Stephen J. Turnbull wrote: > > My feeling is that you want to ask on Postfix channels, since I don't > see a good reason to involve Mailman itself in what is really a task > for the MTA. Mailman was deliberately designed to not know anything > about outgoing mail except a host and port to send to. Which brings up the point I've been meaning to post for days but it keeps slipping off the back burner and falling on the floor. I can think of a couple of ways to hack the code in Mailman 2.1 to select a different outgoing MTA by list. It can also be done in Mailman 3 by having separate MTA configs per list, but I can't give you a recipe off hand. But, the way I would do this is what you are presumably doing anyway. That is have separate Mailman installations on the old and new server. Then you can move the lists incrementally and gradually. Then all you need is a transport map in Postfix on the old server to route mail to the new server for the already moved lists, and then finally update DNS after all the lists are moved. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years

[MM3-users] Re: moving lists to another server

by Odhiambo Washington

On Mon, Nov 20, 2023 at 8:53 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 11/20/23 00:58, Odhiambo Washington wrote: > > > > What is the command to export the archive as a mbox from the DB? > > I can't figure out which option it is by looking at 'mailman-web -h'. > > Normally you do this on the old server via the HyperKitty web UI which > has download buttons which do things like > > > https://example.com/archives/list/list@example.com/export/list@example.com.… > > or for a partial archive > > > https://example.com/archives/list/list@example.com/export/list@example.com-… > > However, in your case I don't think you have the old installation working > any more so the above won't help. > I had a dump of the old installation actually - both databases. The above has actually helped and I obtained the archive. > > BTW, how will ' mailman addmembers' treat a file containing: > > ``` > > Firstname Lastname <email@address> > > Onlyname <email2@address> > > ``` > > Correctly. It will import email@address with display name = 'Firstname > Lastname' and email2@address with display name = 'Onlyname'. > Super! > > I have opted for the simple way to do this: > > 1. Create the site in Django Admin and create/configure the list in > > Postorius > > 2. Add the members from the file dump, with delivery set to regular. > > 3. Send the members an email informing them that they need to set their > > delivery preferences. > > > > I am stuck on the issue of exporting the archives to mbox file as already > > stated above. > > Perhaps you can export the mbox via the web UI on the old server or > maybe temporarily create a second mailman-web on your server with the > old mailman-web database and use that web UI. That's exactly how I did it and got the archives. > Otherwise, if you have a working mailman-web that can access this > database, you could try > something like > ``` > $ mailman-web shell > > >>> from hyperkitty.lib.compat import get_list_by_name > >>> mlist = get_list_by_name('list_name_only', 'list_domain') > >>> with open('output.mbox', 'wb') as fp: > ... for email in mlist.emails.order_by("archived_date").all(): > ... fp.write(email.as_bytes() + b'\n') > ... > >>> > ``` > I tested the above out of curiosity. It failed. There are 9 lists in the setup, but I am only interested in 1. ``` (venv) mailman@debian12:~$ mailman-web shell Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0] Type 'copyright', 'credits' or 'license' for more information IPython 8.17.2 -- An enhanced Interactive Python. Type '?' for help. In [1]: from hyperkitty.lib.compat import get_list_by_name In [2]: mlist = get_list_by_name('list_name_only', 'list_domain') --------------------------------------------------------------------------- Http404 Traceback (most recent call last) Cell In[2], line 1 ----> 1 mlist = get_list_by_name('list_name_only', 'list_domain') File ~/venv/lib/python3.11/site-packages/hyperkitty/lib/compat.py:37, in get_list_by_name(list_name, domain) 35 matching = list(MailingList.objects.filter(name__startswith=list_name+"@")) 36 if len(matching) == 0: # no candidate found ---> 37 raise Http404("No archived mailinglist by that name") 38 if len(matching) == 1: # only one candidate 39 return matching[0] Http404: No archived mailinglist by that name ``` Was I supposed to substitute something for the real listname of the list I wanted? Another thing - totally unrelated - that surprised me: While using the commented-out block below, I could not click and get anything beyond http://http://list.name/mailman3 as anything to do with /postorius/xxxxx gave "Page not found" error. However, with the second config block that uses the UNIX socket, I am able to access everything ``` #<IfModule mod_proxy.c> # ProxyPreserveHost On # ProxyPass "/mailman3" "http://127.0.0.1:8010/mailman3" # ProxyPass "/archives" "http://127.0.0.1:8010/archives" # ProxyPass "/accounts" "http://127.0.0.1:8010/accounts" # ProxyPass "/admin" "http://127.0.0.1:8010/admin" # ProxyPass "/user-profile" "http://127.0.0.1:8010/user-profile" # </IfModule> ProxyPassMatch ^/static/ ! ProxyPassMatch ^/favicon.ico ! ProxyPass / unix:/opt/mailman/mm/var/uwsgi.sock|uwsgi://localhost/ ProxyPassReverse / unix:/opt/mailman/mm/var/uwsgi.sock|uwsgi://localhost/ ``` Why is it that the UNIX socket option worked flawlessly while the other option failed??? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 5 months

[MM3-users] Solved Re: after last upgrade I've got a CSRF failed verification

by Guillermo Hernandez (Oldno7)

El 27/10/22 a las 5:48, Mark Sapiro escribió: > On 10/26/22 04:33, Guillermo Hernandez (Oldno7) via Mailman-users wrote: >> >> I did it via pip and all seems to be working, but when I try to >> discard or accept any message via postorius it shows a Forbidden 403 >> error CSRF verification failed. >> >> In my settings.py I have commented out these variables: >> >> # Other security settings >> # SECURE_SSL_REDIRECT = True >> # If you set SECURE_SSL_REDIRECT to True, make sure the >> SECURE_REDIRECT_EXEMPT >> # contains at least this line: >> # SECURE_REDIRECT_EXEMPT = [ >> # "archives/api/mailman/.*", # Request from Mailman. >> # ] >> # SESSION_COOKIE_SECURE = True >> # SECURE_CONTENT_TYPE_NOSNIFF = True >> # SECURE_BROWSER_XSS_FILTER = True >> # CSRF_COOKIE_SECURE = True >> # CSRF_COOKIE_HTTPONLY = True >> # X_FRAME_OPTIONS = 'DENY' >> >> I've been messing with them whith no results. It's like it lacked >> some value in some template... > > > It's not an issue with the code per se or the templates. These updates > are all installed on mail.python.org and lists.mailman3.org and are > working fine. > > After upgrading did you run > > django-admin collectstatic --clear > django-admin compress > django admin migrate Since I made all the mailman3 enviroment wide server open (not using venv) I already executed the migration doing a su -m mailman3 -c "python3 manage.py collectstatic" su -m mailman3 -c "python3 manage.py migrate" Being mailman3 the user who runs all of mailman3 related stuff I had problems doing the migrate part, showing an error of lacking perms. I solved it running the migration under root (I know it could be trouble after, but...) After that the compress part showed errors... but the postorius web maintenance was working well except for the CSRF error verification. I will trace the compress errors and will try to find the problem later. With your point to the CSRF_TRUSTED_ORIGINS parameter, I can now do the accept or discard part of a receiving message to the lists (I put below the config that is working for me). All seems to be working now flawlessly. Thanks once again for your guidance. ############ SESSION_COOKIE_SECURE = True SECURE_CONTENT_TYPE_NOSNIFF = True SECURE_BROWSER_XSS_FILTER = True CSRF_COOKIE_SECURE = True CSRF_COOKIE_HTTPONLY = True X_FRAME_OPTIONS = 'DENY' # CSRF_TRUSTED_ORIGINS = [ "https://*.mydomain-example.xxx", "https://mydomain-example", "https://mydomain", ] ############ > > If you have and it doesn't help, you probably need to add > CSRF_TRUSTED_ORIGINS to your settings.py. > > See > https://docs.djangoproject.com/en/4.1/ref/settings/#csrf-trusted-origins > and note the differences between Django <4.0 and >=4.0. > -- ___________________________________________ Mailman's content filtering has removed the following MIME parts from this message. Content-Type: image/png Name: firma-GHP-emails.png Replaced multipart/alternative part with first alternative.

2 years, 5 months

[MM3-users] Re: Using MySQL via unix socket

by Mark Sapiro

On 2/2/19 5:31 AM, Torge Riedel wrote: > > A call to > > mysql -umailman -p > > successfully uses the socket on the machine and logs in. Yet you haven't specified -S or --socket > I tried > > mysql+pymysql://mailman:mailmanpass@127.0.0.1/mailman3?charset=utf8&use_unicode=1&unix_socket=/var/run/mysqld/mysqld.sock > > > as the connection string but it says that mysql server is not available. > Which is the same if remove the "unix_socket" parameter. I have found > this parameter when searching the net, but I'm not sure if it is supported. I think it should be, but the actual connection is via the the sqlalchemy create_engine() function. It appears this should be passed to the pymysql Connection() function per <https://docs.sqlalchemy.org/en/rel_1_2/core/engines.html#custom-dbapi-args> What happens if in a Python 3 session, you do from pymysql import connect conn = connect('127.0.0.1', user='mailman', password='mailmanpass', database='mailman3', charset='utf8', use_unicode=1, unix_socket='/var/run/mysqld/mysqld.sock') As I understand it, that's what sqlalchemy should be doing with your database url. In my testing, the above works with or without the unix_socket= argument, so I suspect something else is wrong in your case. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 2 months

[MM3-users] Re: Held message notifications ending up in junk

by Tibor Molnar

Hi Steve, I will look in to DKIM, thanks for your suggestion. Tibor On 09/09/2022 03:01, Stephen J. Turnbull wrote: Tibor Molnar writes: > I wonder if anyone else if having this trouble that all the held > message notifications are landing in junk folder. It's reported occasionally. This is automated pattern recognition doing its thing: these notifications *do* present very similar content *repeatedly* and *are* sent by a bot, and the algorithms figure that out quickly. Make sure the site DKIM signs its outgoing mail and whitelist the site, or whitelist the bot's address. Steve -- [Walton icon] Tibor Molnar [website icon] <https://waltoninstitute.ie/> [linkedin icon] <https://www.linkedin.com/in/tibor-molnar-564293106> [twitter icon] <https://twitter.com/username> [facebook icon] <https://www.facebook.com/username> System Administrator tibor.molnar(a)waltoninstitute.ie<mailto:name.name@waltoninstitute.ie> | +353 (0)51 30 6145 Walton Institute, South East Technological University, West Campus, Carriganore, Waterford, Ireland, X91 P20H [walton logo]<https://waltoninstitute.ie/> [setu logo] <https://www.setu.ie/> [DORA logo] <https://sfdora.org/read/> ________________________________ This email is subject to the following disclaimer(s) available at SETU Disclaimer.<https://www.wit.ie/about_wit/documents_and_policies/email-disclaimer> T? an r?omhphost seo faoi r?ir an ts?anta/na s?anta seo leanas at? le f?il ag SETU S?anad<https://www.wit.ie/about_wit/documents_and_policies/email-disclaimer> [SETU]<https://www.setu.ie>

2 years, 7 months

[MM3-users] Re: Mailman 3 Installation Assistance

by brian＠emwd.com

Hi Simon, Thank you for your reply. I did not realize that docker created everything for you so I prefer that. So let me get back to my original problems. I ran into the following after doing the normal docker installation: 1. curl http://172.19.199.3:8000/postorius/lists/ curl: (7) Failed connect to 172.19.199.3:8000; Connection refused 2. I was told to run docker ps. Here is the output from that: ONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 073ecf209106 maxking/mailman-web:0.1 "docker-entrypoint..." 3 days ago Up 3 days 8000/tcp, 8080/tcp mailman-web aef8f44a7136 maxking/mailman-core:0.1 "docker-entrypoint..." 3 days ago Up 3 days 8001/tcp, 8024/tcp mailman-core 398e3fc05e2c postgres:9.6-alpine "docker-entrypoint..." 3 days ago Restarting (1) 36 hours ago dockermailman_database_1 3. I was asked to look at the logs which I don't have any: cd /opt/mailman/web/logs -bash: cd: /opt/mailman/web/logs: No such file or directory 4. I was asked to do docker logs mailman-web. It is filled with the following entries: psql: could not translate host name "database" to address: Try again Postgres is unavailable - sleeping It is after the above when I got confused. So now I understand that the Docker installation creates the database and runs it. That is important to know. So if you can help me get through the above 4 issues, it would be very appreciated. Thanks! Brian

7 years

[MM3-users] Re: Help understanding why some users don't receive emails

by Mark Sapiro

On 9/21/22 14:06, Stephen Daniel wrote: > > Looking at one user in particular, I see in /var/log/syslog that postfix is > sending the email. There is nothing in bounce.log. And does the postfix log indicate the mail is accepted by the users MX? I.e. a log message with `status=sent`. > They are the only user who uses that particular email domain (embarqmail.com > ). > > Is there anything I can do to debug why they do not get the emails? Or is > this up to them and their email provider? Assuming the message is accepted by the user's MX, the user can check a spam/bulk/junk folder and if the messages aren't there, complain to their ISP about messages being silently discarded. Your log entries showing the message successfully delivered to the MX can provide evidence. Other than that, you need to ensure that your outgoing messages are DKIM signed, and that your outgoing MTA server has full circle DNS <https://en.wikipedia.org/wiki/Forward-confirmed_reverse_DNS>. It can also possibly help for the server's domain to publish a DMARC policy even if that is `p=none` -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 7 months

[MM3-users] My Server is unable to connect to Mailman REST API few times

by Shashikanth Komandoor

Hi Team, I am currently running Mailman 3 with version 3.3.1 and in built postfix version 2.10.1-6 on RHEL 7.5 with PostgreSQL 11.7 version with default values in production environment from the past 4 months almost. As of now, we are having around 1327 lists created on this. When I am trying to do some operations like creating the lists, deleting the lists or accessing the lists through the GUI, I am getting the below error. If I am trying to do the operations through API or through mailman shell, still I am not able to connect to the API. Something went wrong Mailman REST API not available. Please start Mailman core. But my mailman core was working fine in the background. At the same time I was able to do other operations on a few other lists. By the time I am getting the above error, the mailman.log recorded the below messages. *[2020-09-16 12:49:08 +0530] [2600] [CRITICAL] WORKER TIMEOUT (pid:20234)* *[2020-09-16 12:49:08 +0530] [20234] [INFO] Worker exiting (pid: 20234)* *[2020-09-16 12:49:09 +0530] [21042] [INFO] Booting worker with pid: 21042* My mailman.cfg configuration is as below. The timeout value is the default value. I did not set any customized value. *(venv3) [root@lsmgr mailman]# grep -v ^# /var/lib/mailman/mailman/var/etc/mailman.cfg* *[archiver.hyperkitty]* *class: mailman_hyperkitty.Archiver* *enable: yes* *configuration: /var/lib/mailman/mailman-hyperkitty/mailman-hyperkitty.cfg* *[mta]* *incoming: mailman.mta.postfix.LMTP* *outgoing: mailman.mta.deliver.deliver* *lmtp_host: 0.0.0.0* *lmtp_port: 8024* *smtp_host: localhost* *smtp_port: 25* *[webservice]* *workers: 10* *[database]* *class: mailman.database.postgresql.PostgreSQLDatabase* *url: postgres://<postgresdbuser>:<postgresdbpassword>@127.0.0.1/mailman <http://127.0.0.1/mailman>* Then as per the suggestion I got earlier I configured the [webservice] section in the above file as below. *[webservice]* *configuration: /var/lib/mailman/mailman/var/etc/gunicorn.cfg* * [root@lsmgr logs]# cat /var/lib/mailman/mailman/var/etc/gunicorn.cfg* *[gunicorn]* *workers = 10* *timeout = 90 * After the above configuration, I found many errors like below in mailman.log file: *sqlalchemy.exc.NoSuchColumnError: "Could not locate column in row for column 'pended.id <http://pended.id>'"* *sqlalchemy.exc.ResourceClosedError: This result object does not return rows. It has been closed automatically.* *sqlalchemy.exc.DatabaseError: (psycopg2.DatabaseError) error with status PGRES_TUPLES_OK and no message from the libpq* The above might be few of the errors. FYI, for the creation of each list, it is taking almost around 15 to 20 minutes. After multiple times of the above error messages, at some time, I am fortunately getting the list created or some other operation getting done. I found the same scenario when the workers are from default 2 to 10. I don't understand where exactly I need to focus to solve the issue. Please let me know if I have to share any other details for you to suggest to me. -- Thanks & Regards, Shashi Kanth.K 9052671936 <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

4 years, 7 months

[MM3-users] Re: Question after upgrade to mm 3.2.3 and latest postorius

by David Krantz

Thank you for your quick reply! Comments below. On Sun, Aug 11, 2019 at 10:03 PM Abhilash Raj <maxking(a)asynchronous.in> wrote: > I would recommend that you bump up to 3.7 for the web part too, mostly because 3.5 is now has been in security maintenance state for a while. We will drop support for 3.5 after this next release (so you do have some time :), but I fear there *could* potentially be other dependent libraries who might have dropped 3.5 support. > > Even though we do run CI and we'd (hopefully) know when there is a dependent library seriously breaking, but since we don't pin down versions, newer releases can cause problems. > > The web-server plugin I assume is mod_wsgi? Good information. Of course it is mod_wsgi. > If you use a separate wsgi server than the one embedded in web-server, you can bump versions a bit more easily. gunicorn or uwsgi are recommended options. Do note that the new version of Mailman Core also uses gunicorn now. That might be simpler although I probably still will have to use apache as passthrough as there are other things on that server using port 443 (80) and yet another server running is not what I'd like even if wsgi is a server process anyway as I understand it. I'll consider that and change it. > 1. The index page with all lists is not sorted in any useful way > > although it is based on something as the order seems to be stable. > > Prior to the upgrade the lists were sorted in alphabetical order after > > list name which is a lot more usable for me as admin. If I click the > > link at the bottom with "click to view all lists" I get the old > > behaviour. > > This change was made so that you will see only the lists you are a member of either as a subscriber, moderator or owner. This is default when you are logged-in, but when logged-out, you will see the old view with all lists alphabetically sorted. That is very good. It still is strange that this view is not sorted. > Are you sure the migrations are there? I can see the following list on the latest git master of Postorius (all the ones after 0004_ are related to emailtemplate): I thought so, but it seems as if they are not. That said I have not used django for anything else. After setting up the django-admin-script and modifying a few paths I got it to work correctly. The run I had made did not work although it also failed silently. Had I been used to django I'd known that it should print "OK" and ticked boxes for performed migrations, but I just use django for mailman-things. So now it works. Great. Thanks! // David

5 years, 8 months

[MM3-users] Re: Single-Sign-out for List member

by Ángel

On 2020-08-13 at 16:55 -0700, Abhilash Raj wrote: > > I understand you may have a legal requirement do do this, but these > > "one-click - no user confirmation" links are a bad idea because usera > > will reply to a list post or forward it and not remove the link and > > userb will receive usera's reply and click usera's unsubscribe link > > either maliciously or thinking it will unsubscribe userb. > > There is also the issue that these days some Mail clients will try to > create a preview of all the URLs if they can and it would inadvertently > GET the URL resulting in the un-subscription. It's not just mail clients, but also anti-spam solutions. So for some customers, when the email passes through the antivirus/anti-spam solution, it would automatically unsubscribe the user. Check also this piece: https://inboxplacement.com/2020/05/machine-clicks-in-email/ If you end up with such system, the very least, I would make such system to also email the user one last time saying "Per your instruction as requested by machine IP V.X.Y.Z, we have unsubscribed from foobar-list, you can subscribe again by XYZ, etc." (maybe bcc the responsible internal team) And you don't want to start trying to tell apart real vs synthetic clicks. Regards

4 years, 8 months

[MM3-users] Re: Struggling with log rotation in Docker context

by Danil Smirnov

Hi Stephen, My example assumes that there are folders (inside of /basedir) on a Docker host machine which are mounted to mailman containers. So we run logrotate on the host machine against those mapped folders. Hence, /etc/logrotate.d/mailman file is for the host machine as well. Danil On Fri, Sep 4, 2020 at 12:36 PM <skenny(a)scss.tcd.ie> wrote: > Hi Danil, > > Firstly, thank you so much for your reply, and I do apologize for taking > so long to respond to your message. > > I understand your approach, and it sounds reliable and sensible. I'm > still a bit confused by something though. In your example, you create the > file /etc/logrotate.d/mailman - I presume that it must live in, or be > available in the container - but which one? You've created a single file, > with entries for both the mailman-core and mailman-web logs. But the logs > of -core are not available in -web and vice-versa. Did you mean to do > separate > "cat <<EOF > /etc/logrotate.d/mailman" operations for each container? > > Thanks again > Stephen > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >

4 years, 7 months

[MM3-users] Re: Archiver Hyperkitty Not Found

by Mark Sapiro

On 3/3/23 15:16, pat(a)suwalski.net wrote: > Hello, > > I upgraded from Debian 10 to 11 today, and hyperkitty archiver stopped working. > >>From the mailman.log: > > AssertionError: Archiver not found: hyperkitty > > I followed along on a related thread: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… > > I don't see any resolution to that thread. The only thing that worked for me was removing the hyperkitty rows from the listarchiver table in the database. But of course, now I don't have working archiving. There is a resolution of sorts there: It was setting ``` [archiver.hyperkitty] enable: no ``` in mailman.cfg, restarting Mailman core and then setting it back to `enable: yes`. > Any ideas? How would I make the archiver available? This django stuff is infuriatingly difficult compared to other frameworks. Do you have ``` [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /opt/mailman/mm/mailman-hyperkitty.cfg ``` in your mailman.cfg where `/opt/mailman/mm/mailman-hyperkitty.cfg` is the actual path to mailman-hyperkitty.cfg and do you have in that file ``` [general] base_url: http://example.com/hyperkitty/ api_key: key matching the MAILMAN_ARCHIVER_KEY set in Django's settings. ``` Actually, even if these latter settings were wrong, the error would be different. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 1 month

[MM3-users] Re: Apache shows No Lists

by Mark Sapiro

On 5/22/23 12:57, ceo(a)sartrack.nz wrote: > Postorius is running. > I just removed all mailing lists, and created new empty ones. > These now show in the Apache2 website, via the link to Postorius I assume. > Then I imported members from the old mailing list "Templist" into the new one. > Now the "templist" is no longer visible on the website! Did you do this import with `mailman import21`? If so, did you run it as the Mailman user and not as root? > It is here: > https://sartrack.nz/mailman3/ > Note that the existing list "Templist" is missing. https://sartrack.nz/mailman3/ is missing CSS. Apache doesn't know how to access /static/ or you never built it with the django admin collectstatic command. > Now I need to login as 'superuser' or whatever it is called, so I can manage all the lists. > Where do I set up my login and password for access via the web browser? You create a superuser with the django admin createsuperuser command. How you invoke the django admin command depends on how you installed Mailman. Please tell us how you installed Mailman so we don't have to guess about this and other things. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: Message is received but is not sent out. Another, similar message, is processed fine.

by Stephen J. Turnbull

Allan Hansen writes: > LookupError: unknown encoding: iso-8859-8-i > Finally, in the captured message source (the last which was Cc'd to me) I do see this: > > Content-Type: text/plain; charset="iso-8859-8-i" Yes, that's the problem. Python doesn't define a codec for that encoding. It's generally preferable that mail senders use UTF-8, as that is likely to be implemented correctly in almost all modern mail clients, while the ISO-8859/8 series are likely to be implemented only in mail clients that specifically support Hebrew. That said, if the users are unable or unwilling to use UTF-8, it would be possible to create a codec for "iso-8859-8-i", I don't know how to do that, and I doubt Mark does. You could ask on python-list(a)python.org, or file an RFE on Python's GitHub tracker. For Mailman's purpose, there's no need to handle bidi, just codepoint for codepoint translation from "iso-8859-8-i" to Python internal encoding. So I guess the encoder and decoder from "iso-8859-8" (which does exist) can be used. If it's just code-for-code, then we can figure out how to have it used only for Mailman. Steve

1 year, 9 months

[MM3-users] Re: Mailman sends Welcome emails, but does not send [List] postings emails

by Nelson Strother

Yes, Postfix is also running, but this system currently has a trivially small configuration (single domain, single digit number of lists). When the CPU is kept ~100% busy for (maybe once as few as a) dozen minutes to (usually 20 minutes, but rarely) an hour [1] during `mailman start`, essentially all of the CPU time is being consumed by the dozen or so mailman runner processes, so I do not think Postfix alias processing has much if anything to do with these delays. [1] wall clock time; as an arbitrary indicator of how many cycles VMWare is giving to this server, here is what 7-zip observes: x@localhost:~$ 7za b 7-Zip (a) [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21 p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,1 CPU Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz (406F0),ASM,AES-NI) Intel(R) Xeon(R) CPU E5-2660 v4 @ 2.00GHz (406F0) CPU Freq: - - - - - - - - - RAM size: 425 MB, # CPU hardware threads: 1 RAM usage: 219 MB, # Benchmark threads: 1 Compressing | Decompressing Dict Speed Usage R/U Rating | Speed Usage R/U Rating KiB/s % MIPS MIPS | KiB/s % MIPS MIPS 22: 2909 99 2861 2831 | 29117 99 2502 2486 23: 2370 88 2741 2415 | 28833 99 2512 2496 24: 1937 79 2622 2083 | 27937 98 2501 2453 ---------------------------------- | ------------------------------ Avr: 89 2741 2443 | 99 2505 2478 Tot: 94 2623 2461 x@localhost:~$ On 6/8/23 10:14, Stephen J. Turnbull wrote: > Nelson Strother writes: > > > I did not intend to imply that `mailman start` (predictably) > > consumes more time than `mailman restart`. Both are lengthy and > > variable; > > You did say something about "30min" I believe. I don't understand why > it would take anywhere near that long. For example, I'm working with > a site with ~20,000 lists, and it only takes a few seconds. > > Oh ... wait ... are you using Postfix as the MTA? The supplied > Postfix MTA interface rebuilds the list aliases database on every > (re)start, and that's an O(#lists^2) process the way Mailman does it. > Postfix doesn't actually use the file to route mail, it always goes to > lmtp:127.0.01 or something like that. So I configured Postfix to > probe for existence of the list in Mailman's database. > > I think Postfix has plugins for all Mailman-supported databases > (PostgreSQL, MySQL/MariaDB, SQLite3). I can provide the changes > needed for this for PostgreSQL right away, if you're a MySQL site I > can give you the PostgreSQL config to give you the idea, but I may be > sslow if you want advice about the MySQL config. It's pretty > straightforward, though. > > > I do not yet understand how to make use of these clues, but at > > least one can see an epitaph from each deceased process. > > I don't understand them either. The only thing I can think of is that > a runner may try to access Mailman core, timeout, and crash during the > long startup. > > At least the MTA reconfig would make the restart cycle a lot less > painful. Note: this is NOT a Mailman-supported config (or even > contrib quality) yet, but I'm pretty confident of the theory and it is > working well in QA testing. > > Regarding the "alpha" status of the config, one Mailman 3 instance can > support multiple domains, but the Postfix docs say not to hit the > database for the "domain exists" check. If you aren't going to add > additional Mailman domains, then this doesn't matter (the domain list > file produced by the stock Mailman postfix config will work), but if > you do add or remove domains, you either need to configure Postfix to > hit the database for the "domain exists" check too contrary to > Postfix's advice, or you'd need to manage the domain list file by > hand. > > In any case, you could use this config for debugging, and go back to > the tried and true aliases file approach for production. And as I > indicated I'm somewhat available on a best-effort basis for > trouble-shooting. > > > _______________________________________________ > Mailman-users mailing list --mailman-users(a)mailman3.org > To unsubscribe send an email tomailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > Archived at:https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/mess… > > This message sent tojustfixit(a)marilynstrother.com

1 year, 10 months

[MM3-users] Re: Rerun emails in the queue/bad

by Mark Sapiro

On 11/20/18 8:20 AM, Kaleb White wrote: > How do I run the emails in the queue/bad again? I need to see why the failed and get them to work. Thanks. There should be error messages in the 'mailman' log for each preserved file. These would be like 'Skipping and preserving unparseable message: ....psv' 'Unpickling .bak exception: <error msg> Preserving file: ....psv' '.bak file max count, preserving file: ....psv' The first of these indicates an error in retrieving the message from it's original queue. The others have to do with how message loss is avoided. When a .pck file in a queue is processed, it is read and renamed to a .bak. Then if processing is interrupted by a crash, upon restart the .bak file will be processed. The second error above indicates a problem in unpickling the .bak and the third says the same .bak has already been tried too many times. You may be able to examine the files by pointing 'mailman qfile' at them. If that fails, either 'cat' or 'strings' may produce something useful. If they appear to be good, you can reprocess them by renaming to .pck, moving to queue/shunt and running 'mailman unshunt'. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 5 months

[MM3-users] Re: Migrating Mailman 3 lists

by Mark Dadgar

On Apr 27, 2020, at 8:58 AM, Abhilash Raj <maxking(a)asynchronous.in> wrote: >> I know how to migrate mailman 2 lists to a new mailman 3 server. However >> I do not know how to migrate a mailman 3 list from one mailman 3 server >> to another one. Are there any instructions or protocol on how to >> accomplish this? The Mailman 3 server I want to migrate *from* was setup >> using Docker. The Mailman 3 server I want to migrate these lists *to* >> was setup using a python virtual environment via pip. > > If you can backup and migrate the database, that should do all of the Web stuff (except search index & logs) and most of the Core data. You'd need to additionally move the `var/` directory if you want to digests/logs/pending emails. At some point I would like to redo my MM3 instance to correct 2 bad decisions I made when I installed it: 1) using sqlite3 in production, and 2) using the Ubuntu packages, which are way behind current stable (~1 year). I’ve seen mentioned that it’s not as simple as dumping the sqlite3 database and restoring it to, say, Postgres because some of the data types are different between them (which seems like an odd design choice). Anyone sorted this kind of migration out yet? - Mark ----- mark(a)pdc-racing.net | 408-348-2878

4 years, 11 months

[MM3-users] Renaming a server after building

by Philip Colmer

We're getting closer to migrating from Mailman 2 to Mailman 3. In preparation, I want to get new servers built ready to accept the migrated data from our old MM2 servers before we shut them down. So, the new servers will be something like "new-lists.example.com" to complement the existing "lists.example.com" servers. When we are ready to do the migration, we'll rename the MM2 servers to "old-lists" and rename the MM3 servers to "lists" and then migrate the data. Looking at the settings in the Django admin interface, I *thought* I had figure out how best to do this: - Under /admin/sites/site/, click on the existing domain name and change it to match the correct FQDN. - Under /admin/django_mailman3/maildomain/, click on the exist mail domain and change the mail domain to match the correct FQDN. However, although the above works, if I then go back to the *Mailman* interface and go to /mailman3/domains/, the web interface recreates a domain for the original domain name that was in place when the server was created, i.e. we end up with "lists" and "new-lists". We've tried deleting that "new-lists" domain, rebooting and trying again but "new-lists" keeps on being created again. What am I overlooking here? Is there a better/approved way to achieve what we want to achieve? Thanks. Philip

3 years, 4 months

[MM3-users] Re: Phantom Email Address in Nonmember List

by Steve Brown

Genius. Yes, the bodyhash_mismatch is in the DKIM stuff, and the message returned from MM3 has a footer attachment. Although I had modified the default to contain no content, it is still 129 bytes. Second, the reason why I saw different behavior from my posts and my wife's was that she wasn't a member. When I made her a member and sent another post from her address, the bounce+ address showed up in the nonmember list identically. So all of this has something to do with how our email host handles the outgoing mail. TMD uses Mailgun as a mail handler that provides deliverability services. I have a ticket in to them, but haven't heard back. Mailgun appears to modify the return path to a bounce+ address that MM3 sees as a nonmember sender, and then the recipient's email handler sees it as equivalent to another address that might be in the envelope. The header of a message sent from steve(a)stevebrown.us to my radg.us address shows: spf=pass (fr-int-smtpin1.hostinger.io: domain of "bounce+906d23.99dcd9c-administrator=radg.us(a)stevebrown.us" designates 143.55.232.17 as permitted sender) smtp.mailfrom="bounce+906d23.99dcd9c-administrator=radg.us(a)stevebrown.us"; I think I have bothered you enough for something that does not seem to create any real problems or threaten to do so. So reply only if something here stimulates another thought.

7 months

[MM3-users] Re: Things I miss about mailman2

by Mark Sapiro

On 3/17/20 8:58 AM, Quanah Gibson-Mount wrote: > Now that we are on mailman3, I'm finding things that were really useful > in mailman2 are completely missing in mailman3, which seems odd, since > they in particular affect the ability of list moderators to do their job > well. > > a) When a post was made to a moderated list in mailman2, I would get an > email that included a LINK to the held email. Now I just get a canned > email saying I need to go to the dashboard, blah blah. Why was this > link removed? It was extremely useful and now I have to jump through > extra hoops. The message comes from Mailman core. Mailman core does not know what web management UI you are using or the URI to access it. You need to change the template for the message to include the URL. E.g. on this iist, in var/templates/sitr/en/list\:admin\:action\:post.txt we have As list administrator, your authorization is requested for the following mailing list posting: List: $listname From: $sender_email Subject: $subject The message is being held because: $reasons At your convenience, visit https://lists.mailman3.org/mailman3/lists/$list_id/held_messages to approve or deny the request. > b) When a post is made to a moderated list in mailman2, when I went to > the page to approve/deny/discard, there was additionally an option to > remove the moderated flag from the user for all future emails. This > option no longer exists. This was EXTREMELY useful, as we force all new > members of the list to be moderated for a time while we evaluate the > quality of their postings. Now I have to go manually track down the > user and their settings. Unnecessary extra hoops to jump through Click on the subject in the held messages list. At the bottom of the dialog that opens, there is a drop down to set the user's moderation. Normally, you would set it to 'default processing'. > c) When a post is made to a moderated list, one of the options when > selecting REJECT was it allowed me to set a custom message when > rejecting the email. This was extremely useful. For example today, > someone emailed our bug tracking list directly instead of filing a bug. > In the past, I would have added a note to them about what they should do > (in this case, I would have told them to send their email to our > community technical discussion list). Now I can no longer do that, I > can only reject it or discard it. Why was this removed? This was not "removed". It just hasn't been implemented in MM 3 yet. See, e.g., <https://gitlab.com/mailman/postorius/-/issues/368> and <https://gitlab.com/mailman/postorius/-/issues/368>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 1 month

[MM3-users] Re: How to remove a nonmember from a list

by Abhilash Raj

On Thu, Apr 9, 2020, at 3:25 AM, skenny(a)scss.tcd.ie wrote: > Thanks for that Abhilash. I've since figured out how to add and remove > nonmembers using the REST API. > > Regarding the web interface, I wonder could you comment on the > following: I've created a test list and I have added a large number - > 1,800 - of nonmembers to it. I find that if I try to delete a > nonmember via the web interface, it seems to hang, and then the > following message appears: > > Something went wrong > Mailman REST API not available. Please start Mailman core. > > The same operation succeeds on other lists, where the number of > nonmembers is not large. Do you think this could be an issue of scale? Could be, I am not sure which operation is it stuck at. Can you check logs to see where is it breaking? Can you try doing the same with the REST API, just to verify if it is the Core which has the issue or it is the web frontend. Abhilash > > Thanks > Stephen > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

5 years

[MM3-users] Re: Replace "visit your dashboard" with URL link, like in Mailman 2.

by Mark Sapiro

On 5/8/23 09:52, Mark London via Mailman-users wrote: > Has anybody attempted to change the format of the emails that are sent > to the owner of a mailing list, to include a URL, instead of stating > "visit your dashboard"? The former is the behavior of Mailman 2. Many users, e.g. Jens Günther whose replied to this thread, have made custom templates to do this. > Is there any reason why this can't be done? If nobody has tried to do > so yet, I'll give it a try myself, as I'm familiar with django. Thanks. See https://gitlab.com/mailman/mailman/-/issues/901 and https://gitlab.com/mailman/mailman/-/issues/1055 Also see https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/rest/docs/… for some documentation of templates, but note that you don't need to set URI's via REST, You can place list specific templates in Mailman's var/templates/lists/<list-id>/<lc>/ directory, domain specific templates in var/templates/domains/<domain-name>/<lc>/ and sitewide templates in var/templates/domain/site/<lc>/ or you can create list and/or domain specific templates via Postorius but see https://gitlab.com/mailman/postorius/-/issues/366 -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 11 months

[MM3-users] Re: Mailman3 stopped working after Upgrade to Ubuntu 21.04

by Thomas Möhle

Hey Mark, thanks for your reply!> In what way? Do list posts get delivered? What works and what doesn't? > What are the observable symptoms for things that don't work? Yes, mails are not delivered. You can send a mail to the mailinglist without getting a bounce, but you will not receive the mail back through mailman. In addition to that, I'm unable to edit mailing lists in the web interface. After clicking on a list, I'll get a 404. Plus, I noticed that mailman is constantly writing files to /var/lib/mailman3/queue/out/ but they seem to get deleted right away again. I'm getting alot of IO there though. > What do you get for example if you go in a web browser with hyperkitty > running to > > https://mail.bitkomplex.de/mailman3/hyperkitty/api/mailman/urls?mlist=landw… I get a small gziped json file back. Key is "url", value is a link to a message. > And please don't post secret keys and change the value of api_key: in > mailman-hyperkitty.cfg and the corresponding value in > MAILMAN_ARCHIVER_KEY in your Django settings. I actually tried to redact the logs and config files, but I must have failed to save my edits on that one file. I'll change it right away.

3 years, 8 months

[MM3-users] Re: Anyone integrated Single Sign On like Azure SSO with Mailman3?

by Ryan Morash

Since mailman-suite is already using allauth, I was able to easily enable the Microsoft Graph provider: https://django-allauth.readthedocs.io/en/latest/providers.html#microsoft-gr… From: Gilles Filippini <gilles.filippini(a)free.fr> Date: Wednesday, July 29, 2020 at 1:11 PM To: Jacob Bargery <jbargery(a)smccme.edu>, mailman-users(a)mailman3.org <mailman-users(a)mailman3.org> Subject: [MM3-users] Re: Anyone integrated Single Sign On like Azure SSO with Mailman3? Hi, Jacob Bargery a écrit le 28/07/2020 à 22:28 : > We are looking at whether it is possible to integrate Azure Single Sign On with Mailman3 to streamline use for our users, has anyone had any luck with doing this? If so, how did you go about doing so? I did such a thing with LemonLDAP-ng and the OpenID Connect protocol. I just had to add the django module mozilla-django-oidc and a custom logout method. The mozilla-django-oidc documentation [1] was quite helpful. [1] https://linkprotect.cudasvc.com/url?a=https%3a%2f%2fmozilla-django-oidc.rea… Best, _g. _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://linkprotect.cudasvc.com/url?a=https%3a%2f%2flists.mailman3.org%2fma… Confidential Transmission This correspondence is confidential and may contain privileged materials or information. It is intended for the use of the addressee only and all others are prohibited from copying or disseminating this message or its contents. If you have received this transmission in error, delete it immediately and notify the sender.

4 years, 8 months

[MM3-users] Re: mailman-suite scheduled tasks

by Eric Broens

Thanks Morris!Since I included it in the crontab of the mailman user I could leave out the user: @hourly /opt/mailman/venv/bin/django-admin runjobs hourly --pythonpath /opt/mailman/mailman-suite/mailman-suite_project --settings settings Clear skies!Eric On Saturday, December 5, 2020, 11:39:41 PM GMT+1, Morris Jones <mojo(a)whiteoaks.com> wrote: On 12/5/2020 2:12 PM, Eric Broens via Mailman-users wrote: > Hi, > The documentation https://docs.mailman3.org/en/latest/config-web.html includes a section on scheduled tasks that need to be included in cron. > "runjobs" seems to be available only from "manage.py". > Do these scheduled tasks need to be executed from the python virtual environment?If so, is there a way to do that directly from cron, or should I create a script for these tasks which can be called from by cron? Eric, here's an example from my mailman crontab. By calling the django-admin instance from the virtual env, it gets picked up automatically: @hourly mailman /opt/mailman/venv/bin/django-admin runjobs hourly --pythonpath /opt/mailman/mailman-suite/mailman-suite_project --settings settings (Hopefully the line wrap won't munge the line too badly.) Mojo -- Morris Jones, Monrovia, CA BridgeMojo <http://bridgemojo.com> Old Town Sidewalk Astronomers <http://otastro.org> Mojo's Blog <http://mojo.whiteoaks.com> _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/

4 years, 4 months

[MM3-users] Re: Broken web UI after upgrade

by Odhiambo Washington

On Wed, Dec 14, 2022 at 8:10 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/14/22 08:15, Odhiambo Washington wrote: > > After upgrading MM3 and running all the post-update tasks and even > > re-indexing all the posts, I have ended up with a somehow "broken" > > hyperkitty. > > The archives display on a browser six, to say the least. > > The site is public, so I can share the link: > https://list.rc.org/archives/ > > > > What should I do in order to fix this? > > > > > Are you asking about the lack of style or the "No archived list yet."? > The lack of style is the main issue. > The former indicates an issue in your web browser with accessing the > `static` directory or an issue with the django admin collectstatic or > compress commands. > So I have tested this with Brave, Google Chrome, Firefox - all on MS Windows and I do clear the browser cache. > I don't know about the latter - could it be because all the archives are > private and I'm, not logged in? > Even when logged in, the situation is the same, unfortunately. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

2 years, 4 months

[MM3-users] Re: Social signup?

by Duane Raymond

HI Mark, On Sun, 12 Mar 2023 at 22:06, Mark Sapiro <mark(a)msapiro.net> wrote: > On 3/12/23 13:56, Duane Raymond wrote: > > Is there a way to enable social signup (vs just login for existing > users)? > > It isn't at all clear or documented, but a user without an account can > go to the login page and login via a social account button and this will > create an account connected to that social account and log the user in. > Thanks for clarifying. Once I implemented social login, the buttons for social login did appear fine on the login page, but not on the signup page. I noticed for this list as well, there are no social signup buttons. So if it works, how does this happen? 1. Is there something I am missing adding to my settings.py and settings_local.py files to make it appear on the Posterius/Hyperkitty signup (vs login) page? (I searched but couldn't find anything) 2. Do I manually add this code to the Posterius/Hyperkitty signup template? 3. If a user tries to login via the login page and isn't registered will it be counted as a signup? 4. something else :-) I'm trying to get my head around where this is working from / what I need to do to get social signup obvious on the signup page (or other route) Cheers, Duane

2 years, 1 month

[MM3-users] Re: [Mailman-Developers] Mailman 3.1 beta coming soon

by Florian Fuchs

On Fri, Dec 02, 2016 at 11:07:24AM -0500, Barry Warsaw wrote: >Hello Mailman 3 users and developers! > >It's been a long slog but I think we are finally ready to begin the release >process for Mailman 3.1. I am pretty happy about the state of the Core, and >Florian is going to do some more integration testing with HyperKitty and >Postorius. We still have a few issues and a merge proposal or two to address, I did some manual integration testing today (core+mailmanclient+postorius) which looked fine so far. I didn't get to test HyperKitty and the bundler though, so any help testing those would be very much appreciated. I will have some more time tomorrow. I did all of my testing locally, which has some limitations. So I started setting up a more realistic environment on one of my dev machines. But I'm not done yet. Will report back when I'm done... ;-) >but I am planning to spin a beta of Core this weekend to facilitate testing. I think it's OK to put out a separate beta of the core, because the version pulled from pypi will still be 3.0 if I'm not terribly mistaken. For the real 3.1 we should probably do a coordinated release of all components, once everything's tested a little more thoroughly. Cheers Florian

8 years, 4 months

[MM3-users] Re: [Mailman-Developers] How to know the URLs for CURL while getting or modifying the data of mailman 3

by Shashikanth Komandoor

Stephen, Thank you for your response. I am sorry for getting confused between two lists mailman-users and mailman-developers. Developers may be busy and my question may be basic but still there is a space for more politeness at your end to advice me. Apart from that, you have given a lot much of useful information which is really and honestly helpful for me to the maximum extent. Now I shall take the help of members of mailman-users only. @mailman-users@mailman3.org <mailman-users(a)mailman3.org>, Team, I have installed Mailman Version 3.3 and running in production. Our development team developed another application which requires the access of the REST API and do changes over the MM3 DB automatically without manual intervention. That application would be connecting to REST API over http or https protocol To achieve this I have enabled the REST API to run at all the IP addresses of my MM3 Server by editing the mailman/src/mailman/config/schema.cfg file. I was able to run few commands like creation of domains, lists, list configuration changes for testing using the CURL (GET, POST, PATCH, DELTE) and got succeeded. But for every operation I need to write a different URL for CURL command to work. Out of many operations I require, addition of members to a list and removal of members from a list are most important tasks. So, I request herewith, from the URL https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/rest.html, I could see many URLs but they are executed at python prompt (>>>) only. I require URLs usable at the CURL command. Is there any way I could generate the URLs or any where documented regarding the URLs usable with CURL for the addition and removal of subscribers ? On Sat, Apr 25, 2020 at 8:04 PM Stephen J. Turnbull < turnbull.stephen.fw(a)u.tsukuba.ac.jp> wrote: > Shashi, > > This whole thread is off-topic for the developers list. This list is > for development of Mailman, not for teaching people to use it. Read > the whole recommended documentation before you ask busy developers to > tutor you in very basic things. There's a mailman-users(a)mailman3.org > list for users to help each other. All of the Mailman developers who > might be willing to answer your questions are there as well, but there > are also many experienced users, some of whom have experimented with > the REST API who will also help. Please reply there for further > help. (Reply-To is set.) > > That said, there are plenty of URLs in the API documentation. Here's > a hint: search for "dump_json". That function takes an URL. You may > want https: instead of http: in your URLs, and you may need to change > the port from 9001, depending on the configuration of your REST > server. Try it with simple GET requests for information first, such > as for domains or lists. You can also do these requests with an > ordinary web browser, though I don't know what it will do with the > JSON-formatted reply. > > If you don't have domains and lists configured, I suppose the > informational requests will come back as empty JSON objects. It > should be safe to make them. You can either use Postorius to > bootstrap a few example domains, lists, and users, or (the hard way) > figure out how to POST appropriate requests. I don't recommend trying > to update the backend DBMS by hand; the schema is quite complicated. > I don't know how to use curl to update Mailman's databases. That > requires a POST request which I have never done with curl. The POST > request needs to be valid JSON. > > The more I think about this, the less I think your idea of using curl > is worthwhile, because formatting JSON requests by hand is going to be > a real annoyance and a great way to mess up your database with > spurious information. You're really going to want programmatic > support for this. But that's already all available in Python in the > Mailman system. > > It's up to you, but I feel a responsibility to warn you that using > curl is not going to be simpler than learning enough Python to do > these things. > > Regards, > -- Thanks & Regards, Shashi Kanth.K 9052671936

4 years, 11 months

[MM3-users] Re: hello， Discussion on how to subscribe to the mailing list

by Stephen J. Turnbull

Mark Sapiro writes: > On 1/16/23 18:55, 朱超 wrote: > > Hi, When I subscribe the email list in Subscription Policy is > > confirm, Some problems happen in here： > > 1.Some mail mua reject send the confirm the message, because the > > length of recipient is too long. for exmaple: > > requirements-confirm+9605556e0b35a5da280c1de0d34a3e6f770f8ea5@domain, > > and the mail mua reject to modify about this. > > The default English template says in part: > > Before you can start using GNU Mailman at this site, you must first > confirm that this is your email address. You can do this by replying to > this message. > > Or you should include the following line -- and only the following > line -- in a message to $request_email: > > confirm $token > > I.e. It gives an alternative method if `reply` doesn't work. You can > provide a custom version of this template with different wording if you > think you can improve it. The problem is the reply address, though. Changing the template to suggest only the "confirm $token" in body method doesn't help people who hit R expecting that should work, especially since many "user fiendly" (misspelling intentional) MUAs don't display the address. Avoiding that requires code changes, I guess? > > 2.It is inconvenient for users to use. Many people will > > mistakenly think that after clicking the subscribe button, it > > will be successful, and they will not process the email. > step, you can set Subscription Policy to Open, but then anyone can > maliciously subscribe third parties to the list. *Please* do not do this if your server is exposed to the Internet. There are bots that search for such servers, and sell lists of them to people who want to DOS mailboxes. You may find yourself banned across the Internet. The only real alternative to confirmation is approval by moderators. I believe Mailman 3 offers that alternative as Mailman 2 did, can't check at the moment. > > Regarding the discussion on the subscription method of the > > mailing list, should we consider optimizing the subscription > > method of the mailing list, for example: > > 1. use the method of sending a verification code to subscribe by > > email，When you receive the verification code sent by the > > mailing list and fill it in again, you can subscribe > > successfully。 > > How is this different from the present method. Just wording. I think they are thinking of the "invite" option that was provided in Mailman 2 mass subscribe (again, I think Mailman 3 retains it but I never ever used it so I don't recall for sure). But it doesn't make sense for a user-initiated interaction. > If you want, you can make > a custom template and include something like: > > Alternatively, you can confirm by going to the URL > > https://www.example.com/mailman3/lists/$list_id/confirm/?token=$token If I understand the OP's PoV correctly, I think I would change the list information page to say "Send a personal invitation to join the list to [email address here]. If you aren't a subscriber, you can invite yourself." And change the word "confirm" in the confirmation template to "subscribe". > We don't include that in the default template because Mailman core > doesn't know if you even have a web UI or how to access it if you > do. We should fix that, at least if the web interface is Postorius (wishlist, assigned to me): https://gitlab.com/mailman/mailman/-/issues/1055 @mark https://gitlab.com/mailman/mailman/-/issues/901 Maybe we can close this? I'm not sure why it was left open since there's no action proposed for Mailman improvement. > > 2. use the email to send a connection to confirm the > > subscription，People click the link to be redirected to a > > confirmation page to subscribe to the email。 > > See above. Indeed, AFAICS almost everything the OP is suggesting amounts to an identical procedure as far as the Mailman server is concerned, it's just described to the subscriber differently. The one exception is the suggestion to eliminate the confirmation step, and while that is supported, it's quite likely to cause problems for third parties and eventually for the Mailman site unless you have an alternative ground source of truth such as an employee database. Steve

2 years, 3 months

[MM3-users] Re: What implications do GDPR have on Mailman, and how to requiring members to accept registration

by Mark Sapiro

On 5/17/18 3:35 AM, Henrik Rasmussen wrote: > > I am also concerned that new lists are created with a subscription policy "Confirm" as default, rather than at least "Moderate", which can cause people to be subscribed by others against there will. I'm confused. Confirm sends a confirmation request to the subscribed address which must be acted upon by the user before she is added to the list. Moderate just means approval by an owner/moderator which, it seems to me is more susceptible to a 3rd party subscribe succeeding - i.e., subscription requires membership in some organization. A subscribes B who is a member of the organization but doesn't want to be on the list. The moderator verifies that B is an organization member and approves the subscription. Granted, it may be possible for some brain-dead vacation responder to confirm a subscription request, but that's a separate issue. > Also, regardless of this setting, administrators can subscribe people without their knowledge. Granted that this can be abused, but not allowing admins to directly add members will probably create more problems than it solves. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 11 months

[MM3-users] Re: Mailserver Log entries following through mailman?

by Mark Sapiro

On 11/10/23 12:39, Andreas Barth wrote: > > is there some way to find an ID to follow an email through mailman? In > the exim logfile there is only something like C="250 Ok" (whereas in > mails sent to another exim there is something like C="250 OK id=…"). > (What I sometimes need to do is to follow an mail whether it is sent > through mailman and to where.) Every message should have a unique Message-ID: header. According to my reading of https://www.exim.org/exim-html-current/doc/html/spec_html/ch-log_files.html Exim should create a => log entry with an id= field containing the Message-ID when the message is received for delivery to Mailman and another similar entry when the message is received from Mailman for delivery to one or more list members. Mailman itself logs ACCEPT:, HOLD:, DISCARD:, REJECT: and OWNER: entries in mailman.log for those events (OWNER: indicates a message to list owners). All these entries contain the Message-ID. Mailman's smtp.log contains 'post to' and 'smtp to' entries with Message-IDs for all outgoing messages. > Or should I raise an issue as whishlist request? What exactly would you wish for that Mailman can do. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 5 months

[MM3-users] Re: Can creating too many Django accounts crash Mailman3 server?

by Abhilash Raj

On Tue, Sep 15, 2020, at 12:09 AM, Stephen J. Turnbull wrote: > Mohsen Masoudfar writes: > > > It seems anybody can go to the site: > > https://LISTSERVNAME/mailman3/postorius/lists/ > > and click on the [Sign up] on the top-right corner and create an > > account. > > Yes. > > > This can easily be automated, even though the next step, confirming > > the email address, being ignored. I believe it can be used as a > > target for a DOS attack by creating so many accounts, that > > eventually causes an 'out of space' error. > > > > Is this a justified concern? > > "Justified" depends on who you think the attacker is. Theoretically > it's a real possibility, but the space used by an unverified account > is not large. I suspect there are always much more painful DoS > attacks to worry about. > > > Is there a way to manage this feature in a secure way? > > In some sense, I don't think there is. The point of the feature is to > allow anybody to sign up without authentication beyond having a usable > email address. Either you allow the DoS attack or anything you do is > likely to deny service to legitimate users. > > Brian's approach (cron job purging unverified users) is generally good > hygiene, but I don't think it would do much against an deliberate > attack. And it shouldn't be hard to automate the confirmation > process. I guess you could handle that by purging accounts with no > subscriptions or other roles on any lists, but that might annoy a few > legitimate users. > > Probably the best you could do for an open server would be to throttle > user creation to say 1 per minute (adjustable to the scale of your > site). > > I don't know if there is currently a way to require admin approval for > account creation (as opposed to list subscription). Perhaps we should > add that if we don't have it. I checked django-allauth, it doesn't have a feature like that. We could implement something on-top of that to optionally allow for admin approval but some other details would need to be figured out and would be a sizeable task involving a new view for account approvals. We potentially also would have to modify the models used in django-allauth to add the flag for "approved", which I am not sure would be an easy task to figure out. Perhaps, it might be easier to make a feature request and implement it in django-allauth though. > > Steve > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

4 years, 7 months

Search results for query "dO"