Search results for "Postorius" - Mailman-users

db migration from mailman3.2.2 to mailman3.3.9 (sqlite3 to postgres16)

by Peter Thornton

Hello, I know this question comes up here periodically, but I am having some trouble performing a data migration from an older version of mailman3 to a more recent one. We have a legacy environment with: mailman3.2.2 postorius 1.2.4 hyperkitty 1.2.2 there are two sqlite3 dbs for mailman core and mailman web. I've staged a new environment using the docker-mailman project with the following: mailman3.3.9 postorius 1.3.10 hyperkitty 1.3.8 there is a single postgres db here for both core and web. I've tried migration a few different ways, using pgloader, and also with some manual python scripts. Data is definitely not my forte, but I am struggling to get a working instance. I am running into several issues such as foreignkeyviolations, datatype mismatches, unique PK errors, etc.. Does anyone out there have a prescriptive process for this migration, or a suggestion for workflow/tooling that has worked in a similar upgrade process? Thanks! -Peter

8 months, 3 weeks

Re: nginx configuration on a multitasking server

by David Newman

On 12/22/21 7:29 PM, Mark Sapiro wrote: > On 12/22/21 6:20 PM, David Newman wrote: >> >> Update: The above worked fine until MM3 informed a list owner of >> pending subscription requests, with a URL like this: >> >> https://lists.example.com/mailman/admindb/listname >> >> and that URL returned a 404 error. > > > This looks like a uwsgi issue as discussed at > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… > although that's with apache and not nginx so it may not be. If I'm reading the thread correctly, it's Apache workarounds to an underlying Debian issue, so I agree it may not apply with nginx. > > >> Adding a stanza for 'location /mailman/' to the nginx config above >> clears the 404 error, but Postorius returns "Page not found" with no >> entry in the web or MM3 logs, and a 200 OK in the Nginx logs. >> >> I think the URL is supposed to go to the list page in Postorius. How >> to configure this so that list owners and moderators get a valid URL >> for list management? > > > I'm not sure what the solution is in this case, but a workaround would > be to add > > url(r'^mailman/', include('postorius.urls')), > > to the urlpatterns list in urls.py. There are 260 files named 'urls.py' under /opt/mailman, mostly for socialaccount stuff. Where does that change go? All files? Or just this one: /opt/mailman/venv/lib/python3.9/site-packages/postorius/urls.py Or somewhere else? Thanks again. dn

4 years, 4 months

Re: Another interesting error...

by Darren Smith

OK chalk another one up to a python newbie... commit() was the magic sauce that we needed. The error 500 is no longer happening on that mailing list. We have three different lists so far that have gotten into this state, and we are going to work on the other two to make sure that this all works. FYI if this is fixed somehow in a later release (later than 3.1.0) we are working on migrating to the latest mailman code. -Darren On Mon, Apr 23, 2018 at 4:20 PM, Mark Sapiro <mark(a)msapiro.net> wrote: > On 04/23/2018 02:59 PM, Darren Smith wrote: > > Well, using the mailman shell we were able to find the request that was > > causing the problem - it was apparently a spam message that had some > > chinese characters in it. > > > I am trying to duplicate this issue in a test environment. I can create > a message with an invalid RFC 2047 encoded subject, i.e., > > Subject: =?gb2312?Q?=ff=fe=de=21=a2?= > > and send it to a list where it gets held, but I don't get a 500 in > postorius and I see the held message with a raw (not decoded) header. > > I think there were some recent changes that affect this. I'll look some > more. > > > > We used the shell to delete the held request... > > > > And postorius is still giving me an error 500. > > > > If I'm not mistaken the held messages are kept in .pck files - do you > know > > if when postorius asks for held messages through the API, does mailman go > > to the database or to the .pck? I would actually suspect the latter, or > > removing the request should have fixed the problem. > > > They were held in .pck files in Mailman 2.1, but not in Mailman 3. They > should just be in the database and deleting them via mailman shell > should delete them as long as you quit the shell or commit(). > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list > mailman-users(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >

8 years

Re: Whitelist in mailman3: How to allow only ~400 e-mail senders in a file whitelist to send to a list?

by Mark Sapiro

On 8/3/25 13:52, Wikinaut wrote: > In mailman2, it was quite handy to place "@whitelist" into the field sender/accept_these_nonmembers, when such a file has been set up. > > How can I (per list or programmatically) define the ~400 e-mail senders to be allowed to send to my about 30 lists? > And, yes, I already searched for a solution of this problem, but could not find any. This feature was added in Mailman core 3.3.10. See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/NEWS.… https://gitlab.com/mailman/mailman/-/issues/794 https://gitlab.com/mailman/mailman/-/merge_requests/1154 and documented in postorius 1.3.13. See https://gitlab.com/mailman/postorius/-/issues/589 https://gitlab.com/mailman/postorius/-/merge_requests/938 -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months

Re: Request for ideas and mentors for Summer of Code 2026

by Stephen J. Turnbull

alain williams writes: > Hmmm, I get your point. I was not paranoid enough :-( Yeah, I'm going to post it as an RFE since you're the third person to support it. I've also tagged it "won't fix" :-) but if somebody has a really brilliant idea with a merge request, I'll review it. https://gitlab.com/mailman/postorius/-/issues/642 > Maybe some really clearly written end user documentation that is > easily found might help. I think that I have just given myself a > job. The easily-found part would be easy to implement with link in the Postorius template(s). Or the process could be implemented with a workflow starting at the landing page: - a prominent button "change address" takes you to the addresses page - each address would have a "change address" button which has a form prompting for the new address - submitting the form sends a verification code to the address, - clicking on the verification link takes you to a page which asks if the old address should be deleted or kept - if you click "keep", you get a list of memberships using the old address with radio buttons for "keep <old>" and "change to <new>". Bonus points for short-circuiting trivial cases (only one address, only one subscription). Need to handle primary address. The main problem is (as always) the Postorius authentication step. People forget their passwords or get scared by social auth. :-( -- GNU Mailman consultant (installation, migration, customization) Sirius Open Source https://www.siriusopensource.com/ Software systems consulting in Europe, North America, and Japan

3 months

Re: Postorius not HTML-decoding < to "<" characters

by Ron / BCLUG

Mark Sapiro wrote on 2024-11-09 13:05: > This is a HyperKitty issue. Ah, I see, I thought it'd be on the display process. Does that mean the DB has data with mismatched tags in it? If so, will that require a query to fix? Interestingly, the quoted part of my message has < where my message has proper less-than and greater-than for the Apache tags. https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… It's inconsistent with the archive rendering mode at lists.mailman3.org. I haven't currently got an instance that I can test on but will keep this in mind when the time comes to migrate. Should the rendering at lists.mailman3.org get modified, please share the procedure. Testing: less-than and greater-than around a tag: <Location /mailman/accounts/signup> Testing: less-than and greater-than around a tag in a quoted block: > <Location /mailman/accounts/signup>

1 year, 5 months

Re: Mailman REST API not available. Please start Mailman core.

by Mark Sapiro

On 7/28/20 1:07 PM, joseverde(a)gmail.com wrote: > [Does your systemd script set the user to the Mailman user, and does the > Mailman user have read/write permission on Mailman's var/locks/?] > > How do I check for that? ls -la /path/to/mailman/var/locks > Also, what's the difference between the mailman command and the systemctl mailman3? Are they the same processes? Presumably your mailman3.service actually uses the `mailman start` command to start Mailman. The `mailman` command is a shell with many subcommands for various purposes including starting and stopping Mailman. > Oh and does the /3.1 matter at the end of the Rest url for Django? Do not put the 3.1 at the end of your MAILMAN_REST_API_URL. Postorius adds it. See <https://gitlab.com/mailman/postorius/-/blob/master/src/postorius/utils.py#L…>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 9 months

Re: Splitting hosts: mta&core vs postorius

by Ruth Ivimey-Cook

>> My reason for thinking, in my original post, that the wrong host >> address is being used is that the ConnectionError above contains >> 0.0.0.0 in its url for /3.1/domains/... but 0.0.0.0 is only present as >> the listen address on the core web service and does not appear in the >> config for postorius. > The ConnectionError above comes from requests.request (docs at > <https://requests.readthedocs.io/en/master/>). Client only provides a > URL in the call to request and the URL is the baseurl + the path and the > baseurl is MAILMAN_REST_API_URL which you have as > http://greyarea-post:8870. Entries above have > http://greyarea-post.cam.ivimey.org:8870/. Is that the correct FQDN? > > I suspect a DNS lookup issue. How does greyarea-web1 resolve > greyarea-post? You could try a FQDN that greyarea-web1 can lookup in DNS > rather than relying on /etc/resolv.conf and/or /etc/hosts. No, ignore that... I edited the FQDN down to the hostname in the email for simplicity, but even if it was in the log the hostname does map properly (i.e. host greyarea-post and host greyarea.cam.ivimey.org return the same thing). In referring to the ConnectionError from: 'ConnectionError(MaxRetryError("HTTPConnectionPool(host=\'0.0.0.0\', port=8870): Max retries exceeded with url: /3.1/domains/ch-bc.org.uk (Caused by NewConnectionError(\'<urllib3.connection.HTTPConnection object at 0x7f5416db8518>: Failed to establish a new connection: [Errno 111] Connection refused\',))",),)') if you reconstruct the url passed in it was presumably: "http://0.0.0.0:8870/3.1/domains/ch-bc.org.uk" ... and if that is correct I am not surprised to see an error message. But perhaps that isn't what it was... Ruth

5 years, 10 months

Re: Postorius claims 2 messages held when there are none - out of sync

by Mark Sapiro

On 6/26/23 10:27 PM, Ken Alker wrote: > > So is the only thing stored in var/messages/ the held messages, and > nothing more? Two kinds of messages are in the message store. They are messages which are held for moderator action and bounce DSN messages. Held messages should be removed from the message store when they are handled by a moderator. If there are no held messages in Postorius for any list, any in the message store can be safely removed. Bounce DSNs are only needed for a very short time. They are saved when a bounce is received and removed after a few days by the task runner, but they are only needed until they are attached to the admin notice which happens within minutes, and this was only implemented in Mailman 3.3.5. Prior to that bounce DSNs weren't saved. Probably most if not all of the messages in your message store are not needed and could be deleted, but it's more complicated than that because there are also entries in various database tables that should be removed as well. > Is there an outline as to how to clean up the var/messages hierarchy? > (I assume one has to be careful not to remove current held messages and > maybe old ones that have not been processed; or maybe "old ones" can all > be assumed orphaned, and thus, removed w/o concern?) You could try something like this in mailman shell ``` >>> pendings = getUtility(IPendings) >>> messages = getUtility(IMessageStore) >>> mids = [] >>> for mlist in getUtility(IListManager): ... requests = IListRequests(mlist) ... for request in requests.held_requests: ... key, data = requests.get_request(request.id) ... if data.get('_mod_message_id'): ... mids.append(data.get('_mod_message_id')) ... >>> for key, data in pendings: ... mid = data.get('_mod_message_id') ... if data['type'] != 'probe' and mid and mid not in mids: ... pendings.confirm(key, expunge=True) ... messages.delete_message(mid) ... >>> commit() This will find all the message ids from all held message requests, and then find those pendings for message ids not DSNs and not found in requests and delete the pending an the message store message. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 10 months

Announcing Mailman Suite 3.2 release

by Abhilash Raj

I am very pleased to announce the release of Mailman Suite 3.2. This includes Mailman Core 3.2.0, MailmanClient 3.2.0, Postorius 1.2.0, Django-Mailman3 1.2.0, Hyperkitty 1.2.0. This release includes tons of new features and bug fixes. We had support from tons of new contributors and I, on behalf of the whole Mailman Core team, would like to thank each one of you. Mailman Core includes support for plugins, more attributes exposed in REST API and improved support for migrating Mailman 2.x lists. You can now migrate settings and memberships from Mailman 2.x lists to Mailman 3.1. Full change log is available here: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#la-vill… Postorius, The New Mailman Web UI, now has more settings exposed. The most noteworthy of the features include Python 3.5+ support. Also, you can now set templates for headers, footers and automatic responses inside of Postorius. Full change log is available here: https://postorius.readthedocs.io/en/latest/news.html#id1 Hyperkitty, the next-generation mailing-list archiver, has also jumped on the Python 3.5+ wagon and supports all the latest and stable versions of Django. Importing archives from Mailman 2.x is now even more improved. Full change log is available here: https://hyperkitty.readthedocs.io/en/latest/news.html#id1 All the components can be downloaded from https://pypi.org. Mailman is free software for managing email mailing lists and e-newsletters. Mailman is used for all the python.org and SourceForge.net mailing lists, as well as at hundreds of other sites. The Full documentation for the Suite is available at: http://docs.mailman3.org/en/latest/ For more information, please see our web site at one of: http://www.list.org https://www.gnu.org/software/mailman http://mailman.sourceforge.net/ https://mirror.list.org/ -- thanks, Abhilash Raj (maxking)

7 years, 9 months

Mailman-users search results for query "Postorius"