Search results for "Postorius" - Mailman-users

Re: Dump/restore users (with passwords) via API

by Dmitry Makovey

On 09/17/2018 12:39 PM, Abhilash Raj wrote: > On Mon, Sep 17, 2018, at 12:15 PM, Dmitry Makovey wrote: >> We are trying to dump/restore users using API calls and it seems >> that API allows us to dump password hashes (a good thing), but then >> API does not allow to insert users back using saved password hashes >> - only cleartext passwords. > > I'd say that is intentional. You don't want people to be setting up > hashes as passwords. > >> Aside from create_user is there any other way to create >> users/change their password? > > Not that I know of, not using the API atleast. You could potentially > use the low level API that inserts records in the database or use SQL > to dump and restore that data. > > What do you use the Core's user/password for? Currently, the user > passwords are basically just a carry-over from Mailman2 and there > shouldn't be any use for it. I have been considering removing that > completely have Postorius do all the authentication/authorization. > > Email based authentication should rely on more reliable identities > like email signatures, intead of having to send cleartext passwords > over email. I think I am asking about the username/password auth for postorious and how to dump/restore it. At present we have no tools for dump/restoring users so that's what we're trying to build. -- Sr System and DevOps Engineer SoM IRT

8 years, 1 month

Re: old usernames appearing in mailman.log

by Ken Alker

--On Monday, June 26, 2023 5:03 PM -0700 Mark Sapiro <mark(a)msapiro.net> wrote: > On 6/25/23 10:57 PM, Ken Alker wrote: >> >> I have studied the output, looked at the code lines referenced in the >> Traceback, and I can't figure out the problem (I feel like the sad guy >> on the side of the street with his hood up staring into the engine bay >> with stream pouring out and not knowing what to do next). I did some >> analyses on the log file and determined that there are 71 messages it is >> having problems processing and there are 71 messages "stuck" in >> /opt/mailman/mm/var/archives/hyperkitty/spool/ (and that it has tried to >> process each message about 20 times). > > > Each time there is a new post, it retries all the messages in the spool/ > directory. > > >> Since upgrading to V3.3.8 I've >> not seen new messages get stuck like this (although it's only been >> running smoothly for 24 hours now and there hasn't been much activity). >> But I'm suspecting there was something awry between the conversion from >> V2 to V3 in February and me installing V3.3.8 that caused this (based on >> message time stamps). It is HIGHLY likely these messages are in the >> archiving spool as a result of me unshunting the shunt queue and that >> they are copies of the messages that got delivered to the subscribers >> when I did that... but are now hung up in the archiving process. > > > Are new messages being archived OK. If so, that is a real mystery. It > says mailman-hyperkitty can talk to hyperkitty and archive new messages, > but it can't talk to hyperkitty when attempting to process a queued > message. Ahhh! I had convinced myself that new messages were being archived, but now that you ask, they ARE NOT. I may have said they were at some point, and I apologize if I did. Now I feel less confused. It appears that archiving stopped when I did the migration from "Debian package layout" to "source layout" and upgraded to V3.3.8. I'll bet I munged a config file or two. I was struggling with what to keep from Debian layout and what to bring over from the source install instructions and I haven't gone back through to clean them up. I had previously figured it could not be a configuration issue since some messages were making it into the archive and some were not, but now that I see NONE are making it, this makes the problem less daunting. >> Following is an excerpt from mailman.log. Note that the "first >> section" (from DOCTYPE at top to 404 at bottom) is repeated four times >> (maybe not identical; but similar) (so I did not include it to save >> room) before the Traceback appears. >> >> Jun 25 00:13:04 2023 (386086) No cached copy of the public suffix list >> found >> Jun 25 00:13:04 2023 (386086) ACCEPT: >> <7500f0e2-1ae1-309d-60d7-6e592c7abf7a(a)west.net> >> Jun 25 00:13:04 2023 (386090) HyperKitty failure on >> https://lists.netlojix.com/hyperkitty/api/mailman/urls: > > I just went to that URL and got a 404. This is a serious problem. > https://lists.netlojix.com/hyperkitty/api/ also returns a 404. It should > return some documentation of the API. > > https://lists.netlojix.com/archives/api/ does work and returns the > expected information. > > Your urls.py file probably contains in its urlpatterns list > ``` > re_path(r'^mailman3/', include('postorius.urls')), > re_path(r'^archives/', include('hyperkitty.urls')), > ``` > The simplest fix is to add > ``` > re_path(r'^postorius/', include('postorius.urls')), > re_path(r'^hyperkitty/', include('hyperkitty.urls')), > ``` > to that list. I see many ursl.py files all over the system, but none that appear to be where I'd expect them to be for processing by any executables. Is this a file I should have copied over and edited, or created from scratch and somehow missed? I don't see anything about it in the instructions at <https://docs.mailman3.org/en/latest/install/virtualenv.html> (although I do see a post from last July from someone stating it got missed in the instructions back then). > Another way to fix this is in your mailman-hyperkitty.cfg, you have > ``` > base_url: https://lists.netlojix.com/hyperkitty > ``` > Change that to > ``` > base_url: https://lists.netlojix.com/archives > ``` Done, and restarted both services, but I'm not seeing a difference when I go to <https://lists.netlojix.com/hyperkitty/api/> (I was getting a "Page not found", and still get that). > but it wouldn't hurt to add the `^postorius/` and `^hyperkitty/` patterns > to urls.py anyway.

3 years, 4 months

Re: Clean-up of non-members

by Odhiambo Washington

On Tue, Dec 24, 2024 at 8:39 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/24/24 08:13, Odhiambo Washington via Mailman-users wrote: > > On Mon, Dec 23, 2024 at 8:58 PM Mark Sapiro <mark(a)msapiro.net> wrote: > > > >> I saw that too. Reported > >> https://gitlab.com/mailman/mailman/-/issues/1187 and fixed > >> https://gitlab.com/mailman/mailman/-/merge_requests/1297 > > > > > > It isn't clear to me what I should do to mitigate the error. > > > Apply this patch: > ``` > --- a/src/mailman/commands/cli_members.py > +++ b/src/mailman/commands/cli_members.py > @@ -103,7 +103,12 @@ def display_members(ctx, mlist, role, regular, digest, > if nomail is not None: > if member.delivery_status not in status_types: > continue > - dn = address.display_name or member.user.display_name > + # Non-members may have empty address.display_name and > member.user can > + # be None resulting in AttributeError on member.user.display_name. > + try: > + dn = address.display_name or member.user.display_name > + except AttributeError: > + dn = '' > if email_only or not dn: > print(address.original_email, file=outfp) > else: > ``` > Thank you. Now only if you can help me reconcile the fact that Postorius tells me that I have ``` List Nonmembers (872) ``` ..while the CLI command gives me only 13 addresses. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 10 months

Re: Assistance with mailman3

by Andy Yen

Hi Abhilash Thanks for the response. Tried your suggestion I ran the command "pip install -U falcon==1.4.1" and started mailman but still getting same error. ==> var/logs/mailman.log <== Mar 15 10:10:43 2019 (3004) REST request handler error: Traceback (most recent call last): File "/usr/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/rest/wsgiapp.py", line 218, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 248, in __call__ responder, params, resource, req.uri_template = self._get_responder(req) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 664, in _get_responder route = self._router_search(path, req=req) TypeError: find() got an unexpected keyword argument 'req' Mar 15 10:10:43 2019 (3004) 127.0.0.1 - - "GET /3.1/ HTTP/1.1" 500 59 Kind regards Andy On Wed, Mar 13, 2019 at 12:51 PM Abhilash Raj <maxking(a)asynchronous.in> wrote: > On Wed, Mar 13, 2019, at 8:47 AM, ayen(a)afilias.info wrote: > > Hi all > > > > I'm pretty new to mailman but been trying to install mailman 3 and been > > running into issues, following the documentation at > > http://docs.mailman3.org/en/latest/prodsetup.html > > installed Python 3.6, nginx, ruby-sass > > then with pip installed whoosh mailman-hyperkitty postorius hyperkitty > > mailman > > > > tried to start mailman core, symlinked master and runner -> /usr/bin/ > > (otherwise it wouldn't run) > > mailman core starts but when I hit the api url I get this in the logs > > > > File > > > "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/database/transaction.py", > line 50, in wrapper > > rtn = function(*args, **kws) > > File > > > "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/rest/wsgiapp.py", > line 218, in __call__ > > return super().__call__(environ, start_response) > > File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line > > 248, in __call__ > > responder, params, resource, req.uri_template = > > self._get_responder(req) > > File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line > > 664, in _get_responder > > route = self._router_search(path, req=req) > > TypeError: find() got an unexpected keyword argument 'req' > > Mar 13 10:54:44 2019 (17273) 127.0.0.1 - - "GET /3.1/ HTTP/1.1" 500 59 > > > > and on frontend "A server error occurred. Please contact the > administrator." > > Inside your virtualenv, please run: > > $ pip install -U falcon==1.4.1 > > This should fix the above error. > > > > > that leads to my gnu not working and throwing keyerrors for postorius. > > > > I'm using a clean install of ubuntu 18.04 but have also tried to > > install on centos 7 with no success. > > > > Are there any missing dependencies or steps that I've missed any > > assistance would be appreciated. > > > > Andy > > _______________________________________________ > > Mailman-users mailing list -- mailman-users(a)mailman3.org > > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > > > > -- > thanks, > Abhilash Raj (maxking) >

7 years, 7 months

Re: Clean-up of non-members

by Odhiambo Washington

On Wed, Dec 25, 2024 at 8:05 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/24/24 23:35, Odhiambo Washington via Mailman-users wrote: > > > > Now only if you can help me reconcile the fact that Postorius tells me > that > > I have > > ``` > > List Nonmembers (872) > > > > ``` > > > > ..while the CLI command gives me only 13 addresses. > > > How are you invoking the `mailman nonmembers` command? I suspect it is > not using the proper mailman.cfg. Does `mailman info` show the correct > mailman.cfg. > ``` (venv) mailman@eu:~$ whoami mailman (venv) mailman@eu:~$ mailman info GNU Mailman 3.3.10 (Tom Sawyer) Python 3.11.2 (main, Sep 14 2024, 03:00:30) [GCC 12.2.0] config file: /etc/mailman3/mailman.cfg db url: mysql+pymysql://mailman:XXXXXXXXX@localhost /mailmansuite?charset=utf8mb4&use_unicode=1 devmode: DISABLED REST root url: https://localhost:8001/3.1/ REST credentials: restadmin:restpass (venv) mailman@eu:~$ mailman members --role nonmember LISTSPEC Agnes <agnesa(a)REDACTED.com> Angela M <angelam(a)REDACTED.org> <beatiemaina!!(a)REDACTED.com> <psgimode(a)REDACTED.ke> <jwothaxxx(a)\REDACTED.ke> <lgichdhdh(a)REDACTED.ke> <mrussher(a)REDACTED.org> <mutwiXXj3(a)REDACTED.com> <news@REDACTED> Nesema <xxxxxx(a)kictanet.or.ke> Robert M <xxxxxxo(a)yahoo.com> <telasalma17@ REDACTED > <wambdddddd(a)REDACTED.ke> (venv) mailman@eu:~$ mailman members --role nonmember LISTSPEC | wc -l 13 (venv) mailman@eu:~$ ``` It uses the correct config file. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 year, 10 months

Re: Converting discussion list to read-only list (settings)

by Mark Sapiro

On 10/14/19 7:03 PM, Paul Arenson wrote: > > MAILMAN 2 > What I got from the Mailman 2 Wiki is "How to restrict the list so only authorized persons can post (moderation). If there is an option like that in Mailman 3 I want that. There is, but you can't do it the best way. See below. > SUMMARY > I want to be able to reply personally to the user if necessary without his or her message going to the list. So something like moderation. > > So let me take a guess: > > Default action to take when a non-member posts to the list AND > Default action to take when a member posts to the list > > should be set to HOLD FOR MODERATION? That will work and is probably what you want anyway. Your own posts will also be held, but you can just accept them. Alternatively, you could set your own Moderation setting to Accept or Default Processing so your posts won't be held, but don't do that as it allows anyone to post by spoofing your address in From:, Sender: or Reply-To: or the envelope sender. The best way to post without the post being held is pre-approval with an Approved: <password> header, where <password> is the list's moderator_password, but you can't set that in postorius so it won't work for you. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years

Mailman 3 Container Images v0.1

by Abhilash Raj

Hi Everyone, I have been working on containerizing Mailman 3 so that it becomes easier to test and try Mailman 3. There are two images in total: * maxking/mailman-core : This consists of Mailman Core and includes the plugin to enable the Hyperkitty Archiver. * maxking/mailman-web : This consists of a full Django installation and run the Mailman's Web UI components. It has Mailman Client, Postorius & Hyperkitty. The images are built from the Dockerfiles hosted on Github[3] in case you want to look at it. You can find most of the documentation about these images at https://asynchronous.in/docker-mailman/. The version of the internal components included in each image is available here[7]. The images are versioned and the process is documented[4], please have a look before you use them. Also, the images are signed and I encourage you to verify them before using. The process of how-to verify is also documented. Docker Compose is a tool written in Python makes is very easy to deploy connected-images and take the pain out of writing long long commands for spinning of containers. There is a sample `docker-compose.yml` file in the Github repository mentioned above which is kind-of tested to be able to spin off these images in vanilla condition (without any customization/configuration). You can report issues, comments or concerns in the Github repo[6]. [1]: https://hub.docker.com/r/maxking/mailman-core/ [2]: https://hub.docker.com/r/maxking/mailman-web/ [3]: https://github.com/maxking/docker-mailman [4]: https://asynchronous.in/docker-mailman/#release [5]: http://semver.org/ [6]: https://github.com/maxking/docker-mailman/issues [7]: https://github.com/maxking/docker-mailman/wiki -- thanks, Abhilash Raj

9 years, 4 months

Re: Redundant and load balanced Mailman3

by Abhilash Raj

On Thu, Sep 17, 2020, at 8:31 AM, Pawel Grzywaczewski wrote: > Hi, > > Can someone share some hints about how to deploy redundant and load > balanced Mailman3? What are your recommendations and best practices? > For example what components to put on the same VM? Can we have 2VM with > Mailman core/Postorious/Hyperkitty/django-mailman/mailmanclient > connecting to one (the same) database? How to load balance mail routing > (incoming)? The current implementation of Mailman is good for vertical scaling but not that great for horizontal scaling and redundancy. The web frontend, Postorius & Hyperkitty, are pretty much stateless and can be horizontally scaled and redundantly deployed easily. I am not going to recommend how to handle redundancy for database, because I am not the best person for that and I honestly don't know anything beyond using a "cloud managed" database from cloud providers for HA. Mailman Core is a bit hard to run redundantly mostly because of it's reliance on filesystem for some data like email queues, held messages, shunted messages etc. You can potentially have two running instances, one on standby and failover to other instance. You'd need to synchronize the var directory between them using *some* mechanism, rsync or NFS or something. Although, you want to make sure that they both aren't sending out emails at the same time. > Thanks! > Paweł > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking)

6 years, 1 month

Re: [Extern] Re: Moving lists to different server and domain

by Washington Odhiambo

On Thu, Oct 29, 2026 at 2:31 PM Julian Kippels <kippels(a)hhu.de> wrote: > Am 29.10.26 um 12:25 schrieb Washington Odhiambo: > > > > > > On Thu, Oct 29, 2026 at 12:41 PM Julian Kippels <kippels(a)hhu.de > > <mailto:kippels@hhu.de>> wrote: > > > > Hi, > > > > I want to move all my lists to another server. While I am doing > that, I > > also want to change all lists from listname(a)domain.tld to > > listname(a)lists.domain.tld > > > > How would I best go about this? Will I have issues with the archives > of > > the lists when the domain changes? > > > > Thanks in advance, > > Julain > > > > Allow me to first ask: what is the reason for wanting to use > > lists.domain.tld? > > Is it to split mail routing away from the main domain’s MX? > [snip] > Historically I had users and mailinglists mixed together in the same > namespace. This has grown a bit out of control and is really > complicating things on the identity management side of things. I would > like to have a simple route defined on my mta that sends everything from > the new domain over to the new server instead of having to look up > everything in LDAP all the time. > > Julian > You just threw me off the cliff with that LDAP bit. Anyway, here is the process (ignoring the LDAP bit): I'd strongly suggest doing this as two separate steps: move the server first with nothing renamed, verify everything works, and only then change the domain. If something breaks, you'll know which step caused it. 1. The server move (same domain) Install the same versions of Mailman Core, Postorius and HyperKitty on the new server, then bring across: - Both databases: the Core DB and the Django (mailman-web) DB. - The Core var directory (list templates, held messages, queues, prototype archive). - mailman.cfg, mailman-hyperkitty.cfg and settings.py. Keep SECRET_KEY, the HyperKitty api_key and the REST credentials unchanged. - The full-text search index, or rebuild it afterwards with "mailman-web rebuild_index". - Your web server vhost and MTA transport maps. Run collectstatic/compress, test, then cut over DNS/MX. Upgrade versions only after the move works. 2. The domain change Mailman 3 has no supported way to rename a list or move it to another domain. Maybe there is, but not off the top of my head right now. The list address lives in Core (mail_host, list_id, plus subscriptions and templates keyed by list_id), in HyperKitty (the list name, which is also in every archive URL), and in the Django mail domain/site records. You have roughly three options: 1 - Create new lists and re-import (the clean, supported route) - Create the domain lists.domain.tld. - Create the new lists and copy their settings (scriptable via REST or "mailman shell"). - Export members with "mailman members -o" and import them with "mailman addmembers" (or mass subscribe in Postorius with invites off). - Export each archive as mbox and load it with: mailman-web hyperkitty_import -l listname(a)lists.domain.tld archive.mbox then rebuild the index. To answer your question directly: your archives will be fine. Old archive URLs will change, but HyperKitty's message and thread hashes are derived from the Message-ID, so they stay the same after re-import. A single redirect in your web server maps old URLs to new ones, e.g. in nginx: rewrite ^/archives/list/([^@/]+)@domain\.tld/(.*)$ /archives/list/$1(a)lists.domain.tld/$2 permanent; Held messages, pending requests and per-member preferences (digest, nomail) won't carry over unless you script them, so clear moderation queues first. 2 - Rename in place via SQL Faster, but unsupported. You would update mail_host/list_id in Core, rename the template directories, then update the HyperKitty list name and the Django mail domain. It's easy to miss a reference, so only try this on a copy of the databases, and compare lists, rosters and archives before and after. 3 - Don't rename If the goal of lists.domain.tld is just to separate list mail routing from your main domain, MTA routing alone may get you there without touching the lists. If you do change the domain: - Set up MX, SPF, DKIM and DMARC records for lists.domain.tld, and check the PTR/HELO name on the new server. - Keep listname(a)domain.tld forwarding to the new addresses for a few months. - Warn subscribers that the List-Id is changing, since their mail filters keyed on it will stop matching. - Check that accept_these_nonmembers and ban lists came across. Hope that helps. PS: You can always simulate things before the main shebang. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 In an Internet failure case, the #1 suspect is a constant: DNS. "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-) [How to ask smart questions: http://www.catb.org/~esr/faqs/smart-questions.html]

1 week, 5 days

Re: Special Characters Issue when using Wordpress HTML messages

by Mark Sapiro

On 3/22/22 07:46, ryan.anderson.4--- via Mailman-users wrote: > Hello, > > We are having trouble where we are using a WordPress server send messages our to a few of our lists as HTML embedded messages. We do not want the messages to be shown as Plaintext, so we have that setting turned off in WordPress and in all our lists' settings. You can accept HTML and not convert it if in Postorius -> Settings -> Alter Messages, assuming Filter content is yes, ensure Pass types includes `text/html` or maybe `text` to include all text maintypes and both Collapse alternatives and Convert html to plaintext are set to No. > The messages come through just fine, but several characters are being changed to "?". Some of these include ` and - . They probably aren't ` and -, but rather things like Unicode Left Single Quote and En Dash. > We recently upgraded from 2.1 to 3.3 and we love the new system, other than the fact that our news messages are looking bad because of all the "?" in them. The charset was set to US-ASCII, but I have changed it to UTF-8 and that has not seemed to do anything. When you say you changed the character set to UTF-8, what did you do? If you set ``` [language.en] charset: utf-8 ``` in mailman.cfg and restart mailman core, that should allow those characters without replacing them. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 7 months

Mailman-users search results for query "Postorius"