Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: getting all registered users and their lists

by IOhannes m zmoelnig

On 1/26/22 17:19, Mark Sapiro wrote: > On 1/26/22 00:16, IOhannes m zmoelnig wrote: > > You can do this in mailman shell[...]> ``` > >>> from datetime import datetime > >>> um = getUtility(IUserManager) > >>> for usr in um.users: > ... if len(list(usr.memberships.members)) > 0: > ... continue > ... if usr.created_on < datetime(2022, 1, 1): > ... continue > ... adr = usr.addresses[0] > ... print(f'Name: {adr.display_name}, Email: {adr.email}, Created: > {usr.created_on}') > ... > ``` > perfect. that did the trick, thanks a lot. >> is there a scriptable way to get all users that have registered in my >> mailman3 (3.2.1) instance and which lists they are subscribed to (if >> any)? > > It's in Postorius >= 1.3.6 i'm not entirely sure how this relates to the above (working) snippet. is it, that with postorious>=1.3.6 i would be able to perform that task from the webinterface, rather than having to resort to 'mailman shell'? in any case, this might be related: before i received your email with the 'mailman shell' snippet, i scraped some bits of my django knowledge and visited <https://lists.example.com/admin> (the django admin interface), and noticed the list of users there. so i scraped that page for users (assuming that this was the list of registered users). then i get myself a list of all subscribers in my instance, using a crude `mailman lists | grep "@" | while read l; do mailman members "${l}"; done | sort -u`. finally i calculated the difference between the two sets. interestingly the results are quite different from the ones i got from your script: both sets contain users that are not in the other set. how come? gfmdras IOhannes

4 years, 9 months

[MM3-users] Re: message duplication and an NNTP related error

by Laurens Kils-Hütten

Am Tue, Feb 24, 2026 at 01:16:45PM -0800 schrieb Mark Sapiro: > On 2/24/26 09:23, Laurens Kils-Hütten wrote: > > > > I've used the debian packages: > > > > apt install mailman3-full mailman3-web > > Then this may be a Debian issue and should be reported there in any case. > See <https://wiki.list.org/x/12812344>. I will, once I convinced it's really a bug. Right now I'm thinking it's a misconfiguration on inn2's side. From scrutinising the message headers this is what happens: mailman sends the message to the newsserver where it get's injected properly receiving an Injection-Information: header field. Then however this new message is sent back to mailman. Now there's a duplicate with identical message ID. Mailman then sends it back to inn2 which refuses to take it and the python nntp client throws an error, thus preventing an endless loop. Why inn2 even sends the message back to mailman I can't tell right now. These are the relevant snippets from my inn2 setup: # this is from /etc/news/news2mail.cf # no surprises, and it basically works. News from the grenzland.test # group is forwarded to the proper list address test-grenzland-club test(a)grenzland.club # this is in /etc/news/newsfeeds news2mail!:!*:Ac,Tc,Wn*:/usr/lib/news/bin/news2mail test-grenzland-club/grenzland.club:!*,grenzland.test:Ap,Tm:news2mail! # this last line should do two things: forward messages from the # test(a)grenzland.club list to the grenzland.test newsgroup, # AND don't send any messages back which have grenzland.club # in their Path header. This last bit seems to fail however, # and I fail to spot the error. I'll ask about this in the inn2 places I known of. Cheers, lkh -- Laurens Kils-Hütten https://lkh.sdf-eu.org

8 months

[MM3-users] Re: Set domain inactive / archive import from other domain.

by Johannes Winter

Am Sat, 15 Sep 2018 09:31:53 -0700 schrieb Mark Sapiro <mark(a)msapiro.net>: > On 09/15/2018 07:15 AM, Johannes Winter wrote: > > > > we've migrated a list from another domain and would like to keep the > > archives. Hyperkitty doesn't recognize the emails in the mbox > > archive during import due to the other domain name. > > > I don't understand the problem. I just ran a test where I imported a > mbox containing 3 messages which were not even list posts and in > which I had changed all the domain names to 'example.com'. I.e., in > the mbox I imported, the headers containing domain names looked like > > From root(a)example.com Sun Aug 26 09:12:06 2018 > Return-Path: <root(a)example.com> > Delivered-To: root(a)example.com > Received: by example.com (Postfix, from userid 0) > From: Anacron <root(a)example.com> > To: root(a)example.com > Message-Id: <20180826161158.F154D34010C(a)example.com> > X-msapiro-MailScanner-From: root(a)example.com > > and the 3 messages were all added to the archive. > > Why do you think the domain name is an issue? Perhaps the issue is > there is already one or more messages in the archive and the messages > you are importing are older. If you don't specify --since to > hyperkitty_import it won't import messages older than the newest > message in the existing archive. Thanks a lot for your excellent and fast support! That was the problem. Maybe it would be wise to include that into the help of the hyperkitty_import command? Although this command successfully imported 3/4 of the huge (1.7GB) mbox, it stumbled upon an error after some minutes: https://gitlab.com/mailman/hyperkitty/issues/200 -- Johannes Winter matrix: @yova:matrix.allmende.io

8 years, 1 month

[MM3-users] Re: SPF check fails for lists subdomain

by Odhiambo Washington

On Thu, Jan 5, 2023 at 10:56 AM Jan Eden via Mailman-users < mailman-users(a)mailman3.org> wrote: > On 2023-01-04 15:07, Mark Sapiro wrote: > > > On 1/4/23 14:02, Jan Eden via Mailman-users wrote: > > > > Although I could specify the IP address in my SPF records directly (as > > > you suggested), I do hope that my understanding of DNS records laid out > > > above is not entirely misguided. My current setup does work as expected > > > for eden.one, after all. > > > > As I said at < > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… > > > > I was misreading your DNS and now I am as puzzled as you about the > failure. > > It gets even more mysterious. I tried sending messages from both > lists.eden.one and janeden.net (my other domain) to a gmail account and > to another mail provider. Both messages passed the SPF checks on both > services (s. the relevant headers quoted below). Now because I send > those messages via my SMTP user (smtpuser(a)eden.one) and use SRS, the SPF > check operates (and succeeds) on e.g. > > srs0=jdm+=5c=lists.eden.one=testlist-bounces+gmailuser=googlemail.com(a)eden.one > (and not on somethingsomething(a)lists.eden.one or > somethingsomething(a)janeden.net) Could this be the reason for the failed > SPF checks in Yahoo's and Google's DMARC reports? > > - Jan > Might you be willing to use proven tools instead of trying so hard to understand the myth? I use https://easydmarc.com/tools#spf-tools It allows me to generate, lookup, test SPF, DKIM, DMARC, etc. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

3 years, 9 months

[MM3-users] Re: urls.py location on venv install

by Torsten

Am 2026-08-09 17:48, schrieb Mark Sapiro: > On 8/9/26 00:30, Torsten wrote: >> >> the traceback is this: >> >> Traceback (most recent call last): >> File >> "/opt/mailman/web/venv/lib/python3.13/site-packages/django/core/handlers/wsgi.py", >> line 124, in __call__ >> response = self.get_response(request) >> File >> "/opt/mailman/web/venv/lib/python3.13/site-packages/django/core/handlers/base.py", >> line 139, in get_response >> set_urlconf(settings.ROOT_URLCONF) >> ^^^^^^^^^^^^^^^^^^^^^ >> File >> "/opt/mailman/web/venv/lib/python3.13/site-packages/django/conf/__init__.py", >> line 104, in __getattr__ >> val = getattr(_wrapped, name) > >> Where should mailman_web.urls be located, also in /etc/mailman3 or >> rather in the venv of mailman_web in /opt/mailman...? > > How did you install Mailman? If you followed > <https://docs.mailman3.org/en/latest/install/virtualenv.html>, you > should have /etc/mailmasn3/settings.py which is similar to > <https://docs.mailman3.org/en/latest/install/virtualenv.html#initial-configu…>. > In particular, it should have near the beginning > ``` > from mailman_web.settings.base import * > from mailman_web.settings.mailman import * > ``` > The import from mailman_web.settings.base defines > ``` > ROOT_URLCONF = 'mailman_web.urls' > ``` > which points to mailman_web/urls.py in the venv's site-packages > directory. In fact, my settings.py does contain these import lines: import os from mailman_web.settings.base import * from mailman_web.settings.mailman import * BASE_DIR = ('/var/lib/mailman3/web') SECRET_KEY = '<MYSECRETKEY>' DEBUG = False #: Default list of admins who receive the emails from error logging. ADMINS = ( ('Mailman Suite Admin', 'torsten(a)bbadmin.de'),) ALLOWED_HOSTS = ['localhost', '127.0.0.1',] INSTALLED_APPS = [ 'django_mailman3', 'postorius', 'hyperkitty', # Uncomment the next line to enable the admin: 'django.contrib.admin', And I have the mailman_web/urls.py in the venv where mailman was installed.

2 months, 3 weeks

[MM3-users] Re: Mailman3 not working following distribution upgrade from Debian 10 to 11.

by David Newman

On 1/11/22 12:39 PM, gordon(a)dickens.com wrote: > 2) Install mailman3 using the venv and web instructions as suggested in this thread. I plan to use mysql (mariadb) since my database was originally implemented with mysql. I too use MariaDB. Here are the MariaDB-specific variations from the venv and web docs: 1. Before going through the venv docs I installed these packages: libmariadb3 libmariadb-dev default-libmysqlclient-dev 2. When installing mailman in venv, I did this: (venv)$ pip install --upgrade pip (venv)$ pip install wheel mailman pymysql mysqlclient 3. In /etc/mailman.cfg, the database config looks like this: .. [database] class: mailman.database.mysql.MySQLDatabase url: mysql+pymysql://myuser:mypassword@mymysqlhost/mailman?charset=utf8mb4&use_unicode=1 .. The url is all one line (it's wrapping in my mail client). 4. The [Unit] section of /etc/systemd/system/mailman3.service looks like this: [Unit] Description=GNU Mailing List Manager After=syslog.target network.target mariadb.service .. Note that this is on a Debian 11 system. On Debian 10 and previous, it'd be mysql.service instead of mariadb.service. 5. The settings.py file includes this section: .. # MySQL database setup. DATABASES = { 'default': { 'ENGINE': 'django.db.backends.mysql', 'NAME': 'mailmanweb', 'USER': 'mailman', 'PASSWORD': '<password>', 'HOST': 'localhost', 'PORT': '', 'OPTIONS': {'charset': 'utf8mb4'} # Enable utf8 4-byte encodings. } } .. Note that your NAME, USER, PASSWORD, and possibly HOST may differ. 6. The [Unit] section of /etc/systemd/system/mailmanweb.service looks like this: [Unit] Description=GNU Mailman Web UI After=syslog.target network.target mariadb.service mailman3.service .. Same caveat as with step 4 that this is for Debian 11, and you'd use mysql.service instead on Debian 10 and previous. I think that's all the changes, but if I've omitted something I hope Mark Sapiro or someone else can step in. dn

4 years, 9 months

[MM3-users] Re: Could not locate column in row for column 'user.id'

by Shashikanth Komandoor

Hi Mark, Thank you for your response. And sorry for not giving you complete information as I am not sue what to share with you. I am using Postgresql-11.7 as my backend database. The below is the structure of the address table in* mailman *database: mailman=# \d address; Table "public.address" Column | Type | Collation | Nullable | Default ----------------+-----------------------------+-----------+----------+------------------------------------- id | integer | | not null | nextval('address_id_seq'::regclass) email | character varying | | | _original | character varying | | | display_name | character varying | | | verified_on | timestamp without time zone | | | registered_on | timestamp without time zone | | | user_id | integer | | | preferences_id | integer | | | Indexes: "address_pkey" PRIMARY KEY, btree (id) "ix_address_email" UNIQUE, btree (email) "ix_address_preferences_id" btree (preferences_id) "ix_address_user_id" btree (user_id) Foreign-key constraints: "address_preferences_id_fkey" FOREIGN KEY (preferences_id) REFERENCES preferences(id) "address_user_id_fkey" FOREIGN KEY (user_id) REFERENCES "user"(id) Referenced by: TABLE ""user"" CONSTRAINT "_preferred_address" FOREIGN KEY (_preferred_address_id) REFERENCES address(id) ON DELETE SET NULL TABLE "autoresponserecord" CONSTRAINT "autoresponserecord_address_id_fkey" FOREIGN KEY (address_id) REFERENCES address(id) TABLE "member" CONSTRAINT "member_address_id_fkey" FOREIGN KEY (address_id) REFERENCES address(id) TABLE "onelastdigest" CONSTRAINT "onelastdigest_address_id_fkey" FOREIGN KEY (address_id) REFERENCES address(id) The below is the structure of *user* table: mailman=# \d user; Table "public.user" Column | Type | Collation | Nullable | Default -----------------------+-----------------------------+-----------+----------+---------------------------------- id | integer | | not null | nextval('user_id_seq'::regclass) display_name | character varying | | | password | character varying | | | _user_id | uuid | | | _created_on | timestamp without time zone | | | is_server_owner | boolean | | | _preferred_address_id | integer | | | preferences_id | integer | | | Indexes: "user_pkey" PRIMARY KEY, btree (id) "ix_user__user_id" btree (_user_id) "ix_user_preferences_id" btree (preferences_id) Foreign-key constraints: "_preferred_address" FOREIGN KEY (_preferred_address_id) REFERENCES address(id) ON DELETE SET NULL "user_preferences_id_fkey" FOREIGN KEY (preferences_id) REFERENCES preferences(id) Referenced by: TABLE "address" CONSTRAINT "address_user_id_fkey" FOREIGN KEY (user_id) REFERENCES "user"(id) TABLE "domain_owner" CONSTRAINT "domain_owner_user_id_fkey" FOREIGN KEY (user_id) REFERENCES "user"(id) TABLE "member" CONSTRAINT "member_user_id_fkey" FOREIGN KEY (user_id) REFERENCES "user"(id) mailman=# \dn List of schemas Name | Owner --------+---------- public | postgres (1 row) mailman=# select * from user; user ---------- postgres (1 row) *The above command output is not showing any fields. But if use the table as public.user (schema.tablename) with select command, it is showing the data. But without schema name this table is not showing those fields. Not sure if this the expected behavior or not.* I have not done any changes. Few days back I made DR machine up as I am taking primary into maintenance. The entire database was running streaming replication and I even kept the /var/lib/mailman directory in sync where all the components are installed. Please let me know if any more things I need to share. On Mon, Jul 27, 2020 at 7:45 AM Mark Sapiro <mark(a)msapiro.net> wrote: > On 7/26/20 10:56 AM, Shashikanth Komandoor wrote: > > Hi Team, > > > > I am currently running Mailman 3 with version 3.3.1 and in built > postfix > > version 2.10.1-6 on RHEL 7.5 in production environment from the past 2 > > months almost. > > > > From the past few days, I found my server is responding to the users > > very slowly and throwing the Server Error page (of course getting the > > required page after multiple refreshes) for almost every click on the > > postorius pages (not yet observed on hyperkitty front end which in fact > is > > not so important for me as of now). > > > > During that time, I observed in the mailman.log an error message > saying > > "Could not locate column in row for column 'user.id'". The complete > > traceback log is attached with the mail. The error message is generated > for > > almost all the lists and all the clicks. > > > I don't understand what's going on. I suspect some kind of database > corruption, but I don't know what. > > The traceback indicates Mailman is getting the Members of a list and in > this process is trying to get the display_name for a member. The > member's subscriber attribute doesn't have a display_name so it is > trying to get is from the member's user attribute so it is trying to get > the user record for the member's email address via > IUserManager.get_user(). This in turn gets the Address record for the > email address and returns it's user attribute. > > This leads to the > > sqlalchemy.exc.NoSuchColumnError: "Could not locate column in row for > column 'user.id'" > > error which I don't understand. There is no table with a 'user.id' > column. user.id refers to the id column in the user table which comes > from the user_id column in the address table which should be a reference > to the id column in the user table, not a reference to ay 'user.id' > column. > > What is your backend database and what is the structure of the address > table in that database. Have you done any kind of direct database query > that might have affected this? > > -- > Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- Thanks & Regards, Shashi Kanth.K 9052671936

6 years, 3 months

[MM3-users] Re: mailman 2.1 or 3.0 (or another MLM)

by nate

On 2022-01-26 9:37, Mark Sapiro wrote: > Posts to this list from non-members are discarded without notice. OK good to know, thanks. Didn't want one of my main email addresses to be leaked to the list (I have ~550 email addresses normally have one per purpose). > Your initial post was held because all new members are moderated by > default. This is an anti-spam measure. If you post on topic, we clear > your moderation. Can I suggest the messaging to new users be improved to communicate this situation as it is not clear. The automated message I got said this was the reason my message was held: The message comes from a moderated member. Which makes sense if I REALLY think about it(I was a moderated member at first), but then the next question is why was I moderated. Your explanation makes sense. It would be nice if it had more info along the lines of what you said, or even better adjust the messaging for the "Welcome" email to indicate your first message(s) will be held for moderation(I checked both emails I got back from the list just now to verify this info is not there). I was confused for a while(again 21 year veteran of mailman) thinking I sent my message using the wrong email address, after confirming I sent with the right one I just decided to wait to see what would happen. If you can adjust the messaging it would be good I think to make it really clear all CAPS, or putting **** message here **** in the email so it really stands out to the new users what the situation is. > And yes, Mailman 3 doesn't (yet?) have a way for ordinary users to > delete their own held posts. good to know too, thanks! nate

4 years, 9 months

[MM3-users] Re: Things I miss about mailman2

by Quanah Gibson-Mount

Hi Mark, --On Tuesday, March 17, 2020 1:43 PM -0700 Mark Sapiro <mark(a)msapiro.net> wrote: > The message comes from Mailman core. Mailman core does not know what > web management UI you are using or the URI to access it. You need to > change the template for the message to include the URL. Ok great, thank you!. >> b) When a post is made to a moderated list in mailman2, when I went to >> the page to approve/deny/discard, there was additionally an option to >> remove the moderated flag from the user for all future emails. This >> option no longer exists. This was EXTREMELY useful, as we force all new >> members of the list to be moderated for a time while we evaluate the >> quality of their postings. Now I have to go manually track down the >> user and their settings. Unnecessary extra hoops to jump through > > > Click on the subject in the held messages list. At the bottom of the > dialog that opens, there is a drop down to set the user's moderation. > Normally, you would set it to 'default processing'. I do not see any such option. After clicking on the header the only options available at the bottom are: Accept, Reject, Discard, Show Source, Show Header There are zero drop downs anywhere. > This was not "removed". It just hasn't been implemented in MM 3 yet. So in terms of available functionality that was present in MM2, it was removed. It may need to be re-implemented, but this was a core feature that was present in the prior version that is no longer available. --Quasnah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

6 years, 7 months

[MM3-users] Re: Change digest frequency and default threshold

by Henrik Rasmussen

Thanks for the hints. It looks to be a file permission problem. I am not sure what the right persommions should be inside he container. Is there a command for checking file permissions, like the Mailman 2's command check_perms? I couldn't file one. Mark Sapiro wrote: > Something is going wrong in this process in DigestRunner. Is > DigestRunner running? Yes: 43 mailman 2:05 /usr/local/bin/python /usr/local/bin/runner -C /etc/mailman.cfg --runner=digest:0:1 > Is there anything in Mailman's digest or shunt > queues? As of /opt/mailman/core/var/queue/digest/ and /opt/mailman/core/var/queue/shunt/ no, but there is three files in /opt/mailman/core/var/queue/bad/ -rw-rw---- 1 root root 398 Oct 10 14:42 1539175326.8246331+4b7e80db0d22f01c2d4363e323320fcd34560657.psv -rw-rw---- 1 root root 398 Oct 11 12:11 1539252672.3947155+ae2631d9f6514d74c77a38f09f821ee71515f9d9.psv -rw-rw---- 1 root root 398 Oct 11 12:24 1539253469.5928977+15b0842462ddd3abcac8d688e5bbb195b07409bc.psv They seems to be binary, buy strings reveal: mailman.email.message Message policy email._policybase Compat32 _headers _unixfrom _payload _charset preamble epilogue defects _default_type text/plain listid test.lists.example.com digest_path =/opt/mailman/var/lists/test.lists.example.com/digest.1.9.mmdf volume digest_number version _parsemsg If that reveals anything. > Is there anything logged in Mailman's 'mailman' log? It seem to say PermissionError: [Errno 13] Permission denied, but inside the container, the directoried in /opt/mailman/var/queue is drwxrwx--- 2 mailman root 4096 Mar 14 2018 archive drwxrwx--- 2 mailman root 4096 Oct 12 10:14 bad drwxrwx--- 2 mailman root 4096 Mar 14 2018 bounces drwxrwx--- 2 mailman root 4096 Mar 14 2018 command drwxrwx--- 2 mailman root 4096 Oct 11 10:24 digest drwxrwx--- 2 mailman root 4096 Oct 12 10:07 in drwxrwx--- 2 mailman root 4096 Mar 14 2018 nntp drwxrwx--- 2 mailman root 4096 Oct 12 10:07 out drwxrwx--- 2 mailman root 4096 Oct 12 10:07 pipeline drwxrwx--- 2 mailman root 4096 Mar 26 2018 retry drwxrwx--- 2 mailman root 4096 Mar 14 2018 shunt drwxrwx--- 2 mailman root 4096 Oct 10 12:32 virgin Henrik Rasmussen

8 years

Search results for query "sapiro"