Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: Mirroring a mailman3 server

by Mark Sapiro

On 1/16/22 9:09 AM, Axel Rau wrote: > > What else must be synced (by rsync)? Aside from the database, there are multiple directories containing Mailman mutable data. Where these directories are depends on Mailman's layout configuration. For all layouts except `fhs` they are all in a single directory, but for `fhs` they are split. See https://gitlab.com/mailman/mailman/-/blob/master/src/mailman/config/mailman… Depending on exactly what's going on between the two servers, you need to decide what needs to be synced. For example, you probably don't want to sync .pid files or or the locks directory. You probably should sync archives/, cache/, data/, etc/, lists/, messages/, templates/, public_suffix_list.dat and the search engine's (Whoosh, Xapian, whatever) index files. Syncing Mailman's queue files is problematic. They are very dynamic and it isn't practical to rsync them. The same is true to a lesser extent with messages/ > While creating a domain, what should I enter into the fields? > > Mail Host lists.framail.de (currently lists5.lrau.net) Mail Host is the FQDN of the host's email address. > Alias Domain listsl.framail.de Alias Domain is a special case to handle situations where Mail Host is a Postfix virtual domain rather than a local destination. It is normally None (not set), and if requires would never be the same as Mail Host. See https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/docs/mta.h… > Web Host lists.framail.de (currently lists5.lrau.net) Web Host is the host name of the web web server, i.e., the host in the URL that accesses the web UI -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 9 months

[MM3-users] Re: List of "site admin" commands in Mailman 3.1 docker-mailman

by Mark Sapiro

On 07/17/2017 07:55 AM, Henrik Rasmussen wrote: > > On another note: Is it a setting in the mailman-users(a)mailman3.org list setup that make each of my postings to the list come back with the note "This sender failed our fraud detection checks and may not be who they appear to be."? I suspect this is something in the MTA/MDA chain between the lists.mailman3.org server and you. I suspect that something in that path doesn't like the fact that your original message's DKIM signature has been broken by such things as subject prefixing and addition of the list's msg_footer. When your message reaches my server at msapiro.net, it sees > Authentication-Results: sbh16.songbird.com; > dkim=pass (1024-bit key; unprotected) header.d=mailman3.org header.i=(a)mailman3.org header.b=QBeM9elY; > dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=alumni.onmicrosoft.com header.i=(a)alumni.onmicrosoft.com header.b=GeTpYnXK; > dkim-atps=neutral I.e., the list's DKIM sig is valid but your original sig is not, even though it was valid when received by the list > Authentication-Results: mail.mailman3.org; dkim=pass > reason="1024-bit key; unprotected key" > header.d=alumni.onmicrosoft.com header.i=(a)alumni.onmicrosoft.com > header.b=GeTpYnXK; dkim-atps=neutral If my suspicion is correct, you should be seeing the same thing with other people's posts such as this reply and your posts to other lists. If you don't then my suspicion about DKIM is not the reason and it is something else or the conditions are more complex. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 years, 3 months

[MM3-users] Re: Bounce handling after upgrade

by Mark Sapiro

On 7/8/20 6:05 AM, David Krantz wrote: > > To my surprise mailman core started by sending tens of mails and > blocking the corresponding users for very old bounces. What is worse > is that this happens every time I start mailman core. Now I have > blocked (almost) all outgoing mail in postfix using a transport map > which discards it but this is a temporary testing measure of course. Sorry about that. Yes this is an issue when first upgrading from a prior version to 3.3.1, there are lots of old unprocessed bounce events which all of a sudden get processed. See below for solutions. > When I deploy this server into production, I do not want these > recipients to be blocked as the old problems have been solved since > very long. My plan is to reload the database from a newer backup > anyway... Would it be enough to empty the bounce table (bounceevent) > or is there anything else driving this behaviour? Or is there a better > way to do this via the mailman shell? For me a "delete from > bounceevent" seems a lot simpler than anything via the shell but there > may be dependencies in the database. You are on the right track. The "delete from bounceevent" is a perfectly acceptable solution. So is "update bounceevent set processed = true". Another way to deal with this is to set [mta] verp_probes: yes in mailman.cfg. This will still send a lot of probe messages which may be undesirable, but if the probes don't bounce, the user's delivery won't be disabled. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 3 months

[MM3-users] Re: Hyperkitty not receaving messages / empty archive [Django] ERROR (EXTERNAL IP): Internal Server Error: /hyperkitty/api/mailman/urls

by Mark Sapiro

On 1/21/25 05:44, Helge Baumgart wrote: > Hyperkitty-Api-Key in the docker-compose.yml is set via .env Variabel, > so it should be identical. I don't know how this works in the Docker image, but ... > Traceback (most recent call last): > File > "/usr/lib/python3.11/site-packages/django/core/handlers/exception.py", > line 56, in inner > response = get_response(request) > File > "/usr/lib/python3.11/site-packages/django/core/handlers/base.py", line > 197, in _get_response > response = wrapped_callback(request, *callback_args, > **callback_kwargs) > File "/usr/lib/python3.11/site-packages/hyperkitty/views/mailman.py", > line 109, in _decorator > not hmac.compare_digest( > > Exception Type: TypeError at /hyperkitty/api/mailman/urls > Exception Value: unsupported operand types(s) or combination of types: > 'str' and 'NoneType' The above code is doing auth = authorization.split() if (len(auth) != 2 or auth[0] != 'Token' or not hmac.compare_digest( auth[1], settings.MAILMAN_ARCHIVER_KEY)): and the exception says either auth[0] is None or auth[1] or settings.MAILMAN_ARCHIVER_KEY is None. But > META: ... > HTTP_AUTHORIZATION = 'Token (value)' and > Settings: > Using settings module settings ... > MAILMAN_ARCHIVER_KEY = '********************' So The Authorization header is the appropriate `Token value` which should result in auth[0] being 'Token', auth[1] being the value and MAILMAN_ARCHIVER_KEY is set > That is my docker-compose.yml: ... > mailman-web: ... > - HAYPERKITTY_API_KEY=${MM3_HYPERKITTY_API_KEY} #someapikey_longAndTrustworty I don't really understand why the above typo (HAYPERKITTY_API_KEY, not HYPERKITTY_API_KEY) would cause this error, but it needs to be fixed. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months, 1 week

[MM3-users] Re: Mailman List Lost on URL transfer

by Mark Sapiro

On 09/20/2017 10:28 AM, heartsandbones(a)zoho.com wrote: > > Here’s the scoop: > I did a web site redesign for a non-profit. They didn’t mention to me that they had a mailman list associated with the site. When we transferred the url to Squarespace their list quakers(a)sbfriends.org stopped functioning and the administration login link: http://mail.sbfriends.org/mailman/admin/quakers_sbfriends.org results in a “server not found” error. > > I don’t know how to set up the site so that their mailman list works again. Please tell me exactly what to do to make this work. Let me know if I can provide any additional information to help you help me. As I have told you in other communications, you need a DNS A record for the mail.sbfriends.org pointing to the IP address of the Mailman server that hosts the list. We have no idea what that IP address is. You will have to ask your client what Mailman hosting service they were using for their sbfriends.org domain. That A record will probably suffice to get to the web UI for the list, but you will probably also need an MX record for the sbfriends.org domain pointing to mail.sbfriends.org for mail delivery to the list. > This is my first post to this forum, so I hope I’ve done so correctly. The correct list for Mailman 2.1 issues (http://mail.sbfriends.org/mailman/admin/quakers_sbfriends.org is a Mailman 2.1 URL) is mailman-users(a)python.org <https://mail.python.org/mailman/listinfo/mailman-users>. This list is for Mailman 3. However, you won't get a different answer from that list. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 years, 1 month

[MM3-users] Re: Can login at /admin, but cannot login at the account/login page.

by Mark Sapiro

On 8/14/21 9:34 PM, Stephen J. Turnbull wrote: > I'm sorry, I'm in a "second vaccination" fog at the moment (mending > but concentration lasts only about 10 minutes), so I'll answer what I > know offhand since Abhilash is busy and Mark is probably offline for > vacation by now. Not quite, but very soon. > pabsta(a)gmail.com writes: > > > However, if logout and attempt to login from the postorius website, > > I get a « 502 bad gateway » error after roughly 30 seconds. The > > logs in Systemctl for gunicorn register a "DIGEST-MD5 common mech > > free" error message > > I would guess this is also just a connection drop because it doesn't > receive the expected response within timeout. I'm sure that's right. > > and the nginx error logs just show a connection drop: > > > > 2021/08/12 18:11:09 [error] 26026#26026: *31 upstream prematurely closed connbection while reading response header from upstream, client: [ip redacted], server: > > [domain redacted], request: "POST /accounts/login/ HTTP/2.0", upstream: "http://127.0.0.1:8006/accounts/login/", host: "[domain redacted]", referrer: "https://[domain redacted]/accounts/login/?next=/mailman3/lists/" > a > I see in the above `upstream: "http://127.0.0.1:8006/accounts/login/",` but in your settings ACCOUNT_DEFAULT_HTTP_PROTOCOL = "https" I suspect you may be getting a redirect from http to https which is losing POST data and you need to change proxy_pass http://127.0.0.1:8006; in your nginx configuration to proxy_pass https://127.0.0.1:8006; or set ACCOUNT_DEFAULT_HTTP_PROTOCOL = "http" -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 2 months

[MM3-users] Re: File "/usr/lib/python2.7/httplib.py", line 1148, in getresponse raise ResponseNotReady()

by Mark Sapiro

On 10/2/20 10:49 AM, Alex Schuilenburg via Mailman-users wrote: > > So something in the import has decided that the original message quote > is a header and the To: field has been modified to protect the sender > so has created the email <Firstname Surname@Company-UK> (note the > space). Not only that, it has decided this is a valid email address. > So a bug, filed as https://gitlab.com/mailman/mailman/-/issues/777 > Unfortunately I've been moving the lists over a clutch at a time, and > they are active, so I cannot just drop everything and start over. I can > munge the future .mbox files being imported to remove the quoted email > to stop this happening again, but ideally I also need to find and fix > the errors in the database. I'm very new to mm3, but handy with SQL > (I'm running on mariadb) so suggestions appreciated. There's much more detail in my reply at <https://gitlab.com/mailman/hyperkitty/-/issues/320#note_422894486>, but you can fix the ResponseNotReady() issue from the sync_mailman job by finding the entries in the hyperkitty_sender table with invalid addresses in the address column and deleting them. We can try to address this specific issue in hyperkitty_import, but there are in general various mbox defects that we can't detect. mboxes need to be checked for unescaped `From ` lines in message bodies and other defects before importing them. The Mailman 2.1 bin/cleanarch script and the new hyperkitty/contrib/check_hk_import script can help with some of this. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years

[MM3-users] Re: 500 error on Held Messages page

by Mark Sapiro

On 9/21/22 16:24, Dan Caballero wrote: > Mark, > > I'm seeing this issue pop up this week with several lists. You previously mentioned two conflicting browsers potentially causing the issue. Can you elaborate? That would only cause a transient issue which would not occur on a subsequent get of the held message view. I gather this is not the case here. I.e. once the error occurs on a get of the held message view, it is persistent. > In addition, is there a way for me to run this cleanup using mailman shell -r "somescript" so that I can check all the lists instead of one by one? For a -r script, try ``` # In non-interactive scripts, we need the explicit imports. from mailman.interfaces.listmanager import IListManager from mailman.interfaces.requests import IListRequests, RequestType from zope.component import getUtility def somescript(): for mlist in getUtility(IListManager): requestdb = IListRequests(mlist) for req in requestdb.held_requests: if req.request_type == RequestType.held_message: if not requestdb.get_request(req.id): print(f'List: {mlist.list_id}, Bad request id: {req.id}, deleting') requestdb.delete_request(req.id) ``` The real question here is what are these spurious requests and how are they occurring. If you do a query like ``` SELECT * FROM _request; ``` Are there entries with empty `data_hash` or entries with an `id` that is not the value of any `pended_id` in the `pendedkeyvalue` table. BTW, I understand why you thought an import was needed in the interactive script in my message at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… - the `from mailman.interfaces.` line was a mistake on my part and shouldn't have been there. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 1 month

[MM3-users] Re: Manage Member(s) Mailman Settings / Display Names

by Mark Sapiro

On 5/18/22 10:48, dancab(a)caltech.edu wrote: > Mark, > > We have a question related to this thread. We use LDAP for authentication. It seems that the name attributes can only be edited via the LDAP synchronization when a user logs in for the first time and thus creates their user account. > > But what about list members that are not in LDAP? What happens behind the scenes when a member is added to a list? The user's display name is set when the user record is initially created. Assuming someone who is initially unknown, this can happen when the unknown user signs up for a web account, when the unknown user subscribes to a list via the web UI or when the unknown user is mass subscribed to a list. > Manually subscribing members has different results with our configuration. > > I've seen the manually entered name show up as "None" <foobar(a)caltech.edu>. There was a pre-existing user with that address and no display name. > I've seen the entry be accepted as is, eg. "John Doe" <jdoe(a)example.com> > I've seen the name entry be ignored but the email accepted eg. "Foo Bar" <foobar(a)caltech.edu> is subscribed but the member list only shows <foobar(a)caltech.edu> The display name has nothing to do with message acceptance. That is based only on the address. In Postorius >=1.3.6 there is a `Users` selection at the top of most pages if you are logged in as a superuser. This allows management of users including their display name. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 5 months

[MM3-users] Re: Mailman archive issues (Hyperkitty)

by Mark Sapiro

On 6/15/21 11:31 AM, Kimmo L wrote: > > It seems that we have some perfomance issues on webUI, if we try to check archived messages. > Some lists, that contains low number of archives is not a problem but lists, that contains several thousand messages and grows faster are issue. Sometimes it loads so long, that i get "504 Gateway Time-Out" > I was also monitoring server perfomance and i didnt see any issues on that side. It seems that there might be some issues to read archived messages from database. But this is just my one opinion. > > I also debugged log files and found some error messages: > 1) mailmansuite.log -> django.db.utils.DatabaseError: out of memory for query result > # it happens when i try to open a lists in webui, to check archived messages. > nginx-error.log -> upstream timed out (110: Connection timed out) while reading response header from upstream > # also happens when i try to open list in hyperkitty and it takes long time to open > > If any information is more needed then let me know. My one thought was also, that maybe i need to try rebuild_indexes. Rebuilding indexes will affect only searches. It should have no effect on just opening a list. We have some large imported archives at https://mail.python.org/archives/ e.g. https://mail.python.org/archives/list/mailman-users@python.org/ with over 85,000 messages, and don't see these issues. It definitely looks like your server doesn't have enough memory. You might also run memcached and enable it for Django https://gitlab.com/mailman/mailman-suite/-/blob/master/mailman-suite_projec… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 4 months

Search results for query "sapiro"