Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: psycopg2 error?

by Mark Sapiro

On 10/26/23 01:03, Odhiambo Washington wrote: > > <CUT> > root@debian12:/home/wash# systemctl status mailman3.service > × mailman3.service - GNU Mailing List Manager > Loaded: loaded (/etc/systemd/system/mailman3.service; enabled; preset: > enabled) > Active: failed (Result: exit-code) since Thu 2023-10-26 09:36:41 EAT; > 8s ago > Process: 1893842 ExecStart=/opt/mailman/venv/bin/mailman start > (code=exited, status=1/FAILURE) > CPU: 789ms > > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: dbapi = > dbapi_meth(**dbapi_args) > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: > ^^^^^^^^^^^^^^^^^^^^^^^^ > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: File > "/opt/mailman/venv/lib/python3.11/site-packages/sqlalchemy/dialects/postgresql/psycopg2.py", > line 690, in import_dbapi > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: import psycopg2 > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: File > "/opt/mailman/venv/lib/python3.11/site-packages/psycopg2/__init__.py", line > 51, in <module> > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: from > psycopg2._psycopg import ( # noqa > Oct 26 09:36:41 debian12.wash.lan mailman[1893842]: SystemError: > initialization of _psycopg raised unreported exception > Oct 26 09:36:41 debian12.wash.lan systemd[1]: mailman3.service: Control > process exited, code=exited, status=1/FAILURE > Oct 26 09:36:41 debian12.wash.lan systemd[1]: mailman3.service: Failed with > result 'exit-code'. > Oct 26 09:36:41 debian12.wash.lan systemd[1]: Failed to start > mailman3.service - GNU Mailing List Manager. > </CUT> Is your database PostgreSQL or some other? If it's not PostgreSQL, see the thread at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… - particularly https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… Also see https://docs.mailman3.org/en/latest/install/virtualenv.html#installing-mail… where it now says in part "This will install latest release of Mailman Core, and Python bindings for Postgresql database. If you are using a different database manager, do not install psycopg2-binary." -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 6 months

[MM3-users] Re: Unable to update templates

by Mark Sapiro

On 5/28/25 19:40, Mark wrote: > > I have jumped the gun on thinking that the template as a file was > working. It's not. It's the same story: the initial file template is > good, but it's for sure getting cached somewhere, and an updated file is > ignored. The same as when the template was being drawn from the database. Are you just updating the file /opt/mailman/mm/var/templates/lists/testlist.example.com/en/list:user:notice:welcome.txt with nothing in Postorius and either no entry at all in the mailman.template table with name = 'list:user:notice:welcome' context = 'testlist.example.com' or if there is such an entry, with uri = 'file:///opt/mailman/mm/var/templates/lists/testlist.example.com/en/list:use…' If so, editing the file /opt/mailman/mm/var/templates/lists/testlist.example.com/en/list:user:notice:welcome.txt should work. > Restarting mailman3 and mailmanweb didn't help, neither did rebooting > the server. > > Looking at Gunicorn status, I see a failing connection to 127.0.0.1 > which is the error message I was getting when adding a new subscriber - > with the custom Welcome template in the database (which is why I moved > it to file). > > 127.0.0.1 and locahost are in the ALLOWED_HOSTS and CSRF_TRUSTED_ORIGINS > of the settings.py file > > I'm at a loss with this caching problem. Any other clues happily received. If as I say above, there is no entry in the mailman.template table for the name and context or if there is an entry with uri = 'file:///opt/mailman/mm/var/templates/lists/testlist.example.com/en/list:use…', then gunicorn and mailman-web are not involved at all - mailman core will get the template from the file directly. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

11 months, 1 week

[MM3-users] Re: Default values for new lists

by Mark Sapiro

On 1/10/20 11:16 PM, hansen(a)rc.org wrote: > I just moved from MM2 to MM3. I have some 50 lists I need to configure and they all need the same settings (private archives, max 2 recipients, etc.). I often add and remove lists. I'm pleased that I now can set domain-level templates, but I really need domain-level default list settings as well. > The archived 'Deault values for new lists' thread indicates that a new version is needed to get this into the UI. Is there a back-door way to alter these defaults in the mean-time? For lists you import from Mailman 2.1 using the `mailman import21` command, the Mailman 2.1 list settings are applied to the Mailman 3 list. As far as new lists you create in MM 3 goes, you can define more styles to be applied to newly created lists. See <https://mailman.readthedocs.io/en/latest/src/mailman/styles/docs/styles.html>. However, you can't just create a style via `mailman shell` as described there because it won't persist. You need to create a plugin that implements the style. See <https://mailman.readthedocs.io/en/latest/src/mailman/plugins/docs/intro.html> for info on this. Note the Components section discusses adding a plugin implementing an IRule, but one implementing one or more IStyle classes would be similar. Another possibility, which I haven't tested but which may work is to create Mailman 2.1 lists with the desired styles, but no members, owners, moderators, etc and save their config.pck files. Then you should be able to apply those settings to a Mailman 3 list using the `mailman import21` command. This will probably still require fixing some things on the MM 3 list such as Description, Information, Display name and Subject prefix, but it may help. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 3 months

[MM3-users] Re: Attachement processings questions

by Mark Sapiro

On 2/3/20 4:27 AM, Lars Schimmer wrote: > > In a mailinglist it seems some mails are not forwarded to a member, but > is listed in archive in hyperkitty. > That mail did include a PDF attachement, but HyperKitty does not list > any attachement. There are two issues here. Why wasn't the message delivered to list members?, and why is there no attachment in Hyperkitty? For the first issue, you need to examine mailman.log for the time of the post looking for errors and tracebacks. Also, the MTA logs may have useful info if the messages were sent but not delivered. For the second, there are many content filtering settings not (yet) exposed in Postorius. These include filter_extensions, filter_types, pass_extensions and pass_types which control which MIME parts are removed. For a newly created Mailman 3 list, these four settings are empty, but importing a Mailman 2.1 list will set them according to the corresponding MM 2.1 list's settings. > All I found was "convert HTML to plaintext", but does this setting > remove attachements? It would only affect HTML parts, not pdfs. > Is there any generel documentation about attachement processing in MM3? <https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/filterin…>. > I would like this mailinglist to accept mails with attachements, send it > to the members and archvie the attachments in HyperKitty, to. You can set Settings -> Alter Messages -> Filter content to No in Postorius to not do any content filtering at all. This will override the Collapse alternatives and Convert html to plaintext settings and pass the message without removing any MIME parts. But, I think you must have other issues, either with this mail in particular or in general as evidenced by the mail not being received by list members. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 3 months

[MM3-users] Re: mailman3 auto-disabling of subscriptions

by Mark Sapiro

On 6/16/23 20:04, Mike Wertheim wrote: > Thanks for the response. > > A while back I experimented with enabling verp-probes. The users on the > list were confused by the probe emails and sent me a lot of messages asking > about them, so I disabled it. But at least their delivery wasn't being disabled because the probes weren't being bounced. Further, the first sentence in the body of the probe is "This is a probe message. You can ignore this message." If you think the probe could be more explanatory, you can always set a list:user:notice:probe template to say what you want. > There is zero spam on the list. Ill try reducing "bounce info stale after" > to "2d". (Actually, would "1d" be even better?) Suppose you set it to 1d. This means that in order for a true bouncing user to have delivery disabled with threshold = 5 There have to be posts every day for 5 consecutive days. If it's set to 2d, there can only be one day out of 6 with no posts for a true bouncing user's delivery to be disabled. If you can't guarantee that condition, you might as well just set Process Bounces to No. I would ensure Notify owner on bounce increment and Notify owner on disable are set to Yes. Then, assuming Mailman core >= 3.3.5, when users scores are incremented the owner will get a notice containing the bounce DSN. With that information, you can figure out why these valid addresses are bouncing the mail. Or, if the bounces occur during your outgoing SMTP, your MTA logs will have the reason. Given that information, you may be able to fix whatever is causing the delivery issue. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 10 months

[MM3-users] Re: Mailman stopping message distribution because of SMTP errors

by Mark Sapiro

On 2/11/20 10:28 PM, Victoriano Giralt wrote: > > I have recently migrated some lists from Mailman 2 to Mailman 3. Users have > been added using the mailman client as pre-verified addresses so the > migration happened "silently". Thus, there was a dozen "bad" addresses > (domains that did not exist anymore). It seems you rolled your own instead of using `mailman import21`. Is there a reason for this? > Unfortunately, Mailman got some of the "bad" addresses in the first message > batch for sending out, so, Postfix closed the connection because of "too > many errors" and this stopped the process completely, i.e. Mailman did not > continue sending messages to the rest of the list over 600 addresses. Is the message shunted? Is there a traceback and a shunting message in mailman.log? Normally, I would expect the message to be queued in Mailman's retry queue and retried by Mailman > There was no more information in the logs than the Postfix error messages > in smtp.log. What was in the smtp.log? Nothing in mailman.log? Nothing in var/queue/shunt? > Once the "bad" addresses were removed, the list started working as > expected. > > I consider this a bug. The bouncing addresses should have been marked as > "non deliverable" and the subscriptions "paused" and the rest should have > been delivered. Or, the list owner should have been notified that there was > a problem with message distribution. None of these happened. The HEAD of the https://gitlab.com/mailman/mailman master branch implements bounce processing. This will be in 3.3.1 which is not yet released. The place for a bug report is <https://gitlab.com/mailman/mailman/issues>. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 2 months

[MM3-users] Re: [Django] ERROR (EXTERNAL IP): Service Unavailable

by Mark Sapiro

On 2/25/21 9:38 AM, dancab(a)caltech.edu wrote: > Mark, > > Is it only this list that has an issue? > > Yes, this is the only list that is having the issue. > > Can you visit other pages for this list? > > Yes, I'm able to view the members list, list settings, templates, etc. > > I've restarted the service and tried to access the held messages for the list once again. Here's what is in the mailman log. > > > ERROR 2021-02-25 17:28:14,197 393 postorius Mailman REST API not available > Traceback (most recent call last): > File "/opt/mailmanve/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen > chunked=chunked, > File "/opt/mailmanve/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 445, in _make_request > six.raise_from(e, None) > File "<string>", line 3, in raise_from > File "/opt/mailmanve/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request > httplib_response = conn.getresponse() > File "/usr/lib64/python3.6/http/client.py", line 1346, in getresponse > response.begin() > File "/usr/lib64/python3.6/http/client.py", line 307, in begin > version, status, reason = self._read_status() > File "/usr/lib64/python3.6/http/client.py", line 276, in _read_status > raise RemoteDisconnected("Remote end closed connection without" > http.client.RemoteDisconnected: Remote end closed connection without response This is from Django's log. What's in Mailman core's mailman.log? Since everything else is accessing the REST API with no problem, I think core must be stuck on something and timing out. Is there a time delay between trying to get the held messages view and the "Mailman REST API not available. Please start Mailman core." response? Also is there a non-zero count in the badge on the Held messages tab? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 2 months

[MM3-users] Re: update_index_one_list in parallel?

by Mark Sapiro

On 5/28/19 3:44 AM, Szymon Sokół wrote: > > Now, however, I have noticed that indexing my archives in hyperkitty (using "manage.py update_index_one_list" for each list in sequence) takes quite a lot of time while using only one CPU (out of 4). Hence my question - is it safe to run several such processes in parallel, and if so, will it have any benefits? I have no idea how locking on the database is done in this code, maybe I'll end up running the jobs in sequence anyway due to exclusive locks… Any informed answers will be appreciated. As Abhilash says, we really haven't tried. You could try running more than one "manage.py update_index_one_list" for different lists in parallel and see how it goes. I suspect it depends on the Haystack backend. Whoosh tends to be used because it's pure Python and installable with pip, but again as Abhilash says, we have recently converted to elasticsearch. There are some issues with that both due to the fact that elasticsearch runs as a separate service on the host, and we are using elasticsearch 5, the Haystack support for which is still developmental (and the current elasticsearch version is 7), but for example, indexing 180,000+ messages on mail.python.org takes 15 minutes elapsed time (about 14 minutes CPU) with elasticsearch which is an order of magnitude faster than the multiple hours it took with Whoosh. On the other hand, this only affects search in HyperKitty, and you didn't have archive search in Mailman 2.1, so if it takes an extra day to get it working in HyperKitty, it's probably not a big deal. You could just migrate all your lists and when done, run manage.py rebuild_index & and just let it run in the background until it's done. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 11 months

[MM3-users] Re: non-member moderation: list default vs default processing

by Mark Sapiro

On 5/24/21 10:46 AM, dancab(a)caltech.edu wrote: > Sorry for any confusion. I'm specifically referring to addresses configured as "accept_these_nonmembers" in Mailman2. Upon importing to Mailman3 I see the moderation setting for most of those non-members as "Default Processing -- run additional checks and accept the message." This is the correct result for an imported address from accept_these_nonmembers. > However, I've seen a few others set with the moderation option as "List default -- follow the list's default member action." after migrating to Mailman3. In our case that means "Hold for moderation". So we've had a couple of incidents where a user that was able to email the list just fine via Mailman2 is unable to message the list once migrated to Mailman3. > > I'll try importing more lists to look for some kind of pattern now that I'm aware of this happening. Yes. importing an address from accept_these_nonmembers should not result in a non-member with moderation_action = List Default. If you send me a config.pck that you imported that resulted in this, I'll investigate further, or perhaps you can identify the conditions that cause this. One thing you might look at is whether the affected addresses were previously imported as members or non-members of another list. Also, I don't know if this is possible given your list create/import scenario, but if there is a window between list creation and the import, if the non-member posts during that window, a non-member record will be created with moderation_action = List Default and the import won't change that. If this is the case, the import will print <address> is already imported with role MemberRole.nonmember for each such address. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: Dealing with spam from Web users

by Mark Sapiro

On 4/1/23 08:09, Jeremy Stanley wrote: > We recently migrated a bunch of lists from 2.1 to 3.3.7 and have > started to get spammers posting via HyperKitty (because I guess > that's easier for them than SMTP). It looks like I should be able to > set posts from HyperKitty to be automatically moderated by creating > a header filter on "User-Agent" matching "HyperKitty" but is there a > better/easier way? Typically, these would be non-members posting from HyperKitty and then being automatically subscribed. Set `Default action to take when a member posts to the list` to `Hold for moderation` so that all posts from members you haven't seen before are held. Then when handling a held post, if it is spam set the posters moderation action to discard and discard the message; if it is on topic, set the posters moderation action to default processing and accept the message. > Also, for things which already went out to the list, obviously I can > ban the spammer but what's the cleanest solution for removing > their posts from list archives so that we don't further their goals > by continuing to publish their handiwork? List owners should be able to delete messages and threads from HyperKitty, but they can't. See <https://gitlab.com/mailman/hyperkitty/-/issues/261>. You need to be a superuser to do this. If you are logged in as a user with Superuser status there will be a `Delete this thread` link in the thread view and a `Delete this message` link in the message view. You can use the `django-admin createsuperuser` command to create superusers. Also, anyone who is a superuser can set this for any user via the Django admin web UI. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 1 month

Search results for query "sapiro"