Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: Badsignature on uwsgi-error.log

by Mark Sapiro

On 3/22/24 09:48, David Partain via Mailman-users wrote: > > Right now, archiving is not working on the new installation, both building the archive on the new installation after the move and for new messages. > > uwsgi-error.log is getting blasted with constant errors along the lines of what follows. I suspect that these errors are why archiving isn't working, but I obviously don't know that: > > Message: BadSignature('Signature "ZWBXqQmWZwHTfa390lLIacpp8NQ" does not match') I'm not sure if this is the issue with archiving or not. > What we have in our config files on the old installation and new installation are (the quotes are exactly as they are in the files): ... > settings.py > > SECRET_KEY = 'somerandomstringiaintputtinginmail' > MAILMAN_ARCHIVER_KEY = 'somerandomstringiaintputtinginmail' > > mailman-hyperkitty.cfg > > api_key: somerandomstringiaintputtinginmail > > All of that says that the value is the same for all three (whether I should have done so or not...) and those settings were carried along to the new installation as well. See my reply at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… As I say there, SECRET_KEY is not related in any way to MAILMAN_ARCHIVER_KEY and api_key. The latter two have to do with archiving and must match. The former is a Django thing and is completely separate. At this point, put ``` SECRET_KEY_FALLBACKS = [ 'F6V0Dr_SvBsx5-cY8vcvLXrX8tA', 'ZWBXqQmWZwHTfa390lLIacpp8NQ', ] ``` in your local Django settings file. If you continue to get BadSignature: Signature "..." does not match' errors, add those unmatched signatures to SECRET_KEY_FALLBACKS. Once you are no longer seeing BadSignature errors, if archiving is still not working, report any errors you are seeing from Mailman's mailman.log and Django's log. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 5 months

[MM3-users] Re: Does hyperkitty show JPEGs in line and what about attachments?

by Mark Sapiro

On 07/12/2017 04:47 AM, Jason Glazer wrote: > > Does anyone know if Hyperkitty can be configured to allow for inline > images to be maintained so that an HTML file looks like a normal HTML > message? > > Also, can attachments to a message under Hyperkitty preserve their name > rather than being "scrubbed" into "attachment-*.*" files? The answer to some of this is at <https://lists.mailman3.org/archives/list/test@mailman3.org/message/N3XVN3DC…>. One question unanswered by that post is what happens with an inline image in an HTML message body. In the original message, the image is referenced by an IMG tag with "src=" pointing to the image MIME part. Since this structure is not maintained in HyperKitty, inline images probably don't work. Also, with respect to Mailman 2.1, if you want the scrubber to preserve file names and extensions, set the following in mm_cfg.py SCRUBBER_DONT_USE_ATTACHMENT_FILENAME = False SCRUBBER_USE_ATTACHMENT_FILENAME_EXTENSION = True and if you want scrubbed HTML to not be HTML escaped so it renders rather than looking like raw html, set ARCHIVE_HTML_SANITIZER = 3 but note this comment from Defaults.py > # 3 - Remove text/html as attachments but don't HTML-escape them. Note: this > # is very dangerous because it essentially means anybody can send an HTML > # email to your site containing evil JavaScript or web bugs, or other > # nasty things, and folks viewing your archives will be susceptible. You > # should only consider this option if you do heavy moderation of your list > # postings. This is an issue with HyperKitty as it appears this is what HyperKitty does and there's no way to turn it off. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

8 years, 2 months

[MM3-users] Re: Link to account

by Mark Sapiro

On 4/11/23 12:04, Lars Bjørndal wrote: > Thanks a lot. Maybe I've done a mistake, it doesn.t work. > > At the bottom of /etc/mailman3/settings.py I have: > > ROOT_URLCONF = 'urls' > > `cat /etc/mailman3/urls.py` > > [...] > > urlpatterns = [ > path( > '', > RedirectView.as_view(url=reverse_lazy('list_index'), permanent=True), > ), > path('lists/mailman3/', include('postorius.urls')), > path('lists/archives/', include('hyperkitty.urls')), > path('lists/', include('django_mailman3.urls')), > path('lists/accounts/', include('allauth.urls')), > path('lists/admin/', admin.site.urls), > ] > > In Apache config for the domain, I now have: > > <IfModule mod_proxy.c> > ProxyPreserveHost On > ProxyPass "lists/mailman3" "http://127.0.0.1:8000/lists/mailman3" > ProxyPass "lists/archives" "http://127.0.0.1:8000/lists/archives" > ProxyPass "lists/accounts" "http://127.0.0.1:8000/lists/accounts" > ProxyPass "lists/admin" "http://127.0.0.1:8000/lists/admin" > ProxyPass "lists/user-profile" "http://127.0.0.1:8000/lists/user-profile" > </IfModule> > > Restarted mailmanweb, httpd and mailman3. > > If I go to list.punktskriftutvalget.no/mailman3/, I get a 404 Not Found response in browser. > > So what's wrong, do you think? You followed https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… literally. The literal instructions where to access everything via URLs like https://mydomain.org/lists/.... If you were to replace `lists` with `mailman3` everywhere in the abpve, you would then access HyperKitty via a URL like https://list.punktskriftutvalget.no/mailman3/archives/ and Postorius via https://list.punktskriftutvalget.no/mailman3/mailman3/ If that's not what you want, it's more complicated and some things might not be possible. What exactly do you want for access to Postorius, HyperKitty, user accounts, user profiles and the Django admin UI? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 5 months

[MM3-users] Re: log rotation for bounce.log

by Mark Sapiro

On 1/22/24 14:50, Quanah Gibson-Mount wrote: > I noticed that our smtp.log and bounce.log files haven't been rotated in > years. I see the reason for smtp.log not being rotated is due to > <https://gitlab.com/mailman/mailman/-/issues/931>. Does this same issue > affect bounce.log or is it safe to rotate similar to mailman.log? Rotating all the logs in Mailman's var/logs/ directory is appropriate. This is the logrotate script I use. ``` /opt/mailman/mm/var/logs/*.log { missingok sharedscripts su mailman mailman postrotate if [ -r /opt/mailman/mm/var/master.pid ]; then PID=`cat /opt/mailman/mm/var/master.pid` kill -s HUP $PID fi if [ -r /opt/mailman/mm/var/gunicorn.pid ]; then PID=`cat /opt/mailman/mm/var/gunicorn.pid` kill -s USR1 $PID fi endscript } ``` You will still have the issue #931 in that the smtp.log will rotate, but as it says in that issue, the runners that write smtp.log directly will write to the new generation, but aiosmtpd continues to write to the older log until such time as mailman core is restarted. I'm not sure what will happen if mailman core is not restarted before the log aiosmtpd is writing to is rotated out of existence, but that could be an issue too. You could avoid this by replacing ``` if [ -r /opt/mailman/mm/var/master.pid ]; then PID=`cat /opt/mailman/mm/var/master.pid` kill -s HUP $PID fi ``` in the above postrotate script with ``` if [ -r /opt/mailman/mm/var/master.pid ]; then sudo -u mailman /opt/mailman/mm/bin/mailman restart &>/dev/null || true fi ``` but there is a potential issue in that if Mailman is delivering list mail when the `mailman restart` command is issued, some recipients may receive duplicates. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 7 months

[MM3-users] Re: hyperkitty threads by month question

by Mark Sapiro

On 7/26/24 10:41, Bryan Fields wrote: > On 7/26/24 1:30 PM, Bryan Fields wrote: > >> mailman=> \c mailmanweb >> You are now connected to database "mailmanweb" as user "mailman". >> mailmanweb=> SELECT * FROM hyperkitty_thread WHERE EXTRACT(year FROM >> date_active) < 1000; >> id | thread_id | date_active | >> category_id | mailinglist_id | starting_email_id >> -------+----------------------------------+------------------------+-------------+----------------+------------------- >> 35670 | GHLCKUC7TDEBAI27SKRQN5PWX3TGB26Q | 0102-04-15 20:06:12+00 >> | | 3 | 150555 >> (1 row) >> >> mailmanweb=> SELECT id FROM hyperkitty_email WHERE EXTRACT(year FROM >> date) < 1000; >> id >> -------- >> 136872 >> 150555 >> (2 rows) >> >> Does this mean it imported archives with an invalid date somehow? Yes, I suspect this bad date is part of the issue. I would do a few things. First, SELECT message_id FROM hyperkitty_email WHERE thread_id = 35670; If this returns just the one message_id, I would then DELETE FROM hyperkitty_thread WHERE id = 35670; DELETE FROM hyperkitty_email WHERE id = 150555; and see if that fixes the internal server error when accessing the archive. I would also SELECT * FROM hyperkitty_email WHERE id = 136872; and maybe update the `date` in that entry. After deleting that one message and thread, you can make a mbox with just the one message with the date corrected and run hyperkitty_import with `--since 2000-01-01` and that mbox as input to add the message back to the archive. Also, FYI, assuming those messages with very old Date: headers had reasonable unix from dates, the hyperkitty/contrib/cleanarch3 script would fix them, except you have to get the script from https://gitlab.com/mailman/hyperkitty/-/blob/master/hyperkitty/contrib/clea… or https://www.msapiro.net/scripts/cleanarch3 because the script in the latest release has a bug. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 year, 1 month

[MM3-users] Re: How to prevent members to attach executables (exe, bat, ...) to the emails sent to list

by Mark Sapiro

On 10/1/20 3:23 PM, Mohsen Masoudfar wrote: > Hi Mark, > Thanks again for the helpful hint. It seems that I still miss something. I am running Mailman3.1.1. I ran the following on my test server. > I am trying, for test purpose only, to filter PDF attachments. > > First I just used the pass_type, assuming once this is set, everything else is filtered. That's how it should work. > # mailman withlist testlist3(a)x.com >>>> m.pass_types = ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] >>>> commit() >>>> print(list(m.pass_types)) > ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] > > This let PDF be send by Mailman3. Well, I need to add filter_types too, so I did this: It shouldn't unless athe Content-Type: of the PDF part was text/* or application/pgp-signature >>>> m.filter_types = ['application/pdf'] >>>> commit() >>>> print(list(m.filter_types)) > ['application/pdf'] This should allow ONLY the PDF and nothing else, not even the text/* message body parts. > Mailman3 still distributes PDF files as attachment. What am I doing wrong? > > This is the final settings: > >>>> print(list(m.pass_types)) > ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] >>>> print(list(m.filter_types)) > ['application/pdf'] This is wrong. set m.filter_types =[] Look at the raw message you receive from the list. What is the VConten-Type of the PDF part? Actually, what's m.filter_content? I suspect it's False which means don't do any content filtering. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 11 months

[MM3-users] Re: Request for help debugging a hyperkitty connection issue

by Mark Sapiro

On 1/6/22 12:12 PM, Stephen Daniel wrote: > > I have two problems. One is with getting list mail out of GCP. I am > working on that. The issue I don't know how to address is a problem with > hyperkitty. Nothing is being archived. When I send an email through my > test list, this message shows up in the mailman log: > > Jan 04 11:57:26 2022 (806) Exception in "hyperkitty" archiver > > Traceback (most recent call last): > > File > "/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/connection.py", > line 175, in _new_conn > > (self._dns_host, self.port), self.timeout, **extra_kw > > File > "/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/util/connection.py", > line 73, in create_connection > > for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): > > File "/usr/lib/python3.7/socket.py", line 748, in getaddrinfo > > for res in _socket.getaddrinfo(host, port, family, type, proto, flags): > > socket.gaierror: [Errno -2] Name or service not known > > > This triggers a bunch more tracebacks. > > Then I get this: > > Jan 04 11:57:27 2022 (797) Connection to HyperKitty failed: > HTTPSConnectionPool(host='www.XXXXX.dev <http://www.xxxxx.dev/>', > port=443): Max retries exceeded with url: /archives/api/mailman/archive > (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object > at 0x7f2114e14e10>: Failed to establish a new connection: [Errno -2] Name > or service not known')) What is your setting for base_url: in mailman-hyperkitty.cfg?. Can you get wget -O- xxx where xxx is base_url with `api/` appended. This should return an html page of API documentation. If your base_url: seems good and its scheme is `https`, try changing it to `http`. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 8 months

[MM3-users] Re: Importing mailman 2 shows member's "Moderation Action" = "Default processing". But new members show = "None". Why

by Mark Sapiro

On 5/26/23 12:25 AM, mrl(a)psfc.mit.edu wrote: > I've asked the wrong question. The correct question is that my MM2 imported mailing list, shows the setting "Default action to take when a member posts to the list" is set to "Hold for moderation". That is expected because your MM 2.1 list had member_moderation_action = Hold. > However, when I add a user via Mass Subscription, and view the user in the member's list, it states "None" in the moderation column for him. Doesn't that imply, not to hold for moderation? Or am I wrong? No. That means apply the list's default. > Note that when I look at the user's "Administration options Moderation" personal setting, it is set to "List Default." I assume that because the List's setting in the above first paragraph is "Hold for moderation", that this means the "List Default" is set for moderating. And that newly added email addresses should be moderated. Or am I wrong? Newly added users get their moderation action set to None. This means the same thing as the List Default you see as an admin looking at the user. If you set the user to something other than List Default and then set it back to List Default, the actual value set for the member's moderation_action is None. I.e., List Default is a more admin friendly way of displaying/setting None for the value. Presumably, your MM 2.1 list had default_member_moderation = Yes and member_moderation_action = Hold and this mimics that behavior. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 3 months

[MM3-users] Re: Flushing/syncing hyperkitty with mailman

by Mark Sapiro

On 06/16/2018 06:38 PM, Eric Abrahamsen wrote: > > > A bump for this, I've been getting this series of errors once a minute > for weeks now. There must be some way to clear out dangling thread > references? And I take it that for the meantime we shouldn't be using > the "delete thread" feature of hyperkitty... > >> [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. >> [Q] INFO Process-1:1 processing [rebuild_email_cache_votes] >> [Q] ERROR Failed [rebuild_email_cache_votes] - Email matching query does not exist. >> [Q] INFO Process-1:2 processing [rebuild_thread_cache_votes] >> [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. >> [Q] INFO Process-1:3 processing [rebuild_email_cache_votes] >> [Q] ERROR Failed [rebuild_email_cache_votes] - Email matching query does not exist. >> [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] >> [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. >> >> Is there something more I should be doing to sync hyperkitty's database >> with mailman? I've got the crontab file in place, and that appears to be >> running without error. Anything else? Except that 'django-admin runjobs minutely' is probably what's producing the errors. You might try 'django-admin runjob empty_threads' (normally a monthly job) or 'django-admin runjob thread_order_depth' (normally a yearly job). I don't know if they will clear this up or not, but I don't think it would hurt to try. See 'django-admin runjob --list' to see the various jobs and note that 'django-admin runjob update_index' which runs minutely and does an incremental update is not the same as 'django-admin update_index' which only runs manually and does a full search index update. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

7 years, 2 months

[MM3-users] Re: Problem with missing MySQLDatabase

by Mark Sapiro

On 10/19/18 3:44 AM, Peter Sørensen wrote: > Hi, > > I have looked into installing this before without success but found > The Debian package Mailman3-full > > I installed this succesfully along with the mailman-suite. > I have configured varios setting but are stuck when trying to generate aliases > For mailman with: > > mailman aliases > Traceback (most recent call last): > File /usr/bin/mailman, line 11, in <module> > load_entry_point('mailman==3.1.1', 'console_scripts', 'mailman')() > File /usr/lib/python3/dist-packages/mailman/bin/mailman.py, line 94, in main > initialize(config_path) > File /usr/lib/python3/dist-packages/mailman/core/initialize.py, line 189, in initialize > initialize_2(propagate_logs=propagate_logs) > File /usr/lib/python3/dist-packages/mailman/core/initialize.py, line 160, in initialize_2 > config.db = getUtility(IDatabaseFactory, utility_name).create() > File /usr/lib/python3/dist-packages/mailman/database/factory.py, line 52, in create > database = call_name(database_class) > File /usr/lib/python3/dist-packages/mailman/utilities/modules.py, line 67, in call_name > named_callable = find_name(dotted_name) > File /usr/lib/python3/dist-packages/mailman/utilities/modules.py, line 50, in find_name > __import__(package_path) > ModuleNotFoundError: No module named 'mailman.database.mysql.MySQLDatabase\t\t\t#MOD(inserted ) 02'; 'mailman.database.mysql' is not a package > > I can see from the message that I’m missing a module but I can’t figure out. how to get > This installed. The mudule is referenced in the mailman.cfg as > class: mailman.database.mysql.MySQLDatabase The module mailman.database.mysql is part of mailman core. In your case, it should be /usr/lib/python3/dist-packages/mailman/database/mysql.py. If that file exists, I don't know what the problem might be. If not, there is something wrong with your installation. In any case, this is a Debian issue. You need to take it up with Debian. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years, 10 months

Search results for query "sapiro"