Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: mailman-web migrate error

by Mark Sapiro

On 11/12/25 11:48, pashdown(a)xmission.com wrote: > I'm migrating from Ubuntu 20.04, mailman 3.2.2, postgresql 12 to Debian 13, mailman 3.3.10, postgresql 17. > > After migrating the postgresql databases and assuring the perms and passwords work, this is what I get with a "mailman-web migrate": > > (user(a)domain.com) redacted from the original > > # mailman-web migrate > Operations to perform: > Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, \ > sessions, sites, socialaccount > Running migrations: > Applying account.0003_alter_emailaddress_create_unique_verified_email... OK > Applying account.0004_alter_emailaddress_drop_unique_email... OK > Applying account.0005_emailaddress_idx_upper_email... OK > Applying account.0006_emailaddress_lower...Traceback (most recent call last): > File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 89, in _execute > return self.cursor.execute(sql, params) > ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ > psycopg2.errors.UniqueViolation: duplicate key value violates unique constraint "account_emailaddress_user_id_\ > email_987c8728_uniq" > DETAIL: Key (user_id, email)=(24, user(a)domain.com) already exists. This is actually a django-allauth issue. This issue is due to changes in Django allauth to prevent creating multiple addresses differing only in case. The problem is if you have such multiple addresses in your account_emailaddress table, this migration fails. There is a script at https://www.msapiro.net/scripts/UC_fix that will fix this. You may need to adjust the shebang and replace psycopg2 with sqlite3. See https://github.com/pennersr/django-allauth/issues/3019 perhaps starting at This issue is due to changes in Django allauth to prevent creating multiple addresses differing only in case. The problem is if you have such multiple addresses in your account_emailaddress table, this migration fails. There is a script at https://www.msapiro.net/scripts/UC_fix that will fix this. You may need to adjust the shebang. See https://github.com/pennersr/django-allauth/issues/3019 perhaps starting at https://github.com/pennersr/django-allauth/issues/3019#issuecomment-1748028… -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 months, 1 week

[MM3-users] Re: Creating superuser - problem with documentation or it's just me?

by Mark Sapiro

On 7/26/20 9:39 AM, Odhiambo Washington wrote: > Hi, > > In my quest to create a superuser, I followed another HOWTO - > https://docs.mailman3.org/en/latest/devsetup.html > > (venv) [root@gw /opt/mailman/git/mailman-suite/mailman-suite_project]# > python manage.py migrate > Traceback (most recent call last): manage.py migrate (or django-admin migrate) is part if the mailman-post-update script. It doesn't work here because when you run it this way, it doesn't get your settings.py. > ModuleNotFoundError: No module named '_sqlite3' And it's looking for sqlite3 because that's the default database. > *<==============================================================* > (venv) [root@gw /opt/mailman/git/mailman-suite/mailman-suite_project]# pip > install pysqlite3 You don't need this. You need to run django-admin with the correct settings. > So I figured out that I need to put my own settings_local.py into the > directory and let the command rely on MySQL as the database backend since > by default, it uses sqlite3 backend. > > But the question then is WHY is this not documented on the above page??? Because that's not relevant to what you are doing. You are trying to install Mailman for production, not development. > How can I delete the superuser after creating it?? The only django-admin or manage.py you should run is /opt/mailman/mm/bin/djhango-admin. You can run `django-admin createsuperuser` to create a superuser. If you want to delete one, you need to go to the Django admin web UI - should be http://your.server/admin - login as a superuser and go to the Users page and delete it. You should probably do this as a different superuser -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

6 years

[MM3-users] Re: Badsignature on uwsgi-error.log

by Mark Sapiro

On 3/22/24 09:48, David Partain via Mailman-users wrote: > > Right now, archiving is not working on the new installation, both building the archive on the new installation after the move and for new messages. > > uwsgi-error.log is getting blasted with constant errors along the lines of what follows. I suspect that these errors are why archiving isn't working, but I obviously don't know that: > > Message: BadSignature('Signature "ZWBXqQmWZwHTfa390lLIacpp8NQ" does not match') I'm not sure if this is the issue with archiving or not. > What we have in our config files on the old installation and new installation are (the quotes are exactly as they are in the files): ... > settings.py > > SECRET_KEY = 'somerandomstringiaintputtinginmail' > MAILMAN_ARCHIVER_KEY = 'somerandomstringiaintputtinginmail' > > mailman-hyperkitty.cfg > > api_key: somerandomstringiaintputtinginmail > > All of that says that the value is the same for all three (whether I should have done so or not...) and those settings were carried along to the new installation as well. See my reply at https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… As I say there, SECRET_KEY is not related in any way to MAILMAN_ARCHIVER_KEY and api_key. The latter two have to do with archiving and must match. The former is a Django thing and is completely separate. At this point, put ``` SECRET_KEY_FALLBACKS = [ 'F6V0Dr_SvBsx5-cY8vcvLXrX8tA', 'ZWBXqQmWZwHTfa390lLIacpp8NQ', ] ``` in your local Django settings file. If you continue to get BadSignature: Signature "..." does not match' errors, add those unmatched signatures to SECRET_KEY_FALLBACKS. Once you are no longer seeing BadSignature errors, if archiving is still not working, report any errors you are seeing from Mailman's mailman.log and Django's log. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 4 months

[MM3-users] Re: Does hyperkitty show JPEGs in line and what about attachments?

by Mark Sapiro

On 07/12/2017 04:47 AM, Jason Glazer wrote: > > Does anyone know if Hyperkitty can be configured to allow for inline > images to be maintained so that an HTML file looks like a normal HTML > message? > > Also, can attachments to a message under Hyperkitty preserve their name > rather than being "scrubbed" into "attachment-*.*" files? The answer to some of this is at <https://lists.mailman3.org/archives/list/test@mailman3.org/message/N3XVN3DC…>. One question unanswered by that post is what happens with an inline image in an HTML message body. In the original message, the image is referenced by an IMG tag with "src=" pointing to the image MIME part. Since this structure is not maintained in HyperKitty, inline images probably don't work. Also, with respect to Mailman 2.1, if you want the scrubber to preserve file names and extensions, set the following in mm_cfg.py SCRUBBER_DONT_USE_ATTACHMENT_FILENAME = False SCRUBBER_USE_ATTACHMENT_FILENAME_EXTENSION = True and if you want scrubbed HTML to not be HTML escaped so it renders rather than looking like raw html, set ARCHIVE_HTML_SANITIZER = 3 but note this comment from Defaults.py > # 3 - Remove text/html as attachments but don't HTML-escape them. Note: this > # is very dangerous because it essentially means anybody can send an HTML > # email to your site containing evil JavaScript or web bugs, or other > # nasty things, and folks viewing your archives will be susceptible. You > # should only consider this option if you do heavy moderation of your list > # postings. This is an issue with HyperKitty as it appears this is what HyperKitty does and there's no way to turn it off. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

9 years, 1 month

[MM3-users] Re: Link to account

by Mark Sapiro

On 4/11/23 12:04, Lars Bjørndal wrote: > Thanks a lot. Maybe I've done a mistake, it doesn.t work. > > At the bottom of /etc/mailman3/settings.py I have: > > ROOT_URLCONF = 'urls' > > `cat /etc/mailman3/urls.py` > > [...] > > urlpatterns = [ > path( > '', > RedirectView.as_view(url=reverse_lazy('list_index'), permanent=True), > ), > path('lists/mailman3/', include('postorius.urls')), > path('lists/archives/', include('hyperkitty.urls')), > path('lists/', include('django_mailman3.urls')), > path('lists/accounts/', include('allauth.urls')), > path('lists/admin/', admin.site.urls), > ] > > In Apache config for the domain, I now have: > > <IfModule mod_proxy.c> > ProxyPreserveHost On > ProxyPass "lists/mailman3" "http://127.0.0.1:8000/lists/mailman3" > ProxyPass "lists/archives" "http://127.0.0.1:8000/lists/archives" > ProxyPass "lists/accounts" "http://127.0.0.1:8000/lists/accounts" > ProxyPass "lists/admin" "http://127.0.0.1:8000/lists/admin" > ProxyPass "lists/user-profile" "http://127.0.0.1:8000/lists/user-profile" > </IfModule> > > Restarted mailmanweb, httpd and mailman3. > > If I go to list.punktskriftutvalget.no/mailman3/, I get a 404 Not Found response in browser. > > So what's wrong, do you think? You followed https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… literally. The literal instructions where to access everything via URLs like https://mydomain.org/lists/.... If you were to replace `lists` with `mailman3` everywhere in the abpve, you would then access HyperKitty via a URL like https://list.punktskriftutvalget.no/mailman3/archives/ and Postorius via https://list.punktskriftutvalget.no/mailman3/mailman3/ If that's not what you want, it's more complicated and some things might not be possible. What exactly do you want for access to Postorius, HyperKitty, user accounts, user profiles and the Django admin UI? -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 years, 4 months

[MM3-users] Re: log rotation for bounce.log

by Mark Sapiro

On 1/22/24 14:50, Quanah Gibson-Mount wrote: > I noticed that our smtp.log and bounce.log files haven't been rotated in > years. I see the reason for smtp.log not being rotated is due to > <https://gitlab.com/mailman/mailman/-/issues/931>. Does this same issue > affect bounce.log or is it safe to rotate similar to mailman.log? Rotating all the logs in Mailman's var/logs/ directory is appropriate. This is the logrotate script I use. ``` /opt/mailman/mm/var/logs/*.log { missingok sharedscripts su mailman mailman postrotate if [ -r /opt/mailman/mm/var/master.pid ]; then PID=`cat /opt/mailman/mm/var/master.pid` kill -s HUP $PID fi if [ -r /opt/mailman/mm/var/gunicorn.pid ]; then PID=`cat /opt/mailman/mm/var/gunicorn.pid` kill -s USR1 $PID fi endscript } ``` You will still have the issue #931 in that the smtp.log will rotate, but as it says in that issue, the runners that write smtp.log directly will write to the new generation, but aiosmtpd continues to write to the older log until such time as mailman core is restarted. I'm not sure what will happen if mailman core is not restarted before the log aiosmtpd is writing to is rotated out of existence, but that could be an issue too. You could avoid this by replacing ``` if [ -r /opt/mailman/mm/var/master.pid ]; then PID=`cat /opt/mailman/mm/var/master.pid` kill -s HUP $PID fi ``` in the above postrotate script with ``` if [ -r /opt/mailman/mm/var/master.pid ]; then sudo -u mailman /opt/mailman/mm/bin/mailman restart &>/dev/null || true fi ``` but there is a potential issue in that if Mailman is delivering list mail when the `mailman restart` command is issued, some recipients may receive duplicates. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years, 6 months

[MM3-users] Re: hyperkitty threads by month question

by Mark Sapiro

On 7/26/24 10:41, Bryan Fields wrote: > On 7/26/24 1:30 PM, Bryan Fields wrote: > >> mailman=> \c mailmanweb >> You are now connected to database "mailmanweb" as user "mailman". >> mailmanweb=> SELECT * FROM hyperkitty_thread WHERE EXTRACT(year FROM >> date_active) < 1000; >> id | thread_id | date_active | >> category_id | mailinglist_id | starting_email_id >> -------+----------------------------------+------------------------+-------------+----------------+------------------- >> 35670 | GHLCKUC7TDEBAI27SKRQN5PWX3TGB26Q | 0102-04-15 20:06:12+00 >> | | 3 | 150555 >> (1 row) >> >> mailmanweb=> SELECT id FROM hyperkitty_email WHERE EXTRACT(year FROM >> date) < 1000; >> id >> -------- >> 136872 >> 150555 >> (2 rows) >> >> Does this mean it imported archives with an invalid date somehow? Yes, I suspect this bad date is part of the issue. I would do a few things. First, SELECT message_id FROM hyperkitty_email WHERE thread_id = 35670; If this returns just the one message_id, I would then DELETE FROM hyperkitty_thread WHERE id = 35670; DELETE FROM hyperkitty_email WHERE id = 150555; and see if that fixes the internal server error when accessing the archive. I would also SELECT * FROM hyperkitty_email WHERE id = 136872; and maybe update the `date` in that entry. After deleting that one message and thread, you can make a mbox with just the one message with the date corrected and run hyperkitty_import with `--since 2000-01-01` and that mbox as input to add the message back to the archive. Also, FYI, assuming those messages with very old Date: headers had reasonable unix from dates, the hyperkitty/contrib/cleanarch3 script would fix them, except you have to get the script from https://gitlab.com/mailman/hyperkitty/-/blob/master/hyperkitty/contrib/clea… or https://www.msapiro.net/scripts/cleanarch3 because the script in the latest release has a bug. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 years

[MM3-users] Re: Incorrect error log message in OutgoingRunner._dispose()

by Mark Sapiro

On 4/26/26 10:42 AM, Craig Leres wrote: > On 4/26/26 06:52, Mark Sapiro wrote: >> >> Did you by chance run import21 as root or another non-mailman user >> resulting in template files unreadable by Mailman? > > Yes and no. I ran it as a user in group mailman; the template files are > owned by the user but are group mailman read/write... Then those templates in Mailman's var/templates/LIST-ID/LC/ should be used for the list for that language as long as they are readable and not overridden by a Postorius template or other URI for the list in the template table in the database. Was there anything in mailman.log prior to your defining a Postorius template indicating why they weren't used? >>> Apr 25 12:32:22 2026 (82977) Cannot connect to SMTP server >>> 127.0.0.1 on port 25 >> >> This is a well known issue. See <https://gitlab.com/mailman/mailman/-/ >> work_items/582> and related issues referenced therein. > ... > What really bothers me about the error message is that it's reporting a > SMTP connection failure when what really happened was a HTTP connection > failure. That is all part of the above referenced issues. It is a bug and should be fixed but hasn't been yet. It is caused by the low level socket error upon trying to fetch the template, ultimately being caught by the try/except in outgoing runner's sending of the message. >>> I'm using the default webservice port (8001) so I would not expect >>> anything to ever be listening on 8000. >> >> The default web service port (Postorius and HyperKitty) is 8000. Port >> 8001 is Mailman core's rest api. > > Ah. I never noticed anything telling me the apache config needed to also > listen on 8000. It's also confusing to me to call the rest api port the > "web service port" (Also, I'm not running hyperkitty.) Apache doesn't listen on port 8000. The WSGI server (uWsgi or Gunicorn or ...) listens on port 8000 and Apache listens on ports 80 and 443 as normal and proxies the mailman requests to port 8000. > Ok, I added apache config to handle 127:0.0.1:8000 and that solves the > "SMTP" (HTTP) connection error and cpu bound runner. I don't know what you did, but see <https://docs.mailman3.org/en/latest/install/virtualenv.html#apache-configur…> for how Apache should proxy to port 8000. > I still can't get templates to work but I'll debug further and ask for > help later if I still can't get it to work. Do you have a WSGI server running and listening on port 8000? See <https://docs.mailman3.org/en/latest/install/virtualenv.html#setting-up-a-ws…>. You need this for Postorius as Postorius is a Django project and Django is a WSGI application. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

3 months, 3 weeks

[MM3-users] Re: How to prevent members to attach executables (exe, bat, ...) to the emails sent to list

by Mark Sapiro

On 10/1/20 3:23 PM, Mohsen Masoudfar wrote: > Hi Mark, > Thanks again for the helpful hint. It seems that I still miss something. I am running Mailman3.1.1. I ran the following on my test server. > I am trying, for test purpose only, to filter PDF attachments. > > First I just used the pass_type, assuming once this is set, everything else is filtered. That's how it should work. > # mailman withlist testlist3(a)x.com >>>> m.pass_types = ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] >>>> commit() >>>> print(list(m.pass_types)) > ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] > > This let PDF be send by Mailman3. Well, I need to add filter_types too, so I did this: It shouldn't unless athe Content-Type: of the PDF part was text/* or application/pgp-signature >>>> m.filter_types = ['application/pdf'] >>>> commit() >>>> print(list(m.filter_types)) > ['application/pdf'] This should allow ONLY the PDF and nothing else, not even the text/* message body parts. > Mailman3 still distributes PDF files as attachment. What am I doing wrong? > > This is the final settings: > >>>> print(list(m.pass_types)) > ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] >>>> print(list(m.filter_types)) > ['application/pdf'] This is wrong. set m.filter_types =[] Look at the raw message you receive from the list. What is the VConten-Type of the PDF part? Actually, what's m.filter_content? I suspect it's False which means don't do any content filtering. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

5 years, 10 months

[MM3-users] Re: Request for help debugging a hyperkitty connection issue

by Mark Sapiro

On 1/6/22 12:12 PM, Stephen Daniel wrote: > > I have two problems. One is with getting list mail out of GCP. I am > working on that. The issue I don't know how to address is a problem with > hyperkitty. Nothing is being archived. When I send an email through my > test list, this message shows up in the mailman log: > > Jan 04 11:57:26 2022 (806) Exception in "hyperkitty" archiver > > Traceback (most recent call last): > > File > "/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/connection.py", > line 175, in _new_conn > > (self._dns_host, self.port), self.timeout, **extra_kw > > File > "/opt/mailman/mm/venv/lib/python3.7/site-packages/urllib3/util/connection.py", > line 73, in create_connection > > for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): > > File "/usr/lib/python3.7/socket.py", line 748, in getaddrinfo > > for res in _socket.getaddrinfo(host, port, family, type, proto, flags): > > socket.gaierror: [Errno -2] Name or service not known > > > This triggers a bunch more tracebacks. > > Then I get this: > > Jan 04 11:57:27 2022 (797) Connection to HyperKitty failed: > HTTPSConnectionPool(host='www.XXXXX.dev <http://www.xxxxx.dev/>', > port=443): Max retries exceeded with url: /archives/api/mailman/archive > (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object > at 0x7f2114e14e10>: Failed to establish a new connection: [Errno -2] Name > or service not known')) What is your setting for base_url: in mailman-hyperkitty.cfg?. Can you get wget -O- xxx where xxx is base_url with `api/` appended. This should return an html page of API documentation. If your base_url: seems good and its scheme is `https`, try changing it to `http`. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

4 years, 7 months

Search results for query "sapiro"