Search results for "sapiro" - lists.mailman3.org

[MM3-users] Re: Errors while importing mm2 list archives

by Odhiambo Washington

On Sat, Dec 10, 2022 at 9:45 PM Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/10/22 01:13, Odhiambo Washington wrote: > > On Thu, Dec 8, 2022 at 10:41 PM Mark Sapiro <mark(a)msapiro.net> wrote: > >> > >> In the DATABASES['default'] definition, you need to set `'OPTIONS': > >> {'charset': 'utf8mb4'}` > >> > > > > I added that: > > > > [database] > > class: mailman.database.mysql.MySQLDatabase > > url: mysql+pymysql://mailman_user:XXXXXXXXX@localhost > > /mailmansuite?charset=utf8mb4&use_unicode=1 > > > The above is for Mailman core. It doesn't affect HyperKitty. For that > you need to look at the DATABASES definition in > /etc/mailman3/settings.py > < > https://docs.mailman3.org/projects/mailman-web/en/latest/settings.html#mail…> > > and ensure that in addition to the other settings under `default {` you > have > ``` > 'OPTIONS': {'charset': 'utf8mb4'}, > ``` > > ... > >> You might also need to modify the tables, particularly hyperkitty_email > >> with something like > >> ``` > >> ALTER TABLE hyperkitty_email > >> DEFAULT CHARACTER SET utf8mb4, > >> MODIFY subject varchar(512) > >> CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci, > >> MODIFY content > >> CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci; > >> > > > > > > So I removed my list, dropped the database, and proceeded as follows: > > > > create database mailmansuite CHARACTER SET utf8mb4 COLLATE > > utf8mb4_0900_ai_ci; > > ALTER TABLE hyperkitty_email DEFAULT CHARACTER SET utf8mb4; > > ALTER TABLE hyperkitty_email MODIFY subject varchar(512) CHARACTER SET > > utf8mb4 COLLATE utf8mb4_unicode_ci; > > ALTER TABLE hyperkitty_email MODIFY content longtext CHARACTER SET > utf8mb4 > > COLLATE utf8mb4_unicode_ci; > > ALTER TABLE hyperkitty_email MODIFY sender_name varchar(255) CHARACTER > SET > > utf8mb4 COLLATE utf8mb4_unicode_ci; > > ALTER TABLE hyperkitty_email MODIFY in_reply_to varchar(255) CHARACTER > SET > > utf8mb4 COLLATE utf8mb4_unicode_ci; > > > > I did all those (although looks overzealous) just to be on the safe > side. I > > have seen people putting emojis in their names. > > > None of that should be necessary. `mailman-web migrate` should create > the database and tables as needed. > > > > After that, I did the mailman-web migrate, created the list, imported the > > config from MM2 and then proceeded to import the archives. > > However, the errors still are there, and several messages were not > imported > > Do you have the OPTIONS setting in your DATABASES definition in > settings.py? > Here is what I have tested lately in settings.py: # MySQL Database setup DATABASES = { 'default': { 'ENGINE': 'django.db.backends.mysql', 'NAME': 'mailmansuite', 'USER': 'mm3', 'PASSWORD': 'XXXXXXXXX', 'HOST': 'localhost', 'PORT': '', 'OPTIONS': { 'init_command': "SET sql_mode='STRICT_TRANS_TABLES'", 'charset': 'utf8mb4', }, } } I have dropped the DB, recreated, run the 'migrate', created the list, imported config from MM2. However, nothing seems to be able to address the errors with importing the archives. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' ¯\_(ツ)_/¯ :-)

3 years, 8 months

[MM3-users] Re: Issues with cross posted emails after upgrading to mailman 3.3.6

by Stephen J. Turnbull

Mark Sapiro writes: > Thanks for filing the issue. I'll work on a solution. My current > thinking is to add a `count` column to the message table, set the count > to 1 when initially adding a message-id, increment the count when adding > an existing message-id, decrement the count when deleting a message-id > and only delete the entry and message when the count reaches 0. Are we guaranteed to get a separate LMTP delivery for each list? That is, if the MTA receives 2 RCPT TOs to lists for one transaction, won't it do the same in LMTP when it sends forwards the message to Mailman? Steve

4 years, 9 months

[MM3-users] Re: Disabling mail/news gateway was: Moderation action "None" is misleading

by Ron / BCLUG

Mark Sapiro wrote on 2025-02-05 12:48: > As of Mailman 3.3.10 (not yet released) the nntp runner is not started > by default. This is a welcome change, thank you. > For older releases you can add > ``` > [runner.nntp] > start: no > ``` > to mailman.cfg I've been digging into MM3 resource usage vs MM2 and have been wondering: are there any other runners that can be disabled, or invoked via cron job to run every $interval then exit again? Second question, similar topic but MM2: how to disable NNTP? (if that's what this is doing): /usr/bin/python2 /var/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s Thanks again.

1 year, 6 months

[MM3-users] Re: Migrating Mailman 3 lists

by Andrew Hodgson

Mark Sapiro wrote: >On 5/19/20 7:25 PM, Mark Dadgar wrote: >> >> I get a bunch of these errors because identifiers in postgres are limited to 63 characters and mm3 creates some in sqlite that are longer than that: >> >> 2020-05-20T02:16:20.574000Z WARNING PostgreSQL warning: identifier "idx_44731_auth_user_user_permissions_user_id_permission_id_14a6b632_uniq" will be truncated to "idx_44731_auth_user_user_permissions_user_id_permission_id_14a6" [...] >> For reference my pgloader script looks like: >> >> load database >> from sqlite:///var/lib/dbconfig-common/sqlite3/mailman3-web/mailman3web.db >> into postgresql://mailman3:XXREDACTEDXX@localhost/mailman >> >> with include drop, create tables, create indexes, reset sequences, no >> truncate Have you tried this without indexes and then run the migrate script? It may re-create them as part of the schema upgrade check. Andrew.

6 years, 2 months

[MM3-users] Mass subscription: HTTP Error 400: 'pathlib._local.PosixPath' object does not support the context manager protocol

by Stephen J. Turnbull

Flo via Mailman-users writes: > Hi, > > Debian trixie, virtualenv installation: When I entered addresses at the > mass subscription field I got: > > HTTP Error 400: 'pathlib._local.PosixPath' object does not support the > context manager protocol Compare this post, pretty sure it's the same issue: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… and see the reply from Mark Sapiro for a patch. I believe this will be fixed in the next release. Steve -- GNU Mailman consultant (installation, migration, customization) Sirius Open Source https://www.siriusopensource.com/ Software systems consulting in Europe, North America, and Japan

1 month, 3 weeks

[MM3-users] Re: list footer questions

by Mohsen Masoudfar

Hi, Thanks again for your help. When I check the postorius version, it says 1.1.2-3: [509]# apt list | grep postorius python-django-postorius/bionic,now 1.1.2-3 all [installed,automatic] It is on Ubuntu18.04 and has been installed with Ubuntu package Mailman-full. There is no update available yet. So it looks like I cannot use the easy way of modifying the templates. Question: Is there a way to achieve the same by updating the code? Thanks Mohsen -----Original Message----- From: Mark Sapiro <mark(a)msapiro.net> Sent: Friday, May 8, 2020 4:44 PM To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: list footer questions [EXTERNAL EMAIL] On 5/8/20 12:52 PM, Mohsen Masoudfar wrote: > Hi, > > This seems to me like basic simple questions, I have tried FAQ and other resources, with not much success. > > I have two questions: > > 1. When I send an email to a list, in gmail and yahoo I see the following text with the links at the end of the email body: > _______________________________________________ > Testlist_dmark1 mailing list - > listname(a)domain.tlb<mailto:testlist_dmark1@newlistserv.aaas.org> > To unsubscribe send an email to listname-leave(a)domain.tlb > > In<mailto:listname-leave@domain.tlb%0b%0bIn> outlook this is added as an attachment in the form of a TEXT file, when you open it, you see the same text. > Question: Is there a way to change this, that it looks in outlook the same way as it appears in gmail/yahoo? There are a few things going on here. First, the actual footer is _______________________________________________ Testlist_dmark1 mailing list - listname(a)domain.tlb To unsubscribe send an email to listname-leave(a)domain.tlb The <mailto:...> links are added by the Mail client displaying the mail. > In outlook this is added as an attachment in the form of a TEXT file, when you open it, you see the same text. > Question: Is there a way to change this, that it looks in outlook the same way as it appears in gmail/yahoo? > > I know MS does it own stuff sometime and we have no impact on that, but I was thinking maybe we might change the footer in a way that outlooks sees that as part of email body. Yes, this is an outlook thing, but you do have some control. See the FAQ article at <https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.list…> for a more detailed explanation, but the issue is that after any content filtering has been applied, the message is still multipart so Mailman adds the footer as a separate MIME text/plain part at the end of the message. You can avoid this by doing heavy content filtering on the messages. Namely, accept only multipart, text/plain and text/html, collapse alternatives and convert html to plain text. Note that some of this involves updating the list's pass_types which is not exposed in Postorius before 1.3.3 which is not yet released. > 2. How may I change the format and the text in footer? > I was expecting it under list > setting, in postorius, but I could not find it. It's the top level Templates tab in Postorius (just left of Settings). It was added in Postorius 1.2.1. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.mai…

6 years, 3 months

[MM3-users] Re: Mailman3 reinstall fail, need some help

by Odhiambo Washington

On Sun, Apr 3, 2022 at 12:06 PM Yvan ♞ <elemac(a)free.fr> wrote: > Hello every body > I have progress to try to reinstall mailman3 on yunohost server but I > still have an error, if somebody can help me as I don't understand the log > https://paste.yunohost.org/raw/ugijepuyuv > Sincerely. > Yvan > Hi Yvan, As previously advised by Mark Sapiro, you are better off taking to the YunoHost support people for help. They will most likely help you with the failing dependencies issue. But I also wonder - why don't you follow the virtualenv method to install? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", egrep -v '^$|^.*#' :-)

4 years, 4 months

[MM3-users] Re: Subscribing users stuck in pending hell

by Quanah Gibson-Mount

--On Wednesday, May 24, 2023 10:13 AM -0700 Mark Sapiro <mark(a)msapiro.net> wrote: > This was added in Postorius 1.3.0 which was released almost 4 years ago. > If you can't upgrade, see > https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/messa > ge/6GKWYT3ZMXPHMGSXUW6OI6J2222AR7OV/ for a mailman shell script. That shell script seems to have errors: >>> pendings = getUtility(IPendings) >>> for token, data in pendings.find( ... token_owner=TokenOwner.subscriber, ... pend_type='subscription'): ... print("hello") ... Traceback (most recent call last): File "<console>", line 3, in <module> File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) TypeError: find() got an unexpected keyword argument 'token_owner' --Quanah

3 years, 2 months

[MM3-users] Re: Hyperkitty is not archiving due to 405 error - GET instead of POST

by Matthias

Hi Mark, Mark Sapiro wrote: ... > You could always try adding additional logging to > mailman_hyperkitty/__init__.py to log the entire result, but I suspect > the issue is that there is a redirect somewhere in the path from the > configured HyperKitty base_url (see mailman_hyperkitty.cfg) and the > actual HyperKitty API that is redirecting the POST to a GET and also > dropping the POST data. Thanks a lot...I assumed already the same, but your sentence was giving me again some hint...and I found the base_url...there it wasn't httpS but http, which then was redirected and lost the POST... Now it is working as intended! Great, Thanks, Matthias

2 years, 6 months

[MM3-users] Re: How to prevent members to attach executables (exe, bat, ...) to the emails sent to list

by Mohsen Masoudfar

Hi Mark, Thanks again for the helpful hint. It seems that I still miss something. I am running Mailman3.1.1. I ran the following on my test server. I am trying, for test purpose only, to filter PDF attachments. First I just used the pass_type, assuming once this is set, everything else is filtered. # mailman withlist testlist3(a)x.com >>> m.pass_types = ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] >>> commit() >>> print(list(m.pass_types)) ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] This let PDF be send by Mailman3. Well, I need to add filter_types too, so I did this: >>> m.filter_types = ['application/pdf'] >>> commit() >>> print(list(m.filter_types)) ['application/pdf'] Mailman3 still distributes PDF files as attachment. What am I doing wrong? This is the final settings: >>> print(list(m.pass_types)) ['multipart', 'message/rfc822', 'text', 'application/pgp-signature'] >>> print(list(m.filter_types)) ['application/pdf'] Thanks Mohsen Thanks Mohsen -----Original Message----- From: Mark Sapiro <mark(a)msapiro.net> Sent: Wednesday, September 30, 2020 1:07 PM To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: How to prevent members to attach executables (exe, bat, ...) to the emails sent to list [EXTERNAL EMAIL] On 9/30/20 9:25 AM, Mohsen Masoudfar wrote: > Hi, > > I am trying to find a way for content filtering to remove executables from the emails sent to the list. I found some hints under: > https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmail > man.readthedocs.io%2Fen%2Fstable%2Fbuild%2Flib%2Fmailman%2Fhandlers%2F > docs%2Ffiltering.html%3Fhighlight%3Dcontent%2520filter&data=01%7C0 > 1%7Cmmasoudf%40aaas.org%7Ceb728218f9884b4bfc1a08d865635075%7C2eebd8ff9 > ed140f0a15638e5dfb3bc56%7C0&sdata=mGUdz5NfrJgEyPmd5Isa0l01WWPQMpTA > 9thyWLZ0qbU%3D&reserved=0 > > but still not clear how to do it for all type of excecutables. There are four list settings that affect this. They are pass_types, pass_extensions, filter_types and filter_extensions. the pass_* settings specify message parts the list will accept while the filter_* settings specify message parts the list won't accept. The page at <https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmailman.r…> only discusses filter_types and needs updating for the others. Filtering by extension only works on message parts that have an associated file name. Thus, while you can add things like 'exe', 'bat', 'cmd', 'com', 'pif', 'scr', 'vbs' and 'cpl' to filter_extensions, it won't be completely effective. A better approach is to use MIME types[1] and only allow those you want. For a discussion list, a reasonable set is what this list uses: multipart message/rfc822 text application/pgp-signature This will accept any multipart and message/rfc822 parts for further analysis and ultimately accept only text/* and application/pgp-signature elemental parts. If you want to accept images and pdfs, you can add image application/pdf See <https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.iana.…> for a list of all registered MIME types. Note that these are all of the form main_type/sub_type and putting just main_type in *_types passes or filters all subtypes for that maintype. [1] You can use both, e.g. filter_extensions to remove those you don't want and pass_types to accept the MIME types you do want. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.mai…

5 years, 10 months

Search results for query "sapiro"