- Mailman-users - lists.mailman3.org

Help with mailman2 to mailman3 archive migration
by francisco.lopezayuso＠sib.swiss 02 Apr '24

02 Apr '24

Hello all, I'm having some issues with a migration I'm performing right now from our old mailman2 server to a mailman3 one. The mailing lists imports work fine, but the archives seems to work sometimes: This means that some lists archives appear but others are missing when browsing the archives in the web UI. This happens despite the command line telling me that the import went fine. Here are the steps I run for the archives: # Copy the archives into the my new server # Cleaning old archives, where $LIST is my mailing list name $ /opt/mailman3/venv/lib/python3.11/site-packages/hyperkitty/contrib/check_hk_import /opt/mailman3/archives/private/"$LIST".mbox/"$LIST".mbox $ /opt/mailman3/venv/lib/python3.11/site-packages/hyperkitty/contrib/cleanarch3 /opt/mailman3/archives/private/"$LIST".mbox/"$LIST ".mbox # Importing the archives $ mailman-web hyperkitty_import -l "$LIST(a)my.domain.com" /opt/mailman3/archives/private/"$LIST".mbox/"$LIST".mbox # Indexing the new archive $ mailman-web update_index_one_list "$LIST(a)my.domain.com" Here is also an example log of an archive I'm migrating that does not appear in the UI, for reference (list and domain were renamed for privacy): $ mailman-web hyperkitty_import -l my_list(a)domain.com --since=1900-01-01 /opt/mailman3/archives/private/my_list.mbox/my_list.mbox Importing from mbox file /opt/mailman3/archives/private/my_list.mbox/my_list.mbox to my_list(a)domain.com Computing thread structure Synchronizing properties with Mailman Adding admin as owner of MailingList: my_list.lists.domain.com 2070 emails left to refresh, checked 1000 2070 emails left to refresh, checked 2000 Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the Django admin command with arguments 'update_index_one_list my_list(a)domain.com'. $ mailman-web update_index_one_list my_list(a)domain.com Indexing 22 emails Any help would be greatly appreciated, I'm very lost here... Cheers,

2 1

Mailman stops processing....... where to start looking for root cause?
by bob B 02 Apr '24

02 Apr '24

Today was the 2nd time mailman stopped sending out mail, it receives mail but sends nothing out. To resolve the issue I restarted the mailman services and then all the incoming/queued mail was sent out... last time this happened was 21 days ago.... Before that, it has been rock solid for years. We are running in a docker environment with no recent changes. On the host in /var/log/maillog, I see the mail coming in and going to mailman in docker. for docker, the mailman logs are in /opt/mailman/core/var/logs in /opt/mailman/core/var/logs/smtp.log ---------- I see the messages coming in /opt/mailman/core/var/logs/debug.log ------------ is empty /opt/mailman/core/var/logs/mailman.log -------------- I do not see anything that looks like it had an issue So where can I look to try to determine a cause? If it happens again, what and where can I cook to troubleshoot before restarting the service? Thanks

4 4

Seeking help completing a useful installation
by Hugh Esco 30 Mar '24

30 Mar '24

I have more fully documented where I am at with this attempt to build a working installation of mm3 at this link: https://gitlab.com/mailman/django-mailman3/-/issues/73 My questions include: - the template for /etc/mailman3/mailman.cfg, defines vardir, but no DATA_DIR. See test failure #1 (closed) <http:///mailman/django-mailman3/-/issues/1>, above. Where does that want to be? Any issue with putting the mm3.db next to the mm3_web.db at /opt/mailman/mm/var/data? - there are two possible virtualenv's in my build: (a) /opt/mailman/venv/ and (b) /opt/mailman/.pyenv/. I say more about these below. Which do I want to use in this instance? I'm guessing the latter where the mailman3 libraries are published, but have doubts. The link above urges a dependency on python ^3.11, but bookworm provides only python 3.8, so I used pyenv to satisfy the requirement. It wanted to deploy to its own path, though perhaps there is some switch which would consolidate everything under /opt/mailman/venv/. I do not work with python enough to know. - attempts to run bin/mailman-web startapp mm3web fail to add any new processes to the process list. bin/mailman-web start fails with errors. What change of state to the server should I expect from running this command? How do I test for success? If startapp is the correct invocation, what argument does it want on a working installation? - having run the command in the previous point, I see nothing in the browser except for the apache starter page at the root path '/'. None of the paths defined in the apache2 configuration seem to offer any joy. I assume that uwsgi wants to proxy the requests to a running mailman-web service somehow, but that no such service is found. I see one hopeful line in the log at: /opt/mailman/mm/var/logs/mailman.log "GET /3.1/lists?count=10&page=1 HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.5" - I assume that once I get apache2 wired to a running application through the uwsgi proxy, that I can proceed to create an admin user, use it to explore the web gui, and begin to consider how to migrate my legacy mm2.1 lists into the new installation. Any further help crossing the finish line would be appreciated. Thanks, -- Hugh

2 2

Disabling the footer on a mailing list: Is this how?
by David Partain 28 Mar '24

28 Mar '24

Hi, I regularly get requests from users to disable footers since they use email clients that simply show an attached text file. Yes, I know that's broken. I never got this working with my old broken installation. Since we're now running a shiny new version of mailman3, I thought I'd give it a go again. From what I've read, I thought the following would do the trick: # sudo -u mailman -s /usr/bin/bash $ source /local/mailman/venv/bin/activate $ cd ~/var/templates/ $ mkdir -p lists/test-list.our.domain/en/ $ cp /dev/null "lists/test-list.our.wee.domain/en/list:member:regular:footer" However, sending mail to test-list(a)our.wee.domain<mailto:test-list@our.wee.domain> still includes the footer. What am I missing? Do I need to restart something? Did I misunderstand what I've read? With kind regards, David

2 2

See list of subscribers
by Tom Yates 27 Mar '24

27 Mar '24

I'm sure I'm just doing something stupid, but I can't work out what. I have a list, as admin under "Settings" -> "List Identity" -> "Members List Visibility" I have it set to "Only Mailinglist Members". But a random subscriber, who's signed up and authenticated, when she visits the list page she sees her subscription, but no option to list the other subscribers. Is she looking in the wrong place? Do I need to open up more settings? Am I just being an idiot? Thanks for any light anyone can shed. -- Tom Yates - https://www.teaparty.net

2 2

Hyperkitty on Debian 12
by Markus Grandpre 27 Mar '24

27 Mar '24

Dear list members, when following the instructions to migrate list archives from Mailman21 to Mailman3 (see [1]), I face the following problem: # python3 manage.py hyperkitty_import -l mailman21-migration-test-04 /var/mailman21/testlist.mbox python3: can't open file '/var/mailman21/manage.py': [Errno 2] No such file or directory and have no clue, where to find the right <manage.py> file. The command dpkg returns: # dpkg -l | grep hyperkitty ii python3-django-hyperkitty 1.3.7-1 all Web user interface to access GNU Mailman3 archives In </etc/mailman3/mailman-web.py> I find: INSTALLED_APPS = ( 'hyperkitty', 'postorius', 'django_mailman3', ... Can you please help me? Thank you in advance? Best, Markus [1] <https://docs.mailman3.org/en/latest/migration.html> -- Markus Grandpré Universität Konstanz Kommunikations-, Informations-, Medienzentrum (KIM) Abteilung IT-Dienste Forschung, Lehre und Infrastruktur, Tel: ++49 7531 88 4342

5 7

Topics - Tags
by Mark 27 Mar '24

27 Mar '24

Hi, I'm reading the docs on "Message tagging" (https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/handlers/d…) as saying shell access is needed to: (a) enable topics, and (b) write the keywords. In Mailman 2 there is an Admin web UI for "Topics". Is there such a web UI that can be enabled in Mailman 3 so that the list owners can create topics (tags) in their lists? Thanks.

3 5

Deleting messages from HyperKitty archive
by Mark 25 Mar '24

25 Mar '24

Hi, I'm running Mailman 3.3.9 with HyperKitty version 1.3.8 (venv installed as per the docs). As superuser (listmaster) I can "Delete message/thread" and "Delete archive". These options aren't there for the list owners. The docs (link below) say that in the newer HyperKitty version 1.3.9, list owners can delete messages/threads Is there a patch I can implement on HyperKitty version 1.3.8 (so list owners can delete messages), or is it possible to update HyperKitty to version 1.3.9 without bringing everything crashing down? *** https://docs.mailman3.org/projects/hyperkitty/en/latest/news.html 1.3.9 (2024-02-27) List owners can now delete messages and threads and reattach threads. (Fixes #261) *** Thanks, Mark

2 4

Issue converting table charset to utf8mb4 on mysql
by Helio Loureiro 24 Mar '24

24 Mar '24

3 3

How to fix lists with characters errors?
by Helio Loureiro 24 Mar '24

24 Mar '24

Hi, I just found several lists have the issue like this regarding charset: (venv) mailman@new-mailman3 ~ (v3.1.1)> mailman members listas-charset-issue(a)mailman.domain.com anders(a)domain.com beth(a)domain.com charlie(a)domain.com david(a)domain.com ellen(a)domain.com Traceback (most recent call last): File "/local/mailman/venv/bin/mailman", line 33, in <module> sys.exit(load_entry_point('mailman==3.3.9', 'console_scripts', 'mailman')()) File "/local/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1157, in __call__ return self.main(*args, **kwargs) File "/local/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1078, in main rv = self.invoke(ctx) File "/local/mailman/venv/lib/python3.10/site-packages/mailman/bin/mailman.py", line 69, in invoke return super().invoke(ctx) File "/local/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1688, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/local/mailman/venv/lib/python3.10/site-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, **ctx.params) File "/local/mailman/venv/lib/python3.10/site-packages/click/core.py", line 783, in invoke return __callback(*args, **kwargs) File "/local/mailman/venv/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func return f(get_current_context(), *args, **kwargs) File "/local/mailman/venv/lib/python3.10/site-packages/mailman/commands/cli_members.py", line 222, in members display_members(ctx, mlist, role, regular, File "/local/mailman/venv/lib/python3.10/site-packages/mailman/commands/cli_members.py", line 109, in display_members print(f'{address.display_name} <{address.original_email}>', UnicodeEncodeError: 'latin-1' codec can't encode character '\u0142' in position 9: ordinal not in range(256) Since this service is running since time of python2, I guess the old lists handled accented characters was to save as latin-1. But how can I fix this now? Note: apparently the list remains working just fine. It is just the command line failing. And perhaps some other side effect. Best Regards, Helio Loureiro https://helio.loureiro.eng.br https://github.com/helioloureiro https://mastodon.social/@helioloureiro

2 4