- Mailman-users - lists.mailman3.org

exposing Mailman3 API securely
by dancab＠caltech.edu 05 Aug '19

05 Aug '19

I'm working on a container based Mailman3 solution for my university. We have a help desk tool which needs to access the API remotely for creating and deleting Mailman lists. The API will be restricted to a private network, behind a firewall, etc. What is the simplest way to expose the API to an external host? At the moment, I seem to have this partially working via an Apache virtual host configuration which simply proxies via api.example.edu:80 to localhost:8001 on the container. I'm able to remotely use the mailmanclient module for the client.lists, client.system and client.members commands. However running client.domains generates an API connection error. So it seems unstable. Any thoughts or suggestions? Thanks. ---- Dan Caballero Systems Administrator Academic Computing Solutions IMSS - Caltech https://imss.caltech.edu

4 10

Replies unthreading
by Andrew Bernard 01 Aug '19

01 Aug '19

In my new list, I have a user - one of the foundation members, so an important use case - who will not be talked out of using a very old version of Eudora (!) for mail. Replies to threads from that mailer keep sometimes being properly threaded in Hyperkitty and then randomly jumping out into a new thread. This messes up the web view of the threads, and it's not right. Yet the threading appears to be correct in mail programs such as Thunderbird, using the email based interface to the list. Have others seen such behaviour with ancient mailers? Is it the mailer, or is there a known issue with threading the web interface? Looking carefully at message ID's and how they are threaded to examine the behaviour, I can't see what is causing this. Possibly some interaction with other RFC-822 headers? Andrew

3 3

Authenticating against Hyperkitty's DB
by Marvin Gülker 29 Jul '19

29 Jul '19

Hi, inspired by the question about LDAP, I want to ask a related question. We're currently thinking about adding a wiki to our small OSS project, and requiring users to have multiple accounts for the same project is nonsense. We don't have LDAP set up yet, but we do have a running Mailman 3 installation, including Hyperkitty. Thus I thought about whether it's possible to just write some glue script that authenticates against the user information in Hyperkitty's database. Creating an account for Hyperkitty would then be sufficient to get access to the wiki. Could someone give me a hint where and in what format Hyperkitty stores the user information into its database? Marvin -- Blog: https://mg.guelker.eu

2 6

Exim, Mailman3 and missing Message-ID:
by Robert Lister 29 Jul '19

29 Jul '19

Just a note that may help some people. After a bit of a learning curve, managed to get Mailman3 working in Debian 10 using the Debian package. I have mailman3-full + exim4 + apache2 setup: I did quite a lot of testing and getting it working, then when all seemed well, declared success and made it live. As (bad) luck would have it, the very first real message bounced: :-( 2019-07-25 20:53:09 1hqjnY-0005ms-RD <= xxxxxxx(a)ntlworld.com H=cloudi.spamtitan.com [52.26.55.167] P=esmtps X=TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256 CV=no S=7854 DKIM=ntlworld.com 2019-07-25 20:53:09 1hqjnY-0005ms-RD ** mylist(a)lentil.org R=mailman3_router T=mailman3_t H=127.0.0.1 [127.0.0.1]: LMTP error after DATA: 550 No Message-ID header provided 2019-07-25 20:53:09 1hqjnZ-0005mx-3F <= <> R=1hqjnY-0005ms-RD U=Debian-exim P=local S=9222 The user forwarded me the bounce, which contained the original message and headers, and indeed the original message did not contain a Message-ID: header. (Oddly, his message to me reporting the error using the same mail client DID contain a Message-ID: header.) Mail client: X-Mailer: Microsoft Outlook 16.0 So it seems in certain circumstances, Outlook doesn't put a Message-ID: header in its messages. The change from Mailman2.x to Mailman3 means it's now using LMTP to deliver to mailman instead of a local submission seems to have exposed this issue. Exim tries to be helpful for "locally submitted" messages: <https://www.exim.org/exim-html-current/doc/html/spec_html/ch-message_proces…> "12. The Message-ID: header line If a locally-generated or submission-mode incoming message does not contain a Message-ID: or Resent-Message-ID: header line, and the suppress_local_fixups control is not set, Exim adds a suitable header line to the message. If there are any Resent-: headers in the message, it creates Resent-Message-ID:. The id is constructed from Exim's internal message id, preceded by the letter E to ensure it starts with a letter, and followed by @ and the primary host name." However: "Note: Messages received over TCP/IP on the loopback interface (127.0.0.1 or ::1) are not considered to be locally-originated. Exim does not treat the loopback interface specially in any way." Therefore, Mailman3 using LMTP means exim will NOT "fix up" this problem before mailman3 receives the message. My solution for now (apart from telling people not to use old broken Outlook!) is to modify the exim mailman3_transport so that any message with a missing Message-ID: will have one generated by exim before it's passed to LMTP. This reproduces the same behaviour exim uses for locally submitted messages. (headers_remove ensures that we end up only with one Message-ID: header and not two, then we put back either the original Message-ID, or if that's not there, use Exim's ID to generate a new Message-ID header.) Here's an updated version of the example at: https://mailman.readthedocs.io/en/latest/src/mailman/docs/mta.html#exim # /etc/exim4/conf.d/main/25_mm3_macros # The colon-separated list of domains served by Mailman. domainlist mm_domains=list.example.net MM3_LMTP_PORT=8024 # MM3_HOME must be set to mailman's var directory, wherever it is # according to your installation. # debian default is /var/lib/mailman3 MM3_HOME=/opt/mailman/var MM3_UID=list MM3_GID=list ################################################################ # The configuration below is boilerplate: # you should not need to change it. # The path to the list receipt (used as the required file when # matching list addresses) MM3_LISTCHK=MM3_HOME/lists/${local_part}.${domain} # /etc/exim4/conf.d/router/455_mm3_router mailman3_router: driver = accept domains = +mm_domains require_files = MM3_LISTCHK local_part_suffix_optional local_part_suffix = \ -bounces : -bounces+* : \ -confirm : -confirm+* : \ -join : -leave : \ -owner : -request : \ -subscribe : -unsubscribe transport = mailman3_transport # /etc/exim4/conf.d/transport/55_mm3_transport mailman3_transport: driver = smtp protocol = lmtp allow_localhost hosts = localhost port = MM3_LMTP_PORT rcpt_include_affixes = true mailman3_transport: driver = smtp protocol = lmtp allow_localhost hosts = localhost port = MM3_LMTP_PORT rcpt_include_affixes = true headers_remove = message-id headers_add = "Message-ID: ${if def:header_message-id:{$h_message-id:}{<E${message_exim_id}@${qualify_domain}>}}"

4 6

import21 / hyperkitty_import: sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none()
by Christian Schwarz 29 Jul '19

29 Jul '19

Hi all, after upgrading from Mailman 2.1 to Mailman 3 (Debian Buster), one (but not all) of the lists causes the following exception. The list was imported using import21 and archives were imported using manage.py hyperkitty_import. Jul 29 10:19:43 2019 (761) REST request handler error: Traceback (most recent call last): File "/usr/lib/python3.7/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/lib/python3/dist-packages/mailman/rest/wsgiapp.py", line 216, in __call__ return super().__call__(environ, start_response) File "falcon/api.py", line 215, in falcon.api.API.__call__ File "falcon/api.py", line 189, in falcon.api.API.__call__ File "/usr/lib/python3/dist-packages/mailman/rest/lists.py", line 402, in on_get archiver_set = IListArchiverSet(self._mlist) File "/usr/lib/python3/dist-packages/zope/interface/interface.py", line 135, in __call__ adapter = self.__adapt__(obj) File "/usr/lib/python3/dist-packages/zope/interface/interface.py", line 151, in __adapt__ adapter = hook(self, obj) File "/usr/lib/python3/dist-packages/zope/component/_api.py", line 156, in adapter_hook return sitemanager.queryAdapter(object, interface, name, default) File "/usr/lib/python3/dist-packages/zope/interface/registry.py", line 348, in queryAdapter return self.adapters.queryAdapter(object, interface, name, default) File "/usr/lib/python3/dist-packages/zope/interface/adapter.py", line 353, in queryAdapter return self.adapter_hook(provided, object, name, default) File "/usr/lib/python3/dist-packages/zope/interface/adapter.py", line 363, in adapter_hook result = factory(object) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/mailinglist.py", line 607, in __init__ ListArchiver.name == archiver_name).one_or_none() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/query.py", line 3017, in one_or_none "Multiple rows were found for one_or_none()" sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none() I got that from the log file /var/log/mailman3/mailman.log. The Installation also sends emails to me, indicating some kind of exception in the except branch (see below). What can I do to debug this? Thanks, Christian --------------------------------------------- Internal Server Error: /postorius/lists/LISTNAMEREDACTED/ KeyError at /postorius/lists/LISTNAMEREDACTED/ 'file' Traceback: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 187. response = self.process_exception_by_middleware(e, request) File "/usr/lib/python3/dist-packages/django/core/handlers/base.py" in _get_response 185. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in view 68. return self.dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/generic.py" in dispatch 65. return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/django/views/generic/base.py" in dispatch 88. return handler(request, *args, **kwargs) File "/usr/lib/python3/dist-packages/postorius/views/list.py" in get 252. 'hyperkitty' in self.mailing_list.archivers and # noqa: W504 File "/usr/lib/python3.7/_collections_abc.py" in __contains__ 666. self[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in __getitem__ 151. return self._get(key) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in _get 90. return self.rest_data[key] File "/usr/lib/python3/dist-packages/mailmanclient/restbase/base.py" in rest_data 76. response, content = self._connection.call(self._url) File "/usr/lib/python3/dist-packages/mailmanclient/restbase/connection.py" in call 99. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 41. response = get_response(request) File "/usr/lib/python3/dist-packages/postorius/middleware.py" in __call__ 39. return self.get_response(request) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in inner 43. response = response_for_exception(request, exc) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in response_for_exception 93. response = handle_uncaught_exception(request, get_resolver(get_urlconf()), sys.exc_info()) File "/usr/lib/python3/dist-packages/django/core/handlers/exception.py" in handle_uncaught_exception 135. extra={'status_code': 500, 'request': request}, File "/usr/lib/python3.7/logging/__init__.py" in error 1412. self._log(ERROR, msg, args, **kwargs) File "/usr/lib/python3.7/logging/__init__.py" in _log 1519. self.handle(record) File "/usr/lib/python3.7/logging/__init__.py" in handle 1529. self.callHandlers(record) File "/usr/lib/python3.7/logging/__init__.py" in callHandlers 1591. hdlr.handle(record) File "/usr/lib/python3.7/logging/__init__.py" in handle 905. self.emit(record) File "/usr/lib/python3/dist-packages/django/utils/log.py" in emit 118. reporter = ExceptionReporter(request, is_email=True, *exc_info) File "/usr/lib/python3/dist-packages/django/views/debug.py" in __init__ 246. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib/python3.7/tempfile.py" in __getattr__ 614. file = self.__dict__['file'] Exception Type: KeyError at /postorius/lists/LISTNAMEREDACTED/ Exception Value: 'file'

1 1

import21: ModuleNotFoundError: No module named 'Mailman'
by Christian Schwarz 29 Jul '19

29 Jul '19

Hi, I am migrating a Mailman 2.1 setup to Mailman 3 (Debian Buster). Most mailing lists can be imported successfully using the `import21` subcommand, as described in the docs. Some mailing lists fail with the following error: sudo -u list mailman import21 REDACTEDLIST(a)example.org /var/lib/mailman/lists/REDACTEDLIST/config.pck Traceback (most recent call last): File "/usr/bin/mailman", line 11, in <module> load_entry_point('mailman==3.2.1', 'console_scripts', 'mailman')() File "/usr/lib/python3/dist-packages/click/core.py", line 764, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/usr/lib/python3/dist-packages/mailman/bin/mailman.py", line 69, in invoke return super().invoke(ctx) File "/usr/lib/python3/dist-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/lib/python3/dist-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/usr/lib/python3/dist-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/usr/lib/python3/dist-packages/click/decorators.py", line 17, in new_func return f(get_current_context(), *args, **kwargs) File "/usr/lib/python3/dist-packages/mailman/commands/cli_import.py", line 64, in import21 pickle_file, encoding='utf-8', errors='ignore') ModuleNotFoundError: No module named 'Mailman' Note again: most mailing lists of the installation work fine. And this particular pck file is fairly recently modified. Has this happened before? Any suggestions how to debug this? Thanks, Christian

2 3

Mailman 3 Installation Assistance
by brian＠emwd.com 26 Jul '19

26 Jul '19

I am making a serious attempt at installing Mailman 3 using docker. I have a CentOS 7 server setup via Linode. I am using the following documentation to setup a Mailman 3 server: https://xiaoxing.us/2018/01/02/Deploy-Mailman-3-on-AWS-using-Docker/ I have Docker, Postfix, and Nginx installed and working fine. The installation of the Mailman 3 container went fine. However I am getting the following error when I go to test Posterius via shell: curl http://172.19.199.3:8000/postorius/lists/ curl: (7) Failed connect to 172.19.199.3:8000; Connection refused I assume this has something to do with uwsgi which I have no experience with. Appreciate any assistance with getting Mailman 3 up and running. Thanks! Brian Carpenter

4 28

Ldap integration with Mailman 3
by sandeep kumar 18 Jul '19

18 Jul '19

Hi Team Is anyone using Ldap authentication for Mailman 3. It would be helpful if any such inputs -- Regards Sandeep Kumar +91-9642669192

1 0

Default posting pipeline
by Andrew Bernard 16 Jul '19

16 Jul '19

What is a posting pipeline, and what is the difference between detault-posting-pipeline and default-owner-pipeline and virgin? Where to read about this? Andrew

2 1

Delete a single email or thread from hyperkitty archive
by andrew.bernard＠gmail.com 15 Jul '19

15 Jul '19

How can one do this? Raw database access gets you involved in all the usual foreign key constraints. I don't know how to make use of this information: https://gitlab.com/mailman/hyperkitty/commit/6e3e6a5270f37543a757d76c0aee12… After a very large import of decades of data, I need to delete just one wrong mail that is corrupt. I think it is a valid case. I could run the import again after fixing the import mbox, but it takes many hours to load. Andrew

4 7

RHEL 7 + Mailman 3 : Need help and guidance
by vgandhi＠fdu.edu 15 Jul '19

15 Jul '19

Hi, We would like to use the latest Mailman 3 in our environment. We are planning to set up RHEL 7 virtual machine. I am trying to figure out best method (if possible - step-by-step guide) for installing and configuring Mailman3 on RHEL 7 . Can someone please provide me some guidance or point me in direction. Thank you.

4 5

Unable to get mailman3-full on Debian
by Frank Yappa 15 Jul '19

15 Jul '19

When trying apt-get install on Debian, I get E: Unable to locate package mailman3-full. What am I doing wrong? I have run apt-get update.

3 2

unable to un-subscribe
by Steven Jones 13 Jul '19

13 Jul '19

Please fix / unsubscribe me, thanks regards Steven

1 0

How to see post headers
by Andrew Bernard 13 Jul '19

13 Jul '19

Once a post has gone into Hyperkitty, how can I see the full mail headers? Andrew

3 5

Looking for large sites that have migrated to mailman3
by ssw＠washington.edu 10 Jul '19

10 Jul '19

Hi. We're looking for information on large sites that have migrated to mailman3. Preferably academic institutions. As we start to look at a migration project we're hoping to hear any 'lessons learned' from those who have gone before us. (Sorry if this information is already posted somewhere, I wasn't able to find it) Thanks, Steve Mats Mats Software Engineer Academic & Collaborative Applications - UW-IT University of Washington Seattle, Washington

3 2

List nonmembers
by Andrew Bernard 09 Jul '19

09 Jul '19

Under Users for a list, there is a category for List nonmembers. What does this term mean? [It's rather curious philosophically when you think about it, because I would have thought that the category [all humans - list members] fits that category term.] But seriously, I don't understand it. I have several email addresses there and I don't know what do with them, if anything. Andrew

4 5

delete examples.com site
by enrique.terrazas＠utsa.edu 09 Jul '19

09 Jul '19

Hello, I've been working on setting up Mailman3 on a RHEL 7.5 vm using the guides and documentation found here: http://docs.mailman3.org/en/latest/index.html https://mailman.readthedocs.io/en/latest/README.html http://docs.mailman3.org/projects/postorius/en/latest/index.html http://docs.mailman3.org/projects/mailmanclient/en/latest/README.html https://hyperkitty.readthedocs.io/en/latest/index.html https://gitlab.com/mailman/mailman-hyperkitty nginx is serving the Django applications via uwsgi. I was able to get mailman, postorius + hyperkitty, running and test sending out email verifications. In an attempt to set the default domain to something other than example.com I deleted the site: example.com, I did have another site. Unfortunately, this seems to have broken the Django applications. At the moment I am preparing to delete the virtual environment and set things up again. Unless there is something that can be done in the current virtual environment to "reset" things back to start. I was also running into an issue where the verification emails were successfully sent out. The url to verify the email looks like this: http://my.domain.com:8000/accounts/confirm-email/xxxxxxxxxxxx/ Replacing my.domain.com with the domain I added. How can I get the outgoing verification emails to not reference port 8000? If I take that same link and remove the port, I get the desired page. Port 8000 is blocked at our sites permitter firewall, I don't necessarily want to open it. I'd rather the URL just obfuscate the port and send it to https... Thank you in advance for your attention and assistance. Best regards, Enrique J. Terrazas

3 4

HTML post only showing as attachment
by andrew.bernard＠gmail.com 08 Jul '19

08 Jul '19

I have a post come in that is in HTML and has an image attached. It is distributed fine to email subscribers. Hyperkitty shows a blank message, with the in an html attachment, and the image as a jpg attachment. Why doesn't the text show in Hyperkitty? So far, all other messages display correctly. Andrew

2 2

Rich Text support in Hyperkitty
by Abhilash Raj 08 Jul '19

08 Jul '19

Hi All, I have been recently working on adding rich text support through markdown in Hyperkitty so that emails can be made easier to read. The core design idea in my mind when working on this was building something that doesn't bother writers of plain text emails too much, but allows people to write emails in markdown. The supported syntax is limited Markdown, for example: Hyperkitty's Markdown Syntax ============================ - List items are supported - Even nested ones - Headers with `#` aren't supported, mostly due to their widespread use as comments in code shared on mailing lists. - You can **emphasize** text and _itcalize_ them too - Block code and `inline code` works. - URLs work like they usually do. - Images _do work_, but are disabled by default because of their potential for tracking users. They need to be enabled by administrators through a configuration flag. ``` def sample(): return "yay" ``` While text intentionally written for Markdown rending looks pretty good, plain text sometimes isn't as good. I have applied my branch[1] on both the Mailman installations for these two lists (mail.python.org & lists.mailman3.org). Any feedback or bug reports on weird looking stuff is welcome here or directly [on my PR][1] [1]: https://gitlab.com/mailman/hyperkitty/merge_requests/160 -- thanks, Abhilash Raj (maxking)

4 9

Mandatory First and Last Name
by andrew.bernard＠gmail.com 08 Jul '19

08 Jul '19

Is there a way to make the profile require users to fill out their name? Andrew

3 3

Odd hold message
by Andrew Bernard 08 Jul '19

08 Jul '19

I received a very simple post today that was held with the following reason: The message is being held because: Message contains administrivia At your convenience, visit your dashboard to approve or deny the request. What is this all about? What does Mailman consider to be administrivia, of all things, and why is this a reason to hold a message? The only thing in the message I can see is that it mentioned '100 members'. Is Mailman becoming sentient and developing an attitude? Seriously, I'd like to know more about this. Andrew

2 2

Images and rich content in hyperkitty
by andrew.bernard＠gmail.com 07 Jul '19

07 Jul '19

I see discussion about this topic here in July. My immediate interest is that I had hoped to move from an antique plain-text only list to modern list software that will support content such as inline images (partly to staunch the flow of subscribers to facebook, simply to be able to post pictures.) Does hyperkitty support this, and where can one read about that? Andrew

3 2

Post confirmation
by andrew.bernard＠gmail.com 07 Jul '19

07 Jul '19

Some mailing lists have an intermediary step where when the user posts, an email is received frm the server asking them to confirm posting, or discard it. Some of my users feel this gives them the chance to not post something they may have composed in error, or regret, or changed their mind about something. Is it possible to configure this behaviour (I think from Listserv) in Mailman? Andrew

2 1

Hyperkitty message threading
by andrew.bernard＠gmail.com 07 Jul '19

07 Jul '19

I am seeing some anomalies with message threading. without going into detail about the symptoms, first le me ask how does Hyperkitty thread messages? Is it based on the message-id in the header, guaranteed unique, or on the subject header? I appear to have a situation where people reply to a message, and then probably thinking to start a new thread, change the subject field., and them post. The message goes to the original thread. I cant stop people doing this as it seems the vast majority of people all over just hit reply for most things anyway as they are generally too lazy to start a new mail (drives me nuts). With this situation, where the subject has apparently been changed, Hyperkitty adds a not to the top of the post "New subject ...' which is what makes me think the message id is involved. Some of my subscribers say they do this all the time on the old Listserv mailing list and a new thread is started. Any help would be appreciated. It's difficult fro me to manually ressign the incorrectly threaded replies as there is no parent message to attach them to. Andrew

3 3

Show number of subscribers
by andrew.bernard＠gmail.com 04 Jul '19

04 Jul '19

Would there be a way to show the number of subscribers to a list in the web UI? The number of participants per message is great, but this would be good too. My users seem very interested in this number. I guess they want to know how big the audience is that is reading their posts. Andrew

4 3

opt in/out for hidden lists
by mailman3＠malevil.cc 04 Jul '19

04 Jul '19

Is it possible to change the default value for list visibility? Sometime when my list admins create a new list they forget to check that they should be hidden, I think that should be the default value anyway because its a potentially security issue when a list is unwanted visible...

2 1

Documentation for users for Mailman 3
by andrew.bernard＠gmail.com 04 Jul '19

04 Jul '19

There exists this: https://wiki.list.org/DOC/Mailman%202.1%20Members%20Manual I cant find a version for Mailman 3. Does it exist? If not, i will volunteer to write/update it. Let me know. Andrew

3 2

Waht are all these messages
by andrew.bernard＠gmail.com 30 Jun '19

30 Jun '19

My log is flooded with messages like this, with apparent IP address in them: [pid: 1014|app: 0|req: 228/228] 148.251.78.18 () {38 vars in 865 bytes} [Sun Jun 30 13:26:10 2019] GET /accounts/login/?next=/archives/list/jackrail(a)jackrail.org/thread/E5WNO25XQV74CIV4QS7MQ32EZ5EWKLQ7/ => generated 7658 bytes in 9 msecs (HTTP/1.1 200) 6 headers in 331 bytes (1 switches on core 1) What are these? The flow is continuous, many different IP addresses? Andrew

1 1

Reset digest number and volume
by andrew.bernard＠gmail.com 29 Jun '19

29 Jun '19

How to do this? After lots of testing on my pre-release beta testing list, I want the first production digest to be reset toVolume 1, Number 1. Andrew

3 3

Monthly job failure
by andrew.bernard＠gmail.com 26 Jun '19

26 Jun '19

I see this error oin startup: 3:22:11 [Q] INFO Process-1:1 processing [rebuild_mailinglist_cache_for_month] 13:22:11 [Q] ERROR Failed [rebuild_mailinglist_cache_for_month] - MailingList matching query does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7.egg/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.egg/hyperkitty/tasks.py", line 79, in _rebuild_mailinglist_cache_for_month mlist = MailingList.objects.get(name=mlist_name) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.mailinglist.MailingList.DoesNotExist: MailingList matching query does not exist. Latest build versions of everything. Any pointers? Andrew

3 7

SECRET_KEY is not defined. Aborting.
by Steven Jones 26 Jun '19

26 Jun '19

8><--- root@debian-mailman-001:/opt/mailman/docker-mailman# docker run maxking/mailman-web:0.2 SECRET_KEY is not defined. Aborting. root@debian-mailman-001:/opt/mailman/docker-mailman# 8><--- I keep getting this, I have attempted to set a SECRET_KEY in /opt/mailman/web/settings_local.py and, docker-compose.yaml No joy, can you tell me how I set this variable? or where I get it from? is it pre-generated somewhere? your documentation just does not explain this that I can find, despite even a lot of time googling. PS I have assumed the hyprekitty key is something I set myself, just like a manual password sort of thing, again there is no explanation I can find that explains how to do this properly either. Can this documentation be improved please. To get anywhere at all I finally found this, https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ So I have core running OK I think, ====== root@debian-mailman-001:/opt/mailman/docker-mailman# docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 99f434ef3664 maxking/mailman-core:0.2 "docker-entrypoint.s…" 2 hours ago Up About an hour 8001/tcp, 8024/tcp mailman-core 4c0e165d3a90 postgres:9.6-alpine "docker-entrypoint.s…" 2 hours ago Up About an hour 5432/tcp dockermailman_database_1 root@debian-mailman-001:/opt/mailman/docker-mailman# ====== regards Steven

2 2

Confirmation for subscriptions
by andrew.bernard＠gmail.com 24 Jun '19

24 Jun '19

Suddenly stopped working. For all the lists I have created, suddenly the confirm setting is ignored for subscriptions and users are subscribed right away. This only happened after I added another domain - surely that can't be the cause? Where to look to troubleshoot this? Andrew

3 5

Unable to download attachments from HyperKitty
by Derek Lambert 24 Jun '19

24 Jun '19

I’m having an issue downloading attachments from HyperKitty. The download begins as expected, but never progresses. Eventually it times out. I imagine the browser is expecting data matching the content-length header, but never receives it. Inspecting the contents of the download file reveals (address varies): <memory at 0x7f148fcb9588> I’ve been able to work around the issue with the following patch: --- env/lib/python3.7/site-packages/hyperkitty/models/email.py.orig 2018-12-06 21:38:39.544448735 +0000 +++ env/lib/python3.7/site-packages/hyperkitty/models/email.py 2018-12-06 23:01:39.923239421 +0000 @@ -309,7 +309,7 @@ def get_content(self): folder = self._get_folder() if folder is None: - return self.content + return self.content.tobytes() filepath = os.path.join(folder, str(self.counter)) if not os.path.exists(filepath): logger.error("Could not find local attachment %s for email %s", I haven't been able to replicate the issue with the HyperKitty tests, presumably the issue is somewhere in the Django <-> uwsgi <-> nginx stack. My configs are based on mailman-suite and maxking/docker-mailman. I've tried stripping out all the performance tweaks from my uwsgi and nginx configs, but no change. Versions: HyperKitty 1.2.1 Postorius 1.2.3 Django 2.1.7 nginx 1.14.1 uwsgi 2.0.18 Python 3.7.2 Has anyone come across this before? Derek Lambert

5 6

Unwanted indent on first line of post in hyperkiity
by andrew.bernard＠gmail.com 23 Jun '19

23 Jun '19

I don't want hyperkiitty adding an unasked for indent on the first line of all posts. How can one turn that off? Andrew

2 1

Mail not going out
by andrew.bernard＠gmail.com 22 Jun '19

22 Jun '19

What process handles the sending of the mail out to subscribers? My new installation suddenly stopped sending. Apologies for so many newbie questions. Andrew

2 1

How to download attachments from hyperkitty
by andrew.bernard＠gmail.com 22 Jun '19

22 Jun '19

Not working - download just waits forever after a few bytes in the browser. Could it be that you have to set hyperkitty to store attachments in the filesystem, and configure uwsgi to serve them as static files? Is that what the hyperkitty setting HYPERKITYY_ATTACHMENT_FOLDER is for? If this is so, can anybody show the fragment of uwsgi configuration required? Andrew

1 1

change preferred language of list
by mailman3＠malevil.cc 22 Jun '19

22 Jun '19

hey, I am not very experienced with the mailman shell and configuration. I configured mailman using the mailman.cnf and I know that I can use "mailman conf" to get all the parameters. But now I would like to change the preferred language of a list. Because despite I set [mailman] default_language: de even new lists will still have "en" as preferred language. I checked this just by reading the $language variable in a list template. How can I change the list parameters and how can I make mailman to use the german language files? I found the files, so I know they exist, but still need to make mailman use them...

3 8

join via webform
by mailman3＠malevil.cc 21 Jun '19

21 Jun '19

Is there a simple possibility to join a mailinglist besider writing a mail to list-join(a)example.com? I know you can register and then join a list, but thats only possible for public lists and I would like to have such a very simple webform for a specific list where you just enter your email address and then get the confirmation mail. I guess there was something like this with mailman2

2 5

Please help - Held message is crashing mailman.
by Alex King 21 Jun '19

21 Jun '19

Hi, I've used mailman a lot in the past, and decided to install mailman3 in a recent install. I'm unimpressed so far, it seems buggy. Running on Ubuntu 18.04.2 LTS from packages, mailman3 3.1.1-9, mailman3-web 0+20170523-14, python-django-postorius 1.1.2-3. After a few messages, I now can't go to the "Held Messages" in postorius, I get a 500 error. I tried to interact on the command line, but could not work out how. Reading https://mailman.readthedocs.io/en/latest/src/mailman/docs/install.html and https://mailman.readthedocs.io/en/latest/src/mailman/commands/docs/shell.ht…, I tried: # mailman shell Welcome to the GNU Mailman shell >>> command = cli('mailman.commands.cli_withlist.shell') Traceback (most recent call last): File "/usr/lib/python3.6/code.py", line 91, in runcode exec(code, self.locals) File "<console>", line 1, in <module> NameError: name 'cli' is not defined I did a lot of reading of the manual and googled, but I have no idea where the cli object is supposed to come from.....? The documentation is confusing. Anyway, after some trial and error, i found: # mailman shell Welcome to the GNU Mailman shell >>> list_manager = getUtility(IListManager) >>> m=list_manager.get("committee(a)[redacted].org") >>> from mailman.interfaces.requests import IListRequests >>> requests = IListRequests(m) >>> [x for x in requests.held_requests][0].id 8 >>> requests.get_request(8) Traceback (most recent call last): File "/usr/lib/python3.6/code.py", line 91, in runcode exec(code, self.locals) File "<console>", line 1, in <module> File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/requests.py", line 120, in get_request result.data_hash, expunge=False) File "/usr/lib/python3/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3/dist-packages/mailman/model/pending.py", line 138, in confirm value = json.loads(keyvalue.value) File "/usr/lib/python3.6/json/__init__.py", line 354, in loads return _default_decoder.decode(s) File "/usr/lib/python3.6/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.6/json/decoder.py", line 355, in raw_decode obj, end = self.scan_once(s, idx) json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 1 (char 0) It seems something was written out to disk that can't be read in for some reason (assuming a json object on disk?) How do I debug this further? How do I find the json being decoded? Any help would be appreciated. (I found mailman2 just worked, I was happy with that.) (My colleague posted a bug about this I believe but I don't have the link to that.) Thanks, Alex

3 3

mass invitation
by mailman3＠malevil.cc 20 Jun '19

20 Jun '19

in postorius there is just the option to make a mass subscription, in mailman2 there was also the possibility to just invite users, so they need to click a link when they really want to join the list. Is this also available in mailman3/postorius?

3 2

Importing mbox files into hyperkitty since date
by andrew.bernard＠gmail.com 20 Jun '19

20 Jun '19

What is the syntax for the data in the --since argument to hyperkitty_import> --since SINCE SINCE is not very informative. :-) Guessing, using '1/1/1970' does not seem to achieve anything, and gives no error.

2 3

Hyperkitty Archives - Sidebar years/months
by Enrique Terrazas 20 Jun '19

20 Jun '19

Hello, I’m going through importing archives from mm2 to mm3. One of the lists I’ve imported has messages going back to 11/2013. I was able to successfully import the lists settings using: mailman import21 lists(a)domain.com<mailto:lists@domain.com> /path/to/list/config.pck This successfully imported lists owners, moderators, subscribers, & settings. I then imported the messages with the following command: python /path/to/manage.py hyperkitty_import -l list(a)domain.com<mailto:list@domain.com> /path/to/list.mbox —since 10/01/2013 I used that date because it is older than the first message sent to the list: 11/13/2013 And followed that up with the update index command: python /path/to/manage.py update_index_one_list list(a)domain.com<mailto:list@domain.com> This successfully imported all the messages from 11/13/2013 through 09/30/2018. Here is where I’m facing two issues: * Messages from October 2018 were not imported * The sidebar only shows the year 2018. Fdasfds If I modify the URL to go to https://my.domain.org/hyperkitty/list/list@domain.com/2013/11 the archived emails show up fine. October 2018 shows two test messages I’ve sent but not any of the messages from October 2018 that should have been imported. Is there something additional that needs to be done to show the previous years and months in the sidebar? Thanks, Enrique

4 5

Flushing/syncing hyperkitty with mailman
by Eric Abrahamsen 20 Jun '19

20 Jun '19

I've got mailman running on Ubuntu 14.04, with systemd service files to govern the mailman and hyperkitty qcluster processes. I notice in the systemctl status call for the qcluster command that there are a bunch of errors like: [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. [Q] INFO Process-1:1 processing [rebuild_email_cache_votes] [Q] ERROR Failed [rebuild_email_cache_votes] - Email matching query does not exist. [Q] INFO Process-1:2 processing [rebuild_thread_cache_votes] [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. [Q] INFO Process-1:3 processing [rebuild_email_cache_votes] [Q] ERROR Failed [rebuild_email_cache_votes] - Email matching query does not exist. [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching query does not exist. Is there something more I should be doing to sync hyperkitty's database with mailman? I've got the crontab file in place, and that appears to be running without error. Anything else? Thanks, Eric

4 5

Django error - External IP
by andrew.bernard＠gmail.com 20 Jun '19

20 Jun '19

I am seeing this error frequently: Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/list/jackrail(a)list.jackrail.org/message/new Internal Server Error: /archives/list/jackrail(a)list.jackrail.org/message/new Error at /archives/list/jackrail(a)list.jackrail.org/message/new error 14 from memcached_get(:2:User:11:subscriptions) Request Method: GET Request URL: https://list.jackrail.org/archives/list/jackrail@list.jackrail.org/message/… ... followed by many many pages of settings information, none of which is informative to me. What does this signify? I am trying to bring my list to a go live state, but this does not bode well. I can send the full diagnostic (long) if need be. Andrew

2 2

problems in setting up mailman3 containers.
by Steven Jones 20 Jun '19

20 Jun '19

Hi, Trying to setup the 2 mailman3 containers, they fail to start, config and failure messages are, ======== [root@rhel8-svr-001 mailman]# pwd /opt/mailman [root@rhel8-svr-001 mailman]# !269 more core/mailman-extra.cfg # mailman-extra.cfg [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 172.19.199.2 lmtp_port: 8024 smtp_host: 172.19.199.1 smtp_port: 25 configuration: /etc/postfix-mailman.cfg [mailman] site_owner: steven(a)xx.co.nz SECRET_KEY: testing123 [root@rhel8-svr-001 mailman]# !271 more web/settings_local.py SECRET_KEY: testing123 [root@rhel8-svr-001 mailman]# !272 podman run mailman-core DATABASE_URL is not defined. Using sqlite database... No MTA environment variable found, defaulting to Exim HYPERKITTY_API_KEY not defined, please set this environment variable... exiting... [root@rhel8-svr-001 mailman]# !273 podman run mailman-web SECRET_KEY is not defined. Aborting. [root@rhel8-svr-001 mailman]# ========= Could really do with some examples of these files as well... regards Steven

2 1

join via webform
by mailman3＠malevil.cc 19 Jun '19

19 Jun '19

Is there a simple possibility to join a mailinglist besider writing a mail to list-join(a)example.com? I know you can register and then join a list, but thats only possible for public lists and I would like to have such a very simple webform for a specific list where you just enter your email address and then get the confirmation mail. I guess there was something like this with mailman2

1 0

howto reallow a banned email ?
by Nicolas Pettiaux 19 Jun '19

19 Jun '19

Hello, By mistake a user has been banned to post to mailman list. How can I allow him not only to post but also to become a member of a list ? I have not found any info on the web, or I have been unable to search correctly. Much thanks, Nicolas -- Nicolas Pettiaux - PhD - nicolas(a){educode,pettiaux}.be - Président de Educode asbl Informer, former et susciter la réflexion des acteurs du monde de l'enseignement face aux évolutions d'un monde numérique - http://2019.educode.be & http://2018.educode.be

2 4

Do not show archives to public
by andrew.bernard＠gmail.com 19 Jun '19

19 Jun '19

Is there a way to have list archives only visible to list subscribers? Presently, they are world visible - unless I have configured my site incorrectly.

4 3

Domain owner functionality?
by Derek Lambert 14 Jun '19

14 Jun '19

I noticed there's a "domain_owners" table in the mailman core database. If I add a user and domain id to this table will it grant the user owner permissions for all lists in a domain? Will they be able to create lists? Thanks! Derek

2 1

Invalid FilterAction: discard. Treating as discard
by Henrik Rasmussen 12 Jun '19

12 Jun '19

Having set the Filter content to Yes - regardless of other setting in the "Alter Messages" tab, make a HTML message come out empty. I can replicate this on my test list. I have tried debugging by changing each setting one-by-one and sending the user's mail, but no change makes the mail come out with a content. However setting "Filter content" to "no" makes the mail come out okay. With "Filter content" set to "Yes", sending another HTML mail is okay, so something in the user's mail may not be right, but I wonder why setting "Filter content" to no "solves" the problem. Afte all this setting is switching all other settings on and off, so I can't just ask the user to turn it off. May 06 11:53:32 2019 (33) ACCEPT: <250E794B36C1E646AF3D81E1F15348C79DA8CA83(a)P2KITMBX06WC03.unicph.domain> May 06 11:53:32 2019 (37) [LISTNAME](a)lists.example.com invalid FilterAction: discard. Treating as discard May 06 11:53:32 2019 (37) <250E794B36C1E646AF3D81E1F15348C79DA8CA83(a)P2KITMBX06WC03.unicph.domain> discarded by "default-posting-pipeline" pipeline handler "mime-delete": After content filtering, the message was empty May 06 17:27:35 2019 (33) ACCEPT: <250E794B36C1E646AF3D81E1F15348C79DA8CAEC(a)P2KITMBX06WC03.unicph.domain> May 06 17:27:35 2019 (37) [LISTNAME](a)lists.example.com invalid FilterAction: discard. Treating as discard May 06 17:27:35 2019 (37) <250E794B36C1E646AF3D81E1F15348C79DA8CAEC(a)P2KITMBX06WC03.unicph.domain> discarded by "default-posting-pipeline" pipeline handler "mime-delete": After content filtering, the message was empty /Henrik Rasmussen

2 9