From coldkayak@gmail.com Tue Jun 4 16:31:59 2019 From: Cold Kayak To: mailman-users@mailman3.org Subject: [MM3-users] Hope for Mailman 3.X in cPanel Date: Tue, 04 Jun 2019 08:27:29 -0700 Message-ID: <66A0EBDF-7633-4692-816B-8F75DF0C8B7A@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5310953448946894540==" --===============5310953448946894540== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, it appears that cPanel is interested in supporting MailMan 3.X! See = - https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870 "We=E2=80=99re hoping to work with the Mailman folks at some point in the f= uture to accomplish this goal."=20 Hopefully this happens sooner than later. regards, Edmond --===============5310953448946894540==-- From her@adm.ku.dk Thu Jun 6 13:02:40 2019 From: Henrik Rasmussen To: mailman-users@mailman3.org Subject: [MM3-users] Re: Invalid FilterAction: discard. Treating as discard Date: Thu, 06 Jun 2019 13:02:36 +0000 Message-ID: <155982615685.15215.7821460028851431566@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1791371299473843216==" --===============1791371299473843216== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Mark Sapiro wrote: > Then if collapse_alternatives is True (settable here or in Postorius), > any multipart/alternative parts will by replaced by the first, > presumably text/plain, sub-part. > > Finally, if convert_html_to_plaintext is True (settable here or in > Postorius), any remaining text/html parts will be converted to plain > text by lynx or whatever is configured as html_to_plain_text_command in > mailman.cfg. > This will ensure that filter_action is applied only to those messages > which have no text/plain or text/html parts. Great, that helped for the content. Thanks. Still, attachments (PDF) is removed by Mailman. I as the list admin to send a= new mail, but hold it back, to see what type it is. If that doesn't work, we have talked about deleting the list and add it from = scratch. Is the any prolems (with left overs from the old imported list), whe= n deleting the list from Postorius? /Henrik Rasmussen --===============1791371299473843216==-- From andrew.bernard@gmail.com Thu Jun 6 15:13:49 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Hyperkitty Authorization Required Date: Thu, 06 Jun 2019 12:52:28 +0000 Message-ID: <155982554852.15215.11647712563982054167@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4680300958729901209==" --===============4680300958729901209== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Nearly there configuring my first Mailman 3 installation with Postorius and H= yperkiity. This issue eludes me: When trying to start a new thread in the archive, we have: HyperKitty failure on https://list.jackrail.org/hyperkitty/api/mailman/archiv= e: Auth required

Authorization Required

(401) I can access this URL just fine" https://list.jackrail.org/hyperkitty/api/ Where do we look to solve this issue? --===============4680300958729901209==-- From mark@msapiro.net Thu Jun 6 15:21:54 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Hyperkitty Authorization Required Date: Thu, 06 Jun 2019 08:21:39 -0700 Message-ID: In-Reply-To: <155982554852.15215.11647712563982054167@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0835405940260273204==" --===============0835405940260273204== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/6/19 5:52 AM, andrew.bernard(a)gmail.com wrote: > Nearly there configuring my first Mailman 3 installation with Postorius and= Hyperkiity. This issue eludes me: >=20 > When trying to start a new thread in the archive, we have: >=20 > HyperKitty failure on https://list.jackrail.org/hyperkitty/api/mailman/arch= ive: Auth required >

Authorization Required

(401) >=20 > I can access this URL just fine" >=20 > https://list.jackrail.org/hyperkitty/api/ >=20 > Where do we look to solve this issue? You have to be logged in to post from HyperKitty. You can't post anonymously. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0835405940260273204==-- From mark@msapiro.net Thu Jun 6 16:19:25 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Invalid FilterAction: discard. Treating as discard Date: Thu, 06 Jun 2019 09:19:14 -0700 Message-ID: <7111864f-ef59-583d-8d5a-8eac74e8cf74@msapiro.net> In-Reply-To: <155982615685.15215.7821460028851431566@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2642727248641268250==" --===============2642727248641268250== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/6/19 6:02 AM, Henrik Rasmussen wrote: >=20 > Still, attachments (PDF) is removed by Mailman. I as the list admin to send= a new mail, but hold it back, to see what type it is. You have to add the MIME types for the attachments you want kept the the list's pass_types. You need to do this via mailman shell or REST as it isn't currently exposed in Postorius. Here's an example from a list that wants to accept PDFs as well as word processing and spreadsheet documents. Note that nappdf and x-pdf are uncommon PDF subtypes that I have seen. ['multipart', 'message/rfc822', 'text/plain', 'text/html', 'application/pdf', 'application/nappdf', 'application/x-pdf', 'application/rtf', 'application/vnd.oasis.opendocument.spreadsheet', 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet', 'application/vnd.ms-excel', 'application/vnd.oasis.opendocument.text', 'application/vnd.openxmlformats-officedocument.wordprocessingml.document', 'application/msword' ] --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2642727248641268250==-- From maxking@asynchronous.in Thu Jun 6 16:37:52 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Hyperkitty Authorization Required Date: Thu, 06 Jun 2019 16:37:50 +0000 Message-ID: <155983907059.15212.17567048438170735711@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3102578825742101740==" --===============3102578825742101740== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable It feels like this is coming from Mailman not being able to archive emails, w= hich is most probably because of missing HYPERKITTY_API_KEY in mailman-hyperk= itty.cfg file. --===============3102578825742101740==-- From turnbull.stephen.fw@u.tsukuba.ac.jp Thu Jun 6 17:05:45 2019 From: "Stephen J. Turnbull" To: mailman-users@mailman3.org Subject: [MM3-users] Hope for Mailman 3.X in cPanel Date: Fri, 07 Jun 2019 02:05:39 +0900 Message-ID: <23801.18403.193263.594752@turnbull.sk.tsukuba.ac.jp> In-Reply-To: <66A0EBDF-7633-4692-816B-8F75DF0C8B7A@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6866011765984303949==" --===============6866011765984303949== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Yup, we know about this, and we are *very* excited, as you might guess. Cold Kayak writes: > Hi, >=20 > it appears that cPanel is interested in supporting MailMan 3.X! S= ee - https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870 <= https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870> >=20 > "We=E2=80=99re hoping to work with the Mailman folks at some point in th= e future to accomplish this goal."=20 >=20 > Hopefully this happens sooner than later. >=20 > regards, > Edmond >=20 > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ --===============6866011765984303949==-- From brian@emwd.com Thu Jun 6 18:36:58 2019 From: brian@emwd.com To: mailman-users@mailman3.org Subject: [MM3-users] Import Archives using Docker Image Date: Thu, 06 Jun 2019 18:36:55 +0000 Message-ID: <155984621565.15216.8617680508937639308@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8321302672182240436==" --===============8321302672182240436== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I want to test out importing a 2.1 archive into a Mailman 3.2 list. I am usin= g maxking's docker images for MM3. How would I go about importing the mbox fi= le? I don't think the following commands would work on a Docker installation = of MM3: $ python manage.py hyperkitty_import -l foo-list(a)example.com $var_prefix/ar= chives/private/foo-list.mbox/foo-list.mbox $ python manage.py update_index_one_list foo-list(a)example.com I am not sure how to go about doing this within Docker. Thanks for any assistance, Brian --===============8321302672182240436==-- From maxking@asynchronous.in Thu Jun 6 18:41:50 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Import Archives using Docker Image Date: Thu, 06 Jun 2019 11:41:45 -0700 Message-ID: In-Reply-To: <155984621565.15216.8617680508937639308@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5208441240664519062==" --===============5208441240664519062== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On Thu, Jun 6, 2019, at 11:37 AM, brian(a)emwd.com wrote: > I want to test out importing a 2.1 archive into a Mailman 3.2 list. I=20 > am using maxking's docker images for MM3. How would I go about=20 > importing the mbox file? I don't think the following commands would=20 > work on a Docker installation of MM3: >=20 > $ python manage.py hyperkitty_import -l foo-list(a)example.com=20 > $var_prefix/archives/private/foo-list.mbox/foo-list.mbox > $ python manage.py update_index_one_list foo-list(a)example.com >=20 > I am not sure how to go about doing this within Docker. You can copy the mbox file inside the container and them import it from there. See docs for "docker cp"[1] on how to copy something inside a container. Afte= r that, you can enter the container with usual "docker exec -it mailman-web bash" and use the commands mentioned above. https://docs.docker.com/engine/reference/commandline/cp/ >=20 > Thanks for any assistance, > Brian > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > --=20 thanks, Abhilash Raj (maxking) --===============5208441240664519062==-- From andrew.bernard@gmail.com Thu Jun 6 23:37:44 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Hyperkitty Authorization Required Date: Fri, 07 Jun 2019 09:37:35 +1000 Message-ID: <012e01d51cc0$d3962a30$7ac27e90$@gmail.com> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4633593047533827268==" --===============4633593047533827268== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Hi Mark, Thanks. But that is not the problem. It's hyperkitty background processes that show the error in the logs. I was probably not clear in my statement of the problem. I was testing it by typing in URL's. Sorry! I solved it by searching these archives. There was a post in January regarding the same issue, and the solution turned out to be replacing the given api keys with new ones, and all it all just works. Why that should be is a mystery to me, but now at least two people have found this. I would have thought a key is just a key. Andrew > -----Original Message----- > From: Mark Sapiro > Sent: Friday, 7 June 2019 1:22 AM > To: mailman-users(a)mailman3.org > Subject: [MM3-users] Re: Hyperkitty Authorization Required > You have to be logged in to post from HyperKitty. You can't post > anonymously. --===============4633593047533827268==-- From brian@emwd.com Fri Jun 7 17:41:16 2019 From: brian@emwd.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Import Archives using Docker Image Date: Fri, 07 Jun 2019 17:41:13 +0000 Message-ID: <155992927393.15211.14915814551730884096@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6009434845641115396==" --===============6009434845641115396== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable That worked. I was able to successfully import MM2 archives into a MM3 list. = This is a big deal for me so thank you for helping! Brian --===============6009434845641115396==-- From andrew.bernard@gmail.com Sat Jun 8 02:19:16 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Daily Cronjob fails Date: Sat, 08 Jun 2019 02:19:12 +0000 Message-ID: <155996035213.29680.2142396597411788693@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5716407137339339464==" --===============5716407137339339464== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I am seeing the same error with the Hyperkitty installed from packages on Ubu= ntu 19. In order to apply that patch, should I install hyperkitty from git myself? --===============5716407137339339464==-- From mark@msapiro.net Sat Jun 8 03:56:41 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Daily Cronjob fails Date: Fri, 07 Jun 2019 20:56:04 -0700 Message-ID: In-Reply-To: <155996035213.29680.2142396597411788693@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7582634791350543352==" --===============7582634791350543352== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/7/19 7:19 PM, andrew.bernard(a)gmail.com wrote: > I am seeing the same error with the Hyperkitty installed from packages on U= buntu 19. >=20 > In order to apply that patch, should I install hyperkitty from git myself? Assuming your hyperkitty installation includes hyperkitty/migrations/0018_threadcategory_color.py all you should need to do is get hyperkitty/migrations/0019_auto_20190127_null_description.py from gitlab and put it in your hyperkitty/migrations/ directory and run `manage.py migrate` to apply it. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============7582634791350543352==-- From andrew.bernard@gmail.com Sat Jun 8 09:12:04 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sat, 08 Jun 2019 09:12:00 +0000 Message-ID: <155998512043.29679.15067799561342038178@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2840882169944037672==" --===============2840882169944037672== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I'm new to Mailman. I have a Ubuntu 19 production server. I attempted to get = Mailman 3 and the web components going with the system packages, but I encoun= tered a few showstopper errors (such as indexing not working at all) which I = know have been fixed in the codebase. To that end I erased my installation, a= nd installed mailman from the gitlab source. That all works much more nicely = now and I feel I have a lot more control of the layout of all the files (the = various Ubuntu packages smear the parts all over the place, confusingly). Now I want to get Postorius and Hyperkitty going again, independently of Ubun= tu packages. I would like to run Postorius and Hyperkitty under one Django pr= oject. So I downloaded the git source for mailman_web. I do not know if this = is the right way to install. I am partially familiar with Django, but to come to the point, I have no idea= once having obtained the source from git how to setup and install the projec= t, where it lives in the filesystem, and so on. Are there any pointers to hel= p in this area? The very nice readthedocs format files for Postorius and Hype= rkitty are very silent on basic matters like this, which is not of much help!= The git README files also define a new level of brevity. I need some initial hand holding here. If any help is forthcoming, such as li= nks to more full documentation for newbies to Mailman, I would be most gratef= ul. --===============2840882169944037672==-- From maxking@asynchronous.in Sat Jun 8 09:52:39 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sat, 08 Jun 2019 02:52:32 -0700 Message-ID: <7c48b580-6fb4-472b-8bd2-df6babd0e7ef@www.fastmail.com> In-Reply-To: <155998512043.29679.15067799561342038178@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6347053828344510786==" --===============6347053828344510786== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Sat, Jun 8, 2019, at 2:12 AM, andrew.bernard(a)gmail.com wrote: > I'm new to Mailman. I have a Ubuntu 19 production server. I attempted > to get Mailman 3 and the web components going with the system packages, > but I encountered a few showstopper errors (such as indexing not > working at all) which I know have been fixed in the codebase. To that > end I erased my installation, and installed mailman from the gitlab > source. That all works much more nicely now and I feel I have a lot > more control of the layout of all the files (the various Ubuntu > packages smear the parts all over the place, confusingly). > > Now I want to get Postorius and Hyperkitty going again, independently > of Ubuntu packages. I would like to run Postorius and Hyperkitty under > one Django project. So I downloaded the git source for mailman_web. I > do not know if this is the right way to install. Mailman Web works okay, there are very few things actually in there. If you want to install things from source, consider using the mailman_suite project as a starting point. https://gitlab.com/mailman/mailman-suite Mark wrote down his experience installing Mailman 3 on two machines, which is currently running this very list. https://wiki.list.org/DOC/Mailman%203%20installation%20experience > I am partially familiar with Django, but to come to the point, I have > no idea once having obtained the source from git how to setup and > install the project, where it lives in the filesystem, and so on. Are > there any pointers to help in this area? The very nice readthedocs > format files for Postorius and Hyperkitty are very silent on basic > matters like this, which is not of much help! The git README files also > define a new level of brevity. > > I need some initial hand holding here. If any help is forthcoming, such > as links to more full documentation for newbies to Mailman, I would be > most grateful. I'll try to write the steps in short, let me know if you need me to expand on any of these. 1. Choose a directory to get all the sources. I usually prefer /opt. So, create /opt/mailman 2. Create a Python 3 virtual environment. $ cd /opt/mailman $ python3 -m venv vevn $ source venv/bin/activate 3. Get all the sources and install in this virtualenv, you neeed: 1. Mailman Core (mailman/mailman) 2. Mailman Client (mailman/mailmanclient 3. Mailman-Hyperkitty (mailman/mailman-hyperkitty 4. Django-Mailman3 (mailman/django-mailman3 5. Postorius (mailman/postorius) 6. Hyperkitty (mailman/hyperkitty) You can also just `pip` install those packages, instead of using git sources. I would actually recommend using the release versions if you are not ready to deal with the instability of the git heads. 4. Finally, you need to create config files in right places: - Mailman Core's config lives at `/etc/mailman.cfg - Django config lives in the django project, mailman-suite. I am not going to dive into actual runtime configuration here. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============6347053828344510786==-- From andrew.bernard@gmail.com Sat Jun 8 11:04:41 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sat, 08 Jun 2019 21:04:26 +1000 Message-ID: In-Reply-To: <7c48b580-6fb4-472b-8bd2-df6babd0e7ef@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6837300234097222202==" --===============6837300234097222202== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Abilash, This is most helpful. But there seems to be an inconsistency, and it goes to exactly the question I am asking. You refer to mailman suite at the top of the file. But I want to follow your advice to use pip. Then after the pip instructions, you talk about the mailman-suite config file for Django. t's exactyl what I _don't_ want. Where is the Django config area for the pip installed modules? It is this that I find obscure. Andrew On Sat, 8 Jun 2019 at 19:53, Abhilash Raj wrote: > > 4. Finally, you need to create config files in right places: > > - Mailman Core's config lives at `/etc/mailman.cfg > > - Django config lives in the django project, mailman-suite. > > I am not going to dive into actual runtime configuration here. > > --===============6837300234097222202==-- From mark@msapiro.net Sat Jun 8 14:56:40 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sat, 08 Jun 2019 07:56:28 -0700 Message-ID: <2b93423d-dc2f-1431-5d7d-c71089dc984f@msapiro.net> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2707476195437690968==" --===============2707476195437690968== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/8/19 4:04 AM, Andrew Bernard wrote: > > Where is the Django config area for the > pip installed modules? It is this that I find obscure. The short answer is wherever you put it. If you look at which Abhilash mentioned, you'll see what I do. Abhilash mentioned creating the virtualenv in /opt/mailman/. I actually have another level below that, /opt/mailman/mm/, but this is only for convenience to separate things as I also have directories for the git branches and for local patches, so if we are just working with /opt/mailman/, you can put your Django settings.py and settings_local.py files there. I also put various other config things there like Mailman's var/ directory Django's static/ directory mailman.cfg mailman-hyperkitty.cfg gunicorn.conf and an empty __init__.py file so Django can import settings. Then I create a /opt/mailman/bin/ directory and in that I put small bash scripts to run things. for example: opt/mailman/bin/mailman contains #!/bin/bash unset PYTHONSTARTUP exec /opt/mailman/venv/bin/mailman \ -C "/opt/mailman/mm/mailman.cfg" \ $@ opt/mailman/bin/django-admin contains #!/bin/bash . /opt/mailman/venv/bin/activate cd /opt/mailman/ export PYTHONPATH=/opt/mailman/ export DJANGO_SETTINGS_MODULE=settings django-admin $@ and opt/mailman/bin/gunicorn contains #!/opt/mailman/venv/bin/python import sys sys.path[0:0] = [ '/opt/mailman/', ] import os os.environ['DJANGO_SETTINGS_MODULE'] = 'settings' import gunicorn.app.wsgiapp if __name__ == '__main__': sys.exit(gunicorn.app.wsgiapp.run()) Then I use those commands to run Mailman, Django and gunicorn. Some of this may not be directly applicable to you, but I hope it gives you the basic idea. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2707476195437690968==-- From mail@nickwynja.com Sat Jun 8 16:20:26 2019 From: Nick W To: mailman-users@mailman3.org Subject: [MM3-users] Postorius performance with over 1000 pending users Date: Sat, 08 Jun 2019 12:13:12 -0400 Message-ID: <20190608161312.fwqbsanpawm5di7g@eos> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2119140273220307213==" --===============2119140273220307213== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I've got a couple things I need help with: The Symptom and The Problem. The Symptom: Postorius has gotten quite slow to load, taking more than 30s to load the Subscription Requests tab. Having zero pending subscription requests (I'm on v1.2.5), I started investigating unconfirmed subscriptions. I followed the commands from here[1] and got this: mailman shell -l your.list.id util =3D getUtility(IPendings) print(len(list(util.find(mlist=3Dm,pend_type=3D'subscription')))) 1816 Wow, 1816 pending subscription requests. I can say for certain that my list is not popular so these requests must have been submitted by bots. Let's get the= re in The Problem. How can I "purge" this list? I'm willing to assume that none of these reques= ts are valid and would reject all unconfirmed user requests. The Problem: How might this activity be happening? Running cat /opt/mailman/core/var/logs/mailman.log | grep POST returns a lot of 202 and 409 responses for `POST /3.1/members`. Could it be that these requests are being submitted through Postorius? I'd assume there would be some sort of honeypot input to prevent abuse. I'll continue investigating and follow up with any insight I can on the cause of T= he Problem. Thanks, Nick [1]: https://lists.mailman3.org/archives/list/mailman-users(a)mailman3.org/me= ssage/LU5FQMHELEAHV7F5MXFRUFIELWHWJM6M/>=20 --===============2119140273220307213==-- From mail@nickwynja.com Sat Jun 8 16:46:04 2019 From: Nick W To: mailman-users@mailman3.org Subject: [MM3-users] Re: Postorius performance with over 1000 pending users Date: Sat, 08 Jun 2019 12:45:56 -0400 Message-ID: <20190608164556.3qhczfqzsnels23c@eos> In-Reply-To: <20190608161312.fwqbsanpawm5di7g@eos> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6973482840447310945==" --===============6973482840447310945== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 06/08/19 at 12:13, Nick W wrote: > Could it be that these requests are being submitted through Postorius? I'd > assume there would be some sort of honeypot input to prevent abuse. I'll > continue investigating and follow up with any insight I can on the cause of= The > Problem. Some follow up here: cat /var/log/nginx/access.log | grep "POST /postorius/lists/mylist.exmple= .com/" shows only a recent manual attempt I made to subscribe but not much else, whi= ch leads me to believe these requests aren't coming through Postorius. Now the more embarrassing part. The likely culprit is my stupidity. In an attempt to have subscription forms embedded on my static websites, I created this flask app to handle POSTs and subscribe people the the specifi= ed lists. https://github.com/nickwynja/fmmss/ I included a menial honeypot feature to handle spam requests, which I thought was working. It must not be but it appeared like it was, likely because I made the honeypot for my app at the same time I changed the subscription policy to 'confirm' and upgraded from Postorius 1.2.3 (when pending user subscriptions were no longer shown). Seems like I have some homework to do to prevent spam subscriptions through my app. --===============6973482840447310945==-- From mark@msapiro.net Sat Jun 8 22:06:46 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Postorius performance with over 1000 pending users Date: Sat, 08 Jun 2019 15:06:37 -0700 Message-ID: <5cc21449-6f8e-f167-681c-20b48a52de56@msapiro.net> In-Reply-To: <20190608161312.fwqbsanpawm5di7g@eos> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6262147843571809100==" --===============6262147843571809100== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/8/19 9:13 AM, Nick W wrote: > I've got a couple things I need help with: The Symptom and The Problem. >=20 > The Symptom: >=20 > Postorius has gotten quite slow to load, taking more than 30s to load the > Subscription Requests tab. Having zero pending subscription requests (I'm on > v1.2.5), I started investigating unconfirmed subscriptions. >=20 > I followed the commands from here[1] and got this: >=20 > mailman shell -l your.list.id > util =3D getUtility(IPendings) > print(len(list(util.find(mlist=3Dm,pend_type=3D'subscription')))) > 1816 >=20 > Wow, 1816 pending subscription requests. I can say for certain that my list= is > not popular so these requests must have been submitted by bots. Let's get t= here > in The Problem. >=20 > How can I "purge" this list? I'm willing to assume that none of these requ= ests > are valid and would reject all unconfirmed user requests. mailman shell -l your.list.id util =3D getUtility(IPendings) for token, data in util.find(mlist=3Dm, pend_type=3D'subscription'): util.confirm(token, expunge=3DTrue) --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============6262147843571809100==-- From andrew.bernard@gmail.com Sat Jun 8 23:34:12 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sun, 09 Jun 2019 09:33:57 +1000 Message-ID: In-Reply-To: <2b93423d-dc2f-1431-5d7d-c71089dc984f@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1023430093144522770==" --===============1023430093144522770== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Hi Mark, Thanks for your great help. But despite decades of UNIX experience, my area is not Django (yet). The nub of my question is that I thought you have to have a manage.py file for Django to be able to set up the various affairs, such as making the database migrations and so on. It is that that is eluding me. Apologies for this hopelessly newbie question. I was impressed with your method of installation in the page referenced, and I have foolwed that closely. But I am puzzled about the build script. If I run as user mailman, not root, it wanted to install under /usr. which of course results in permission denied. I had to modify the script to say this: python setup.py install --prefix /opt/mailman/mm/venv I am concerned that I have also misunderstood something here. A On Sun, 9 Jun 2019 at 00:57, Mark Sapiro wrote: > On 6/8/19 4:04 AM, Andrew Bernard wrote: > > > > Where is the Django config area for the > > pip installed modules? It is this that I find obscure. > > The short answer is wherever you put it. If you look at > > which Abhilash mentioned, you'll see what I do. > > > --===============1023430093144522770==-- From andrew.bernard@gmail.com Sat Jun 8 23:52:13 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sun, 09 Jun 2019 09:51:58 +1000 Message-ID: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5607301394849996186==" --===============5607301394849996186== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Ah. Base ignorance at play. It helps if one overcomes indolence and actually reads up on the docs for Django. I see that django-admin does all that the manage.py script does. So all is good. I shall proceed! > --===============5607301394849996186==-- From mark@msapiro.net Sun Jun 9 00:02:02 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Help with installing Postorius and Hyperkitty on Ubuntu 19 Date: Sat, 08 Jun 2019 17:01:50 -0700 Message-ID: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0281256144586712668==" --===============0281256144586712668== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/8/19 4:33 PM, Andrew Bernard wrote: > Hi Mark, >=20 > Thanks for your great help. But despite decades of UNIX experience, my area > is not Django (yet). The nub of my question is that I thought you have to > have a manage.py file for Django to be able to set up the various affairs, > such as making the database migrations and so on. It is that that is > eluding me. Apologies for this hopelessly newbie question. The equivalent of manage.py in what I suggested is /opt/mailman/bin/django-admin. > I was impressed with your method of installation in the page referenced, > and I have foolwed that closely. But I am puzzled about the build script. > If I run as user mailman, not root, it wanted to install under /usr. which > of course results in permission denied. I had to modify the script to say > this: >=20 > python setup.py install --prefix /opt/mailman/mm/venv If you want to install in the virtualenv, you should just activate the virtualenv and it should work. Perhaps the issue is that the build script at assumes the virtualenv is at /opt/mailman/mm/venv. You need to insure that the '. ../mm/venv/bin/activate' line is actually pointing to your 'venv/bin/activate' --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0281256144586712668==-- From andrew.bernard@gmail.com Sun Jun 9 10:18:26 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] WSGI: gunicorn and uwsgi Date: Sun, 09 Jun 2019 10:18:21 +0000 Message-ID: <156007550178.29678.10244921141693005298@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7114637120513771221==" --===============7114637120513771221== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Using the Ubuntu 19 packages for all the mailman suite, uwsgi is the Python W= SGI server included. I have now switched over to a full build from current so= urce from gitlab, following Mark Sapiro's excellent instructions. It would appear that the current code has the use of gunicorn built in. Is gu= nicorn the preferred way now to run the mailman Django apps? Is it worth spen= ding time converting everything to use uwsgi, or should I go with the flow an= d use gunicorn? What are the advantages of gunicorn over uwsgi? --===============7114637120513771221==-- From mark@msapiro.net Sun Jun 9 14:11:55 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: WSGI: gunicorn and uwsgi Date: Sun, 09 Jun 2019 07:11:43 -0700 Message-ID: In-Reply-To: <156007550178.29678.10244921141693005298@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5799054189753221999==" --===============5799054189753221999== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/9/19 3:18 AM, andrew.bernard(a)gmail.com wrote: > Using the Ubuntu 19 packages for all the mailman suite, uwsgi is the Python= WSGI server included. I have now switched over to a full build from current = source from gitlab, following Mark Sapiro's excellent instructions. Thank you. > It would appear that the current code has the use of gunicorn built in. Is = gunicorn the preferred way now to run the mailman Django apps? Is it worth sp= ending time converting everything to use uwsgi, or should I go with the flow = and use gunicorn? The "built-in" gunicorn is used only by core to provide the REST API interface. This replaced the former standard library wsgiref module to improve performance. It is completely independent of whatever WSGI server you use for Django. > What are the advantages of gunicorn over uwsgi? I can't comment intelligently on that. For a long time I used Graham Dumpleton's mod_wsgi with Apache for wsgi support, mostly for MoinMoin. I have no experience with uwsgi. When I set up MM 3 on lists.mailman3.org, the server was already using nginx so I arbitrarily chose gunicorn for that. On mail.python.org I started using mod_wsgi, but at one point there was an issue due apparently to an SSL library mismatch following an upgrade, but before the cause was recognized, I switched to gunicorn to get things up. On a third server I manage, I use mod_wsgi for MoinMoin which is Python 2.7. I found setting up both Python 2.7 and Python 3 versions of mod_wsgi on the same server to be daunting, so I went with gunicorn for Mailman 3 on that server too. My choices of gunicorn over uwsgi were an initial arbitrary choice followed by familiarity for subsequent choices. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============5799054189753221999==-- From andrew.bernard@gmail.com Tue Jun 11 01:21:42 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Mailman shell tutorial Date: Tue, 11 Jun 2019 01:21:38 +0000 Message-ID: <156021609891.14878.16809087291831942463@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3338317509992337257==" --===============3338317509992337257== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable is there a tutorial or some examples for using the mailman shell? Is there de= tailed documentation on it? Anything I try to do such as the following fails: $ mailman shell Welcome to the GNU Mailman shell >>> command('mailman shell --details') Traceback (most recent call last): File "", line 1, in NameError: name 'command' is not defined >>>=20 I execute the shell as user mailman and from within the same venv that all th= e programs run under. --===============3338317509992337257==-- From mark@msapiro.net Tue Jun 11 03:26:32 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Mailman shell tutorial Date: Mon, 10 Jun 2019 20:26:21 -0700 Message-ID: In-Reply-To: <156021609891.14878.16809087291831942463@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2182715000821834392==" --===============2182715000821834392== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/10/19 6:21 PM, andrew.bernard(a)gmail.com wrote: > is there a tutorial or some examples for using the mailman shell? Is there = detailed documentation on it? What documentation there is is at > Anything I try to do such as the following fails: >=20 > $ mailman shell > Welcome to the GNU Mailman shell >=20 >>>> command('mailman shell --details') > Traceback (most recent call last): > File "", line 1, in > NameError: name 'command' is not defined >>>> You could just do `mailman shell --details` at a command prompt. Perhaps you saw the `command('mailman shell --details')` line in the docs at in any case, that requires two things to precede it. The first is part of the doctest infrastructure and is not evident in the docs. that step is from mailman.testing.documentation import cli The second step is in the docs and is command =3D cli('mailman.commands.cli_withlist.shell') If you do those two steps within `mailman shell`, then the step command('mailman shell --details') will work, but as I said, this is just the same as doing `mailman shell --details` at a command prompt. Beyond that, actually doing stuff within `mailman shell` requires some knowledge of Mailman interfaces, methods and objects as well as Python. Some of this is covered throughout the documentation at but some can only be found in the source code itself. That said, all the interfaces and a few other useful functions are imported for you in `mailman shell` interactive mode. do `dir()` to see what these are. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2182715000821834392==-- From mail@nickwynja.com Tue Jun 11 12:05:38 2019 From: Nick To: mailman-users@mailman3.org Subject: [MM3-users] Re: Postorius performance with over 1000 pending users Date: Tue, 11 Jun 2019 08:05:33 -0400 Message-ID: <20190611120533.y7yt6wtvu5jsjspm@eos> In-Reply-To: <5cc21449-6f8e-f167-681c-20b48a52de56@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============9149390746358325023==" --===============9149390746358325023== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 06/08/19 at 18:06, Mark Sapiro wrote: > mailman shell -l your.list.id > util = getUtility(IPendings) > for token, data in util.find(mlist=m, pend_type='subscription'): > util.confirm(token, expunge=True) Thanks! In trying to learn more about preventing spam registrations, what methods does Postorius successfully employ to reduce spam signups through the "anonymous_subscribe" form? --===============9149390746358325023==-- From mark@msapiro.net Tue Jun 11 14:30:56 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Postorius performance with over 1000 pending users Date: Tue, 11 Jun 2019 07:30:47 -0700 Message-ID: <81bd3bd7-ca0d-07c5-d7cc-c3123a298b5e@msapiro.net> In-Reply-To: <20190611120533.y7yt6wtvu5jsjspm@eos> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0060489417493318099==" --===============0060489417493318099== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/11/19 5:05 AM, Nick wrote: >=20 > In trying to learn more about preventing spam registrations, what methods d= oes > Postorius successfully employ to reduce spam signups through the > "anonymous_subscribe" form? Only those implied by the list's Subscription Policy. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0060489417493318099==-- From andrew.bernard@gmail.com Wed Jun 12 01:00:29 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Mailman shell tutorial Date: Wed, 12 Jun 2019 11:00:21 +1000 Message-ID: <017501d520ba$37d1a630$a774f290$@gmail.com> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7183953528594319661==" --===============7183953528594319661== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Thanks Mark, The omission of the code to make the examples work seems to need correction. Perhaps I can submit an update to the project. Had me scratching my head for a long time. Obviously I knew there were imports etc missing, but what to put? I have this going, and it is great. But I recall seeing something called mmclient or similar which has simple commands like show user, show lists, and so on. Is that still available? Now knowing how mailman shell works, anybody could write their own commands, but I don't want to reinvent wheels. Andrew > -----Original Message----- > From: Mark Sapiro > Sent: Tuesday, 11 June 2019 1:26 PM > To: mailman-users(a)mailman3.org > > Perhaps you saw the `command('mailman shell --details')` line in the docs at > hell.html#getting-detailed-help> > in any case, that requires two things to precede it. The first is part of the > doctest infrastructure and is not evident in the docs. that step is > > from mailman.testing.documentation import cli > > The second step is in the docs and is > > command = cli('mailman.commands.cli_withlist.shell') > > If you do those two steps within `mailman shell`, then the step > > command('mailman shell --details') > > will work, but as I said, this is just the same as doing `mailman shell --details` > at a command prompt. --===============7183953528594319661==-- From mark@msapiro.net Wed Jun 12 02:10:34 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Mailman shell tutorial Date: Tue, 11 Jun 2019 19:10:25 -0700 Message-ID: <3c346d5b-ec3d-a2ba-e7ba-b8a48d59096a@msapiro.net> In-Reply-To: <017501d520ba$37d1a630$a774f290$@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7159208328854447247==" --===============7159208328854447247== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/11/19 6:00 PM, Andrew Bernard wrote: > > I have this going, and it is great. But I recall seeing something called > mmclient or similar which has simple commands like show user, show lists, > and so on. Is that still available? Are you thinking of the mailman command itself? Things like `mailman lists` and `mailman users`. Try running the `mailman` command itself with no arguments to see a list of sub-commands and then `mailman sub-command --help` to get the details of a particular subcommand. > Now knowing how mailman shell works, anybody could write their own commands, > but I don't want to reinvent wheels. I don't know what it is you are trying to accomplish, but yes, you can create scripts which you run via `mailman shell -run ...`, but is there something specific you are trying to do that is not currently available via the `mailman` command or the Postorius wb UI? -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============7159208328854447247==-- From her@adm.ku.dk Wed Jun 12 08:46:10 2019 From: Henrik Rasmussen To: mailman-users@mailman3.org Subject: [MM3-users] Re: Invalid FilterAction: discard. Treating as discard Date: Wed, 12 Jun 2019 08:46:06 +0000 Message-ID: <156032916635.32682.1238943274509176264@mailman.iad1.psf.io> In-Reply-To: <7111864f-ef59-583d-8d5a-8eac74e8cf74@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6840670668185403384==" --===============6840670668185403384== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Mark Sapiro wrote: > On 6/6/19 6:02 AM, Henrik Rasmussen wrote: > > Still, attachments (PDF) is removed by Mailman. I as > > the list admin to send a new mail, but hold it back, to see what type it = is. > You have to add the MIME types for the attachments you want kept the the > list's pass_types. You need to do this via mailman shell or REST as it > isn't currently exposed in Postorius. > Here's an example from a list that wants to accept PDFs as well as word > processing and spreadsheet documents. Note that nappdf and x-pdf are > uncommon PDF subtypes that I have seen. > ['multipart', > 'message/rfc822', > 'text/plain', > 'text/html', > 'application/pdf', > 'application/nappdf', > 'application/x-pdf', > 'application/rtf', > 'application/vnd.oasis.opendocument.spreadsheet', > 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet', > 'application/vnd.ms-excel', > 'application/vnd.oasis.opendocument.text', > 'application/vnd.openxmlformats-officedocument.wordprocessingml.document', > 'application/msword' > ] Thanks, done! However, PDF's and an image is still filterd out. On May 21st the list admin tested by setting Filter content to 'No'. As expec= ted, the mail was received as sent, with PDF attachment, inline image and HTM= L intact. Resending this mail to a newly created test list (from Outlook by selecting R= esend, which does exactly just that, the mail was again received as sent, eve= n the config of Alter Messages as the same as the list having the problem. The difference was that list(m.pass_types) is [] Now, setting m.pass_types =3D ['multipart', 'message/rfc822', 'text/plain', 'text/html', '= application/pdf', 'application/nappdf', 'application/x-pdf', 'application/rtf= ', 'application/vnd.oasis.opendocument.spreadsheet', 'application/vnd.openxml= formats-officedocument.spreadsheetml.sheet', 'application/vnd.ms-excel', 'app= lication/vnd.oasis.opendocument.text', 'application/vnd.openxmlformats-office= document.wordprocessingml.document', 'application/msword'] on the new testlist and resending the mail again, the mail still came out int= act. So I guess the problem must be something complete different. Also I wonder why a newly created list accepts the PDF in question, when list= (m.pass_types) is []. /Henrik Rasmussen --===============6840670668185403384==-- From mark@msapiro.net Wed Jun 12 15:06:10 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Invalid FilterAction: discard. Treating as discard Date: Wed, 12 Jun 2019 08:05:59 -0700 Message-ID: In-Reply-To: <156032916635.32682.1238943274509176264@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2838529259247535918==" --===============2838529259247535918== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/12/19 1:46 AM, Henrik Rasmussen wrote: >=20 > The difference was that list(m.pass_types) is [] >=20 > Now, setting >=20 > m.pass_types =3D ['multipart', 'message/rfc822', 'text/plain', 'text/html',= 'application/pdf', 'application/nappdf', 'application/x-pdf', 'application/r= tf', 'application/vnd.oasis.opendocument.spreadsheet', 'application/vnd.openx= mlformats-officedocument.spreadsheetml.sheet', 'application/vnd.ms-excel', 'a= pplication/vnd.oasis.opendocument.text', 'application/vnd.openxmlformats-offi= cedocument.wordprocessingml.document', 'application/msword'] >=20 > on the new testlist and resending the mail again, the mail still came out i= ntact. >=20 > So I guess the problem must be something complete different. >=20 > Also I wonder why a newly created list accepts the PDF in question, when li= st(m.pass_types) is []. You need to look at all of pass_types, filter_types, pass_extensions and filter_extensions for both lists. For a newly created list, these are all empty. They work as in Mailmam 2.1 and are imported from the similarly named 2.1 attributes by `mailman import21`. In brief if filter_content is True, processing is: 1. If a part's MIME type is in filter_types it is removed. 2. If pass_types is not empty and a part's MIME type is not in pass_types it is removed. 3. If a part has a file name and the file name extension is in filter_extensions it is removed. 4. If a part has a file name and pass_extensions is not empty and the part's file name extension is not in pass_extensions it is removed. So in your case of the list that doesn't work, possibilities are: 1. The PDF part's MIME type is in filter_types, or 2. The PDF part has a file name whose extension is in filter_extensions, or 3. pass_extensions is non-empty and The PDF part has a file name whose extension is not in pass_extensions. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2838529259247535918==-- From michael@theangel.net Wed Jun 12 15:08:01 2019 From: Michael Sage To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Wed, 12 Jun 2019 09:54:03 +0000 Message-ID: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3959942703443092660==" --===============3959942703443092660== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, I came across this really useful guide (posted to the list earlier). It has a= ll gone really well and mailman 3 is installed. However, I have an issue, whe= n I go to login using Postorius, I get the login page when I enter my credent= ials the page appears to hang and eventually goes to a Error 500 page. This t= otally hangs all of the mailman 3 web interface (but not apache). I then have= to reboot the server to even get back to the login page. Any tips please? Thanks --===============3959942703443092660==-- From maxking@asynchronous.in Wed Jun 12 16:40:32 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Wed, 12 Jun 2019 09:40:25 -0700 Message-ID: In-Reply-To: =?utf-8?q?=3CCWLP265MB1299A783EC7F02C22A626FACD4EC0=40CWLP265MB?= =?utf-8?q?1299=2EGBRP265=2EPROD=2EOUTLOOK=2ECOM=3E?= MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6353429719266613650==" --===============6353429719266613650== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Wed, Jun 12, 2019, at 8:08 AM, Michael Sage wrote: > Hi, > I came across this really useful guide (posted to the list earlier). It > has all gone really well and mailman 3 is installed. However, I have an > issue, when I go to login using Postorius, I get the login page when I > enter my credentials the page appears to hang and eventually goes to a > Error 500 page. This totally hangs all of the mailman 3 web interface > (but not apache). I then have to reboot the server to even get back to > the login page. Sorry, but can you post the URL to the guide you were following? It it hard to keep up with all the previous emails on this list. > > Any tips please? > > Thanks > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============6353429719266613650==-- From michael@theangel.net Wed Jun 12 16:43:32 2019 From: Michael Sage To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Wed, 12 Jun 2019 16:43:28 +0000 Message-ID: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0023287032011263325==" --===============0023287032011263325== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable > On Wed, Jun 12, 2019, at 8:08 AM, Michael Sage wrote: >> Hi, >> I came across this really useful guide (posted to the list earlier).=20 >> It has all gone really well and mailman 3 is installed. However, I=20 >> have an issue, when I go to login using Postorius, I get the login=20 >> page when I enter my credentials the page appears to hang and=20 >> eventually goes to a Error 500 page. This totally hangs all of the=20 >> mailman 3 web interface (but not apache). I then have to reboot the=20 >> server to even get back to the login page. > Sorry, but can you post the URL to the guide you were following? It it hard= to keep up with all the previous emails on this list. Of course sorry! https://docs.google.com/document/d/1xIcSsoNFp2nHi7r4eQys00s9= a0k2sHhu1V5PlantPTs/edit?usp=3Dsharing=20 --===============0023287032011263325==-- From mark@msapiro.net Wed Jun 12 16:46:32 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Wed, 12 Jun 2019 09:46:21 -0700 Message-ID: <96b39fec-7b7b-4299-3839-0c1c5527558c@msapiro.net> In-Reply-To: =?utf-8?q?=3CCWLP265MB1299A783EC7F02C22A626FACD4EC0=40CWLP265MB?= =?utf-8?q?1299=2EGBRP265=2EPROD=2EOUTLOOK=2ECOM=3E?= MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4152655934141297331==" --===============4152655934141297331== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/12/19 2:54 AM, Michael Sage wrote: > Hi, > I came across this really useful guide (posted to the list earlier). It has= all gone really well and mailman 3 is installed. However, I have an issue, w= hen I go to login using Postorius, I get the login page when I enter my crede= ntials the page appears to hang and eventually goes to a Error 500 page. This= totally hangs all of the mailman 3 web interface (but not apache). I then ha= ve to reboot the server to even get back to the login page. This seems like something I've seen reported before, but I can't find it now. Is anything logged in the various Mailman, Django, Apache logs? --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============4152655934141297331==-- From michael@theangel.net Wed Jun 12 16:53:26 2019 From: Michael Sage To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Wed, 12 Jun 2019 16:53:22 +0000 Message-ID: In-Reply-To: <96b39fec-7b7b-4299-3839-0c1c5527558c@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7534237805912605981==" --===============7534237805912605981== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable > This seems like something I've seen reported before, but I can't find it no= w. > Is anything logged in the various Mailman, Django, Apache logs? Nothing at the time in the Mailman, Mailman web or apache (error or access) l= ogs, I can't find any Django logs I am afraid. I only have standard logging, = happy to turn any debugging logging that you think might help Thanks --===============7534237805912605981==-- From mark@msapiro.net Wed Jun 12 16:56:22 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Wed, 12 Jun 2019 09:56:10 -0700 Message-ID: <05345b62-26f8-dca3-c94d-2fc7d2a632e3@msapiro.net> In-Reply-To: =?utf-8?q?=3CCWLP265MB1299A0CFE157E325E738C35CD4EC0=40CWLP265MB?= =?utf-8?q?1299=2EGBRP265=2EPROD=2EOUTLOOK=2ECOM=3E?= MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8967234255888387463==" --===============8967234255888387463== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/12/19 9:53 AM, Michael Sage wrote: >> This seems like something I've seen reported before, but I can't find it n= ow. >=20 >> Is anything logged in the various Mailman, Django, Apache logs? >=20 > Nothing at the time in the Mailman, Mailman web or apache (error or access)= logs, I can't find any Django logs I am afraid. I only have standard logging= , happy to turn any debugging logging that you think might help The Django log is most likely the one named mailman_web. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============8967234255888387463==-- From maxking@asynchronous.in Fri Jun 14 03:21:02 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Rich Text support in Hyperkitty Date: Thu, 13 Jun 2019 23:22:23 -0400 Message-ID: <5f53fb5d-572b-4bb8-bf66-e556ca069177@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2843670223101361682==" --===============2843670223101361682== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi All, I have been recently working on adding rich text support through markdown in = Hyperkitty so that emails can be made easier to read. The core design idea in= my mind when working on this was building something that doesn't bother writ= ers of plain text emails too much, but allows people to write emails in markd= own. The supported syntax is limited Markdown, for example: Hyperkitty's Markdown Syntax =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D - List items are supported - Even nested ones - Headers with `#` aren't supported, mostly due to their widespread use as co= mments in code shared on mailing lists. - You can **emphasize** text and _itcalize_ them too - Block code and `inline code` works. - URLs work like they usually do. - Images _do work_, but are disabled by default because of their potential fo= r tracking users. They need to be enabled by administrators through a configu= ration flag. ``` def sample(): return "yay" ``` While text intentionally written for Markdown rending looks pretty good, plai= n text sometimes isn't as good. I have applied my branch[1] on both the Mailm= an installations for these two lists (mail.python.org & lists.mailman3.org). Any feedback or bug reports on weird looking stuff is welcome here or directl= y [on my PR][1] [1]: https://gitlab.com/mailman/hyperkitty/merge_requests/160 --=20 thanks, Abhilash Raj (maxking) --===============2843670223101361682==-- From post+mm3-users@guelker.eu Fri Jun 14 15:07:50 2019 From: Marvin =?utf-8?q?G=C3=BClker?= To: mailman-users@mailman3.org Subject: [MM3-users] Re: Rich Text support in Hyperkitty Date: Fri, 14 Jun 2019 16:51:08 +0200 Message-ID: <20190614145108.qkdntsay4dqm4kkc@atlantis> In-Reply-To: <5f53fb5d-572b-4bb8-bf66-e556ca069177@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0306901482271963658==" --===============0306901482271963658== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Am 13. Juni 2019 um 23:22 Uhr -0400 schrieb Abhilash Raj: > - Block code and `inline code` works. I'd say to not accept inline code this way, because I perceive it as way to common to use `this' kind of quoting. If the leading ` is taken as the beginning of an inline code element, it will break the formatting of everything that follows. -- Blog: https://mg.guelker.eu --===============0306901482271963658==-- From maxking@asynchronous.in Fri Jun 14 18:25:37 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Rich Text support in Hyperkitty Date: Fri, 14 Jun 2019 14:27:02 -0400 Message-ID: <9f8c5371-3b58-40f2-a31f-a750d7c19e0d@www.fastmail.com> In-Reply-To: <20190614145108.qkdntsay4dqm4kkc@atlantis> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8208863127121450298==" --===============8208863127121450298== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit On Fri, Jun 14, 2019, at 11:07 AM, Marvin Gülker wrote: > Am 13. Juni 2019 um 23:22 Uhr -0400 schrieb Abhilash Raj: > > - Block code and `inline code` works. > > I'd say to not accept inline code this way, because I perceive it as way > to common to use `this' kind of quoting. If the leading ` is taken as > the beginning of an inline code element, it will break the formatting of > everything that follows. I would actually like inline code to work, it is quite helpful actually when reading, although I agree with your point. The rendering of the above message broke the formatting of only that line since inline style ended when it encountered a new-line character. Not to say that it isn't bad. > > -- > Blog: https://mg.guelker.eu > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============8208863127121450298==-- From michael@theangel.net Fri Jun 14 19:50:18 2019 From: Michael Sage To: mailman-users@mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup Date: Fri, 14 Jun 2019 19:50:12 +0000 Message-ID: In-Reply-To: <05345b62-26f8-dca3-c94d-2fc7d2a632e3@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8109977007912042154==" --===============8109977007912042154== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Thanks for your tip about digging deeper into the logs! Turns out it was a po= stfix issue (the hash files hadn't been created), which was causing it to loo= p and crash out. -----Original Message----- From: Mark Sapiro =20 Sent: 12 June 2019 17:56 To: mailman-users(a)mailman3.org Subject: [MM3-users] Re: Walk-thru for Ubuntu Bionic Mailman 3 Full setup On 6/12/19 9:53 AM, Michael Sage wrote: >> This seems like something I've seen reported before, but I can't find it n= ow. >=20 >> Is anything logged in the various Mailman, Django, Apache logs? >=20 > Nothing at the time in the Mailman, Mailman web or apache (error or=20 > access) logs, I can't find any Django logs I am afraid. I only have=20 > standard logging, happy to turn any debugging logging that you think=20 > might help The Django log is most likely the one named mailman_web. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe sen= d an email to mailman-users-leave(a)mailman3.org https://lists.mailman3.org/m= ailman3/lists/mailman-users.mailman3.org/ --===============8109977007912042154==-- From dlambert@dereklambert.com Fri Jun 14 20:04:05 2019 From: Derek Lambert To: mailman-users@mailman3.org Subject: [MM3-users] Domain owner functionality? Date: Fri, 14 Jun 2019 15:02:28 -0500 Message-ID: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8344602500103561198==" --===============8344602500103561198== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit I noticed there's a "domain_owners" table in the mailman core database. If I add a user and domain id to this table will it grant the user owner permissions for all lists in a domain? Will they be able to create lists? Thanks! Derek --===============8344602500103561198==-- From maxking@asynchronous.in Fri Jun 14 20:05:34 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Domain owner functionality? Date: Fri, 14 Jun 2019 16:06:59 -0400 Message-ID: <794fedca-c6b8-401e-bd6b-a949a2394a9d@www.fastmail.com> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2699067604052498659==" --===============2699067604052498659== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Fri, Jun 14, 2019, at 4:04 PM, Derek Lambert wrote: > I noticed there's a "domain_owners" table in the mailman core database. If > I add a user and domain id to this table will it grant the user owner > permissions for all lists in a domain? Will they be able to create lists? That is the intention, but hasn't yet been implemented in the UI. Domain owners will have access to all the lists in a domain and will be able to change/edit domain related settings like Templates, Description etc. > > Thanks! > > Derek > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============2699067604052498659==-- From mark@msapiro.net Sat Jun 15 05:27:27 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Rich Text support in Hyperkitty Date: Fri, 14 Jun 2019 22:27:18 -0700 Message-ID: In-Reply-To: <9f8c5371-3b58-40f2-a31f-a750d7c19e0d@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5518659722194915392==" --===============5518659722194915392== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/14/19 11:27 AM, Abhilash Raj wrote: > > The rendering of the above message broke the formatting of only that > line since inline style ended when it encountered a new-line character. > Not to say that it isn't bad. Actually, there was a second backtick on the line that terminated it. I'm not sure if the newline would have in the absence of that. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============5518659722194915392==-- From mark@msapiro.net Sun Jun 16 16:25:48 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Rich Text support in Hyperkitty Date: Sun, 16 Jun 2019 09:25:37 -0700 Message-ID: <27dcb795-124c-74b0-81e0-549d0a4dab45@msapiro.net> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7927316901947161018==" --===============7927316901947161018== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/14/19 10:27 PM, Mark Sapiro wrote: > On 6/14/19 11:27 AM, Abhilash Raj wrote: >> >> The rendering of the above message broke the formatting of only that >> line since inline style ended when it encountered a new-line character. >> Not to say that it isn't bad. > > > Actually, there was a second backtick on the line that terminated it. > I'm not sure if the newline would have in the absence of that. > Just out of `curiosity', I'm going to see if a new line does break the inline style. If it does, the style above should end after 'break the'. If not, we'll see... -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============7927316901947161018==-- From mark@msapiro.net Sun Jun 16 16:39:17 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Rich Text support in Hyperkitty Date: Sun, 16 Jun 2019 09:39:06 -0700 Message-ID: In-Reply-To: <27dcb795-124c-74b0-81e0-549d0a4dab45@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2913727028948027239==" --===============2913727028948027239== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/16/19 9:25 AM, Mark Sapiro wrote: > > Just out of `curiosity', I'm going to see if a new line does break the > inline style. > > If it does, the style above should end after 'break the'. If not, we'll > see... Based on the above as viewed in HyperKitty, it seems even smarter than that. If there is only one, unmatched ` on a line, no style is applied. Testing further. The above line has only one backtick. This `line` has a pair. This `line` has `three. This `line` has `four` backticks. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2913727028948027239==-- From andrew.bernard@gmail.com Tue Jun 18 11:32:19 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Do not show archives to public Date: Tue, 18 Jun 2019 11:32:15 +0000 Message-ID: <156085753546.30455.2640304302314666390@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1434560158191101482==" --===============1434560158191101482== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Is there a way to have list archives only visible to list subscribers? Presen= tly, they are world visible - unless I have configured my site incorrectly. --===============1434560158191101482==-- From maxking@asynchronous.in Tue Jun 18 12:36:59 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Do not show archives to public Date: Tue, 18 Jun 2019 05:36:53 -0700 Message-ID: <5b3ffc31-09cb-4b69-a937-05c3fae28200@www.fastmail.com> In-Reply-To: <156085753546.30455.2640304302314666390@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8632418913791116369==" --===============8632418913791116369== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Tue, Jun 18, 2019, at 4:32 AM, andrew.bernard(a)gmail.com wrote: > Is there a way to have list archives only visible to list subscribers? > Presently, they are world visible - unless I have configured my site > incorrectly. You can set archives to be private in Postorius under Settings -> Archiving -> Private Archives It might take some time for the changes to sync back to Archiver after you have updated the settings. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============8632418913791116369==-- From andrew.bernard@gmail.com Wed Jun 19 00:21:59 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Do not show archives to public Date: Wed, 19 Jun 2019 10:21:45 +1000 Message-ID: In-Reply-To: <5b3ffc31-09cb-4b69-a937-05c3fae28200@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4634302282269579709==" --===============4634302282269579709== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Hi Abhilash, This resulted in dozens of messages about Django errors, when I turned on Private Archives, and then accessed the page. Is that to be expected? [Hard to imagine.] Perhaps you have to wait? But how long typically? Andrew On Tue, 18 Jun 2019 at 22:37, Abhilash Raj wrote: > On Tue, Jun 18, 2019, at 4:32 AM, andrew.bernard(a)gmail.com wrote: > > Is there a way to have list archives only visible to list subscribers? > > Presently, they are world visible - unless I have configured my site > > incorrectly. > > You can set archives to be private in Postorius under > > Settings -> Archiving -> Private Archives > > It might take some time for the changes to sync back to Archiver > after you have updated the settings. > > --===============4634302282269579709==-- From mark@msapiro.net Wed Jun 19 01:23:05 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Do not show archives to public Date: Tue, 18 Jun 2019 18:22:57 -0700 Message-ID: <4c8ddda5-16ba-44a6-7ebd-91ad299c7bdd@msapiro.net> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6708726544133502125==" --===============6708726544133502125== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/18/19 5:21 PM, Andrew Bernard wrote: > > This resulted in dozens of messages about Django errors, when I turned on > Private Archives, and then accessed the page. Is that to be expected? [Hard > to imagine.] Perhaps you have to wait? But how long typically? This is definitely not expected. What are the errors? Including tracebacks from logs if any. As far as waiting is concerned, I think the thing you might be waiting for is the Django sync_mailman job which, if you have set up cron to run the periodic Django jobs, runs daily, but you can run it manually via the Django admin `runjob sync_mailman` command. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============6708726544133502125==-- From nicolas@pettiaux.be Wed Jun 19 04:25:27 2019 From: Nicolas Pettiaux To: mailman-users@mailman3.org Subject: [MM3-users] howto reallow a banned email ? Date: Wed, 19 Jun 2019 06:12:20 +0200 Message-ID: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4379557040395150466==" --===============4379557040395150466== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Hello, By mistake a user has been banned to post to mailman list. How can I allow him not only to post but also to become a member of a list ? I have not found any info on the web, or I have been unable to search correctly. Much thanks, Nicolas -- Nicolas Pettiaux - PhD - nicolas@{educode,pettiaux}.be - Président de Educode asbl Informer, former et susciter la réflexion des acteurs du monde de l'enseignement face aux évolutions d'un monde numérique - http://2019.educode.be & http://2018.educode.be --===============4379557040395150466==-- From mark@msapiro.net Wed Jun 19 04:33:34 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: howto reallow a banned email ? Date: Tue, 18 Jun 2019 21:33:22 -0700 Message-ID: <0154532e-d26a-8754-add9-580e555c36ab@msapiro.net> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0098612859853876326==" --===============0098612859853876326== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/18/19 9:12 PM, Nicolas Pettiaux wrote: > > By mistake a user has been banned to post to mailman list. How can I > allow him not only to post but also to become a member of a list ? > > I have not found any info on the web, or I have been unable to search > correctly. Do you have the Postorius web UI in your installation? If so go to the list's Ban List and remove the unwanted entry. Or is this perhaps a Mailman 2 question? If so you'll find the ban_list in the web admin UI at Privacy options... -> Subscription rules. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0098612859853876326==-- From nicolas@pettiaux.be Wed Jun 19 04:40:16 2019 From: Nicolas Pettiaux To: mailman-users@mailman3.org Subject: [MM3-users] Re: howto reallow a banned email ? Date: Wed, 19 Jun 2019 06:40:11 +0200 Message-ID: <3324e19929fdc712dad35c8dd0e17262@pettiaux.be> In-Reply-To: <0154532e-d26a-8754-add9-580e555c36ab@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0287481526001977390==" --===============0287481526001977390== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit much thanks. I use mailman 2 interface (and will switch soon to 3) i'll look asap. --- Nicolas Pettiaux - PhD - nicolas@{educode,pettiaux}.be - Président de Educode asbl Informer, former et susciter la réflexion des acteurs du monde de l'enseignement face aux évolutions d'un monde numérique - http://2019.educode.be & http://2018.educode.be Le 2019-06-19 6:33, Mark Sapiro a écrit : > On 6/18/19 9:12 PM, Nicolas Pettiaux wrote: >> >> By mistake a user has been banned to post to mailman list. How can I >> allow him not only to post but also to become a member of a list ? >> >> I have not found any info on the web, or I have been unable to search >> correctly. > > > Do you have the Postorius web UI in your installation? If so go to the > list's Ban List and remove the unwanted entry. > > Or is this perhaps a Mailman 2 question? If so you'll find the ban_list > in the web admin UI at Privacy options... -> Subscription rules. --===============0287481526001977390==-- From mark@msapiro.net Wed Jun 19 04:48:46 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: howto reallow a banned email ? Date: Tue, 18 Jun 2019 21:48:34 -0700 Message-ID: <9bf82634-c48c-d3b9-92ff-30e5b1b5c049@msapiro.net> In-Reply-To: <3324e19929fdc712dad35c8dd0e17262@pettiaux.be> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0881646697384272522==" --===============0881646697384272522== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/18/19 9:40 PM, Nicolas Pettiaux wrote: > much thanks. I use mailman 2 interface (and will switch soon to 3) This list is for Mailman 3. The appropriate list for Mailman 2 questions is mailman-users(a)python.org . -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0881646697384272522==-- From nicolas@pettiaux.be Wed Jun 19 05:18:05 2019 From: Nicolas Pettiaux To: mailman-users@mailman3.org Subject: [MM3-users] Re: howto reallow a banned email ? Date: Wed, 19 Jun 2019 07:17:58 +0200 Message-ID: <907440f69ee95b4369baf46985f2b432@pettiaux.be> In-Reply-To: <9bf82634-c48c-d3b9-92ff-30e5b1b5c049@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4260458365434019208==" --===============4260458365434019208== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit Le 2019-06-19 6:48, Mark Sapiro a écrit : > On 6/18/19 9:40 PM, Nicolas Pettiaux wrote: >> much thanks. I use mailman 2 interface (and will switch soon to 3) > > This list is for Mailman 3. > > The appropriate list for Mailman 2 questions is > mailman-users(a)python.org > . much thanks. Sorry ! --===============4260458365434019208==-- From mailman3@malevil.cc Wed Jun 19 11:49:59 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] join via webform Date: Wed, 19 Jun 2019 11:49:56 +0000 Message-ID: <156094499610.22318.5313072750379582424@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6656018562613100847==" --===============6656018562613100847== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Is there a simple possibility to join a mailinglist besider writing a mail to= list-join(a)example.com? I know you can register and then join a list, but t= hats only possible for public lists and I would like to have such a very simp= le webform for a specific list where you just enter your email address and th= en get the confirmation mail. I guess there was something like this with mail= man2 --===============6656018562613100847==-- From mailman3@malevil.cc Wed Jun 19 11:50:47 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] join via webform Date: Wed, 19 Jun 2019 11:50:43 +0000 Message-ID: <156094504347.22320.6371726364676995981@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6269043631042505821==" --===============6269043631042505821== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Is there a simple possibility to join a mailinglist besider writing a mail to= list-join(a)example.com? I know you can register and then join a list, but t= hats only possible for public lists and I would like to have such a very simp= le webform for a specific list where you just enter your email address and th= en get the confirmation mail. I guess there was something like this with mail= man2 --===============6269043631042505821==-- From mark@msapiro.net Wed Jun 19 14:25:51 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: join via webform Date: Wed, 19 Jun 2019 07:25:39 -0700 Message-ID: <8ac18d81-e353-daca-96a0-7cef0cef2e6b@msapiro.net> In-Reply-To: <156094504347.22320.6371726364676995981@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2884229808336793758==" --===============2884229808336793758== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/19/19 4:50 AM, mailman3(a)malevil.cc wrote: > Is there a simple possibility to join a mailinglist besider writing a mail = to list-join(a)example.com? I know you can register and then join a list, but= thats only possible for public lists It is also possible for unadvertised lists. You can go to `lists/list(a)domain` and subscribe even though the list is not advertised. > and I would like to have such a very simple webform for a specific list whe= re you just enter your email address and then get the confirmation mail. I gu= ess there was something like this with mailman2 You can do this by having your web form do the subscription via the REST API. See and . --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2884229808336793758==-- From steven.jones@vuw.ac.nz Thu Jun 20 02:02:21 2019 From: Steven Jones To: mailman-users@mailman3.org Subject: [MM3-users] problems in setting up mailman3 containers. Date: Thu, 20 Jun 2019 01:43:50 +0000 Message-ID: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1036388862883041799==" --===============1036388862883041799== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, Trying to setup the 2 mailman3 containers, they fail to start, config and fai= lure messages are, =3D=3D=3D=3D=3D=3D=3D=3D [root(a)rhel8-svr-001 mailman]# pwd /opt/mailman [root(a)rhel8-svr-001 mailman]# !269 more core/mailman-extra.cfg # mailman-extra.cfg [mta] incoming: mailman.mta.postfix.LMTP outgoing: mailman.mta.deliver.deliver lmtp_host: 172.19.199.2 lmtp_port: 8024 smtp_host: 172.19.199.1 smtp_port: 25 configuration: /etc/postfix-mailman.cfg [mailman] site_owner: steven(a)xx.co.nz SECRET_KEY: testing123 [root(a)rhel8-svr-001 mailman]# !271 more web/settings_local.py SECRET_KEY: testing123 [root(a)rhel8-svr-001 mailman]# !272 podman run mailman-core DATABASE_URL is not defined. Using sqlite database... No MTA environment variable found, defaulting to Exim HYPERKITTY_API_KEY not defined, please set this environment variable... exiting... [root(a)rhel8-svr-001 mailman]# !273 podman run mailman-web SECRET_KEY is not defined. Aborting. [root(a)rhel8-svr-001 mailman]# =3D=3D=3D=3D=3D=3D=3D=3D=3D Could really do with some examples of these files as well... regards Steven --===============1036388862883041799==-- From maxking@asynchronous.in Thu Jun 20 02:52:18 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: problems in setting up mailman3 containers. Date: Wed, 19 Jun 2019 19:52:11 -0700 Message-ID: <0faa7b0f-84e1-487e-abc2-8480df5815d8@www.fastmail.com> In-Reply-To: =?utf-8?q?=3CME2PR01MB4930219975822813334751AED4E40=40ME2PR01MB?= =?utf-8?q?4930=2Eausprd01=2Eprod=2Eoutlook=2Ecom=3E?= MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2208293136981138424==" --===============2208293136981138424== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Wed, Jun 19, 2019, at 7:02 PM, Steven Jones wrote: > Hi, > > > Trying to setup the 2 mailman3 containers, they fail to start, config > and failure messages are, Check the required configuration for container images [1]. [1]: https://github.com/maxking/docker-mailman#configuration > > > ======== > > [root(a)rhel8-svr-001 mailman]# pwd > /opt/mailman > [root(a)rhel8-svr-001 mailman]# !269 > more core/mailman-extra.cfg > # mailman-extra.cfg > > [mta] > incoming: mailman.mta.postfix.LMTP > outgoing: mailman.mta.deliver.deliver > lmtp_host: 172.19.199.2 > lmtp_port: 8024 > smtp_host: 172.19.199.1 > smtp_port: 25 > configuration: /etc/postfix-mailman.cfg > > [mailman] > site_owner: steven(a)xx.co.nz > > SECRET_KEY: testing123 > [root(a)rhel8-svr-001 mailman]# !271 > more web/settings_local.py > SECRET_KEY: testing123 > > [root(a)rhel8-svr-001 mailman]# !272 > podman run mailman-core > DATABASE_URL is not defined. Using sqlite database... > No MTA environment variable found, defaulting to Exim > HYPERKITTY_API_KEY not defined, please set this environment variable... > exiting... > [root(a)rhel8-svr-001 mailman]# !273 > podman run mailman-web > SECRET_KEY is not defined. Aborting. > [root(a)rhel8-svr-001 mailman]# > ========= > > > Could really do with some examples of these files as well... > > > regards > > Steven > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============2208293136981138424==-- From andrew.bernard@gmail.com Thu Jun 20 05:50:16 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Django error - External IP Date: Thu, 20 Jun 2019 05:50:13 +0000 Message-ID: <156100981301.22319.4115806696278025478@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2680658461978869384==" --===============2680658461978869384== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I am seeing this error frequently: Subject: [Django] ERROR (EXTERNAL IP): Internal Server Error: /archives/list/= jackrail(a)list.jackrail.org/message/new Internal Server Error: /archives/list/jackrail(a)list.jackrail.org/message/new Error at /archives/list/jackrail(a)list.jackrail.org/message/new error 14 from memcached_get(:2:User:11:subscriptions) Request Method: GET Request URL: https://list.jackrail.org/archives/list/jackrail(a)list.jackrail= .org/message/new ... followed by many many pages of settings information, none of which is inf= ormative to me. What does this signify? I am trying to bring my list to a go live state, but = this does not bode well. I can send the full diagnostic (long) if need be. Andrew --===============2680658461978869384==-- From andrew.bernard@gmail.com Thu Jun 20 07:01:12 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Django error - External IP Date: Thu, 20 Jun 2019 07:01:09 +0000 Message-ID: <156101406988.22323.17197870664796433892@mailman.iad1.psf.io> In-Reply-To: <156100981301.22319.4115806696278025478@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2361677954973511299==" --===============2361677954973511299== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable OK. I deleted the hyperkitty archive and started again. Now what I see is thi= s: 6:58:48 [Q] INFO Process-1:1 processing [rebuild_thread_cache_votes] 06:58:48 [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching quer= y does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7= .egg/django_q/cluster.py", line 377, in worker res =3D f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3= .7.egg/hyperkitty/tasks.py", line 189, in _rebuild_thread_cache_votes thread =3D Thread.objects.get(id=3Dthread_id) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.e= gg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.e= gg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not = exist. Any ideas? --===============2361677954973511299==-- From andrew.bernard@gmail.com Thu Jun 20 07:10:26 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Flushing/syncing hyperkitty with mailman Date: Thu, 20 Jun 2019 07:10:23 +0000 Message-ID: <156101462329.22320.9935312346982851423@mailman.iad1.psf.io> In-Reply-To: <87wouuzn5y.fsf@ericabrahamsen.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3225986294229034685==" --===============3225986294229034685== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hello Eric, Did you ever solve this? I have the exact same problem. I don't know where to= start looking. --===============3225986294229034685==-- From andrew.bernard@gmail.com Thu Jun 20 09:44:52 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Importing mbox files into hyperkitty since date Date: Thu, 20 Jun 2019 09:44:48 +0000 Message-ID: <156102388801.22319.13378306937332794723@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1656118500892865412==" --===============1656118500892865412== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable What is the syntax for the data in the --since argument to hyperkitty_import> --since SINCE SINCE is not very informative. :-) Guessing, using '1/1/1970' does not seem to achieve anything, and gives no er= ror. --===============1656118500892865412==-- From andrew.bernard@gmail.com Thu Jun 20 10:08:41 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into hyperkitty since date Date: Thu, 20 Jun 2019 10:08:39 +0000 Message-ID: <156102531905.22323.4269278299504369378@mailman.iad1.psf.io> In-Reply-To: <156102388801.22319.13378306937332794723@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6736649979027359364==" --===============6736649979027359364== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Well, reading the hyperkitty command source code, looks like it uses dateutil= .parser, which shoudl read pretty much any date format (?). This is what happens: $ django-admin hyperkitty_import -v 2 -l jackrail(a)list.jackrail.org --since= "2010-01-01 00:00Z" /tmp/jackrail(a)list.jackrail.org-2019-07.mbox=20 CommandError: No such file: 00:00Z Regardless of whether Z for UTC is present or not. --===============6736649979027359364==-- From andrew.bernard@gmail.com Thu Jun 20 10:32:25 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into hyperkitty since date Date: Thu, 20 Jun 2019 10:32:24 +0000 Message-ID: <156102674452.22318.16979858761159740071@mailman.iad1.psf.io> In-Reply-To: <156102531905.22323.4269278299504369378@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8116276721505901990==" --===============8116276721505901990== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Alrighty. It only accepts the YYYY-MM-DD. Not HH:MM or TZ. I'd submit that as a bit of feedback to the developer. Andrew --===============8116276721505901990==-- From andrew.bernard@gmail.com Thu Jun 20 10:51:41 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Hyperkitty Archives - Sidebar years/months Date: Thu, 20 Jun 2019 20:51:32 +1000 Message-ID: <943cd9be-f44b-26d7-1c9f-447b550eaa18@gmail.com> In-Reply-To: <081D3C02-3D91-4829-803D-A79D31936A3C@utsa.edu> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4987209704189435963==" --===============4987209704189435963== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit I am importing 25 years worth of archives from a list I am migrating. I seem to be able to get messages in from a converted Listserv archive format munged to a proper mbox format, and they turn up quite nicely in the all threads view. But with this many years of archives, it would be good to get the side bar panel to update. It does not at present. How do I fix this? Running the usual django-admin commands has no effect, but at least they don't fail. Andrew --===============4987209704189435963==-- From mailman3@malevil.cc Thu Jun 20 14:05:37 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] Re: join via webform Date: Thu, 20 Jun 2019 14:05:34 +0000 Message-ID: <156103953400.22320.8591330734381636445@mailman.iad1.psf.io> In-Reply-To: <8ac18d81-e353-daca-96a0-7cef0cef2e6b@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6279527813951703201==" --===============6279527813951703201== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit thanks, is there something like this for unsubscribng in postorius? --===============6279527813951703201==-- From mailman3@malevil.cc Thu Jun 20 14:10:22 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] change preferred language of list Date: Thu, 20 Jun 2019 14:10:19 +0000 Message-ID: <156103981901.22320.1377399834962641778@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5568579362600655963==" --===============5568579362600655963== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable hey, I am not very experienced with the mailman shell and configuration. I co= nfigured mailman using the mailman.cnf and I know that I can use "mailman con= f" to get all the parameters. But now I would like to change the preferred la= nguage of a list. Because despite I set=20 [mailman] default_language: de even new lists will still have "en" as preferred language. I checked this jus= t by reading the $language variable in a list template. How can I change the = list parameters and how can I make mailman to use the german language files? = I found the files, so I know they exist, but still need to make mailman use t= hem... --===============5568579362600655963==-- From mailman3@malevil.cc Thu Jun 20 14:17:03 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] mass invitation Date: Thu, 20 Jun 2019 14:17:00 +0000 Message-ID: <156104022038.22319.17233333079207898082@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3862487690745006977==" --===============3862487690745006977== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable in postorius there is just the option to make a mass subscription, in mailman= 2 there was also the possibility to just invite users, so they need to click = a link when they really want to join the list. Is this also available in mail= man3/postorius? --===============3862487690745006977==-- From mailman3@malevil.cc Thu Jun 20 15:55:50 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 15:55:47 +0000 Message-ID: <156104614780.22323.12192681699872962812@mailman.iad1.psf.io> In-Reply-To: <156103981901.22320.1377399834962641778@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5318023532006704505==" --===============5318023532006704505== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable ok I managed to change the settings via mmclient like: python3.6 manage.py mmclient >>> m =3D client.get_list('test(a)example.com') >>> m.settings['preferred_language'] =3D 'de' >>> m.settings.save() but I really hope there is a more convenient way to adjust list settings? However, it still does not work, even now where the mailman.cfg setting is se= t to german and also the list settings, there is still the english welcome me= ssage sent by mailman... --===============5318023532006704505==-- From maxking@asynchronous.in Thu Jun 20 16:01:26 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Django error - External IP Date: Thu, 20 Jun 2019 09:01:17 -0700 Message-ID: <56463f05-4f43-4ea4-93fe-1dda5f1d0c1a@www.fastmail.com> In-Reply-To: <156101406988.22323.17197870664796433892@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1426857086634911618==" --===============1426857086634911618== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On Thu, Jun 20, 2019, at 12:01 AM, andrew.bernard(a)gmail.com wrote: > OK. I deleted the hyperkitty archive and started again. Now what I see is t= his: >=20 > 6:58:48 [Q] INFO Process-1:1 processing [rebuild_thread_cache_votes] > 06:58:48 [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread=20 > matching query does not exist. : Traceback (most recent call last): > File=20 > "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7.egg/= django_q/cluster.py", line 377, in worker > res =3D f(*task['args'], **task['kwargs']) > File=20 > "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3.7.eg= g/hyperkitty/tasks.py", line 189, in _rebuild_thread_cache_votes > thread =3D Thread.objects.get(id=3Dthread_id) > File=20 > "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/dj= ango/db/models/manager.py", line 82, in manager_method > return getattr(self.get_queryset(), name)(*args, **kwargs) > File=20 > "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.egg/dj= ango/db/models/query.py", line 399, in get > self.model._meta.object_name > hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query=20 > does not exist. >=20 >=20 > Any ideas? These seem to be queued jobs which came up after you cleared and restarted yo= ur instance. Since the threads don't exist anymore those queued jobs would fa= il with this error. I would say this would be a pretty harmless error. I would need to look more = on how to clean up the queue when cleared the archives. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > --=20 thanks, Abhilash Raj (maxking) --===============1426857086634911618==-- From maxking@asynchronous.in Thu Jun 20 16:02:15 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Flushing/syncing hyperkitty with mailman Date: Thu, 20 Jun 2019 09:02:10 -0700 Message-ID: In-Reply-To: <156101462329.22320.9935312346982851423@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4130144748331456336==" --===============4130144748331456336== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Thu, Jun 20, 2019, at 12:10 AM, andrew.bernard(a)gmail.com wrote: > Hello Eric, > > Did you ever solve this? I have the exact same problem. I don't know > where to start looking. There is a daily cronjob which does this job. If you have setup the cron jobs correctly, they should be working. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============4130144748331456336==-- From maxking@asynchronous.in Thu Jun 20 16:04:54 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Hyperkitty Archives - Sidebar years/months Date: Thu, 20 Jun 2019 09:04:45 -0700 Message-ID: <16b9cbf9-6895-41cd-8961-26fdd3c3e213@www.fastmail.com> In-Reply-To: <943cd9be-f44b-26d7-1c9f-447b550eaa18@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5352407461745552014==" --===============5352407461745552014== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Thu, Jun 20, 2019, at 3:52 AM, Andrew Bernard wrote: > I am importing 25 years worth of archives from a list I am migrating. I > seem to be able to get messages in from a converted Listserv archive > format munged to a proper mbox format, and they turn up quite nicely in > the all threads view. But with this many years of archives, it would be > good to get the side bar panel to update. It does not at present. > I don't exactly get what does do you mean by side bar panel to update? Do you mean on the left or right? What do you see and what do you expect to see? > How do I fix this? > > Running the usual django-admin commands has no effect, but at least they > don't fail. > > Andrew > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============5352407461745552014==-- From maxking@asynchronous.in Thu Jun 20 16:07:13 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: mass invitation Date: Thu, 20 Jun 2019 09:07:03 -0700 Message-ID: <67025243-5a37-4908-a7dd-4d7d72cad414@www.fastmail.com> In-Reply-To: <156104022038.22319.17233333079207898082@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4788833488502304119==" --===============4788833488502304119== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Thu, Jun 20, 2019, at 7:17 AM, mailman3(a)malevil.cc wrote: > in postorius there is just the option to make a mass subscription, in > mailman2 there was also the possibility to just invite users, so they > need to click a link when they really want to join the list. Is this > also available in mailman3/postorius? No, not yet. There is an open issue that I can't dig out right now. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============4788833488502304119==-- From maxking@asynchronous.in Thu Jun 20 16:10:08 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 09:10:02 -0700 Message-ID: In-Reply-To: <156103981901.22320.1377399834962641778@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1782448624374644941==" --===============1782448624374644941== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Thu, Jun 20, 2019, at 7:10 AM, mailman3(a)malevil.cc wrote: > hey, I am not very experienced with the mailman shell and > configuration. I configured mailman using the mailman.cnf and I know > that I can use "mailman conf" to get all the parameters. But now I > would like to change the preferred language of a list. Because despite > I set > > [mailman] default_language: de This should be on two separate lines: [mailman] default_language: de > > even new lists will still have "en" as preferred language. I checked > this just by reading the $language variable in a list template. How can > I change the list parameters and how can I make mailman to use the > german language files? I found the files, so I know they exist, but > still need to make mailman use them... By default, the lists start with a default language of 'en'. You can change the list's default language in the Web UI under Settings -> List Identity -> Preferred Langauge > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============1782448624374644941==-- From mark@msapiro.net Thu Jun 20 20:13:40 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into hyperkitty since date Date: Thu, 20 Jun 2019 13:13:31 -0700 Message-ID: In-Reply-To: <156102531905.22323.4269278299504369378@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1259825741265350520==" --===============1259825741265350520== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/20/19 3:08 AM, andrew.bernard(a)gmail.com wrote: > Well, reading the hyperkitty command source code, looks like it uses dateut= il.parser, which shoudl read pretty much any date format (?). >=20 > This is what happens: >=20 > $ django-admin hyperkitty_import -v 2 -l jackrail(a)list.jackrail.org --sin= ce "2010-01-01 00:00Z" /tmp/jackrail(a)list.jackrail.org-2019-07.mbox=20 >=20 > CommandError: No such file: 00:00Z This appears to be a bug in Django's BaseCommand class which somehow separates '--since "2010-01-01 00:00Z"' into '--since 2010-01-01' and '00:00Z' despite the quotes. As a workaround, you can use '--since "2010-01-01/00:00Z"' which doesn't contain the problematic whitespace and which is acceptable to dateutil.parser.parse(). --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============1259825741265350520==-- From mark@msapiro.net Thu Jun 20 20:28:29 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: join via webform Date: Thu, 20 Jun 2019 13:28:17 -0700 Message-ID: <8dd3d992-56b6-6acc-8a46-3631a1f51f09@msapiro.net> In-Reply-To: <156103953400.22320.8591330734381636445@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0905735240054273117==" --===============0905735240054273117== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/20/19 7:05 AM, mailman3(a)malevil.cc wrote: > thanks, is there something like this for unsubscribng in postorius? If you are a member of list(a)example.com and you go to lists/list(a)example.com in Postorius and log-in if necessary, there is an Unsubscribe button on that page. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0905735240054273117==-- From mark@msapiro.net Thu Jun 20 20:36:42 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: mass invitation Date: Thu, 20 Jun 2019 13:36:29 -0700 Message-ID: <4b2e32b3-5d49-d7a4-d738-ca6f4e4a8885@msapiro.net> In-Reply-To: <67025243-5a37-4908-a7dd-4d7d72cad414@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8043719972188528801==" --===============8043719972188528801== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/20/19 9:07 AM, Abhilash Raj wrote: > > > On Thu, Jun 20, 2019, at 7:17 AM, mailman3(a)malevil.cc wrote: >> in postorius there is just the option to make a mass subscription, in >> mailman2 there was also the possibility to just invite users, so they >> need to click a link when they really want to join the list. Is this >> also available in mailman3/postorius? > > > No, not yet. There is an open issue that I can't dig out right now. The issue is -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============8043719972188528801==-- From mailman3@malevil.cc Thu Jun 20 21:40:28 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 21:40:24 +0000 Message-ID: <156106682479.22323.6548704043445910135@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1415832253054615583==" --===============1415832253054615583== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Abhilash Raj wrote: > > [mailman] default_language: de > > This should be on two separate lines: > [mailman] > default_language: de yes it is indeed, the one-line was just the output of mailman conf :) > change the list's default language in the Web UI under > Settings -> List Identity -> Preferred Langauge sorry what postorius version are you running? there is nothing like that for = me, see: https://share.riseup.net/#dS71TjSihRSrTeZDnBQB1A --===============1415832253054615583==-- From mailman3@malevil.cc Thu Jun 20 21:42:33 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 21:42:29 +0000 Message-ID: <156106694988.22323.14385748825747857840@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0117873714701435947==" --===============0117873714701435947== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable the one-liner was just the output of mailman conf, its correct in the conf fi= le > Settings -> List Identity -> Preferred Langauge sorry what postorius version are you running? there is nothing like that for = me,=20 see: https://share.riseup.net/#dS71TjSihRSrTeZDnBQB1A... --===============0117873714701435947==-- From mark@msapiro.net Thu Jun 20 21:55:30 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 14:55:23 -0700 Message-ID: <7abea41e-dbc0-e36b-1d04-1a740905a490@msapiro.net> In-Reply-To: <156106694988.22323.14385748825747857840@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2337470436834280646==" --===============2337470436834280646== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/20/19 2:42 PM, mailman3(a)malevil.cc wrote: > the one-liner was just the output of mailman conf, its correct in the conf = file >=20 >> Settings -> List Identity -> Preferred Langauge >=20 > sorry what postorius version are you running? there is nothing like that fo= r me,=20 > see: https://share.riseup.net/#dS71TjSihRSrTeZDnBQB1A... It is new. It will be in Postorius 1.2.5 The implementation is at . --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2337470436834280646==-- From mailman3@malevil.cc Thu Jun 20 22:38:55 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 22:38:53 +0000 Message-ID: <156107033313.22319.9885529834641861234@mailman.iad1.psf.io> In-Reply-To: <7abea41e-dbc0-e36b-1d04-1a740905a490@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5364663179214034017==" --===============5364663179214034017== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable ok, thats good, but however, list and mailman are set to "de" but still the e= nglish template is used... --===============5364663179214034017==-- From mark@msapiro.net Fri Jun 21 00:02:00 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Thu, 20 Jun 2019 17:01:51 -0700 Message-ID: <46eb0eae-dc90-64e3-5c1b-797d5572b37f@msapiro.net> In-Reply-To: <156107033313.22319.9885529834641861234@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1535715787945813905==" --===============1535715787945813905== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/20/19 3:38 PM, mailman3(a)malevil.cc wrote: > ok, thats good, but however, list and mailman are set to "de" but still the= english template is used... There does seem to be an issue. I set the preferred_language of a list to 'de' and subscribed an address. The address was sent a confirmation request in German, but upon response, the subsequent "The results of your email commands" message and the list welcome message were in English. The "The results of your email commands" message was in English because it is built dynamically by the command runner and while the messages are i18n'd, there is as yet no German message catalog. However the list welcome message should have used the German template. This appears to be a bug. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============1535715787945813905==-- From andrew.bernard@gmail.com Fri Jun 21 07:57:05 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Importing mbox files into archive defect with lines with From Date: Fri, 21 Jun 2019 07:57:02 +0000 Message-ID: <156110382216.22320.3141128551822346248@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3070810277600076627==" --===============3070810277600076627== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable A curious problem, but seems to be well defined. I am importing mbox format f= iles with 25 years worth of archives in 250 files from a Listserv list into h= yperkitty. All is going swimmingly, except I get lots of partial emails with = sender of None put into the current month, with text that has clearly been tr= uncated. As I look at each one, I see that the line in the imported text is i= mmediately after a line starting with 'From'. Clearly, 'From:' is an RCS-82 h= eader, but 'From ' is not, and yet there is much evidence here that this is m= essing up the import. Is this a known bug? If not, how do I report it? --===============3070810277600076627==-- From andrew.bernard@gmail.com Fri Jun 21 08:22:49 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into archive defect with lines with From Date: Fri, 21 Jun 2019 08:22:46 +0000 Message-ID: <156110536626.22320.4396428321553812353@mailman.iad1.psf.io> In-Reply-To: <156110382216.22320.3141128551822346248@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1402926709014889654==" --===============1402926709014889654== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable My goodness - have just tested with a small Python program. This is a bug in = Python. Parsing a single message mbox with a body line somewhere starting wit= h 'From' breaks it into two fragmentary messages. Wow. Off then to the Python developers world, although I find it hard to believe I= could have found such a thing, yet the evidence is there. --===============1402926709014889654==-- From malcolm.austen@weald.org.uk Fri Jun 21 08:39:04 2019 From: Malcolm Austen To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into archive defect with lines with From Date: Fri, 21 Jun 2019 09:38:59 +0100 Message-ID: In-Reply-To: <156110536626.22320.4396428321553812353@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5260194205661580358==" --===============5260194205661580358== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Fri, 21 Jun 2019 09:22:46 +0100, wrote: > My goodness - have just tested with a small Python program. This is a > bug in Python. Parsing a single message mbox with a body line somewhere > starting with 'From' breaks it into two fragmentary messages. Wow. > > Off then to the Python developers world, although I find it hard to > believe I could have found such a thing, yet the evidence is there. Won't they just tell you that a message body line starting "From " should be escaped as ">From " in the mbox file ..? Malcolm. -- Malcolm Austen --===============5260194205661580358==-- From turnbull.stephen.fw@u.tsukuba.ac.jp Fri Jun 21 09:01:06 2019 From: "Stephen J. Turnbull" To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into archive defect with lines with From Date: Fri, 21 Jun 2019 18:00:59 +0900 Message-ID: <23820.40139.421147.172474@turnbull.sk.tsukuba.ac.jp> In-Reply-To: <156110536626.22320.4396428321553812353@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1348478717820264723==" --===============1348478717820264723== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit andrew.bernard(a)gmail.com writes: > My goodness - have just tested with a small Python program. This is > a bug in Python. Parsing a single message mbox with a body line > somewhere starting with 'From' breaks it into two fragmentary > messages. Wow. Almost certainly not a bug in Python. That's the mbox format. If you're into scatological software analysis, here's one of the best flamers in the business doing his thing on mbox: https://www.jwz.org/doc/content-length.html If you've been shocked by the date on that post, no, *nothing* has changed since then. Jamie explains why. You may be dealing with MTA/MDA software using Content-Length, in which case I'm pretty sure the email package has an option for dealing with it. In that case, you should report an RFE to us and we'll try to figure out how to recognize that file format, and automatically deal with it. If not, the software is too unusual for us to worry about, and we'll help you work around the problem. Regards, --===============1348478717820264723==-- From abbot@monksofcool.net Fri Jun 21 12:06:05 2019 From: Ralph Seichter To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into archive defect with lines with From Date: Fri, 21 Jun 2019 14:05:53 +0200 Message-ID: <875zoz9m8u.fsf@ra.horus-it.com> In-Reply-To: <23820.40139.421147.172474@turnbull.sk.tsukuba.ac.jp> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5848490057585785056==" --===============5848490057585785056== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit * Stephen J. Turnbull: > Almost certainly not a bug in Python. Agreed. > If you've been shocked by the date on that post, no, *nothing* has > changed since then. Jamie explains why. Well, there's https://tools.ietf.org/html/rfc4155 , but the amount of information presented is, as expected, very limited. I like the term "anecdotally documented" in that RFC. ;-) Having had a shot at writing a robust mbox parser/converter myself, I came across numerous different formats/flavours, and frankly "mbox" is best avoided. -Ralph --===============5848490057585785056==-- From mailman3@malevil.cc Fri Jun 21 13:33:02 2019 From: mailman3@malevil.cc To: mailman-users@mailman3.org Subject: [MM3-users] Re: join via webform Date: Fri, 21 Jun 2019 13:32:59 +0000 Message-ID: <156112397988.22319.7344288992768291919@mailman.iad1.psf.io> In-Reply-To: <8dd3d992-56b6-6acc-8a46-3631a1f51f09@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7729795698485546698==" --===============7729795698485546698== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable but that means you have to login first and need a password, ok. That is not v= ery convenient, so I think about setting up a simple (external) form where us= ers can enter their emailaddress and its then used to send a message to list-= leave(a)example.com. --===============7729795698485546698==-- From andrew.bernard@gmail.com Fri Jun 21 13:54:59 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Delete a single email or thread from hyperkitty archive Date: Fri, 21 Jun 2019 13:54:57 +0000 Message-ID: <156112529740.22320.8761848351189777034@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6317151517374145842==" --===============6317151517374145842== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable How can one do this? Raw database access gets you involved in all the usual f= oreign key constraints. I don't know how to make use of this information: https://gitlab.com/mailman/hyperkitty/commit/6e3e6a5270f37543a757d76c0aee1271= a7f850b7 After a very large import of decades of data, I need to delete just one wrong= mail that is corrupt. I think it is a valid case. I could run the import aga= in after fixing the import mbox, but it takes many hours to load. Andrew --===============6317151517374145842==-- From brief-mailman-announce@gateweb.gr Fri Jun 21 16:34:17 2019 From: Tassos Kolydas To: mailman-users@mailman3.org Subject: [MM3-users] Re: Please help - Held message is crashing mailman. Date: Fri, 21 Jun 2019 08:22:53 +0000 Message-ID: <156110537311.22319.3531701644946993858@mailman.iad1.psf.io> In-Reply-To: <06865246-c254-658a-499b-ed305151cc03@king.net.nz> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2097015803903114904==" --===============2097015803903114904== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi, Alex! Did you proceed with the bug report on the ubuntu package?=20 I'd like to upvote your report.=20 I agree it is a very important issue having a crippled mailman3 package on th= e latest LTS of Ubuntu server. Also I'd be very interested if someone has back-ported or PPA sourced 3.2 ve= rsion on ubuntu 18.04 LTS. regards --=20 Dr Tassos Kolydas PhD Musicology, MSc Computer Science National and Kapodistrian University of Athens https://www.kolydart.gr/en/ --===============2097015803903114904==-- From mark@msapiro.net Fri Jun 21 17:41:12 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into archive defect with lines with From Date: Fri, 21 Jun 2019 10:41:02 -0700 Message-ID: <1fbd8071-6dd4-996c-0e59-b157623651e4@msapiro.net> In-Reply-To: <156110382216.22320.3141128551822346248@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0533160626649888417==" --===============0533160626649888417== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/21/19 12:57 AM, andrew.bernard(a)gmail.com wrote: > A curious problem, but seems to be well defined. I am importing mbox format= files with 25 years worth of archives in 250 files from a Listserv list into= hyperkitty. All is going swimmingly, except I get lots of partial emails wit= h sender of None put into the current month, with text that has clearly been = truncated. As I look at each one, I see that the line in the imported text is= immediately after a line starting with 'From'. Clearly, 'From:' is an RCS-82= header, but 'From ' is not, and yet there is much evidence here that this is= messing up the import. >=20 > Is this a known bug? If not, how do I report it? As other responses in this thread have pointed out, it is a well known issue with mbox format in that lines beginning with 'From ' are message separators. There is a (Python 2) script at that will process a mbox and prefix with '>' all lines beginning with 'From ' that don't look like real 'From ' lines or which aren't immediately followed by a line that looks like a valid header line. It isn't perfect because it won't handle a message that contains in it's body a copy of another message containing a Unix From_ line, but it can helm with most unescaped From_ lines. If you want to use that script, replace lines 55 and 56 import paths from Mailman.i18n import C_ with def C_(s): return s --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0533160626649888417==-- From mark@msapiro.net Fri Jun 21 21:07:05 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Delete a single email or thread from hyperkitty archive Date: Fri, 21 Jun 2019 14:06:57 -0700 Message-ID: <78d3fb1a-10f5-ad5c-3c00-88624dd57e94@msapiro.net> In-Reply-To: <156112529740.22320.8761848351189777034@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4393467157638407672==" --===============4393467157638407672== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/21/19 6:54 AM, andrew.bernard(a)gmail.com wrote: > How can one do this? Raw database access gets you involved in all the usual= foreign key constraints. In the HyperKitty thread view there is a link to "Delete this thread". In the message view there is a link to "Delete this message". --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============4393467157638407672==-- From mark@msapiro.net Fri Jun 21 21:45:34 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: join via webform Date: Fri, 21 Jun 2019 14:45:27 -0700 Message-ID: <3aa3ed17-0c1c-2944-ae9c-5b2e54554c0d@msapiro.net> In-Reply-To: <156112397988.22319.7344288992768291919@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4070911965007945248==" --===============4070911965007945248== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/21/19 6:32 AM, mailman3(a)malevil.cc wrote: > but that means you have to login first and need a password, ok. That is not= very convenient, so I think about setting up a simple (external) form where = users can enter their emailaddress and its then used to send a message to lis= t-leave(a)example.com. That would certainly work, but you should ensure that the list's unsubscription_policy is not 'open' so people can't unsubscribe others without their knowledge. The default policy is 'confirm' so it should be OK if you haven't changed it. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============4070911965007945248==-- From andrew.bernard@gmail.com Fri Jun 21 22:55:12 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Importing mbox files into archive defect with lines with From Date: Sat, 22 Jun 2019 08:55:01 +1000 Message-ID: In-Reply-To: <1fbd8071-6dd4-996c-0e59-b157623651e4@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5512612663694420880==" --===============5512612663694420880== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Thanks all for pointing out the limitations of the mbox format, of which I was unaware. It was easy for me to add a line to my preprocessing Python to put a space in front of the From lines in question. I prefer this instead of '>' as that tends to indicate quotation. which would be confusing. Having to mangle the input messages, using a space seems to be the least intrusive. I have imported 25 years of messages, and there were hundreds of occurrences of this. Ironically, the preprocessing has to be done on mbox format archives from Listserv which depart from the rough mbox standard. I was aware of the lack of uniformity of what people think mbox is, but not the >From gotcha. Andrew --===============5512612663694420880==-- From andrew.bernard@gmail.com Sat Jun 22 00:55:19 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Images and rich content in hyperkitty Date: Sat, 22 Jun 2019 00:55:16 +0000 Message-ID: <156116491656.22320.15558197002220003278@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8238255192311626015==" --===============8238255192311626015== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I see discussion about this topic here in July. My immediate interest is that= I had hoped to move from an antique plain-text only list to modern list soft= ware that will support content such as inline images (partly to staunch the f= low of subscribers to facebook, simply to be able to post pictures.) Does hyperkitty support this, and where can one read about that? Andrew --===============8238255192311626015==-- From jbn@forestfield.org Sat Jun 22 03:41:57 2019 From: "J.B. Nicholson" To: mailman-users@mailman3.org Subject: [MM3-users] What is the recommended format for mailbox interchange as files? Date: Fri, 21 Jun 2019 22:38:41 -0500 Message-ID: <663eef80-b39e-92cc-17b7-9ee3ebf26c89@forestfield.org> In-Reply-To: <875zoz9m8u.fsf@ra.horus-it.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4408523980331623581==" --===============4408523980331623581== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Ralph Seichter wrote: > Having had a shot at writing a robust mbox parser/converter myself, I > came across numerous different formats/flavours, and frankly "mbox" is > best avoided. What is the recommended file format for mail archives to share? I ask because I often see mailman mailing list archives available as some format of mbox file. I like this feature. I want to quickly import a bunch of archived messages into my account so that I can read old threads and get more discussion context anytime I need it. --===============4408523980331623581==-- From mark@msapiro.net Sat Jun 22 03:52:10 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: change preferred language of list Date: Fri, 21 Jun 2019 20:52:00 -0700 Message-ID: <25d589fa-98b4-e6ff-3c01-a1dc7e8acec5@msapiro.net> In-Reply-To: <46eb0eae-dc90-64e3-5c1b-797d5572b37f@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7014246804472697747==" --===============7014246804472697747== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/20/19 5:01 PM, Mark Sapiro wrote: > > There does seem to be an issue. I set the preferred_language of a list > to 'de' and subscribed an address. The address was sent a confirmation > request in German, but upon response, the subsequent "The results of > your email commands" message and the list welcome message were in English. > > The "The results of your email commands" message was in English because > it is built dynamically by the command runner and while the messages are > i18n'd, there is as yet no German message catalog. > > However the list welcome message should have used the German template. > This appears to be a bug. Actually the issue is the welcome message is sent in the user's preferred language, not the list's preferred language, and a newly created user has no preferred language so the language defaults to English. See . -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============7014246804472697747==-- From mark@msapiro.net Sat Jun 22 04:45:25 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: What is the recommended format for mailbox interchange as files? Date: Fri, 21 Jun 2019 21:45:16 -0700 Message-ID: <29b51c62-ae32-b170-18b4-213821dfc294@msapiro.net> In-Reply-To: <663eef80-b39e-92cc-17b7-9ee3ebf26c89@forestfield.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3130727155490592964==" --===============3130727155490592964== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On 6/21/19 8:38 PM, J.B. Nicholson wrote: > > What is the recommended file format for mail archives to share? > > I ask because I often see mailman mailing list archives available as > some format of mbox file. I like this feature. I want to quickly import > a bunch of archived messages into my account so that I can read old > threads and get more discussion context anytime I need it. Some flavor of mbox is ubiquitous in the *nix world. The problem with this format is lines in the message body beginning with 'From '. Most modern software that writes mbox format files avoids this problem by somhow mangling such lines. The Python mailbox package will prefix such lines with '>' when writing a message to a mbox. Before Mailman 3, Mailman kept a cumulative archive in mbox format. Even after pipermail was included, the cumulative mbox was normally written and could be used to rebuild the pipermail archive or move the archive elsewhere. The problem is that the Python mailbox package didn't always mangle 'From ' lines in the body, so archive mboxes that go back many years are likely to have problems. A more robust mailbox format which is still a single file is MMDF format. This is similar to mbox with the addition that each message is preceded and followed by a line consisting of exactly four control-A bytes. I.e., there is one such line at the beginning and at the end of the file and two such lines between each message. Mailman 3 uses this format for the mailboxes that accumulate messages for digests. However, lot's of things including HyperKitty's importer and Mailman 2's bin/arch tool require input in mbox format. -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============3130727155490592964==-- From andrew.bernard@gmail.com Sat Jun 22 05:05:29 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: What is the recommended format for mailbox interchange as files? Date: Sat, 22 Jun 2019 15:05:15 +1000 Message-ID: In-Reply-To: <29b51c62-ae32-b170-18b4-213821dfc294@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7171939936545201033==" --===============7171939936545201033== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit That's funny that this should come up, as I have just been asking questions in the list about importing mbox format files into hyperkitty, just yesterday. The archives I needed to import went back 30 years. I thought I found a bug in Python when I discovered that posts that contain '^From' cause the Python mbox library code to choke and throw bogus cut messages. It turns out this is a well known issue with the very loose mbox format, of which there are dozens of species known to science. The problem is solved by mangling the files with a pre-process script. I changed all body text with '^From' to '^ From' and hyperkitty and Python will behave correctly. Not ideal but better than dropping messages from the old archive altogether. This issue could very well go in an FAQ for mailman. Can I add a topic somehow? Many others will hit the same problem. Andrew --===============7171939936545201033==-- From andrew.bernard@gmail.com Sat Jun 22 06:30:50 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Mail not going out Date: Sat, 22 Jun 2019 06:30:48 +0000 Message-ID: <156118504815.22320.17518207722626443308@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5362667407009633732==" --===============5362667407009633732== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable What process handles the sending of the mail out to subscribers? My new installation suddenly stopped sending. Apologies for so many newbie qu= estions. Andrew --===============5362667407009633732==-- From andrew.bernard@gmail.com Sat Jun 22 08:35:53 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: [EXTERNAL]Re: Unable to download attachments from HyperKitty Date: Sat, 22 Jun 2019 08:35:49 +0000 Message-ID: <156119254991.22320.17975516684113555892@mailman.iad1.psf.io> In-Reply-To: <155251341609.27368.9224349390662884566@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7617459526142916812==" --===============7617459526142916812== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hello Derek, Did you solve this? I also have postgres on localhost, and I see the same pro= blem. Andrew --===============7617459526142916812==-- From andrew.bernard@gmail.com Sat Jun 22 11:06:25 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] How to download attachments from hyperkitty Date: Sat, 22 Jun 2019 11:06:22 +0000 Message-ID: <156120158229.22319.5183088310524147852@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5904299852424245796==" --===============5904299852424245796== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Not working - download just waits forever after a few bytes in the browser. Could it be that you have to set hyperkitty to store attachments in the files= ystem, and configure uwsgi to serve them as static files? Is that what the hy= perkitty setting HYPERKITYY_ATTACHMENT_FOLDER is for? If this is so, can anybody show the fragment of uwsgi configuration required? Andrew --===============5904299852424245796==-- From andrew.bernard@gmail.com Sat Jun 22 12:54:11 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: How to download attachments from hyperkitty Date: Sat, 22 Jun 2019 12:54:08 +0000 Message-ID: <156120804851.22318.6256048193875033310@mailman.iad1.psf.io> In-Reply-To: <156120158229.22319.5183088310524147852@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4383324036278581552==" --===============4383324036278581552== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Indeed, this is the answer. Setting HYPERKITTY_ATTACHMENT_FOLDER to a filesys= tem path in settings_local.py allows nginx to serve the file and the download= works. Andrew --===============4383324036278581552==-- From mark@msapiro.net Sat Jun 22 14:16:55 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: What is the recommended format for mailbox interchange as files? Date: Sat, 22 Jun 2019 07:16:40 -0700 Message-ID: <5eb50b84-a5de-84ad-9af1-29d9441d76df@msapiro.net> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0461879243750074898==" --===============0461879243750074898== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/21/19 10:05 PM, Andrew Bernard wrote: >=20 > This issue could very well go in an FAQ for mailman. Can I add a topic > somehow? Many others will hit the same problem. There is a FAQ article at . If you wish to edit that or create a new article, see the first paragraph at about obtaining write permission. There is also some documentation of hyperkitty_import at , the source for which is at . You could create a merge request to update that. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============0461879243750074898==-- From mark@msapiro.net Sat Jun 22 14:40:01 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Mail not going out Date: Sat, 22 Jun 2019 07:39:52 -0700 Message-ID: <9a3a3d81-b059-9df0-0d2a-1f947acca048@msapiro.net> In-Reply-To: <156118504815.22320.17518207722626443308@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7388508157974794375==" --===============7388508157974794375== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/21/19 11:30 PM, andrew.bernard(a)gmail.com wrote: > What process handles the sending of the mail out to subscribers? >=20 > My new installation suddenly stopped sending. Apologies for so many newbie = questions. See Incoming messages are received by Mailman's `lmtp` runner and queued in the `in` queue. They are picked up from there by the `in` runner and processed through a chain of rules and if accepted processed through a pipeline of handlers, one of which will queue the message in the `out` queue. Then the `out` runner will pick up and send the message. Look at logs, particularly mailman.log, and queues and ensure Mailman and all the runners are running. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============7388508157974794375==-- From abbot@monksofcool.net Sat Jun 22 15:32:09 2019 From: Ralph Seichter To: mailman-users@mailman3.org Subject: [MM3-users] Re: What is the recommended format for mailbox interchange as files? Date: Sat, 22 Jun 2019 17:31:58 +0200 Message-ID: <874l4hiqkx.fsf@ra.horus-it.com> In-Reply-To: <663eef80-b39e-92cc-17b7-9ee3ebf26c89@forestfield.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4577862076751340434==" --===============4577862076751340434== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit * J. B. Nicholson: > What is the recommended file format for mail archives to share? Maildir [1] has been around for decades and is widely supported. Other than mbox it stores one email message per file, so there is no problem identifying individual messages. On my servers, incoming mail is delivered to Dovecot (configured to use maildir storage). Users can access via IMAP and Notmuch [2], the latter directly accessing maildir. Notmuch is what I am using right now. In Emacs. Because I can. ;-) BTW, Notmuch does not care much about the directory structure, but attempts to parse and file not explicitly added to an ignore list as email. You can thus add files/directories not strictly adhering to the official structure and Notmuch will happily index them. -Ralph [1] https://en.wikipedia.org/wiki/Maildir [2] https://notmuchmail.org --===============4577862076751340434==-- From maxking@asynchronous.in Sat Jun 22 22:45:55 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Delete a single email or thread from hyperkitty archive Date: Sat, 22 Jun 2019 15:45:48 -0700 Message-ID: <768abd26-728b-46b3-b823-f9530e27fcbd@www.fastmail.com> In-Reply-To: <78d3fb1a-10f5-ad5c-3c00-88624dd57e94@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3415707235751090288==" --===============3415707235751090288== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On Fri, Jun 21, 2019, at 2:07 PM, Mark Sapiro wrote: > On 6/21/19 6:54 AM, andrew.bernard(a)gmail.com wrote: > > How can one do this? Raw database access gets you involved in all the usu= al foreign key constraints. >=20 >=20 > In the HyperKitty thread view there is a link to "Delete this thread". > In the message view there is a link to "Delete this message". Do note that this option is only visible to "Superuser" in Django, i.e. Admin= accounts. >=20 > --=20 > Mark Sapiro The highway is for gamblers, > San Francisco Bay Area, California better use your sense - B. Dylan > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > --=20 thanks, Abhilash Raj (maxking) --===============3415707235751090288==-- From maxking@asynchronous.in Sat Jun 22 22:50:58 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Images and rich content in hyperkitty Date: Sat, 22 Jun 2019 15:50:54 -0700 Message-ID: <3090b573-3d60-45d9-997d-433dd48b48fa@www.fastmail.com> In-Reply-To: <156116491656.22320.15558197002220003278@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4028924922921856488==" --===============4028924922921856488== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Fri, Jun 21, 2019, at 5:55 PM, andrew.bernard(a)gmail.com wrote: > I see discussion about this topic here in July. My immediate interest > is that I had hoped to move from an antique plain-text only list to > modern list software that will support content such as inline images > (partly to staunch the flow of subscribers to facebook, simply to be > able to post pictures.) > > Does hyperkitty support this, and where can one read about that? This support is under works and there are some corner cases that needs to be fixed before it gets merged. See my MR[1] that implements this feature in Hyperkitty. Support for inline image is currently disabled by default but can be enabled with a setting that an administrator can change. There is documentation in that MR about kind of syntax is supported, which to summarize is a subset of Markdown syntax. [1]: https://gitlab.com/mailman/hyperkitty/merge_requests/160 > > Andrew > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============4028924922921856488==-- From andrew.bernard@gmail.com Sun Jun 23 14:01:08 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Unwanted indent on first line of post in hyperkiity Date: Sun, 23 Jun 2019 14:01:04 +0000 Message-ID: <156129846479.30974.686290454408552154@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============9006338661650068078==" --===============9006338661650068078== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I don't want hyperkiitty adding an unasked for indent on the first line of al= l posts. How can one turn that off? Andrew --===============9006338661650068078==-- From andrew.bernard@gmail.com Sun Jun 23 14:24:43 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Confirmation for subscriptions Date: Sun, 23 Jun 2019 14:24:40 +0000 Message-ID: <156129988006.30973.3504530308051474505@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1845223226754706599==" --===============1845223226754706599== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Suddenly stopped working. For all the lists I have created, suddenly the conf= irm setting is ignored for subscriptions and users are subscribed right away. This only happened after I added another domain - surely that can't be the ca= use? Where to look to troubleshoot this? Andrew --===============1845223226754706599==-- From mark@msapiro.net Sun Jun 23 17:21:27 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Unwanted indent on first line of post in hyperkiity Date: Sun, 23 Jun 2019 10:21:17 -0700 Message-ID: <535f0758-0d77-724e-d566-fe6918e63a1c@msapiro.net> In-Reply-To: <156129846479.30974.686290454408552154@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1601635419067020502==" --===============1601635419067020502== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/23/19 7:01 AM, andrew.bernard(a)gmail.com wrote: > I don't want hyperkiitty adding an unasked for indent on the first line of = all posts. How can one turn that off? This is probably fixed by which is not yet merged but is installed for this list, so see for example . --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============1601635419067020502==-- From mark@msapiro.net Sun Jun 23 18:06:20 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Confirmation for subscriptions Date: Sun, 23 Jun 2019 11:06:13 -0700 Message-ID: In-Reply-To: <156129988006.30973.3504530308051474505@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6450715839813949109==" --===============6450715839813949109== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/23/19 7:24 AM, andrew.bernard(a)gmail.com wrote: > Suddenly stopped working. For all the lists I have created, suddenly the co= nfirm setting is ignored for subscriptions and users are subscribed right awa= y. I assume you are looking at the Postorius List Settings -> Subscription Policy. That should reflect the setting in core. How are these users requesting subscription/being subscribed? > This only happened after I added another domain - surely that can't be the = cause? Unlikely, but not impossible. > Where to look to troubleshoot this? You could use `mailman shell` to examine the setting in Mailman core, but it's unlikely that would be different from what Postorius shows. Other than that, you can look in logs, but there is not very much logged for the subscription workflow. To be more help, I'd like to know exactly when this happens. First, for Postorius Mass subscribe, this is expected. Other than that, does it happen on email to the list-join address? Does it happen with subscription via the form on the Postorius list Info page? Is it possible the user has a 'vacation' program that is responding to the confirmation request? See (we should fix that) --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============6450715839813949109==-- From andrew.bernard@gmail.com Sun Jun 23 22:28:58 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Confirmation for subscriptions Date: Mon, 24 Jun 2019 08:28:43 +1000 Message-ID: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5435999801154895148==" --===============5435999801154895148== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Hi Mark, Happens for any user subscribing by web or email. Setting to 'Moderate' works fine. Andrew On Mon, 24 Jun 2019 at 04:06, Mark Sapiro wrote: > On 6/23/19 7:24 AM, andrew.bernard(a)gmail.com wrote: > > Suddenly stopped working. For all the lists I have created, suddenly the > confirm setting is ignored for subscriptions and users are subscribed right > away. > > > I assume you are looking at the Postorius List Settings -> Subscription > Policy. That should reflect the setting in core. > > How are these users requesting subscription/being subscribed? > > > --===============5435999801154895148==-- From andrew.bernard@gmail.com Mon Jun 24 02:11:52 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Confirmation for subscriptions Date: Mon, 24 Jun 2019 02:11:50 +0000 Message-ID: <156134231029.24112.16049035431479153164@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5853161964405913810==" --===============5853161964405913810== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I have had some trouble with uwsgi, now resolved. Not that there may be any c= onnection, but now, email requests to join are sent a confirmation mail, but = the webui just signs you up with no confirmation despite having the subscript= ion policy set to Confirm, and the right code in the database table underneat= h. Not sure where to look to debug this. I don't want to live with Open subscrip= tion policy. Worth noting that Moderate works fine. --===============5853161964405913810==-- From mark@msapiro.net Mon Jun 24 02:28:32 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Confirmation for subscriptions Date: Sun, 23 Jun 2019 19:28:21 -0700 Message-ID: <2ff9da74-a170-b48b-bdf3-ae95c0c6ad8d@msapiro.net> In-Reply-To: <156134231029.24112.16049035431479153164@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2005752388909750526==" --===============2005752388909750526== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/23/19 7:11 PM, andrew.bernard(a)gmail.com wrote: > I have had some trouble with uwsgi, now resolved. Not that there may be any= connection, but now, email requests to join are sent a confirmation mail, bu= t the webui just signs you up with no confirmation despite having the subscri= ption policy set to Confirm, and the right code in the database table underne= ath. Is this a web subscribe for a logged in user or and "anonymous subscribe" for a non-logged in user or both? --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2005752388909750526==-- From dlambert@dereklambert.com Mon Jun 24 13:11:10 2019 From: Derek Lambert To: mailman-users@mailman3.org Subject: [MM3-users] Re: Unable to download attachments from HyperKitty Date: Mon, 24 Jun 2019 08:10:56 -0500 Message-ID: In-Reply-To: <156119254991.22320.17975516684113555892@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4225695921191758824==" --===============4225695921191758824== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit I'm still patching HyperKitty in my container to work around it. sed -i 's/return self.content/return self.content.tobytes()/' venv/lib/python3.6/site-packages/hyperkitty/models/email.py Spent some time trying to determine if the issue was in Django, psycopg2, or HyperKitty, but ended up putting it aside to work on other things. Has it ever worked for you with postgres? On Sat, Jun 22, 2019 at 3:36 AM wrote: > Hello Derek, > > Did you solve this? I also have postgres on localhost, and I see the same > problem. > > Andrew > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > --===============4225695921191758824==-- From mark@msapiro.net Mon Jun 24 20:36:23 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Confirmation for subscriptions Date: Mon, 24 Jun 2019 13:36:10 -0700 Message-ID: In-Reply-To: <2ff9da74-a170-b48b-bdf3-ae95c0c6ad8d@msapiro.net> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============5217432552512702150==" --===============5217432552512702150== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/23/19 7:28 PM, Mark Sapiro wrote: > On 6/23/19 7:11 PM, andrew.bernard(a)gmail.com wrote: >> I have had some trouble with uwsgi, now resolved. Not that there may be an= y connection, but now, email requests to join are sent a confirmation mail, b= ut the webui just signs you up with no confirmation despite having the subscr= iption policy set to Confirm, and the right code in the database table undern= eath. >=20 >=20 > Is this a web subscribe for a logged in user or and "anonymous > subscribe" for a non-logged in user or both? I have done some further investigation. With subscribe policy 'confirm': A person without an account can subscribe to a list anonymously. The person is sent an email requesting confirmation of her address and intent to subscribe. Replying to the email confirms the address and subscribes it. A person can sign up for an account with an email address. This results in an email request to the address with a link to confirm it. Following the link and confirming the address then creates the account with the confirmed address. Subsequently, the user can log in and subscribe to the list without further confirmation because the user has already confirmed the address and has logged in, so further confirmation is not required. If subscribe policy is 'moderate', both of the above cases send the request to the moderator for approval. I think this behavior, particularly allowing a logged in user with a confirmed address to subscribe without further confirmation, is reasonable. Is this what you see, or are you seeing something else. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============5217432552512702150==-- From turnbull.stephen.fw@u.tsukuba.ac.jp Tue Jun 25 09:48:23 2019 From: "Stephen J. Turnbull" To: mailman-users@mailman3.org Subject: [MM3-users] What is the recommended format for mailbox interchange as files? Date: Tue, 25 Jun 2019 18:48:17 +0900 Message-ID: <23825.60897.495924.295302@turnbull.sk.tsukuba.ac.jp> In-Reply-To: <663eef80-b39e-92cc-17b7-9ee3ebf26c89@forestfield.org> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8066929453330602194==" --===============8066929453330602194== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit J.B. Nicholson writes: > Ralph Seichter wrote: > > Having had a shot at writing a robust mbox parser/converter myself, I > > came across numerous different formats/flavours, and frankly "mbox" is > > best avoided. > > What is the recommended file format for mail archives to share? This depends on requirements you haven't stated. If you have a "From munging" mail system that creates mboxes, your messages are already From-munged, and there's little point in going beyond the traditional ^From_-delimited mbox, which is quite safe and universally understood. (Unless for the sake of prettification you're willing to clean up the munged Froms pretty much by hand, as they sometimes can't be distinguished from quoting, and the fact that they're often quoted makes finding them non-trivial, too. Then go ahead, and when done use a reliable format.) If you have a message-at-a-time system (as Mailman does, since it receives messages over a pipe -- Mailman 2, or LMTP -- Mailman 3), you have at least two good choices for single-file distribution: - MMDF - put it in a maildir and zip it up (for maximum portability; obviously if you know the target host(s), tar + compressor du jour is good too) and one mediocre (but in some sense portable) one: - From-munged mbox Obviously MMDF and mbox can be compressed if you like. Note that both MMDF and maildir can be considered message-at-a-time, and each converted to the other. How you sort the stream is up to you, again depending on unstated requirements. All of the above are widely understood by MUAs, and easily interconverted. If you have some other format, such as Content-Length, it's best to convert to one of the reliable (ie, well-defined and usually correctly implemented) ones, maildir or MMDF. There are other reliable formats, such as Babyl as used by Emacs's RMail MUA, but simple is best. Steve --===============8066929453330602194==-- From andrew.bernard@gmail.com Tue Jun 25 13:23:46 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Monthly job failure Date: Tue, 25 Jun 2019 13:23:44 +0000 Message-ID: <156146902433.24114.14631506402525470973@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8946346167932463337==" --===============8946346167932463337== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I see this error oin startup: 3:22:11 [Q] INFO Process-1:1 processing [rebuild_mailinglist_cache_for_month] 13:22:11 [Q] ERROR Failed [rebuild_mailinglist_cache_for_month] - MailingList= matching query does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7= .egg/django_q/cluster.py", line 377, in worker res =3D f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3= .7.egg/hyperkitty/tasks.py", line 79, in _rebuild_mailinglist_cache_for_month mlist =3D MailingList.objects.get(name=3Dmlist_name) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.e= gg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.e= gg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.mailinglist.MailingList.DoesNotExist: MailingList matching = query does not exist. Latest build versions of everything. Any pointers? Andrew --===============8946346167932463337==-- From andrew.bernard@gmail.com Tue Jun 25 13:51:38 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Tue, 25 Jun 2019 13:51:36 +0000 Message-ID: <156147069631.24114.6034411074152837805@mailman.iad1.psf.io> In-Reply-To: <156146902433.24114.14631506402525470973@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1509748422565277628==" --===============1509748422565277628== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Is there some way to add debug log statements into the offending code? Knowin= g the list name causing the problem would be a big help. Andrew --===============1509748422565277628==-- From andrew.bernard@gmail.com Tue Jun 25 14:49:09 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Tue, 25 Jun 2019 14:49:06 +0000 Message-ID: <156147414676.24114.4838350375874474771@mailman.iad1.psf.io> In-Reply-To: <156146902433.24114.14631506402525470973@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7340904516083678229==" --===============7340904516083678229== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit I am running all the cron jobs, by the way. This one fails. --===============7340904516083678229==-- From maxking@asynchronous.in Tue Jun 25 16:37:11 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Tue, 25 Jun 2019 09:37:05 -0700 Message-ID: In-Reply-To: <156147414676.24114.4838350375874474771@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7323807561382358511==" --===============7323807561382358511== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Tue, Jun 25, 2019, at 7:49 AM, andrew.bernard(a)gmail.com wrote: > I am running all the cron jobs, by the way. This one fails. Did you delete some MailingLists after you created them? This seems to be coming from routine jobs which for some reason are running for mailing lists that have been deleted. > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============7323807561382358511==-- From andrew.bernard@gmail.com Tue Jun 25 23:08:47 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Tue, 25 Jun 2019 23:08:43 +0000 Message-ID: <156150412340.24110.4061041640658731951@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4488765300555591625==" --===============4488765300555591625== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Yes I did. So something is out of sync, the job are referring to lists no lon= ger existing. What is this? Andrew --===============4488765300555591625==-- From mark@msapiro.net Tue Jun 25 23:50:48 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Tue, 25 Jun 2019 16:50:35 -0700 Message-ID: In-Reply-To: <156150412340.24110.4061041640658731951@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2811560502653781100==" --===============2811560502653781100== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/25/19 4:08 PM, andrew.bernard(a)gmail.com wrote: > Yes I did. So something is out of sync, the job are referring to lists no l= onger existing. What is this? I'm confused. The subject of this thread is 'Monthly job failure', but your original post said 'I see this error on startup:' Perhaps you are confused in that the error occurs in 'rebuild_mailinglist_cache_for_month'. That is not a monthly job. That is a queued task to rebuild the cached data for a particular 'by month' view. That task is queued whenever a post is added to update the monthly cache for the year and month of the date of the post, and whenever a thread is deleted to update the monthly cache for the year and month of the date the thread was active. I'm guessing here, but I think you have a task queued for a list that no longer exists in HyperKitty. Go to the Django web admin and look at the DJANGO Q section, particularly Queued tasks, but maybe the others too. Maybe there's a task you can delete. --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2811560502653781100==-- From steven.jones@vuw.ac.nz Wed Jun 26 00:56:37 2019 From: Steven Jones To: mailman-users@mailman3.org Subject: [MM3-users] SECRET_KEY is not defined. Aborting. Date: Wed, 26 Jun 2019 00:52:16 +0000 Message-ID: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6976832873019932721==" --===============6976832873019932721== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable 8><--- root(a)debian-mailman-001:/opt/mailman/docker-mailman# docker run maxking/mai= lman-web:0.2 SECRET_KEY is not defined. Aborting. root(a)debian-mailman-001:/opt/mailman/docker-mailman# 8><--- I keep getting this, I have attempted to set a SECRET_KEY in /opt/mailman/web/settings_local.py and, docker-compose.yaml No joy, can you tell me how I set this variable? or where I get it from? is i= t pre-generated somewhere? your documentation just does not explain this tha= t I can find, despite even a lot of time googling. PS I have assumed the hyprekitty key is something I set myself, just like a m= anual password sort of thing, again there is no explanation I can find that e= xplains how to do this properly either. Can this documentation be improved please. To get anywhere at all I finally found this, https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ So I have core running OK I think, =3D=3D=3D=3D=3D=3D root(a)debian-mailman-001:/opt/mailman/docker-mailman# docker ps CONTAINER ID IMAGE COMMAND CREAT= ED STATUS PORTS NAMES 99f434ef3664 maxking/mailman-core:0.2 "docker-entrypoint.s=E2=80=A6"= 2 hours ago Up About an hour 8001/tcp, 8024/tcp mailman-core 4c0e165d3a90 postgres:9.6-alpine "docker-entrypoint.s=E2=80=A6"= 2 hours ago Up About an hour 5432/tcp dockermailman= _database_1 root(a)debian-mailman-001:/opt/mailman/docker-mailman# =3D=3D=3D=3D=3D=3D regards Steven --===============6976832873019932721==-- From maxking@asynchronous.in Wed Jun 26 00:58:55 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: SECRET_KEY is not defined. Aborting. Date: Tue, 25 Jun 2019 17:58:47 -0700 Message-ID: <66bd6566-ad10-425d-b6f6-21075e276ee9@www.fastmail.com> In-Reply-To: =?utf-8?q?=3CME2PR01MB49302716A7D081A9F9FD7EC6D4E20=40ME2PR01MB?= =?utf-8?q?4930=2Eausprd01=2Eprod=2Eoutlook=2Ecom=3E?= MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0830488004882066457==" --===============0830488004882066457== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit On Tue, Jun 25, 2019, at 5:56 PM, Steven Jones wrote: > 8><--- > root(a)debian-mailman-001:/opt/mailman/docker-mailman# docker run > maxking/mailman-web:0.2 > SECRET_KEY is not defined. Aborting. > root(a)debian-mailman-001:/opt/mailman/docker-mailman# > 8><--- > > > I keep getting this, I have attempted to set a SECRET_KEY in > > > /opt/mailman/web/settings_local.py > > > and, > > > docker-compose.yaml Did you set it under mailman-web -> environment? That is where you need to set that value. > > > No joy, can you tell me how I set this variable? or where I get it > from? is it pre-generated somewhere? your documentation just does not > explain this that I can find, despite even a lot of time googling. It is not autogenerate, you neeed to generate a random value and put it there manually. > > > PS I have assumed the hyprekitty key is something I set myself, just > like a manual password sort of thing, again there is no explanation I > can find that explains how to do this properly either. > > > Can this documentation be improved please. > > > To get anywhere at all I finally found this, > > > https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ > > > So I have core running OK I think, > > > ====== > > root(a)debian-mailman-001:/opt/mailman/docker-mailman# docker ps > CONTAINER ID IMAGE COMMAND > CREATED STATUS PORTS NAMES > 99f434ef3664 maxking/mailman-core:0.2 "docker-entrypoint.s…" > 2 hours ago Up About an hour 8001/tcp, 8024/tcp > mailman-core > 4c0e165d3a90 postgres:9.6-alpine "docker-entrypoint.s…" > 2 hours ago Up About an hour 5432/tcp > dockermailman_database_1 > root(a)debian-mailman-001:/opt/mailman/docker-mailman# > ====== > > > > > regards > > Steven > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============0830488004882066457==-- From steven.jones@vuw.ac.nz Wed Jun 26 01:48:16 2019 From: Steven Jones To: mailman-users@mailman3.org Subject: [MM3-users] Re: SECRET_KEY is not defined. Aborting. Date: Wed, 26 Jun 2019 01:48:06 +0000 Message-ID: In-Reply-To: <66bd6566-ad10-425d-b6f6-21075e276ee9@www.fastmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6636243594464619043==" --===============6636243594464619043== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable This is the part from the file as below, root(a)debian-mailman-001:/opt/mailman/docker-mailman# vi docker-compose.yaml =3D=3D=3D=3D=3D=3D=3D 8><---- mailman-web: image: maxking/mailman-web:0.2 container_name: mailman-web hostname: mailman-web depends_on: - database links: - mailman-core:mailman-core - database:database volumes: - /opt/mailman/web:/opt/mailman-web-data environment: - DATABASE_TYPE=3Dpostgres - DATABASE_URL=3Dpostgres://mailman:mailmanpass(a)database/mailmandb - HYPERKITTY_API_KEY=3Dblah-blah-hyper - SECRET_KEY=3Dblah-blah-secret - SERVE_FROM_DOMAIN=3Dlists.xxxxxxxx networks: mailman: ipv4_address: 172.19.199.3 8><=3D=3D=3D=3D=3D regards Steven ________________________________ From: Abhilash Raj Sent: Wednesday, 26 June 2019 12:58 PM To: Mailman users Subject: [MM3-users] Re: SECRET_KEY is not defined. Aborting. On Tue, Jun 25, 2019, at 5:56 PM, Steven Jones wrote: > 8><--- > root(a)debian-mailman-001:/opt/mailman/docker-mailman# docker run > maxking/mailman-web:0.2 > SECRET_KEY is not defined. Aborting. > root(a)debian-mailman-001:/opt/mailman/docker-mailman# > 8><--- > > > I keep getting this, I have attempted to set a SECRET_KEY in > > > /opt/mailman/web/settings_local.py > > > and, > > > docker-compose.yaml Did you set it under mailman-web -> environment? That is where you need to set that value. > > > No joy, can you tell me how I set this variable? or where I get it > from? is it pre-generated somewhere? your documentation just does not > explain this that I can find, despite even a lot of time googling. It is not autogenerate, you neeed to generate a random value and put it there manually. > > > PS I have assumed the hyprekitty key is something I set myself, just > like a manual password sort of thing, again there is no explanation I > can find that explains how to do this properly either. > > > Can this documentation be improved please. > > > To get anywhere at all I finally found this, > > > https://apc01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fxiaoxin= g.us%2F2018%2F01%2F01%2Fdeploy-mailman-3-on-aws-using-docker%2F&data=3D02= %7C01%7Csteven.jones%40vuw.ac.nz%7Cdb577a0bfaff4290c8a208d6f9d18a47%7Ccfe63e2= 36951427e8683bb84dcf1d20c%7C0%7C0%7C636971075751629134&sdata=3DkzRKONPJHx= 3hjN88BiP%2F41o1g41X9qq3mAEMe5LP5BQ%3D&reserved=3D0 > > > So I have core running OK I think, > > > =3D=3D=3D=3D=3D=3D > > root(a)debian-mailman-001:/opt/mailman/docker-mailman# docker ps > CONTAINER ID IMAGE COMMAND > CREATED STATUS PORTS NAMES > 99f434ef3664 maxking/mailman-core:0.2 "docker-entrypoint.s=E2=80= =A6" > 2 hours ago Up About an hour 8001/tcp, 8024/tcp > mailman-core > 4c0e165d3a90 postgres:9.6-alpine "docker-entrypoint.s=E2=80= =A6" > 2 hours ago Up About an hour 5432/tcp > dockermailman_database_1 > root(a)debian-mailman-001:/opt/mailman/docker-mailman# > =3D=3D=3D=3D=3D=3D > > > > > regards > > Steven > > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://apc01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Flists.m= ailman3.org%2Fmailman3%2Flists%2Fmailman-users.mailman3.org%2F&data=3D02%= 7C01%7Csteven.jones%40vuw.ac.nz%7Cdb577a0bfaff4290c8a208d6f9d18a47%7Ccfe63e23= 6951427e8683bb84dcf1d20c%7C0%7C0%7C636971075751629134&sdata=3DtyJ0xNbrRBZ= tCtnPNGopztRA3Rh8UxVc%2FPHHWnq5H2c%3D&reserved=3D0 > -- thanks, Abhilash Raj (maxking) _______________________________________________ Mailman-users mailing list -- mailman-users(a)mailman3.org To unsubscribe send an email to mailman-users-leave(a)mailman3.org https://apc01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Flists.mai= lman3.org%2Fmailman3%2Flists%2Fmailman-users.mailman3.org%2F&data=3D02%7C= 01%7Csteven.jones%40vuw.ac.nz%7Cdb577a0bfaff4290c8a208d6f9d18a47%7Ccfe63e2369= 51427e8683bb84dcf1d20c%7C0%7C0%7C636971075751629134&sdata=3DtyJ0xNbrRBZtC= tnPNGopztRA3Rh8UxVc%2FPHHWnq5H2c%3D&reserved=3D0 --===============6636243594464619043==-- From andrew.bernard@gmail.com Wed Jun 26 09:46:05 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Wed, 26 Jun 2019 09:46:02 +0000 Message-ID: <156154236246.24110.9882497535614659145@mailman.iad1.psf.io> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1658546136455833095==" --===============1658546136455833095== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Hi Mark. Indeed, I am confused. I am not yet familiar with Hyperkiity interna= ls and code, and I must say it is currently like fog to me. :-) Indeed, rebuild_mailinglist_cache_for_month made me think this was a monthly = job. I had made some lists and deleted them shortly thereafter. I managed to add s= ome lines likes raise Exception(locals()) in some of the code, which revealed= that a deleted list was being referred to. I have no idea how to purge this.= I looked everywhere in every table in the database to find references to the= deleted table, to no avail. I deleted all the queued, jobs in Django, to no = avail. I rebooted three times to no avail (highly unscientific), And now, for= no obvious reason, the error has stopped appearing. it definitely did not st= op after deleting Django queued jobs - although perhaps something takes time = to propagate, or there is something stuck cached in RAM? It's nice that it stopped but I feel a bit uncomfortable that creating a lis= t and deleting it a couple of hours later can cause the log to fill up every = minute with these tracebacks. The exception raised in the code simply says . It would be great if the error cou= ld name the list. I think that would be helpful. It would make it clearer to = people what is happening at least, a lot faster. Python tracebacks don't show= the values of local variables, unfortunately. Andrew --===============1658546136455833095==-- From andrew.bernard@gmail.com Wed Jun 26 10:08:27 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Reset digest number and volume Date: Wed, 26 Jun 2019 10:08:24 +0000 Message-ID: <156154370436.24116.13721337761448897251@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============0119414677557020847==" --===============0119414677557020847== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable How to do this? After lots of testing on my pre-release beta testing list, I = want the first production digest to be reset toVolume 1, Number 1. Andrew --===============0119414677557020847==-- From mark@msapiro.net Wed Jun 26 13:49:37 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Reset digest number and volume Date: Wed, 26 Jun 2019 06:49:24 -0700 Message-ID: In-Reply-To: <156154370436.24116.13721337761448897251@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2874125453864436700==" --===============2874125453864436700== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/26/19 3:08 AM, andrew.bernard(a)gmail.com wrote: > How to do this? After lots of testing on my pre-release beta testing list, = I want the first production digest to be reset toVolume 1, Number 1. You can do this in `mailman shell` by setting the list's `volume` and `next_digest_number` to 1. E.g., $ ./mailman shell -l list(a)example.com Welcome to the GNU Mailman shell The variable 'm' is the list(a)example.com mailing list >>> m.volume =3D 1 >>> m.next_digest_number =3D 1 >>> commit() --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============2874125453864436700==-- From maxking@asynchronous.in Wed Jun 26 16:08:24 2019 From: Abhilash Raj To: mailman-users@mailman3.org Subject: [MM3-users] Re: Monthly job failure Date: Wed, 26 Jun 2019 09:08:19 -0700 Message-ID: In-Reply-To: <156154236246.24110.9882497535614659145@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8674813545070669788==" --===============8674813545070669788== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit On Wed, Jun 26, 2019, at 2:46 AM, andrew.bernard(a)gmail.com wrote: > Hi Mark. Indeed, I am confused. I am not yet familiar with Hyperkiity > internals and code, and I must say it is currently like fog to me. :-) > > Indeed, rebuild_mailinglist_cache_for_month made me think this was a > monthly job. > > I had made some lists and deleted them shortly thereafter. I managed to > add some lines likes raise Exception(locals()) in some of the code, > which revealed that a deleted list was being referred to. I have no > idea how to purge this. I looked everywhere in every table in the > database to find references to the deleted table, to no avail. I > deleted all the queued, jobs in Django, to no avail. I rebooted three > times to no avail (highly unscientific), And now, for no obvious > reason, the error has stopped appearing. it definitely did not stop > after deleting Django queued jobs - although perhaps something takes > time to propagate, or there is something stuck cached in RAM? > > It's nice that it stopped but I feel a bit uncomfortable that creating > a list and deleting it a couple of hours later can cause the log to > fill up every minute with these tracebacks. The exception raised in the > code simply says . It would > be great if the error could name the list. I think that would be > helpful. It would make it clearer to people what is happening at least, > a lot faster. Python tracebacks don't show the values of local > variables, unfortunately. The delete functionality isn't completely implemented yet and part of the problem lies in the way MailingList, Thread and Email objects are created in Hyperkitty. What you need to know is that once a MailingList has been created, several (routine and event based) tasks are added up in a queue. If at the time those tasks are ready to be executed, the mailinglist has gone away, it prints those errors. IMO, it is mostly harmless, but I can see so much of errors in logs would be worrisome to users. Right now, errors are logged unconditionally, but it is possible to filter them to skip `MailingList does not exist errors` altogether. Ofcourse, that is not the ideal solution, but I think it should at least stop the exceptions from being logged when us or the user can't do anything about it. > > Andrew > _______________________________________________ > Mailman-users mailing list -- mailman-users(a)mailman3.org > To unsubscribe send an email to mailman-users-leave(a)mailman3.org > https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ > -- thanks, Abhilash Raj (maxking) --===============8674813545070669788==-- From andrew.bernard@gmail.com Fri Jun 28 10:19:09 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Show number of subscribers Date: Fri, 28 Jun 2019 10:19:05 +0000 Message-ID: <156171714542.7500.17772580836979653275@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7319195347918147756==" --===============7319195347918147756== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Would there be a way to show the number of subscribers to a list in the web U= I? The number of participants per message is great, but this would be good too. = My users seem very interested in this number. I guess they want to know how b= ig the audience is that is reading their posts. Andrew --===============7319195347918147756==-- From mark@msapiro.net Fri Jun 28 16:11:27 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Show number of subscribers Date: Fri, 28 Jun 2019 09:11:17 -0700 Message-ID: In-Reply-To: <156171714542.7500.17772580836979653275@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============6547055989418328067==" --===============6547055989418328067== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable On 6/28/19 3:19 AM, andrew.bernard(a)gmail.com wrote: > Would there be a way to show the number of subscribers to a list in the web= UI? >=20 > The number of participants per message is great, but this would be good too= . My users seem very interested in this number. I guess they want to know how= big the audience is that is reading their posts. I don't know how difficult it would be to add this to HyperKitty, and I'm not sure how useful it would be in general. HyperKitty is an archiver. It deals with archiving posts. It knows who has sent a post, but doesn't know or care if that person is, was or will be a member of the list. Postorius knows who the list members are and this information should be available to list members or the world depending on the list's member_roster_visibility setting, but see . --=20 Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============6547055989418328067==-- From andrew.bernard@gmail.com Sat Jun 29 02:30:39 2019 From: Andrew Bernard To: mailman-users@mailman3.org Subject: [MM3-users] Re: Reset digest number and volume Date: Sat, 29 Jun 2019 12:30:28 +1000 Message-ID: <678bae0c-79ac-4627-2e48-0a3faa7fa450@gmail.com> In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7804948979458512242==" --===============7804948979458512242== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable HI Mark, I get: >>> commit() Traceback (most recent call last): =C2=A0 File "", line 1, in NameError: name 'commit' is not defined Andrew On 26/6/19 11:49 pm, Mark Sapiro wrote: > On 6/26/19 3:08 AM, andrew.bernard(a)gmail.com wrote: >> How to do this? After lots of testing on my pre-release beta testing list,= I want the first production digest to be reset toVolume 1, Number 1. > > You can do this in `mailman shell` by setting the list's `volume` and > `next_digest_number` to 1. E.g., > > > $ ./mailman shell -l list(a)example.com > Welcome to the GNU Mailman shell > The variable 'm' is the list(a)example.com mailing list >>>> m.volume =3D 1 >>>> m.next_digest_number =3D 1 >>>> commit() --===============7804948979458512242==-- From mark@msapiro.net Sat Jun 29 03:01:01 2019 From: Mark Sapiro To: mailman-users@mailman3.org Subject: [MM3-users] Re: Reset digest number and volume Date: Fri, 28 Jun 2019 20:00:51 -0700 Message-ID: In-Reply-To: <678bae0c-79ac-4627-2e48-0a3faa7fa450@gmail.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============1352543854625888457==" --===============1352543854625888457== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit On 6/28/19 7:30 PM, Andrew Bernard wrote: > HI Mark, > > > I get: > >>>> commit() > Traceback (most recent call last): > File "", line 1, in > NameError: name 'commit' is not defined It should be if you are running in `mailman shell`, but just exiting with control-D should also do an implicit commit() -- Mark Sapiro The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan --===============1352543854625888457==-- From andrew.bernard@gmail.com Sat Jun 29 23:58:07 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Documentation for users for Mailman 3 Date: Sat, 29 Jun 2019 23:58:04 +0000 Message-ID: <156185268402.7500.1831390694036308842@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============4525155285245019740==" --===============4525155285245019740== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit There exists this: https://wiki.list.org/DOC/Mailman%202.1%20Members%20Manual I cant find a version for Mailman 3. Does it exist? If not, i will volunteer to write/update it. Let me know. Andrew --===============4525155285245019740==-- From andrew.bernard@gmail.com Sun Jun 30 08:26:27 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Mandatory First and Last Name Date: Sun, 30 Jun 2019 08:26:25 +0000 Message-ID: <156188318513.7500.6536009066572786183@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============7082147408371020065==" --===============7082147408371020065== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Is there a way to make the profile require users to fill out their name? Andrew --===============7082147408371020065==-- From andrew.bernard@gmail.com Sun Jun 30 12:17:39 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Thread matching query does not exist Date: Sun, 30 Jun 2019 12:17:36 +0000 Message-ID: <156189705678.7498.2212196829192920157@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3061941718610063753==" --===============3061941718610063753== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Now I am seeing this in the log every few seconds: 12:12:29 [Q] INFO Process-1:4 processing [rebuild_thread_cache_votes] 12:12:29 [Q] ERROR Failed [rebuild_thread_cache_votes] - Thread matching quer= y does not exist. : Traceback (most recent call last): File "/opt/mailman/mm/venv/lib/python3.7/site-packages/django_q-1.0.1-py3.7= .egg/django_q/cluster.py", line 377, in worker res =3D f(*task['args'], **task['kwargs']) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.2.3-py3= .7.egg/hyperkitty/tasks.py", line 189, in _rebuild_thread_cache_votes thread =3D Thread.objects.get(id=3Dthread_id) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.e= gg/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/mm/venv/lib/python3.7/site-packages/Django-2.1.9-py3.7.e= gg/django/db/models/query.py", line 399, in get self.model._meta.object_name hyperkitty.models.thread.Thread.DoesNotExist: Thread matching query does not = exist. Any help? How do I identify the thread in question? I imported an archive from a Listserv list, processed into something resembli= ng mbox format (which I now understand not to be a standard at all) and have = about 100,000 messages there. I am having a lot of trouble with these sort of= errors, as you will see from my flurry of posts recently. Yes, I am running all the jobs. Andrew --===============3061941718610063753==-- From andrew.bernard@gmail.com Sun Jun 30 13:28:01 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Waht are all these messages Date: Sun, 30 Jun 2019 13:27:58 +0000 Message-ID: <156190127888.7496.8543947656365145251@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3796950216096596246==" --===============3796950216096596246== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable My log is flooded with messages like this, with apparent IP address in them: [pid: 1014|app: 0|req: 228/228] 148.251.78.18 () {38 vars in 865 bytes} [Sun = Jun 30 13:26:10 2019] GET /accounts/login/?next=3D/archives/list/jackrail(a)j= ackrail.org/thread/E5WNO25XQV74CIV4QS7MQ32EZ5EWKLQ7/ =3D> generated 7658 byte= s in 9 msecs (HTTP/1.1 200) 6 headers in 331 bytes (1 switches on core 1) What are these? The flow is continuous, many different IP addresses? Andrew --===============3796950216096596246==-- From andrew.bernard@gmail.com Sun Jun 30 13:49:36 2019 From: andrew.bernard@gmail.com To: mailman-users@mailman3.org Subject: [MM3-users] Re: Waht are all these messages Date: Sun, 30 Jun 2019 13:49:33 +0000 Message-ID: <156190257337.7500.2195564118680687504@mailman.iad1.psf.io> In-Reply-To: <156190127888.7496.8543947656365145251@mailman.iad1.psf.io> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8376410716596292994==" --===============8376410716596292994== Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable I looked up the IP's - they are web crawlers, all from Germany for some reaso= n. Life is tough on the internet if you try to run a server. I shall block them. Andrew --===============8376410716596292994==--