- Mailman-users - lists.mailman3.org

Postorius performance with over 1000 pending users
by Nick W 11 Jun '19

11 Jun '19

I've got a couple things I need help with: The Symptom and The Problem. The Symptom: Postorius has gotten quite slow to load, taking more than 30s to load the Subscription Requests tab. Having zero pending subscription requests (I'm on v1.2.5), I started investigating unconfirmed subscriptions. I followed the commands from here[1] and got this: mailman shell -l your.list.id util = getUtility(IPendings) print(len(list(util.find(mlist=m,pend_type='subscription')))) 1816 Wow, 1816 pending subscription requests. I can say for certain that my list is not popular so these requests must have been submitted by bots. Let's get there in The Problem. How can I "purge" this list? I'm willing to assume that none of these requests are valid and would reject all unconfirmed user requests. The Problem: How might this activity be happening? Running cat /opt/mailman/core/var/logs/mailman.log | grep POST returns a lot of 202 and 409 responses for `POST /3.1/members`. Could it be that these requests are being submitted through Postorius? I'd assume there would be some sort of honeypot input to prevent abuse. I'll continue investigating and follow up with any insight I can on the cause of The Problem. Thanks, Nick [1]: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…>

3 4

WSGI: gunicorn and uwsgi
by andrew.bernard＠gmail.com 09 Jun '19

09 Jun '19

Using the Ubuntu 19 packages for all the mailman suite, uwsgi is the Python WSGI server included. I have now switched over to a full build from current source from gitlab, following Mark Sapiro's excellent instructions. It would appear that the current code has the use of gunicorn built in. Is gunicorn the preferred way now to run the mailman Django apps? Is it worth spending time converting everything to use uwsgi, or should I go with the flow and use gunicorn? What are the advantages of gunicorn over uwsgi?

2 1

Help with installing Postorius and Hyperkitty on Ubuntu 19
by andrew.bernard＠gmail.com 09 Jun '19

09 Jun '19

I'm new to Mailman. I have a Ubuntu 19 production server. I attempted to get Mailman 3 and the web components going with the system packages, but I encountered a few showstopper errors (such as indexing not working at all) which I know have been fixed in the codebase. To that end I erased my installation, and installed mailman from the gitlab source. That all works much more nicely now and I feel I have a lot more control of the layout of all the files (the various Ubuntu packages smear the parts all over the place, confusingly). Now I want to get Postorius and Hyperkitty going again, independently of Ubuntu packages. I would like to run Postorius and Hyperkitty under one Django project. So I downloaded the git source for mailman_web. I do not know if this is the right way to install. I am partially familiar with Django, but to come to the point, I have no idea once having obtained the source from git how to setup and install the project, where it lives in the filesystem, and so on. Are there any pointers to help in this area? The very nice readthedocs format files for Postorius and Hyperkitty are very silent on basic matters like this, which is not of much help! The git README files also define a new level of brevity. I need some initial hand holding here. If any help is forthcoming, such as links to more full documentation for newbies to Mailman, I would be most grateful.

4 6

Daily Cronjob fails
by Stefan Tatschner 08 Jun '19

08 Jun '19

Hey hey, I applied a recent Update from Debian Buster, und this night a received an email about a failing cronjob. The traceback can be reproduced using: # sudo -u www-data flock -n /var/run/mailman3-web/cron.daily /usr/share/mailman3-web/manage.py runjobs daily ERROR OCCURED IN DAILY JOB: sync_mailman (APP: hyperkitty) START TRACEBACK: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) psycopg2.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (2, hb-events(a)hackbrettl.de, hb-events, null, [hb-events] , 1, 2015-10-22 09:54:53.684306+00, hb-events.hackbrettl.de). The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/django_extensions/management/commands/runjobs.py", line 36, in runjobs job().execute() File "/usr/lib/python3/dist-packages/hyperkitty/jobs/sync_mailman.py", line 35, in execute sync_with_mailman() File "/usr/lib/python3/dist-packages/hyperkitty/lib/mailman.py", line 131, in sync_with_mailman mlist.update_from_mailman() File "/usr/lib/python3/dist-packages/hyperkitty/models/mailinglist.py", line 192, in update_from_mailman self.save() File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 808, in save force_update=force_update, update_fields=update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 838, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 905, in _save_table forced_update) File "/usr/lib/python3/dist-packages/django/db/models/base.py", line 955, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3/dist-packages/django/db/models/query.py", line 667, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 1204, in execute_sql cursor = super(SQLUpdateCompiler, self).execute_sql(result_type) File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 899, in execute_sql raise original_exception File "/usr/lib/python3/dist-packages/django/db/models/sql/compiler.py", line 889, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) File "/usr/lib/python3/dist-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/lib/python3/dist-packages/django/utils/six.py", line 685, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) django.db.utils.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (2, hb-events(a)hackbrettl.de, hb-events, null, [hb-events] , 1, 2015-10-22 09:54:53.684306+00, hb-events.hackbrettl.de). END TRACEBACK Appearently there is something wrong with the database. Is there anything what I can do about this? Running the migrations doesn't help: # sudo -u www-data flock -n /var/run/mailman3-web/cron.daily /usr/share/mailman3-web/manage.py migrate Operations to perform: Apply all migrations: account, admin, auth, contenttypes, django_mailman3, django_q, hyperkitty, postorius, sessions, sites, socialaccount Running migrations: No migrations to apply. Thanks! Stefan

3 3

Import Archives using Docker Image
by brian＠emwd.com 07 Jun '19

07 Jun '19

I want to test out importing a 2.1 archive into a Mailman 3.2 list. I am using maxking's docker images for MM3. How would I go about importing the mbox file? I don't think the following commands would work on a Docker installation of MM3: $ python manage.py hyperkitty_import -l foo-list(a)example.com $var_prefix/archives/private/foo-list.mbox/foo-list.mbox $ python manage.py update_index_one_list foo-list(a)example.com I am not sure how to go about doing this within Docker. Thanks for any assistance, Brian

2 2

Hyperkitty Authorization Required
by andrew.bernard＠gmail.com 06 Jun '19

06 Jun '19

Nearly there configuring my first Mailman 3 installation with Postorius and Hyperkiity. This issue eludes me: When trying to start a new thread in the archive, we have: HyperKitty failure on https://list.jackrail.org/hyperkitty/api/mailman/archive: <html><title>Auth required</title><body> <h1>Authorization Required</h1></body></html> (401) I can access this URL just fine" https://list.jackrail.org/hyperkitty/api/ Where do we look to solve this issue?

4 3

Hope for Mailman 3.X in cPanel
by Cold Kayak 06 Jun '19

06 Jun '19

Hi, it appears that cPanel is interested in supporting MailMan 3.X! See - https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870 <https://features.cpanel.net/topic/upgrade-to-mailman-3-0#comment-54870> "We’re hoping to work with the Mailman folks at some point in the future to accomplish this goal." Hopefully this happens sooner than later. regards, Edmond

2 1

Changing default message limit (max_message_size)
by roger＠reasonal.com 30 May '19

30 May '19

Right, me again. I'm so close to having what I need up and running ... but a showstopper is the max message size that triggers a moderate in it. 40kB these days is just way small ... unless you're a 1% using text-only email. So found this on list archive: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… $ bin/mailman shell -l list(a)example.com // Welcome to the GNU Mailman shell // The variable 'm' is the list(a)example.com // mailing list m.max_message_size = nn // commit() Unfortunately this does not work in the containerised mailman. So I get the container ID and run: docker exec 3373d426996d /usr/local/bin/mailman shell -i test-list(a)iotcouncil.org.za (in the post by Mark it says "-l" but I get "unrecognized argument" -- I assume it should be -i for "interactive"? Either way, it fires up the mailman shell and then throws me straight out back to the command line: Welcome to the GNU Mailman shell The variable 'm' is the test-list(a)iotcouncil.org.za mailing list >>> [root@listman ~]# So that doesn't help...

3 7

Bug - if you change primary email address, you're "semi-subscribed"
by roger＠reasonal.com 30 May '19

30 May '19

Subscribed to the list, sending mails worked. Changed primary email (my company email system adds branding crap that exceeded the 40k limit). Then mails to list simply vanished. Sent mail via UI, suddenly get a "welcome to list" and held message says "The message comes from a moderated member".

3 4

Re: Bug - if you change primary email address, you're "semi-subscribed"
by Roger Hislop 30 May '19

30 May '19

Testing if emails are being delivered to the list …

1 0