- Mailman-users - lists.mailman3.org

Mailman Core 3.2.2 is now out
by Abhilash Raj April 14, 2019

April 14, 2019

Hello Everyone, Mailman Core 3.2.2 is released and available on PyPI[1]. This is a regular bugfix release and I had to do that to fix a version constraint which pulled in a pre-release of a dependency (falcon) when installed via pip and caused the default install to break. There are few other changes included in this release, including a big refactor of error reporting in Core's REST API. All the error responses are now correctly formatted as JSON with more information about the error. For example, invalid inputs for Enum data types return the valid options. Other error message are now generated from the input validtor and will be more informative. REST API also accepts input as JSON formatted body, alongside the x-www-form-urlencoded. A full list of changes are available here: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#id1 This release supports Python 3.5-3.7. Thanks very much to all the contributors involved in this release. [1]: https://pypi.org/project/mailman/ -- thanks, Abhilash Raj (maxking)

2 3

List options question
by Phil Stracchino April 13, 2019

April 13, 2019

So, I've just sucscribed to this list, and when I go to set subscription options, I find: Receive list copies (possible duplicates) Yes No When you are listed explicitly in the To: or Cc: headers of a list message, you can opt to not receive another copy from the mailing list. Select No to receive copies. Select Yes to avoid receiving copies from the mailing list. This seems rather ... backwards. "Receive copies? Answer no for yes, yes for no." Is that how the option actually works in mailman3, or is the text of the option decription garbled? -- Phil Stracchino Babylon Communications phils(a)caerllewys.net phil(a)co.ordinate.org Landline: +1.603.293.8485 Mobile: +1.603.998.6958

2 1

Mailman3 in dockers on EC2 - running out of memory and puking ev.ry.where.
by roger.hislop＠is.co.za April 11, 2019

April 11, 2019

Hi all -- really need some help. I'm tech literate, but definitely not a sysadmin or dev. I'm following the tutorial at "Olay's Farmland" at https://www.olay.xyz/2018/01/01/deploy-mailman-3-on-aws-using-docker/ which seems to be a clone of the same content here https://xiaoxing.us/2018/01/01/deploy-mailman-3-on-aws-using-docker/ Easy enough to get most of the way ... set up EC2 instance, configure SES and add DNS settings with DKIM etc. Set up Postfix, test it. All working groovy. I run through the how to all the way through setting up the containers and firing it up. This is where things start to get funky. Once the docker-compose is run, I run "curl http://172.19.199.3:8000/postorius/lists/" to test. First time it said it couldn't connect to database. So I nuked and restarted from scratch. Second time it said the same thing... was reading around the place and tried again, and then reran that curl and it worked -- gave me html from a page. But the VM started running slowly --taking forever to follow keypresses. Eventually became unresponsive. So I rebooted the machine via AWS console, and docker ps showed only the postgres db running. docker-compose ps shows Name Command State Ports ------------------------------------------------------------------------------------------ docker-mailman_database_1 docker-entrypoint.sh postgres Up 5432/tcp mailman-core docker-entrypoint.sh maste ... Exit 255 8001/tcp, 8024/tcp mailman-web docker-entrypoint.sh uwsgi ... Exit 255 8000/tcp, 8080/tcp So rebuilt the container -- same thing. It looks and feels like its running out of memory. I used the compose file from https://gist.githubusercontent.com/Yexiaoxing/833bfcc5d3e4e0c06a8b7f0bac7c4… (with appropriate edits). I have no idea how to proceed from here... Go to logs... Partial log (they're LONG) docker logs docker-mailman_database_1 The files belonging to this database system will be owned by user "postgres". This user must also own the server process. The database cluster will be initialized with locale "en_US.utf8". The default database encoding has accordingly been set to "UTF8". The default text search configuration will be set to "english". Data page checksums are disabled. fixing permissions on existing directory /var/lib/postgresql/data ... ok creating subdirectories ... ok selecting default max_connections ... 100 selecting default shared_buffers ... 128MB selecting dynamic shared memory implementation ... posix creating configuration files ... ok running bootstrap script ... ok sh: locale: not found performing post-bootstrap initialization ... No usable system locales were found. Use the option "--debug" to see details. ok syncing data to disk ... ok WARNING: enabling "trust" authentication for local connections You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. Success. You can now start the database server using: pg_ctl -D /var/lib/postgresql/data -l logfile start waiting for server to start....LOG: database system was shut down at 2019-04-09 14:37:48 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started done server started CREATE DATABASE /usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/* LOG: received fast shutdown request LOG: aborting any active transactions LOG: autovacuum launcher shutting down LOG: shutting down waiting for server to shut down....LOG: database system is shut down done server stopped PostgreSQL init process complete; ready for start up. LOG: database system was shut down at 2019-04-09 14:37:50 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: relation "social_auth_usersocialauth" does not exist at character 15 STATEMENT: SELECT 1 from social_auth_usersocialauth LOG: database system was interrupted; last known up at 2019-04-09 14:48:37 UTC LOG: database system was not properly shut down; automatic recovery in progress LOG: invalid record length at 0/1767BB8: wanted 24, got 0 LOG: redo is not required LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started LOG: received smart shutdown request LOG: autovacuum launcher shutting down LOG: shutting down LOG: database system is shut down LOG: database system was shut down at 2019-04-09 15:18:06 UTC LOG: MultiXact member wraparound protections are now enabled LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: duplicate key value violates unique constraint "auth_user_username_key" DETAIL: Key (username)=(lists) already exists. STATEMENT: INSERT INTO "auth_user" ("password", "last_login", "is_superuser", "username", "first_name", "last_name", "email", "is_staff", "is_active", "date_joined") VALUES ('!lS8pgTTV7CyhUbZItku00ZnUGxLQkVEuc3ENZKbV', NULL, true, 'lists', '', '', 'iotic-za(a)reasondigital.co.za', true, true, '2019-04-09T15:39:57.715036+00:00'::timestamptz) RETURNING "auth_user"."id" TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (3 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (12 chunks); 179176 used ERROR: out of memory DETAIL: Failed on request of size 4032. CONTEXT: writing block 0 of relation base/16384/16797 TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (2 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used LOG: could not fork autovacuum worker process: Out of memory MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used LOG: could not fork autovacuum worker process: Out of memory Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (11 chunks); 179176 used LOG: could not fork autovacuum worker process: Out of memory ERROR: out of memory DETAIL: Failed on request of size 4032. CONTEXT: writing block 0 of relation base/16384/16797 LOG: could not fork autovacuum worker process: Out of memory WARNING: could not write block 0 of base/16384/16797 DETAIL: Multiple failures --- write error might be permanent. TopMemoryContext: 8192 total in 1 blocks; 3480 free (0 chunks); 4712 used smgr relation table: 24576 total in 2 blocks; 13008 free (4 chunks); 11568 used WAL record construction: 49768 total in 2 blocks; 6584 free (0 chunks); 43184 used Checkpointer: 8192 total in 1 blocks; 7992 free (2 chunks); 200 used PrivateRefCount: 8192 total in 1 blocks; 2840 free (0 chunks); 5352 used MdSmgr: 8192 total in 1 blocks; 8120 free (0 chunks); 72 used Pending ops context: 0 total in 0 blocks; 0 free (0 chunks); 0 used Pending Ops Table: 8192 total in 1 blocks; 2840 free (5 chunks); 5352 used LOCALLOCK hash: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used TopMemoryContext: 51040 total in 4 blocks; 1344 free (1 chunks); 49696 used TopTransactionContext: 8192 total in 1 blocks; 6968 free (0 chunks); 1224 used Timezones: 104120 total in 2 blocks; 2840 free (0 chunks); 101280 used Statistics snapshot: 0 total in 0 blocks; 0 free (0 chunks); 0 used ErrorContext: 8192 total in 1 blocks; 8152 free (0 chunks); 40 used Grand total: 235808 bytes in 13 blocks; 56632 free (11 chunks); 179176 used Per-database function: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database table: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database function: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Per-database table: 8192 total in 1 blocks; 776 free (0 chunks); 7416 used Databases hash: 24576 total in 2 blocks; 15072 free (5 chunks); 9504 used ERROR: out of memory For UWSGI cat uwsgi.log [pid: 49|app: 0|req: 1/1] 172.19.199.1 () {24 vars in 291 bytes} [Tue Apr 9 14:43:43 2019] GET /postorius/lists/ => generated 3710 bytes in 705 msecs (HTTP/1.1 200) 5 headers in 163 bytes (1 switches on core 0) [pid: 39|app: 0|req: 1/1] 172.19.199.1 () {24 vars in 291 bytes} [Tue Apr 9 15:40:12 2019] GET /postorius/lists/ => generated 3710 bytes in 694 msecs (HTTP/1.1 200) 5 headers in 163 bytes (1 switches on core 0) [ec2-user@ip-172-31-23-250 logs]$ cat uwsgi-error.log cat: uwsgi-error.log: Permission denied [ec2-user@ip-172-31-23-250 logs]$ sudo cat uwsgi-error.log *** Starting uWSGI 2.0.15 (64bit) on [Tue Apr 9 14:38:03 2019] *** compiled with version: 6.3.0 on 29 December 2017 00:16:31 os: Linux-4.14.77-70.59.amzn1.x86_64 #1 SMP Mon Nov 12 22:02:45 UTC 2018 nodename: mailman-web machine: x86_64 clock source: unix detected number of CPU cores: 1 current working directory: /opt/mailman-web detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! setgid() to 101 setuid() to 100 chdir() to /opt/mailman-web your processes number limit is 3860 your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address 0.0.0.0:8080 fd 8 uwsgi socket 1 bound to TCP address 0.0.0.0:8000 fd 9 Python version: 2.7.14 (default, Dec 19 2017, 17:52:21) [GCC 6.3.0] Python main interpreter initialized at 0x55ca1d90e1e0 python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds [uwsgi-cron] command "./manage.py runjobs minutely" registered as cron task [uwsgi-cron] command "./manage.py runjobs quarter_hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs daily" registered as cron task [uwsgi-cron] command "./manage.py runjobs monthly" registered as cron task [uwsgi-cron] command "./manage.py runjobs weekly" registered as cron task [uwsgi-cron] command "./manage.py runjobs yearly" registered as cron task mapped 166144 bytes (162 KB) for 2 cores *** Operational MODE: threaded *** WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x55ca1d90e1e0 pid: 1 (default app) *** uWSGI is running in multiple interpreter mode *** spawned uWSGI master process (pid: 1) spawned uWSGI worker 1 (pid: 49, cores: 2) Tue Apr 9 14:38:04 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 51) [uwsgi-daemons] spawning "./manage.py qcluster" (uid: 100 gid: 101) 14:38:07 [Q] INFO Q Cluster-52 starting. 14:38:07 [Q] INFO Process-1 guarding cluster at 67 14:38:07 [Q] INFO Process-1:1 ready for work at 68 14:38:07 [Q] INFO Process-1:3 pushing tasks at 70 14:38:07 [Q] INFO Q Cluster-52 running. 14:38:07 [Q] INFO Process-1:2 monitoring at 69 [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 51 exited after 4 second(s) Tue Apr 9 14:39:04 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 71) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 71 exited after 269 second(s) Tue Apr 9 14:43:33 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 79) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 79 exited after 3 second(s) Tue Apr 9 14:51:35 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 89) *** Starting uWSGI 2.0.15 (64bit) on [Tue Apr 9 15:39:58 2019] *** compiled with version: 6.3.0 on 29 December 2017 00:16:31 os: Linux-4.14.109-80.92.amzn1.x86_64 #1 SMP Mon Apr 1 23:07:39 UTC 2019 nodename: mailman-web machine: x86_64 clock source: unix detected number of CPU cores: 1 current working directory: /opt/mailman-web detected binary path: /usr/local/bin/uwsgi !!! no internal routing support, rebuild with pcre support !!! setgid() to 101 setuid() to 100 chdir() to /opt/mailman-web your processes number limit is 3860 your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to TCP address 0.0.0.0:8080 fd 8 uwsgi socket 1 bound to TCP address 0.0.0.0:8000 fd 9 Python version: 2.7.14 (default, Dec 19 2017, 17:52:21) [GCC 6.3.0] Python main interpreter initialized at 0x562e2c0b11e0 python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds [uwsgi-cron] command "./manage.py runjobs minutely" registered as cron task [uwsgi-cron] command "./manage.py runjobs quarter_hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs hourly" registered as cron task [uwsgi-cron] command "./manage.py runjobs daily" registered as cron task [uwsgi-cron] command "./manage.py runjobs monthly" registered as cron task [uwsgi-cron] command "./manage.py runjobs weekly" registered as cron task [uwsgi-cron] command "./manage.py runjobs yearly" registered as cron task mapped 166144 bytes (162 KB) for 2 cores *** Operational MODE: threaded *** WSGI app 0 (mountpoint='') ready in 1 seconds on interpreter 0x562e2c0b11e0 pid: 1 (default app) *** uWSGI is running in multiple interpreter mode *** spawned uWSGI master process (pid: 1) spawned uWSGI worker 1 (pid: 39, cores: 2) Tue Apr 9 15:39:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 41) [uwsgi-daemons] spawning "./manage.py qcluster" (uid: 100 gid: 101) 15:40:02 [Q] INFO Q Cluster-43 starting. 15:40:02 [Q] INFO Process-1:1 ready for work at 58 15:40:02 [Q] INFO Process-1:2 monitoring at 59 15:40:02 [Q] INFO Process-1 guarding cluster at 57 15:40:02 [Q] INFO Process-1:3 pushing tasks at 60 15:40:02 [Q] INFO Q Cluster-43 running. [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 41 exited after 4 second(s) Tue Apr 9 15:40:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 63) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 63 exited after 13 second(s) Tue Apr 9 15:41:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 71) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 71 exited after 33 second(s) Tue Apr 9 15:42:59 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 79) 16:33:36 [Q] ERROR could not translate host name "database" to address: Try again 16:35:17 [Q] INFO Process-1:3 stopped pushing tasks 16:35:25 [Q] ERROR reincarnated pusher Process-1:3 after sudden death 16:35:25 [Q] INFO Process-1:4 pushing tasks at 87 [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 79 exited after 3146 second(s) Tue Apr 9 16:35:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 88) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 88 exited after 3 second(s) Tue Apr 9 16:36:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 96) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 96 exited after 3 second(s) Tue Apr 9 16:37:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 104) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 104 exited after 3 second(s) Tue Apr 9 16:38:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 112) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 112 exited after 3 second(s) Tue Apr 9 16:39:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 120) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 120 exited after 3 second(s) Tue Apr 9 16:40:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 128) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 128 exited after 3 second(s) Tue Apr 9 16:41:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 136) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 136 exited after 3 second(s) Tue Apr 9 16:42:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 144) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 144 exited after 3 second(s) Tue Apr 9 16:43:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 152) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 152 exited after 3 second(s) Tue Apr 9 16:44:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 160) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 160 exited after 3 second(s) Tue Apr 9 16:45:00 2019 - [uwsgi-cron] running "./manage.py runjobs quarter_hourly" (pid 168) [uwsgi-cron] command "./manage.py runjobs quarter_hourly" running with pid 168 exited after 2 second(s) Tue Apr 9 16:45:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 176) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 176 exited after 3 second(s) Tue Apr 9 16:46:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 184) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 184 exited after 2 second(s) Tue Apr 9 16:47:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 192) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 192 exited after 3 second(s) Tue Apr 9 16:48:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 200) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 200 exited after 3 second(s) Tue Apr 9 16:49:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 208) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 208 exited after 3 second(s) Tue Apr 9 16:50:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 216) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 216 exited after 3 second(s) Tue Apr 9 16:51:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 224) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 224 exited after 3 second(s) Tue Apr 9 16:52:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 232) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 232 exited after 3 second(s) Tue Apr 9 16:53:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 240) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 240 exited after 2 second(s) Tue Apr 9 16:54:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 248) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 248 exited after 2 second(s) Tue Apr 9 16:55:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 256) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 256 exited after 3 second(s) Tue Apr 9 16:56:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 264) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 264 exited after 3 second(s) Tue Apr 9 16:57:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 272) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 272 exited after 3 second(s) Tue Apr 9 16:58:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 280) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 280 exited after 3 second(s) Tue Apr 9 16:59:25 2019 - [uwsgi-cron] running "./manage.py runjobs minutely" (pid 288) [uwsgi-cron] command "./manage.py runjobs minutely" running with pid 288 exited after 3 second(s) Tue Apr 9 17:00:00 2019 - [uwsgi-cron] running "./manage.py runjobs quarter_hourly" (pid 296) Tue Apr 9 17:00:00 2019 - [uwsgi-cron] running "./manage.py runjobs hourly" (pid 297) Traceback (most recent call last): File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 363, in execute_from_command_line Traceback (most recent call last): File "./manage.py", line 10, in <module> execute_from_command_line(sys.argv) utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 363, in execute_from_command_line File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 337, in execute utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 337, in execute django.setup() django.setup() File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup File "/usr/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup apps.populate(settings.INSTALLED_APPS) apps.populate(settings.INSTALLED_APPS) File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate File "/usr/local/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate app_config.import_models() app_config.import_models() File "/usr/local/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models File "/usr/local/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models self.models_module = import_module(models_module_name) self.models_module = import_module(models_module_name) File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) __import__(name) File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/__init__.py", line 28, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/__init__.py", line 28, in <module> from .email import Email, Attachment from .email import Email, Attachment File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/email.py", line 37, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/models/email.py", line 37, in <module> from hyperkitty.lib.analysis import compute_thread_order_and_depth from hyperkitty.lib.analysis import compute_thread_order_and_depth File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/analysis.py", line 28, in <module> File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/analysis.py", line 28, in <module> import networkx as nx import networkx as nx File "/usr/local/lib/python2.7/site-packages/networkx/__init__.py", line 114, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/__init__.py", line 114, in <module> import networkx.generators import networkx.generators File "/usr/local/lib/python2.7/site-packages/networkx/generators/__init__.py", line 6, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/generators/__init__.py", line 6, in <module> from networkx.generators.classic import * from networkx.generators.classic import * File "/usr/local/lib/python2.7/site-packages/networkx/generators/classic.py", line 26, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/generators/classic.py", line 26, in <module> from networkx.algorithms.bipartite.generators import complete_bipartite_graph from networkx.algorithms.bipartite.generators import complete_bipartite_graph File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/__init__.py", line 57, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/__init__.py", line 57, in <module> import networkx.algorithms.connectivity import networkx.algorithms.connectivity File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/__init__.py", line 3, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/__init__.py", line 3, in <module> from .connectivity import * from .connectivity import * File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/connectivity.py", line 13, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/connectivity/connectivity.py", line 13, in <module> from networkx.algorithms.flow import boykov_kolmogorov from networkx.algorithms.flow import boykov_kolmogorov File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/flow/__init__.py", line 1, in <module> File "/usr/local/lib/python2.7/site-packages/networkx/algorithms/flow/__init__.py", line 1, in <module> from .maxflow import * from .maxflow import * MemoryErrorMemoryError 18:16:37 [Q] ERROR could not translate host name "database" to address: Try again ...etc ... For Mailman cat mailmanweb.log ERROR 2019-04-09 20:05:48,878 934 hyperkitty.lib.utils Failed to update the fulltext index: could not translate host name "database" to address: Try again Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/utils.py", line 186, in run_with_lock fn(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/search_indexes.py", line 87, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 240, in update_backend total = qs.count() File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 363, in count return self.query.get_count(using=self.db) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 498, in get_count number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 479, in get_aggregation result = compiler.execute_sql(SINGLE) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 874, in execute_sql cursor = self.connection.cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor return self._cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor self.ensure_connection() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect self.connection = self.get_new_connection(conn_params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py", line 176, in get_new_connection connection = Database.connect(**conn_params) File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) OperationalError: could not translate host name "database" to address: Try again ERROR 2019-04-09 20:15:08,192 983 hyperkitty.lib.utils Failed to update the fulltext index: could not translate host name "database" to address: Try again Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/utils.py", line 186, in run_with_lock fn(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/search_indexes.py", line 87, in update_index update_cmd.update_backend("hyperkitty", "default") File "/usr/local/lib/python2.7/site-packages/haystack/management/commands/update_index.py", line 240, in update_backend total = qs.count() File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 363, in count return self.query.get_count(using=self.db) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 498, in get_count number = obj.get_aggregation(using, ['__count'])['__count'] File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/query.py", line 479, in get_aggregation result = compiler.execute_sql(SINGLE) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 874, in execute_sql cursor = self.connection.cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 254, in cursor return self._cursor() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 229, in _cursor self.ensure_connection() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/utils.py", line 94, in __exit__ six.reraise(dj_exc_type, dj_exc_value, traceback) File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 213, in ensure_connection self.connect() File "/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py", line 189, in connect self.connection = self.get_new_connection(conn_params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py", line 176, in get_new_connection connection = Database.connect(**conn_params) File "/usr/local/lib/python2.7/site-packages/psycopg2/__init__.py", line 130, in connect conn = _connect(dsn, connection_factory=connection_factory, **kwasync) OperationalError: could not translate host name "database" to address: Try again

3 3

Simplified installation instructions
by Frank Yappa April 8, 2019

April 8, 2019

I've looked at installing Mailman3 many times but have never succeeded - there simply too many instructions. Is there a simple guide to get just web front end to Mailman3 where you can import an existing mailing list simply for viewing? Which is the easiest system to install Mailman3 on? I have a Debian system and would be grateful for any pointers showing how to install it . I came across:- https://iomarmochtar.wordpress.com/2017/07/21/mailman3-easy-installation/ but this is for Centos and I don't know what to change. Elsewhere I came across a list of apps which needed to be installed on Debian but that didn't work because of missing packages. apt-get install python3-setuptools python3-virtualenv python3-dev git gcc node-less nodejs postfix python3-tox

2 1

easy way to delete old mails in hyperkitty?
by l.schimmer＠cgv.tugraz.at April 8, 2019

April 8, 2019

Hi! is thjere a easy way to delete old mails in hyperkitty? e.g. with a list and checkmarks, or via a cli command? We got several mailinglists and we did import them from mailman2.x into mailman 3.2. Now it is time to remove old posts before 2016. But I do not see a easy way to remove old posts in one go, just the "remove thread" button in each mail view. thank you, Lars

2 1

Archiver "prototype" and disabling archiving at all
by Torge Riedel April 7, 2019

April 7, 2019

Hi list, in the settings of a mailing list I can choose two archivers: "Hyperkitty" and "prototype". What is this archive "prototype" and how can I disable/remove/deinstall it? And how can I disable archiving at all, so no archiver can be chosen in the settings. Best regards Torge

3 4

UI changes in Hyperkitty
by Abhilash Raj April 2, 2019

April 2, 2019

Hi All, I have been working this past weekend trying to change some UI elements of Hyperkitty to make it a bit more cleaner, easier to read quoted emails and make unread posts more visible than they were before. As a test bed, I have deployed my changes to lists.mailman3.org[1]. A complete summary of changes is available in my MR[2] on Gitlab. I would appreciate some feedback from users to make sure that is is a step in the right direction. Since it has been a long long time since I ever designed a UI, I would also really appreciate if there people who want to work with me on fixing some of the UX issues in Hyperkitty. Summary of Changes: --------------------------------- - The grey background for the email headers are removed. - Gravatars are now round in shape instead of square. - Links to permalink of the message and fixed-font button has been moved to the bottom to remove clutter from the top of the message. - The date format is changed to remove the Day of the week and uses 3 letter month names for minimalism. - Right sidebar is now fixed and doesn't scroll with the page. - All buttons on the bottom of the email now have a hover property that changes their background on mouse hover. - Quoted part of the email now has a different background. Each level of quoting gets a different background till 3-levels of indentation. After, which we don't process more quoted text. - Unread threads show a blue bar on the left side as a more prominent indication as compared to current envelope icon. [1]: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ [2]: https://gitlab.com/mailman/hyperkitty/merge_requests/132 Feel free to reply here or just comment on MR in Gitlab. -- thanks, Abhilash Raj (maxking)

3 2

mail stuck in "out" queue
by Dmitry Makovey March 30, 2019

March 30, 2019

I've had encountered this situation now twice: mail is being stuck in "out" queue and nothing in the logs indicates the issue. Is there a way to ask mailman-core politely to attempt delivery (perhaps with increased debugging in the logs) *without* restarting the core (which does solve *this* problem but creates other problems, like availability of the mailman as a whole) -- Sr System and DevOps Engineer SoM IRT

2 1

Delete archive of mailing list
by Torge Riedel March 28, 2019

March 28, 2019

Hi list, I've successfully set up mailman3 in a test environment and deleted a test list which I only used for some basic tests. Looking at the archiver, the archive is still there and I haven't found a way to delete it. Although I am logged in as admin. Is there a (non-) official way to delete the archive? I want a clean environment for the later user to test mailman3. Thanks and regards Torge

2 2

Introducing Mailman Web project
by Abhilash Raj March 26, 2019

March 26, 2019

I have been working on a new sub-project Mailman Web[1][2]. This project basically combines Postorius and Hyperkitty together in a single package which you can easily use to serve Mailman's web interface. The basic motivation behind this was to make it simpler for people to install the web interface *and* make it easier for people to configure Mailman's web ui. Both Postorius and Hyperkitty are based on Django Web Framework, which uses settings.py as its default configuration language. While it is quite convenient for Python developers to be able to put Python statements in configuration to join/edit/configure settings. However, I think a traditional INI, or TOML style configuration is easier for non-developers without having to worry about PYTHONPATH, valid Python sytax etc, etc. For this reason, I decided to combine all the projects together into a Django project which can be easily installed and run: $ pip install mailman-web # Export Settings for commands to just work. $ export DJANGO_SETTINGS=mailman_web.settings $ django-admin migrate $ django-admin runserver This should get you default settings for running. If you want to customize your installation, which you almost always would need to in a prod environment, you can create a config file at one of these locations (which are searched in following order): - /etc/mailman-web.toml - /etc/mailman3/mailman-web.toml - ./mailman-web.toml Note that we support only TOML as the configuration language[3][4] because of its simplicity. I would have loved to use INI, like Mailman Core, but it turns out to be way too simple to represent more complex data structures like maps and tables, that is commonly used in Django's Settings. This project is currently in alpha stage (I created it today!), but can be installed with pip[5] and in my basic tests works. There isn't much in the project itself beyond some configurations. I also took this opportunity to document all the settings that are used in Mailman Web (both Postorius and Hyperkitty) together[6]. This is documented in code and so I really hope that it won't go out of date like many other places ;-) Improvements to docs is very welcome, just a modification of a comment and is quite easy to propose right in your web browser using Gitlab! Any questions, comments or suggestions are welcome. You can open issues for feature requests on gitlab[1] too. [1]: https://gitlab.com/mailman/mailman-web [2]: https://mailman-web.readthedocs.io/en/latest/ [3]: https://github.com/maxking/django-settings-toml [4]: https://github.com/toml-lang/toml [5]: https://pypi.org/project/mailman-web/ [6]: https://mailman-web.readthedocs.io/en/latest/settings.html -- thanks, Abhilash Raj (maxking)

2 6

Configuring the List-Archive and Archived-At headers
by Ralph Seichter March 25, 2019

March 25, 2019

With archiving enabled, mail is sent with headers like the following: Archived-At: <https://example.com/hyperkitty/list/foo-users@lists.example.com/message/ABC/> List-Archive: <https://example.com/hyperkitty/list/foo-users@lists.example.com/> List-Post: <mailto:foo-users@lists.example.com> List-Subscribe: <mailto:foo-users-join@lists.example.com> The 'mailto:' entries are fine, but I need all 'https:' links to be prefixed with https://lists.example.com instead of https://example.com . Does Mailman extract CN parts from the SSL certificate to populate the header values (that would explain 'example.com' in my tests), or is this something I can influence using configuration parameters? I searched the docs for Mailman Suite and HyperKitty, but did not find an answer. -Ralph

5 9

Non resolved placeholders in action message
by Torge Riedel March 23, 2019

March 23, 2019

Hi, after adding a new moderator to a list I get the following message in a green box: %(email)s has been added with the role %(role)s Looks like the placeholders are not resolved (correctly). Should I report this somewhere as a bug? Mailman Core Version GNU Mailman 3.2.0 (La Villa Strangiato) Mailman Core API Version 3.0 Mailman Core Python Version 3.6.7 (default, Oct 22 2018, 11:32:17) [GCC 8.2.0] Best regards Torge

2 1

State of STARTTLS/SMTPS support?
by Ralph Seichter March 21, 2019

March 21, 2019

Hello list. I just found https://gitlab.com/mailman/mailman/issues/252 and was surprised to see that a) the issue is two years old and b) a related merge request has been submitted a year ago and is also still open. The possibility to send mail unencrypted via localhost is something I have in a test environment, but not in production. I need to be able to specify settings that look like these: [mta] smtp_host: outbound-mta.mydomain.tld smtp_port: 587 smtp_security: STARTTLS When is STARTTLS/SMTPS likely to become available in Mailman? -Ralph

2 2

How to best disable message decoration for all lists defined for a domain
by Ralph Seichter March 19, 2019

March 19, 2019

Hello list. I have read [1] and [2], but I am not quite sure what the recommended method is to completely disable message headers/footers and subject modifications for *all* lists tied to a specific domain. Being new to Mailman 3, I was actually surprised that there are no configuration switches in the Web UI's settings for mailing lists that allow me to get rid of unwanted message decorations. [1] https://mailman.readthedocs.io/en/latest/src/mailman/handlers/docs/decorate… [2] https://mailman.readthedocs.io/en/latest/build/lib/mailman/rest/docs/templa… Thanks for your input. -Ralph

3 4

REST Runner (and other runners) taking long time to boot up
by Dmitry Makovey March 18, 2019

March 18, 2019

splitting this discussion into it's own thread from "MM3 occasionally chokes (?)". Re-iterating background info for posterity: we have been experiencing increasingly long boot ups from mailman-core over the past year to the point where it's at about 45min for the sequence to complete. We run couple of mailing lists (20+) that are anywhere between 100 and 10K+ members and most of them are low traffic. From what I can tell all that time is spent doing some sort of indexing operations, I'm writing from memory since I can't restart the system to confirm that. sizes of directories that containers use: 3.6G core 352M database 285M web state of my queues (as far as I understand how to evaluate them: $ for q in core/var/queue/*; do echo ${q}; ls ${q}/ | wc -l ; done core/var/queue/archive 1 core/var/queue/bad 3845 core/var/queue/bounces 0 core/var/queue/command 0 core/var/queue/digest 0 core/var/queue/in 0 core/var/queue/nntp 0 core/var/queue/out 7 core/var/queue/pipeline 0 core/var/queue/retry 1 core/var/queue/shunt 958 core/var/queue/virgin 0 what kind of tuning should we be looking into to speed up our boot-ups? -- Sr System and DevOps Engineer SoM IRT

2 1

Maximum number of recipients error
by brian＠emwd.com March 18, 2019

March 18, 2019

I am unable to modify the "Maximum number of recipients" setting. It generates the following error when I click the "save changes" button: "An error occured: Unknown attribute: max_num_recipients" I am using the docker version of MM3 and its happening on "Postorius Version 1.2.3". Is this a known bug? Brian

3 2

MM3 occasionally chokes (?)
by Dmitry Makovey March 18, 2019

March 18, 2019

In the last couple of month we've observed some odd behavior from MM3 (namely the core) where it seems like email that is about to be sent to a large-ish mailing list (10K users) has been processed yet never gets sent out until we restart the core. I would appreciate any pointers on where to look for the source of the problem. At the moment, since I can't reliably reproduce it I can't really test it nor do I know where to look next time things get stuck. Mailing list in question is high profile thus when event like this happens I have only limited time amount to spend on troubleshooting/digging before I just restart the core (which by the way takes about 45min to fully start... which is another puzzle to solve at later time) -- Sr System and DevOps Engineer SoM IRT

2 5

REST API Question: possible to change user preferred email?
by Nathan Dixon March 18, 2019

March 18, 2019

Hi, We are in need of being able to change a user's email address via the REST API. After looking through the documentation and code, I can't see a way to do this in a simple way. Although the documentation seems to show that if a user changes their preferred address, it will track throughout all their subscriptions. See: https://gitlab.com/mailman/mailman/blob/master/src/mailman/rest/docs/member… "When Gwen changes her preferred address, her subscription automatically tracks the new address." The only way I can see to do this via the REST API would be to do the following long winded way: *1. Create a new address:* POST to http://<api_url>/3.1/users/<$OldEmail>/addresses $postData: {email = "$NewEmail"} *2. Verify the new address:* POST to http://<api_url>/3.1/addresses/<$NewEmail>/verify $postData: { } *3. Get all the memberships for the old email address* $memberships = GET to http://<api_url>/3.1/addresses/<$OldEmail>/memberships *4. Change users email for each membership individually* foreach ($membership in $memberships) { PATCH to http://<api_url>/3.1/members/<$membership.member_id> $pathData: { address = $NewEmail } } *5. Delete Old Address* DELETE to http://<api_url>/3.1/addresses/<$OldEmail> Am I missing something (as in there is a way to do a single PATCH request somewhere)? Or is this the only way to update someone's email address with these 5 steps? Thanks, Nathan Dixon

2 1

[Mailman-Users] mailman 3 and freeipa
by Stephen J. Turnbull March 18, 2019

March 18, 2019

Crossposting and redirecting replies to mailman-users(a)mailman3.org. Steven Jones writes: > I cant find anything on this so far but can Mailman3's webui use > freeipa as the authentication mechanism? Hi Steve, I don't have a complete answer offhand (and right now I'm just reducing my inbox so a single google search is as much as I can do), but searching for "freeipa django" indicates that there are "connectors" for Django and FreeIPA. The nicest option would be a plugin for Django's socialauth application. If that doesn't seem to exist, perhaps you can just add a FreeIPA application to the Django configuration. You would need to add it to both Postorius and HyperKitty configurations. Steve -- Associate Professor Division of Policy and Planning Science http://turnbull.sk.tsukuba.ac.jp/ Faculty of Systems and Information Email: turnbull(a)sk.tsukuba.ac.jp University of Tsukuba Tel: 029-853-5175 Tennodai 1-1-1, Tsukuba 305-8573 JAPAN

2 1

How to count the number of members in a list using Mailman client?
by Alan So March 18, 2019

March 18, 2019

I tried to do so using Mailman client but it is really slow for lists with size > 1000. I use the following code snippet: my_list = client.get_list(listname) print ("number of members =", len(my_list.members)) Are there any other ways to do so in a much faster speed? Thanks.

2 1

Assistance with mailman3
by ayen＠afilias.info March 15, 2019

March 15, 2019

Hi all I'm pretty new to mailman but been trying to install mailman 3 and been running into issues, following the documentation at http://docs.mailman3.org/en/latest/prodsetup.html installed Python 3.6, nginx, ruby-sass then with pip installed whoosh mailman-hyperkitty postorius hyperkitty mailman tried to start mailman core, symlinked master and runner -> /usr/bin/ (otherwise it wouldn't run) mailman core starts but when I hit the api url I get this in the logs File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/dist-packages/mailman-3.2.2-py3.6.egg/mailman/rest/wsgiapp.py", line 218, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 248, in __call__ responder, params, resource, req.uri_template = self._get_responder(req) File "/usr/local/lib/python3.6/dist-packages/falcon/api.py", line 664, in _get_responder route = self._router_search(path, req=req) TypeError: find() got an unexpected keyword argument 'req' Mar 13 10:54:44 2019 (17273) 127.0.0.1 - - "GET /3.1/ HTTP/1.1" 500 59 and on frontend "A server error occurred. Please contact the administrator." that leads to my gnu not working and throwing keyerrors for postorius. I'm using a clean install of ubuntu 18.04 but have also tried to install on centos 7 with no success. Are there any missing dependencies or steps that I've missed any assistance would be appreciated. Andy

3 2

Import Mailman 2.1.15 => Mailman 3 fails
by Jens Bretschneider March 15, 2019

March 15, 2019

Hi, we want to replace our Mailman 2.1.15 installation and have installed Mailman 3 with Docker (maxking/docker-mailman). Everything seems to be fine so far, but the import of the old mailing lists fails. There are two different exceptions: MySQLdb._exceptions.OperationalError: (1366, "Incorrect string value: '\\xE2\\\x80\x8D0\xE2\\x80...' for column `mailmandb`.`hyperkitty_email`.`content` at row 1") as well as MySQLdb._exceptions.OperationalError: (1048, "Column 'description' cannot be null") The complete log can be found here: https://www.dropbox.com/s/htd4eia1cg1kyi7/mailman3_import_log.txt?dl=0 Any idea what's going wrong here? Kind regards, Jens

3 3

Unable to configure mailman . Please give any information
by pradeep Kumar xplorer March 14, 2019

March 14, 2019

Subject: [Fwd: Please list the variables i need to modify in the configure.in] From: "Pradeep Kumar Xplorer" pradeepkumarxplorer(a)pradeepkumarxplorer.com Date: Mon, March 11, 2019 4:04 am To: mailman-users(a)mailman3.org Priority: High Read Receipt: Requested [ Send Read Receipt Now ] Options: View Full Header | Print | Download this as a file ---------------------------- Original Message ---------------------------- Subject: Please list the variables i need to modify in the configure.in From: "Pradeep Kumar Xplorer" pradeepkumarxplorer(a)pradeepkumarxplorer.com Date: Thu, March 7, 2019 6:36 am To: mailman-users(a)python.org before running the configure script I changed AC_PREFIX_DEFAULT(/home1/explodi4/public_html/MAILMAN) and it still says /home/mailman does not exist. Pradeep Kumar Xplorer http://www.dhyanayoga.info http://www.pradeepkumarxplorer.com/2016/CyberCrime/index.php

2 1

hyperkitty error importing (from mm2 mbox) HTML emails / binary attachments
by M4tze March 13, 2019

March 13, 2019

Dear list, I am importing emails from mm2 mbox archives into hyperkitty. This generally works but for HTML mails or mails having binary attachments, I get some errors: + ProgrammingError: (1064, u'You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near \'_binary\'<html>\\n<head>\\n<meta http-equiv=\\"Content-Type\\" content=\\"text/html; c\' at line 1') + I am using the following debian/ubuntu packages: * mailman3 3.1.1-9 * mailman3-full 3.1.1-9 * mailman3-web 0+20170523-14 * python-django-mailman3 1.1.0-4 * python-mailmanclient 3.1.1-5 * python3-mailman-hyperkitty 1.1.0-4 * mysql-server 5.7.25-0ubuntu0.18.04.2 * mysql-server-5.7 5.7.25-0ubuntu0.18.04.2 * mysql-server-core-5.7 5.7.25-0ubuntu0.18.04.2 I changed the charset & collation of the mailman-web (incl. hyperkitty's) tables from latin1 to UTF8_mb4, which was neccessary to fix errors importing UTF8 mail. Does anyone has an idea of how to fix that? Kind regards - m4tze

1 0

mailman admin (django) interface does not work anymore after deleting website example.com
by Torge Riedel March 10, 2019

March 10, 2019

Hi, I've just installed successfully mailman3 and started with basic configuration. When adding a new domain it gives me a link to a django admin page where I have to configure the available websites. I deleted the existing "example.com" and added a new one "lists.mydomain.de". Now the admin (django) interface always gives "An error occurred while processing your request". After one of the first navigation clicks I saw a message that "site with id 1 is missing". Can you point me to where the problem is and how to solve it? Maybe it was not a good idea to delete the existing one, but I would have expected that django will prevent this, if it will fail afterwards. Thanks and regards Torge The logs: Traceback (most recent call last): File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 156, in _get_response response = self.process_exception_by_middleware(e, request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/core/handlers/base.py", line 154, in _get_response response = response.render() File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/response.py", line 106, in render self.content = self.rendered_content File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/response.py", line 83, in rendered_content content = template.render(context, self._request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/backends/django.py", line 61, in render return self.template.render(context) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/base.py", line 169, in render with context.bind_template(self): File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/template/context.py", line 246, in bind_template updates.update(processor(self.request)) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django_mailman3/context_processors.py", line 32, in common context["site_name"] = get_current_site(request).name File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/contrib/sites/shortcuts.py", line 13, in get_current_site return Site.objects.get_current(request) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/contrib/sites/models.py", line 60, in get_current return self._get_site_by_id(site_id) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/contrib/sites/models.py", line 32, in _get_site_by_id site = self.get(pk=site_id) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/db/models/manager.py", line 82, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/opt/mailman/web/venv/lib/python3.6/site-packages/django/db/models/query.py", line 399, in get self.model._meta.object_name django.contrib.sites.models.Site.DoesNotExist: Site matching query does not exist.

3 3

Automatic response to non-members
by daniel.eckhoff＠gmail.com March 8, 2019

March 8, 2019

Hi! I have a mailing list, where I accept every incoming message without subscription. I set this up for a recruitment website (jobs(a)xyz.org) It works nice. All mails are sent to archive where me and other admins can go through all applications. Now we want to set up an automatic response to incoming messages. I tried to set "Autorespond postings" but since the applicants are not subscribers, this won't work. I aso set the template for "Notice sent to a poster when their message has been received by the mailing list". Both approaches don't seem to work. Any ideas to get this working without relying on additional software?

2 1

Domain Resolving Issue
by brian＠emwd.com March 7, 2019

March 7, 2019

I am running a Mailman 3 server with about 5 list domains configured on it. Most of them resolve quickly both to Postorius and HyperKitty. However there is one domain that resolves very slowly. Once it does, access to other pages/tasks go quickly. If you don't do anything with that domain in the browser after about 5 minutes, it takes its time again to resolve. What could be causing this? The webserver is Nginx. Not sure if this is a Mailman 3 issue or not. Brian

2 1

Change settings via mailman shell
by kk＠eco.cept.org March 6, 2019

March 6, 2019

I am trying to find a way to set some parameters on the lists from a shell script. One specific parameter - max_message_size is not presented through the REST interface apparantly, and i found a way to set this with mailman shell command. Continuing this path i seem not to be able to set any other parameters like this: m.archive_policy = 'never' m.subject_prefix = '' m.dmarc_mitigate_action = 'munge_from' m.dmarc_mitigate_unconditionally = True commit() However i end up with this error: sqlalchemy.exc.StatementError: (builtins.AttributeError) 'str' object has no attribute 'value' [SQL: 'UPDATE mailinglist SET archive_policy=?, dmarc_mitigate_action=?, dmarc_mitigate_unconditionally=?, subject_prefix=? WHERE mailinglist.id = ?'] [parameters: [{'dmarc_mitigate_unconditionally': 'True', 'dmarc_mitigate_action': 'munge_from', 'subject_prefix': '', 'archive_policy': 'never', 'mailinglist_id': 65}]] Not sure what to make of it, but it seems like the fields are not there. I then proceed to get a list of all parameters with information found here: http://docs.mailman3.org/projects/mailmanclient/en/latest/src/mailmanclient… and the parameters seems to exist - however this list is made with the REST interface - so my question are - are there a difference in parameters in "mailman shell" command and REST interface - and how do i then get a list of parameter and possible settings in the "mailman shell" command ? Thanks in advance Kenneth Denmark

2 1

Mailman3 without Hyperkitty in docker
by Danil Smirnov March 4, 2019

March 4, 2019

Hi, I'm interesting in Mailman3 deployment with archiving feature completely disabled. I've tried to deploy Core + Postorius using this docker-compose template: https://github.com/maxking/docker-mailman/blob/master/docker-compose-postor… Unfortunately Postorius version came with this template is quite outdated: 1.2.0a1 (as reported in page footer). In Hyperkitty-enabled docker image I see version 1.2.3. I've also checked image maxking/postorius:rolling but it seems irrelevant/broken (container exits with error). Are there newer Postorius docker image I can use? Thanks, Danil Smirnov

3 18

Re: postorius only show 50 owner lists
by Alejandro Lopez March 3, 2019

March 3, 2019

Ok, thanks!

1 0

postorius only show 50 owner lists
by elalelopez＠gmail.com March 2, 2019

March 2, 2019

Hi, I have installed mailman3 suite on Debian 9. And postorius only lists up to 50 addresses when filter by owner: https: //lists.domain/mailman3/postorius/lists/? role = owner A first query in the database returns all the lists, but then, when it makes the subsequent queries for each list, it ends when it reaches 50. Any ideas? regards

2 3

Selective mailing
by chucka＠blackforest-co.com March 2, 2019

March 2, 2019

I'm trying to find out if I move my web site to a hosting company using MM Ver 3 - with SQL. If I have a membership list in MySql used by MM - can I send an email to a select group? ["Your dues are due"]. Assumes the MM tables can be accessed? Anyhow what I want to do is: send message96 where expire > next month else send message95 Thanks

4 7

From address of subscription notifications
by worik March 2, 2019

March 2, 2019

Friends When I subscribe some body to to a list I on I get a notification that says it comes from changeme(a)example.com As far as I can tell no subscribers are getting mail with that, so this is not a crises. But it is untidy and I cannot find where to change it. SERVE_FROM_DOMAIN is set in the mailman-web/environment section of docker-compose.yaml (I am using the docker distribution...) cheers Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

4 4

Managing users
by worik March 1, 2019

March 1, 2019

Is there a interface for managing users? I can use the data base directly to query `auth_user` etcetera, but Postorious? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 1

Bounces address spammed
by Enrique Terrazas Feb. 28, 2019

Feb. 28, 2019

Greetings, I hope everyone is having a good day. We have a highly visible list that is being spammed with join requests from spoofed addresses. When the confirmation email is sent a bounce is received by the list owner. The count is in the 100’s of bounced emails/hour. We noticed they are all coming from one particular domain, this may help if we are able to filter/block the domain. What would be the best way to handle this? Is there a way to handle this granularly at the list level? Thank you as always for your assistance. Enrique

2 2

Member occur in Subscription Requests when Subscription Policy = Confirm
by Henrik Rasmussen Feb. 27, 2019

Feb. 27, 2019

When Subscription Policy is set to Confirm (only), new potential subscriber appears in Subscription Requests until they have confirmed that they actually want to subscribe. As expected, the new potential subscriber receives a mail with a link to confirm. And also as expected, since moderation is NOT needed, the admin does not receive a mail about authorisation. Why does the new potential subscriber appear in Subscription Requests until confirmed by the subscriber, when the admin doesn't have to appove anyway? Is that by design? /Henrik Rasmussen

2 1

Archives visible to all
by worik Feb. 25, 2019

Feb. 25, 2019

When I load my new mailing list system, before I log in, I can see the archives of all the lists. Without logging in. Even lists with archives set to private archives. What can I do about that? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 3

Is logging.subscribe working in /etc/mailman.cfg?
by ktso＠cuhk.edu.hk Feb. 25, 2019

Feb. 25, 2019

I have put the following in /etc/mailman.cfg and restart mailman. An empty file can be created but nothing can be logged when admin or non-member subscribe/unsubscribe. Anything I have missed? So far I can only see log appear in mailman.log and smtp.log. Thanks. [logging.subscribe] path: subscribe.log level: debug

3 5

Changing delivery mode for ALL subscribers on a SINGLE list using REST
by Henrik Rasmussen Feb. 25, 2019

Feb. 25, 2019

While in Mailman Settings a user can change delivery mode for either Global (all subscriptions regardless of address or list), Address based (regardless of list name) or List Based (regardless of address). The list admin can change a user's delivery mode setting on a single list (affecting only that address and only that list), but only one subscriber at the time on the list. Changing a user's delivery mode can also be done using REST[1], but I asume this will affect the user's subscription on all the lists where she subscribed using the same address. How do I change ALL the subscribers[2] on a _single list_ to a certain delivery mode, using REST? [1] https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/preferences.… [2] Most likely by iterating through all subscribers, one at the time, on the list in question.

2 4

Tracking from gravatar
by worik Feb. 19, 2019

Feb. 19, 2019

Privacy badger reports one tracker (for which it disables cookies) on my Mailman installation. It is: secure.gravatar.com What is this for and how do I get rid of it? I looked at the site and it seems like some sort of take a avatar any where. I do not want that on the lists I am managing for this group of users. cheers Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

3 3

Turn off social logins?
by worik Feb. 18, 2019

Feb. 18, 2019

How do I turn off the social logins? I looked in the admin manual but They are not working, but I absolutely do not want them for now. Maybe one day, but my users will be allergic to even the hint.... Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

12 27

hyperkitty failed to create a thread
by Danil Smirnov Feb. 17, 2019

Feb. 17, 2019

Hi all, What could be a reason of HyperKitty failing to create a thread from chained emails? For example, see "RECENTLY ACTIVE DISCUSSIONS" on page https://wlug.mailman3.com/hyperkitty/list/wlug@lists.wlug.org/ "Openvpn and Network mapping" discussion displayed as five threads instead of only one... Any ideas how to improve HyperKitty ability to detect threaded messages? With my best regards, Danil Smirnov

6 19

Logging of unsubscribe process
by Johannes Winter Feb. 16, 2019

Feb. 16, 2019

Dear MM3 list, I was wondering whether the unsubscribe process is logged. One user accidentally hit "unsubscribe all" aborted the process but is now unsure whether he accidentally deleted users. Is there a easy way to check? Best regards, Johannes Winter

2 1

Remove message from send queue
by Johannes Winter Feb. 15, 2019

Feb. 15, 2019

Dear MM3 list, A address with false syntax got added accidentally to one of our lists. The smtp server now rejects the mail with the following error codes found in mailman.log: Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> recipients refused: {'l3s3105p7(a)91.55.218.102': (401, b'4.1.3 Bad recipient address syntax')} Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> smtp to xxx(a)yyy.com for 1 recips, completed in 0.031468868255615234 seconds Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> post to list from address(a)domain.tld, 767768 bytes, 1 failures Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> delivery to l3s3105p7(a)91.55.218.102 failed with code 401, b'4.1.3 Bad recipient address syntax' How to remove this mails from the queue? Removing the address from the list doesn't help. Best regards, Johannes Winter

2 1

Mass subscription maximum addresses
by Enrique Terrazas Feb. 14, 2019

Feb. 14, 2019

Greetings, Is there a maximum amount of accounts that can be imported using the postorius mass subscription application? I know we can import using the command line; some of our customers have very large mailing lists that change by semester. Trying to see how much of that work could be handled by the list owner rather than by the mailman admins. As always thank you for your time and assistance. Best regards, Enrique

2 1

Feature list / compare mailman3 <-> mailman3
by Torge Riedel Feb. 14, 2019

Feb. 14, 2019

Hi, here I have found an interesting sentence: https://mailman.readthedocs.io/en/latest/src/mailman/docs/release-notes.html "Mailman 3 is not yet feature complete with Mailman 2.1" Is there somewhere an overview of what is missing / different? Since I'm faced with changing the server where mailman is running on, I came up to install mailman3 instead of mailman2. Best regards Torge

2 1

Different (official?) documentations available - what is the correct one?
by Torge Riedel Feb. 14, 2019

Feb. 14, 2019

Hi, I've found two different documentations: http://docs.mailman3.org/en/latest/index.html https://mailman.readthedocs.io/en/latest/README.html Where the first one looks to me like the official documentation (when looking at the URL), the second one looks more up-to-date. Is there a reason behind it? Best regards Torge

2 1

Gmail emails bouncing - anybody seen this problem?
by worik Feb. 14, 2019

Feb. 14, 2019

Friends On a fresh install (docker) on a fresh VPS I am getting all Mailman messages to Gmail addresses bouncing telling me I am sending too many messages. Has anybody else have this problem? I am getting the following error in mail.log: "Our system has detected an unusual rate of 550-5.7.1 unsolicited mail originating from your IP address. To protect our 550-5.7.1 users from spam, mail sent from your IP address has been blocked. 550-5.7.1 Please visit 550-5.7.1 https://support.google.com/mail/?p=UnsolicitedIPError to review our 550 5.7.1 Bulk Email Senders Guidelines. l26si395949wme.8 - gsmtp" I have been to the URL mentioned and exhausted my options there. Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

3 6

Postorius 1.2.3 and MailmanClient 3.2.1 is now out
by Abhilash Raj Feb. 11, 2019

Feb. 11, 2019

Hi All, I am very pleased to announce (a bit late) that Postorius 1.2.3 and MailmanClient 3.2.1 is now out. The full set of changelog can be found in the documentation[1][2]. The most notable feature that I can think of is non-member management in Postorius. New releases are available on PyPI[3][4]. Thanks to all the contributors who made this release possible! :) [1]: https://postorius.readthedocs.io/en/latest/news.html#id2 [2]: https://mailmanclient.readthedocs.io/en/latest/src/mailmanclient/docs/NEWS.… [3]: https://pypi.org/project/mailmanclient/ [4]: https://pypi.org/project/postorius/ -- thanks, Abhilash Raj (maxking)

2 6

How can administrator sign people up to a list?
by worik Feb. 11, 2019

Feb. 11, 2019

As a list administrator, how do I add a group of email addresses to a list? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 3

Recommendation - Developer
by jk＠ascii.com Feb. 8, 2019

Feb. 8, 2019

Hi - we are currently seeking a developer to work with us on leveraging HyperKitty and our current use of mailman. Any suggestions is appreciated, please DM me at jk(a)ascii.com. Thank you in advance.

1 0

mailman start - can't open file
by Mark Dale Feb. 7, 2019

Feb. 7, 2019

Hi All, On a new installation (pip), when starting Mailman it seems it cannot find the "master" file. Have I missed a configuration somewhere that tells it to look in "/usr/local/bin" rather than "/usr/bin"? TIA, Mark root@sfo:/etc# mailman start Starting Mailman's master runner /usr/bin/python3: can't open file '/usr/bin/master': [Errno 2] No such file or directory root@sfo:/etc# ls -la /usr/local/bin total 1528 drwxrwsr-x 4 root staff 4096 Feb 7 05:22 . drwxrwsr-x 10 root staff 4096 Jan 23 23:12 .. -rwxr-xr-x 1 root staff 215 Feb 7 04:03 aiosmtpd -rwxr-xr-x 1 root staff 216 Feb 7 04:03 alembic -rwxr-xr-x 1 root staff 266 Feb 7 04:24 django-admin -rwxr-xr-x 1 root staff 125 Feb 7 04:24 django-admin.py -rwxr-xr-x 1 root staff 218 Feb 7 04:03 falcon-bench -rwxr-xr-x 1 root staff 225 Feb 7 04:03 falcon-print-routes -rwxr-xr-x 1 root staff 221 Feb 7 04:03 mailman -rwxr-xr-x 1 root staff 216 Feb 7 04:03 mako-render -rwxr-xr-x 1 root staff 220 Feb 7 04:03 master -rwxr-xr-x 1 root staff 214 Feb 7 04:03 nosetests -rwxr-xr-x 1 root staff 214 Feb 7 04:03 nosetests-3.4 drwxr-sr-x 2 root staff 4096 Feb 7 04:24 __pycache__ -rwxr-xr-x 1 root staff 220 Feb 7 04:03 runner -rwxr-xr-x 1 root staff 1496712 Feb 7 04:52 uwsgi drwxr-xr-x 12 root staff 4096 Feb 7 05:22 var root@sfo:/etc# mailman info GNU Mailman 3.2.0 (La Villa Strangiato) Python 3.7.2+ (default, Feb 2 2019, 14:31:48) [GCC 8.2.0] config file: /etc/mailman.cfg db url: sqlite:////etc/var/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:restpass

2 2

Strange error in uwsgi-error.log
by brian＠emwd.com Feb. 7, 2019

Feb. 7, 2019

I am seeing the following error being logged every few minutes: 18:50:29 [Q] INFO Process-1:7 processing [update_from_mailman] 18:50:29 [Q] ERROR malformed return hook '<function process_task_result at 0x7f588e8c5950>' for [update_from_mailman] 18:50:29 [Q] ERROR Failed [update_from_mailman] - null value in column "description" violates not-null constraint DETAIL: Failing row contains (1, testlist@"listdomain", Testlist, null, [Testlist] , 2, 2018-12-21 22:22:08.440729+00, testlist."listdomain"). : Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) psycopg2.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (1, testlist@"listdomain", Testlist, null, [Testlist] , 2, 2018-12-21 22:22:08.440729+00, testlist."listdomain"). The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/usr/lib/python3.6/site-packages/hyperkitty/tasks.py", line 66, in unlock_and_call return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/hyperkitty/tasks.py", line 293, in update_from_mailman mlist.update_from_mailman() File "/usr/lib/python3.6/site-packages/hyperkitty/models/mailinglist.py", line 192, in update_from_mailman self.save() File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 718, in save force_update=force_update, update_fields=update_fields) File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 748, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 812, in _save_table forced_update) File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 861, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 712, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1383, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1065, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 68, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 77, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) django.db.utils.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (1, testlist@"listdomain", Testlist, null, [Testlist] , 2, 2018-12-21 22:22:08.440729+00, testlist."listdomain"). Any ideas? Thanks, Brian

3 5

Various settings files for mailman3-web
by worik Feb. 7, 2019

Feb. 7, 2019

Friends What is the difference between the three settings*.py files in /usr/share/mailman3-web/? ~$ ls /usr/share/mailman3-web/settings* -l -rw-r--r-- 1 root root 14939 Feb 7 01:50 /usr/share/mailman3-web/settings.py lrwxrwxrwx 1 root root 28 Sep 17 11:00 /usr/share/mailman3-web/settings_local.py -> /etc/mailman3/mailman-web.py -rw-r--r-- 1 root root 6178 Sep 17 11:00 /usr/share/mailman3-web/settings_local.py.sample Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 1

Mass subscription in "file submit"
by erlonmz＠terra.com.br Feb. 5, 2019

Feb. 5, 2019

We would like add members using "file submit" "class ListMassSubscription(forms.Form): emails = forms.FileField( label='Select File' help_text='Select a file' ) " What is your opinion about this change?

2 1

Installation problem: Ubuntu 18.10 mailman3-full. EMAIL_HOST_USER
by worik Feb. 5, 2019

Feb. 5, 2019

Friends I am installing on a fresh ubuntu 18.10 using mailman3-full. Following http://docs.mailman3.org/en/latest/config-web.html after http://docs.mailman3.org/en/latest/config-core.html and I have got to point where I am a bit stumped. I have to set EMAIL_HOST_USER and EMAIL_HOST_PASSWORD I am unsure what I should use here. What sort of user? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 1

Using MySQL via unix socket
by Torge Riedel Feb. 2, 2019

Feb. 2, 2019

Hi, I'm trying to setup mailman3 on Linux and try to find out how the connection string must look like to let it accept unix sockets. A call to mysql -umailman -p successfully uses the socket on the machine and logs in. I tried mysql+pymysql://mailman:mailmanpass@127.0.0.1/mailman3?charset=utf8&use_unicode=1&unix_socket=/var/run/mysqld/mysqld.sock as the connection string but it says that mysql server is not available. Which is the same if remove the "unix_socket" parameter. I have found this parameter when searching the net, but I'm not sure if it is supported. Thanks in advance and best regards Torge

2 2

Audit Logs
by Enrique Terrazas Jan. 31, 2019

Jan. 31, 2019

Greetings, I’m wondering if there is an “audit log” of sorts to see who made changes to a specific list. What we’re after is a way of tracking, in case requested, who made additions or deletions of subscribers etc. I can see the DELETE commands in the ./mailman/logs/mailman.log file but it doesn’t specifically state who made the request. It can be inferred from the timestamps. I’m just wondering if there is somewhere else I should be looking for this information. Thank you, Enrique J. Terrazas

2 1

Issue with mySQLdb-module on Debian
by Bjoern Franke Jan. 24, 2019

Jan. 24, 2019

Hi, I already opened a debian bugreport for it, but I'm still wondering why the following issue appears: File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py", line 30, in <module> 'Did you install mysqlclient or MySQL-python?' % e django.core.exceptions.ImproperlyConfigured: Error loading MySQLdb module: No module named 'MySQLdb'. Did you install mysqlclient or MySQL-python? python3-pymysql, which is a dependency of mailman3-web and provides mySQLdb, is installed. (Maybe it's time to migrate to postgres.) Kind regards Bjoern

3 4

importing from google groups.
by Abhijith PA Jan. 23, 2019

Jan. 23, 2019

Hello. Is it possible to import google group archives to mailman3. With this[1] script, I was able to export archives. Please let me know if anyone have tried and succeeded. --abhijith [1] - https://github.com/icy/google-group-crawler

2 1

MAILMAN_HOST_IP_AUTO
by Johannes Winter Jan. 22, 2019

Jan. 22, 2019

Dear MM3 list, while doing some reboot proofing for our mailman setup, I once more ran into https://github.com/maxking/docker-mailman/issues/133. May it be that https://github.com/maxking/docker-mailman/pull/143 hasn't made it yet into the docker image maxking/mailman-web:0.2 which is the current recommended stable version? Would be real nice (for stability!) to have this feature included. Best regards, Johannes Winter

2 1

MAILMAN_HOST_IP_AUTO
by Johannes Winter Jan. 22, 2019

Jan. 22, 2019

Dear MM3 list, while doing some reboot proofing for our mailman setup, I once more ran into https://github.com/maxking/docker-mailman/issues/133. May it be that https://github.com/maxking/docker-mailman/pull/143 hasn't made it yet into the docker image maxking/mailman-web:0.2 which is the current recommended stable version? Would be real nice (for stability!) to have this feature included. Best regards, Johannes Winter

1 0

MIME Digests with posts and index inline likewise Plain Text Digests
by Henrik Rasmussen Jan. 18, 2019

Jan. 18, 2019

Please correct me if I'm wrong, but as I understand, Mailman attaches posts in a MIME Digest mail intead of inline in the digest mail itself, like Plain Text Digests does. Some mail readers like Gmail eventually displays attachments inline anyway, but readers like Outlook do not. Also the digest index seems to be posted as an attachment in MIME Digests. Would it be possible for Mailman to send both posts and index inline in the MIME digest? I am pretty sure it's not a feature yet, but if Mailman would be able to, I will submit an issue in core (I presume). /Henrik Rasmussen

2 1

Re: digests are created but not sent out
by "Jörg M. Schulz" Jan. 17, 2019

Jan. 17, 2019

Well, the template files seem to reside in the database, not on the filesystem. So maybe there is some other issue here?

1 0

Change domain, easy?
by Thor Atle Rustad Jan. 14, 2019

Jan. 14, 2019

Hello list, How can I change the domain (from spammedtodeath.example.org to newdomain.example.org. The change should apply to all relevant settings as well as existing lists. Sincerely, Thor Atle Rustad

2 1

MM3 Docker
by Odhiambo Washington Jan. 11, 2019

Jan. 11, 2019

[Requesting everyone to be patient with me because I am not so good with Linux, Docker is a completely new thing to me, and MM3, well....] So, I have a VM running Ubuntu-18.04. It is in a Data Centre somewhere. It has an IP n.n.n.n (a public IP). Also, it does not have high resources. However, I hope I can at least get to install MM3 and test it using https://asynchronous.in/docker-mailman/ If I could run MM3 using the apt-get install method, perhaps that would have made my life a bit easier, hoping that MM3 can actually be run in parallel with MM2.1 on the same host. Is anyone doing that already?? Anyway, I need some hand-holding using the docker method for now. I am reading the steps as documented on the https://asynchronous.in/docker-mailman/ and somethings aren't clear to me: I have created two files: (a) /opt/mailman/web/settings_local.py: SERVE_FROM_DOMAIN: 'mm3.my.co.ke' ALLOWED_HOSTS: 'my.co.ke' HYPERKITTY_API_KEY: 'Whatever' MAILMAN_ADMIN_USER: 'admin' MAILMAN_ADMIN_EMAIL: 'odhiambo(a)gmail.com' SECRET_KEY: 'Whatever' EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = '172.19.199.1' EMAIL_PORT = 25 (b) /opt/mailman/core/mailman-extra.cfg HYPERKITTY_API_KEY: 'Whatever' DATABASE_URL: 'mysql+pymysql://mailman:mailmanpass@database/mailmandb' DATABASE_TYPE: 'mysql' DATABASE_CLASS: 'mailman.database.mysql.MySQLDatabase' Questions: Are the formats correct? Do I use quotes or not? My docker-compuse.yaml: version: '2' services: mailman-core: image: maxking/mailman-core:latest container_name: mailman-core hostname: mailman-core volumes: - /opt/mailman/core:/opt/mailman/ links: - database:database depends_on: - database environment: - DATABASE_URL=mysql+pymysql://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=mysql - DATABASE_CLASS=mailman.database.mysql.MySQLDatabase - HYPERKITTY_API_KEY=someapikey networks: mailman: ipv4_address: 172.19.199.2 mailman-web: image: maxking/mailman-web:latest container_name: mailman-web hostname: mailman-web depends_on: - database links: - mailman-core:mailman-core - database:database volumes: - /opt/mailman/web:/opt/mailman-web-data environment: - DATABASE_URL=mysql://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=mysql - HYPERKITTY_API_KEY=someapikey - SECRET_KEY=thisisaverysecretkey - DYLD_LIBRARY_PATH=/usr/local/mysql/lib/ networks: mailman: ipv4_address: 172.19.199.3 database: environment: MYSQL_DATABASE: mailmandb MYSQL_USER: mailman MYSQL_PASSWORD: mailmanpass MYSQL_RANDOM_ROOT_PASSWORD: "yes" restart: always image: mariadb:10.3 volumes: - /opt/mailman/database:/var/lib/mysql After all that, I have run the following: wash@lists:~/docker-mailman$ docker-compose up -d Creating network "docker-mailman_mailman" with driver "bridge" Creating docker-mailman_database_1 ... done Creating mailman-core ... done Recreating 4b7bc1ecef65_mailman-web ... done Question - Should I assume everything is okay and proceed to the next steps? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

4 21

digests are created but not sent out
by "Jörg M. Schulz" Jan. 9, 2019

Jan. 9, 2019

sudo -u list mailman digests -vp tells that the most recent digest has been sent, but nobody receives these digests. No mail or other log file has any clue what has happened. digest_queue = config.switchboards['digest'] >>> digest_queue <mailman.core.switchboard.Switchboard object at 0x7f9c8ed14940> >>> digest_queue.files [] m.digest_send_periodic = True Normal, non-digest messages are sent correctly. Administrative messages as well. Using GNU Mailman 3.2.0 (La Villa Strangiato) Where could I look for errors / stuck queues? /var/lib/mailman3/lists /var/lib/mailman3/lists/mailman.unswolke.de /var/lib/mailman3/lists/mailman.unswolke.de/digest.2.3.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.3.2.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.4.2.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.2.6.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.2.4.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.4.1.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.3.1.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.4.3.mmdf

2 13

Docker-mailman (performance?): "AH00894: declining URL", "AH01077: declining URL", "AH01105: NOT Closing connection", "AH01076: url: ... proxyname: (null) proxyport: 0"
by Henrik Rasmussen Jan. 9, 2019

Jan. 9, 2019

I am using docker-mailman with GNU Mailman 3.2.0 (La Villa Strangiato). Even I have had no complains previously, a list admin have received proxy errors a couple of days. Right after one occurrence I immediately looked at the logs and while I had no related errors in the log files in /var/log/mailman/web/{uwsgi,uwsgi-error,mailmanweb}.log, the Apache log often shows "AH00894: declining URL", "AH01077: declining URL", "AH01105: NOT Closing connection", "AH01076: url: ... proxyname: (null) proxyport: 0". The errors seems to go back a long time, also on previous versions of Mailman, but no one have complained about it until now. Apache is version 2.4.6 on a RHEL 7 assuming Red Hat have backported any bugs about timeout previously know as hardcoded timeout of 30s etc. I assume therefore that even Mailman did not indicate any errors, it may have been too slow to respond. The server does not seem to be slow at all. Is there a way I can enhance the performance of Mailman (Docker)? I've asked about performance previously, but as I don't think my current question is related to REST, it's probably not related to https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…. Henrik

1 0

Removing Archives for a Deleted List
by kelly.close＠lrewater.com Jan. 9, 2019

Jan. 9, 2019

Renewing this question ... maybe, there is now a straightforward way to delete archives associated with a deleted list in MM3? Through the UI would be ideal, but if there is a command line approach, I can make that work. Searching the message boards has not turned up anything either way for me. Thoughts? ~Kelly

2 1

hyperkitty base_url
by Thomas Stein Jan. 8, 2019

Jan. 8, 2019

Hi all. Now I'm struggeling with configuring hyperkitty. It's not clear to me which base_url to set. Currently it's base_url: http://localhost:8001/hyperkitty/ but that leads to Jan 04 21:01:39 2019 (8322) HyperKitty failure on http://localhost:8000/hyperkitty/api/mailman/urls: <html><title>Auth required</title><body> <h1>Authorization Required</h1></body></html> (401) The api_key is set in /usr/share/mailman3-web/settings.py. I suppose I'm doing it wrong. Any hints appreciated. thanks and cheers t.

4 8

Auth question
by David Krantz Jan. 8, 2019

Jan. 8, 2019

Hi, I have of course activated password login as it was not possible to get the provider based logins to work (might be but not worth the time for me right now). Is there any way for an user to request a new password when it is forgotten? I presume that the Persona login is removed now. I cannot hide it in my version or at least I do not know how. cheers // David

6 25

Getting Archives to work - new setup on Ubuntu 18.04 (with mailman3-full pkg)
by kelly.close＠lrewater.com Jan. 8, 2019

Jan. 8, 2019

Happy New Year! I'm setting up my first Mailman 3 server and was delighted to find a distribution package for Ubuntu 18.04, since that's the environment I'm most familiar with working in, that installs an integrated mailman3-hyperkitty-postorius setup. The package install plus the additional config steps in the included README files have gotten me oh-so-very close! What isn't working yet are the archives, specifically the messages sent to lists showing up at .../mailman3/hyperkitty. I'm at a loss and I'm hoping maybe the folks on this list can help me bring it home. Messages are distributed to subscribers as they should be - subscribers can send from their emails or from the web site. People can subscribe, etc. It's all working great. Just no archives. I am able to successfully run these django-admin processes without errors (described here: http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required) I've run them all manually and then I've been running the minutely and hourly ones manually after each test message I send (haven't set up the actual cron jobs yet). I'm not sure what to try next or what info to provide here for help - can anyone suggest where I can look to see why archives aren't getting created, or let me know what information would be essential for me to post to get help on this? I'm using PostgreSQL for the database, Postfix for mail and Apache2 for the web server. Thanks for your time! ~Kelly

2 8

$member does not appear to be dereferencing correctly in moderated subscription requests
by Joel Lord Jan. 8, 2019

Jan. 8, 2019

So I'm having an issue with a new 3.2 install. All the lists I have are set to confirm + approve on new subscriptions, but it seems that no matter how a new subscription come in, it does not actually pass the applicant's name to the moderator. I've tested now with a new email address previously unknown to the system and made sure I filled in the name field in the form. I've tested with an email address previously KNOWN to the system (subscribed to other lists) that has its display name fields filled in AND filled in the name on the subscription form, and yet again with that account having cleared out the display name fields associated with the account. In all cases I was careful to be sure to fill in the name on the subscription form. Buried somewhere in the templates documenation I found that the $member template variable in the list:admin:action:subscribe.txt template is supposed to be both the email address and the display name of the person applying to subscribe, but it just doesn't appear to be coming up as more than just the email address. Have I missed something horribly, or did I come across a bug? -- Joel Lord

2 1

File Attachments
by brian＠emwd.com Jan. 8, 2019

Jan. 8, 2019

Happy Monday everyone. Are there any plans to include the ability to attach files via the web interface? Or did I miss something? Thanks, Brian

5 9

Mass subscriptions
by Enrique Terrazas Jan. 7, 2019

Jan. 7, 2019

Hello, One of our customers has requested a list that will include around 50,000 subscribers. The customers has provided the email addresses in a CSV file, is there a way to import this data to a mailman list from a CSV file or is the Mass Subscribe option the preferred method? Best regards, Enrique J. Terrazas

2 2

ARC support
by Marvin Gülker Jan. 5, 2019

Jan. 5, 2019

Hi everyone, I just stumbled over an in-progress standard called ARC. It is appearently intended to solve the problems DMARC causes for mailinglists if I understand correctly. Since I've not seen a summary of it somewhere, I just give the plain links to it: * Website: http://arc-spec.org/ * Draft: https://datatracker.ietf.org/doc/draft-ietf-dmarc-arc-protocol/ Will Mailman at some point support this new standard? Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

2 1

Avoiding the List name in TO or CC headers
by Asaf Ohayon Jan. 4, 2019

Jan. 4, 2019

Hello I've made a list personalized ( =2 in mailinglist table), So in TO: I see the actual member, But still I have the list address in CC header, Can this be removed ? 10x

3 2

no mails to list members
by Thomas Stein Jan. 4, 2019

Jan. 4, 2019

Hi all. I'm trying to upgrade my mailman2 installation to version 3. I thought lets test with on list first. I imported the list with: mailman import21 bla(a)lists.blabla.de bla/config.pck. This went well. Now i try to send an email to bla(a)lists.blabla.de but the message only got delivered to the mailman host. Jan 03 14:43:44 2019 (10434) Peer: ('127.0.0.1', 38784) Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) handling connection Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'LHLO shinymail.eu' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'MAIL FROM:<himbeere(a)meine-oma.de>' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) sender: himbeere(a)meine-oma.de Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'RCPT TO:<bla(a)lists.blabla.de>' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) recip: bla(a)lists.blabla.de Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'DATA' Jan 03 14:43:45 2019 (10434) ('127.0.0.1', 38784) Data: b'QUIT' Jan 03 14:43:45 2019 (10434) ('127.0.0.1', 38784) connection lost Jan 03 14:43:45 2019 (10434) Connection lost during _handle_client() No messages ar actually delivered to the list members. Can someone tell me where i have to look to solve this problem? The "Delivery status" is set to enabled. thanks and cheers t.

5 16

mailman3-suite not sending confirmation emails
by ccehb＠nus.edu.sg Jan. 4, 2019

Jan. 4, 2019

Hi, This is my first experience using mailman. I recently downloaded and setup mailman3 suite which comes with hyperkitty. I don't really understand why the email is not working. I had an external smtp server (mymailserver.com) residing on different IP from my web server that hosts mailman stuff. I had modified settings.py with debug = False and added the following: EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'mymailserver.com' EMAIL_PORT = 25 I also added these inside mailman.cfg [mta] outgoing: mailman.mta.deliver.deliver lmtp_host: 127.0.0.1 lmtp_port: 8024 smtp_host: mymailserver.com smtp_port: 25 Thanks for your help! I check the logs but there isn't anything. When I sign up, nothing happens and I can't figure out why?

2 1

mailman shell
by Alan So Jan. 3, 2019

Jan. 3, 2019

Sorry for my ignorance. May I know what should be imported before using mailman shell within Python? $ python3.6 Python 3.6.6 (default, Aug 13 2018, 18:24:23) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> command = cli('mailman.commands.cli_withlist.shell') Traceback (most recent call last): File "<stdin>", line 1, in <module> NameError: name 'cli' is not defined Link to documentation: https://mailman.readthedocs.io/en/latest/src/mailman/commands/docs/shell.ht…

3 6

Re: Getting Archives to work - new setup on Ubuntu 18.04 (with mailman3-full pkg)
by Abhijith PA Jan. 3, 2019

Jan. 3, 2019

Hi On Thursday 03 January 2019 06:39 AM, kelly.close(a)lrewater.com wrote: > Yes - lists are known to Hyperkitty but no, no Archived-At header > in received posts. > > But, Bingo! > > I hadn't looked at the log file immediately after trying to post a > message so I missed this. I don't know the solution yet but ... > what is this telling me? Something doesn't have the permissions it > needs somewhere... > > Jan 02 18:01:15 2019 (616) 127.0.0.1 - - "GET > /3.0/lists/mailman3_test.udfcd-lists.org/member/udfcd.alert(a)gmail.com > HTTP/1.1" 200 484 Jan 02 18:01:18 2019 (609) ACCEPT: > <20190103010115.530.63813@udmailman> Jan 02 18:01:18 2019 (615) > HyperKitty failure on > https://udfcd-lists.org/mailman3/hyperkitty/api/mailman/urls: > <html><title>Auth required</title><bod$ <h1>Authorization > Required</h1></body></html> (401) ... (that line repeates 4 times) > Jan 02 18:01:20 2019 (606) Exception in the HyperKitty archiver: > <html><title>Auth required</title><body> <h1>Authorization > Required</h1></body></html> Jan 02 18:01:20 2019 (606) Traceback > (most recent call last): File > "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", > line 154, in _archive_message url = self._send_message(mlist, msg) > File > "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", > line 210, in _send_message raise ValueError(result.text) > ValueError: <html><title>Auth required</title><body> > <h1>Authorization Required</h1></body></html> What is your base_url in mailman-hyperkitty.cfg ? --a

2 2

Mailman3 and Centos 7
by brian＠emwd.com Jan. 3, 2019

Jan. 3, 2019

Just a heads up for those wanting to install Mailman3 on a Centos 7 server, be aware of FirewallD. There are a number of ports and services you have to tell it to allow in order to get Mailman3 functional. More experienced sysadmins might know this but I did not.

2 2

How to get Mailman core to provide more debug info in a running environment
by Henrik Rasmussen Jan. 3, 2019

Jan. 3, 2019

Docker-mailman 0.1.1 I am using Mailman 3.1 in production and I am trying to debug a problem[1] so I tried to setting Mailman to provide more debug info in the smtp.log file[2]. I might have been doing it wrong, but in the mailman-extra.cfg I set [logging.smtp-failure] path: smtp.log and restarted Mailman, which stopped incoming mails until removing the added section. What is the correct way to get Mailman to provide more debug info in the smtp.log 1) https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… 2) http://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html… Henrik Rasmussen

4 5

Customizing Look and Feel?
by Joel Lord Dec. 31, 2018

Dec. 31, 2018

Is it possible to customize the look at feel of the web interface at all? I have some lists that really require that subscription requests include full name, to make the workload on the moderators, well, workable in keeping a closed list tight. I've found where the "Your name (optional)" text is in list_forms.py, but modifying that strikes me as a poor plan. Changing that text would be lovely. Actually making that field required would be seriously awesome. Is this possible in the current code base (3.2.0) without doing ill-advised things modifying source code? Thanks! -- Joel Lord Web Administrator, Alpha Psi Omega Grand Cast etc... etc... etc...

2 1

Converting non-members to members
by Alan So Dec. 27, 2018

Dec. 27, 2018

Postorius is not currently exposing non-members management. Our Mailman 2 users are currently using accept_these_nonmembers, hold_these_nonmembers and reject_these_nonmembers. We know that mailman import21 will change these to nonmembers entries in Mailman 3. Since list owners will still want to manage them, we tend to move all of them to members and turn off delivery status for them. However, we met some difficulties when we try to develop using mailman client. 1) If those non-members addresses already exist as members, we will encounter error when we subscribe for them: urllib.error.HTTPError: HTTP Error 409: b'Member already subscribed' 2) We cannot change the moderation_action: urllib.error.HTTPError: HTTP Error 400: b'Cannot convert parameters: moderation_action' 3) We cannot change the preference: urllib.error.HTTPError: HTTP Error 400: b'Cannot convert parameters: delivery_status' Are there any better ways to enable the list owners to manage those previously configured nonmembers' addresses through the web? Otherwise, we probably need to have some manual effort to overcome the above three issues. We know that we can always do the above manually but we got a lot of lists to migrate to Mailman 3.

2 3

Verification Failed Error
by brian＠emwd.com Dec. 23, 2018

Dec. 23, 2018

I am trying to get the reset password function to work but I am getting this error message: smtplib.SMTPRecipientsRefused: {'email(a)address.com': (550, b'Verification failed for <postorius(a)mailman3.hostname.com>\nUnknown user\nSender verify failed')} Brian

4 31

Docker Installation of Mailman -- The Hyperkitty Chronicles
by brian＠emwd.com Dec. 23, 2018

Dec. 23, 2018

Using Maxking's docker project to install mailman3, I have a fairly functional mailman3 installation. However Hyperkitty is not archiving or showing list participants like: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ This is my page: https://mailman3.emwd.com/hyperkitty/list/testlist@mailman3.emwd.com/ The docker documents really don't say much about getting HK up and running. Brian

3 9

Mailman3 and Exim setup
by brian＠emwd.com Dec. 21, 2018

Dec. 21, 2018

I am installing Mailman3 via the Docker image provided by maxking. In his instructions he says: "To use Exim4, it should be setup to relay emails from 172.19.199.3 and 172.19.199.2." I am not sure where in the exim.conf file this is done. I took a guess at: hostlist relay_from_hosts = localhost : 172.19.199.3 : 172.19.199.2 Was my guess wrong?

4 4

ONLY moderator senders messages
by erlonmz＠hotmail.com Dec. 21, 2018

Dec. 21, 2018

how to configure the mailman 3 for only moderators to send messages?

1 0

Mailman3 via Docker and NGINX
by brian＠emwd.com Dec. 19, 2018

Dec. 19, 2018

I have Mailman3 installed on CentOS 7 using maxking's docker image. I believe the installation went fine and running "curl http://172.19.199.3:8000/postorius/lists/" produces the correct output. I also will be using exim and nginx with this installation. It seems I am stuck with the nginx setup. I created a sitename.com.conf file in the /etc/nginx/conf.d folder. I have the following inputted there: server { listen 80; server_name `sitename.com`; location /static/ { alias /opt/mailman/web/static/; } location / { include uwsgi_params; uwsgi_pass 172.19.199.3:8000; uwsgi_read_timeout 300; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } } However when I go to http://sitename.com (obviously using an alias here for privacy reasons) I get the default nginx index page. Do I need to add anything to the main nginx.conf file to be able to see my mailman3 installation? Thank you for any assistance, Brian Carpenter

4 9

Templates
by David Krantz Dec. 19, 2018

Dec. 19, 2018

Hi. How do I set a template for one specific list? I want one list to have a special footer template. I have tried updating the database (template table) without effect so apparently the database is not used for templates or some kind of fallback is used to set it to the generic footer. Of course I also tried to restart mailman after that operation to try to rule out any caching-related problem. I want to use a file://-path as that is the least painful way of doing it. I also would like a solution to place a file in a special location. My current templates are in a .../var/templates/site/en/ structure with names like list:member:generic:footer.txt Cheers // David

4 14

Newbie Wants To Know About Multiple Lists
by Christopher Garwood Dec. 19, 2018

Dec. 19, 2018

Howdy, I am new to Mailman and there are so many things I would like to know. Before I try to find out how to install and configure the software, I need to know if, how and what is required for us to set up this software to deal with more than one email list. I am working with a plan to setup a CentOS VPS on which Mailman will be hosted. The objective is to host and administrate mailing list for the 3 entities that I am directly involved with. These lists must function completely unrelated to each other including the email addresses from which the emails & news letters are sent from. If this is possible can I be given information or a link to how it can be done and what is required?

2 2

disable-by-bounces
by erlonmz＠hotmail.com Dec. 19, 2018

Dec. 19, 2018

copying a question already made here last year "I want to delete members automatically from a mailing list if the delivery has failed after a certain time of attempts because his mailbox has been removed or his mail server has been shutdown." at the time Mailman 3 was in version 3.1, today we are in 3.2. is this option available?

2 1

Button unsubscribe
by erlonmz＠hotmail.com Dec. 17, 2018

Dec. 17, 2018

how to put a button unsubscribe in the message together with the part " LIST mailing list -- LIST@domain To unsubscribe send an email to LIST-leave@domain' I want to put this button in the emails to the users unsubscribe. it would already send the confirmation tolkien. my question is, has some place where generated tolkien is saved in mailman files?

3 4

Hyperkitty archives - new list not archived
by vaarcilal＠eafit.edu.co Dec. 12, 2018

Dec. 12, 2018

Hi!! I'm running mailman 3.2 on Ubuntu server 18.04. Installed it via pip inside a conda virtual environment. I'm having problems related to hyperkitty on which I'd really appreciate some help. When I try to access the archives of a mailing list named 'test-nov' it redirects me to 'example.com/hyperkitty/list/test-nov@example.com/', where a 404 appears and a 'No archived mailing-list by that name.' message is thrown by hyperkitty.views.mlist.overview. I'm not very experienced with django, so I could have made a mistake on any configuration. I have not configured an MX for my mail server yet, so I'm able to send emails but I can't recieve emails for my lists. Is this somehow related to a misconfigurated MTA? Which logs should I take into account? Regards, Vincent.

2 5

Mailman3-Web lots of database queries
by Stefan Tatschner Dec. 10, 2018

Dec. 10, 2018

Hey! I recently set up a mailman3 instance and it works quite nice. I use the debian packages from buster. After running the thing for a few days, I realized an unexpected network load (my postgres database is on a separate machine). Turning the postgres log on revealed that mailman3 constantly queries the database: [...] 2018-11-17 16:33:15.417 UTC [8304] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.385901+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.663 UTC [8305] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.621505+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.664 UTC [8306] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.624011+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.908 UTC [8308] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.870547+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.910 UTC [8307] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.871611+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.152 UTC [8310] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.116762+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.154 UTC [8309] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.114878+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.390 UTC [8311] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.358211+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.393 UTC [8312] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.359704+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.634 UTC [8313] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.596602+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.636 UTC [8314] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.598296+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.882 UTC [8315] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.842795+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.884 UTC [8316] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.841916+00:00'::timestamptz) LIMIT 1 [...] Is this behaviour intended? Stefan

4 12

Re: [Mailman-Users] Mailman 3 on Ubuntu 18.04
by Odhiambo Washington Dec. 9, 2018

Dec. 9, 2018

On Sun, 9 Dec 2018 at 22:37, Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/9/18 10:14 AM, Odhiambo Washington wrote: > > > > In my quest to run Mailman3, I obtained a VM running Ubuntu 18.04 and > > started on getting to run Mailman3. > > I found this link -> https://github.com/iomarmochtar/mailman3_ei > > It has instructions which looked fairly simple to get Mailman3 installed. > > However, I did encounter some hitches since the script is not meant for > > Ubuntu. > > > First, a more appropriate list for Mailman 3 is > mailman-users(a)mailman3.org > <https://lists.mailman3.org/mailman3/lists/mailman-users@mailman3.org/>. > I am shifting to that list, after this. > > Also, we find it very difficult to address issues arising from third > party packages and how-tos. See <https://wiki.list.org/x/12812344>. > > And, there is a Mailman 3 package for Debian/Ubuntu > > apt install mailman3-full > In all my searching, I never found this in any documentation. I must have been searching in the wild, or my FreeBSD-mindedness got me stuck to containers and VENVs. > > With a few runs and observing the logs and modifying the script at every > > step it encountered and error, I finally managed to install Mailman3. It > > seems this is what you guys call a virtual environment in the Linux > world? > > :-) > > > I think the virtual environment in this case is a Python thing, not a > Linux thing. > I agree with you on that. > <snip> > > > Much of what I snipped is specific to > <https://github.com/iomarmochtar/mailman3_ei>, the details of which I'm > not interested in learning. > That is fine. I have put it aside for now. > > > >>From this point now is where I need help - serious help in smoothening > > things up and getting to understand these venv stuff! > > > > So I did run 'service mailman3 start' but this seems to be waiting for > too > > long to drop me back into the CLI. > > I also run 'systemctl start supervisord' and that seems to work. What I > am > > not sure is whether 'systemctl stop supervisord' actually does what it is > > expected to do because after I execute it, I still see processes running > > that I think are related. > > > > So far, I have been able to access the webUI on my VM using > > https://N.N.N.N:9090 > > I created a domain. > > But when I create a test list, I get an error - and I do not have a clue > > which logfile would have the error details - nginx or mailman... (I am > 100% > > new to nginx). > > > The nginx logs generally aren't too useful. Both Mailman core and Django > write logs. Core's log is probably in var/log/mailman.log where is > defined in mailman.cfg as var_dir. Django's log is defined in Django's > settings in the LOGGING setting. > Which file contains Django's settings? > > So now, I am stuck at: > > 1. Creating the mailing list > > 2. Getting to know whether the archiver is installed and running > > 3. Knowing is there are cron jobs to be running (Mailman2 type of > thinking!) > > > See > <http://docs.mailman3.org/en/latest/config-core.html#configuring-cron-jobs > > > and > < > http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required > > > Great to see that. I'll read and see if I make heads or tails of the writeup. > > Ultimately I need to figure out: > > 1. How the mailman queue runners are started and stopped > > mailman start > Why not systemctl mailman start?? Just wondering, as that is what I am seeing is common in Ubuntu. Does this make the components start after a reboot? > > 2. Migrate s few lists from Mailman2 to this Mailman3 > > mailman import21 > <django management> hyperkitty_import > Please show me where that is documented. I have to pull my lists from an old machine to this new one. > > 3. Mailman3 should use MySQL storage and Exim4 as the MTA (I have > > configured these bits in mailman.cfg) > > > You also need to configure MySQL in Django. See the DATABASES setting in > the Django settings. > So, when you talk about Django settings, you are referring to mailman.cfg file??? :-) I have spent all my weekend till now, trying to figure all this out. Life seems a little easier with mm2.x .... Thank you. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 1

Do not send email "The results of your email commands"
by erlonmz＠hotmail.com Dec. 7, 2018

Dec. 7, 2018

Hello guys. Have to configure the mailman3 for not to send the e-mail " The results of your email commands" when an email is sent to "-leave@" and "-join@" ?? Sorry for my English, i from another country.

3 2

What is the difference between Mime Digest and Summary Digest in Mailman 3.2.0?
by Henrik Rasmussen Dec. 5, 2018

Dec. 5, 2018

Having tried both Outlook and Gmail, there doesn't seem to be any visible difference between Mime Digest and Summary Digest. Of cause Gmail shows both index and all posts inline while Outlook shows both index and all posts as attachments, but overall the two digest types doesn't seem different from each other. Is that corrent or did I miss something? /Henrik Rasmussen

2 1

Mysql issue in django migrations
by Peter Sørensen Dec. 5, 2018

Dec. 5, 2018

Hi, I have seen others having below problem: File "/usr/local/lib/python3.6/dist-packages/django/db/migrations/recorder.py", line 57, in ensure_schema raise MigrationSchemaMissing("Unable to create the django_migrations table (%s)" % exc) django.db.migrations.exceptions.MigrationSchemaMissing: Unable to create the django_migrations table ((1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '(6) NOT NULL)' at line 1")) But haven’t been able to find a proper solution. It’s not a syntax problem. Can anyone help ? Best regards Peter Sørensen/University of Southern Denmark

2 2