- Mailman-users - lists.mailman3.org

Remove message from send queue
by Johannes Winter 15 Feb '19

15 Feb '19

Dear MM3 list, A address with false syntax got added accidentally to one of our lists. The smtp server now rejects the mail with the following error codes found in mailman.log: Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> recipients refused: {'l3s3105p7(a)91.55.218.102': (401, b'4.1.3 Bad recipient address syntax')} Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> smtp to xxx(a)yyy.com for 1 recips, completed in 0.031468868255615234 seconds Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> post to list from address(a)domain.tld, 767768 bytes, 1 failures Feb 15 11:36:55 2019 (34) <bbd7a3da-32e7-ad12-4b5b-e250b3447639(a)domain.tld> delivery to l3s3105p7(a)91.55.218.102 failed with code 401, b'4.1.3 Bad recipient address syntax' How to remove this mails from the queue? Removing the address from the list doesn't help. Best regards, Johannes Winter

2 1

Mass subscription maximum addresses
by Enrique Terrazas 14 Feb '19

14 Feb '19

Greetings, Is there a maximum amount of accounts that can be imported using the postorius mass subscription application? I know we can import using the command line; some of our customers have very large mailing lists that change by semester. Trying to see how much of that work could be handled by the list owner rather than by the mailman admins. As always thank you for your time and assistance. Best regards, Enrique

2 1

Feature list / compare mailman3 <-> mailman3
by Torge Riedel 14 Feb '19

14 Feb '19

Hi, here I have found an interesting sentence: https://mailman.readthedocs.io/en/latest/src/mailman/docs/release-notes.html "Mailman 3 is not yet feature complete with Mailman 2.1" Is there somewhere an overview of what is missing / different? Since I'm faced with changing the server where mailman is running on, I came up to install mailman3 instead of mailman2. Best regards Torge

2 1

Different (official?) documentations available - what is the correct one?
by Torge Riedel 14 Feb '19

14 Feb '19

Hi, I've found two different documentations: http://docs.mailman3.org/en/latest/index.html https://mailman.readthedocs.io/en/latest/README.html Where the first one looks to me like the official documentation (when looking at the URL), the second one looks more up-to-date. Is there a reason behind it? Best regards Torge

2 1

Gmail emails bouncing - anybody seen this problem?
by worik 14 Feb '19

14 Feb '19

Friends On a fresh install (docker) on a fresh VPS I am getting all Mailman messages to Gmail addresses bouncing telling me I am sending too many messages. Has anybody else have this problem? I am getting the following error in mail.log: "Our system has detected an unusual rate of 550-5.7.1 unsolicited mail originating from your IP address. To protect our 550-5.7.1 users from spam, mail sent from your IP address has been blocked. 550-5.7.1 Please visit 550-5.7.1 https://support.google.com/mail/?p=UnsolicitedIPError to review our 550 5.7.1 Bulk Email Senders Guidelines. l26si395949wme.8 - gsmtp" I have been to the URL mentioned and exhausted my options there. Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

3 6

Postorius 1.2.3 and MailmanClient 3.2.1 is now out
by Abhilash Raj 11 Feb '19

11 Feb '19

Hi All, I am very pleased to announce (a bit late) that Postorius 1.2.3 and MailmanClient 3.2.1 is now out. The full set of changelog can be found in the documentation[1][2]. The most notable feature that I can think of is non-member management in Postorius. New releases are available on PyPI[3][4]. Thanks to all the contributors who made this release possible! :) [1]: https://postorius.readthedocs.io/en/latest/news.html#id2 [2]: https://mailmanclient.readthedocs.io/en/latest/src/mailmanclient/docs/NEWS.… [3]: https://pypi.org/project/mailmanclient/ [4]: https://pypi.org/project/postorius/ -- thanks, Abhilash Raj (maxking)

2 6

How can administrator sign people up to a list?
by worik 11 Feb '19

11 Feb '19

As a list administrator, how do I add a group of email addresses to a list? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 3

Recommendation - Developer
by jk＠ascii.com 08 Feb '19

08 Feb '19

Hi - we are currently seeking a developer to work with us on leveraging HyperKitty and our current use of mailman. Any suggestions is appreciated, please DM me at jk(a)ascii.com. Thank you in advance.

1 0

mailman start - can't open file
by Mark Dale 07 Feb '19

07 Feb '19

Hi All, On a new installation (pip), when starting Mailman it seems it cannot find the "master" file. Have I missed a configuration somewhere that tells it to look in "/usr/local/bin" rather than "/usr/bin"? TIA, Mark root@sfo:/etc# mailman start Starting Mailman's master runner /usr/bin/python3: can't open file '/usr/bin/master': [Errno 2] No such file or directory root@sfo:/etc# ls -la /usr/local/bin total 1528 drwxrwsr-x 4 root staff 4096 Feb 7 05:22 . drwxrwsr-x 10 root staff 4096 Jan 23 23:12 .. -rwxr-xr-x 1 root staff 215 Feb 7 04:03 aiosmtpd -rwxr-xr-x 1 root staff 216 Feb 7 04:03 alembic -rwxr-xr-x 1 root staff 266 Feb 7 04:24 django-admin -rwxr-xr-x 1 root staff 125 Feb 7 04:24 django-admin.py -rwxr-xr-x 1 root staff 218 Feb 7 04:03 falcon-bench -rwxr-xr-x 1 root staff 225 Feb 7 04:03 falcon-print-routes -rwxr-xr-x 1 root staff 221 Feb 7 04:03 mailman -rwxr-xr-x 1 root staff 216 Feb 7 04:03 mako-render -rwxr-xr-x 1 root staff 220 Feb 7 04:03 master -rwxr-xr-x 1 root staff 214 Feb 7 04:03 nosetests -rwxr-xr-x 1 root staff 214 Feb 7 04:03 nosetests-3.4 drwxr-sr-x 2 root staff 4096 Feb 7 04:24 __pycache__ -rwxr-xr-x 1 root staff 220 Feb 7 04:03 runner -rwxr-xr-x 1 root staff 1496712 Feb 7 04:52 uwsgi drwxr-xr-x 12 root staff 4096 Feb 7 05:22 var root@sfo:/etc# mailman info GNU Mailman 3.2.0 (La Villa Strangiato) Python 3.7.2+ (default, Feb 2 2019, 14:31:48) [GCC 8.2.0] config file: /etc/mailman.cfg db url: sqlite:////etc/var/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:restpass

2 2

Strange error in uwsgi-error.log
by brian＠emwd.com 07 Feb '19

07 Feb '19

I am seeing the following error being logged every few minutes: 18:50:29 [Q] INFO Process-1:7 processing [update_from_mailman] 18:50:29 [Q] ERROR malformed return hook '<function process_task_result at 0x7f588e8c5950>' for [update_from_mailman] 18:50:29 [Q] ERROR Failed [update_from_mailman] - null value in column "description" violates not-null constraint DETAIL: Failing row contains (1, testlist@"listdomain", Testlist, null, [Testlist] , 2, 2018-12-21 22:22:08.440729+00, testlist."listdomain"). : Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) psycopg2.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (1, testlist@"listdomain", Testlist, null, [Testlist] , 2, 2018-12-21 22:22:08.440729+00, testlist."listdomain"). The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/django_q/cluster.py", line 377, in worker res = f(*task['args'], **task['kwargs']) File "/usr/lib/python3.6/site-packages/hyperkitty/tasks.py", line 66, in unlock_and_call return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/hyperkitty/tasks.py", line 293, in update_from_mailman mlist.update_from_mailman() File "/usr/lib/python3.6/site-packages/hyperkitty/models/mailinglist.py", line 192, in update_from_mailman self.save() File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 718, in save force_update=force_update, update_fields=update_fields) File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 748, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 812, in _save_table forced_update) File "/usr/lib/python3.6/site-packages/django/db/models/base.py", line 861, in _do_update return filtered._update(values) > 0 File "/usr/lib/python3.6/site-packages/django/db/models/query.py", line 712, in _update return query.get_compiler(self.db).execute_sql(CURSOR) File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1383, in execute_sql cursor = super().execute_sql(result_type) File "/usr/lib/python3.6/site-packages/django/db/models/sql/compiler.py", line 1065, in execute_sql cursor.execute(sql, params) File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 68, in execute return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 77, in _execute_with_wrappers return executor(sql, params, many, context) File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) File "/usr/lib/python3.6/site-packages/django/db/utils.py", line 89, in __exit__ raise dj_exc_value.with_traceback(traceback) from exc_value File "/usr/lib/python3.6/site-packages/django/db/backends/utils.py", line 85, in _execute return self.cursor.execute(sql, params) django.db.utils.IntegrityError: null value in column "description" violates not-null constraint DETAIL: Failing row contains (1, testlist@"listdomain", Testlist, null, [Testlist] , 2, 2018-12-21 22:22:08.440729+00, testlist."listdomain"). Any ideas? Thanks, Brian

3 5

Various settings files for mailman3-web
by worik 07 Feb '19

07 Feb '19

Friends What is the difference between the three settings*.py files in /usr/share/mailman3-web/? ~$ ls /usr/share/mailman3-web/settings* -l -rw-r--r-- 1 root root 14939 Feb 7 01:50 /usr/share/mailman3-web/settings.py lrwxrwxrwx 1 root root 28 Sep 17 11:00 /usr/share/mailman3-web/settings_local.py -> /etc/mailman3/mailman-web.py -rw-r--r-- 1 root root 6178 Sep 17 11:00 /usr/share/mailman3-web/settings_local.py.sample Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 1

Mass subscription in "file submit"
by erlonmz＠terra.com.br 05 Feb '19

05 Feb '19

We would like add members using "file submit" "class ListMassSubscription(forms.Form): emails = forms.FileField( label='Select File' help_text='Select a file' ) " What is your opinion about this change?

2 1

Installation problem: Ubuntu 18.10 mailman3-full. EMAIL_HOST_USER
by worik 05 Feb '19

05 Feb '19

Friends I am installing on a fresh ubuntu 18.10 using mailman3-full. Following http://docs.mailman3.org/en/latest/config-web.html after http://docs.mailman3.org/en/latest/config-core.html and I have got to point where I am a bit stumped. I have to set EMAIL_HOST_USER and EMAIL_HOST_PASSWORD I am unsure what I should use here. What sort of user? Worik -- If not me then who? If not now then when? If not here then where? So, here I stand, I can do no other root(a)worik.org 021-1680650, (03) 4821804 Aotearoa (New Zealand)

2 1

Using MySQL via unix socket
by Torge Riedel 02 Feb '19

02 Feb '19

Hi, I'm trying to setup mailman3 on Linux and try to find out how the connection string must look like to let it accept unix sockets. A call to mysql -umailman -p successfully uses the socket on the machine and logs in. I tried mysql+pymysql://mailman:mailmanpass@127.0.0.1/mailman3?charset=utf8&use_unicode=1&unix_socket=/var/run/mysqld/mysqld.sock as the connection string but it says that mysql server is not available. Which is the same if remove the "unix_socket" parameter. I have found this parameter when searching the net, but I'm not sure if it is supported. Thanks in advance and best regards Torge

2 2

Audit Logs
by Enrique Terrazas 31 Jan '19

31 Jan '19

Greetings, I’m wondering if there is an “audit log” of sorts to see who made changes to a specific list. What we’re after is a way of tracking, in case requested, who made additions or deletions of subscribers etc. I can see the DELETE commands in the ./mailman/logs/mailman.log file but it doesn’t specifically state who made the request. It can be inferred from the timestamps. I’m just wondering if there is somewhere else I should be looking for this information. Thank you, Enrique J. Terrazas

2 1

Issue with mySQLdb-module on Debian
by Bjoern Franke 24 Jan '19

24 Jan '19

Hi, I already opened a debian bugreport for it, but I'm still wondering why the following issue appears: File "/usr/lib/python3/dist-packages/django/db/backends/mysql/base.py", line 30, in <module> 'Did you install mysqlclient or MySQL-python?' % e django.core.exceptions.ImproperlyConfigured: Error loading MySQLdb module: No module named 'MySQLdb'. Did you install mysqlclient or MySQL-python? python3-pymysql, which is a dependency of mailman3-web and provides mySQLdb, is installed. (Maybe it's time to migrate to postgres.) Kind regards Bjoern

3 4

importing from google groups.
by Abhijith PA 23 Jan '19

23 Jan '19

Hello. Is it possible to import google group archives to mailman3. With this[1] script, I was able to export archives. Please let me know if anyone have tried and succeeded. --abhijith [1] - https://github.com/icy/google-group-crawler

2 1

MAILMAN_HOST_IP_AUTO
by Johannes Winter 22 Jan '19

22 Jan '19

Dear MM3 list, while doing some reboot proofing for our mailman setup, I once more ran into https://github.com/maxking/docker-mailman/issues/133. May it be that https://github.com/maxking/docker-mailman/pull/143 hasn't made it yet into the docker image maxking/mailman-web:0.2 which is the current recommended stable version? Would be real nice (for stability!) to have this feature included. Best regards, Johannes Winter

2 1

MAILMAN_HOST_IP_AUTO
by Johannes Winter 22 Jan '19

22 Jan '19

Dear MM3 list, while doing some reboot proofing for our mailman setup, I once more ran into https://github.com/maxking/docker-mailman/issues/133. May it be that https://github.com/maxking/docker-mailman/pull/143 hasn't made it yet into the docker image maxking/mailman-web:0.2 which is the current recommended stable version? Would be real nice (for stability!) to have this feature included. Best regards, Johannes Winter

1 0

MIME Digests with posts and index inline likewise Plain Text Digests
by Henrik Rasmussen 18 Jan '19

18 Jan '19

Please correct me if I'm wrong, but as I understand, Mailman attaches posts in a MIME Digest mail intead of inline in the digest mail itself, like Plain Text Digests does. Some mail readers like Gmail eventually displays attachments inline anyway, but readers like Outlook do not. Also the digest index seems to be posted as an attachment in MIME Digests. Would it be possible for Mailman to send both posts and index inline in the MIME digest? I am pretty sure it's not a feature yet, but if Mailman would be able to, I will submit an issue in core (I presume). /Henrik Rasmussen

2 1

Re: digests are created but not sent out
by "Jörg M. Schulz" 17 Jan '19

17 Jan '19

Well, the template files seem to reside in the database, not on the filesystem. So maybe there is some other issue here?

1 0

Change domain, easy?
by Thor Atle Rustad 14 Jan '19

14 Jan '19

Hello list, How can I change the domain (from spammedtodeath.example.org to newdomain.example.org. The change should apply to all relevant settings as well as existing lists. Sincerely, Thor Atle Rustad

2 1

MM3 Docker
by Odhiambo Washington 11 Jan '19

11 Jan '19

[Requesting everyone to be patient with me because I am not so good with Linux, Docker is a completely new thing to me, and MM3, well....] So, I have a VM running Ubuntu-18.04. It is in a Data Centre somewhere. It has an IP n.n.n.n (a public IP). Also, it does not have high resources. However, I hope I can at least get to install MM3 and test it using https://asynchronous.in/docker-mailman/ If I could run MM3 using the apt-get install method, perhaps that would have made my life a bit easier, hoping that MM3 can actually be run in parallel with MM2.1 on the same host. Is anyone doing that already?? Anyway, I need some hand-holding using the docker method for now. I am reading the steps as documented on the https://asynchronous.in/docker-mailman/ and somethings aren't clear to me: I have created two files: (a) /opt/mailman/web/settings_local.py: SERVE_FROM_DOMAIN: 'mm3.my.co.ke' ALLOWED_HOSTS: 'my.co.ke' HYPERKITTY_API_KEY: 'Whatever' MAILMAN_ADMIN_USER: 'admin' MAILMAN_ADMIN_EMAIL: 'odhiambo(a)gmail.com' SECRET_KEY: 'Whatever' EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = '172.19.199.1' EMAIL_PORT = 25 (b) /opt/mailman/core/mailman-extra.cfg HYPERKITTY_API_KEY: 'Whatever' DATABASE_URL: 'mysql+pymysql://mailman:mailmanpass@database/mailmandb' DATABASE_TYPE: 'mysql' DATABASE_CLASS: 'mailman.database.mysql.MySQLDatabase' Questions: Are the formats correct? Do I use quotes or not? My docker-compuse.yaml: version: '2' services: mailman-core: image: maxking/mailman-core:latest container_name: mailman-core hostname: mailman-core volumes: - /opt/mailman/core:/opt/mailman/ links: - database:database depends_on: - database environment: - DATABASE_URL=mysql+pymysql://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=mysql - DATABASE_CLASS=mailman.database.mysql.MySQLDatabase - HYPERKITTY_API_KEY=someapikey networks: mailman: ipv4_address: 172.19.199.2 mailman-web: image: maxking/mailman-web:latest container_name: mailman-web hostname: mailman-web depends_on: - database links: - mailman-core:mailman-core - database:database volumes: - /opt/mailman/web:/opt/mailman-web-data environment: - DATABASE_URL=mysql://mailman:mailmanpass@database/mailmandb - DATABASE_TYPE=mysql - HYPERKITTY_API_KEY=someapikey - SECRET_KEY=thisisaverysecretkey - DYLD_LIBRARY_PATH=/usr/local/mysql/lib/ networks: mailman: ipv4_address: 172.19.199.3 database: environment: MYSQL_DATABASE: mailmandb MYSQL_USER: mailman MYSQL_PASSWORD: mailmanpass MYSQL_RANDOM_ROOT_PASSWORD: "yes" restart: always image: mariadb:10.3 volumes: - /opt/mailman/database:/var/lib/mysql After all that, I have run the following: wash@lists:~/docker-mailman$ docker-compose up -d Creating network "docker-mailman_mailman" with driver "bridge" Creating docker-mailman_database_1 ... done Creating mailman-core ... done Recreating 4b7bc1ecef65_mailman-web ... done Question - Should I assume everything is okay and proceed to the next steps? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

4 21

digests are created but not sent out
by "Jörg M. Schulz" 09 Jan '19

09 Jan '19

sudo -u list mailman digests -vp tells that the most recent digest has been sent, but nobody receives these digests. No mail or other log file has any clue what has happened. digest_queue = config.switchboards['digest'] >>> digest_queue <mailman.core.switchboard.Switchboard object at 0x7f9c8ed14940> >>> digest_queue.files [] m.digest_send_periodic = True Normal, non-digest messages are sent correctly. Administrative messages as well. Using GNU Mailman 3.2.0 (La Villa Strangiato) Where could I look for errors / stuck queues? /var/lib/mailman3/lists /var/lib/mailman3/lists/mailman.unswolke.de /var/lib/mailman3/lists/mailman.unswolke.de/digest.2.3.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.3.2.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.4.2.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.2.6.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.2.4.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.4.1.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.3.1.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.mmdf /var/lib/mailman3/lists/mailman.unswolke.de/digest.4.3.mmdf

2 13

Docker-mailman (performance?): "AH00894: declining URL", "AH01077: declining URL", "AH01105: NOT Closing connection", "AH01076: url: ... proxyname: (null) proxyport: 0"
by Henrik Rasmussen 09 Jan '19

09 Jan '19

I am using docker-mailman with GNU Mailman 3.2.0 (La Villa Strangiato). Even I have had no complains previously, a list admin have received proxy errors a couple of days. Right after one occurrence I immediately looked at the logs and while I had no related errors in the log files in /var/log/mailman/web/{uwsgi,uwsgi-error,mailmanweb}.log, the Apache log often shows "AH00894: declining URL", "AH01077: declining URL", "AH01105: NOT Closing connection", "AH01076: url: ... proxyname: (null) proxyport: 0". The errors seems to go back a long time, also on previous versions of Mailman, but no one have complained about it until now. Apache is version 2.4.6 on a RHEL 7 assuming Red Hat have backported any bugs about timeout previously know as hardcoded timeout of 30s etc. I assume therefore that even Mailman did not indicate any errors, it may have been too slow to respond. The server does not seem to be slow at all. Is there a way I can enhance the performance of Mailman (Docker)? I've asked about performance previously, but as I don't think my current question is related to REST, it's probably not related to https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…. Henrik

1 0

Removing Archives for a Deleted List
by kelly.close＠lrewater.com 09 Jan '19

09 Jan '19

Renewing this question ... maybe, there is now a straightforward way to delete archives associated with a deleted list in MM3? Through the UI would be ideal, but if there is a command line approach, I can make that work. Searching the message boards has not turned up anything either way for me. Thoughts? ~Kelly

2 1

hyperkitty base_url
by Thomas Stein 08 Jan '19

08 Jan '19

Hi all. Now I'm struggeling with configuring hyperkitty. It's not clear to me which base_url to set. Currently it's base_url: http://localhost:8001/hyperkitty/ but that leads to Jan 04 21:01:39 2019 (8322) HyperKitty failure on http://localhost:8000/hyperkitty/api/mailman/urls: <html><title>Auth required</title><body> <h1>Authorization Required</h1></body></html> (401) The api_key is set in /usr/share/mailman3-web/settings.py. I suppose I'm doing it wrong. Any hints appreciated. thanks and cheers t.

4 8

Auth question
by David Krantz 08 Jan '19

08 Jan '19

Hi, I have of course activated password login as it was not possible to get the provider based logins to work (might be but not worth the time for me right now). Is there any way for an user to request a new password when it is forgotten? I presume that the Persona login is removed now. I cannot hide it in my version or at least I do not know how. cheers // David

6 25

Getting Archives to work - new setup on Ubuntu 18.04 (with mailman3-full pkg)
by kelly.close＠lrewater.com 08 Jan '19

08 Jan '19

Happy New Year! I'm setting up my first Mailman 3 server and was delighted to find a distribution package for Ubuntu 18.04, since that's the environment I'm most familiar with working in, that installs an integrated mailman3-hyperkitty-postorius setup. The package install plus the additional config steps in the included README files have gotten me oh-so-very close! What isn't working yet are the archives, specifically the messages sent to lists showing up at .../mailman3/hyperkitty. I'm at a loss and I'm hoping maybe the folks on this list can help me bring it home. Messages are distributed to subscribers as they should be - subscribers can send from their emails or from the web site. People can subscribe, etc. It's all working great. Just no archives. I am able to successfully run these django-admin processes without errors (described here: http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required). I've run them all manually and then I've been running the minutely and hourly ones manually after each test message I send (haven't set up the actual cron jobs yet). I'm not sure what to try next or what info to provide here for help - can anyone suggest where I can look to see why archives aren't getting created, or let me know what information would be essential for me to post to get help on this? I'm using PostgreSQL for the database, Postfix for mail and Apache2 for the web server. Thanks for your time! ~Kelly

2 8

$member does not appear to be dereferencing correctly in moderated subscription requests
by Joel Lord 08 Jan '19

08 Jan '19

So I'm having an issue with a new 3.2 install. All the lists I have are set to confirm + approve on new subscriptions, but it seems that no matter how a new subscription come in, it does not actually pass the applicant's name to the moderator. I've tested now with a new email address previously unknown to the system and made sure I filled in the name field in the form. I've tested with an email address previously KNOWN to the system (subscribed to other lists) that has its display name fields filled in AND filled in the name on the subscription form, and yet again with that account having cleared out the display name fields associated with the account. In all cases I was careful to be sure to fill in the name on the subscription form. Buried somewhere in the templates documenation I found that the $member template variable in the list:admin:action:subscribe.txt template is supposed to be both the email address and the display name of the person applying to subscribe, but it just doesn't appear to be coming up as more than just the email address. Have I missed something horribly, or did I come across a bug? -- Joel Lord

2 1

File Attachments
by brian＠emwd.com 08 Jan '19

08 Jan '19

Happy Monday everyone. Are there any plans to include the ability to attach files via the web interface? Or did I miss something? Thanks, Brian

5 9

Mass subscriptions
by Enrique Terrazas 07 Jan '19

07 Jan '19

Hello, One of our customers has requested a list that will include around 50,000 subscribers. The customers has provided the email addresses in a CSV file, is there a way to import this data to a mailman list from a CSV file or is the Mass Subscribe option the preferred method? Best regards, Enrique J. Terrazas

2 2

ARC support
by Marvin Gülker 05 Jan '19

05 Jan '19

Hi everyone, I just stumbled over an in-progress standard called ARC. It is appearently intended to solve the problems DMARC causes for mailinglists if I understand correctly. Since I've not seen a summary of it somewhere, I just give the plain links to it: * Website: http://arc-spec.org/ * Draft: https://datatracker.ietf.org/doc/draft-ietf-dmarc-arc-protocol/ Will Mailman at some point support this new standard? Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

2 1

Avoiding the List name in TO or CC headers
by Asaf Ohayon 04 Jan '19

04 Jan '19

Hello I've made a list personalized ( =2 in mailinglist table), So in TO: I see the actual member, But still I have the list address in CC header, Can this be removed ? 10x

3 2

no mails to list members
by Thomas Stein 04 Jan '19

04 Jan '19

Hi all. I'm trying to upgrade my mailman2 installation to version 3. I thought lets test with on list first. I imported the list with: mailman import21 bla(a)lists.blabla.de bla/config.pck. This went well. Now i try to send an email to bla(a)lists.blabla.de but the message only got delivered to the mailman host. Jan 03 14:43:44 2019 (10434) Peer: ('127.0.0.1', 38784) Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) handling connection Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'LHLO shinymail.eu' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'MAIL FROM:<himbeere(a)meine-oma.de>' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) sender: himbeere(a)meine-oma.de Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'RCPT TO:<bla(a)lists.blabla.de>' Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) recip: bla(a)lists.blabla.de Jan 03 14:43:44 2019 (10434) ('127.0.0.1', 38784) Data: b'DATA' Jan 03 14:43:45 2019 (10434) ('127.0.0.1', 38784) Data: b'QUIT' Jan 03 14:43:45 2019 (10434) ('127.0.0.1', 38784) connection lost Jan 03 14:43:45 2019 (10434) Connection lost during _handle_client() No messages ar actually delivered to the list members. Can someone tell me where i have to look to solve this problem? The "Delivery status" is set to enabled. thanks and cheers t.

5 16

mailman3-suite not sending confirmation emails
by ccehb＠nus.edu.sg 04 Jan '19

04 Jan '19

Hi, This is my first experience using mailman. I recently downloaded and setup mailman3 suite which comes with hyperkitty. I don't really understand why the email is not working. I had an external smtp server (mymailserver.com) residing on different IP from my web server that hosts mailman stuff. I had modified settings.py with debug = False and added the following: EMAIL_BACKEND = 'django.core.mail.backends.smtp.EmailBackend' EMAIL_HOST = 'mymailserver.com' EMAIL_PORT = 25 I also added these inside mailman.cfg [mta] outgoing: mailman.mta.deliver.deliver lmtp_host: 127.0.0.1 lmtp_port: 8024 smtp_host: mymailserver.com smtp_port: 25 Thanks for your help! I check the logs but there isn't anything. When I sign up, nothing happens and I can't figure out why?

2 1

mailman shell
by Alan So 03 Jan '19

03 Jan '19

Sorry for my ignorance. May I know what should be imported before using mailman shell within Python? $ python3.6 Python 3.6.6 (default, Aug 13 2018, 18:24:23) [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux Type "help", "copyright", "credits" or "license" for more information. >>> command = cli('mailman.commands.cli_withlist.shell') Traceback (most recent call last): File "<stdin>", line 1, in <module> NameError: name 'cli' is not defined Link to documentation: https://mailman.readthedocs.io/en/latest/src/mailman/commands/docs/shell.ht…

3 6

Re: Getting Archives to work - new setup on Ubuntu 18.04 (with mailman3-full pkg)
by Abhijith PA 03 Jan '19

03 Jan '19

Hi On Thursday 03 January 2019 06:39 AM, kelly.close(a)lrewater.com wrote: > Yes - lists are known to Hyperkitty but no, no Archived-At header > in received posts. > > But, Bingo! > > I hadn't looked at the log file immediately after trying to post a > message so I missed this. I don't know the solution yet but ... > what is this telling me? Something doesn't have the permissions it > needs somewhere... > > Jan 02 18:01:15 2019 (616) 127.0.0.1 - - "GET > /3.0/lists/mailman3_test.udfcd-lists.org/member/udfcd.alert(a)gmail.com > HTTP/1.1" 200 484 Jan 02 18:01:18 2019 (609) ACCEPT: > <20190103010115.530.63813@udmailman> Jan 02 18:01:18 2019 (615) > HyperKitty failure on > https://udfcd-lists.org/mailman3/hyperkitty/api/mailman/urls: > <html><title>Auth required</title><bod$ <h1>Authorization > Required</h1></body></html> (401) ... (that line repeates 4 times) > Jan 02 18:01:20 2019 (606) Exception in the HyperKitty archiver: > <html><title>Auth required</title><body> <h1>Authorization > Required</h1></body></html> Jan 02 18:01:20 2019 (606) Traceback > (most recent call last): File > "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", > line 154, in _archive_message url = self._send_message(mlist, msg) > File > "/usr/lib/python3/dist-packages/mailman_hyperkitty/__init__.py", > line 210, in _send_message raise ValueError(result.text) > ValueError: <html><title>Auth required</title><body> > <h1>Authorization Required</h1></body></html> What is your base_url in mailman-hyperkitty.cfg ? --a

2 2

Mailman3 and Centos 7
by brian＠emwd.com 03 Jan '19

03 Jan '19

Just a heads up for those wanting to install Mailman3 on a Centos 7 server, be aware of FirewallD. There are a number of ports and services you have to tell it to allow in order to get Mailman3 functional. More experienced sysadmins might know this but I did not.

2 2

How to get Mailman core to provide more debug info in a running environment
by Henrik Rasmussen 03 Jan '19

03 Jan '19

Docker-mailman 0.1.1 I am using Mailman 3.1 in production and I am trying to debug a problem[1] so I tried to setting Mailman to provide more debug info in the smtp.log file[2]. I might have been doing it wrong, but in the mailman-extra.cfg I set [logging.smtp-failure] path: smtp.log and restarted Mailman, which stopped incoming mails until removing the added section. What is the correct way to get Mailman to provide more debug info in the smtp.log 1) https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… 2) http://mailman.readthedocs.io/en/latest/src/mailman/config/docs/config.html… Henrik Rasmussen

4 5

Customizing Look and Feel?
by Joel Lord 31 Dec '18

31 Dec '18

Is it possible to customize the look at feel of the web interface at all? I have some lists that really require that subscription requests include full name, to make the workload on the moderators, well, workable in keeping a closed list tight. I've found where the "Your name (optional)" text is in list_forms.py, but modifying that strikes me as a poor plan. Changing that text would be lovely. Actually making that field required would be seriously awesome. Is this possible in the current code base (3.2.0) without doing ill-advised things modifying source code? Thanks! -- Joel Lord Web Administrator, Alpha Psi Omega Grand Cast etc... etc... etc...

2 1

Converting non-members to members
by Alan So 27 Dec '18

27 Dec '18

Postorius is not currently exposing non-members management. Our Mailman 2 users are currently using accept_these_nonmembers, hold_these_nonmembers and reject_these_nonmembers. We know that mailman import21 will change these to nonmembers entries in Mailman 3. Since list owners will still want to manage them, we tend to move all of them to members and turn off delivery status for them. However, we met some difficulties when we try to develop using mailman client. 1) If those non-members addresses already exist as members, we will encounter error when we subscribe for them: urllib.error.HTTPError: HTTP Error 409: b'Member already subscribed' 2) We cannot change the moderation_action: urllib.error.HTTPError: HTTP Error 400: b'Cannot convert parameters: moderation_action' 3) We cannot change the preference: urllib.error.HTTPError: HTTP Error 400: b'Cannot convert parameters: delivery_status' Are there any better ways to enable the list owners to manage those previously configured nonmembers' addresses through the web? Otherwise, we probably need to have some manual effort to overcome the above three issues. We know that we can always do the above manually but we got a lot of lists to migrate to Mailman 3.

2 3

Verification Failed Error
by brian＠emwd.com 23 Dec '18

23 Dec '18

I am trying to get the reset password function to work but I am getting this error message: smtplib.SMTPRecipientsRefused: {'email(a)address.com': (550, b'Verification failed for <postorius(a)mailman3.hostname.com>\nUnknown user\nSender verify failed')} Brian

4 31

Docker Installation of Mailman -- The Hyperkitty Chronicles
by brian＠emwd.com 23 Dec '18

23 Dec '18

Using Maxking's docker project to install mailman3, I have a fairly functional mailman3 installation. However Hyperkitty is not archiving or showing list participants like: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/ This is my page: https://mailman3.emwd.com/hyperkitty/list/testlist@mailman3.emwd.com/ The docker documents really don't say much about getting HK up and running. Brian

3 9

Mailman3 and Exim setup
by brian＠emwd.com 21 Dec '18

21 Dec '18

I am installing Mailman3 via the Docker image provided by maxking. In his instructions he says: "To use Exim4, it should be setup to relay emails from 172.19.199.3 and 172.19.199.2." I am not sure where in the exim.conf file this is done. I took a guess at: hostlist relay_from_hosts = localhost : 172.19.199.3 : 172.19.199.2 Was my guess wrong?

4 4

ONLY moderator senders messages
by erlonmz＠hotmail.com 21 Dec '18

21 Dec '18

how to configure the mailman 3 for only moderators to send messages?

1 0

Mailman3 via Docker and NGINX
by brian＠emwd.com 19 Dec '18

19 Dec '18

I have Mailman3 installed on CentOS 7 using maxking's docker image. I believe the installation went fine and running "curl http://172.19.199.3:8000/postorius/lists/" produces the correct output. I also will be using exim and nginx with this installation. It seems I am stuck with the nginx setup. I created a sitename.com.conf file in the /etc/nginx/conf.d folder. I have the following inputted there: server { listen 80; server_name `sitename.com`; location /static/ { alias /opt/mailman/web/static/; } location / { include uwsgi_params; uwsgi_pass 172.19.199.3:8000; uwsgi_read_timeout 300; proxy_set_header Host $host; proxy_set_header X-Forwarded-For $remote_addr; } } However when I go to http://sitename.com (obviously using an alias here for privacy reasons) I get the default nginx index page. Do I need to add anything to the main nginx.conf file to be able to see my mailman3 installation? Thank you for any assistance, Brian Carpenter

4 9

Templates
by David Krantz 19 Dec '18

19 Dec '18

Hi. How do I set a template for one specific list? I want one list to have a special footer template. I have tried updating the database (template table) without effect so apparently the database is not used for templates or some kind of fallback is used to set it to the generic footer. Of course I also tried to restart mailman after that operation to try to rule out any caching-related problem. I want to use a file://-path as that is the least painful way of doing it. I also would like a solution to place a file in a special location. My current templates are in a .../var/templates/site/en/ structure with names like list:member:generic:footer.txt Cheers // David

4 14

Newbie Wants To Know About Multiple Lists
by Christopher Garwood 19 Dec '18

19 Dec '18

Howdy, I am new to Mailman and there are so many things I would like to know. Before I try to find out how to install and configure the software, I need to know if, how and what is required for us to set up this software to deal with more than one email list. I am working with a plan to setup a CentOS VPS on which Mailman will be hosted. The objective is to host and administrate mailing list for the 3 entities that I am directly involved with. These lists must function completely unrelated to each other including the email addresses from which the emails & news letters are sent from. If this is possible can I be given information or a link to how it can be done and what is required?

2 2

disable-by-bounces
by erlonmz＠hotmail.com 19 Dec '18

19 Dec '18

copying a question already made here last year "I want to delete members automatically from a mailing list if the delivery has failed after a certain time of attempts because his mailbox has been removed or his mail server has been shutdown." at the time Mailman 3 was in version 3.1, today we are in 3.2. is this option available?

2 1

Button unsubscribe
by erlonmz＠hotmail.com 17 Dec '18

17 Dec '18

how to put a button unsubscribe in the message together with the part " LIST mailing list -- LIST@domain To unsubscribe send an email to LIST-leave@domain' I want to put this button in the emails to the users unsubscribe. it would already send the confirmation tolkien. my question is, has some place where generated tolkien is saved in mailman files?

3 4

Hyperkitty archives - new list not archived
by vaarcilal＠eafit.edu.co 12 Dec '18

12 Dec '18

Hi!! I'm running mailman 3.2 on Ubuntu server 18.04. Installed it via pip inside a conda virtual environment. I'm having problems related to hyperkitty on which I'd really appreciate some help. When I try to access the archives of a mailing list named 'test-nov' it redirects me to 'example.com/hyperkitty/list/test-nov@example.com/', where a 404 appears and a 'No archived mailing-list by that name.' message is thrown by hyperkitty.views.mlist.overview. I'm not very experienced with django, so I could have made a mistake on any configuration. I have not configured an MX for my mail server yet, so I'm able to send emails but I can't recieve emails for my lists. Is this somehow related to a misconfigurated MTA? Which logs should I take into account? Regards, Vincent.

2 5

Mailman3-Web lots of database queries
by Stefan Tatschner 10 Dec '18

10 Dec '18

Hey! I recently set up a mailman3 instance and it works quite nice. I use the debian packages from buster. After running the thing for a few days, I realized an unexpected network load (my postgres database is on a separate machine). Turning the postgres log on revealed that mailman3 constantly queries the database: [...] 2018-11-17 16:33:15.417 UTC [8304] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.385901+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.663 UTC [8305] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.621505+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.664 UTC [8306] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.624011+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.908 UTC [8308] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.870547+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:15.910 UTC [8307] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:15.871611+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.152 UTC [8310] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.116762+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.154 UTC [8309] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.114878+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.390 UTC [8311] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.358211+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.393 UTC [8312] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.359704+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.634 UTC [8313] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.596602+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.636 UTC [8314] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.598296+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.882 UTC [8315] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.842795+00:00'::timestamptz) LIMIT 1 2018-11-17 16:33:16.884 UTC [8316] mailman3web@mailman3web LOG: statement: SELECT "django_q_ormq"."id", "django_q_ormq"."key", "django_q_ormq"."payload", "django_q_ormq"."lock" FROM "django_q_ormq" WHERE ("django_q_ormq"."key" = 'default' AND "django_q_ormq"."lock" < '2018-11-17T16:32:16.841916+00:00'::timestamptz) LIMIT 1 [...] Is this behaviour intended? Stefan

4 12

Re: [Mailman-Users] Mailman 3 on Ubuntu 18.04
by Odhiambo Washington 09 Dec '18

09 Dec '18

On Sun, 9 Dec 2018 at 22:37, Mark Sapiro <mark(a)msapiro.net> wrote: > On 12/9/18 10:14 AM, Odhiambo Washington wrote: > > > > In my quest to run Mailman3, I obtained a VM running Ubuntu 18.04 and > > started on getting to run Mailman3. > > I found this link -> https://github.com/iomarmochtar/mailman3_ei > > It has instructions which looked fairly simple to get Mailman3 installed. > > However, I did encounter some hitches since the script is not meant for > > Ubuntu. > > > First, a more appropriate list for Mailman 3 is > mailman-users(a)mailman3.org > <https://lists.mailman3.org/mailman3/lists/mailman-users@mailman3.org/>. > I am shifting to that list, after this. > > Also, we find it very difficult to address issues arising from third > party packages and how-tos. See <https://wiki.list.org/x/12812344>. > > And, there is a Mailman 3 package for Debian/Ubuntu > > apt install mailman3-full > In all my searching, I never found this in any documentation. I must have been searching in the wild, or my FreeBSD-mindedness got me stuck to containers and VENVs. > > With a few runs and observing the logs and modifying the script at every > > step it encountered and error, I finally managed to install Mailman3. It > > seems this is what you guys call a virtual environment in the Linux > world? > > :-) > > > I think the virtual environment in this case is a Python thing, not a > Linux thing. > I agree with you on that. > <snip> > > > Much of what I snipped is specific to > <https://github.com/iomarmochtar/mailman3_ei>, the details of which I'm > not interested in learning. > That is fine. I have put it aside for now. > > > >>From this point now is where I need help - serious help in smoothening > > things up and getting to understand these venv stuff! > > > > So I did run 'service mailman3 start' but this seems to be waiting for > too > > long to drop me back into the CLI. > > I also run 'systemctl start supervisord' and that seems to work. What I > am > > not sure is whether 'systemctl stop supervisord' actually does what it is > > expected to do because after I execute it, I still see processes running > > that I think are related. > > > > So far, I have been able to access the webUI on my VM using > > https://N.N.N.N:9090 > > I created a domain. > > But when I create a test list, I get an error - and I do not have a clue > > which logfile would have the error details - nginx or mailman... (I am > 100% > > new to nginx). > > > The nginx logs generally aren't too useful. Both Mailman core and Django > write logs. Core's log is probably in var/log/mailman.log where is > defined in mailman.cfg as var_dir. Django's log is defined in Django's > settings in the LOGGING setting. > Which file contains Django's settings? > > So now, I am stuck at: > > 1. Creating the mailing list > > 2. Getting to know whether the archiver is installed and running > > 3. Knowing is there are cron jobs to be running (Mailman2 type of > thinking!) > > > See > <http://docs.mailman3.org/en/latest/config-core.html#configuring-cron-jobs > > > and > < > http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required > > > Great to see that. I'll read and see if I make heads or tails of the writeup. > > Ultimately I need to figure out: > > 1. How the mailman queue runners are started and stopped > > mailman start > Why not systemctl mailman start?? Just wondering, as that is what I am seeing is common in Ubuntu. Does this make the components start after a reboot? > > 2. Migrate s few lists from Mailman2 to this Mailman3 > > mailman import21 > <django management> hyperkitty_import > Please show me where that is documented. I have to pull my lists from an old machine to this new one. > > 3. Mailman3 should use MySQL storage and Exim4 as the MTA (I have > > configured these bits in mailman.cfg) > > > You also need to configure MySQL in Django. See the DATABASES setting in > the Django settings. > So, when you talk about Django settings, you are referring to mailman.cfg file??? :-) I have spent all my weekend till now, trying to figure all this out. Life seems a little easier with mm2.x .... Thank you. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 1

Do not send email "The results of your email commands"
by erlonmz＠hotmail.com 07 Dec '18

07 Dec '18

Hello guys. Have to configure the mailman3 for not to send the e-mail " The results of your email commands" when an email is sent to "-leave@" and "-join@" ?? Sorry for my English, i from another country.

3 2

What is the difference between Mime Digest and Summary Digest in Mailman 3.2.0?
by Henrik Rasmussen 05 Dec '18

05 Dec '18

Having tried both Outlook and Gmail, there doesn't seem to be any visible difference between Mime Digest and Summary Digest. Of cause Gmail shows both index and all posts inline while Outlook shows both index and all posts as attachments, but overall the two digest types doesn't seem different from each other. Is that corrent or did I miss something? /Henrik Rasmussen

2 1

Mysql issue in django migrations
by Peter Sørensen 05 Dec '18

05 Dec '18

Hi, I have seen others having below problem: File "/usr/local/lib/python3.6/dist-packages/django/db/migrations/recorder.py", line 57, in ensure_schema raise MigrationSchemaMissing("Unable to create the django_migrations table (%s)" % exc) django.db.migrations.exceptions.MigrationSchemaMissing: Unable to create the django_migrations table ((1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '(6) NOT NULL)' at line 1")) But haven’t been able to find a proper solution. It’s not a syntax problem. Can anyone help ? Best regards Peter Sørensen/University of Southern Denmark

2 2

HyperKitty/Mailman3 issues
by Florian Schulze 04 Dec '18

04 Dec '18

Hi! I tried setting up Scheduled Tasks as described in <http://docs.mailman3.org/en/latest/config-web.html#scheduled-tasks-required> but the "runjobs" command can't be found. I see the hyperkitty and mailman commands when using "help". The "qcluster" service is working. Using Django 2.1.1 and HyperKitty 1.2.1. Maybe related to that, I have two issues with archives. 1. Changing the archiving setting in the Web-UI to something else than public seems to have no effect. The already archived messages are still accessible in public. 2. Related to 1., how can I remove a list archive without affecting other lists? Regards, Florian Schulze

2 2

Bounce processing via rest api
by Jukka Uusisalo 23 Nov '18

23 Nov '18

Hello, I looked rest api documentation and tried find out way to get information about undelivered postings to the list members. I assum, bouncing processing have this information but is it possible get via rest api? Thank you, Jukka

1 0

Rerun emails in the queue/bad
by Kaleb White 20 Nov '18

20 Nov '18

How do I run the emails in the queue/bad again? I need to see why the failed and get them to work. Thanks.

2 1

Error: 451 Requested action aborted
by Hagen Bauer 16 Nov '18

16 Nov '18

Hi I am running mailman in docker and I start to receive this error when my postfix tries to deliver a mail said: 451 Requested action aborted: error in processing (in reply to end of DATA command)) Any idea what is going wrong and where to look for problems? Regards Hagen

2 2

View only-account
by Henrik Rasmussen 15 Nov '18

15 Nov '18

Is it possible to create a Mailman 3 account as view only-access Postorius so our help desk can check users and list settings, but not manage the settings? /Henrik Rasmussen

1 0

Changing posting address
by Johannes Winter 09 Nov '18

09 Nov '18

Dear list, I'd like to change the sending address of a mailinglist, but when I try to set it via mmclient with ./manage.py mmclient lists=client.lists l=lists[listnumber] l.settings['posting_address']='new name' I get `ValueError: value is read-only`. Is it possible to change this value, or should I use another setting for this objective? Best regards, Johannes Winter

2 1

Setup Mailman3 on shared webhost
by Keyra 08 Nov '18

08 Nov '18

Iam trying to setup mailman3 on a shared webhost (with ssh access). I could use pip3.6 install mailman --user and also mailman info But when I try to start mailman using mailman start I will first get the error message TypeError: expected str, bytes or os.PathLike object, not NoneType and when I try it a second (and third etc.) time, it throws Starting Mailman's master runner /usr/bin/python3.6: can't open file '/usr/bin/master': [Errno 2] No such file or directory I didn't get any error messages during installation, so I guess whatever mailman is looking for in /user/bin/master is available in my /home/user/ folder, but I have no idea where and how to tell mailman to look there. For more infos, this is the output of `mailman info` GNU Mailman 3.2.0 (La Villa Strangiato) Python 3.6.5 (default, Apr 10 2018, 17:08:37) [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] config file: /var/www/virtual/user/html/var/etc/mailman.cfg db url: sqlite:////var/www/virtual/user/html/var/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ REST credentials: restadmin:XXXX

2 1

Hyperkitty - Non-ascii sender address
by Guiseppin Thomas 04 Nov '18

04 Nov '18

Hi, I imported some mbox archives in Hyperkitty. I have lot issues like: /\Failed adding message <5b0900ab.1c69fb81.70ab.2f87(a)mx.google.com>: ('Non-ascii sender address', <email.message.EmailMessage object at 0x7f05f1606048>)// //Non-ascii sender address from "Stéphane blipblop <stlablipblop at gmail.com>" about [HATLAB][It] Re: A débarrasser ! / It's probably because "Stéphane". Some advise to fix it ? Name: HyperKitty Version: 1.2.1 Thanks, Thomas.

3 4

Mailman 3 on RHEL 7 help
by A Almeda 03 Nov '18

03 Nov '18

Hi. I am trying to install mailman 3 on RHEL7. Docker install is not a possibility. I am trying to install it using a bundler by following https://media.readthedocs.org/pdf/mailman-bundler/stable/mailman-bundler.pdf, but after logging in as mailman, I can't do virtualenv venv. It works if I login as root, but still fails during buildout. In short, I need help. Has anyone of you guys installed mailman 3 on RHEL 7 or CEntOS 7? If so would you share me detailed instructions? Thank you in advance.

3 8

how to integrate subscription into static jekyll website
by Hagen Bauer 23 Oct '18

23 Oct '18

Hi, I am running a static website with jekyll and I want to integrate a form that executes a subription rest api call to mailman. From my first investigation this seems to be a bad idea from a security perspective (rest api needs managaer access). Is there a secure way to do this? Any other ideas? Regards Hagen

3 7

Problem with missing MySQLDatabase
by Peter Sørensen 23 Oct '18

23 Oct '18

Hi, I have looked into installing this before without success but found The Debian package Mailman3-full I installed this succesfully along with the mailman-suite. I have configured varios setting but are stuck when trying to generate aliases For mailman with: mailman aliases Traceback (most recent call last): File /usr/bin/mailman, line 11, in <module> load_entry_point('mailman==3.1.1', 'console_scripts', 'mailman')() File /usr/lib/python3/dist-packages/mailman/bin/mailman.py, line 94, in main initialize(config_path) File /usr/lib/python3/dist-packages/mailman/core/initialize.py, line 189, in initialize initialize_2(propagate_logs=propagate_logs) File /usr/lib/python3/dist-packages/mailman/core/initialize.py, line 160, in initialize_2 config.db = getUtility(IDatabaseFactory, utility_name).create() File /usr/lib/python3/dist-packages/mailman/database/factory.py, line 52, in create database = call_name(database_class) File /usr/lib/python3/dist-packages/mailman/utilities/modules.py, line 67, in call_name named_callable = find_name(dotted_name) File /usr/lib/python3/dist-packages/mailman/utilities/modules.py, line 50, in find_name __import__(package_path) ModuleNotFoundError: No module named 'mailman.database.mysql.MySQLDatabase\t\t\t#MOD(inserted ) 02'; 'mailman.database.mysql' is not a package I can see from the message that I’m missing a module but I can’t figure out. how to get This installed. The mudule is referenced in the mailman.cfg as class: mailman.database.mysql.MySQLDatabase Can anybody help ? Best regards Peter Sørensen University Of Southern Denmark

2 3

autoresponse not sent
by shadiakiki1986＠gmail.com 22 Oct '18

22 Oct '18

Hello. Newbie to mailman here. I tried out mailman3 today. My setup is - mailman3 suite using the docker-compose file from asynchronous.io - exim4 on the local machine and configuring it as smarthost using mailgun smtp server The emails to the mailing list are received by the subscribers, but the autoresponse is not being received by the sender (who is not from the subscribers list). I'm not sure if the problem is from mailman-core, settings from mailman-web, or from exim. The setting for autoresponse to posters is set to yes, with some text to be sent in the autoresponse message. The autoresponse grace period is set to "0d60.0s" (I was unable to set to "0" or "negative" due to error saying something like "could not update parameter") The "Acknowledge posts" in the "global mailman settings" is set to "yes". The "Acknowledge posts" in the list-based preferences is also "yes". Here are the exim logs after I send the email from the non-subscriber to the mailing list ``` 2018-10-19 15:13:32 1gDWSy-0004n7-VR DKIM: d=gmail.com s=20161025 c=relaxed/relaxed a=rsa-sha256 b=2048 [verification succeeded] 2018-10-19 15:13:32 1gDWSy-0004n7-VR <= shadiakiki1986(a)gmail.com H=mail-vk1-f171.google.com [209.85.221.171] P=esmtp K S=2416 id=CACk+RNtq_hu+M_ufoCJQFCtOWOD_DX0omdVJbKfva0w=n4Qhuw(a)mail.gmail.com 2018-10-19 15:13:33 1gDWSy-0004n7-VR => quotations(a)mailman3.akikieng.com R=mailman3_router T=mailman3_transport H=172.19.199.2 [172.19.199.2] C="250 Ok" 2018-10-19 15:13:33 1gDWSy-0004n7-VR Completed 2018-10-19 15:13:35 1gDWT1-0004nC-1I DKIM: d=gmail.com s=20161025 c=relaxed/relaxed a=rsa-sha256 b=2048 [verification failed - signature did not verify (headers probably modified in transit)] 2018-10-19 15:13:35 1gDWT1-0004nC-1I <= quotations-bounces(a)mailman3.akikieng.com H=ip-172-19-199-2.us-west-2.compute.internal [172.19.199.2] P=esmtp S=3847 id=CACk+RNtq_hu+M_ufoCJQFCtOWOD_DX0omdVJbKfva0w=n4Qhuw(a)mail.gmail.com 2018-10-19 15:13:35 1gDWT1-0004nC-1I => shadi(a)akikieng.com R=smarthost T=remote_smtp_smarthost H=smtp.mailgun.org [35.161.201.187] X=TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256 CV=yes DN="C=US,ST=California,L=San Francisco,O=MAILGUN TECHNOLOGIES\, INC,OU=MAILGUN TECHNOLOGIES\, INC,CN=*.mailgun.org" A=plain C="250 Great success" 2018-10-19 15:13:35 1gDWT1-0004nC-1I Completed ``` 1. Is the signature verification failure due to mailman-core trying to send the autoresponse outgoing message? At first, I thought that the DKIM signature verification caused Exim to be dropping the autoresponse. So I set `DISABLE_DKIM_VERIFY=true` in exim, but still no autoresponse. Here are the exim logs after the sender sends the email ``` ^[[A2018-10-19 14:58:40 1gDWEa-0004Ww-QF <= shadiakiki1986(a)gmail.com H=mail-vs1-f53.google.com [209.85.217.53] P=esmtp K S=2410 id=CACk+RNvnfS+e+Uh-OSKjPB8oe+b1=efAJ6BSrc51jz_h9sVoFQ(a)mail.gmail.com 2018-10-19 14:58:40 1gDWEa-0004Ww-QF => quotations(a)mailman3.akikieng.com R=mailman3_router T=mailman3_transport H=172.19.199.2 [172.19.199.2] C="250 Ok" 2018-10-19 14:58:40 1gDWEa-0004Ww-QF Completed 2018-10-19 14:58:42 1gDWEc-0004Wz-R1 <= quotations-bounces(a)mailman3.akikieng.com H=ip-172-19-199-2.us-west-2.compute.internal [172.19.199.2] P=esmtp S=3841 id=CACk+RNvnfS+e+Uh-OSKjPB8oe+b1=efAJ6BSrc51jz_h9sVoFQ(a)mail.gmail.com 2018-10-19 14:58:42 1gDWEc-0004Wz-R1 => shadi(a)akikieng.com R=smarthost T=remote_smtp_smarthost H=smtp.mailgun.org [54.69.10.167] X=TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256 CV=yes DN="C=US,ST=California,L=San Francisco,O=MAILGUN TECHNOLOGIES\, INC,OU=MAILGUN TECHNOLOGIES\, INC,CN=*.mailgun.org" A=plain C="250 Great success" 2018-10-19 14:58:42 1gDWEc-0004Wz-R1 Completed ``` 2. is my understanding correct in reading these logs that there is nothing here about an autoresponse?

3 2

MM3 vs. Sympa
by Tom Browder 21 Oct '18

21 Oct '18

I still haven’t gotten around to getting a new MM3 service up and running, and now I’m looking at Sympa. I’ve seen a few comparisons of the two systems on the net, but the ones I’ve seen are for announcement lists only. I did see one university that did a study of list managers to replace Listproc and chose Sympa. I must admit my short-lived MM2 experience (used for my social sites for my high school and college classmates) seven years ago wasn’t the best was for two reasons: (1) no duplication of list names even for different domains and (2) it’s written in Python (instead of Perl). But, thanks to much help from Mark, I did get it runnng. I think it would be running today but it failed after about a year when Gmail (whose sntp server I was using) stopped allowing that, and I just didn’t know enough to get around the situation and had too much else to do. I waited expectantly for MM3 to come out and was ready to try again, but the separation of a formerly-integrated system into several systems was a bit daunting. Now I’m considering using Sympa: it’s coded in Perl, it’s monolithic, and it can support identical list names for different domains, so I am leaning in that direction. Before I go, I would appreciate anyone giving me a good reason to stay with MM (besides excellent support and a welcoming community—one which is a member of an unfortunately small group of such communities). Thanks so much. Best regards, -Tom

4 5

Difficulties setting up MM3 with Postfix MTA in Docker Environment: Invalid EHLO domain name & Authentification as lists.local
by Niklas Frühauf 21 Oct '18

21 Oct '18

Hi everyone, I managed to setup mailman using the maxking/mailman-* docker containers, connected to a postfix/dovecot mailserver and a mysql database. The mail domain is @mail.local, mailman is reachable at lists.local. I can see the mailman UI fine, its connection to the database is working as well, the only things that’s not working is the initial login: When I try to login with the correct credentials of the superuser I added, I get An error occurred while processing your request. To me it seems like mailman is trying to authenticate as “lists.local” or “mail.local” or “localhost” to postfix (which of course isn’t working), then issues a EHLO/HELO to postfix which is not a FQDN. So I guess the latter issue could be resolved by providing a FQDN by mailman. These are the logfiles from the period: mail | Oct 21 11:15:07 mail postfix/postscreen[1862]: CONNECT from [172.18.18.8]:49288 to [172.18.18.254]:25 ldap_1 | 5bcc5fc1 conn=1000 fd=12 ACCEPT from IP=172.18.19.8:49252 (IP=0.0.0.0:389) ldap_1 | 5bcc5fc1 conn=1000 op=0 BIND dn="cn=admin,dc=..." method=128 ldap_1 | 5bcc5fc1 conn=1000 op=0 BIND dn="cn=admin,dc=..." mech=SIMPLE ssf=0 ldap_1 | 5bcc5fc1 conn=1000 op=0 RESULT tag=97 err=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=1 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=1 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=1 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=2 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=2 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=2 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=3 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fc1 conn=1000 op=3 SRCH attr=mail ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fc1 conn=1000 op=3 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=4 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=mail.local)" ldap_1 | 5bcc5fc1 conn=1000 op=4 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=4 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=5 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=mail.local)" ldap_1 | 5bcc5fc1 conn=1000 op=5 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=5 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=6 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@mail.local)(mailalias=*@mail.local))" ldap_1 | 5bcc5fc1 conn=1000 op=6 SRCH attr=mail ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fc1 conn=1000 op=6 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=7 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=7 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=7 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=8 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fc1 conn=1000 op=8 SRCH attr=mail ldap_1 | 5bcc5fc1 conn=1000 op=8 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fc1 conn=1000 op=9 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fc1 conn=1000 op=9 SRCH attr=mail ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fc1 <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fc1 conn=1000 op=9 SEARCH RESULT tag=101 err=0 nentries=0 text= mail | Oct 21 11:15:13 mail postfix/postscreen[1862]: PASS OLD [172.18.18.8]:49288 mail | Oct 21 11:15:13 mail postfix/smtpd[1873]: connect from srv-docker_mailman-web_1.srv-docker_frontend[172.18.18.8] mail | Oct 21 11:15:17 mail postfix/postscreen[1862]: warning: dnsblog reply timeout 10s for list.dnswl.org mail | Oct 21 11:15:27 mail postfix/dnsblog[1866]: warning: dnsblog_query: lookup error for DNS query 8.18.18.172.list.dnswl.org: Host or domain name not found. Name service error for name=8.18.18.172.list.dnswl.org type=A: Host not found, try again ldap_1 | 5bcc5fdf conn=1000 op=10 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=10 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=10 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=11 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=11 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=11 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=12 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fdf conn=1000 op=12 SRCH attr=mail ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fdf conn=1000 op=12 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=13 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=localhost)" ldap_1 | 5bcc5fdf conn=1000 op=13 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=13 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=14 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=localhost)" ldap_1 | 5bcc5fdf conn=1000 op=14 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=14 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=15 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@localhost)(mailalias=*@localhost))" ldap_1 | 5bcc5fdf conn=1000 op=15 SRCH attr=mail ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fdf conn=1000 op=15 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=16 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(mail=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=16 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=16 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=17 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(?mailGroupMember=lists.local)" ldap_1 | 5bcc5fdf conn=1000 op=17 SRCH attr=mail ldap_1 | 5bcc5fdf conn=1000 op=17 SEARCH RESULT tag=101 err=0 nentries=0 text= ldap_1 | 5bcc5fdf conn=1000 op=18 SRCH base="ou=users,dc=..." scope=2 deref=0 filter="(|(mail=*@lists.local)(mailalias=*@lists.local))" ldap_1 | 5bcc5fdf conn=1000 op=18 SRCH attr=mail ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mail) not indexed ldap_1 | 5bcc5fdf <= mdb_substring_candidates: (mailalias) not indexed ldap_1 | 5bcc5fdf conn=1000 op=18 SEARCH RESULT tag=101 err=0 nentries=0 text= mail | Oct 21 11:15:43 mail policyd-spf[1886]: prepend Received-SPF: Temperror (mailfrom) identity=mailfrom; client-ip=172.18.18.8; helo=c98c668820fd; envelope-from=postorius(a)lists.local; receiver=<UNKNOWN> mail | Oct 21 11:15:43 mail postfix/smtpd[1873]: NOQUEUE: reject: RCPT from srv-docker_mailman-web_1.srv-docker_frontend[172.18.18.8]: 504 5.5.2 <c98c668820fd>: Helo command rejected: need fully-qualified hostname; from=<postorius(a)lists.local> to=<niklas.fruehauf(a)mail.local> proto=ESMTP helo=<c98c668820fd> mail | Oct 21 11:15:43 mail postfix/postscreen[1862]: CONNECT from [172.18.18.8]:49304 to [172.18.18.254]:25 mail | Oct 21 11:15:43 mail postfix/postscreen[1862]: PASS OLD [172.18.18.8]:49304 mail | Oct 21 11:15:43 mail postfix/smtpd[1903]: connect from srv-docker_mailman-web_1.srv-docker_frontend[172.18.18.8] proxy_1 | 172.18.18.1 - - [21/Oct/2018:11:16:13 +0000] "POST /accounts/login/ HTTP/1.1" 500 1102 "https://lists.local/accounts/login/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36" "-"

3 2

footer message
by Abhijith PA 19 Oct '18

19 Oct '18

Hello. Is there any way to enable footer for some lists at the same time disable for lists. I maintain an mailman3 instance and some of the lists in it need the footer message well some not. Regards, Abhijith.

3 5

dkim failing
by Abhijith PA 16 Oct '18

16 Oct '18

Hello. I am seeing dkim fail in mail that people send to lists /dkim=fail reason="signature verification failed"/ but it is not happening when the list solely sending mail to subscribers (like digest, or subscribe/unsubscribe messages etc). I recently added a new domain to the mailman3. After this I started noticing this issue. Any help ?

2 1

dkim failing
by Abhijith PA 16 Oct '18

16 Oct '18

Hello. I am seeing dkim fail in mail that people send to lists /dkim=fail reason="signature verification failed"/ but it is not happening when the list solely sending mail to subscribers (like digest, or subscribe/unsubscribe messages etc). I recently added a new domain to the mailman3. After this I started noticing this issue. Any help ? Thanks Abhijith PA

2 1

Change digest frequency and default threshold
by Henrik Rasmussen 12 Oct '18

12 Oct '18

When creating a new list in Mailman 3, the Digest Size Threshold is set to 30KB, which is not much in my opnion. 1) How do I set another default for Digest Size Threshold for new lists. 2) How do I change the default for existing lists When Digest Size Threshold is not reached, mails seems to be sent according to digest_volume_frequency': which is set to 'monthly'. The web interface doesn't seem to have a setting for this. How do I change this setting, both on a single list and the default for new lists? Henrik Rasmussen

2 9

Can't remove footer(s)
by Henrik Rasmussen 11 Oct '18

11 Oct '18

I have a problem removing the footer(s) from a list imported from MM2.1. I have been testing by entering my message in Hyperkitty (the list forum). I an aware about the double footer issue[1], and I am aware that footers are cached, but I have removed the footer files according to [2], run Mailman shell according to [3], restarted the Mailman (Mailman core, Mailan web, Postgres database and postfix). Did I miss something in order to remove the footers? [1] https://gitlab.com/mailman/mailman/issues/407 [2] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… [3] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… I'm running Docker-Mailman (Mailman version 3.2.0a1). -- Henrik Rasmussen

2 5

Archiving error
by Enrique Terrazas 05 Oct '18

05 Oct '18

Hello, I'm hoping someone can help me configure hyperkitty correctly. I've got mailman3 installed and working. I created a test list and can send/receive, moderate message. However, archiving does not seem to be working. Below is a copy of my (sanitized) hyperkitty.cfg file and settings.py file(edited) along with the errors being logged to mailman.log hyperkitty.cfg ----- # Mailman-Hyperkitty Archiver plugin [general] base_url: http://localhost:8002/ api_key: ----- settings.py # Mailman API credentials MAILMAN_REST_API_URL = 'http://localhost:8001' MAILMAN_REST_API_USER = '' MAILMAN_REST_API_PASS = '' MAILMAN_ARCHIVER_KEY = '' MAILMAN_ARCHIVER_FROM = ('my.host.name', 'myIPaddress', '127.0.0.1', '::1') ------ This is the error being sent to maillog.log ------ Oct 05 01:54:59 2018 (15127) Exception in "hyperkitty" archiver Traceback (most recent call last): File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connection.py", line 171, in _new_ conn (self._dns_host, self.port), self.timeout, **extra_kw) File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/util/connection.py", line 79, in c reate_connection raise err File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/util/connection.py", line 69, in c reate_connection sock.connect(sa) ConnectionRefusedError: [Errno 111] Connection refused During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 600, in urlopen chunked=chunked) File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connectionpool.py", line 354, in _make_request conn.request(method, url, **httplib_request_kw) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1239, in request self._send_request(method, url, body, headers, encode_chunked) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1285, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1234, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 1026, in _send_output self.send(msg) File "/opt/rh/rh-python36/root/usr/lib64/python3.6/http/client.py", line 964, in send self.connect() File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connection.py", line 196, in connect conn = self._new_conn() File "/opt/mailman/mailman/lib64/python3.6/site-packages/urllib3/connection.py", line 180, in _new_conn self, "Failed to establish a new connection: %s" % e) urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f0ba1c22048>: Failed to establish a new connection: [Errno 111] Connection refused During handling of the above exception, another exception occurred: ------ Thanks in advance, Enrique J. Terrazas

3 5

Hyperkitty 1.1.1 to HyperKitty 1.2.1
by Thomas G 05 Oct '18

05 Oct '18

Hi, I would like to migrate my current Mailman3.1/Hyperkitty data to a fresh install in Mailman3.2. I didn't found how migrate the archives. From : HyperKitty - Version: 1.1.1 - Python2.7 To : HyperKitty - Version: 1.2.1 - Python3.5 I exported a mbox from hyperkitty (web interface) and tried to re-import it, without result. """""""""""""""""""""""""""""""""""""""" xxxx @xxxxxx :/opt/mailman# python3.5 manage.py hyperkitty_import -l listedetests(a)hatlab.fr /home/admin/listedetests(a)hatlab.fr.mbox.gz Importing from mbox file /home/admin/listedetests(a)hatlab.fr.mbox.gz to listedetests(a)hatlab.fr Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the 'manage.py update_index_one_list listedetests(a)hatlab.fr' command. """""""""""""""""""""""""""""""""""""" The database stay empty (and web interface): """""""""""""""""""""""""""""""""""""" mailmandbnameprod=# select * from hyperkitty_email; id | message_id | message_id_hash | subject | content | date | timezone | in_reply_to | archived_date | thread_depth | thread_order | mailinglist_id | parent_id | sender_id | thread_id | sender_name ----+------------+-----------------+---------+---------+------+----------+-------------+---------------+--------------+--------------+----------------+-----------+-----------+-----------+------------- (0 rows) """""""""""""""""""""""""""""""""""""" Any idea to do this importation ? Thanks !

3 7

Proper permissions for mailman installation under home directory, with layout: local
by Eric Abrahamsen 03 Oct '18

03 Oct '18

I recently upgraded my server from Ubuntu 16.04 to 18.04, and have hit some snags in the process. I've had my mailman3 installation under my home directory, running as my own user, without too many problems. var_dir was set to something in my home directory. Recently, while tracking down some weird behavior, I realized that with this sort of setup I'm supposed to use "layout: local", and that previously I'd had a sort of weird half-way installation where some things were kept in my /home/<me>/sites/mailman directory, and other bits (pids and whatnot) were scattered around the filesystem. Now that I'm using "layout: local", mailman really is trying to keep everything under that main directory, and now everything's breaking. The hyperkitty search indexer is saying it has no permissions to write into that directory, postfix won't deliver mail, saying the mailbox is unavailable, and in the web UI postorius shows no configured list domains (though hyperkitty still displays the archives correctly). So obviously I've got quite a big problem with permissions, but I don't know how to resolve it. My webserver is nginx, running as www-data. I'm starting mailman in a systemd script, with User and Group set to my user -- though maybe that should be set to root? I guess postfix runs as root, I'm not sure, but obviously it's not able to read the files in var/data/*, which appear all correct to me. What's the recommended solution here? I'd still like to keep this whole directory under my home directory, if possible... Thanks, Eric

1 0

About the link destination of the logo image of the homepage
by Ooyama Yosiyuki 01 Oct '18

01 Oct '18

At next page: https://www.gnu.org/software/mailman/ Despite the fact that "Mailman" is written in the logo on the upper left of the screen, However if I click the logo image on the upper left of the screen,then it is to move to https://www.gnu.org/software/ I think it is strange. In the Wikipedia English version, the following address is introduced as mailman's website. www.gnu.org/software/mailman/

3 2

Hyperkitty splitting threads?
by Marvin Gülker 30 Sep '18

30 Sep '18

Hi, I'm experiencing a problem with regard to how Hyperkitty decides how to group messages into a thread. It appearently randomly splits a thread and creates a new one from the replies, even though the replies have the proper In-Reply-To: header set. As of now, the front page for our mailing list[1] illustrates the issue nicely: the "TSC Boost Build Issues" topic has been split over three threads for no appearent reason, and the "Providing an APT repository" one in two. Sometimes replies are collected into the proper thread, though (see the latter thread). Exact links follow as the front page can change later on: * The "Boost Build Issues" topic (these should all be in one thread page): * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * The "APT repository" topic (these should all be in one thread page as well): * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… * https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… This is Mailman 3.2.0 with Hyperkitty 1.2.0. We will shortly upgrade Hyperkitty to the current version, but since I didn't find something related in the release notes for newer versions, I thought I'd ask here if the problem is known. Also, is there a way to rebuild the thread structure so that the existing errorneous splits can be corrected? Marvin [1]: https://lists.secretchronicles.org/hyperkitty/list/tsc-devel@lists.secretch… -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

2 2

Docker-mailman: Performance issue
by Henrik Rasmussen 28 Sep '18

28 Sep '18

I am using Docker-mailman (currently Mailman version 3.2.0a1). I have a list with 38513 subscribers and when I operate on a very large number of them (for example click Unsubscribe all), the web interface times out. The same happens if I use the REST API, one member at the time, but run from a python script i've made). The Docker containers for both Mailman core (mostly) and mailman web (sometimes) are using 100% CPU (quart of the server's amount of CPUs). By doubleing the CPU shares that the two docker containers can use (using RHEL Cockpit) from 1024 to 2048 for each, Mailman-core had a max usage of 190% and Mailman-web about 101%. Still, mass unsubscribing the members by clicking Unsubscribe all made theinterface time out. Using the REST API succeeded unsubscribing all, but still made the Mailman web interface inaccessible. How can I make Docker-mailman perform better, to avoid these timeouts. -- Henrik Rasmussen University of Copenhagen

2 2

Where is the site to translate HyperKitty?
by Ooyama Yosiyuki 27 Sep '18

27 Sep '18

Where can I translate HyperKitty(GNU Mailman v3)? please tell me.

3 3

Dump/restore users (with passwords) via API
by Dmitry Makovey 26 Sep '18

26 Sep '18

We are trying to dump/restore users using API calls and it seems that API allows us to dump password hashes (a good thing), but then API does not allow to insert users back using saved password hashes - only cleartext passwords. Aside from create_user is there any other way to create users/change their password? -- Sr System and DevOps Engineer SoM IRT

4 9

List description as sender
by Henrik Rasmussen 26 Sep '18

26 Sep '18

When receiving a mail from Mailman 3, the From: User name is the description of the list, like From: Long desription of the list for all members of certain project <project(a)lists.example.com>. Starting to get old, I recall something about a discussion we once had on http://mail.python.org/pipermail/mailman-users/, but I don't recall the reason for this and I can't find the discussion, so it might be something I dreamed. What was the reason for implementing this? And could it be a selectable choise in Mailman 3?

2 7

Disable Archive for a mailing list
by Hagen Bauer 24 Sep '18

24 Sep '18

Hi to all, is there a way to totally disable the archive of a mailing list? I would like to setup mailman as a "mailforwarder" without the ability to store the mails Regards Hagen

2 1

Text encoding problem, preapproved header
by Thor Atle Rustad 20 Sep '18

20 Sep '18

Mailman 3.2. I send a message to the list with some national characters (æøå ÆØÅ), and everything shows up fine. Then I send the same message using pseudo-header approved: with the list password. This messes up the character encoding, so that instead I get (=C3=A6=C3=B8=C3=A5 =C3= =86=C3=98=C3=85) I experience the problem when I send or receive with Gmail web client, however, when using the Claws-mail (an ordinary mail client) to pick up from my gmail account, the contents is shown correctly. Any suggestions?

3 3

Rejection based on total message size including attachments
by leith＠khimaira.com 20 Sep '18

20 Sep '18

As a web hosting provider I have searched and searched for a way to limit the total size of messages posted to all lists. We have moderators who just can't get it through their heads to limit the size of attachments. One list today distributed a 6 mb pdf to over 700 recipients. I have found information on creating a custom handler and some old and brief logic on limiting max_message_size from Mr. Sapiro. Would anyone who has developed a custom handler to reject messages based on total size, mind sharing the full file? If so, could you also state where the handler was positioned in the chain of handlers. Thank you for your time.

2 2

Set domain inactive / archive import from other domain.
by Johannes Winter 19 Sep '18

19 Sep '18

Dear list, we've migrated a list from another domain and would like to keep the archives. Hyperkitty doesn't recognize the emails in the mbox archive during import due to the other domain name. As a workaround we thought of creating a placeholder list with the original and than import the mbox. But actually I don't like to have dysfunctional lists in the domain list. Is it possible to set domains invisible? Or is there a switch to import a list from another domain? Best regards, Johannes Winter

2 3

Disable "confirmation emails"
by Hagen Bauer 19 Sep '18

19 Sep '18

Hi to all, even after a lot of google search I could not find a way to disable the Confirmation Mails like .... The results of your email command are provided below. - Original message details: ....... Is there a way to do this? I have users who would be irritated and I dont want them to recieve this Regards Hagen

3 3

Counter-intuitive header filter processing
by Jonas Meurer 18 Sep '18

18 Sep '18

Hello, it seems like the way mailman3 processes header filters is a bit counter-intuitive. With a header filter (HeaderMatch) like the following: header => from pattern => .*(a)freesources.org chain => accept I expect mails from *(a)freesources.org to be accepted regardless of the default message acceptance settings. Apparently, that's not the case. If the default message acceptance setting for members is set to "reject", then mails from *(a)freesources.org get rejected even though the header filter says "accept". In other words, the default message acceptance action seems to overrule any header filters. Is this expected behaviour? Kind regards jonas

2 3

New platform administrators
by Hellen Cubero 18 Sep '18

18 Sep '18

Hello! I would like to know how to add a new site administrator to the mailman 3.2 platform. Can you help me please?

3 2

Using as a forum
by tokyoprogressive＠mailbox.org 18 Sep '18

18 Sep '18

Our group of 30 plus people have the perennial problem in MM II of not checking previous messages before replying. A second problem is starting a new topic rather than responding to a message in the same topic, which makes searching even harder. I previously suggested a forum or something like Stack or Flock. People had no interest in a Word Press forum yet moan about the inefficiency of a list, also it is something new and involves leaving email. Stack and Flock make it hard to require all to be a member of all topics in their free versions. Then it occurred to me, the threaded view in Mailman III looks good and could help us nudge people back on topic. Am I being too optimistic. It is a closed group only open to people we approve. I would like to migrate to MM III but lack the technical skills to fo this? Anyone who could do this for a fee? We probably do not need to bring in the old topics. (I guess there us no way like a forum to limit the topics but at least we could keep things on track). Thanks Paul Arenson Japan Association for Language Teaching Sent from my iPhone

5 12

How to connect mailman into existing postfix server
by Hagen Bauer 16 Sep '18

16 Sep '18

Hi to all, I am trying to setup mailman3 with the Docker Image. Everythings works relative nicely but I am blocked by the Postfix integration part. I have a small postfix server that is delivering mails to known domains and an alias map. The standard use case assumes that the external postfix is only routing mails to the mailman lmtp. If I do this all my old users are recected. I am looking for an example(s) to integrate mailman into a Postfix configuration as an additional target for postfix. Any hints Regards Hagen

2 1

Stability issues
by schultmc＠cinlug.org 14 Sep '18

14 Sep '18

We're currently piloting Mailman3 to replace a failing Ecartis installation. We've had to push back our go live date several times due to stability issues with our Mailman 3 installation. We currently have Mailman core 3.2.0 running on Red Hat Enterprise Linux 7.5 with 2 vCPUs, 8GB RAM and 25GB swap space. Occasionally, we see mailman become unresponsive both via the REST API and the web UI. We haven't seen anything glaring in the logs but would be happy to check further. I know Mailman 3 powers many large lists and would appreciate any performance, stability and tuning information that can be provided.

3 2

Memory usage
by Adi Kriegisch 13 Sep '18

13 Sep '18

Dear all, I've been using mailman2 for quite some time and I am considering upgrading to mailman3. In a test setup I noticed that mailman3 with just a basic setup (Debian with mailman3 package and sqlite as backend using exim4) uses over 700MB RAM (RSS): | USER VSZ RSS COMMAND | list 73072 54568 /usr/bin/python3 /usr/lib/mailman3/bin/master | list 73100 54500 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=archive:0:1 | list 73100 54572 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=bounces:0:1 | list 73100 54560 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=command:0:1 | list 73100 54600 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=in:0:1 | list 146832 54700 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=lmtp:0:1 | list 73100 54808 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=nntp:0:1 | list 73100 54652 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=out:0:1 | list 73100 54504 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=pipeline:0:1 | list 150516 58228 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=rest:0:1 | list 73100 54508 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=retry:0:1 | list 73100 54500 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=virgin:0:1 | list 73100 54608 /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=digest:0:1 This is with only one test list configured that just has one member. Compared to a mailman2 setup with many lists with up to 300 members that only uses around 70MB RAM: | USER VSZ RSS COMMAND | list 63724 1396 /usr/bin/python /usr/lib/mailman/bin/mailmanctl -q start | list 62896 10660 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=ArchRunner:0:1 -s | list 61156 1792 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=BounceRunner:0:1 -s | list 58148 1808 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=CommandRunner:0:1 -s | list 73116 23316 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=IncomingRunner:0:1 -s | list 55464 1672 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=NewsRunner:0:1 -s | list 65840 11868 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s | list 62036 10840 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=VirginRunner:0:1 -s | list 58716 5712 /usr/bin/python /var/lib/mailman/bin/qrunner --runner=RetryRunner:0:1 -s This is without hyperkitty or a management interface, just mailman3 core that uses 10 times as much ram as mailman2. Did I do something wrong here? Is there probably a bug in my python environment? Are there any config options that I should set to avoid this huge memory footprint? I found one thread[1] on this mailing list where a user asked a question similar to mine with comparable numbers. best regards, Adi Kriegisch [1] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message…

2 1

Subscription notification sent from the site admins work-mail.
by Henrik Rasmussen 13 Sep '18

13 Sep '18

One of my list administrators told me that all seven list administrators on a list received a "None <foo(a)example.com> has been successfully subscribed to [LIST NAME].", when someone subscribed to their list, however the sender of the mail (From:) was my own work mail address. I am not associated with the list other that I am site admin. The log /opt/mailman/web/logs/smtp.log seems to confirm that Mailman have sendt the mail on behalf of me. Sep 13 09:07:24 2018 (34) <153682964402.36.12950433926619808467@mailman-core> smtp to [LISTNAME](a)lists.example.com for 7 recips, completed in 0.12819194793701172 seconds Sep 13 09:07:24 2018 (34) <153682964402.36.12950433926619808467@mailman-core> post to [LISTNAME](a)lists.example.com from me(a)example.com, 525 bytes How can I, the site admin, be the sender og the mail? Note: Mailman 3 have been running with users half a year, but last week the particular list was imported from Mailman 2 using import21.

2 2

MM3 management tools (for those who need them)
by Dmitry Makovey 13 Sep '18

13 Sep '18

Hi, I wanted to share our current development of MM3-related tools that we currently employ on a daily basis. forks, ideas, pointers and issue reports are welcome: https://gitlab.med.stanford.edu/irt-public/mailman-tools Note that it's a "work in progress" bunch of scripts that work, but YMMV. ...so no refunds ;) -- Sr System and DevOps Engineer SoM IRT

1 0

LookupError: unknown encoding: _iso-2022-jp$esc
by Thor Atle Rustad 07 Sep '18

07 Sep '18

This happens when I open a page of Held Messages containing an offending message. I get Server Error (500) in Postorius. Here is the mailman.log: Sep 07 15:25:39 2018 (32) REST request handler error: Traceback (most recent call last): File "/usr/local/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/local/lib/python3.6/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/site-packages/mailman/rest/wsgiapp.py", line 214, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/site-packages/falcon/api.py", line 244, in __call__ responder(req, resp, **params) File "/usr/local/lib/python3.6/site-packages/mailman/rest/post_moderation.py", line 160, in on_get resource = self._make_collection(request) File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/post_moderation.py", line 150, in _resource_as_dict resource = self._make_resource(request.id) File "/usr/local/lib/python3.6/site-packages/mailman/rest/post_moderation.py", line 77, in _make_resource resource['msg'] = msg.as_string() File "/usr/local/lib/python3.6/site-packages/mailman/email/message.py", line 54, in as_string value = email.message.Message.as_string(self) File "/usr/local/lib/python3.6/email/message.py", line 158, in as_string g.flatten(self, unixfrom=unixfrom) File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/local/lib/python3.6/email/generator.py", line 181, in _write self._dispatch(msg) File "/usr/local/lib/python3.6/email/generator.py", line 214, in _dispatch meth(msg) File "/usr/local/lib/python3.6/email/generator.py", line 243, in _handle_text msg.set_payload(payload, charset) File "/usr/local/lib/python3.6/email/message.py", line 315, in set_payload payload = payload.encode(charset.output_charset) LookupError: unknown encoding: _iso-2022-jp$esc

2 1

confusing contents of database (data corruption?)
by Dmitry Makovey 07 Sep '18

07 Sep '18

I'm troubleshooting slowness and issues in our mailman (container-based) setup. (See also "ORM exceptions" thread) And I've come across really odd contents of DB: mailmandb=# select * from address, (select email, count(email) as instances from address group by email) as emails where emails.instances>1 and emails.email=address.email ; -[ RECORD 1 ]--+---------------------------------------------- id | 1001 email | some_person(a)some.org _original | Some_Person(a)some.org display_name | Some Person verified_on | registered_on | 2018-07-02 03:23:18.761679 user_id | 22543 preferences_id | 146541 email | some_person(a)some.org instances | 2 -[ RECORD 2 ]--+---------------------------------------------- id | 1002 email | some_person(a)some.org _original | display_name | verified_on | registered_on | 2018-07-02 03:23:19.036667 user_id | preferences_id | 146543 email | some_person(a)some.org instances | 2 mailmandb=# select * from member where address_id in (1002,1001); -[ RECORD 1 ]-----+------------------------------------- id | 73682 _member_id | f4cdxxxx-5c64-xxxx-9ac8-1f5xxxxa0f1c role | 4 list_id | mylist.lists.here.stanford.edu moderation_action | address_id | 1002 preferences_id | 146544 user_id | so: 1. address for the same email gets created twice 2. membership references "empty" address 3. membership does not reference proper user 4. preferences_id in all 3 records are different is there a documentation on the DB contents someplace? I feel like our mailman instance slowness is related to DB content but cleaning up that content seems to be risky at best. -- Sr System and DevOps Engineer SoM IRT

1 0

message file gone, but exists in database?
by Thor Atle Rustad 06 Sep '18

06 Sep '18

I'm investigating some problems, and in the process I want to delete some messages. First, listing all messages: >>> messages = list(message_store.messages) Traceback (most recent call last): File "<console>", line 1, in <module> File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 117, in messages yield self._get_message(row) File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 95, in _get_message with open(path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/messages/5X/7W/5X7WMWNORTGVNB6KVWTHHOI2VF2BEQ7K' Since this message should not exist in database, I try to delete it: >>> message_store.delete_message('5X7WMWNORTGVNB6KVWTHHOI2VF2BEQ7K') >>> commit() >>> messages = list(message_store.messages) Traceback (most recent call last): File "<console>", line 1, in <module> File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 117, in messages yield self._get_message(row) File "/usr/local/lib/python3.6/site-packages/mailman/model/messagestore.py", line 95, in _get_message with open(path, 'rb') as fp: FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/messages/5X/7W/5X7WMWNORTGVNB6KVWTHHOI2VF2BEQ7K' However, it continues to exist in mailman's mind I also cannot delete messages that actually exist. For instance, I find a message in Postorius that I want to delete. I look at the headers and then run >>> message_store.delete_message('6XFISRRFY74NJEE4FTRNWOA2KGKDBZ3T') >>> commit() After that, the message continues to live, both in postorius and as a file: bash-4.3# ls 6XFISRRFY74NJEE4FTRNWOA2KGKDBZ3T What is wrong?

1 0

ORM exceptions
by Dmitry Makovey 06 Sep '18

06 Sep '18

I'm tracing slowness of mailman in our infrastructure, and came across ORM exception: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2837, in one ret = self.one_or_none() File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2816, in one_or_none "Multiple rows were found for one_or_none()") sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one_or_none() During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/local/lib/python3.6/site-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.6/site-packages/mailman/rest/wsgiapp.py", line 214, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.6/site-packages/falcon/api.py", line 244, in __call__ responder(req, resp, **params) File "/usr/local/lib/python3.6/site-packages/mailman/rest/members.py", line 365, in on_post return self._find(request, response) File "/usr/local/lib/python3.6/site-packages/mailman/rest/members.py", line 389, in _find okay(response, etag(resource._make_collection(request))) File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/local/lib/python3.6/site-packages/mailman/rest/members.py", line 72, in _resource_as_dict user = member.user File "/usr/local/lib/python3.6/site-packages/mailman/model/member.py", line 128, in user else getUtility(IUserManager).get_user(self._address.email)) File "/usr/local/lib/python3.6/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/local/lib/python3.6/site-packages/mailman/model/usermanager.py", line 88, in get_user return addresses.one().user File "/usr/local/lib/python3.6/site-packages/sqlalchemy/orm/query.py", line 2840, in one "Multiple rows were found for one()") sqlalchemy.orm.exc.MultipleResultsFound: Multiple rows were found for one() is this a known thing and what's the best path for fixing it? -- Sr System and DevOps Engineer SoM IRT

1 1

log rotation
by Dmitry Makovey 06 Sep '18

06 Sep '18

I've been looking for a while and cannot find any information regarding log rotation for Mailman3. We're running containerized deployment which complicates the matter slightly, but having "some" approach for log rotation would be helpful. So before I dig into the code looking for SIGUSR1 or SIGHUP handlers can someone point me to a proper documentation for log management with MM3 ? -- Sr System and DevOps Engineer SoM IRT

3 3

ARC
by David Krantz 30 Aug '18

30 Aug '18

Hi, I just found out that gmail uses ARC (sometimes, at least). Is there support for that in Mailman 3? Without having had the time (yet) to read about in depth it it seems as if ARC is intended to solve at least some of the problems that mail lists have with DKIM. Probably causes others... It might be that no support really is needed in mailman so that just milters in sendmail, postfix etc. might do the trick. regards // David

2 1

Migration advice
by Quanah Gibson-Mount 29 Aug '18

29 Aug '18

Hi, I'm looking at migrating from an old server running mailman 2.1.15 (Debian wheezy) to a new Ubuntu 18.04 LTS system. I'd like to upgrade to mailman3 as a part of this migration. I was reading the migration docs (<http://docs.mailman3.org/en/latest/migration.html>), which seem to require both mailman2 and mailman3 be installed concurrently on the same system. Is that correct, or can I rsync the mailman2 list information onto the new server without mailman2 itself being present, and import from there? Thanks! Regards, Quanah -- Quanah Gibson-Mount Product Architect Symas Corporation Packaged, certified, and supported LDAP solutions powered by OpenLDAP: <http://www.symas.com>

2 1

Implicit destination
by David Krantz 28 Aug '18

28 Aug '18

Hi, I have a spam-problem like anyone else. Most of the spam my listserver receives has some kind of impilict destination so the implicit rule catches most of the spam that way. This is fine. What is not so fine, however, is that this results in a moderation message to the sender. I'd like to stop that so that the spammer has no confirmation that the mail was received. I can probably stop this in postfix before the mail reaches mailman3, but I'd prefer changing the behaviour of the rule. Is there any setting that could be used or should I just modify the rule? Cheers. // David

4 5

Whitelist non subscriber
by Mark Ziranski 27 Aug '18

27 Aug '18

Hello, I want to whitelist an email address on all lists to bypass moderation. The email address is not a subscriber. On google I found accept_these_nonmembers but I do not know how to use it. Please show me some examples how to whitelist someone(a)example.org. Thanks in advance. M.Z.

4 6

Configuration Question
by Ryan McClung 24 Aug '18

24 Aug '18

Greetings, Is there a simple way to force the mailman3 install to run off of a specified config/specified db without having to enter it manually each time? I just want any administrator to be able to enter mailman without wrecking the config/db. -- Ryan McClung Systems Administrator @ Afilias Canada A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> W. www.afilias.info T. +1.416.646.3304 x4186

2 3

changing adverstised status
by Alexander Klotz 24 Aug '18

24 Aug '18

Hi there, we are trying to set a once public list to private but have trouble doing so. In Postorius this doesn't seem to work - you can change "show list on index page" via the settings, but the value isn't saved. Is there a way to set advertised = False to a specific list via the shell? Thanks & Regards, Alex (Kulturserver editorial staff)

6 5

Docker release cycle maxking/mailman-core
by Johannes Winter 24 Aug '18

24 Aug '18

Hi guys, I'd like to test out some bugfixes in the master branch, namely the merge request related to: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… But I use the maxking docker images of which the 'rolling' and 'latest' tags are apparently not really used. Might it be possible to push these a litte bit more frequently? Thank you and best regards, Johannes Winter

2 1

Avoiding welcome message when subscribing using REST API
by Henrik Rasmussen 21 Aug '18

21 Aug '18

In Mailman 2 the site admin could add a member to a list using the -wn parameter of add_members to avoid sending a welcome message. On the host (outside the docker container) I've made an updater using the REST API to keep certain lists updated with imported addresses from one of our other systems, though respecting opt ins and opt outs. Similar to Mailman 2 I would like to avoid the welcome message to those automatic updated members, even the list is configred to send welcome message to those opting in by will, and I also like to avoid forcing the list owner/moderator to approve all new members automatically updated even the list is set for moderation of new members opting in by will. What is the payload for "no welcome message"? def add_new_members(listname_fqdn, members): [SNIP] for member in newmembers: payload['list_id'] = listname_fqdn.replace('@', '.') payload['subscriber'] = member payload['pre_verified'] = True payload['pre_confirmed'] = True payload['pre_approved'] = True response = mmapipost('members', payload) def mmapipost(apicommand,payload): response = requests.post('http://172.19.199.2:8001/%s/%s' % (restapiversion, apicommand), data=payload, auth=('restadmin', 'restpass'))

2 2

Moving from old-school install to docker
by David Krantz 19 Aug '18

19 Aug '18

Hi, Is there any documented procedure moving from a working install of mailman3 and postorius to a docker-based version? The reason would be to get a setup that is somewhat easier to maintain and upgrade. That said much of the work is to keep a mta, web server, spamfilter, grey list solution, dkim signing etc. running and up to date. I suspect that there is no pre-made docker images for that? cheers // David

1 0

receiving digest
by Abhijith PA 14 Aug '18

14 Aug '18

Hello. How a subscriber can receive the digest of a list ( assuming the list has enabled digests. Is there something to do for a subscriber in web interface to receive. Abhijith

2 1

Re: issue with Hyperkitty
by Mark Sapiro 08 Aug '18

08 Aug '18

On 08/07/2018 07:14 AM, Ali Alnubani wrote: > > I'm seeing the following trace when I go to http://example.com/hyperkitty/list/dev@example.com/2018/5/: This was fixed by downgrading Django to 2.0.8. See <https://gitlab.com/mailman/hyperkitty/issues/192> for more detail. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

proper update procedure for MM3 docker containers
by Fabian A. Santiago 07 Aug '18

07 Aug '18

Hello, Can someone remind me of the proper / best way to update my docker containers for MM3 / postorius based on maxking's images? Thanks. and this for both the stable and rolling releases. -- Fabian S. OpenPGP: 0x643082042DC83E6D94B86C405E3DAA18A1C22D8F (new key) *** 0x3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC (to be retired, still valid)

2 2

issue with Hyperkitty
by Ali Alnubani 07 Aug '18

07 Aug '18

Hi, I'm migrating from mailman 2.1.15, I did the following: * Installed packages * Created database * ./manage.py migrate * mailman create dev(a)example.com<mailto:dev@example.com> * ./manage.py hyperkitty_import -l dev(a)example.com /usr/local/mailman2/archives/private/dev.mbox/dev.mbox (the archive includes 69 emails). * ./manage.py update_index_one_list dev(a)example.com I'm seeing the following trace when I go to http://example.com/hyperkitty/list/dev@example.com/2018/5/: ``` ERROR 2018-08-07 13:54:23,897 19997 django.request Internal Server Error: /hyperkitty/list/dev(a)example.com/2018/5/ Traceback (most recent call last): File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 126, in _get_response response = self.process_exception_by_middleware(e, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 124, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/lib/view_helpers.py", line 134, in inner return func(request, *args, **kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 94, in archives return _thread_list(request, mlist, threads, extra_context=extra_context) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 123, in _thread_list return render(request, template_name, context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/shortcuts.py", line 36, in render content = loader.render_to_string(template_name, context, request, using=using) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/backends/django.py", line 61, in render return self.template.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 171, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 234, in render return t.render(new_context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 173, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 209, in render nodelist.append(node.render_annotated(context)) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 192, in render output = self.func(*resolved_args, **resolved_kwargs) File "venv_path/lib/python3.5/site-packages/django_mailman3-1.2.0-py3.5.egg/django_mailman3/templatetags/pagination.py", line 36, in add_to_query_string return conditional_escape(qs.urlencode()) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in urlencode for v in list_ File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in <genexpr> for v in list_ AttributeError: 'int' object has no attribute 'encode' ERROR 2018-08-07 13:54:23,897 19997 django.request Internal Server Error: /hyperkitty/list/dev(a)example.com/2018/5/ Traceback (most recent call last): File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/exception.py", line 34, in inner response = get_response(request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 126, in _get_response response = self.process_exception_by_middleware(e, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/core/handlers/base.py", line 124, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/lib/view_helpers.py", line 134, in inner return func(request, *args, **kwargs) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 94, in archives return _thread_list(request, mlist, threads, extra_context=extra_context) File "venv_path/lib/python3.5/site-packages/HyperKitty-1.2.0-py3.5.egg/hyperkitty/views/mlist.py", line 123, in _thread_list return render(request, template_name, context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/shortcuts.py", line 36, in render content = loader.render_to_string(template_name, context, request, using=using) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader.py", line 62, in render_to_string return template.render(context, request) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/backends/django.py", line 61, in render return self.template.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 171, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 150, in render return compiled_parent._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/loader_tags.py", line 62, in render result = block.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 234, in render return t.render(new_context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 173, in render return self._render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 163, in _render return self.nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 209, in render nodelist.append(node.render_annotated(context)) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/defaulttags.py", line 309, in render return nodelist.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 937, in render bit = node.render_annotated(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/base.py", line 904, in render_annotated return self.render(context) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/template/library.py", line 192, in render output = self.func(*resolved_args, **resolved_kwargs) File "venv_path/lib/python3.5/site-packages/django_mailman3-1.2.0-py3.5.egg/django_mailman3/templatetags/pagination.py", line 36, in add_to_query_string return conditional_escape(qs.urlencode()) File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in urlencode for v in list_ File "venv_path/lib/python3.5/site-packages/Django-2.1-py3.5.egg/django/http/request.py", line 524, in <genexpr> for v in list_ AttributeError: 'int' object has no attribute 'encode' ERROR 2018-08-07 13:54:25,721 19997 django.server "GET /hyperkitty/list/dev(a)example.com/2018/5/ HTTP/1.1" 500 317983 ``` Environment: ``` alembic==1.0.0 arrow==0.12.1 click==6.7 Django==2.1 django-haystack==2.8.1 django-mailman3==1.2.0 django-q==0.9.4 djangorestframework==3.8.2 httplib2==0.11.3 HyperKitty==1.2.0 mailman==3.2.0 mailman-hyperkitty==1.1.1 mailmanclient==3.2.0 Mako==1.0.7 postorius==1.2.0 psycopg2-binary==2.7.5 python-dateutil==2.7.3 requests==2.19.1 requests-oauthlib==1.0.0 SQLAlchemy==1.2.10 urllib3==1.23 uWSGI==2.0.17.1 Whoosh==2.7.4 ``` Some of the archives are listed fine tho. The same trace reproduced with 2 different imported archives. I'm on Debian stretch and using python 3.5.3. Can you help please? Thanks, Ali

1 0

migration subscribers from mm2 to mm3
by Mateusz Ostrzyżek 07 Aug '18

07 Aug '18

Hello, Is there any way to migrate subscribers from mailman2 to mailman3 other than writing them to mm3? I have a fiew lists on mailman2 an i want to migrate them to mailman 3, i found a way to migrate archive but cannot find any information about subscribers. Best regards -- Mateusz Ostrzyżek (null) (null)

2 1

dedicated mailman3 list server on Ubuntu 18.04 LTS - questions after installation
by John Seifarth 06 Aug '18

06 Aug '18

My goal is to build a stable dedicated list server using mailman3. It should use all current email authentication techniques to clearly show that it is an authentic non-spam mail list server. In the future, I may want to use the REST interface, so that’s why mailman2 is not an option. My installation: Installed Ubuntu 18.04 LTS server, with postfix, mysql and postgres. I then installed mail-stack-delivery, postfix-policyd-spf-python, OpenDKIM, and OpenDMARC. I configured SPF, DKIM, and DMARC records on my DNS server, and then configured postfix and dovecot to DKIM sign outgoing mail from local users, and check SPF, DMARC, and DKIM on incoming mail. I then installed the package mailman3-full, which provides version 3.1.1-9, using postgres 10 as the database. I have looked in Ubuntu bionic-backports and bionic-updates and do not see a more recent version. I see that version 3.2 was released in July, are debian/ubuntu mailman 3.2 packages available somewhere? I set up the /etc/mailman3 files: I added this to the end of mailman.cfg [archiver.hyperkitty] class: mailman_hyperkitty.Archiver enable: yes configuration: /etc/mailman3/mailman-hyperkitty.cfg In mailman-hyperkitty.cfg I copied the api_key: value from mailman-web.py MAILMAN_ARCHIVER_KEY, but removed the single quotes surrounding the value in the mailman-web.py file when writing the key in the mailman-hyperkitty.cfg file. I modified /etc/postfix/main.cf with this appended to the end: # Mailman-postfix integration owner_request_special = no # Support the default VERP delimiter. recipient_delimiter = + unknown_local_recipient_reject_code = 550 owner_request_special = no transport_maps = hash:/var/lib/mailman3/data/postfix_lmtp local_recipient_maps = proxy:unix:passwd.byname, $alias_maps, hash:/var/lib/mailman3/data/postfix_lmtp relay_domains = ${{$compatibility_level} < {2} ? {$mydestination} : {}} hash:/var/lib/mailman3/data/postfix_domains I ran /usr/share/mailman3-web/manage.py createsuperuser I ran a2enmod proxy_uwsgi I made a symbolic link from /etc/mailman3/apache.conf to /etc/apache2/conf-available/mailman3.conf, then ran a2enconf mailman3 I have read the documentation in /usr/share/docs/mailman3* along with what I could find concerning mailman3 on the web. The installation allows me to sign into the web interface, create a host, create mailing lists, and mass subscribe members. When members send email to the list address, the server sends the messages normally to the other members of the list. However, when I look at the list archives, there are no posts. I deliberately mass-subscribed an invalid address, and I can see in /var/log/mail.log that the message bounces, but I get no notification, nor do I see any bounce info when I look at the member info. My questions: 1) logging A lot of my questions would probably be answered if I could figure out hot to activate logging correctly. Currently, I see: root@mailman:/var/log/mailman3# ll -R -rw-rw---- 1 list list 0 Jul 29 20:06 bounce.log -rw-rw---- 1 list list 0 Jul 29 20:06 debug.log -rw-r----- 1 list list 3298 Aug 4 00:00 mailman.log -rw-rw---- 1 list list 34606 Jul 30 17:44 smtp.log drwxr-xr-x 2 www-data www-data 4096 Aug 3 06:25 web/ ./web: -rw-rw-r-- 1 www-data www-data 1520 Aug 3 06:25 mailman-web.log The bounce log and debug log are empty. I’ve set propagate: yes in the [logging.debian] section From /etc/mailman3/mailman.cfg # In this section, you can define defaults for all loggers, which will be # prefixed by 'mailman.'. Use subsections to override settings for specific # loggers. The names of the available loggers are: # # - archiver -- All archiver output # - bounce -- All bounce processing logs go here # - config -- Configuration issues <…snip…> Can anyone post an example of a ‘subsection’ to set archiver and bounce to debug? Do I have to create /var/log/mailman3/mailman.archiver.log and set ownership to list:list? 2) Where are posts stored? For me, this is the biggest mystery in mailman3. Local mail is delivered to ~/Maildir by dovecot. In the $var_dir hierarchy the directory messages contains just 2 messages dating to my initial tests. Anything I send to a list now, and which seems to be sent properly to the member addresses, I cannot find on the filesystem. Any clues as to what may be going on here? 3) Archival - Hyperkitty How does this work? All the parts seem to be in place, and I can see from ps /usr/bin/python3 /usr/lib/mailman3/bin/runner --runner=archive:0:1 -C /etc/mailman3/mailman.cfg How can I figure out why this is not working? In the web interface, I see that each of my lists has zero posts. But posts mailed to the list address do appear in the list members’ mailboxes! 4) Bounces I’ve deliberately put an erroneous email address as a list member. In postfix’s /var/log/mail.log I see the bounces, but get no notification, and /var/log/mailman3/bounce.log remains empty. 5) DKIM and DMARC I’ve got OpenDKIM running on inet:12345@localhost and OpenDMARC running on net:54321@localhost. How can I get mailman to use these milters and sign messages? How should DMARC munging be configured when signing? 6) Is there an overview of how mailman3 works? Is there documentation which explains the path of an incoming post through the system, including initial reception, list processing, sending to members, processing bounces, and archiving posts? Thanks in advance for help and pointers to any available documentation! John Seifarth Words & Wires SPRL Computer Consulting & Language Services Brussels, Belgium

3 2

bad ssl cert on docker guide site
by Fabian A. Santiago 06 Aug '18

06 Aug '18

hello, On the docker deployment guide site: https://asynchronous.in/docker-mailman/ linked to from here: http://docs.mailman3.org/en/latest/prodsetup.html the ssl cert is invalid, as it's issued against CN = www.github.com. just an fyi (although I"m sure others have seen this and there's likely a perfectly valid explanation I just haven't thought of). good day. -- Fabian S. OpenPGP: 0x643082042DC83E6D94B86C405E3DAA18A1C22D8F (new key) *** 0x3C3FA072ACCB7AC5DB0F723455502B0EEB9070FC (to be retired, still valid)

2 1

getting spammed when sending lots of mails (>1000)
by Asaf Ohayon 06 Aug '18

06 Aug '18

Hello Using Mailman 3.2 / Posfix 2.10.1 I have a list configured, when having only few members, all is OK, email gets to inbox (at GMail) But when sending to thousands of members, it gets to the Spam folder, Is it a matter of rate-limiting at postfix ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

2 1

"To:" header field
by Asaf Ohayon 05 Aug '18

05 Aug '18

Hello I'm having trouble with getting into spam folder (at least at gmail), I'm suspecting to "To:" field (among other things). Comparing to Mailman 2.1, which we recently upgrading from, and didn't got spammed, the "To:" field was set to the actual reciever, While in Mailman 3.2, the "To:" field is set to the list's address. How can this be configured ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

2 1

Archiving error
by Eric Abrahamsen 03 Aug '18

03 Aug '18

Since about two days ago, all attempts to archive messages via Hyperkitty have raised the error below. So far as I know, I haven't updated any packages, or changed any config. I don't know why this has started happening. Internal Server Error: /hyperkitty/api/mailman/archive IntegrityError at /hyperkitty/api/mailman/archive NOT NULL constraint failed: hyperkitty_attachment.size Request Method: POST Request URL: http://lists.my-domain.org/hyperkitty/api/mailman/archive?key=NotMyRealKey Django Version: 2.0.5 Python Executable: /home/eric/.local/share/virtualenvs/mailman-FH66s6f7/bin/python Python Version: 3.5.2 Traceback: File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute 85. return self.cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/sqlite3/base.py" in execute 303. return Database.Cursor.execute(self, query, params) The above exception (NOT NULL constraint failed: hyperkitty_attachment.size) was the direct cause of the following exception: File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/core/handlers/exception.py" in inner 35. response = get_response(request) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/core/handlers/base.py" in _get_response 128. response = self.process_exception_by_middleware(e, request) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/core/handlers/base.py" in _get_response 126. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/hyperkitty/views/mailman.py" in _decorator 72. return func(request, *args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/views/decorators/csrf.py" in wrapped_view 54. return view_func(*args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/hyperkitty/views/mailman.py" in archive 119. add_to_list(mlist_fqdn, msg) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/hyperkitty/lib/incoming.py" in add_to_list 162. encoding=encoding) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/manager.py" in manager_method 82. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/query.py" in create 417. obj.save(force_insert=True, using=self.db) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in save 729. force_update=force_update, update_fields=update_fields) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in save_base 759. updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in _save_table 842. result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/base.py" in _do_insert 880. using=using, raw=raw) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/manager.py" in manager_method 82. return getattr(self.get_queryset(), name)(*args, **kwargs) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/query.py" in _insert 1125. return query.get_compiler(using=using).execute_sql(return_id) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/models/sql/compiler.py" in execute_sql 1283. cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in execute 68. return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute_with_wrappers 77. return executor(sql, params, many, context) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute 85. return self.cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/utils.py" in __exit__ 89. raise dj_exc_value.with_traceback(traceback) from exc_value File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/utils.py" in _execute 85. return self.cursor.execute(sql, params) File "/home/eric/.local/share/virtualenvs/mailman-FH66s6f7/lib/python3.5/site-packages/django/db/backends/sqlite3/base.py" in execute 303. return Database.Cursor.execute(self, query, params) Exception Type: IntegrityError at /hyperkitty/api/mailman/archive Exception Value: NOT NULL constraint failed: hyperkitty_attachment.size Request information: USER: AnonymousUser GET: key = 'NotMyRealKey' POST: mlist = 'my-list(a)lists.my-domain.org' FILES: message = <InMemoryUploadedFile: message.txt ()> COOKIES: No cookie data META: CONTENT_LENGTH = '579002' CONTENT_TYPE = 'multipart/form-data; boundary=4c9a29456f514b2a9ef4f9a5d042abc6' HTTP_ACCEPT = '*/*' HTTP_ACCEPT_ENCODING = 'gzip, deflate' HTTP_CONNECTION = 'close' HTTP_HOST = 'lists.my-domain.org' HTTP_USER_AGENT = 'python-requests/2.18.4' HTTP_X_FORWARDED_FOR = 'xxx.xxx.xx.xxx' HTTP_X_FORWARDED_HOST = 'lists.my-domain.org' HTTP_X_REAL_IP = 'xxx.xxx.xx.xxx' PATH_INFO = '/hyperkitty/api/mailman/archive' QUERY_STRING = 'key=NotMyRealKey' REMOTE_ADDR = '127.0.0.1' REQUEST_METHOD = 'POST' SCRIPT_NAME = '' SERVER_NAME = '127.0.0.1' SERVER_PORT = '231742768' SERVER_PROTOCOL = 'HTTP/1.0' wsgi.errors = <_io.TextIOWrapper name='<stderr>' mode='w' encoding='UTF-8'> wsgi.file_wrapper = '' wsgi.input = <_io.BytesIO object at 0x7f940d0055c8> wsgi.multiprocess = True wsgi.multithread = False wsgi.run_once = False wsgi.url_scheme = 'http' wsgi.version = '(1, 0)'

1 0

Removing banned emails
by Kaleb White 02 Aug '18

02 Aug '18

I am trying to remove a banned email with a special character via the rest api and it's not working. It's also not working via the UI. Any ideas? http://localhost:8001/3.0/lists/example.com/bans/provisor#41@bankofamerica.… <Response [404]>

3 2

Re: Mailman 3 Keeps Forgettings Imported Lists
by Ryan McClung 31 Jul '18

31 Jul '18

I do see the output of the script and it shows the mailing lists being created. If you put "${VARIABLE}"@domain.com it outputs correctly. Also, to that end, the output of lists changes depending on which directory I am in which makes 0 sense. On Tue, Jul 31, 2018 at 3:27 PM Ryan McClung <rmcclung(a)afilias.info> wrote: > I do see the output of the script and it shows the mailing lists being > created. If you put "${VARIABLE}"@domain.com it outputs correctly. > > On Tue, Jul 31, 2018 at 3:22 PM Mark Sapiro <mark(a)msapiro.net> wrote: > >> On 07/31/2018 07:04 AM, Ryan McClung wrote: >> > Scratch that. Ran with the corrected script and getting the following: >> > [root@mailman3(stg) archives]# mailman lists >> > No matching mailing lists found >> > >> > Any thoughts? >> >> This >> >> > for DIR in $DIRS; do mailman create "${DIR}"; mailman import21 "${DIR}"@ >> afilias.info "${DIR}"/config.pck; >> >> is still wrong. The list name for mailman create needs to be fully >> qualified as in >> >> > for DIR in $DIRS; do mailman create ${DIR}(a)afilias.info; mailman >> import21 ${DIR}(a)afilias.info ${DIR}/config.pck; >> >> (Do you look at the output from your script?) >> >> -- >> Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, >> San Francisco Bay Area, California better use your sense - B. Dylan >> _______________________________________________ >> Mailman-users mailing list -- mailman-users(a)mailman3.org >> To unsubscribe send an email to mailman-users-leave(a)mailman3.org >> https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/ >> > > > -- > > Ryan McClung > Systems Administrator @ Afilias Canada > A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 > <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> > W. www.afilias.info > T. +1.416.646.3304 x4186 > -- Ryan McClung Systems Administrator @ Afilias Canada A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> W. www.afilias.info T. +1.416.646.3304 x4186

2 3

Mailman 3 Keeps Forgettings Imported Lists
by Ryan McClung 31 Jul '18

31 Jul '18

GNU Mailman 3.2.0 (La Villa Strangiato) Python 3.6.5 (default, Apr 10 2018, 17:08:37) [GCC 4.8.5 20150623 (Red Hat 4.8.5-16)] config file: /opt/mailman/var/etc/mailman.cfg db url: sqlite:////opt/mailman/var/data/mailman.db devmode: DISABLED REST root url: http://localhost:8001/3.1/ Shortly after I run an import on a bunch of lists they all disappear. [root@mailman3(stg) mailman]# mailman lists No matching mailing lists found I have 30+ lists. Any thoughts? -- Ryan McClung Systems Administrator @ Afilias Canada A. 204-4141 Yonge Street, Toronto, ON, Canada, M2P 2A8 <https://maps.google.com/?q=4141+Yonge+Street,+Toronto,+ON,+Canada,+M2P+2A8&…> W. www.afilias.info T. +1.416.646.3304 x4186

2 4

mailman command to remove members
by Asaf Ohayon 31 Jul '18

31 Jul '18

Is there command like mailman members --add, to mass-remove members from a list ? Thanks

2 1

Autorespond postings: does not seem to work on 3.2?
by Asaf Ohayon 29 Jul '18

29 Jul '18

Hello Maybe I'm not understanding the meaning of this setting correctly, When I set this, I don't see any extra emails going out when I'm posting to the list Thanks

2 1

MM3 installation recommendation: Docker or individual components?
by Tom Browder 28 Jul '18

28 Jul '18

I want to install MM3 on a virgin host running Debian 9. I want to minimize problems as bugs are fixed and necessary upgrades are published. I will use PostgreSQL, nginx, and Postfix, and am reasonably competent runnng my own remote server (full control, hard iron server, not virtual). The host will only serve mail to the public and nothing else (no websites, no other users). I did run a successful MM2 site (thanks to Mark’s copious and gracious help!) for a couple of years from 2011 to 2013, so I’m no stranger to some of the MM3 jargon. I have been running Apache 2.4+ with 10+ virtual https websites since 2010. I use Letsencrypt certificates for all of them. I have no experience with Docker, Django, or nginx. Should I choose the Docker method or individual compnent installation? I realize this is an open ended and very subjective request, but I would appreciate any advice. Best regards, -Tom

2 2

Re: [Mailman-Developers] Container Images for Mailman 3.2 release
by Abhilash Raj 27 Jul '18

27 Jul '18

On Fri, Jul 27, 2018, at 1:16 PM, Kamran Soomro wrote: > Hi Abhilash, > > This is great. Thank you very much. Might I make a small suggestion? I > think it might be less confusing to use tags for your images that > conform to the mailman release. E.g. 3.2 should contain mailman 3.2, 3.3 > should contain mailman 3.3 etc. At the moment it’s hard to tell which > image contains which release. Sounds like a good idea! I will push 3.2 tags as soon as I can! > > Just my two cents. > > –Kamran > > > On 27 Jul 2018, at 21:08, Abhilash Raj <maxking(a)asynchronous.in> wrote: > > > > Hi All, > > > > I have updated and pushed releases for Container Images with 3.2 release of the suite. > > > > They are available at: > > > > docker.io/maxking/mailman-web:0.2 > > docker.io/maxking/mailman-core:0.2 > > > > A similar copy of both is also available at quay: > > > > quay.io/maxking/mailman-web:0.2 > > quay.io/maxking/mailman-core:0.2 > > > > The releases contain the following versions of components: > > > > mailman-core: > > - Mailman Core 3.2.0 > > - Mailman-hyperkitty 1.1.0 > > > > mailman-web: > > - Postorius 1.2.1 > > - Hyperkitty 1.2.0 > > - Django-mailman3 1.2.0 > > - MailmanClient 3.2.0 > > > > The upgrade process from 0.1 release should be relative painless, except for the full-text index, which needs to be rebuilt due to the migration from Python 2 to 3 of the full-text indexing library whoosh. You can run the following commands to do so, after the upgrade: > > > > $ docker exec -it mailman-web bash > > bash # python manage.py rebuild_index > > > > If you are not using the default docker-compose.yaml file provided in the repo, you need to add an extra environment variable for mailman-web container, POSTORIUS_TEMPLATE_BASE_URL, which defaults to `http://mailman-web:8000`. It should be the URL where your mailman-web container is listening on with HTTP (port 8000 by default). > > > > The rolling releases are not being rolled out right everyday now, because of broken build scripts. I'd recommend everyone use the new stable releases that I mentioned above. Going forward, I'll try to release stable versions more often, so that there isn't any need for rolling version, but fixing the rolling releases is on my TODO. > > > > Documentation for these images is available at: > > > > https://github.com/maxking/docker-mailman > > > > -- > > thanks, > > Abhilash Raj (maxking) > > _______________________________________________ > > Mailman-Developers mailing list -- mailman-developers(a)python.org > > To unsubscribe send an email to mailman-developers-leave(a)python.org > > https://mail.python.org/mm3/mailman3/lists/mailman-developers.python.org/ > > Mailman FAQ: https://wiki.list.org/x/AgA3 > > > > Security Policy: https://wiki.list.org/x/QIA9 -- thanks, Abhilash Raj (maxking)

1 0

Container Images for Mailman 3.2 release
by Abhilash Raj 27 Jul '18

27 Jul '18

Hi All, I have updated and pushed releases for Container Images with 3.2 release of the suite. They are available at: docker.io/maxking/mailman-web:0.2 docker.io/maxking/mailman-core:0.2 A similar copy of both is also available at quay: quay.io/maxking/mailman-web:0.2 quay.io/maxking/mailman-core:0.2 The releases contain the following versions of components: mailman-core: - Mailman Core 3.2.0 - Mailman-hyperkitty 1.1.0 mailman-web: - Postorius 1.2.1 - Hyperkitty 1.2.0 - Django-mailman3 1.2.0 - MailmanClient 3.2.0 The upgrade process from 0.1 release should be relative painless, except for the full-text index, which needs to be rebuilt due to the migration from Python 2 to 3 of the full-text indexing library whoosh. You can run the following commands to do so, after the upgrade: $ docker exec -it mailman-web bash bash # python manage.py rebuild_index If you are not using the default docker-compose.yaml file provided in the repo, you need to add an extra environment variable for mailman-web container, POSTORIUS_TEMPLATE_BASE_URL, which defaults to `http://mailman-web:8000`. It should be the URL where your mailman-web container is listening on with HTTP (port 8000 by default). The rolling releases are not being rolled out right everyday now, because of broken build scripts. I'd recommend everyone use the new stable releases that I mentioned above. Going forward, I'll try to release stable versions more often, so that there isn't any need for rolling version, but fixing the rolling releases is on my TODO. Documentation for these images is available at: https://github.com/maxking/docker-mailman -- thanks, Abhilash Raj (maxking)

1 0

Double footer
by Asaf Ohayon 23 Jul '18

23 Jul '18

Hello Upon a clean installation of Mailman 3.2.0a1, Without any additional configuration, nor custom footers, When accepting message from the list on Gmail client for example, The footer shows twice, also in the message source I see two identical footer parts, accept for the message barrier: --===============4363779446011731395== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Info mailing list -- info(a)mailman.sysbind.biz To unsubscribe send an email to info-leave(a)mailman.sysbind.biz --===============4363779446011731395== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Info mailing list -- info(a)mailman.sysbind.biz To unsubscribe send an email to info-leave(a)mailman.sysbind.biz --===============4363779446011731395==--

3 4

Migrating from SQLite to PostgreSQL
by Joe Steeve 20 Jul '18

20 Jul '18

Hello All, I have an installation on SQLite. I want to migrate it to PostgreSQL. Is that feasible? Any gotchas I need to watch for? -- Joe Steeve HiPro IT Solutions Private Limited http://www.hipro.co.in/

6 8

Creating a new list using REST from the host
by Henrik Rasmussen 18 Jul '18

18 Jul '18

I am using Docker-mailman (GNU Mailman 3.2.0a1), but from the host I am trying to create a list using the REST API in the (yet, no offense) lack of a template for new list configurations. I get a nice dictionary when getting data out of Mailman, but using this exact dictionary (for debug) as payload to Mailman (my mmapiwrite), and with reference to https://mailman.readthedocs.io/en/latest/src/mailman/rest/docs/lists.html#c…, I get a response "A server error occurred. Please contact the administrator.". I don't understand the dump_json and I find the docs above hard to follow. How should I create the list using REST? <code> restapiversion = '3.1' def getlistdefaultsx(): # Exact output from Mailman, see below. listdefaultsx = { 'acceptable_aliases': [], 'admin_immed_notify': True, 'admin_notify_mchanges': False, 'administrivia': True, [SNIP] 'subscription_policy': 'confirm_then_moderate', 'volume': 1} return(listdefaultsx) def get_all_list_names(): all_list_fqdn = [] response = mmapi('lists?count=10&page=1') output = response.json() for entry in output.get('entries'): all_list_fqdn.append(entry.get('fqdn_listname')) return(all_list_fqdn) def addlist(): list_setup = getlistdefaultsx() go_create_list('abc', list_setup) def go_create_list(list_name_fqdn, list_setup): #pprint(list_setup) print('Creating list %s ...' % list_name_fqdn) response = mmapiwrite('lists', list_setup) def mmapi(apicommand): response = requests.get('http://172.19.199.2:8001/%s/%s' % (restapiversion, apicommand), auth=('restadmin', 'restpass')) def mmapiwrite(apicommand,payload): response = requests.post('http://172.19.199.2:8001/%s/%s' % (restapiversion, apicommand), data=payload, auth=('restadmin', 'restpass')) getlistdefaultsx is an actual dictionary with real output from Mailman using my mmapi from an existing test list (though domain names are masked. Of course I can't create an existing list, but when changing the list name I get the same error message. {'acceptable_aliases': [], 'admin_immed_notify': True, 'admin_notify_mchanges': False, 'administrivia': True, 'advertised': True, 'allow_list_posts': True, 'anonymous_list': False, 'archive_policy': 'never', 'autorespond_owner': 'none', 'autorespond_postings': 'none', 'autorespond_requests': 'none', 'autoresponse_grace_period': '90d', 'autoresponse_owner_text': '', 'autoresponse_postings_text': '', 'autoresponse_request_text': '', 'bounces_address': 'hertest2-bounces(a)example.ku.dk', 'collapse_alternatives': True, 'convert_html_to_plaintext': False, 'created_at': '2018-03-19T14:19:49.018252', 'default_member_action': 'defer', 'default_nonmember_action': 'hold', 'description': 'Test-domæne for Mailman 3-testlister', 'digest_last_sent_at': None, 'digest_send_periodic': True, 'digest_size_threshold': 30.0, 'digest_volume_frequency': 'monthly', 'digests_enabled': True, 'display_name': 'Hertest2', 'dmarc_mitigate_action': 'no_mitigation', 'dmarc_mitigate_unconditionally': False, 'dmarc_moderation_notice': '', 'dmarc_wrapped_message_text': '', 'filter_content': False, 'first_strip_reply_to': False, 'fqdn_listname': 'hertest2(a)example.ku.dk', 'http_etag': '"987dfgf8g569fvfd6v7"', 'include_rfc2369_headers': True, 'info': '', 'join_address': 'hertest2-join(a)example.ku.dk', 'last_post_at': None, 'leave_address': 'hertest2-leave(a)example.ku.dk', 'list_name': 'hertest2', 'mail_host': 'example.ku.dk', 'max_message_size': 40, 'moderator_password': None, 'next_digest_number': 1, 'no_reply_address': 'noreply(a)example.ku.dk', 'owner_address': 'hertest2-owner(a)example.ku.dk', 'post_id': 1, 'posting_address': 'hertest2(a)example.ku.dk', 'posting_pipeline': 'default-posting-pipeline', 'reply_goes_to_list': 'no_munging', 'reply_to_address': '', 'request_address': 'hertest2-request(a)example.ku.dk', 'send_welcome_message': True, 'subject_prefix': '[Hertest2] ', 'subscription_policy': 'confirm_then_moderate', 'volume': 1} </code>

2 1

Upgrading from 3.1 to 3.2
by Joe Steeve 18 Jul '18

18 Jul '18

Hello All, I have a 3.1 installation. I want to upgrade to 3.2. Has anyone attempted this? Any gotchas I need to be aware of? -- Joe Steeve HiPro IT Solutions Private Limited http://www.hipro.co.in/

2 2

Mail configuration
by Darren Smith 14 Jul '18

14 Jul '18

I'm not sure if this is the correct forum for this question, but I'm pretty sure if there is expertise on how to do what I want to do, it can be found here. Overview of what I am looking to do: Due to the impending shutdown (in the next 6 months) of the data center where our mailman server lives, we are being forced to move the installation. We are going to be moving it to a different location. Here is our problem... Moving things is not really a problem in and of itself - I'm confident that I can get things set up correctly elsewhere. However, our email server sends somewhere around 100,000 emails per day, and if you cut over from one IP address to another IP address, my understanding is that most ISPs will start to ban you, because they are not used to that sort of volume coming from an unknown IP. I know it would be better if we could keep the IP address, but again, due to circumstances beyond my control, this is not going to be a possibility. We have been told that "warming up" the IP is the way to go - that is, cutting over just some of the traffic a little at a time. So what I am looking for is a way for all mail on our domain to be sent to our current mailman installation, and based on some configuration (certain mailing lists?) certain emails being sent out to the list subscribers will first be forwarded to the new server and be sent from the new IP address. Does that make sense? Does anyone know a way that mailman/postfix can be configured to accomplish this? Is there a different forum where I might be able to ask experts about this? Thanks, -Darren

5 6

Triaging message non-receipt
by Eric Abrahamsen 13 Jul '18

13 Jul '18

I've got a very small list (five members) for the management of a charitable organization, and we're having trouble with intermittent message delivery failure. I was running all the mailman related packages at git master from maybe two months ago, and updated everything to master again when I saw the announcement about version 3.2. Two of our subscribers intermittently don't receive emails sent to the list by the other. One is using Gmail, the other Yahoo, and they confirm that messages are not being shunted into spam folders. It happens only occasionally: apparently nearly half the messages don't go through. The rest of us get all the messages, including all sent by these two. All messages are correctly archived in hyperkitty. smtp.log always shows "for 5 recips", even for the messages that the two users aren't getting. These two users only ever miss messages sent by the other. I'm still inclined to blame Gmail and/or Yahoo, though I don't know why they would be swallowing only messages from the other, and not from other list members. Is there any way to get a better sense of where things are going wrong? Turn up the logging verbosity? Send test messages? Get more diagnostics? If anyone has any suggestions (or if this situation sounds familiar to anyone) I would love to hear about it. Thanks, Eric

2 2

Mailman3 Issue
by Danny Weddle 13 Jul '18

13 Jul '18

For some weird reason, the file /mailman/var/data/postfix_domains has a whitespace added to every mail domain. I checked the postfix main.cf file for any white spaces, but did not see any. I get errors every time that I try to add a list. The console shows whitespace " example.org" in the list. The web page shows: Environment: Request Method: GET Request URL: http://172.16.11.235/postorius/lists/list11.mail.example2.com/ Django Version: 2.0.5 Python Version: 3.6.5 Installed Applications: ('hyperkitty', 'postorius', 'django_mailman3', 'django.contrib.admin', 'django.contrib.auth', 'django.contrib.contenttypes', 'django.contrib.sessions', 'django.contrib.sites', 'django.contrib.messages', 'django.contrib.staticfiles', 'rest_framework', 'django_gravatar', 'paintstore', 'compressor', 'haystack', 'django_extensions', 'django_q', 'allauth', 'allauth.account', 'allauth.socialaccount', 'django_mailman3.lib.auth.fedora', 'allauth.socialaccount.providers.openid', 'allauth.socialaccount.providers.github', 'allauth.socialaccount.providers.gitlab', 'allauth.socialaccount.providers.google', 'allauth.socialaccount.providers.twitter', 'allauth.socialaccount.providers.stackexchange') Installed Middleware: ['django.middleware.security.SecurityMiddleware', 'django.contrib.sessions.middleware.SessionMiddleware', 'django.middleware.common.CommonMiddleware', 'django.middleware.csrf.CsrfViewMiddleware', 'django.contrib.auth.middleware.AuthenticationMiddleware', 'django.contrib.messages.middleware.MessageMiddleware', 'django.middleware.clickjacking.XFrameOptionsMiddleware'] Traceback: File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/exception.py" in inner 35. response = get_response(request) File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/base.py" in _get_response 128. response = self.process_exception_by_middleware(e, request) File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/base.py" in _get_response 126. response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/local/lib64/python3.6/site-packages/django/views/generic/base.py" in view 69. return self.dispatch(request, *args, **kwargs) File "/home/weddled/mailman/postorius/src/postorius/views/generic.py" in dispatch 57. return super(MailingListView, self).dispatch(request, *args, **kwargs) File "/usr/local/lib64/python3.6/site-packages/django/views/generic/base.py" in dispatch 89. return handler(request, *args, **kwargs) File "/home/weddled/mailman/postorius/src/postorius/views/list.py" in get 219. 'hyperkitty' in self.mailing_list.archivers and File "/usr/lib64/python3.6/_collections_abc.py" in __contains__ 666. self[key] File "/usr/local/lib/python3.6/site-packages/mailmanclient-3.2.0b1-py3.6.egg/mailmanclient/restbase/base.py" in __getitem__ 151. return self._get(key) File "/usr/local/lib/python3.6/site-packages/mailmanclient-3.2.0b1-py3.6.egg/mailmanclient/restbase/base.py" in _get 90. return self.rest_data[key] File "/usr/local/lib/python3.6/site-packages/mailmanclient-3.2.0b1-py3.6.egg/mailmanclient/restbase/base.py" in rest_data 76. response, content = self._connection.call(self._url) File "/usr/local/lib/python3.6/site-packages/mailmanclient-3.2.0b1-py3.6.egg/mailmanclient/restbase/connection.py" in call 103. raise HTTPError(url, response.status, content, response, None) During handling of the above exception (HTTP Error 500: b'A server error occurred. Please contact the administrator.'), another exception occurred: File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/exception.py" in inner 35. response = get_response(request) File "/usr/local/lib64/python3.6/site-packages/django/utils/deprecation.py" in __call__ 95. response = self.get_response(request) File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/exception.py" in inner 37. response = response_for_exception(request, exc) File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/exception.py" in response_for_exception 87. response = handle_uncaught_exception(request, get_resolver(get_urlconf()), sys.exc_info()) File "/usr/local/lib64/python3.6/site-packages/django/core/handlers/exception.py" in handle_uncaught_exception 122. return debug.technical_500_response(request, *exc_info) File "/usr/local/lib64/python3.6/site-packages/django/views/debug.py" in technical_500_response 89. reporter = ExceptionReporter(request, exc_type, exc_value, tb) File "/usr/local/lib64/python3.6/site-packages/django/views/debug.py" in __init__ 254. self.template_info = getattr(self.exc_value, 'template_debug', None) File "/usr/lib64/python3.6/tempfile.py" in __getattr__ 477. file = self.__dict__['file'] Exception Type: KeyError at /postorius/lists/list11.mail.example2.com/ Exception Value: 'file'

3 10

Announcing Mailman Suite 3.2 release
by Abhilash Raj 11 Jul '18

11 Jul '18

I am very pleased to announce the release of Mailman Suite 3.2. This includes Mailman Core 3.2.0, MailmanClient 3.2.0, Postorius 1.2.0, Django-Mailman3 1.2.0, Hyperkitty 1.2.0. This release includes tons of new features and bug fixes. We had support from tons of new contributors and I, on behalf of the whole Mailman Core team, would like to thank each one of you. Mailman Core includes support for plugins, more attributes exposed in REST API and improved support for migrating Mailman 2.x lists. You can now migrate settings and memberships from Mailman 2.x lists to Mailman 3.1. Full change log is available here: https://mailman.readthedocs.io/en/latest/src/mailman/docs/NEWS.html#la-vill… Postorius, The New Mailman Web UI, now has more settings exposed. The most noteworthy of the features include Python 3.5+ support. Also, you can now set templates for headers, footers and automatic responses inside of Postorius. Full change log is available here: https://postorius.readthedocs.io/en/latest/news.html#id1 Hyperkitty, the next-generation mailing-list archiver, has also jumped on the Python 3.5+ wagon and supports all the latest and stable versions of Django. Importing archives from Mailman 2.x is now even more improved. Full change log is available here: https://hyperkitty.readthedocs.io/en/latest/news.html#id1 All the components can be downloaded from https://pypi.org. Mailman is free software for managing email mailing lists and e-newsletters. Mailman is used for all the python.org and SourceForge.net mailing lists, as well as at hundreds of other sites. The Full documentation for the Suite is available at: http://docs.mailman3.org/en/latest/ For more information, please see our web site at one of: http://www.list.org https://www.gnu.org/software/mailman http://mailman.sourceforge.net/ https://mirror.list.org/ -- thanks, Abhilash Raj (maxking)

4 4

Pre-approved howto
by thor.rustad＠gmail.com 09 Jul '18

09 Jul '18

I have tried to understand the concept of pre-approved messages, but I'm spending way too much trying to figure it out. Help! The scenario is as follows: Mailman installation with hundreds of lists. Each list's owner is only supposed to add/remove members, so approving/rejecting messages is not in the "job description". Then we have a small group of superusers who will be the ones sending documents etc to all 800 lists. The superusers should be able to do so without being stopped by size limits etc. How can I achieve this? ---- Thor Atle Rustad ----

3 3

Mailman 3 localization
by Danil Smirnov 05 Jul '18

05 Jul '18

Hi! I saw in the docs: Localization > > We have it! We just don’t have proper documentation here yet. > Could you please be more specific - can I switch Mailman 3 installation to Spanish? Regards, Danil Smirnov

7 13

Query on how to change moderator message to non-members
by robert.kydd＠gmail.com 04 Jul '18

04 Jul '18

Hi My users are upset that when their mail is waiting moderation release they receive this message: 'Your mail to 'Members' with the subject AW: [Members] Hamburg 2019 Is being held until the list moderator can review it for approval. The reason it is being held: Post by non-member to a members-only list' Is their a way to change the text "post by a non-member to a members-only list" as they are registered members of the Joomla site

3 8

Unknown attribute: max_message_size
by Thor Atle Rustad 27 Jun '18

27 Jun '18

If I make changes here: https://example.com/postorius/lists/test2.example.com/settings/message_acce…, I get a warning that the Maximum Message Size field at the bottom is mandatory. However, if I put a number in that field and save, I get "Unknown attribute: max_message_size". That makes sense, since Mark states in https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message… that max_messages_size is not exposed in REST. What to do? I have Maxking mailman-docker but can easily copy files into the image if necessary. Thor

5 8

List admin statistics
by Andrew Hodgson 26 Jun '18

26 Jun '18

Hi, On my Mailman3 installation the posting statistic doesn't seem to be getting reset, the digest stat is showing correctly however. Not sure about the volume stat. I imported my list from a Mailman2 pck file and the last posting data is the last message that went via Mailman2. Any ideas? Thanks. Andrew.

2 1

Gmail/Fetchmail in Mailman3?
by Bill Christensen 24 Jun '18

24 Jun '18

Hi folks, We're (finally) in the early stages of upgrading from Mailman2 to Mailman3. Our Mailman2 setup uses Fetchmail to retrieve list mail from our accounts on Gmail. Is there a similar setup for Mailman3? I admit that I've only done a light scan of the docs so far, but haven't found anything addressing such a scenario. Thanks in advance! -- Bill Christensen http://SustainableSources.com http://LinkedIn.com/in/billc108 Dance like nobody's watching. Encrypt like everyone is. --Adrián Lamo

2 3

Header / Footer apear as attachements on Outlook / Office365
by Asaf Ohayon 21 Jun '18

21 Jun '18

Trying to play with Header / Footer working OK on normal email clients, But on office they apear as attached txt files. Any Idea ? -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

2 1

Avoiding reply to list when User does "Reply To All"
by Asaf Ohayon 19 Jun '18

19 Jun '18

hello I've played with explicit reply-to address, and "Reply goes to list" -> "Explicit Reply-to headers set", And it works fine when user does "Reply" in the client (e.g: gmail), But when she presses Reply To All, still it sends also to the list, Is there some way to avoid this ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

2 1

HTML header / footer template
by Asaf Ohayon 18 Jun '18

18 Jun '18

Is it possible to put HTML header to allow inserting images ? Thanks -- Asaf Ohayon

2 4

Functionailty of web host domains
by Johannes Winter 16 Jun '18

16 Jun '18

Hello everybody, I'd actually like to use mailman3 in a multi-site setup, so that lists are only accessible from corresponding domains. I already asked once oif this would be possible with domain admins, but that is not implemented: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… Then i was asking myself whether it could be possible with the "wed host" functionality. For each domain you can specify a "web host". But when I specify a different one than the default for one domain, and make it accessible with specifying `DJANGO_ALLOWED_HOSTS`, all mailinglists from the other web hosts are also shown when I access the second site. So does this 'web host' option have a meaning, or is it just an alias for the first site? Best regards, Johannes Winter

2 1

Migrate from mysql to postgresql
by Bjoern Franke 14 Jun '18

14 Jun '18

Hi, is it possible to migrate a mailman3-mysql-database to a postgresql-database? I tried to convert it with pgloader, but some identifiers had to be cut off: _address_id); 2018-03-17T21:33:39.087000+01:00 WARNING PostgreSQL warning: Bezeichner idx_680560_account_emailconfirm_email_address_id_5b7f8c58_fk_account_e wird auf idx_680560_account_emailconfirm_email_address_id_5b7f8c58_fk_ac gekrzt Kind regards Bjoern

2 2

Disable like button
by Marvin Gülker 13 Jun '18

13 Jun '18

Hi everyone, is it possible to disable the facebookish like/dislike thumbs buttons on posts in Hyperkitty? I have the impression that this kind of functionality discourages useful, argumentative discussion and instead causes emotional voting without arguments on whatever is at hand (it is one of the features I would really like to disable on GitHub as well). A voting facility on its own is surely fine, but it shouldn't be on each post, but only where one actually wants to cast a vote. Also, one isn't informed of the thumbs up/thumbs down count when only using the email interface and not Hyperkitty. This can lead to confusion for users that only use Hyperkitty and feel their "votes" are being ignored. Marvin -- Blog: https://mg.guelker.eu PGP/GPG ID: F1D8799FBCC8BC4F

3 2

Is there a reason not to implement the config_list command ?
by Asaf Ohayon 11 Jun '18

11 Jun '18

Hello Is it meant to be implemented ? and if so, how is it recommended to do (for someone new to mailman 3 programming) Thanks

2 1

What is result of planned MM3 integrated installation at Pycon?
by Tom Browder 10 Jun '18

10 Jun '18

I may have missed the announcement, but I thought it was hoped to get a major leap toward an integrated MM3 installation at the May Pycon. Did anything exciting happen toward that goal, or should I just press on with the latest release? Thanks. Best regards, -Tom

2 3

Scheduled tasks
by Darren Smith 08 Jun '18

08 Jun '18

All, I am looking more through the documentation of the Mailman Suite here: https://media.readthedocs.org/pdf/gnu-mailman/latest/gnu-mailman.pdf In section 3.2.5 it talks about the scheduled tasks that need to be run to do "specific routine functions" in hyperkitty. I installed through the easy install script found here: https://github.com/iomarmochtar/mailman3_ei/ However, I can't find anything in THAT documentation that talks about these cron jobs, and in fact the Mailman Suite isn't installed through that script. Can someone point me to any other documentation about the tasks that need to be run on a continual basis? Our hyperkitty installation seems to be bogging down more and more, and I am hoping that it will be as simple as just running some jobs that haven't been on our radar. Thoughts? -Darren

2 3

Attachments
by Darren Smith 06 Jun '18

06 Jun '18

Guys, Is there a setting to disallow attachments in mailman3? Doing a cursory search I can't find it.

3 2

Re: GDPR - save subscriptions confirmation emails
by contact＠maadix.net 04 Jun '18

04 Jun '18

Thanks Selva for you answer. In my Mailman 3 installation there is no /var/log/mailman/subscribe I have logs about confirmations emails in mailman/var/logs/smtp.log the format is the following: Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) handling connection Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'LHLO mails.example.com' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'MAIL FROM:<contact(a)maadix.net>' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) sender: contact(a)example.net Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'RCPT TO:<prueba-confirm+7c010b0d89513b26d72cb4642e80447a2280ac86(a)list.example.org>' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) recip: prueba-confirm+7c010b0d89513b26d72cb4642e80447a2280ac86(a)list.example.org Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'DATA' Jun 03 13:45:27 2018 (20764) ('127.0.0.1', 40145) Data: b'QUIT' So, one solution that comes to my mind is to grep this log file. This is not a perfect solution and the full confirmation email is still missing. I am not sure if this would be GDPR compliant. Maddish El 03/06/18 a las 18:17, Selva Nair escribió: > Hi, > > On Sun, Jun 3, 2018 at 10:12 AM, contact(a)maadix.net <contact(a)maadix.net> wrote: >> >> Hi, >> >> I am new in the list. I have been looking for this topic in the archives >> in order to avoid duplicate, but I could not find any thread. >> >> According to the new GDPR rules, lists owners need to have a >> confirmation from subscribers, and this is easy to do with Mailman 3. >> >> What I can't figure out is how to save all the confirmation emails >> received from users. >> >> I only see the confirmations commands emails in the logs, >> >> Is there another place/way to store them? > > We have been doing this with mailman2 since Canadian Anti-Spam Law (CASL) > got enacted (2014) by independently archiving the confirmation messages. > With postfix we use recipient_bcc_maps and a script to do some extra filtering > but its clunky, and does not check that the confirmation succeeded or not. > > A feature within mailman to archive successful confirmations would be > useful. Keeping unsubscribe requests and evidence of subsequent > actions also seems necessary at least as per CASL. > > That said, we also keep the /var/log/mailman/subscribe logs (not sure > what that would be in mailman 3). Although the log has a single line > for each action, it may be enough to show (?) that a double opt-in process > was properly followed or unsub request was acted up on. > > Thanks, > > Selva > -- Maadix *MaadiX* Tu nube en tus manos https://maadix.net https://twitter.com/MaadiXnet

3 3

Delete User
by Kaleb White 25 May '18

25 May '18

Is it possible to delete a user from postorius completely so that they cannot log in again?

2 4

Urgent help needed...
by Darren Smith 24 May '18

24 May '18

Hello, This morning our Mailman 3/Hyperkitty/Postorius installation has become unresponsive. When looking at the machine, postgres is pegging all 4 CPUs on the machine. We did some digging in postgres, and here is the query that is causing problems: "SELECT hyperkitty_email.date FROM hyperkitty_email WHERE hyperkitty_email.mailinglist_id = 'fooey(a)rootsweb.com' ORDER BY hyperkitty_email.date ASC LIMIT 1;" We have found that it doesn't matter what mailinglist_id is being used. We have also found that this might be an issue with the LIMIT 1 - our investigation is showing that using LIMIT 1 in postgres makes things execute very differently than if you use a limit 2 or more, and that this is probably what is going on. Basically, every time this gets called, it pegs an entire CPU for 20-30 seconds. It appears to be called a LOT. So our users are getting 504 gateway timeouts right now. What has changed: We have been in the process of importing our 40 million archived emails from our old mailman 2 archives. Questions: 1) We have tried doing a grep in the codebase - mailman3, hyperkitty, postorius, django - basically anything that might be calling this code, but we can't find it. Does anyone know what generates this query? 2) We are positing that it might be our archive imports that are causing this problem. Does anyone know of any sort of limit/threshold that might cause this to go haywire? Any help you can give, any direction you can point us would be useful. Right now our lists are just down for our users. Thank you, Darren

2 2

Is it possible to use an authenticator with incorrect, missing, or changing email addresses?
by andrew＠fsf.org 24 May '18

24 May '18

Hello Mailman 3 users list, I was wondering if it's possible to set up a CAS authenticator with django-allauth ( https://pypi.org/project/django-allauth-cas/ ) even if we cannot guarantee the correctness of email addresses supplied by our CAS instance? Some contacts may also be missing an email address. I read about this here, and it seems like it wouldn't be possible: http://docs.mailman3.org/en/latest/config-web.html#configure-social-login > To see a list of all the providers, please have a look at the documentation of django-allauth. Make sure that the one you choose provides “email” as part of user data, otherwise it won’t work with Mailman. e.g. Twitter doesn’t give out emails. What if a user's email address changes on the CAS server? Will their email address in Mailman 3 be updated the next time they log in? Thanks, Andrew

2 1

What implications do GDPR have on Mailman, and how to requiring members to accept registration
by Henrik Rasmussen 23 May '18

23 May '18

In regards to GDPR*) I am wondering if there is any ways I can require my current and future subscribers, members and list administrators to accept registration. I am also concerned that new lists are created with a subscription policy "Confirm" as default, rather than at least "Moderate", which can cause people to be subscribed by others against there will. Also, regardless of this setting, administrators can subscribe people without their knowledge. Away from Gravatar, mentioned in another post, what implications do GDPR have on Mailman? *) http://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1510481733260&uri=CELEX%… Henrik Rasmussen

4 6

No archived messages in hyperkitty
by Eric Abrahamsen 12 May '18

12 May '18

I've got mailman3 up on Ubuntu 16.04, in a virtualenv, and (eventually) got everything working mostly okay. My last hurdle is archiving into hyperkitty: the web interface says "no archived list yet". The list I'm starting with is set to archive both to prototype (which I set up in the beginning, before I got hyperkitty going) and to hyperkitty. There appear to be no further boxes I can check, and mailman_hyperkitty.cfg is in place and I think correct. I think it's nearly working because new messages get filed to ./var/archives/hyperkitty/spool, in individual *.pck files, but then these files don't go anywhere, and the archives don't appear in the web view. It could be a problem with cronjobs, with qrunner, or maybe there's just one last hidden switch in a database somewhere that I haven't thrown. But I can't find anything. Any hints? TIA, Eric

2 3

List enumeration problem
by kawhite＠ancestry.com 11 May '18

11 May '18

On our mailman instance we see the following enumeration of ALL lists and ALL users consistently every 7.5 minutes. Does anyone know why this would be the case? We have a lot of mailing lists so it slows our machine down a lot. Apr 30 15:31:36 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/a(a)example.com HTTP/1.1" 200 310 Apr 30 15:31:36 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/a(a)example.com/config HTTP/1.1" 200 2021 Apr 30 15:31:36 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/b(a)example.com HTTP/1.1" 200 325 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/b(a)example.com/config HTTP/1.1" 200 2108 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/c(a)example.com HTTP/1.1" 200 326 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/c(a)example.com/config HTTP/1.1" 200 2049 Apr 30 15:31:37 2018 (39026) 127.0.0.1 - - "GET /3.0/lists/d(a)example.com HTTP/1.1" 200 324 ... Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/a@a HTTP/1.1" 404 13 Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/b@b HTTP/1.1" 404 13 Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/c@c HTTP/1.1" 404 13 Apr 30 16:26:28 2018 (9581) 127.0.0.1 - - "GET /3.0/users/d@d HTTP/1.1" 404 13

4 3

Subscribe only to one thread
by Ivan Perez 08 May '18

08 May '18

Dear Mailman users, There are many high-traffic mailing lists in which I would only be interested in receiving messages in specific threads (not all messages, nor some topics, nor a daily digest). Is there a way of "subscribing" to individual threads only, mainly those I initiate, or I actively participate in, but generally not receiving any emails from the list? If not, would others find this useful, and could it be implemented? (I understand that everyone wants features; I just don't know if it's a 2-hour patch or a 2-month project). Best wishes Ivan

2 2

Mailman, Supervisor, and keeping things running
by Darren Smith 07 May '18

07 May '18

Hello, Previously I had a problem when upgrading to the newest versions of the mailman modules - and it turns out that everything requires Python 3 or higher. That was fine - I spent some time today moving everything from a Python 2.7 virtual environment to a Python 3.6 virtual environment. What no longer works is Supervisor... The mailman easy install script from Omar Mochtar set up a webui service that runs wsgi and nginx and keeps them running. However...supervisor won't run on python 3.6. I'm not seeing a way to make that work. I've read that you can shim it in, but that it isn't recommended to be used in a production environment. I've looked into circus, and I'm not familiar with it. I'm wondering if anyone has any examples of setting up a service that keeps processes up and running? I've seen circus, but I'm wondering if anyone has an example of how to set it up, or another service that does the same thing? -Darren

3 4

Message Personalization: embed User name in header/footer‏
by Asaf Ohayon 07 May '18

07 May '18

Hello I'm trying to find info on how to embed personal details in message's header/footer Is it possible with mailman 3, if this is not implemented, how one start such feature ? Thanks -- Asaf Ohayon SRE | SysBind M: +972 547920828 P: + 972 3 5096219 E: asaf(a)sysbind.co.il Rothschild 60, Bat Yam www.sysbind.co.il

3 7

Could Mailman3 act like a private forum?
by andrew＠fsf.org 06 May '18

06 May '18

Hello Mailman3 users and maintainers, I'm wondering whether it would be possible for Mailman3 to act like a private forum. I know that Mailman3 has private lists and may allow for custom authenticators. However making some lists private seems to be different than making all list signups and archives public to those who are able to log in, but hidden from all users who cannot. Would Mailman3 be able to act like a forum that hides or shows lists based on whether someone is logged in? Thanks, Andrew

2 1

django-mailman3 update causing errors
by Darren Smith 02 May '18

02 May '18

Hello, In attempting to update our mailman3/postorius/hyperkitty installation, I have run into an error after upgrading the django-mailman3 project. Our webui is being run through supervisord. The command being run is this: /<path>/mailman3/conda/envs/mailman3_ext/bin/waitress-serve --listen=localhost:8787 webui.wsgi:application The error I'm getting is pretty long, but most of it appears to be usage instructions. Here are what I believe to be the pertinent parts: Error: Bad module 'webui.wsgi' Usage: waitress-serve [OPTS] MODULE:OBJECT <lots and lots of usage instructions> There was an exception (ImportError) importing your module. It had these arguments: 1. No module named error Any thoughts on why updating django-mailman3 would cause this? Thanks! -Darren

3 4

Hyperkitty Search box result in error 500
by Carlos R Laguna 02 May '18

02 May '18

Hello everyone, i have being using maxking's docker images for mailman 3 without any issue this far, unfortunately recently i found a problem with the search option in the archive, if i try to search for anything i got a error 500 Hyperkkity 1.1.4 docker exec mailman-web ./manage.py update_index --verbosity 2: https://paste.ubuntu.com/p/nS9htVcxp7/ I suspect that at some point while archiving mails something went wrong, but no sure. Any idea how to fix or debug further. Thanks in advance. -- Carlos R Laguna Mendoza Subdtor. Grp Técnico Tinored Joven Club de Computación y Electrónica Tel: 52793189, 7863-3174, 7868-4230

2 1

Hyperkitty Archives Empty
by jon.kokko＠us.fujitsu.com 02 May '18

02 May '18

I've installed the mailman bundle located here (https://github.com/iomarmochtar/mailman3_ei) and, minus a pip package or two, it was straightforward. Mail & list functionality appears to be working well but I have no archives/thread discussions after posting messages. Delivery, etc.. is all good. Can you offer some suggestions on how to debug the archiving piece? Thanks, ./JK

3 2

Domain admin
by Johannes Winter 29 Apr '18

29 Apr '18

Hello everybody, We would like to give our users the priviledge to create lists per domain. I Haven't found any options for that in the web interface. Is this possible somehow with mailman3? Best regards, Johannes

2 2

Rejecting held emails
by Darren Smith 26 Apr '18

26 Apr '18

Hello, We recently had a phishing message make it through our spam filters and arrive at a mailing list. The good news is that since it was not from a list member it was in the held message queue. I was able to find the message in the var/messages directory by searching for a keyword in the subject. However, after rejecting the message from Postorius, the message doesn't seem to be removed from the var/messages directory. Is this expected behavior? I know that infosec people won't be too happy about a phishing email sitting around on our disk. (Infosec guys are notoriously paranoid. :) ) Is there some sort of cleanup process that would remove these messages? If not, does this pose an issue where over time disk usage will creep up? This could be a pretty significant problem if that is the case. What do you think, sirs? -Darren

2 2

Disabling Gravatar
by Marvin Gülker 26 Apr '18

26 Apr '18

Hi everyone, I want to make you aware of a potential privacy problem in Mailman's Hyperkitty. Under the upcoming EU General Data Protection Regulation (GDPR)[1], which will be in force as of 2018-05-25, it is illegal to transmit data to third parties without a right to do so. Without going into the details, the inclusion of third party services into one's website is usually deemed such a transmission, and unless one has explicit consent of the user (e.g., by an optional (!), unticked ticking box) this is normally illegal (if one targets EU users). The GDPR does not affect private and family use (Art. 2(2)(c) GDPR), but the exact reach of that clause is yet to be determined; it certainly does not exclude company use of Mailman. I've found it's possible to disable the social login providers quite easily (we had this discussion here on the mailinglist recently), but I don't see an option to disable Gravatar. If there is one, please enlighten me, but anyway I want to propose this as a feature request against Hyperkitty. A GDPR-compliant implementation of Gravatar in Mailman would look like this: * In order to not transmit website visitor's data (IP address, browser info, etc) to Gravatar, Hyperkitty has to request the avatar image itself and not leave that to the user's browsers to do. In other words, the HTTP GET request needs to come from the server running Hyperkitty and the user's browser then just requests the avatar from the Hyperkitty server. Most likely easiest way to do this is to pre-download the avatar when an email is archived. * In order to not transmit the subscribers' data (email address, allows Gravatar to track the subscriber) to Gravatar illegally, the retrieval of the avatar image from Gravatar has to be disabled by default. Instead, an option needs to be added to the subscriber's control panel which he has to actively enable in order to have his Gravatar downloaded and thus used (privacy-by-default rule). I'm not saying Gravatar tracks people and sells the information gathered, though I have doubts on how Automattic makes money with the service. I'm just outlining the legal duties under the upcoming GDPR for service owners, which are independant of how Automattic processes the data in this specific case. Please don't dismiss this as some side feature not needed. The fines that can be imposed on service owners due to violation of the GDPR are very high (up to 20,000,000 € [that's 20 million euros, really]). Marvin [1]: http://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1510481733260&uri=CELEX:… -- Blog: https://www.guelkerdev.de PGP/GPG ID: F1D8799FBCC8BC4F

5 5

Mailman not able to process "big" requests
by Jonas Felber 24 Apr '18

24 Apr '18

Hi, We migrated from mailman2 to mailman3 a week ago. Since then we are unable to send messages the our students through the mailing list. Here are some symptoms: 1. I go to mass subscribe and subscribe 400 emails 2. I click subscribe, the browser (in my case safari) tries to load the page for a few seconds 3. The request times out 4. Once the service becomes responsible again, I see that only part of my emails got subscribed (~50 in this case). For me this really looks like the emails are sent on the "web-thread" that gets killed once the request times out. Looking at this https://gitlab.com/mailman/postorius/blob/master/src/postorius/views/list.p… <https://gitlab.com/mailman/postorius/blob/master/src/postorius/views/list.p…> seems to confirm my suspicions. Some quick overview of our infrastructure: The TCP endpoints are: browser -> haproxy in kubernetes-entry-router -> nginx in kubernetes-ingress -> nginx in mailman -> mailman We mitigated the issue by giving it more CPU power and increasing the timeouts in one of the nginx endpoints. We also have a problem with sending out emails to "large" (>50) groups, as they seem to not getting sent out at all. Do you have any idea what the problem here could be? We would be really glad if you can help us getting our mailman up and running, as I currently have to send emails out by "hand". I will happily provide you with more details about our configuration, just let me know what you need. Kind regards, Jonas Jonas Felber <jonas.felber(a)vis.ethz.ch <mailto:jonas.felber@vis.ethz.ch>> Aktuar & CTF Präsident VIS - Verein der Informatik Studierenden an der ETH Zürich CAB E 31, Universitätstr. 6, ETH Zentrum, CH-8092 Zürich https://www.vis.ethz.ch <https://www.vis.ethz.ch/>

4 4

Another interesting error...
by Darren Smith 24 Apr '18

24 Apr '18

So it appears that there was a message sent to one of our mailing lists that was put into the held message queue. However, when attempting to go to the message to do the moderation, the web page returns and Error 500. Looking in the mailman log, I found this: Apr 23 14:21:02 2018 (17878) REST request handler error: Traceback (most recent call last): File "/opt/mailman3/conda/lib/python3.6/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/database/transac tion.py", line 50, in wrapper rtn = function(*args, **kws) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/rest/wsgiapp.py" , line 214, in __call__ return super().__call__(environ, start_response) File "/opt/mailman3/conda/lib/python3.6/site-packages/falcon/api.py", line 227 , in __call__ responder(req, resp, **params) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/rest/post_modera tion.py", line 167, in on_get resource = self._make_collection(request) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/rest/helpers.py" , line 159, in _make_collection for resource in collection] File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/rest/helpers.py" , line 159, in <listcomp> for resource in collection] File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/rest/post_modera tion.py", line 157, in _resource_as_dict resource = self._make_resource(request.id) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/rest/post_modera tion.py", line 100, in _make_resource make_header(decode_header(resource['subject']))) File "/opt/mailman3/conda/lib/python3.6/email/header.py", line 174, in make_he ader h.append(s, charset) File "/opt/mailman3/conda/lib/python3.6/email/header.py", line 295, in append s = s.decode(input_charset, errors) UnicodeDecodeError: 'gb2312' codec can't decode byte 0x87 in position 2: illegal multibyte sequence It LOOKS as if there might be a character in the email somewhere - possibly in the subject or sender fields? - that is somehow unexpected. I am attempting to find the held message - can someone point me where I can go to see the message so that I can see what might be causing the problem? -Darren

4 11

sass error
by Alexander Klotz 20 Apr '18

20 Apr '18

Hi everybody, we tried to make a fresh installation out of the current version following the readme.md - we encounter the following error trying to do so. As mentioned elsewhere, 'sass' has been replaced by 'sassc', however, maybe somewhere there is still a reference to it that may have been overlooked? The answer to a similar error posted to this list in August 2017 unfortunately didn't help either. Any help would be appreciated! Thanks, Alex ERROR 2018-04-19 09:07:49,096 29 django.request Internal Server Error: /accounts/login/ Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/django/core/handlers/exception.py", line 41, in inner response = get_response(request) File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 249, in _legacy_get_response response = self._get_response(request) File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 217, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 215, in _get_response response = response.render() File "/usr/local/lib/python2.7/site-packages/django/template/response.py", line 107, in render self.content = self.rendered_content File "/usr/local/lib/python2.7/site-packages/django/template/response.py", line 84, in rendered_content content = template.render(context, self._request) File "/usr/local/lib/python2.7/site-packages/django/template/backends/django.py", line 66, in render return self.template.render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 207, in render return self._render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 199, in _render return self.nodelist.render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 990, in render bit = node.render_annotated(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 957, in render_annotated return self.render(context) File "/usr/local/lib/python2.7/site-packages/django/template/loader_tags.py", line 177, in render return compiled_parent._render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 199, in _render return self.nodelist.render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 990, in render bit = node.render_annotated(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 957, in render_annotated return self.render(context) File "/usr/local/lib/python2.7/site-packages/django/template/loader_tags.py", line 177, in render return compiled_parent._render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 199, in _render return self.nodelist.render(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 990, in render bit = node.render_annotated(context) File "/usr/local/lib/python2.7/site-packages/django/template/base.py", line 957, in render_annotated return self.render(context) File "/usr/local/lib/python2.7/site-packages/compressor/templatetags/compress.py", line 131, in render return self.render_compressed(context, self.kind, self.mode, forced=forced) File "/usr/local/lib/python2.7/site-packages/compressor/templatetags/compress.py", line 107, in render_compressed rendered_output = compressor.output(mode, forced=forced) File "/usr/local/lib/python2.7/site-packages/compressor/css.py", line 49, in output ret.append(subnode.output(*args, **kwargs)) File "/usr/local/lib/python2.7/site-packages/compressor/css.py", line 51, in output return super(CssCompressor, self).output(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/compressor/base.py", line 295, in output output = '\n'.join(self.filter_input(forced)) File "/usr/local/lib/python2.7/site-packages/compressor/base.py", line 235, in filter_input for hunk in self.hunks(forced): File "/usr/local/lib/python2.7/site-packages/compressor/base.py", line 205, in hunks precompiled, value = self.precompile(value, **options) File "/usr/local/lib/python2.7/site-packages/compressor/base.py", line 268, in precompile return True, filter.input(**kwargs) File "/usr/local/lib/python2.7/site-packages/compressor/filters/base.py", line 229, in input return super(CachedCompilerFilter, self).input(**kwargs) File "/usr/local/lib/python2.7/site-packages/compressor/filters/base.py", line 196, in input raise FilterError(err) FilterError: /bin/sh: sass: not found

2 2

Re: Question regarding serve_from_domain
by Alexander Klotz 20 Apr '18

20 Apr '18

Hi Steve, thanks for your answer - we've made a completely new installation and don't encounter this specific error anymore, so we won't need an answer for that at the moment. Best, Alex Am 20.04.18 um 09:47 schrieb Stephen J. Turnbull: > Did you ever get an answer to this? I will have some time to look > into it over the weekend (I've been away from coding in core dev for a > while, so no answer offhand), but I'd like to know if you still need > an answer before spending time on it. :-) > > Steve > > Alexander Klotz writes: > > Hello, > > > > we're currently unsure in which file the serve_from_domain-entry > > described in the readme.md regarding mailman-web. We just updated the > > docker and encounter the following error, which might correspond to the > > missing entry: > > > > OSError: [Errno 13] Permission denied: '/opt/mailman-web/fulltext_index' > > > > Any help would be appreciated - thanks! > > > > > > -- > > Regards, > > Alex Klotz > > > > (culturebase editorial staff) > -- Mit freundlichen Grüßen, Alexander Klotz (redaktion kulturserver) mailto:alexk@kulturserver.de Stiftung kulturserver.de gGmbH Lothringerstraße 23 D-52062 Aachen http://ggmbh.kulturserver.de Geschäftsführer: Wolfgang Knauff Amtsgericht Aachen* *Handelsregister-Nr.:B 10515 Umsatzsteuer-Identifikations-Nr.:DE DE 230868040

1 0

Outgoing messages fro Mailman fails DMARC
by Henrik Rasmussen 19 Apr '18

19 Apr '18

I have set up Postfix to DKIM sign outgoing mails from GNU Mailman 3.2.0a1 which validates nicely ("dkim=pass (signature was verified)"), but DMARC fails ("dmarc=fail action=none") on the recipient end, probably because the "header.from=gmail.com;" (or similar) which means that DKIM d= will not match. According to dmarc.org*) "Mailing lists usually do not take authorship of the emails they relay" so I should "consider to apply specific rules for emails coming from mailing lists". Also according to dmarc.org*) Mailman (Mailman 2 that is, and I presume Mailman 3 does too) "include features to interoperate with DMARC senders". I assume that the dmarc mitigations list settings in Mailman is for incoming messages, but how do I set Mailman to cope with this on outgoing messages? Note: I have more than one list domain in Mailman 3. *) https://dmarc.org/wiki/FAQ#Is_there_special_handling_required_to_receive_DM… /Henrik

2 3

Upgrade
by Darren Smith 16 Apr '18

16 Apr '18

Hello all, I'm working on upgrading our mailman3 instance. The current running instance is 3.1.0, and I am attempting to move to 3.2.0a1. Partially because La Villa Strangiato is a better song than Between the Wheels, but mostly because we want some of the bug fixes, and we are nailing down our upgrade process for the future. Initially after updating when I ran the "mailman info" command, I got this: Traceback (most recent call last): File "/opt/mailman3/conda/bin/mailman", line 7, in <module> from mailman.bin.mailman import main File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/bin/mailman.py", line 19, in <module> import click ModuleNotFoundError: No module named 'click' So I went and installed click - easy enough to do. But then I get this error: "Traceback (most recent call last): File "/opt/mailman3/conda/bin/mailman", line 11, in <module> sys.exit(main()) File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 722, in __call__ return self.main(*args, **kwargs) File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 696, in main with self.make_context(prog_name, args, **extra) as ctx: File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 621, in make_context self.parse_args(ctx, args) File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 1018, in parse_args rest = Command.parse_args(self, ctx, args) File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 880, in parse_args value, args = param.handle_parse_result(ctx, opts, args) File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 1404, in handle_parse_result self.callback, ctx, self, value) File "/opt/mailman3/conda/lib/python3.6/site-packages/click/core.py", line 78, in invoke_param_callback return callback(ctx, param, value) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/bin/mailman.py", line 93, in initialize_config initialize(value) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/core/initialize.py", line 219, in initialize initialize_2(propagate_logs=propagate_logs) File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/core/initialize.py", line 178, in initialize_2 config.db = getUtility(IDatabaseFactory, utility_name).create() File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/database/factory.py", line 54, in create database.initialize() File "/opt/mailman3/conda/lib/python3.6/site-packages/mailman/database/base.py", line 107, in initialize url, isolation_level='READ UNCOMMITTED', pool_pre_ping=True) File "/opt/mailman3/conda/lib/python3.6/site-packages/sqlalchemy/engine/__init__.py", line 387, in create_engine return strategy.create(*args, **kwargs) File "/opt/mailman3/conda/lib/python3.6/site-packages/sqlalchemy/engine/strategies.py", line 160, in create engineclass.__name__)) TypeError: Invalid argument(s) 'pool_pre_ping' sent to create_engine(), using configuration PGDialect_psycopg2/QueuePool/Engine. Please check that the keyword arguments are appropriate for this combination of components." Anyone able to point me where to go to look for a solution for this? We're running postgresql as the database, and psycopg2 has been installed. Thoughts? -Darren

2 7

Question regarding serve_from_domain
by Alexander Klotz 13 Apr '18

13 Apr '18

Hello, we're currently unsure in which file the serve_from_domain-entry described in the readme.md regarding mailman-web. We just updated the docker and encounter the following error, which might correspond to the missing entry: OSError: [Errno 13] Permission denied: '/opt/mailman-web/fulltext_index' Any help would be appreciated - thanks! -- Regards, Alex Klotz (culturebase editorial staff)

1 0

Starting from scratch
by Benjamin Ragheb 12 Apr '18

12 Apr '18

Hello! Over the weekend, I attempted to install the Mailman Suite on Debian Stretch. My goal is to set up some low volume mailing lists for family and friends. I ran into some problems, and I'm hoping to get some feedback on my overall approach before I make my second attempt. :-) I figured the safest thing to do would be to use pip to install the latest released version of all the components (core, postorius, hyperkitty, etc.). I copied the files from the [mailman-suite repository][1] to set up a Django project and got it mostly working with Apache and mod_wsgi. [1]: https://gitlab.com/mailman/mailman-suite Unfortunately, I was unable to log into the web interface; when I tried, I got a server error like this: > Exception Type: TypeError at /accounts/login/ > Exception Value: authenticate() takes exactly 0 arguments (3 given) Some research leads me to believe this is happening because authenticate() was changed in Django 1.10, and so I must be using a newer version of Django than the app expects. Given that I installed via Pip, I assumed the right version of Django would automatically be installed... I'm open to the possibility that I am misunderstanding how Pip works, or that postorius's and/or hyperkitty's dependency information is incorrect. The two alternatives I am weighing right now are: 1. Stay the course, and see if I can fix this by learning more about Python, Pip, Django and tinkering with the configuration. 2. Ride the bleeding edge, and install postorius and hyperkitty from git. (I'll probably stick with Mailman Core from Pip, since that seemed to work just fine.) Right now I'm leaning toward #2, because it means I'll be in a better position to patch things if I need to, and it seems like Mailman 3 is still rough enough that I will need to. Also, it looks like the master branches of both postorius and hyperkitty are now Python 3 compatible, which could save me from managing two different versions of Python. Which is the least crazy option? -- Ben

2 2

Log rotation
by Darren Smith 11 Apr '18

11 Apr '18

Hey everyone, So I have a question about log rotation... Our mailman.log has grown to over 5 gigs. It's time to add this to log rotation. We added what we thought might work to the /etc/logrotate.d/mailman script, but when we ran it with a -f, we learned that the -f flag doesn't keep old logs. That in itself is fine - a normal scheduled log rotation won't have that problem. My problem is that doing the rotation caused the mailman not to be able to write to the log anymore. It appears that it no longer has a handle to the file. To overcome this with, say, nginx, there is a command in logrotate that you can add that restarts the service. I have found, however, that restarting the mailman service can be VERY problematic. There is so much going on that it takes a very long time to stop, and I have seen several instances where the service never shuts down cleanly - even after 3-4 minutes. The service thinks it is shut down, but there are several threads that haven't yet completed. If they are killed, then you have to go clean up the master.lck files etc. It seems like a bad way of doing things and a good way to somehow corrupt data. Anyway - after rambling... 1) Has anyone come up with a good log rotation strategy that doesn't necessitate a restart of the service? 2) Has anyone seen problems stopping and restarting the service? Is there a way to help with this problem? Thanks, Darren

3 5

"Approved:" header from mailman2 times
by Dmitry Makovey 10 Apr '18

10 Apr '18

Hi, is there any equivalent to "Approved" header that was present in MM2 in MM3 land? Google is not very helpful in that. -- Sr System and DevOps Engineer SoM IRT

3 3

update_index
by Darren Smith 03 Apr '18

03 Apr '18

Hello, If I'm reading the docs correctly, when we run manage.py update_index, it should be an incremental index of new emails that have been added since the last time update_index was run - can anyone confirm that this is the expected behavior? Or is there another command line option that I am missing? Right now we are indexing EVERYTHING every time that this is run. Probably this wouldn't be much of a problem except that we are importing all of our old archives (they go back to 1998 and comprise over 40.5 million emails) into the new system. As of now we have around 700,000 emails imported into hyperkitty, and since it is indexing everything it is taking around 1 hour and 10 minutes. Obviously we can't run that once a minute. Right now we're doing once a day, meaning that new emails won't be indexed until the next day. Fast forward to when we have all 40 million imported...the full index process will take (we estimate) around 4 days or so. So...can anyone help with how to get the update_index to do only emails added since the last time the update_index was run? Thanks! Darren

2 4

Mailman 3 with AWS auto scaling and potentially load balancing
by Chris McMacken 30 Mar '18

30 Mar '18

After doing a lot of googling I can't seem to find solid answers to a couple of basic mailman hosting questions so I thought I would ask here. I'm looking to build an auto scaling group so that my mailman services can self heal if the EC2 instance goes away. What state if any is stored locally on the filesystem that would need to be backed up and restored when an instance is replaced? I'm also interested in a high availability deployment so I would like to do some basic load balancing to ensure that this requirement is met but I haven't been able to find much on this topic for mailman 3. Can someone point me in the direction of a write up on this problem or comment on it?

2 5

Re: Templates and docker-mailman
by Hathaway, John W. 22 Mar '18

22 Mar '18

Hah, adding the extension did the trick. Should have inferred that. Thanks! John W. Hathaway | IT Director LOCKRIDGE GRINDAL NAUEN P.L.L.P. 100 Washington Avenue S | Suite 2200 | Minneapolis MN 55401 V: 612-339-6900 | F: 612-339-0981 | www.locklaw.com<http://www.locklaw.com/> This e-mail may contain information that is privileged, confidential or otherwise protected from disclosure. If you are not the intended recipient or otherwise have received this message in error, you are not authorized to read, print, retain, copy or disseminate this message or any part of it. If you are not the intended recipient or otherwise have received this message in error, please notify us immediately by e-mail, discard any paper copies and delete all electronic files of the message.

1 0

TypeError: authenticate() takes exactly 0 arguments (3 given)
by Bjoern Franke 22 Mar '18

22 Mar '18

Hi, after migrating from a PIP install to Debian Backports packages, I get the following error: https://pastebin.com/tCnTuKYz The whole config of mailman3-suite: https://pastebin.com/nzJufYBN Regards Bjoern

2 4

Templates and docker-mailman
by jwhathaway＠locklaw.com 20 Mar '18

20 Mar '18

I have mailman installed through docker-mailman and I'm trying to get rid of the footer decoration in our messages. Based on earlier threads, I have placed an empty file on the host running Docker at: /opt/mailman/core/var/templates/site/en/list:member:generic:footer But this is not being honored by the mailman container. I have restarted all of the containers. Is there something else I need to do?

3 3

Re: Getting rid of held messages from the command line
by Mark Sapiro 19 Mar '18

19 Mar '18

On 03/19/2018 02:22 PM, Aymeric Mansoux wrote: > > Ah, so if I understand you correctly, as long as I'm on 3.1.1, I could > run into this issue again, but then: Yes, this issue will recur with Mailman 3.1.1 and a MySQL database. > - Would patching 3.1.1 with 5477a201 be enough to prevent further issues > until the next stable is released? I think so. The only potential issue is if mailman/database/alembic/versions/4bd95c99b2e7_fix_template_password.py is not in 3.1.1. I think it is, so I think it's OK, but if not, you'd need to modify mailman/database/alembic/versions/3f31035ed0d7_further_increase_pendedkeyvalue_value_.py to point to the 3.1.1 head of the alembic versions. > - How can I clean the current pendedkeyvalue table? With phpMyAdmin or the mysql command. I think you can just delete those entries from the pendedkeyvalue table. -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

1 0

Getting rid of held messages from the command line
by Aymeric Mansoux 17 Mar '18

17 Mar '18

Hello, We're currently running some of Mailman software, as available via pip, namely: - mailman 3.1.1 (pip3) - postorius 1.1.2 (pip2) - hyperkitty 1.1.4 (pip2) - mailmanclient 3.1.1 (pip3) So far so good, however, for some reasons, a couple of our lists have started to accumulate held messages that cannot be manipulated via the REST API. Regardless if we use the web interface or mailmanclient, it ends up with: Mar 14 10:58:32 2018 (24287) REST request handler error: Traceback (most recent call last): File "/usr/lib/python3.5/wsgiref/handlers.py", line 137, in run self.result = application(self.environ, self.start_response) File "/usr/local/lib/python3.5/dist-packages/mailman/database/transaction.py", line 50, in wrapper rtn = function(*args, **kws) File "/usr/local/lib/python3.5/dist-packages/mailman/rest/wsgiapp.py", line 214, in __call__ return super().__call__(environ, start_response) File "/usr/local/lib/python3.5/dist-packages/falcon/api.py", line 244, in __call__ responder(req, resp, **params) File "/usr/local/lib/python3.5/dist-packages/mailman/rest/post_moderation.py", line 167, in on_get resource = self._make_collection(request) File "/usr/local/lib/python3.5/dist-packages/mailman/rest/helpers.py", line 159, in _make_collection for resource in collection] File "/usr/local/lib/python3.5/dist-packages/mailman/rest/helpers.py", line 159, in <listcomp> for resource in collection] File "/usr/local/lib/python3.5/dist-packages/mailman/rest/post_moderation.py", line 157, in _resource_as_dict resource = self._make_resource(request.id) File "/usr/local/lib/python3.5/dist-packages/mailman/rest/post_moderation.py", line 70, in _make_resource resource = super()._make_resource(request_id) File "/usr/local/lib/python3.5/dist-packages/mailman/rest/post_moderation.py", line 39, in _make_resource results = requests.get_request(request_id) File "/usr/local/lib/python3.5/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/local/lib/python3.5/dist-packages/mailman/model/requests.py", line 120, in get_request result.data_hash, expunge=False) File "/usr/local/lib/python3.5/dist-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/local/lib/python3.5/dist-packages/mailman/model/pending.py", line 138, in confirm value = json.loads(keyvalue.value) File "/usr/lib/python3.5/json/__init__.py", line 319, in loads return _default_decoder.decode(s) File "/usr/lib/python3.5/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.5/json/decoder.py", line 355, in raw_decode obj, end = self.scan_once(s, idx) json.decoder.JSONDecodeError: Unterminated string starting at: line 1 column 1 (char 0) Mar 14 10:58:32 2018 (24287) 127.0.0.1 - - "GET /3.1/lists/xx(a)xx.xx/held HTTP/1.1" 500 59 Is there a way to manipulate/see/remove these mails differently? Right now this prevent moderation of any held messages (note: some lists do not suffer from this and the held panel or mailmanclient works perfectly fine). Thanks!

3 4

disable sign-ups
by Peter Münster 14 Mar '18

14 Mar '18

Hi, I would like to add new accounts only manually, the mailman3 site should not be open for sign-ups. So I've added this code to settings.py: --8<---------------cut here---------------start------------->8--- from allauth.account.adapter import DefaultAccountAdapter class MyAccountAdapter(DefaultAccountAdapter): def is_open_for_signup(self, request): return False ACCOUNT_ADAPTER = 'MyAccountAdapter' --8<---------------cut here---------------end--------------->8--- It seems to work, but the user experience is not optimal: the user can click on "Sign Up", and then gets to "Server Error (500)". This is the log: --8<---------------cut here---------------start------------->8--- ERROR 2018-01-31 21:53:47,116 6769 django.request Internal Server Error: /accounts/signup/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 132, in get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/utils/decorators.py", line 34, in _wrapper return bound_func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/decorators/debug.py", line 76, in sensitive_post_parameters_wrapper return view(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/utils/decorators.py", line 30, in bound_func return func.__get__(self, type(self))(*args2, **kwargs2) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 210, in dispatch return super(SignupView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 79, in dispatch **kwargs) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 182, in dispatch if not self.is_open(): File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 191, in is_open return get_adapter(self.request).is_open_for_signup(self.request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/adapter.py", line 501, in get_adapter return import_attribute(app_settings.ADAPTER)(request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/utils.py", line 150, in import_attribute pkg, attr = path.rsplit('.', 1) ValueError: need more than 1 value to unpack ERROR 2018-01-31 21:53:47,116 6769 django.request Internal Server Error: /accounts/signup/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 132, in get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/utils/decorators.py", line 34, in _wrapper return bound_func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/decorators/debug.py", line 76, in sensitive_post_parameters_wrapper return view(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/utils/decorators.py", line 30, in bound_func return func.__get__(self, type(self))(*args2, **kwargs2) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 210, in dispatch return super(SignupView, self).dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 79, in dispatch **kwargs) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 182, in dispatch if not self.is_open(): File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 191, in is_open return get_adapter(self.request).is_open_for_signup(self.request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/adapter.py", line 501, in get_adapter return import_attribute(app_settings.ADAPTER)(request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/utils.py", line 150, in import_attribute pkg, attr = path.rsplit('.', 1) ValueError: need more than 1 value to unpack --8<---------------cut here---------------end--------------->8--- Do you have any hints, how to avoid such errors please? TIA for any help, -- Peter

3 2

Internal Server Error: /hyperkitty/api/mailman/archive: ValueError: A string literal cannot contain NUL (0x00) characters.
by Henrik Rasmussen 14 Mar '18

14 Mar '18

This could potentially be associated with [1] and [2], but it does not regard import21. When mails are released or otherwise archived I get an Internal Server Error regarding "ValueError: A string literal cannot contain NUL (0x00) characters." in the web/mailmanweb.log, but unlike importing corrupted archives, this is mails coming from the users in the daily life. Would it be possible for Mailman to check for NUL characters and skip those before archiving? ERROR 2018-03-13 10:38:12,602 39 django.request Internal Server Error: /hyperkitty/api/mailman/archive Traceback (most recent call last): File "/usr/local/lib/python2.7/site-packages/django/core/handlers/exception.py", line 39, in inner response = get_response(request) File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 249, in _legacy_get_response response = self._get_response(request) File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 187, in _get_response response = self.process_exception_by_middleware(e, request) File "/usr/local/lib/python2.7/site-packages/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/views/mailman.py", line 68, in _decorator return func(request, *args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/views/decorators/csrf.py", line 58, in wrapped_view return view_func(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/hyperkitty/views/mailman.py", line 114, in archive add_to_list(mlist_fqdn, msg) File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/incoming.py", line 149, in add_to_list email.save() File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 796, in save force_update=force_update, update_fields=update_fields) File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 824, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 908, in _save_table result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 947, in _do_insert using=using, raw=raw) File "/usr/local/lib/python2.7/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 1043, in _insert return query.get_compiler(using=using).execute_sql(return_id) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 1054, in execute_sql cursor.execute(sql, params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) ValueError: A string literal cannot contain NUL (0x00) characters. [1] https://gitlab.com/mailman/hyperkitty/issues/155 [2] https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/….

1 1

A short link to this page -- TinyURL
by John Griessen 14 Mar '18

14 Mar '18

The wiki page has a convenient TinyURL. Is it feasible to make TinyURLs for archived list threads such as: https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/…

3 2

Database running VERY hot
by Darren Smith 12 Mar '18

12 Mar '18

Hello all, We had an old installation of Mailman 2.1 across three servers with over 32,000 mailing lists on them. Due to circumstances beyond my control, we had to shut them down and quickly set up Mailman 3 on a new server. We have Mailman3 set up on a single server this time, as we were having problems with a 3-server setup and Hyperkitty and archives. Long story short, it is up and running, and our users are starting to come back. However, we do not have very many users hitting Postorius and Hyperkitty yet, and we are seeing a distressing number of 504 gateway timeouts. We noticed that there is a significant number of queries to the API whenever hitting Postorius's front page to load the mailing lists, and then on every load. It looks as if it makes a single call to the API to get information about a single list, and does this 10 times - once for each list - to render the page. This gets much worse when users set the view to 200 per page, as they are inclined to do with 32,000 mailing lists... What we've done, actually, is to override the front page and point the users to a different set of static pages where we have all of our lists categorized and searchable, and when they find the list they are looking for, we have a link back to postorius. It has taken a lot of the stress off of the server. However, I still see where the database at times can run VERY hot. We have set up this server to run with PostgreSQL. When I do a ps aux | grep postgres, I find a lot of processes that have been spawned to take care of mailman - a dozen or so. However, one of the threads is taking up about 85% of the load, another thread about 14%, and little dribbles here and there from the rest of the threads. Here are the questions: 1) Has anyone run into problems like these? I would think that maybe this is an issue having so many mailing lists, but honestly there aren't that many people using the system yet. It is going to ramp up as the users realize that we are live again, but we aren't getting that much traffic. 2) Is there any configuration that I can set, especially with regards to the database, so that it can be used more efficiently and not throttle through one or two threads? Please let me know what further information I can provide. Thanks in advance for any help or advice! Silas

5 11

Deactivate list without deleting it?
by Colin Watson 03 Mar '18

03 Mar '18

Hi, I'm experimenting with a port of Launchpad's mailing list infrastructure to Mailman 3. If Barry's reading, he may remember that this is no trivial task, so I'm very definitely not promising that it will be done any time soon. :-) However, for the most part it looks relatively tractable with the aid of the plugin improvements in Mailman 3.2.0; I have the rough outline of a plugin that implements much the same feature set as our current pile of monkey-patches against Mailman 2.1 in a much nicer way. One of the major things I haven't figured out yet is list deactivation and reactivation. In our current 2.1-based code, you can deactivate a list in a reversible way, which basically tars up the list directory so that the list archives can be restored later. This isn't a native operation in 2.1, but it could be done because everything lived on the filesystem. In 3, it's less trivial. We could go to some effort to dump things out of the HyperKitty database and restore it on reactivation, but that seems rather complex and a bit silly. Ideally, I'd like mailing lists to have a "deactivated" state in addition to full deletion. In this state, the list would appear nonexistent for most purposes: incoming email would be rejected, Postorius would deny its existence, etc. There'd need to be corresponding extensions to the IArchiver interface which caused the archiver to put its archives of that list into a corresponding deactivated state, in which it would retain the messages but queries for them would return 404 or similar; these extensions would need to be optional, since while it should be relatively easy to do this in HyperKitty it could be hard or impossible for other archivers, and perhaps this should be a separate operation from deactivating the list itself since people may want to close a list while leaving its archives accessible. Has there been any discussion of this in the past, or any advice as to implementation strategy? Thanks, -- Colin Watson [cjwatson(a)ubuntu.com]

3 7

configure Mysql and postfix on mailman3
by ouerheni.nouha＠gmail.com 20 Feb '18

20 Feb '18

Hello all , I configured mailman3 following this contributer guide http://docs.mailman3.org/en/latest/devsetup.html but i'am still getting problem with the configuration of MySQL and postfix . Is this section is enough for MySQL configurations ? [database] class: mailman.database.mysql.MySQLDatabase url: mysql+pymysql://myuser:mypassword@mymysqlhost/mailman?charset=utf8&use_unicode=1htmlI will appreciated if there are some documents to provide to cotinue the intergration of mailman3 . Is there any tuto for postfix config ? Thanks in advance Ouerheni Nouha

5 4

import21: A string literal cannot contain NUL (0x00) characters.
by Henrik Rasmussen 15 Feb '18

15 Feb '18

Docker-mailman 0.1.1. I am facing errors when using import21 to import list archives. The error message is "A string literal cannot contain NUL (0x00) characters." and the import stops, thus importing only mails up to 2009. The dublicates is mails already imported when retrying. If a mail contains illegal characters I would expect disregarding the particular mail and continue, or ignoring the nul character. bash-4.3# python manage.py hyperkitty_import --verbosity 3 --since "01.01.1970" --list-address example(a)mailman3.ku.dk /opt/mailman-web-data/tmp/example(a)mailman3.ku.dk.mbox Duplicate email with message-id '857A4D84DE6D1D41837DD9284F2729AB08F0C385(a)srv1.example.ku.dk' <857A4D84DE6D1D41837DD9284F2729AB09DA5E45(a)srv1.example.ku.dk> (149) Duplicate email with message-id '857A4D84DE6D1D41837DD9284F2729AB09DA5E45(a)srv1.example.ku.dk' <857A4D84DE6D1D41837DD9284F2729AB09E20126(a)srv1.example.ku.dk> (150) Failed adding message <857A4D84DE6D1D41837DD9284F2729AB09E20126(a)srv1.example.ku.dk>: A string literal cannot contain NUL (0x00) characters. Traceback (most recent call last): File "manage.py", line 10, in <module> execute_from_command_line(sys.argv) File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 367, in execute_from_command_line utility.execute() File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 359, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/usr/local/lib/python2.7/site-packages/django/core/management/base.py", line 305, in run_from_argv self.execute(*args, **cmd_options) File "/usr/local/lib/python2.7/site-packages/django/core/management/base.py", line 356, in execute output = self.handle(*args, **options) File "/usr/local/lib/python2.7/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 278, in handle importer.from_mbox(mbfile) File "/usr/local/lib/python2.7/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 152, in from_mbox add_to_list(self.list_address, message) File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/incoming.py", line 149, in add_to_list email.save() File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 796, in save force_update=force_update, update_fields=update_fields) File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 824, in save_base updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields) File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 908, in _save_table result = self._do_insert(cls._base_manager, using, fields, update_pk, raw) File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 947, in _do_insert using=using, raw=raw) File "/usr/local/lib/python2.7/site-packages/django/db/models/manager.py", line 85, in manager_method return getattr(self.get_queryset(), name)(*args, **kwargs) File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 1043, in _insert return query.get_compiler(using=using).execute_sql(return_id) File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 1054, in execute_sql cursor.execute(sql, params) File "/usr/local/lib/python2.7/site-packages/django/db/backends/utils.py", line 64, in execute return self.cursor.execute(sql, params) ValueError: A string literal cannot contain NUL (0x00) characters. bash-4.3#

6 8

Number of archives in list
by kawhite＠ancestry.com 15 Feb '18

15 Feb '18

Hi, I am importing hundreds of thousands of mbox archive files and I want to know if there is a way to call a list and see how many archives got imported / are in the list now (is there a hyperkitty command to gets stats such as number of archives on a list?) Thanks in advance,

2 1

"mailman start" hangs
by Peter Münster 14 Feb '18

14 Feb '18

Hi, When starting mailman in a terminal, then it works: --8<---------------cut here---------------start------------->8--- $ mailman start Starting Mailman's master runner $ --8<---------------cut here---------------end--------------->8--- But from "cron", it seems to hang. Output of pstree: --8<---------------cut here---------------start------------->8--- |-cron(3022)---cron(21962)-+-mailman(21986) | `-sendmail(22043)---postdrop(22044) --8<---------------cut here---------------end--------------->8--- So it seems, that mailman does not go into the background, and the email with the output is never sent... How could I solve this issue please? TIA for any hints, -- Peter

3 3

list of subscribers
by Peter Münster 08 Feb '18

08 Feb '18

Hi, Where on the web interface is it possible to see the list of subscribers of a mailing list please? TIA for any hint, -- Peter

4 14

Just starting with mailman3
by Loring 01 Feb '18

01 Feb '18

I am just starting with mailman 3 where can I find good documentation on getting started? -- Richmond Loring rloring(a)bnl.gov Advanced Systems Engineer

2 1

confirm-email: error NoReverseMatc
by Peter Münster 31 Jan '18

31 Jan '18

Hi, When confirming the email address after sign-up, I get this error: --8<---------------cut here---------------start------------->8--- ERROR 2018-01-31 09:31:57,143 28537 django.request Internal Server Error: /accounts/confirm-email/Ng:1egno5:_T5eipR8TTan-zWjLK8EhYuetjQ/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 132, in get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 89, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 283, in post resp = self.login_on_confirm(confirmation) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 332, in login_on_confirm redirect_url=self.get_redirect_url) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/utils.py", line 157, in perform_login get_login_redirect_url(request, redirect_url)) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/utils.py", line 50, in get_login_redirect_url url = url() File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 362, in get_redirect_url self.request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/adapter.py", line 176, in get_email_confirmation_redirect_url return self.get_login_redirect_url(request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/adapter.py", line 156, in get_login_redirect_url return resolve_url(url) File "/usr/lib/python2.7/site-packages/django/shortcuts.py", line 205, in resolve_url return urlresolvers.reverse(to, args=args, kwargs=kwargs) File "/usr/lib/python2.7/site-packages/django/core/urlresolvers.py", line 579, in reverse return force_text(iri_to_uri(resolver._reverse_with_prefix(view, prefix, *args, **kwargs))) File "/usr/lib/python2.7/site-packages/django/core/urlresolvers.py", line 496, in _reverse_with_prefix (lookup_view_s, args, kwargs, len(patterns), patterns)) NoReverseMatch: Reverse for '' with arguments '()' and keyword arguments '{}' not found. 0 pattern(s) tried: [] ERROR 2018-01-31 09:31:57,143 28537 django.request Internal Server Error: /accounts/confirm-email/Ng:1egno5:_T5eipR8TTan-zWjLK8EhYuetjQ/ Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/django/core/handlers/base.py", line 132, in get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 71, in view return self.dispatch(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django/views/generic/base.py", line 89, in dispatch return handler(request, *args, **kwargs) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 283, in post resp = self.login_on_confirm(confirmation) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 332, in login_on_confirm redirect_url=self.get_redirect_url) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/utils.py", line 157, in perform_login get_login_redirect_url(request, redirect_url)) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/utils.py", line 50, in get_login_redirect_url url = url() File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/views.py", line 362, in get_redirect_url self.request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/adapter.py", line 176, in get_email_confirmation_redirect_url return self.get_login_redirect_url(request) File "/usr/lib/python2.7/site-packages/django_allauth-0.34.0-py2.7.egg/allauth/account/adapter.py", line 156, in get_login_redirect_url return resolve_url(url) File "/usr/lib/python2.7/site-packages/django/shortcuts.py", line 205, in resolve_url return urlresolvers.reverse(to, args=args, kwargs=kwargs) File "/usr/lib/python2.7/site-packages/django/core/urlresolvers.py", line 579, in reverse return force_text(iri_to_uri(resolver._reverse_with_prefix(view, prefix, *args, **kwargs))) File "/usr/lib/python2.7/site-packages/django/core/urlresolvers.py", line 496, in _reverse_with_prefix (lookup_view_s, args, kwargs, len(patterns), patterns)) NoReverseMatch: Reverse for '' with arguments '()' and keyword arguments '{}' not found. 0 pattern(s) tried: [] --8<---------------cut here---------------end--------------->8--- What could be the reason, and how could I solve this issue please? Since it's perhaps related, here is my urls.py: --8<---------------cut here---------------start------------->8--- from django.conf.urls import include, url from django.contrib import admin from postorius.views.list import list_index urlpatterns = [ url(r'^postorius/', include('postorius.urls')), url(r'^archives/', include('hyperkitty.urls')), url(r'', include('django_mailman3.urls')), url(r'^accounts/', include('allauth.urls')), url(r'^admin/', include(admin.site.urls)), url(r'^$', list_index, name='list_index'), ] --8<---------------cut here---------------end--------------->8--- TIA for any help, -- Peter

2 4