September 2017 - Mailman-users - lists.mailman3.org

Uncaught runner exception: 'str' object has no attribute 'decode'
by Henrik Rasmussen Oct. 3, 2017

Oct. 3, 2017

When held mails are released in Mailman (maybe also mails which are not held) they are sometimes not sent nor archived, as mentioned in https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/thread/… One of my list admins reported that he released two mails on Sep 25 07:20:48 2017 UTC, and only the first was sent to the members. In the mailman.log I found the following from that particular release: Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/… [View More]1.1" 200 353 Sep 25 07:20:48 2017 (36) held message approved, message-id: <CAF9K74uk331j91PfF6S1nQT2YvxywwhUFBWBBcdMGkNMMU4=TA(a)somemail.com> Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "POST /3.0/lists/listname.foo.bar/held/40 HTTP/1.1" 204 0 Sep 25 07:20:48 2017 (36) held message approved, message-id: <804D10D40C57024A90412246998CB72D873B794B(a)P1KITMBX07WC04.mailserver> Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "POST /3.0/lists/listname(a)foo.bar/held/42 HTTP/1.1" 204 0 Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/held?count=0&page=1 HTTP/1.1" 200 90 Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/held?count=10&page=1 HTTP/1.1" 200 90 Sep 25 07:20:53 2017 (28) HyperKitty archived message <CAF9K74uk331j91PfF6S1nQT2YvxywwhUFBWBBcdMGkNMMU4=TA(a)somemail.com> to https://listserver.foo.bar/hyperkitty/list/listname@foo.bar/message/IAKWSH7… Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar HTTP/1.1" 200 353 Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/config HTTP/1.1" 200 2473 Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353 Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/owner HTTP/1.1" 200 613 Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/moderator HTTP/1.1" 200 617 Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353 Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/requests HTTP/1.1" 200 90 Sep 25 07:20:56 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353 Sep 25 07:20:56 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/owner HTTP/1.1" 200 613 Sep 25 07:20:56 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/moderator HTTP/1.1" 200 617 Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/config HTTP/1.1" 200 2473 Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/archivers HTTP/1.1" 200 81 Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/archivers HTTP/1.1" 200 81 Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/requests HTTP/1.1" 200 90 Sep 25 07:20:57 2017 (35) Uncaught runner exception: 'str' object has no attribute 'decode' Sep 25 07:20:57 2017 (35) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/pipeline.py", line 37, in _dispose process(mlist, msg, msgdata, pipeline) File "/usr/local/lib/python3.6/site-packages/mailman/core/pipelines.py", line 53, in process handler.process(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 174, in process mlist, msgdata, subject, prefix, prefix_pattern, ws) File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 72, in all_same_charset chunks.append(chunk.decode(charset)) AttributeError: 'str' object has no attribute 'decode' Sep 25 07:20:57 2017 (35) SHUNTING: 1506324057.584686+a13cc47dc1027a0cfb00c892396b3ba7efabb3dc In addition, the log contains other trace backs that might or might not associate to this problem: Sep 24 21:11:27 2017 (34) Uncaught runner exception: 'ascii' codec can't encode character '\udcea' in position 3093: ordinal not in range(128) Sep 24 21:11:28 2017 (34) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/deliver.py", line 86, in deliver refused = agent.deliver(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/bulk.py", line 101, in deliver mlist, msg, msgdata, recipients) File "/usr/local/lib/python3.6/site-packages/mailman/mta/base.py", line 70, in _deliver_to_recipients sender, sorted(recipients), msg.as_string()) File "/usr/local/lib/python3.6/site-packages/mailman/mta/connection.py", line 84, in sendmail results = self._connection.sendmail(envsender, recipients, msgtext) File "/usr/local/lib/python3.6/smtplib.py", line 855, in sendmail msg = _fix_eols(msg).encode('ascii') UnicodeEncodeError: 'ascii' codec can't encode character '\udcea' in position 3093: ordinal not in range(128) Sep 24 21:11:28 2017 (34) SHUNTING: 1506287488.0529234+cbf8a31cad265a40a18e8955be0c9ad8b48a1b66 ...¨ Sep 25 07:20:57 2017 (35) Uncaught runner exception: 'str' object has no attribute 'decode' Sep 25 07:20:57 2017 (35) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/pipeline.py", line 37, in _dispose process(mlist, msg, msgdata, pipeline) File "/usr/local/lib/python3.6/site-packages/mailman/core/pipelines.py", line 53, in process handler.process(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 174, in process mlist, msgdata, subject, prefix, prefix_pattern, ws) File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 72, in all_same_charset chunks.append(chunk.decode(charset)) AttributeError: 'str' object has no attribute 'decode' Sep 25 07:20:57 2017 (35) SHUNTING: 1506324057.584686+a13cc47dc1027a0cfb00c892396b3ba7efabb3dc ... Sep 25 09:19:58 2017 (30) deque: do_confirm_verify Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/local/lib/python3.6/site-packages/mailman/app/subscriptions.py", line 420, in _step_send_confirmation raise StopIteration StopIteration ... Sep 26 09:21:07 2017 (36) deque: Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/local/lib/python3.6/site-packages/mailman/app/subscriptions.py", line 217, in _step_sanity_checks MemberRole.member) mailman.interfaces.member.AlreadySubscribedError: sender(a)foo.bar is already a MemberRole.member of mailing list listname(a)listserver.foo.bar ... Sep 26 13:32:29 2017 (30) Uncaught runner exception: Sep 26 13:32:29 2017 (30) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/command.py", line 196, in _dispose mlist, msg, msgdata, parts, results) File "/usr/local/lib/python3.6/site-packages/mailman/commands/eml_confirm.py", line 53, in process mlist).confirm(token) File "/usr/local/lib/python3.6/site-packages/mailman/app/subscriptions.py", line 540, in confirm PendableUnsubscription.PEND_TYPE) AssertionError ... Sep 27 13:23:02 2017 (32) Uncaught runner exception: 'content-transfer-encoding' Sep 27 13:23:02 2017 (32) Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration self._process_one_file(msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file keepqueued = self._dispose(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose self._func(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/deliver.py", line 86, in deliver refused = agent.deliver(mlist, msg, msgdata) File "/usr/local/lib/python3.6/site-packages/mailman/mta/bulk.py", line 101, in deliver mlist, msg, msgdata, recipients) File "/usr/local/lib/python3.6/site-packages/mailman/mta/base.py", line 70, in _deliver_to_recipients sender, sorted(recipients), msg.as_string()) File "/usr/local/lib/python3.6/email/message.py", line 158, in as_string g.flatten(self, unixfrom=unixfrom) File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/local/lib/python3.6/email/generator.py", line 181, in _write self._dispatch(msg) File "/usr/local/lib/python3.6/email/generator.py", line 214, in _dispatch meth(msg) File "/usr/local/lib/python3.6/email/generator.py", line 272, in _handle_multipart g.flatten(part, unixfrom=False, linesep=self._NL) File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/local/lib/python3.6/email/generator.py", line 181, in _write self._dispatch(msg) File "/usr/local/lib/python3.6/email/generator.py", line 214, in _dispatch meth(msg) File "/usr/local/lib/python3.6/email/generator.py", line 358, in _handle_message g.flatten(msg.get_payload(0), unixfrom=False, linesep=self._NL) File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten self._write(msg) File "/usr/local/lib/python3.6/email/generator.py", line 189, in _write msg.replace_header('content-transfer-encoding', munge_cte[0]) File "/usr/local/lib/python3.6/email/message.py", line 558, in replace_header raise KeyError(_name) KeyError: 'content-transfer-encoding' Sep 27 13:23:02 2017 (32) SHUNTING: 1506518582.300981+aa68949ca566c7170a81a0bd643cee803f29c312 [View Less]

5 11

"Private archives" aren't private
by Simon Liebold Sept. 29, 2017

Sept. 29, 2017

Hello, #129 says that private lists are visible in the archive overview only but "archives aren't displayed". However, I can browse a private list's archives and read the mail text while not logged in. Shouldn't the private archive be hidden from anonymous users? Simon

6 10

"spoofing" mailing list address
by Dmitry Makovey Sept. 29, 2017

Sept. 29, 2017

Hi, We're trying to migrate from 2.1.x to 3.1. In the process we want to modify old setup in which mailing lists were part of our normal mail domain (so both user accounts and ML would be under @x.stanford.edu) in new scenario we want to move ML into @lists.x.stanford.edu, yet preserve addressing compatibility with old naming scheme. To that end we thought of making following setup: list(a)x.stanford.edu -postfix:alias-> list(a)lists.x.stanford.edu however in this setup users will receive … [View More]

1 0

Mailman only send some release messages to the subscribers
by Henrik Rasmussen Sept. 28, 2017

Sept. 28, 2017

I have three list admins each maintaining one list, thus three lists: E, H and S. All reports that some mails they release from Held messages are sent, some isn't. In the logs (Mailman smtp.log and postfix log I can confirm that at least one of the lists (E) sent out another message to 559 recips at Sep 26 09:31:12 201 (UTC+2) so something is working. The admin of list E explains that she have released mails that came out, but some mails isn't sent when she reases them. Among others a mail … [View More]she released Sep 26 09:38. I can also see in the Mailman Postfix log that Mailman received a mail from the Admin's e-mail address sender(a)foo.bar. Sep 26 09:38:49 postfix postfix/smtpd[5527]: D8E6D1109026: client=gateway[172.19.199.1] Sep 26 09:38:49 postfix postfix/cleanup[6076]: D8E6D1109026: message-id=<E7657360D6CFE64DBAC4E5D158511918873690FB(a)mailserver.foo.bar> Sep 26 09:38:49 postfix postfix/qmgr[139]: D8E6D1109026: from=<sender(a)foo.bar>, size=19589, nrcpt=1 (queue active) Sep 26 09:38:49 postfix postfix/lmtp[6077]: D8E6D1109026: to=<s(a)listserver.foo.bar>, relay=172.19.199.2[172.19.199.2]:8024, delay=0.03, delays=0.01/0.01/0/0.01, dsn=2.0.0, status=sent (250 Ok) Sep 26 09:38:49 postfix postfix/qmgr[139]: D8E6D1109026: removed I cannot find the mail-id in the Mailman smtp.log, however in the smtp.log I found that the mail was received Sep 26 09:38:49 2017 (32) Peer: ('172.19.199.5', 49238) Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) handling connection Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'LHLO mailgateway.foo.bar' Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'MAIL FROM:<sender(a)foo.bar>' Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) sender: sender(a)foo.bar Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'RCPT TO:<s(a)listserver.foo.bar>' Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) recip: s(a)listserver.foo.bar Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'DATA' Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'QUIT' Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) connection lost Sep 26 09:38:49 2017 (32) Connection lost during _handle_client() I don't see any release of the held mail not that it was sent out. Two hours later I see a a log message about a notification mail to the admin that another mail had been held, but not anything about the released mail neither in thge smtp.log nor the postfix log. I don't know why it only works sometimes. -- Henrik Rasmussen <her(a)adm.ku.dk<mailto:her@adm.ku.dk>> University of Copenhagen, Danmark [View Less]

1 2

mailman-cli tools
by Dmitry Makovey Sept. 27, 2017

Sept. 27, 2017

I've come across mailman-cli docs: http://mailman-cli.readthedocs.io/en/latest/src/mailmanclient/cli/docs/usin… yet I cannot figure out what's the official source for the installation. Rabbit hole of links lead me to https://github.com/rajeevs1992/mailmancli which suggests: sudo pip install mailman.client and that doesn't work. I also did: pip install mailmanclient in hopes that it comes with CLI tools, but it looks like it is only the library. Am I looking in wrong places or is it that … [View More]

3 5

HyperKitty: Thread matching query does not exist
by C. R. Oldham Sept. 26, 2017

Sept. 26, 2017

Greetings, I have an active list for which I am trying to debug some deliverability issues. When a user tells me that folks aren't getting their postings, I check the archives first. In this case, I am getting a traceback saying "thread matching query does not exist" when I try to go to the HyperKitty page for the list. How can I debug this? I am using Mailman 3 via the Docker containers documented here: https://asynchronous.in/docker-mailman/ The container versions appear to be 0.1. --cro

3 3

Upgrade path
by David Krantz Sept. 23, 2017

Sept. 23, 2017

Hi. I currently run MM3.0 based on the old bundle installation. It seems to work just fine although with a number of minor and major annoyances that probably have been fixed now. What is the rekommended way to upgrade to the newest version? (newest _usable_ version, of course)? Is it docker-only with a migration from the current solution to a docker based? If so, any ideas or pointers on how to go about this? Cheers // David

2 2

mailman 3 adding extraneous /var/ to pid path?
by Andrew Hodder Sept. 21, 2017

Sept. 21, 2017

I'm not sure if this is a bug, or if I've configured something I'm unable to find doing this. But when I'm attempting to stop my mailman3 process, I keep getting an extra /var/ appending into the pid path, so it never finds the PID to terminate. Here are some examples, run at different times, some with different -C configs to launch, all worked successfully to start, this is only a problem on the stop.: (venv3) [root@mailman3(on1) venv3]# mailman stop Shutting down Mailman's master runner … [View More]

4 3

Change Base URI for Mailman 3.1
by Dmitry Makovey Sept. 21, 2017

Sept. 21, 2017

I'm tinkering with docker container of mailman 3.1 however I'm trying to utilize existing nginx server thus I need to map "/mailman" to mailman-web docker container vs default "/" mapping. Where do I configure base URI for mailman-web ? (quick search of archives and googling didn't yield any positive results thus far) -- Sr System and DevOps Engineer SoM IRT

2 1

Mailman List Lost on URL transfer
by heartsandbones＠zoho.com Sept. 20, 2017

Sept. 20, 2017

Hello Mailman Forum! I hope you all can help me. I have been banging my head against this issue for weeks. Here’s the scoop: I did a web site redesign for a non-profit. They didn’t mention to me that they had a mailman list associated with the site. When we transferred the url to Squarespace their list quakers(a)sbfriends.org stopped functioning and the administration login link: http://mail.sbfriends.org/mailman/admin/quakers_sbfriends.org results in a “server not found” error. I don’t know … [View More]

2 1