configure Mysql and postfix on mailman3
by ouerheni.nouha＠gmail.com
Hello all ,
I configured mailman3 following this contributer guide http://docs.mailman3.org/en/latest/devsetup.html but i'am still getting problem with the configuration of MySQL and postfix . Is this section is enough for MySQL configurations ?
[database]
class: mailman.database.mysql.MySQLDatabase
url: mysql+pymysql://myuser:mypassword@mymysqlhost/mailman?charset=utf8&use_unicode=1htmlI will appreciated if there are some documents to provide to cotinue the intergration of mailman3 .
Is there any tuto for postfix config ?
Thanks in advance
Ouerheni Nouha
3 months
import21: A string literal cannot contain NUL (0x00) characters.
by Henrik Rasmussen
Docker-mailman 0.1.1.
I am facing errors when using import21 to import list archives. The error message is "A string literal cannot contain NUL (0x00) characters." and the import stops, thus importing only mails up to 2009. The dublicates is mails already imported when retrying. If a mail contains illegal characters I would expect disregarding the particular mail and continue, or ignoring the nul character.
bash-4.3# python manage.py hyperkitty_import --verbosity 3 --since "01.01.1970" --list-address example(a)mailman3.ku.dk /opt/mailman-web-data/tmp/example(a)mailman3.ku.dk.mbox
Duplicate email with message-id '857A4D84DE6D1D41837DD9284F2729AB08F0C385(a)srv1.example.ku.dk'
<857A4D84DE6D1D41837DD9284F2729AB09DA5E45(a)srv1.example.ku.dk> (149)
Duplicate email with message-id '857A4D84DE6D1D41837DD9284F2729AB09DA5E45(a)srv1.example.ku.dk'
<857A4D84DE6D1D41837DD9284F2729AB09E20126(a)srv1.example.ku.dk> (150)
Failed adding message <857A4D84DE6D1D41837DD9284F2729AB09E20126(a)srv1.example.ku.dk>: A string literal cannot contain NUL (0x00) characters.
Traceback (most recent call last):
File "manage.py", line 10, in <module>
execute_from_command_line(sys.argv)
File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 367, in execute_from_command_line
utility.execute()
File "/usr/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 359, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/usr/local/lib/python2.7/site-packages/django/core/management/base.py", line 305, in run_from_argv
self.execute(*args, **cmd_options)
File "/usr/local/lib/python2.7/site-packages/django/core/management/base.py", line 356, in execute
output = self.handle(*args, **options)
File "/usr/local/lib/python2.7/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 278, in handle
importer.from_mbox(mbfile)
File "/usr/local/lib/python2.7/site-packages/hyperkitty/management/commands/hyperkitty_import.py", line 152, in from_mbox
add_to_list(self.list_address, message)
File "/usr/local/lib/python2.7/site-packages/hyperkitty/lib/incoming.py", line 149, in add_to_list
email.save()
File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 796, in save
force_update=force_update, update_fields=update_fields)
File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 824, in save_base
updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields)
File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 908, in _save_table
result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)
File "/usr/local/lib/python2.7/site-packages/django/db/models/base.py", line 947, in _do_insert
using=using, raw=raw)
File "/usr/local/lib/python2.7/site-packages/django/db/models/manager.py", line 85, in manager_method
return getattr(self.get_queryset(), name)(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/django/db/models/query.py", line 1043, in _insert
return query.get_compiler(using=using).execute_sql(return_id)
File "/usr/local/lib/python2.7/site-packages/django/db/models/sql/compiler.py", line 1054, in execute_sql
cursor.execute(sql, params)
File "/usr/local/lib/python2.7/site-packages/django/db/backends/utils.py", line 64, in execute
return self.cursor.execute(sql, params)
ValueError: A string literal cannot contain NUL (0x00) characters.
bash-4.3#
3 months, 1 week
Uncaught runner exception: 'str' object has no attribute 'decode'
by Henrik Rasmussen
When held mails are released in Mailman (maybe also mails which are not held) they are sometimes not sent nor archived, as mentioned in https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/threa...
One of my list admins reported that he released two mails on Sep 25 07:20:48 2017 UTC, and only the first was sent to the members. In the mailman.log I found the following from that particular release:
Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353
Sep 25 07:20:48 2017 (36) held message approved, message-id: <CAF9K74uk331j91PfF6S1nQT2YvxywwhUFBWBBcdMGkNMMU4=TA(a)somemail.com>
Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "POST /3.0/lists/listname.foo.bar/held/40 HTTP/1.1" 204 0
Sep 25 07:20:48 2017 (36) held message approved, message-id: <804D10D40C57024A90412246998CB72D873B794B(a)P1KITMBX07WC04.mailserver>
Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "POST /3.0/lists/listname(a)foo.bar/held/42 HTTP/1.1" 204 0
Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/held?count=0&page=1 HTTP/1.1" 200 90
Sep 25 07:20:48 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/held?count=10&page=1 HTTP/1.1" 200 90
Sep 25 07:20:53 2017 (28) HyperKitty archived message <CAF9K74uk331j91PfF6S1nQT2YvxywwhUFBWBBcdMGkNMMU4=TA(a)somemail.com> to https://listserver.foo.bar/hyperkitty/list/listname@foo.bar/message/IAKWS...
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar HTTP/1.1" 200 353
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/config HTTP/1.1" 200 2473
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/owner HTTP/1.1" 200 613
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/moderator HTTP/1.1" 200 617
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353
Sep 25 07:20:53 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/requests HTTP/1.1" 200 90
Sep 25 07:20:56 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar HTTP/1.1" 200 353
Sep 25 07:20:56 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/owner HTTP/1.1" 200 613
Sep 25 07:20:56 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/roster/moderator HTTP/1.1" 200 617
Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/config HTTP/1.1" 200 2473
Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/archivers HTTP/1.1" 200 81
Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname.foo.bar/archivers HTTP/1.1" 200 81
Sep 25 07:20:57 2017 (36) 172.19.199.3 - - "GET /3.0/lists/listname(a)foo.bar/requests HTTP/1.1" 200 90
Sep 25 07:20:57 2017 (35) Uncaught runner exception: 'str' object has no attribute 'decode'
Sep 25 07:20:57 2017 (35) Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration
self._process_one_file(msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/runners/pipeline.py", line 37, in _dispose
process(mlist, msg, msgdata, pipeline)
File "/usr/local/lib/python3.6/site-packages/mailman/core/pipelines.py", line 53, in process
handler.process(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 174, in process
mlist, msgdata, subject, prefix, prefix_pattern, ws)
File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 72, in all_same_charset
chunks.append(chunk.decode(charset))
AttributeError: 'str' object has no attribute 'decode'
Sep 25 07:20:57 2017 (35) SHUNTING: 1506324057.584686+a13cc47dc1027a0cfb00c892396b3ba7efabb3dc
In addition, the log contains other trace backs that might or might not associate to this problem:
Sep 24 21:11:27 2017 (34) Uncaught runner exception: 'ascii' codec can't encode character '\udcea' in position 3093: ordinal not in range(128)
Sep 24 21:11:28 2017 (34) Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration
self._process_one_file(msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose
self._func(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/mta/deliver.py", line 86, in deliver
refused = agent.deliver(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/mta/bulk.py", line 101, in deliver
mlist, msg, msgdata, recipients)
File "/usr/local/lib/python3.6/site-packages/mailman/mta/base.py", line 70, in _deliver_to_recipients
sender, sorted(recipients), msg.as_string())
File "/usr/local/lib/python3.6/site-packages/mailman/mta/connection.py", line 84, in sendmail
results = self._connection.sendmail(envsender, recipients, msgtext)
File "/usr/local/lib/python3.6/smtplib.py", line 855, in sendmail
msg = _fix_eols(msg).encode('ascii')
UnicodeEncodeError: 'ascii' codec can't encode character '\udcea' in position 3093: ordinal not in range(128)
Sep 24 21:11:28 2017 (34) SHUNTING: 1506287488.0529234+cbf8a31cad265a40a18e8955be0c9ad8b48a1b66
...¨
Sep 25 07:20:57 2017 (35) Uncaught runner exception: 'str' object has no attribute 'decode'
Sep 25 07:20:57 2017 (35) Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration
self._process_one_file(msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/runners/pipeline.py", line 37, in _dispose
process(mlist, msg, msgdata, pipeline)
File "/usr/local/lib/python3.6/site-packages/mailman/core/pipelines.py", line 53, in process
handler.process(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 174, in process
mlist, msgdata, subject, prefix, prefix_pattern, ws)
File "/usr/local/lib/python3.6/site-packages/mailman/handlers/subject_prefix.py", line 72, in all_same_charset
chunks.append(chunk.decode(charset))
AttributeError: 'str' object has no attribute 'decode'
Sep 25 07:20:57 2017 (35) SHUNTING: 1506324057.584686+a13cc47dc1027a0cfb00c892396b3ba7efabb3dc
...
Sep 25 09:19:58 2017 (30) deque: do_confirm_verify
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/app/workflow.py", line 69, in __next__
return step()
File "/usr/local/lib/python3.6/site-packages/mailman/app/subscriptions.py", line 420, in _step_send_confirmation
raise StopIteration
StopIteration
...
Sep 26 09:21:07 2017 (36) deque:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/app/workflow.py", line 69, in __next__
return step()
File "/usr/local/lib/python3.6/site-packages/mailman/app/subscriptions.py", line 217, in _step_sanity_checks
MemberRole.member)
mailman.interfaces.member.AlreadySubscribedError: sender(a)foo.bar is already a MemberRole.member of mailing list listname(a)listserver.foo.bar
...
Sep 26 13:32:29 2017 (30) Uncaught runner exception:
Sep 26 13:32:29 2017 (30) Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration
self._process_one_file(msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/runners/command.py", line 196, in _dispose
mlist, msg, msgdata, parts, results)
File "/usr/local/lib/python3.6/site-packages/mailman/commands/eml_confirm.py", line 53, in process
mlist).confirm(token)
File "/usr/local/lib/python3.6/site-packages/mailman/app/subscriptions.py", line 540, in confirm
PendableUnsubscription.PEND_TYPE)
AssertionError
...
Sep 27 13:23:02 2017 (32) Uncaught runner exception: 'content-transfer-encoding'
Sep 27 13:23:02 2017 (32) Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 171, in _one_iteration
self._process_one_file(msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/core/runner.py", line 264, in _process_one_file
keepqueued = self._dispose(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/runners/outgoing.py", line 93, in _dispose
self._func(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/mta/deliver.py", line 86, in deliver
refused = agent.deliver(mlist, msg, msgdata)
File "/usr/local/lib/python3.6/site-packages/mailman/mta/bulk.py", line 101, in deliver
mlist, msg, msgdata, recipients)
File "/usr/local/lib/python3.6/site-packages/mailman/mta/base.py", line 70, in _deliver_to_recipients
sender, sorted(recipients), msg.as_string())
File "/usr/local/lib/python3.6/email/message.py", line 158, in as_string
g.flatten(self, unixfrom=unixfrom)
File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten
self._write(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 181, in _write
self._dispatch(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 214, in _dispatch
meth(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 272, in _handle_multipart
g.flatten(part, unixfrom=False, linesep=self._NL)
File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten
self._write(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 181, in _write
self._dispatch(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 214, in _dispatch
meth(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 358, in _handle_message
g.flatten(msg.get_payload(0), unixfrom=False, linesep=self._NL)
File "/usr/local/lib/python3.6/email/generator.py", line 116, in flatten
self._write(msg)
File "/usr/local/lib/python3.6/email/generator.py", line 189, in _write
msg.replace_header('content-transfer-encoding', munge_cte[0])
File "/usr/local/lib/python3.6/email/message.py", line 558, in replace_header
raise KeyError(_name)
KeyError: 'content-transfer-encoding'
Sep 27 13:23:02 2017 (32) SHUNTING: 1506518582.300981+aa68949ca566c7170a81a0bd643cee803f29c312
7 months, 3 weeks
"Private archives" aren't private
by Simon Liebold
Hello,
#129 says that private lists are visible in the archive overview only
but "archives aren't displayed".
However, I can browse a private list's archives and read the mail text
while not logged in. Shouldn't the private archive be hidden from
anonymous users?
Simon
7 months, 4 weeks
Templates
by David Krantz
Hi.
How do I set a template for one specific list? I want one list to have
a special footer template.
I have tried updating the database (template table) without effect so
apparently the database is not used for templates or some kind of
fallback is used to set it to the generic footer. Of course I also
tried to restart mailman after that operation to try to rule out any
caching-related problem.
I want to use a file://-path as that is the least painful way of doing
it. I also would like a solution to place a file in a special
location. My current templates are in a
.../var/templates/site/en/
structure with names like list:member:generic:footer.txt
Cheers
// David
7 months, 4 weeks
"spoofing" mailing list address
by Dmitry Makovey
Hi,
We're trying to migrate from 2.1.x to 3.1. In the process we want to
modify old setup in which mailing lists were part of our normal mail
domain (so both user accounts and ML would be under @x.stanford.edu) in
new scenario we want to move ML into @lists.x.stanford.edu, yet preserve
addressing compatibility with old naming scheme. To that end we thought
of making following setup:
list(a)x.stanford.edu -postfix:alias-> list(a)lists.x.stanford.edu
however in this setup users will receive mail from the "unknown" domain
for them so any filtering they've done will break. Is there a
configuration change we can make for those old ML to spoof old ML
emails? so they would look as if they came from list(a)x.stanford.edu ?
--
Sr System and DevOps Engineer SoM IRT
7 months, 4 weeks
Mailman only send some release messages to the subscribers
by Henrik Rasmussen
I have three list admins each maintaining one list, thus three lists: E, H and S. All reports that some mails they release from Held messages are sent, some isn't.
In the logs (Mailman smtp.log and postfix log I can confirm that at least one of the lists (E) sent out another message to 559 recips at Sep 26 09:31:12 201 (UTC+2) so something is working.
The admin of list E explains that she have released mails that came out, but some mails isn't sent when she reases them. Among others a mail she released Sep 26 09:38.
I can also see in the Mailman Postfix log that Mailman received a mail from the Admin's e-mail address sender(a)foo.bar.
Sep 26 09:38:49 postfix postfix/smtpd[5527]: D8E6D1109026: client=gateway[172.19.199.1]
Sep 26 09:38:49 postfix postfix/cleanup[6076]: D8E6D1109026: message-id=<E7657360D6CFE64DBAC4E5D158511918873690FB(a)mailserver.foo.bar>
Sep 26 09:38:49 postfix postfix/qmgr[139]: D8E6D1109026: from=<sender(a)foo.bar>, size=19589, nrcpt=1 (queue active)
Sep 26 09:38:49 postfix postfix/lmtp[6077]: D8E6D1109026: to=<s(a)listserver.foo.bar>, relay=172.19.199.2[172.19.199.2]:8024, delay=0.03, delays=0.01/0.01/0/0.01, dsn=2.0.0, status=sent (250 Ok)
Sep 26 09:38:49 postfix postfix/qmgr[139]: D8E6D1109026: removed
I cannot find the mail-id in the Mailman smtp.log, however in the smtp.log I found that the mail was received
Sep 26 09:38:49 2017 (32) Peer: ('172.19.199.5', 49238)
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) handling connection
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'LHLO mailgateway.foo.bar'
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'MAIL FROM:<sender(a)foo.bar>'
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) sender: sender(a)foo.bar
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'RCPT TO:<s(a)listserver.foo.bar>'
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) recip: s(a)listserver.foo.bar
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'DATA'
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) Data: b'QUIT'
Sep 26 09:38:49 2017 (32) ('172.19.199.5', 49238) connection lost
Sep 26 09:38:49 2017 (32) Connection lost during _handle_client()
I don't see any release of the held mail not that it was sent out. Two hours later I see a a log message about a notification mail to the admin that another mail had been held, but not anything about the released mail neither in thge smtp.log nor the postfix log.
I don't know why it only works sometimes.
--
Henrik Rasmussen <her(a)adm.ku.dk<mailto:her@adm.ku.dk>>
University of Copenhagen, Danmark
7 months, 4 weeks
HyperKitty: Thread matching query does not exist
by C. R. Oldham
Greetings,
I have an active list for which I am trying to debug some deliverability
issues. When a user tells me that folks aren't getting their postings, I
check the archives first. In this case, I am getting a traceback saying
"thread matching query does not exist" when I try to go to the HyperKitty
page for the list. How can I debug this?
I am using Mailman 3 via the Docker containers documented here:
https://asynchronous.in/docker-mailman/
The container versions appear to be 0.1.
--cro
8 months
