- Mailman-users - lists.mailman3.org

API errors making member changes to one list but not others
by Stephen Willey Mats Mats Jan. 28, 2021

Jan. 28, 2021

We had an issue with the UI getting API timeouts for a single list for specific functions but not other lists or other functions. This started happening after we accidentally filled the disk partition used by most of the system including the database. There was a single person testing at the time when the disk fullness happened and it was only the single list that got ‘damaged’. After disk cleanup and restarting the docker images the single list would give API errors ("HTTP Error 400: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5)” ) on the screen and logged errors (below) when list members were either subscribed or removed. The issue was repeatable in Postorius and did not ‘heal’. Oddly the issue was resolved by making seemingingly the same API calls from the command line via curl. Making the below call to add a member succeeded and fixed being able to add members in the UI. Similarly sending a DELETE cal from curl worked where unsubscribe requests from postorius (either mass removal or picking addresses from the list member and unsubscribing selected) failed. Again, the unsubscribe from the curl DELETE call ‘healed’ the list such that subsequent unsubscribes in Postorius worked. curl --user user:password -X POST -d 'list_id=laura-test.mm3.aca-aws.s.uw.edu' -d 'subscriber=ssw(a)uw.edu' -d 'pre_verified=true' -d 'pre_confirmed=true' -d 'pre_approved=true' http://172.19.199.2:8001/3.1/members We’re running the current rolling docker images (up to date as of 25Jan2021) Obviously, people should run their servers better than letting disk partitions fill-up but it’s going to happen and mailman3 should do a better job of reporting errors and recovering when accidents happen. thanks, steve I’ve included mailman.log lines from going to the mass subscribe [26/Jan/2021:20:42:49 +0000] "GET /3.1/lists/laura-test.mm3.aca-aws.s.uw.edu HTTP/1.1" 200 434 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:42:49 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:42:49 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:43:01 +0000] "GET /3.1/lists/laura-test.mm3.aca-aws.s.uw.edu HTTP/1.1" 200 434 "-" "GNU Mailman REST client v3.3.2" Jan 26 20:43:07 2021 (48) deque: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 426, in _make_request six.raise_from(e, None) File "<string>", line 3, in raise_from File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 421, in _make_request httplib_response = conn.getresponse() File "/usr/lib/python3.8/http/client.py", line 1347, in getresponse response.begin() File "/usr/lib/python3.8/http/client.py", line 307, in begin version, status, reason = self._read_status() File "/usr/lib/python3.8/http/client.py", line 268, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") File "/usr/lib/python3.8/socket.py", line 669, in readinto return self._sock.recv_into(b) socket.timeout: timed out During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 439, in send resp = conn.urlopen( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 724, in urlopen retries = retries.increment( File "/usr/lib/python3.8/site-packages/urllib3/util/retry.py", line 403, in increment raise six.reraise(type(error), error, _stacktrace) File "/usr/lib/python3.8/site-packages/urllib3/packages/six.py", line 735, in reraise raise value File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 670, in urlopen httplib_response = self._make_request( File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 428, in _make_request self._raise_timeout(err=e, url=url, timeout_value=read_timeout) File "/usr/lib/python3.8/site-packages/urllib3/connectionpool.py", line 335, in _raise_timeout raise ReadTimeoutError( urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/site-packages/mailman/app/workflow.py", line 69, in __next__ return step() File "/usr/lib/python3.8/site-packages/mailman/app/subscriptions.py", line 343, in _step_do_subscription self.member = self.mlist.subscribe( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/mailinglist.py", line 507, in subscribe notify(SubscriptionEvent( File "/usr/lib/python3.8/site-packages/zope/event/__init__.py", line 32, in notify subscriber(event) File "/usr/lib/python3.8/site-packages/mailman/app/membership.py", line 176, in handle_SubscriptionEvent send_welcome_message(mlist, member, member.preferred_language) File "/usr/lib/python3.8/site-packages/mailman/app/notifications.py", line 51, in send_welcome_message welcome_message = wrap(getUtility(ITemplateLoader).get( File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 188, in get contents = getUtility(ITemplateManager).get( File "/usr/lib/python3.8/site-packages/mailman/database/transaction.py", line 85, in wrapper return function(args[0], config.db.store, *args[1:], **kws) File "/usr/lib/python3.8/site-packages/mailman/model/template.py", line 110, in get contents = protocols.get(actual_uri, **auth) File "/usr/lib/python3.8/site-packages/mailman/utilities/protocols.py", line 38, in get response = requests.get(url, timeout=REQUEST_TIMEOUT, **kws) File "/usr/lib/python3.8/site-packages/requests/api.py", line 76, in get return request('get', url, params=params, **kwargs) File "/usr/lib/python3.8/site-packages/requests/api.py", line 61, in request return session.request(method=method, url=url, **kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 530, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3.8/site-packages/requests/sessions.py", line 643, in send r = adapter.send(request, **kwargs) File "/usr/lib/python3.8/site-packages/requests/adapters.py", line 529, in send raise ReadTimeout(e, request=request) requests.exceptions.ReadTimeout: HTTPConnectionPool(host='mailman-web', port=8000): Read timed out. (read timeout=5) [26/Jan/2021:20:43:07 +0000] "POST /3.1/members HTTP/1.1" 400 130 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:43:07 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:43:07 +0000] "GET /3.1/lists/laura-test(a)mm3.aca-aws.s.uw.edu/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" Then the results of a successful subscribe: [26/Jan/2021:20:46:20 +0000] "GET /3.1/lists/list2.mm3.aca-aws.s.uw.edu HTTP/1.1" 200 388 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:46:20 +0000] "POST /3.1/members HTTP/1.1" 201 0 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:46:20 +0000] "GET /3.1/lists/list2(a)mm3.aca-aws.s.uw.edu/requests/count?token_owner=moderator HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2" [26/Jan/2021:20:46:20 +0000] "GET /3.1/lists/list2(a)mm3.aca-aws.s.uw.edu/held/count HTTP/1.1" 200 73 "-" "GNU Mailman REST client v3.3.2” >

2 1

Perplexing unsubscribing notification problem
by Brian Carpenter Jan. 27, 2021

Jan. 27, 2021

Hi MM3 Users, I have a perplexing issue with one of our Mailman 3 servers. It doesn't want to send out unsubscribe notifications when a List Owner removes a list member. The server sends out welcome messages and subscription notifications fine just not unsubscribe notifications when a List Owner removes a list member. It will send out an unsubscribe notification if the list member sends an email to listname-leave@listdomain both to the List Owner and List Member. Nothing is showing in the logs as far as I can tell. -- Brian Carpenter Harmonylists.com Emwd.com

1 1

I like your style, but what is it?
by Stephen Willey Mats Mats Jan. 27, 2021

Jan. 27, 2021

How do I get a dump of list settings for each style. Thanks, steve p.s. the search on https://mailman.readthedocs.io/en/latest/README.html gives results but every link needs to have ‘projects/mailman/‘ removed from the url to work.

2 1

Problem updating mailman
by Odhiambo Washington Jan. 26, 2021

Jan. 26, 2021

I am getting this error after I did a git pull and build. (venv) [mailman3@gw ~/git]$ /opt/mailman/mm/bin/mailman-post-update + '[' False == False ']' + mkdir -p /opt/mailman/mm/static + /opt/mailman/mm/bin/django-admin collectstatic --clear --noinput --verbosity 0 +* /opt/mailman/mm/bin/django-admin compress* CommandError: An error occurred during rendering /opt/mailman/mm/venv/lib/python3.7/site-packages/HyperKitty-1.3.4rc2-py3.7.egg/hyperkitty/templates/hyperkitty/404.html: /usr/local/lib/ruby/site_ruby/2.7/rubygems/dependency.rb:311:in `to_specs': Could not find 'sass-listen' (~> 4.0.0) among 4 total gem(s) (Gem::MissingSpecError) Checked in 'GEM_PATH=/opt/mailman/.gem/ruby/2.7:/usr/local/lib/ruby/gems/2.7', execute `gem env` for more information from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1446:in `block in activate_dependencies' from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1435:in `each' from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1435:in `activate_dependencies' from /usr/local/lib/ruby/site_ruby/2.7/rubygems/specification.rb:1417:in `activate' from /usr/local/lib/ruby/site_ruby/2.7/rubygems.rb:305:in `block in activate_bin_path' from /usr/local/lib/ruby/site_ruby/2.7/rubygems.rb:304:in `synchronize' from /usr/local/lib/ruby/site_ruby/2.7/rubygems.rb:304:in `activate_bin_path' from /usr/local/bin/sass:23:in `<main>' The other output from this process is so long so I pasted it here: https://pastebin.ubuntu.com/p/tsB2CCNrQG/ Thanks -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft.", grep ^[^#] :-)

3 4

Language Support In Templates
by Brian Carpenter Jan. 26, 2021

Jan. 26, 2021

Hello MM3 Users, I have a question regarding the use of templates in different languages. I created a template for the unsubscribe notification in Postorius in Greek. The template shows up fine in Greek via Postorius. However the email that is sent out has a bunch of question marks where the Greek should be: ??????????? ?????????? ???????? ?????????? email ???? ???, ????? ????? ? ??????????? GNU Mailman ???? ????? $. ?????? ??? ?????? ????????? ??? ?? ????????? email $user_email ?????? ?? GNU Mailman ?????? ?? ?????????? ??? ??????? ???, ?????? ????? ?? ????????????? ?? ?????? ???. ???????? ?? ?? ?????? ????? ?????????? ?? ???? ?? ??????. ? ?? ?????? ?? ????????????? ??? ???????? ?????? - ??? ???? ?? ???????? line - ?? ??? ?????? ???? ?? $ request_email: confirm $token ????????? ??? ? ???? ???????? "?????????" ?? ???? ?? ?????? ?????? ?? ?????????? ?? ???????????? ?????????? ?????????????. ??? ??? ?????? ?? ??????????? ??? ????? ?? ????????? ???????????? ????????????, ????? ???????? ??? ??????. ??? ????????? ??? ??????????? ????????? ??? ?? ?????, ? ????? ????? ?????????, ???????? ?? ?????????????? $owner_email What does it take to get templates to send out messages in a different language then the interface itself. -- Brian Carpenter Harmonylists.com Emwd.com

2 2

How to approve moderated messages via email?
by Brian Carpenter Jan. 24, 2021

Jan. 24, 2021

What is the protocol to approve moderated messages via email? I hope I asking the question correctly. -- Brian Carpenter Harmonylists.com Emwd.com

3 5

False attachments in Outlook 2019?
by Brian Olesen Jan. 24, 2021

Jan. 24, 2021

Dear Mailman 3 users, I seriously think of upgrading from Mailman 2.1.33 to this new RC2 or the final one, when it comes out. But there is an annoying issue that I'd like to ask you about. It's the false attachments that Outlook creates for the footer. Is this still an issue when using Mailman 3, or have you made some sort of work around? I mean here in 2021 it could be nice to use html as the default mail format to be able to create nice looking mails, and due to EU regulations an unsubscription is a requirement. Best regards Brian Olesen from Denmark P.S. If this issue has been solved I will happily translate the mail templates into Danish if wanted.

2 1

Blocked by Hotmail
by Tom ＠ Gather Jan. 23, 2021

Jan. 23, 2021

I am getting rejections from Hotmail Jan 18 14:42:22 mail postfix/smtp[6571]: 046713F914: to=< helen_maryd(a)hotmail.com>, relay=hotmail-com.olc.protection.outlook.com[104.47.58.161]:25, delay=0.14, delays=0.06/0.03/0.04/0.01, dsn=5.7.1, status=bounced (host hotmail-com.olc.protection.outlook.com[104.47.58.161] said: 550 5.7.1 Unfortunately, messages from [167.99.151.239] weren't sent. Please contact your Internet service provider since part of their network is on our block list (S3140). You can also refer your provider to http://mail.live.com/mail/troubleshooting.aspx#errors. [ BN8NAM11FT014.eop-nam11.prod.protection.outlook.com] (in reply to MAIL FROM command)) I have submitted a ticket to https://support.microsoft.com/en-us/supportrequestform/8ad563e3-288e-2a61-8… Not sure why they are blocking me. Not on any other blacklists per mxtoolbox... Anyone else experienced this? How to resolve? My mail server is on Digital Ocean if that makes any difference. Thanks for any help -- Tom for the Gather Team https://info.gather.coop

5 4

django fake users
by r.woithe＠callassoftware.com Jan. 23, 2021

Jan. 23, 2021

Hello, is there a opportunity to avoid django fake users? Because of it is not stopping, further and further fake users are subscribing. Would be nice to have a possibility to stop this.

6 10

"Unsubscribe all" failed with large lists
by Alan So Jan. 21, 2021

Jan. 21, 2021

We are currently testing latest mailman suite (w/Postorius 1.3.3) and notice that that the the API call /3.1/lists/listname.domain/roster/member failed when using "Unsubscribe all" on Postorius for a large list (~15000 members). Not sure whether the issue has been already reported or not.

2 3