National language messages in mm3 notifications
Hello
There is a problem with moderator/administrator notifications used national (non-acsii) characters in templates. Messages came with all non-ascii chars changed to '?'
As I can see some parts of customizable text are originated from localized messages (mailman/messages/<country code>/LC_MESSAGES), other from site/domain/list templates. I made some localization/translation of LS_MESSAGES for Russian language via Weblate site and import .po file to test site setup. Web interface messages seems to be ok but email notifications are not. Content-type: and Content-Transfer-Encoding: headers are not suitable for national charsets.
Mailman processes has enviroment variable LANG set to ru_RU.UTF-8. Preferred language for site administrator (listmaster) is Russian
What am I missing in setup?
Return-Path: <test-bounces@solvo.ru> [...] Received: from mail-g3-vlan10 (localhost [IPv6:::1]) by mail-g3 (Postfix) with ESMTP id 889784800512D for <kia@solvo.ru>; Tue, 18 Jan 2022 00:00:22 +0300 (MSK) MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: ????????? ????????????? ???????? ? ?????? ???????? test@solvo.ru: 1. From: listmaster@solvo.ru To: =?utf-8?b?0JjQstCw0L0g0JrRg9C30L3QtdGG0L7Qsg==?= <kia@solvo.ru> Message-ID: <164245320388.3361727.10723274392705308145@mail-g3-vlan10> Date: Tue, 18 Jan 2022 00:00:03 +0300 Precedence: bulk X-Mailman-Version: 3.3.5 List-Id: =?utf-8?b?0KLQtdGB0YLQvtCy0YvQuSDRgdC/0LjRgdC+0Lo=?= <test.solvo.ru> List-Help: <mailto:test-request@solvo.ru?subject=help> List-Owner: <mailto:test-owner@solvo.ru> List-Subscribe: <mailto:test-join@solvo.ru> List-Unsubscribe: <mailto:test-leave@solvo.ru> [...]
The test@solvo.ru list has 1 moderation requests waiting.
????????? ????????? ????????: ????????????: ikuznetsov@solvo.ru
Please attend to this at your earliest convenience.
On 1/18/22 5:31 AM, Ivan Kuznetsov wrote:
Hello
There is a problem with moderator/administrator notifications used national (non-acsii) characters in templates. Messages came with all non-ascii chars changed to '?' ... What am I missing in setup?
Set the list's preferred language to Russian and possibly set
default_language: ru
in the [mailman] section of mailman.cfg.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hello
All works fine if all the site, mailing list and user languages are equal. But I found at least two corner cases if languages are not same:
- Site language is Russian. User default language is US English. User subscribes to mailing list with non-English preferred language (Russian)
User greeting message have correct body encoding but garbled Subject: header:
================= Return-Path: <test-bounces@solvo.ru> [...] MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: ????? ?????????? ? ?????? ???????? "Test" From: test-request@solvo.ru To: =?utf-8?b?0JjQstCw0L0g0JrRg9C30L3QtdGG0L7QsiAo0YLQtdGB0YIp?= <ikuznetsov@solvo.ru> X-No-Archive: yes Message-ID: <164370087756.3121264.15600221365450238466@mail-g3-vlan10.solvo.ru> Date: Tue, 01 Feb 2022 10:34:37 +0300 Precedence: bulk X-Mailman-Version: 3.3.5 List-Id: =?utf-8?b?0KLQtdGB0YLQvtCy0YvQuSDRgdC/0LjRgdC+0Lo=?= <test.solvo.ru> List-Help: <mailto:test-request@solvo.ru?subject=help> List-Owner: <mailto:test-owner@solvo.ru> List-Subscribe: <mailto:test-join@solvo.ru> List-Unsubscribe: <mailto:test-leave@solvo.ru>
Welcome to the "Test" mailing list!
To post to this list, send your message to:
test@solvo.ru
[...]
- Site language is Russian. User default language is US English. User subscribes to mailing list with preferred US English language.
Moderator notify message has Subject: garbled
================= Return-Path: <test-bounces+kia=solvo.ru@solvo.ru> [...] MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Subject: ????? ?????? ?? ???????? ?? ?????? ???????? Test ?? ikuznetsov@solvo.ru From: test-owner@solvo.ru To: =?utf-8?b?0JjQstCw0L0g0JrRg9C30L3QtdGG0L7Qsg==?= <kia@solvo.ru> Message-ID: <164370607233.3121263.10615836031266859672@mail-g3-vlan10.solvo.ru> Date: Tue, 01 Feb 2022 12:01:12 +0300 Precedence: bulk X-Mailman-Version: 3.3.5 List-Id: =?utf-8?b?0KLQtdGB0YLQvtCy0YvQuSDRgdC/0LjRgdC+0Lo=?= <test.solvo.ru> List-Help: <mailto:test-request@solvo.ru?subject=help> List-Owner: <mailto:test-owner@solvo.ru> List-Subscribe: <mailto:test-join@solvo.ru> List-Unsubscribe: <mailto:test-leave@solvo.ru> X-DrWeb-SpamScore: 315 X-DrWeb-SpamState: spam X-DrWeb-SpamDetail: gggruggvucftvghtrhhoucdtuddrgedvvddrgedvgdduvdeiucetufdoteggodetrfcurfhrohhfihhlvgemucfftfghgfeunecuuegrihhlohhuthemuceftddtnecuogetfedtuddqtdduucdludehmdenogfogedtledqfeefucdlfedttddmnecujfgurhepgggtgffuhffvkfffphejfedvtdfjsehtjeertddttddvnecuhfhrohhmpehtvghsthdqohifnhgvrhesshholhhvohdrrhhunecuggftrfgrthhtvghrnheptedvledvheefueekieektdeuueeiheekffehleeuffeiteeuteelheeggfeftdfg X-DrWeb-SpamVersion: Vade Retro 01.422.42#126 AS+AV+AP Profile: DRWEB; Bailout: 300 X-AntiVirus: Checked by Dr.Web [MailD: 11.1.12.2108031732, SE: 11.1.7.2106242330, Core engine: 7.00.52.08270, Virus records: 10792308, Updated: 2022-Feb-01 07:11:29 UTC] Message-ID-Hash: KFWOCUEE7SSJMLW222QGFECTNTBXYDEG X-Message-ID-Hash: KFWOCUEE7SSJMLW222QGFECTNTBXYDEG X-MailFrom: test-bounces@solvo.ru X-DrWeb-SpamScore: 300 X-DrWeb-SpamState: spam X-DrWeb-SpamDetail: gggruggvucftvghtrhhoucdtuddrgedvvddrgedvgdduvdeiucetufdoteggodetrfcurfhrohhfihhlvgemucfftfghgfeunecuuegrihhlohhuthemuceftddtnecuogfogedtledqfeefucdlfedttddmnecujfgurhepgggtgffuhffvkfffphejfedvtdfjsehtjeertddttddvnecuhfhrohhmpehtvghsthdqohifnhgvrhesshholhhvohdrrhhunecuggftrfgrthhtvghrnheptedvledvheefueekieektdeuueeiheekffehleeuffeiteeuteelheeggfeftdfg X-DrWeb-SpamVersion: Vade Retro 01.422.42#126 AS+AV+AP Profile: DRWEB; Bailout: 300 X-AntiVirus: Checked by Dr.Web [MailD: 11.1.12.2108031732, SE: 11.1.7.2106242330, Core engine: 7.00.52.08270, Virus records: 10792308, Updated: 2022-Feb-01 07:11:29 UTC]
Your authorization is required for a mailing list subscription request approval:
For: =?utf-8?b?0JjQstCw0L0g0JrRg9C30L3QtdGG0L7QsiAo0YLQtdGB0YIp?= <ikuznetsov@solvo.ru> List: test@solvo.ru
User greeting message has correct English body and garbled Subject as in case 1
It seems that notifications Subject encoding is selected based on list or user preferred language, but Subject text come from site-wide global strings, translated to site language.
18.01.2022 20:08, Mark Sapiro wrote:
On 1/18/22 5:31 AM, Ivan Kuznetsov wrote:
Hello
There is a problem with moderator/administrator notifications used national (non-acsii) characters in templates. Messages came with all non-ascii chars changed to '?' ... What am I missing in setup?
Set the list's preferred language to Russian and possibly set
default_language: ru
in the [mailman] section of mailman.cfg.
-- С уважением, Иван Кузнецов Руководитель технического отдела
Группа компаний "СОЛВО" +7(812)60-60-555 +7(495)66-83-003 +7(921)740-72-61 http://www.solvo.ru
СОЛВО - Эталон Автоматизации Логистики
On 2/1/22 01:11, Ivan Kuznetsov wrote:
It seems that notifications Subject encoding is selected based on list or user preferred language, but Subject text come from site-wide global strings, translated to site language.
Thank you for the report and analysis. This seems marginally related to https://gitlab.com/mailman/mailman/-/issues/963, but is different enough to warrant a new issue. Please file one at https://gitlab.com/mailman/mailman/-/issues/
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
participants (2)
-
Ivan Kuznetsov -
Mark Sapiro