Does mailman2 regular_exclude_list equal mailman3 receive_list_copy ?
Question: Reduce cross-posting to multiple lists (either BCC: or To: or CC:)
Use-case: User sends email ( to: their email) and ( bcc: list1, list2 ) The sender-user and target-user1 (and target-userX) have receive_list_copy = False, and receive_own = True
Issue: For mailman 3.3.1, a user receives their email from To:, however target receipients receive multiple copies of the emails. This is different from mailman2 with the regular_exclude_list.
Questions:
- this is a configuration issue or expected behaviour ?
- target-user is a "user" who is member on list1 and list2 (verified via api)
- see list-config - any missing?
{ "acceptable_aliases": [], "accept_these_nonmembers": [], "admin_immed_notify": true, "admin_notify_mchanges": false, "administrivia": true, "advertised": true, "allow_list_posts": true, "anonymous_list": false, "archive_policy": "public", "autorespond_owner": "none", "autorespond_postings": "none", "autorespond_requests": "none", "autoresponse_grace_period": "90d", "autoresponse_owner_text": "", "autoresponse_postings_text": "", "autoresponse_request_text": "", "bounces_address": "duplicate1-bounces@mydomain.local", "bounce_info_stale_after": "7d", "bounce_notify_owner_on_disable": true, "bounce_notify_owner_on_removal": true, "bounce_score_threshold": 5, "bounce_you_are_disabled_warnings": 3, "bounce_you_are_disabled_warnings_interval": "7d", "collapse_alternatives": false, "convert_html_to_plaintext": false, "created_at": "2020-05-31T14:43:48", "default_member_action": "defer", "default_nonmember_action": "hold", "description": "", "digest_last_sent_at": "2020-06-04T00:41:35", "digest_send_periodic": true, "digest_size_threshold": 30.0, "digest_volume_frequency": "monthly", "digests_enabled": true, "display_name": "Duplicate1", "discard_these_nonmembers": [], "dmarc_mitigate_action": "munge_from", "dmarc_mitigate_unconditionally": true, "dmarc_moderation_notice": "", "dmarc_wrapped_message_text": "", "filter_action": "discard", "filter_content": true, "filter_extensions": [ "exe", "bat", "cmd", "com", "pif", "cpl" ], "filter_types": [], "first_strip_reply_to": false, "forward_unrecognized_bounces_to": "administrators", "fqdn_listname": "duplicate1@mydomain.local", "gateway_to_mail": false, "gateway_to_news": false, "hold_these_nonmembers": [], "include_rfc2369_headers": true, "info": "", "join_address": "duplicate1-join@mydomain.local", "last_post_at": "2020-06-04T01:17:13", "leave_address": "duplicate1-leave@mydomain.local", "linked_newsgroup": "", "list_name": "duplicate1", "mail_host": "mydomain.local", "max_message_size": 9990, "max_num_recipients": 10, "max_days_to_hold": 0, "member_roster_visibility": "moderators", "moderator_password": null, "newsgroup_moderation": "none", "next_digest_number": 5, "nntp_prefix_subject_too": true, "no_reply_address": "noreply@mydomain.local", "owner_address": "duplicate1-owner@mydomain.local", "pass_types": [], "pass_extensions": [], "personalize": "none", "post_id": 51, "posting_address": "duplicate1@mydomain.local", "posting_pipeline": "default-posting-pipeline", "preferred_language": "en", "process_bounces": true, "reject_these_nonmembers": [], "reply_goes_to_list": "point_to_list", "reply_to_address": "duplicate1@mydomain.local", "request_address": "duplicate1-request@mydomain.local", "require_explicit_destination": false, "respond_to_post_requests": true, "send_welcome_message": true, "subject_prefix": "[Duplicate1] ", "subscription_policy": "confirm", "unsubscription_policy": "confirm", "usenet_watermark": null, "volume": 1, "http_etag": "\"8ec001cb705f24c19f1a48de5b551a6a9653fcd6\"" }
On 6/4/20 8:37 AM, sunil soprey wrote:
Question: Reduce cross-posting to multiple lists (either BCC: or To: or CC:)
Use-case: User sends email ( to: their email) and ( bcc: list1, list2 ) The sender-user and target-user1 (and target-userX) have receive_list_copy = False, and receive_own = True
Issue: For mailman 3.3.1, a user receives their email from To:, however target receipients receive multiple copies of the emails. This is different from mailman2 with the regular_exclude_list.
That's correct. Mailman 3 does not (yet?) have a feature comparable to Mailman 2.1's regular_exclude_lists and regular_include_lists.
People who are members of multiple cross-posted lists will receive a copy from each list.
-- Mark Sapiro mark@msapiro.net The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Do you plan to reintroduce the de-duplication feature so that if a mail list subscriber is on multiple email lists that are cc'd/bcc'd they only get the message one time?
Are you aware of solutions feature outside of Mailman3 core? Say filtering in postfix-mta? (might complicate tracking of dups in postfix)
For "mailman core", could we filter in outbound send of mailman? Example - could the processing pipeline be modified to track/discard duplicate msgs?
Did you ever get an answer to this? I was short of round tuits so left this in the inbox, but maybe you already have the answers.
sunil soprey writes:
Do you plan to reintroduce the de-duplication feature so that if a mail list subscriber is on multiple email lists that are cc'd/bcc'd they only get the message one time?
Yes, it's desirable. However, the question is actually quite complex because a 'User' may have many 'Address' entries. Here, does "subscriber" mean 'User' or 'Address'? I can see it going both ways. Some users have many addresses, all except one are pure forwarding, and they only want to read the email once. Other users have separate addresses for separate roles, and they want to have that message for context in each role even if they have read it before.
Hashing this out means it will take us some time to get it into a release. (That's IMO, I defer to Abhilash as project leader and Mark as having more experience if their opinions differ.)
Of course we could implement "de-dup" with the subscriber = 'Address' interpretation immediately, which provides substantial relief for many users, and later add a User config option for "Also de-dup equivalent addresses" for some definition of "equivalence" (I can think of two implementations already, that's what I do, complexify things ;-).
Are you aware of solutions feature outside of Mailman3 core? Say filtering in postfix-mta? (might complicate tracking of dups in postfix)
I'm sure there are no such. It's much simpler to implement in Mailman core because you don't need to deal with transporting Mailman to filter and filter to MTA, and more reliable to implement in core because Mailman knows a lot more about both subscriptions and messages than you could deduce from the message itself. It's not impossible, of course, but I think it would be hard to implement well.
For "mailman core", could we filter in outbound send of mailman? Example - could the processing pipeline be modified to track/discard duplicate msgs?
I'm not sure what you mean by modifying the processing pipeline, but the basic idea is pretty clear. At some point the list name has to be expanded into a list of addresses. This is done by a specific handler in the pipeline, and the filtering will be done at that time. There are a number of possible implementations. We'd start by looking up all of each subscription's list affiliations when we look up the subscription configuration. In some cases we could create addressee lists for all the relevant mailing lists at that time, then send the message to the outgoing pipeline of each list to be decorated appropriately, but I'm not sure whether it's worth trying to do that. We'd also have to keep a record of lists of addresses (or Users) wanting de-duplication identified by Message-ID for some period of time in case the sender's MTA sent the message multiple times rather than providing multiple recipients in one transaction.
Steve
participants (3)
-
Mark Sapiro -
Stephen J. Turnbull -
sunil soprey