[MM3-users] Re: mail stuck in "out" queue

Apologies for that!! Yes, this strace was on the out runner process (pid 17171) and yes, the out runner is running:

# ps aux | grep [r]unner=out
82 mailman   1:10 /usr/bin/python3 /usr/bin/runner -C /etc/mailman.cfg --runner=out:0:1

Other lists seem to work fine. Here's what I see in mailman.log, after sending two separate emails to the list:

Jun 09 17:36:28 2020 (85) ACCEPT: <CAAQM=w13wB6zM-gkjmUWmL26zFSF2DgNKsX3eFetzjtCVPKmCA@mail.gmail.com>
Jun 09 17:36:30 2020 (84) HyperKitty archived message <CAAQM=w13wB6zM-gkjmUWmL26zFSF2DgNKsX3eFetzjtCVPKmCA@mail.gmail.com> to https://lists.cs50.harvard.edu/hyperkitty/list/ap@lists.cs50.harvard.edu/message/53YMDWGTNF5WMYUTJCTNXMGV6KZGFV5V/
[09/Jun/2020:17:36:30 +0000] "GET /3.0/lists/ap@lists.cs50.harvard.edu HTTP/1.1" 200 373 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:36:30 +0000] "GET /3.0/lists/ap@lists.cs50.harvard.edu/config HTTP/1.1" 200 3099 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:36:30 +0000] "GET /3.0/users/kzidane@cs50.harvard.edu HTTP/1.1" 200 401 "-" "GNU Mailman REST client v3.3.0"
Jun 09 17:36:31 2020 (82) Cannot connect to SMTP server postfix on port 25

[09/Jun/2020:17:41:56 +0000] "GET /3.1/lists/teachers.lists.cs50.harvard.edu HTTP/1.1" 200 571 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:56 +0000] "GET /3.1/lists/teachers@lists.cs50.harvard.edu/held?count=0&page=1 HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:56 +0000] "GET /3.1/lists/teachers@lists.cs50.harvard.edu/held?count=10&page=1 HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:56 +0000] "GET /3.1/lists/teachers@lists.cs50.harvard.edu/requests HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:56 +0000] "GET /3.1/lists/teachers@lists.cs50.harvard.edu/held?count=50&page=1 HTTP/1.1" 200 90 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:58 +0000] "GET /3.1/domains HTTP/1.1" 200 537 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:58 +0000] "GET /3.1/domains/lists.cs50.harvard.edu HTTP/1.1" 200 223 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:58 +0000] "GET /3.1/domains/lists.cs50.yale.edu HTTP/1.1" 200 207 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:41:58 +0000] "POST /3.0/lists/find HTTP/1.1" 200 478 "-" "GNU Mailman REST client v3.3.0"
Jun 09 17:42:05 2020 (85) ACCEPT: <CAC-4VT7LRb7REc39i=a8wRc50hOuB_5mSEN37ozatqp9RGNfVA@mail.gmail.com>
[09/Jun/2020:17:42:06 +0000] "GET /3.0/lists/ap@lists.cs50.harvard.edu HTTP/1.1" 200 373 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:42:06 +0000] "GET /3.0/lists/ap@lists.cs50.harvard.edu/config HTTP/1.1" 200 3099 "-" "GNU Mailman REST client v3.3.0"
[09/Jun/2020:17:42:06 +0000] "GET /3.0/users/kareemzidane2@gmail.com HTTP/1.1" 200 293 "-" "GNU Mailman REST client v3.3.0"
Jun 09 17:42:06 2020 (84) HyperKitty archived message <CAC-4VT7LRb7REc39i=a8wRc50hOuB_5mSEN37ozatqp9RGNfVA@mail.gmail.com> to https://lists.cs50.harvard.edu/hyperkitty/list/ap@lists.cs50.harvard.edu/message/VFBAIB2FSAI54ARYA3CBAOPIPGOCAJ4R/

Doesn't seem there are any errors? I grep'd for errors in mailman.log and this is what I got:

FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/lists/ap.lists.cs50.harvard.edu/digest.mmdf'
FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/lists/ap.lists.cs50.harvard.edu/digest.mmdf'
FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/lists/ap.lists.cs50.harvard.edu/digest.mmdf'
FileNotFoundError: [Errno 2] No such file or directory: '/opt/mailman/var/lists/ap.lists.cs50.harvard.edu/digest.mmdf'

No mention of the /hyperkitty/api/mailman/urls API call in mailman.log but I could confirm with tcpdump that mailman is hitting that and I was able to add some logs to the _get_url function in mailman_hyperkitty plugin and it was being called infinitely.

/opt/mailman/var/archives/hyperkitty/spool appears to be empty.

And lastly, even though emails to this particular list do not go out, they do get archived.

Thank you so much! I appreciate all the help!