New Lists Appear in HyperKitty Archives, But No Mail Data is Shown
Hello,
I have been troubleshooting an issue with our Mailman 3 archives. I have made a key observation that has helped narrow down the problem. While a newly created list appears in the HyperKitty archives, no email data is shown inside that list.
*Problem:* When I create a new mailing list in Mailman Core and then visit the HyperKitty archives, the list is correctly displayed. However, when I send an email to that list, no mail data (messages) are shown inside it. The message count for the list remains at zero in the archives UI.
*Expected Behavior:* I expect that when a new list is created, it should appear in the archives, and any emails sent to it should also be correctly displayed within that list.
*System Environment:*
*Mailman Version:* Mailman 3.x
*Archiver:* HyperKitty
*Web Interface:* Postorius
*Database:* PostgreSQL
*Setup:* Mailman Core (/opt/mailman/venv) and the web components (venv_hk) are running in separate virtual environments on the same server.
*Troubleshooting Steps Taken:*
*List Synchronization:* Creating a new list in Mailman Core immediately makes it visible in the HyperKitty archives, which confirms that the mailmanweb service is correctly communicating with the hyperkitty_mailinglist table. 2.
*Email Injection Test:* I used the mailman shell to inject a test email directly into a list. The inject_message function executed without errors. 3.
*Configuration Check:* I have verified that the base_url in the Mailman archiver configuration (mailman-hyperkitty.cfg) and the MAILMAN_ARCHIVER_KEY in the HyperKitty settings file (settings.py) are correctly set and match.
Could this be due to an API key or permissions issue preventing the data from being written, even though the tables exist? Any advice on what to check next would be extremely helpful.
Thanks
On July 12, 2025 8:28:58 AM EDT, Asif Muzammil via Mailman-users <mailman-users@mailman3.org> wrote:
Hello,
*Problem:* When I create a new mailing list in Mailman Core and then visit the HyperKitty archives, the list is correctly displayed. However, when I send an email to that list, no mail data (messages) are shown inside it. The message count for the list remains at zero in the archives UI.
The messages are probably queued in Mailman core's var/archives/hyperkitty/spool/ directory and the errors that cause this logged in var/logs/mailman.log.
Once you fix the underlying issue, the messages will be delivered to hyperkitty on the next post.
-- Mark Sapiro <mark@msapiro.net> Sent from my Not_an_iThing with standards compliant, open source software.
Hi Mark
but in my server there is no directory located at var/archives/hyperkitty/spool/, i can see the spool /var/maliman/spool and there is no files in it So what should I do?
Thanks
Asif Muzammil via Mailman-users wrote on 2025-07-14 02:57:
but in my server there is no directory located at var/archives/hyperkitty/spool/, i can see the spool /var/maliman/spool and there is no files in it So what should I do?
If you installed using the "venv" method, then the spool should be at:
/opt/mailman/mm/var/archives/hyperkitty/spool
There shouldn't be a /var/mailman/spool created using venv.
Which method did you use during your installation?
Hi rON yes i am install venv and found the path /opt/mailman/mm/archives/hyperkitty/spool/75774848.12344400409.pck now how should i confirm that there is any data available in this file because i check in mailmanweb DB in hyperkitty_email table there is no data over there Thanks
On July 14, 2025 1:04:37 PM EDT, Asif Muzammil via Mailman-users <mailman-users@mailman3.org> wrote:
Hi rON yes i am install venv and found the path /opt/mailman/mm/archives/hyperkitty/spool/75774848.12344400409.pck now how should i confirm that there is any data available in this file because i check in mailmanweb DB in hyperkitty_email table there is no data over there
Those .pck files are messages queued for delivery to hyperkitty. They are actually retried on each new post. Once you fix the underlying issue, they will be delivered to hyperkitty.
-- Mark Sapiro <mark@msapiro.net> Sent from my Not_an_iThing with standards compliant, open source software.
On 7/14/25 5:57 AM, Asif Muzammil via Mailman-users wrote:
Hi Mark
but in my server there is no directory located at var/archives/hyperkitty/spool/, i can see the spool /var/maliman/spool and there is no files in it So what should I do?
I'm not certain where these are in the Debian package, but I think Debian uses the fhs layout in which case that directory is /var/lib/mailman/archives/hyperkitty/spool/ and Mailman's logs are in /var/log/mailman/.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Asif Muzammil via Mailman-users writes:
but in my server there is no directory located at var/archives/hyperkitty/spool/, i can see the spool /var/maliman/spool and there is no files in it
"var" with no leading slash "/" means the Mailman var_dir. You often can find this set in the mailman.cfg file, usually in /etc/mailman3.
If that's no help. please post your mailman.cfg file so we can figure out how your site is set up.
Steve
-- GNU Mailman consultant (installation, migration, customization) Sirius Open Source https://www.siriusopensource.com/ Software systems consulting in Europe, North America, and Japan
Hi Mark,
i have spool data at /opt/mailman/mm/var/archives/hyperkitty/spool/ some files available 17375475,38829901003948757.pck so now what to do with this? Please give me guideline now what do next? Thanks
On July 14, 2025 11:44:56 AM EDT, Asif Muzammil via Mailman-users <mailman-users@mailman3.org> wrote:
Hi Mark,
i have spool data at /opt/mailman/mm/var/archives/hyperkitty/spool/ some files available 17375475,38829901003948757.pck so now what to do with this? Please give me guideline now what do next?
Find the relevant errors and tracebacks in /opt/mailman/mm/var/logs/mailman.log. If those aren't sufficient for you to understand and fix the issue, post one exception and traceback here and we will help.
-- Mark Sapiro <mark@msapiro.net> Sent from my Not_an_iThing with standards compliant, open source software.
participants (4)
-
Asif Muzammil -
Mark Sapiro -
Ron -
Stephen J. Turnbull