Where are the posts stored in the database? What tables? How would on go about exporting them into mbox format for the complete set?
On 4/17/20 10:23 PM, Andrew Bernard wrote:
Where are the posts stored in the database? What tables? How would on go about exporting them into mbox format for the complete set?
It depends on which archiver(s) if any are enabled for the list.
For the prototype archiver, messages are archived in Maildir format, <https://en.wikipedia.org/wiki/Maildir>, in the directory var/archives/prototype/<list-address>/
For Hyperkitty, messages are stored in the database in the hyperkitty_email table and non-plain text parts are in the hyperkitty_attachment table, but you don't need to know that because in any HyperKitty view, i.e. a message view, a thread view, a threads by month view ot an all threads view, there is a button to download all the messages in that view as a gzipped .mbox file.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On Sat, Apr 18, 2020, at 9:45 AM, Mark Sapiro wrote:
On 4/17/20 10:23 PM, Andrew Bernard wrote:
Where are the posts stored in the database? What tables? How would on go about exporting them into mbox format for the complete set?
It depends on which archiver(s) if any are enabled for the list.
For the prototype archiver, messages are archived in Maildir format, <https://en.wikipedia.org/wiki/Maildir>, in the directory var/archives/prototype/<list-address>/
For Hyperkitty, messages are stored in the database in the hyperkitty_email table and non-plain text parts are in the hyperkitty_attachment table, but you don't need to know that because in any HyperKitty view, i.e. a message view, a thread view, a threads by month view ot an all threads view, there is a button to download all the messages in that view as a gzipped .mbox file.
Emails from Hyperkitty are also available via a REST API endpoint. The documentation for it isn't much but you can build URL patterns by looking at:
https://lists.mailman3.org/archives/api/
As Mark above mentioned, you are also able to get an mbox file downloaded via API.
I wrote a small python utility to download archives from Hyperkitty to a local Maildir:
https://gitlab.com/mailman/hksync
But it is also possible to sync to a local mbox if need be. The tool just needs to be extended a little.
Although, if the need is to *only* have a mbox or maildir, you should avoid having the complicated Hyperkitty setup and instead use the prototype archiver that Mark mentioned above.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Mailman-users mailing list -- mailman-users@mailman3.org To unsubscribe send an email to mailman-users-leave@mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/
-- thanks, Abhilash Raj (maxking)
participants (3)
-
Abhilash Raj -
Andrew Bernard -
Mark Sapiro