Archive download - unexpected end of file
Hi,
I have a MM3 list to whose archive I recently added an mbox file of older emails.
Viewing/searching the archive (Hyperkitty) is working fine.
Downloading archives "for the month" or "last 30 days" delivers the expected ".mbox.gz" file and those are fine.
However, when I download the "Entire archive" and attempt to gunzip that ".mbox.gz" file I get the error: " ... unexpected end of file".
Or using Gnome desktop's "Extract", I get the error "..truncated gzip input"
Any tips on resolving this would be gratefully received.
Best, Mark
On 3/1/25 13:58, Mark wrote:
I have a MM3 list to whose archive I recently added an mbox file of older emails.
Viewing/searching the archive (Hyperkitty) is working fine.
Downloading archives "for the month" or "last 30 days" delivers the expected ".mbox.gz" file and those are fine.
However, when I download the "Entire archive" and attempt to gunzip that ".mbox.gz" file I get the error: " ... unexpected end of file".
The process creating the zip for download times out. You can increase the timeout. If your wsgi server is Gunicorn, see https://docs.gunicorn.org/en/stable/settings.html#timeout - for uwsgi see https://uwsgi-docs-additions.readthedocs.io/en/latest/Options.html#harakiri
However, it's probably easier to get it in pieces. You can prpbably get chunks bigger than a month. Look at the URL for a month, e.g. for Jun, 2005 it will be something like
The <fqdn-listname>-2025-02.mbox.gz can be any arbitrary file name. The start and end parameters determine what's included. E.g. for all of 2024
Note that the end date is the first date not included, i.e. the day after the last date included.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
On 3/1/25 13:58, Mark wrote:
I have a MM3 list to whose archive I recently added an mbox file of older emails.
Viewing/searching the archive (Hyperkitty) is working fine.
Downloading archives "for the month" or "last 30 days" delivers the expected ".mbox.gz" file and those are fine.
However, when I download the "Entire archive" and attempt to gunzip that ".mbox.gz" file I get the error: " ... unexpected end of file".
?On 2025-03-01 23:04, Mark Sapiro wrote:
The process creating the zip for download times out. You can increase the timeout. If your wsgi server is Gunicorn, see https://docs.gunicorn.org/en/stable/settings.html#timeout - for uwsgi see https://uwsgi-docs-additions.readthedocs.io/en/latest/Options.html#harakiri
However, it's probably easier to get it in pieces. You can prpbably get chunks bigger than a month. Look at the URL for a month, e.g. for Jun, 2005 it will be something like
The <fqdn-listname>-2025-02.mbox.gz can be any arbitrary file name. The start and end parameters determine what's included. E.g. for all of 2024
Note that the end date is the first date not included, i.e. the day after the last date included.
Thank you very much Mark, for your detailed advice.
Increasing the timeout from the default of 30 seconds to 360 now sees the entire archive downloading successfully.
# /etc/mailman3/gunicorn.conf # bind = ['127.0.0.1:8000'] proc_name = "mailman-web" chdir = "/opt/mailman/mm" pidfile = "/opt/mailman/mm/var/gunicorn.pid" accesslog = "/opt/mailman/mm/var/logs/access.log" errorlog = "/opt/mailman/mm/var/logs/error.log" #Added 2025-03-02 to resolve timeout on download full archive. timeout = 360
$ systemctl daemon-reload $ systemctl restart mailman3 $ systemctl restart mailmanweb
$ pstree ├─gunicorn───gunicorn ├─mailman-web───mailman-web─┬─mailman-web │ └─3*[mailman-web───{mailman-web}]
participants (2)
-
Mark -
Mark Sapiro