I back up my server using "borg" to send it to a different server. I keep 7 dailies, 4 weeklies and 6 monthlies. When I used Mailman 2, my borg backup size stabilized and never seemed to grow much. But since switching to Mailman 3, my backup size has been growing, seemingly without bounds, even though the amount of disk space I'm using on the Mailman server isn't growing much. I suspect this might be because of the way it's storing stuff in PostgreSQL instead of in the file system is fooling borg's deduplication methodology. Does anybody else have any experience with borg and Mailman 3? Should I exclude postgreSQL from the backup and do a separate pg_dumpall?
-- Paul Tomblin
Paul Tomblin via Mailman-users writes:
I back up my server using "borg" to send it to a different server. I keep 7 dailies, 4 weeklies and 6 monthlies. When I used Mailman 2, my borg backup size stabilized and never seemed to grow much. But since switching to Mailman 3, my backup size has been growing, seemingly without bounds,
Do your lists enable archives? If so and you're using HyperKitty, the archives are also stored in Postgres. Depending on whether you backed up archives in Mailman 2 and whether that was conceptually part of your Mailman backup (vs your website backup, for example), that could explain some of a size difference, though I don't see offhand how it would explain consistent growth since conceptually mail archives are append only.
How long have you been using this system with Mailman 3? I can't imagine that it's going to grow without bound for very long (but if you have been observing Mailman 3 for 6 months and it's still growing linearly I'd revise that guess). The question in my mind for now is how big might it get.
even though the amount of disk space I'm using on the Mailman server isn't growing much.
I suspect that because Mailman 3 is storing things in tables that can cut across lists, many of them with small records (indexes and relations), the segments that borg detects and deduplicates are going to be smaller than Mailman 2. So borg's deduplication algorithm just isn't going to work well no matter what you do. I think you will find the size of the incremental backups will stabilize but substantially larger than the Mailman 2 backups. Also, Mailman 3 does keep more data (the User and Address databases) than Mailman 2 did.
Should I exclude postgreSQL from the backup and do a separate pg_dumpall?
I would expect that to result in a larger backup than you're seeing now, even with compression.
-- GNU Mailman consultant (installation, migration, customization) Sirius Open Source https://www.siriusopensource.com/ Software systems consulting in Europe, North America, and Japan
On Fri, May 29, 2026, at 1:09 AM, Stephen J. Turnbull wrote:
How long have you been using this system with Mailman 3? I can't imagine that it's going to grow without bound for very long (but if you have been observing Mailman 3 for 6 months and it's still growing linearly I'd revise that guess). The question in my mind for now is how big might it get.
I backup the full server at a time, not just mailman or the web server separately. I’ve been running Mailman 3 on it since January. The current disk use of my entire server is around 35 Gb. The borg backup is somewhere around 600 Gb. The old borg backup when I was using Mailman 2 was less than 100 Gb (based on the fact that the partition I’m backing up into was smaller than that - after switching, I’ve been doing an lvresize of it every week or so.)
-- Paul Tomblin
participants (2)
-
Paul Tomblin -
Stephen J. Turnbull