Hi,
I would like to migrate my current Mailman3.1/Hyperkitty data to a fresh install in Mailman3.2.
I didn't found how migrate the archives. From : HyperKitty - Version: 1.1.1 - Python2.7 To : HyperKitty - Version: 1.2.1 - Python3.5
I exported a mbox from hyperkitty (web interface) and tried to re-import it, without result. """""""""""""""""""""""""""""""""""""""" xxxx @xxxxxx :/opt/mailman# python3.5 manage.py hyperkitty_import -l listedetests@hatlab.fr /home/admin/listedetests@hatlab.fr.mbox.gz
Importing from mbox file /home/admin/listedetests@hatlab.fr.mbox.gz to listedetests@hatlab.fr Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the 'manage.py update_index_one_list listedetests@hatlab.fr' command. """""""""""""""""""""""""""""""""""""" The database stay empty (and web interface): """""""""""""""""""""""""""""""""""""" mailmandbnameprod=# select * from hyperkitty_email; id | message_id | message_id_hash | subject | content | date | timezone | in_reply_to | archived_date | thread_depth | thread_order | mailinglist_id | parent_id | sender_id | thread_id | sender_name ----+------------+-----------------+---------+---------+------+----------+-------------+---------------+--------------+--------------+----------------+-----------+-----------+-----------+------------- (0 rows) """"""""""""""""""""""""""""""""""""""
Any idea to do this importation ?
Thanks !
Sorry for the top post!
You don't have to do the export import thing, you just need to delete the index for fulltext search, which is typically in a directory alongside your settings.py called "fulltext_index" ( not 100% on the name of directory). After that you need to build your index (python manag.py rebuild_index) for the search to work.
thanks, Abhilash
On Sun, Sep 30, 2018, at 11:42 PM, Thomas G wrote:
Hi,
I would like to migrate my current Mailman3.1/Hyperkitty data to a fresh install in Mailman3.2.
I didn't found how migrate the archives. From : HyperKitty - Version: 1.1.1 - Python2.7 To : HyperKitty - Version: 1.2.1 - Python3.5
I exported a mbox from hyperkitty (web interface) and tried to re-import it, without result. """""""""""""""""""""""""""""""""""""""" xxxx @xxxxxx :/opt/mailman# python3.5 manage.py hyperkitty_import -l listedetests@hatlab.fr /home/admin/listedetests@hatlab.fr.mbox.gz
Importing from mbox file /home/admin/listedetests@hatlab.fr.mbox.gz to listedetests@hatlab.fr Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the 'manage.py update_index_one_list listedetests@hatlab.fr' command. """""""""""""""""""""""""""""""""""""" The database stay empty (and web interface): """""""""""""""""""""""""""""""""""""" mailmandbnameprod=# select * from hyperkitty_email; id | message_id | message_id_hash | subject | content | date | timezone | in_reply_to | archived_date | thread_depth | thread_order | mailinglist_id | parent_id | sender_id | thread_id | sender_name ----+------------+-----------------+---------+---------+------ +----------+-------------+---------------+--------------+-------------- +----------------+-----------+-----------+-----------+------------- (0 rows) """"""""""""""""""""""""""""""""""""""
Any idea to do this importation ?
Thanks !
Mailman-users mailing list -- mailman-users@mailman3.org To unsubscribe send an email to mailman-users-leave@mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/
-- thanks, Abhilash Raj (maxking)
On 09/30/2018 11:42 PM, Thomas G wrote:
Hi,
I would like to migrate my current Mailman3.1/Hyperkitty data to a fresh install in Mailman3.2.
I didn't found how migrate the archives.
From : HyperKitty - Version: 1.1.1 - Python2.7 To : HyperKitty - Version: 1.2.1 - Python3.5
As Abhilash said, you shouldn't need to migrate anything but the search index.
I exported a mbox from hyperkitty (web interface) and tried to re-import it, without result. """""""""""""""""""""""""""""""""""""""" xxxx @xxxxxx :/opt/mailman# python3.5 manage.py hyperkitty_import -l listedetests@hatlab.fr /home/admin/listedetests@hatlab.fr.mbox.gz
Importing from mbox file /home/admin/listedetests@hatlab.fr.mbox.gz to listedetests@hatlab.fr
You can't import a gzipped mbox. You have to gunzip it.
Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the 'manage.py update_index_one_list listedetests@hatlab.fr' command. """""""""""""""""""""""""""""""""""""" The database stay empty (and web interface): """""""""""""""""""""""""""""""""""""" mailmandbnameprod=# select * from hyperkitty_email; id | message_id | message_id_hash | subject | content | date | timezone | in_reply_to | archived_date | thread_depth | thread_order | mailinglist_id | parent_id | sender_id | thread_id | sender_name ----+------------+-----------------+---------+---------+------+----------+-------------+---------------+--------------+--------------+----------------+-----------+-----------+-----------+------------- (0 rows) """"""""""""""""""""""""""""""""""""""
Any idea to do this importation ?
Why is the database empty? It should be as it was with the prior HyperKitty.
Also, it doesn't seem to be the issue here, but if you don't specify a --since option to hyperkitty_import, it won't import any messages older than the most recent message in the existing archive. i.e., if there are any messages in the existing archive, the default for --since is the date of the most recent such message.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Hi,
It's a complete migration, not just a upgrade. I rebuild every things on the new server, without data transfers (mailman data dir) other than archives.
"" You can't import a gzipped mbox. You have to gunzip it. "" Omfg, yes indeed, it's work better... I have just a problem with statistics not available.
"" it won't import any messages older than the most recent message in the existing archive "" It should be not a problem. I will do a dead time to process this change.
Stop prod / migrate archives / start prod on new server.
Thanks,
Thomas.
Le mar. 2 oct. 2018 à 05:11, Mark Sapiro <mark@msapiro.net> a écrit :
On 09/30/2018 11:42 PM, Thomas G wrote:
Hi,
I would like to migrate my current Mailman3.1/Hyperkitty data to a fresh install in Mailman3.2.
I didn't found how migrate the archives.
From : HyperKitty - Version: 1.1.1 - Python2.7 To : HyperKitty - Version: 1.2.1 - Python3.5
As Abhilash said, you shouldn't need to migrate anything but the search index.
I exported a mbox from hyperkitty (web interface) and tried to re-import it, without result. """""""""""""""""""""""""""""""""""""""" xxxx @xxxxxx :/opt/mailman# python3.5 manage.py hyperkitty_import -l listedetests@hatlab.fr /home/admin/listedetests@hatlab.fr.mbox.gz
Importing from mbox file /home/admin/listedetests@hatlab.fr.mbox.gz to listedetests@hatlab.fr
You can't import a gzipped mbox. You have to gunzip it.
Computing thread structure Synchronizing properties with Mailman Warming up cache The full-text search index is not updated for this list. It will not be updated by the 'minutely' incremental update job. To update the index for this list, run the 'manage.py update_index_one_list listedetests@hatlab.fr' command. """""""""""""""""""""""""""""""""""""" The database stay empty (and web interface): """""""""""""""""""""""""""""""""""""" mailmandbnameprod=# select * from hyperkitty_email; id | message_id | message_id_hash | subject | content | date | timezone | in_reply_to | archived_date | thread_depth | thread_order | mailinglist_id | parent_id | sender_id | thread_id | sender_name
----+------------+-----------------+---------+---------+------+----------+-------------+---------------+--------------+--------------+----------------+-----------+-----------+-----------+-------------
(0 rows) """"""""""""""""""""""""""""""""""""""
Any idea to do this importation ?
Why is the database empty? It should be as it was with the prior HyperKitty.
Also, it doesn't seem to be the issue here, but if you don't specify a --since option to hyperkitty_import, it won't import any messages older than the most recent message in the existing archive. i.e., if there are any messages in the existing archive, the default for --since is the date of the most recent such message.
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Mailman-users mailing list -- mailman-users@mailman3.org To unsubscribe send an email to mailman-users-leave@mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/
On 10/03/2018 02:30 AM, Thomas G wrote:
I have just a problem with statistics not available.
If cron is running all the periodic django jobs, this gets fixed eventually. The one thing you may need to run manually is
manage.py runjob thread_order_depth
as that helps with some things and is a 'yearly' job. I think the 'hourly' and 'daily' jobs fix most other issues. See
manage.py runjob --list
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
I tried all job, without result. (and they are correctly in the crontab)
[image: image.png]
If I try to find my list in the form, hyperkitty can find it:
[image: image.png]
Le mer. 3 oct. 2018 à 17:59, Mark Sapiro <mark@msapiro.net> a écrit :
On 10/03/2018 02:30 AM, Thomas G wrote:
I have just a problem with statistics not available.
If cron is running all the periodic django jobs, this gets fixed eventually. The one thing you may need to run manually is
manage.py runjob thread_order_depth
as that helps with some things and is a 'yearly' job. I think the 'hourly' and 'daily' jobs fix most other issues. See
manage.py runjob --list
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Mailman-users mailing list -- mailman-users@mailman3.org To unsubscribe send an email to mailman-users-leave@mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/
On 10/04/2018 03:49 AM, Thomas G wrote:
I tried all job, without result. (and they are correctly in the crontab)
[image: image.png]
If I try to find my list in the form, hyperkitty can find it:
[image: image.png]
Since you are a gmail user, you probably didn't see that content filtering removed your screen shots, but see your post at <https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message/NFGQ5U5UC5P4VH7IY3VX2IWCVM7ACGFR/>.
I did in fact see your screen shots in my direct copy, but I am unable to determine what your issue is except there may be some domain confusion between mailing.hatlab.fr and hatlab.fr. Are your list settings set for Public archives and hyperkitty active?
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Indeed, it was a domain problem. hatlab.fr is the general domain, mailing, the website to manage our mailinglist. And in this case "FILTER_VHOST" have to be switch on "False". Fixed !
Thanks .
Le jeu. 4 oct. 2018 à 23:21, Mark Sapiro <mark@msapiro.net> a écrit :
On 10/04/2018 03:49 AM, Thomas G wrote:
I tried all job, without result. (and they are correctly in the crontab)
[image: image.png]
If I try to find my list in the form, hyperkitty can find it:
[image: image.png]
Since you are a gmail user, you probably didn't see that content filtering removed your screen shots, but see your post at < https://lists.mailman3.org/archives/list/mailman-users@mailman3.org/message/...
.
I did in fact see your screen shots in my direct copy, but I am unable to determine what your issue is except there may be some domain confusion between mailing.hatlab.fr and hatlab.fr. Are your list settings set for Public archives and hyperkitty active?
-- Mark Sapiro <mark@msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan
Mailman-users mailing list -- mailman-users@mailman3.org To unsubscribe send an email to mailman-users-leave@mailman3.org https://lists.mailman3.org/mailman3/lists/mailman-users.mailman3.org/
participants (3)
-
Abhilash Raj -
Mark Sapiro -
Thomas G