Hi Joel, have you changed your DATABASES setting at all? I have a guess at
what the issue may be, but it would be best to start with knowing exactly
what is in your settings.py and settings_local.py files for databases
(excluding passwords of course).
On Sat, Apr 20, 2019 at 8:12 PM Joel Aldor <joel.al...@gmail.com> wrote:
> Hi Adam,
>
> OK, so I found out that the subsequent runs of the export_resources
> command gave me which libraries are missing, and I installed rdflib and
> SPARQLWrapper via pip. Now I tried to run again the command and it gives me
> this info:
>
> (ENV4)ubuntu@PHMARCHES3PROD:~/Projects/phmapp312test$ python manage.py
> packages -o export_resources -d v3fullexport.json
> operation: export_resources
> package: phmapp312test
> Writing 5290 HERITAGE_RESOURCE.E18 resources
> relation "strings" does not exist
> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ...
> ^
> : 5274
> Writing 3712 INFORMATION_RESOURCE.E73 resources
> relation "strings" does not exist
> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ...
> ^
> : 3712
> Writing 2 ACTIVITY.E7 resources
> relation "strings" does not exist
> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ...
> ^
> : 2
> Writing 4 HISTORICAL_EVENT.E5 resources
> relation "strings" does not exist
> LINE 1: SELECT "strings"."entityid", "strings"."val" FROM "strings" ...
> ^
> : 4
> Writing 7 HERITAGE_RESOURCE_GROUP.E27 resources
> relation "domains" does not exist
> LINE 1: SELECT "domains"."entityid", "domains"."val" FROM "domains" ...
> ^
> : 6
> Writing 8 ACTOR.E39 resources
> relation "rules" does not exist
> LINE 1: ...les"."entitytyperange", "rules"."propertyid" FROM "rules" WH...
> ^
> : 8
>
> The subsequent v3fullexport.json file has more strings, but most of it has
> "null" on it:
>
> {"resources":[{"form_groups":null,"child_entities":[],"label":"","value":
> "","entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "70576571-58f2-4922-aac4-3033cd724a15","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "216a290b-9bc6-4a3c-8066-7e0b776a4b6d","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "fc2a1c29-0d5e-44c9-b7ff-73fd3f3712ba","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "5470886e-92da-48c8-9e7e-0cb9f6a0f3cf","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "a67a5cb7-57e6-4d61-8d13-6bf27e327dab","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "188c9c73-242c-4dba-bebb-d72f7924303d","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "9dc90525-2f98-493e-97b9-73b9234defbe","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "56e375cf-3ff7-47fd-a198-15dcd107d984","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "30cc57e1-0425-48a6-9ee3-a2445a93d6a9","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "bfd47a61-4f6f-49ca-ad35-33c5a8e148b2","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "a396985d-79d2-426a-be2e-c170d2e4ca34","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "6ed80815-33d2-4dff-a39c-451126529756","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "92c85fd4-f41f-4464-a6f3-4ac907951de8","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "dec01562-3061-43e3-819c-f33f3da1b02f","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "671c624b-bb2e-47d4-ac70-3938314f8781","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE.E18","entityid":
> "20c362a4-e7d1-4fe1-995a-9151fefa9921","property":"","businesstablename":
> ""},{"form_groups":null,"child_entities":[],"label":"","value":"",
> "entitytypeid":"HERITAGE_RESOURCE_GROUP.E27","entityid":
> "9a003427-6a66-4283-b420-6a5744d7cfb9","property":"","businesstablename":
> ""}]}
>
> Not sure at this point what to do next. Please let me know what to look
> further.
>
> Thanks,
>
> Joel
>
> On Sunday, April 21, 2019 at 9:01:39 AM UTC+8, Joel Aldor wrote:
>>
>> Hi Adam,
>>
>> Tried installing Pillow, version installed is 6.0.0. Then I ran the
>> export_resources command again. Still produced the same export files with
>> empty resources file.
>>
>> Regards,
>>
>> Joel
>>
>> On Sunday, April 21, 2019 at 8:50:38 AM UTC+8, Adam Cox wrote:
>>>
>>> Hi Joel, if you have the new virtual environment activated you want have
>>> to change the settings file at all.
>>>
>>> The PIL error indicates that that python library (and potentially
>>> others) didn't install correctly... Not sure why. You could try pip
>>> installing PIL. I can't look it up right now but it may be actually be
>>> called Pillow in pip.
>>>
>>> Adam
>>>
>>> On Sat, Apr 20, 2019, 7:37 PM Joel Aldor <joel...@gmail.com> wrote:
>>>
>>>> Hi Adam,
>>>>
>>>> I'd like to think we need to explicitly point the settings.py to our
>>>> phm2app instance in order for the export_resources command to run properly,
>>>> but I'm not sure which parts I will need to edit, apart from the DATABASES
>>>> settings. You think this might be the problem?
>>>>
>>>> Regards,
>>>>
>>>> Joel
>>>>
>>>> On Sunday, April 21, 2019 at 8:25:41 AM UTC+8, Joel Aldor wrote:
>>>>>
>>>>> Hi Adam,
>>>>>
>>>>> I tried to install arches v3.1.2 and pointed the instance into our
>>>>> existing database on settings.py, then I ran the export_resources command,
>>>>> which produced those export files. However, the console update gave me
>>>>> this
>>>>> info:
>>>>>
>>>>> (ENV4)ubuntu@PHMARCHES3PROD:~/Projects/phmapp312test$ python manage.py
>>>>> packages -o export_resources -d v3fullexport.json
>>>>> operation: export_resources
>>>>> package: phmapp312test
>>>>> Writing 5290 HERITAGE_RESOURCE.E18 resources
>>>>> No module named PIL : 5290
>>>>> Writing 3712 INFORMATION_RESOURCE.E73 resources
>>>>> No module named PIL : 3712
>>>>> Writing 2 ACTIVITY.E7 resources
>>>>> No module named PIL : 2
>>>>> Writing 4 HISTORICAL_EVENT.E5 resources
>>>>> No module named PIL : 4
>>>>> Writing 7 HERITAGE_RESOURCE_GROUP.E27 resources
>>>>> No module named PIL : 7
>>>>> Writing 8 ACTOR.E39 resources
>>>>> No module named PIL : 8
>>>>>
>>>>> When I checked the v3fullexport.json file it was almost empty. All it
>>>>> has inside the file is this string:
>>>>>
>>>>> {"resources":[]}
>>>>>
>>>>> The v3fullexport.relations file is full of all the relationships.
>>>>>
>>>>> I have a feeling I might be missing something here. Please let me know
>>>>> what I should do further. Thank you.
>>>>>
>>>>> Regards,
>>>>>
>>>>> Joel
>>>>>
>>>>>
>>>>> On Saturday, April 20, 2019 at 8:59:12 PM UTC+8, Adam Cox wrote:
>>>>>>
>>>>>> Hi Joel, indeed, exporting the v3 resources is a crucial step in the
>>>>>> migration process!!
>>>>>>
>>>>>> I'm unable to look into this deeply right now but I have a feeling
>>>>>> that this means you don't have the latest version of Arches 3, which is
>>>>>> 3.1.2. When I can, I'll look back through the version history and see
>>>>>> where
>>>>>> that command was introduced.
>>>>>>
>>>>>> I'm the meantime, you could create a new virtual environment and
>>>>>> explicitly install arches 3.1.2 into that environment with
>>>>>>
>>>>>> pip install arches==3.1.2
>>>>>>
>>>>>> Then activate that new environment and try exporting again. This
>>>>>> would leave your old env untouched.
>>>>>>
>>>>>> Adam
>>>>>>
>>>>>> On Sat, Apr 20, 2019, 6:23 AM Joel Aldor <joel...@gmail.com> wrote:
>>>>>>
>>>>>>> Hi all,
>>>>>>>
>>>>>>> We're supposed to migrate our v3 data into v4 this Easter weekend using
>>>>>>> the instructions from this link
>>>>>>> <https://arches.readthedocs.io/en/stable/exporting-v3-data/>, but
>>>>>>> we ran into a problem. Apparently, our v3 instance doesn't have the
>>>>>>> export_resources option when we execute this command:
>>>>>>>
>>>>>>> (ENV)ubuntu@PHMARCHES3PROD:~/Projects/phm2app$ python manage.py
>>>>>>> packages -o export_resources -d v3fullexport.json
>>>>>>> Usage: manage.py packages [options]
>>>>>>>
>>>>>>> manage.py: error: option -o: invalid choice: 'export_resources' (choose
>>>>>>> from 'setup', 'install', 'setup_db', 'start_elasticsearch',
>>>>>>> 'setup_elasticsearch', 'build_permissions', 'livereload',
>>>>>>> 'load_resources', 'remove_resources', 'load_concept_scheme',
>>>>>>> 'index_database', 'export_resource_graphs')
>>>>>>>
>>>>>>> How can I export the business data from here?
>>>>>>>
>>>>>>> Thank you,
>>>>>>>
>>>>>>> Joel
>>>>>>>
>>>>>>> --
>>>>>>> -- To post, send email to arches...@googlegroups.com. To
>>>>>>> unsubscribe, send email to arches...@googlegroups.com. For more
>>>>>>> information, visit
>>>>>>> https://groups.google.com/d/forum/archesproject?hl=en
>>>>>>> ---
>>>>>>> You received this message because you are subscribed to the Google
>>>>>>> Groups "Arches Project" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>> send an email to arches...@googlegroups.com.
>>>>>>> For more options, visit https://groups.google.com/d/optout.
>>>>>>>
>>>>>> --
>>>> -- To post, send email to arches...@googlegroups.com. To unsubscribe,
>>>> send email to arches...@googlegroups.com. For more information, visit
>>>> https://groups.google.com/d/forum/archesproject?hl=en
>>>> ---
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Arches Project" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to arches...@googlegroups.com.
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
--
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send
email to archesproject+unsubscr...@googlegroups.com. For more information,
visit https://groups.google.com/d/forum/archesproject?hl=en
---
You received this message because you are subscribed to the Google Groups
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
