Hi Alexei, thanks for your detailed indications!
Indeed there were errors in our imported graph (missing node and edges). We hadn't imported our latest version:-( After correcting these errors our legacy data seems to get imported into Arches: install_packages.sh runs through and tells "successfully_saved" for all sites However, when calling Arches in the browser now the "Initializing..." window gets stuck with the following JS errors: TypeError: Arches.config.App.primaryNameInfo is null ...Column1' : 'Name','additembuttontext' : 'Add Name','missingTypeInvalidMsg' : 'Al... en-us.js (line 27) TypeError: Arches.forms.OrganizationName is undefined ...Column1' : 'Name','additembuttontext' : 'Add Name','missingTypeInvalidMsg' : 'Al... en-us.js (line 27) TypeError: Arches.i18n.MapLayers is undefined data: Arches.i18n.MapLayers.basemaps Arches...ctor.js (line 51) Running build.sh again doesn't help. Which script builds the en-us.js? Could you send us a default version of this file? Ours should be the default version, but we have touched it in the past (not line 27). Any other ideas here? Thanks! -Tobias 2014-04-16 22:28 GMT+02:00 Alexei Peters <apet...@fargeo.com>: > Hi Tobias, > I suspect some issue with the schema(essentially the db version of the > resource graph). > > Looking at the error, try this: > > Open a browser and point it to this endpoint (make sure runserver is > running): > Arches/EntityTypes/ARCHAEOLOGICAL HERITAGE (SITE).E27?f=json > > I'll spit out a json representation of your ARCHAEOLOGICAL HERITAGE (SITE).E27 > resource graph. > I'm guessing that it's somehow incomplete (maybe missing some key > Entitytypes) > You should see a top level node called ARCHAEOLOGICAL HERITAGE (SITE).E27 > followed by sub nodes that define the Entitytypes that actually collect > business data (like PLACE_CADASTRAL REFERENCE.E53). > Below that you should see a "steps" node. This node defines all the > intermediate nodes that need to be created from root to leaf in order to > create a valid branch within the graph. > > If you're missing entitytypes like PLACE_CADASTRAL REFERENCE.E53 then > somehow the graph didn't get imported into the system correctly. > If you look in the install directory of your package you should see a file > called resource_graphs.py and in that a method call "load_graphs". It's > that method that get's called to parse and load the csv files that define > your graphs. > I would start looking there for potential issues. > > Cheers > Alexei > > > Director of Web Development - Farallon Geographics, Inc. - 971.227.3173 > > > On Tue, Apr 15, 2014 at 9:12 AM, Tobias Kohr <tobiask...@gmail.com> wrote: > >> Hi Alexei, >> >> if we don't limit the list of resource types in settings.py, we are still >> stuck when running install_packages.sh with a different error: >> >> >> Traceback (most recent call last): >> File "../manage.py", line 28, in <module> >> execute_from_command_line(sys.argv) >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >> line 399, in execute_from_command_line >> utility.execute() >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >> line 392, in execute >> self.fetch_command(subcommand).run_from_argv(self.argv) >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >> line 242, in run_from_argv >> self.execute(*args, **options.__dict__) >> File >> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >> line 285, in execute >> output = self.handle(*args, **options) >> File "/arches-web/archesproject/build/management/commands/packages.py", >> line 41, in handle >> self.load_package(package) >> File "/arches-web/archesproject/build/management/commands/packages.py", >> line 46, in load_package >> install(settings.ROOT_DIR) >> File "/arches-web/archesproject/packages/i3mainz/setup.py", line 77, in >> install >> test_data.DataLoader().load(filepath) >> File "/arches-web/archesproject/db/Data/load_from_csv.py", line 95, in >> load >> return self.resourceListToEntities(resourceList) >> File "/arches-web/archesproject/db/Data/load_from_csv.py", line 123, in >> resourceListToEntities >> entity.create_from_mapping(row.resourcetype, >> schema[row.attributename]['steps'], row.attributename, row.attributevalue) >> KeyError: 'PLACE_CADASTRAL REFERENCE.E53' >> >> The odd underscore/no underscore syntax is consistent with the syntax in >> the files defining the graph. >> The error is provoked by an import csv that looks like this (first site): >> >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF.E42|1|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF >> TYPE.E55|EXTERNAL_XREF_TYPE_1000|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF.E42|853|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF >> TYPE.E55|EXTERNAL_XREF_TYPE_1001|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF.E42|5|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|EXTERNAL XREF >> TYPE.E55|EXTERNAL_XREF_TYPE_2000|MONUMENT:1 >> 1|ARCHAEOLOGICAL HERITAGE >> (SITE).E27|ADDRESS_TOWN/CITY.E45|ALBACH|ADDRESS-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|COMPILER.E82|FETSCH|COMPILER.E82-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|NAME TYPE.E55|NAME_TYPE_1|NAME.E41-1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|NAME.E41|Albach|NAME.E41-1 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|SPATIAL >> COORDINATES_GEOMETRY.E47|POINT (8.79912945 50.55867308)|SPATIAL >> COORDINATES_GEOMETRY.E47-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|PLACE_CADASTRAL >> REFERENCE.E53|Reutereck|PLACE_CADASTRAL REFERENCE.E53-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|GEOMETRY >> QUALIFIER.E55|GEOMETRY_QUALIFIER_1000|SPATIAL COORDINATES_GEOMETRY.E47-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|INVESTIGATION >> TYPE.E55|INVESTIGATION_TYPE_2_1_3|INVESTIGATION TYPE.E55-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|ARCHAEOLOGICAL COMPONENT >> TYPE.E55|ARCHAEOLOGICAL_COMPONENT_ARCHAEOLOGICAL_COMPONENT_2100|COMPONENT.E18-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|COMPONENT CERTAINTY >> TYPE.E55|COMPONENT_CERTAINTY_1|COMPONENT.E18-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|CULTURAL >> PERIOD.E55|PERIOD_1310213|PHASE TYPE ASSIGNMENT.E17-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|PHASE TYPE ASSIGNMENT CERTAINTY >> TYPE.E55|PHASE_TYPE_ASSIGNMENT_CERTAINTY_2|PHASE TYPE ASSIGNMENT.E17-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|ARCHAEOLOGICAL HERITAGE (SITE) >> TYPE.E55|SITE_7|PHASE TYPE ASSIGNMENT.E17-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|SCIENTIFIC DATING >> METHOD.E55|DATING_10002|SCIENTIFIC DATING EVENT.E5-0 >> 1|ARCHAEOLOGICAL HERITAGE (SITE).E27|SUMMARY.E62|Datierendes Material: ; >> |SUMMARY.E62-0 >> >> When we leave out the PLACE_CADASTRAL REFERENCE.E53 information, >> INVESTIGATION TYPE.E55 throws the same error. >> >> We haven't finished building all authority files for our graph. Is this >> the problem or should the import process already work beforehand? >> >> I don't understand why PLACE_CADASTRAL REFERENCE.E53 causes an error, as >> it is already included in the default graph and shouldn't be affected by >> the authority files. >> >> The third column in the import csv should contain the node's name/label, >> however, and not the ID, correct? (e.g. PLACE_CADASTRAL REFERENCE.E53 >> instead of ARCHAEOLOGICAL HERITAGE.E27:PLACE_CADASTRAL REFERENCE.E53) >> >> Thanks for your help! >> Tobias >> >> >> 2014-04-12 4:55 GMT+02:00 Alexei Peters <apet...@fargeo.com>: >> >> Hi Tobias, >>> You may have just found a bug that cropped up during the development of >>> version 2. I haven't had a chance to confirm myself buy I'll let the >>> community know what I find out. >>> Cheers, >>> Alexei >>> >>> Sent from my Windows Phone >>> ------------------------------ >>> From: Tobias Kohr <tobiask...@gmail.com> >>> Sent: 4/10/2014 6:36 AM >>> To: archesproject@googlegroups.com >>> Subject: [Arches] Re: Integrating modified Authority Documents >>> >>> OK, the error did not have anything to do with our modified Authority >>> Documents. >>> >>> It was caused by the entry to limit Resource Types in the global >>> settings.py: >>> LIMIT_ENTITY_TYPES_TO_LOAD = ( >>> # override this setting in your packages settings.py file >>> 'ARCHAEOLOGICAL HERITAGE (SITE).E27', >>> ) >>> >>> I guess this provokes inconsistencies when authority_files.py tries to >>> link data to the entities of the Resource Types that weren't loaded. Is >>> this correct? >>> >>> Putting the same entry in the settings.py of the package to overwrite >>> the global setting doesn't take any effect. Is there a different syntax >>> needed? >>> >>> Cheers, >>> Tobias >>> >>> >>> On Thursday, April 10, 2014 1:11:16 PM UTC+2, Tobias Kohr wrote: >>>> >>>> Dear Archeslist, >>>> >>>> we have extended the ARCHAEOLOGICAL HERITAGE (SITE).E27 Resource Type >>>> and defined our own vocabularies in the according Authority Files. >>>> >>>> (After running install_arches_db.sh and build.sh), install_packages.sh >>>> loads all Authority Files. However the function >>>> create_link_to_entity_types() in authority_files.py aborts with the >>>> following error: >>>> >>>> Traceback (most recent call last): >>>> File "../manage.py", line 28, in <module> >>>> execute_from_command_line(sys.argv) >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >>>> line 399, in execute_from_command_line >>>> utility.execute() >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/__init__.py", >>>> line 392, in execute >>>> self.fetch_command(subcommand).run_from_argv(self.argv) >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >>>> line 242, in run_from_argv >>>> self.execute(*args, **options.__dict__) >>>> File >>>> "/arches-web/archesproject/virtualenv/ENV/local/lib/python2.7/site-packages/django/core/management/base.py", >>>> line 285, in execute >>>> output = self.handle(*args, **options) >>>> File >>>> "/arches-web/archesproject/build/management/commands/packages.py", line 47, >>>> in handle >>>> self.load_package(package) >>>> File >>>> "/arches-web/archesproject/build/management/commands/packages.py", line 52, >>>> in load_package >>>> install(settings.ROOT_DIR) >>>> File "/arches-web/archesproject/packages/i3mainz/setup.py", line 60, >>>> in install >>>> authority_files.load_authority_files(package_settings.ROOT_DIR) >>>> File >>>> "/arches-web/archesproject/packages/i3mainz/install/authority_files.py", >>>> line 24, in load_authority_files >>>> create_link_to_entity_types(cursor, packagepath) >>>> File >>>> "/arches-web/archesproject/packages/i3mainz/install/authority_files.py", >>>> line 125, in create_link_to_entity_types >>>> entity_type = str(cursor.fetchone()[0]) >>>> TypeError: 'NoneType' object has no attribute '__getitem__' >>>> >>>> Any ideas what the cause for this could be? >>>> >>>> What does create_link_to_entity_types() / entity_type = >>>> str(cursor.fetchone()[0]) exactly do? >>>> >>>> Best, >>>> Tobias >>>> >>> -- >>> -- To post, send email to archesproject@googlegroups.com. To >>> unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. >>> For more information, visit >>> https://groups.google.com/d/forum/archesproject?hl=en >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Arches Project" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to archesproject+unsubscr...@googlegroups.com. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> > -- -- To post, send email to archesproject@googlegroups.com. To unsubscribe, send email to archesproject+unsubscr...@googlegroups.com. For more information, visit https://groups.google.com/d/forum/archesproject?hl=en --- You received this message because you are subscribed to the Google Groups "Arches Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to archesproject+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
