We should also mention that a few edits to the code were made before the
CSV importer worked. I have not submitted these changes in a Pull Request
yet, as I am still 100% certain that those changes are unrelated to the
problem described by Nathan. For reference, here is the diff to the code:
diff --git a/arches/app/utils/data_management/resources/formats/csvfile.py
b/arches/app/utils/data_management/resources/formats/csvfile.py
index dbecd9a..7a11e08 100644
--- a/arches/app/utils/data_management/resources/formats/csvfile.py
+++ b/arches/app/utils/data_management/resources/formats/csvfile.py
@@ -396,18 +396,18 @@ class CsvReader(Reader):
# return deepcopy(blank_tile)
return cPickle.loads(cPickle.dumps(blank_tile, -1))
- def check_required_nodes(tile, required_nodes, all_nodes):
+ def check_required_nodes(target_tile, required_nodes,
all_nodes):
# Check that each required node in a tile is populated.
errors = []
if len(required_nodes) > 0:
- if target_tile.data != {}:
- for target_k, target_v in
target_tile.data.iteritems():
+ if getattr(target_tile, 'data', None) != {}:
+ for target_k, target_v in getattr(target_tile,
'data', {}).iteritems():
if target_k in required_nodes.keys() and
target_v is None:
populated_tiles.pop(populated_tiles.index(target_tile))
errors.append({'type': 'WARNING',
'message': 'The {0} node is required and must be populated in order to
populate the {1} nodes. This data was not i
elif target_tile.tiles != None:
- for tile in tiles:
- check_required_nodes(tile)
+ for tile in target_tile.tiles:
+ check_required_nodes(tile, required_nodes,
all_nodes)
if len(errors) > 0:
self.errors += errors
On Wednesday, January 10, 2018 at 11:26:04 AM UTC-8, Nathan Lomeli wrote:
>
> Here's a Dropbox link to the files mentioned below:
>
> https://www.dropbox.com/sh/1wx9x4kdk5b7a33/AACqzIROyoT2R-03lAgXE-qta?dl=0
>
>
>
> We are performing a CSV resources import (for our "Person" model) using
> the included mapping file. Everything seems to be importing properly
> except for this pair of columns:
>
> *name_part_type name_part_value*
>
> In accordance with the CSV import formatting described in the Arches
> documention (link below), each new concept type and value appears on a new
> row.
>
>
> http://arches4.readthedocs.io/en/latest/import-export/#concept-values-in-csvs-and-the-concepts-file
>
> The import process seems to run successfully, but when we inspect the
> imported data, only the first concept-value pair has been loaded, not those
> on subsequent CSV rows for a given resource.
>
> We are not sure if this failure to load a list of concept-values is
> problem with the graph, our card settings, our import process, or the
> formatting of our CSV or mapping files.
>
> Our Arches graph data is included in order for the problem to be
> reproduced (again, see link to Dropbox above).
>
>
--
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send
email to archesproject+unsubscr...@googlegroups.com. For more information,
visit https://groups.google.com/d/forum/archesproject?hl=en
---
You received this message because you are subscribed to the Google Groups
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to archesproject+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
