----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70768/ -----------------------------------------------------------
(Updated June 14, 2019, 9:21 a.m.) Review request for atlas, Ashutosh Mestry, madhan, Nixon Rodrigues, and Sarath Subramanian. Changes ------- Added Perfomance improvement numbers Bugs: ATLAS-3256 https://issues.apache.org/jira/browse/ATLAS-3256 Repository: atlas Description (updated) ------- Please refer jira for description Perfomance improvement numbers with new extract strategy: ##Baseline Full export: #1 Number of entities: 12342 Duration: 93 secs Full export: #2 Number of entities: 25703 Duration: 245 secs ##Optimization: Full export: #1 Number of entities: 12342 Duration: 82 secs Improvement: 12% Full export: #2 Number of entities: 25703 Duration: 185 secs Improvement: 24% Diffs ----- repository/src/main/java/org/apache/atlas/repository/impexp/EntitiesExtractor.java PRE-CREATION repository/src/main/java/org/apache/atlas/repository/impexp/ExportService.java 11289ea repository/src/main/java/org/apache/atlas/repository/impexp/ExtractStrategy.java PRE-CREATION repository/src/main/java/org/apache/atlas/repository/impexp/IncrementalExportEntityProvider.java 3a2a917 repository/src/main/java/org/apache/atlas/repository/impexp/RelationshipAttributesExtractor.java PRE-CREATION repository/src/main/java/org/apache/atlas/repository/impexp/VertexExtractor.java PRE-CREATION repository/src/test/java/org/apache/atlas/repository/impexp/IncrementalExportEntityProviderTest.java 85ed5f9 repository/src/test/java/org/apache/atlas/repository/impexp/RelationshipAttributesExtractorTest.java PRE-CREATION repository/src/test/resources/hive_db_lineage.zip PRE-CREATION Diff: https://reviews.apache.org/r/70768/diff/3/ Testing ------- Added UTs Test cases are passing Manual testing approach: 1. exported data > data1.zip 2. cleaned hbase & solr 3. imported data1.zip & verified imported data 4. exported again > data2.zip 5. compared contents of data1.zip & data2.zip Thanks, Nikhil Bonte