----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47810/#review150227 -----------------------------------------------------------
repository/src/main/scala/org/apache/atlas/query/GremlinQuery.scala (line 489) <https://reviews.apache.org/r/47810/#comment218118> filter in Titan 0.5.4 doesnt use any index. Is it the same for Titan 1.0.0 ? Which types does this apply to - map, etc? - Suma Shivaprasad On Sept. 23, 2016, 3:29 a.m., Jeff Hagelberg wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/47810/ > ----------------------------------------------------------- > > (Updated Sept. 23, 2016, 3:29 a.m.) > > > Review request for atlas, David Kantor and Neeru Gupta. > > > Bugs: ATLAS-694 > https://issues.apache.org/jira/browse/ATLAS-694 > > > Repository: atlas > > > Description > ------- > > ATLAS-694: Update Atlas to use abstraction layer. All of the Atlas code > (with the exception of the catalog, which was only updated minimally) has > been updated to use the graph database abstraction layer. In addition, there > is now an optional Atlas configuration property that specifies the class of > the abstraction layer database to use. I basically put all of the changes in > here with the exception of the actual Titan 1 implementation of code. This > includes the changes to support Tinkerpop 3 syntax. This is mostly to > expedite getting the changes into Atlas. Originally the TP3 changes were > going to be brought in as part of the Titan 1 implementation task. > > Change Summary: > > - change Atlas classes to use AtlasGraph,AtlasVertex,AtlasEdge, etc > instead of TitanGraph/Vertex/Edge, etc > - compile time dependency on titan 0.5.4/TP 2 removed (except in Catalog, > which was only changed to use AtlasGraphProvider/AtlasGraph) - see > repository\pom.xml, other pom.xmls > - updated DSL translation to generate Gremlin that is compliant with TP3 > when TP3 is being used. See GremlinQuery.scala, > GraphPersistenceStrategies.scala > - TitanGraphProvider replaced by AtlasGraphProvider. Graph database > implementation is determined from a new optional configuration property > - HiveTitanSample is no longer used by tests. It has been replaced by > hive-instances.json (which uses normal Atlas json syntax). The data is saved > with a new JSONImporter class. This was needed because the graphson syntax > used by HiveTitanSample is not compatible with TP3. > > Last rebase: 9/22/2016 > > > Diffs > ----- > > .gitignore e10adbc4457f6297600f0feb01eb54718b8ec406 > addons/falcon-bridge/pom.xml 1365bd05a388dc92f7a56c7f7427b5b85f97c7da > addons/hdfs-model/pom.xml 492f39cea085c6e69781e17bcbdbc3a231806df3 > > addons/hdfs-model/src/test/java/org/apache/atlas/fs/model/HDFSModelTest.java > ac60294e328835ba0340e150799ddfb348ccdb52 > addons/hive-bridge/pom.xml 6993bdb938a6095ca24482e290393eeeb3911bcb > > addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java > ad7a4a5d09d8542a841701dfe04981f65f767c14 > addons/sqoop-bridge/pom.xml 8c9d278d43b5979ea1743d10845905c13249f8a6 > addons/storm-bridge/pom.xml 12c1208b448d456a923bd7309601174ddb561ba5 > catalog/pom.xml 2f58a8f0748de65ab78eab35df6abd2fe7c336af > catalog/src/main/java/org/apache/atlas/catalog/query/BaseQuery.java > e7bb505075983371ca12d9bc1d8c6eb240c3d134 > distro/src/conf/atlas-application.properties > d334600dc5534840409b586157799ef3abf9abf2 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasEdge.java > dd4b7e614cdd9bf30f957fb6a839d8c60f3e1701 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasElement.java > 1bc0fc38c0802897f32260520770a16795474d04 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraph.java > 995c5457ac7f807172f367cc8e3348b3a98dd6f3 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphIndex.java > 41194d34f079842db0d95c73a8b099459f76ff2f > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphManagement.java > c8cd2842ca3090b6bbd384c773b4eb45aff149ce > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraphQuery.java > 93447495bcf18e9f19df9df68fd1cbe1427fc462 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasIndexQuery.java > e719d306ffe9f68e3ac6f7406baaf60a12390c34 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasPropertyKey.java > 315ecddb861e1a1be6e0ab9b36fe4c0a52486ae8 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasVertex.java > fff6fb79247e7d0615ce83c4cbbd93d1bf8cf29c > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasVertexQuery.java > 366cfe131512f36c02f59ad7e969ff94dfb0e12c > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/GraphDatabase.java > 37acda5f6ddb883ee364d08a31251b071e6a89a5 > > graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/GremlinVersion.java > f328d3cb9d2b695bf0eb9981d7046bb67d0eac7d > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/NativeTitanGraphQuery.java > b79bf7964ae9c830cfa28b9f2f1a1a1059d67223 > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/NativeTitanQueryFactory.java > 5c654119a4292136e8ff935c34dd6e39741bffc1 > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/TitanGraphQuery.java > f23847a2f75c351ad307680d0642bc1da49fc59f > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/expr/AndCondition.java > f3996d939a0555128066d1a76a379d9320d884cd > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/expr/HasPredicate.java > 8d7bc15acd08124a7eddf0c52cc35af0ecbfafb7 > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/expr/InPredicate.java > 5a43a6aa7a061d2aa2da1703c03f90ecece4be83 > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/expr/OrCondition.java > 9de46556a06608ff425b4b7cc7c911116f9739ea > > graphdb/common/src/main/java/org/apache/atlas/repository/graphdb/titan/query/expr/QueryPredicate.java > 61c692f093e66ea60abaef7c6bfb98908e545260 > graphdb/graphdb-impls/pom.xml PRE-CREATION > graphdb/pom.xml ad3461741d42ae83b9d3306bfa4f632ecfc06f3b > > graphdb/titan0/src/main/java/com/thinkaurelius/titan/graphdb/query/graph/GraphCentricQueryBuilder.java > c1a983b80fedb5ac1a7060f0902bf94eb12dae98 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/GraphDbObjectFactory.java > 89de23d225c738bcb7f4f502315525af8fa26188 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Database.java > 56b16649df99dfb50a7abb45463efe400f91a4cf > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseManager.java > b4234d7321d43c8ff7fc247e895226848b6e256d > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Element.java > cacbaf8851c3513f634f0193954d249514ad69f7 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Graph.java > 51531edf21dd3877e9cb3ccadd545983443b8aa4 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0IndexQuery.java > 18f0be507db4fa263c41dde5a4e1413163f1d578 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0PropertyKey.java > 1f9f6ef786e38a66528189c47d5b147b13461859 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Vertex.java > b26ff040886c777f1892beb15f09a177f54ea279 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/TitanObjectFactory.java > ab0e798d24a2890e60109193f86944b069ff0046 > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/query/NativeTitan0GraphQuery.java > cfd9905e6023f80b90c76277aa4398682d9eba2f > > graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/query/Titan0GraphQuery.java > 6c12ac29a6119be9d9b5249e5f2f5c2c1c22b35b > > graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/AbstractGraphDatabaseTest.java > 35735e335fd8f8d47d211d813817e19d9f6a9552 > > graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/GraphQueryTest.java > d02dce946dc547e8e4ce63fdfe84c9cc458c3d01 > > graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseTest.java > 6c2ea263a309c6f71c9eb39fdffed39c8e4895a2 > > graphdb/titan0/src/test/java/org/apache/atlas/repository/graphdb/titan0/Titan0DatabaseValidationTest.java > 341c0642c26017a135bd0faa86b5a29fcdb15870 > graphdb/titan0/src/test/resources/atlas-application.properties > 1e8963ede10c73c3f80033ee4eb29f6b832277c6 > pom.xml ac5b0425bc7816261e7c35caad99131c79e75872 > repository/pom.xml 663ac874518f0942c6f647ea9ee982503410492d > repository/src/main/java/org/apache/atlas/GraphTransactionInterceptor.java > fff8925ebf3b4a7498565f4b9e33885dbb5bc61a > repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java > f1ef1404a45b10ee4c1c229417565e711624957f > > repository/src/main/java/org/apache/atlas/discovery/DataSetLineageService.java > c216469ceb1d89b5f6a578f9bd96f01c09cccd06 > > repository/src/main/java/org/apache/atlas/discovery/graph/DefaultGraphPersistenceStrategy.java > b17eec7e55f478bf4403a61cef7585cf06a2d9d9 > > repository/src/main/java/org/apache/atlas/discovery/graph/GraphBackedDiscoveryService.java > 0c029bbb489c048d6ea19b4f4f31555c0d22f924 > > repository/src/main/java/org/apache/atlas/repository/graph/AtlasGraphProvider.java > PRE-CREATION > > repository/src/main/java/org/apache/atlas/repository/graph/DeleteHandler.java > 92f98c63081af335e48fc5ff076e277ba6185f60 > > repository/src/main/java/org/apache/atlas/repository/graph/FullTextMapper.java > b342e2700d454b0d6fba595b5cc01cd0e06bbdac > > repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepository.java > 263ea465fda0b445a952943def9a6f7c49834f25 > > repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java > f2e40f9145eb87747430ca98337c53fc7e4864f1 > repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java > 1ce87c9d306faa43fb9d3fdc491c4bcbdd7b2bdb > > repository/src/main/java/org/apache/atlas/repository/graph/GraphProvider.java > f89bdf5c7e8596b11dafced6700d0a4245fd32cf > > repository/src/main/java/org/apache/atlas/repository/graph/GraphProvider.java > f89bdf5c7e8596b11dafced6700d0a4245fd32cf > > repository/src/main/java/org/apache/atlas/repository/graph/GraphSchemaInitializer.java > 6141927eb92bc7e681b43118fbaa399ada6c81f8 > > repository/src/main/java/org/apache/atlas/repository/graph/GraphToTypedInstanceMapper.java > 5c7cb2e8fa32b540f80beed40fb4f25a89d39c56 > > repository/src/main/java/org/apache/atlas/repository/graph/HardDeleteHandler.java > 36367913252b59f7adf7f42924a886365e60819f > > repository/src/main/java/org/apache/atlas/repository/graph/SoftDeleteHandler.java > 25aa7c5844cd3fc39bd7cc9ee23a6c336ca1bfac > > repository/src/main/java/org/apache/atlas/repository/graph/TitanGraphProvider.java > 7a5e6a9c8e0967ad8af2192158f455dd676d20ed > > repository/src/main/java/org/apache/atlas/repository/graph/TypedInstanceToGraphMapper.java > 2e0414e2cee7ca3d5958650ac6abc8a290473545 > > repository/src/main/java/org/apache/atlas/repository/typestore/GraphBackedTypeStore.java > a94d1575365656ed5d7e025b2d71635f4623a424 > > repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java > 35504923166e619baee526d76de89d505ca61377 > > repository/src/main/java/org/apache/atlas/util/AtlasRepositoryConfiguration.java > PRE-CREATION > repository/src/main/scala/org/apache/atlas/query/ClosureQuery.scala > c4621cd509ae049b30a08a9e5b3ace03f888a10c > > repository/src/main/scala/org/apache/atlas/query/GraphPersistenceStrategies.scala > f774d97f878b937d38237989e437b5d826622cbd > repository/src/main/scala/org/apache/atlas/query/GremlinEvaluator.scala > 10d66a94f95df677d3157d9b31e2b75f522645aa > repository/src/main/scala/org/apache/atlas/query/GremlinQuery.scala > d336f1ec6d7637ed6d05cd781c66ed5407632e88 > repository/src/main/scala/org/apache/atlas/query/QueryProcessor.scala > 0d2a908201f526aa487dd4cad926d308f53a04ba > repository/src/test/java/org/apache/atlas/BaseRepositoryTest.java > 500a305d3d1e271cd316fbae4e6790d6e5b066c6 > repository/src/test/java/org/apache/atlas/RepositoryServiceLoadingTest.java > 4195955051d842af973d3ad29602fb97c1e54ecd > repository/src/test/java/org/apache/atlas/TestUtils.java > bd9df62c81d325f128fe051fd23f5f253661647b > > repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java > 40dc861c37a5b1a7d2e3ab4b640e03650c7f22a3 > > repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryDeleteTestBase.java > 550a98e274c80334ad2f1359f80c2557602d9f3f > > repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryTest.java > 25415418d7b81b6c43816adbc95d55ba2f7445ec > > repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedRepositoryHardDeleteTest.java > 79b48b5c45fe0c1dc046dde372623b5acc68d39c > > repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedRepositorySoftDeleteTest.java > a0af487df06575e746d13ea4cb46153f6ad5b31b > > repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexerMockTest.java > f3680ded3834b4e8e1f52815e5e374ca974bb5d6 > > repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexerTest.java > 3291e72b356a21391663d729c3601b939584fc9c > > repository/src/test/java/org/apache/atlas/repository/graph/GraphHelperMockTest.java > 5ebc2f7cbf0ec3a3bf0eb08c47cc661212b7258d > > repository/src/test/java/org/apache/atlas/repository/graph/GraphHelperTest.java > ad34aae6076e980689ea2235cd9fd39dac2b125b > > repository/src/test/java/org/apache/atlas/repository/graph/GraphRepoMapperScaleTest.java > 0a870d8ce7b678c513f1e065e46ab77167f8eadd > > repository/src/test/java/org/apache/atlas/repository/typestore/GraphBackedTypeStoreTest.java > 90e622a0a691c658f9f22a6ae82b9f6acc81079f > > repository/src/test/java/org/apache/atlas/repository/typestore/StoreBackedTypeCacheTest.java > b7cf7e9d42d457cb2a641e42a3876244813e25b0 > > repository/src/test/java/org/apache/atlas/repository/typestore/StoreBackedTypeCacheTestModule.java > 058ed4daab37d53f613adc393e774ec206540524 > > repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java > 6782970958c39ce568e04d34aab6707f74fa28c9 > > repository/src/test/java/org/apache/atlas/service/StoreBackedTypeCacheMetadataServiceTest.java > 8fb59c5a196d7a054cd073105c806f5025857c64 > repository/src/test/java/org/apache/atlas/services/DependencyTreeNode.java > PRE-CREATION > repository/src/test/java/org/apache/atlas/services/JSONImporter.java > PRE-CREATION > repository/src/test/resources/hive-instances.json PRE-CREATION > repository/src/test/scala/org/apache/atlas/query/GremlinTest.scala > fa48c0e44a445f97c25182abee0f7c69832e254b > repository/src/test/scala/org/apache/atlas/query/GremlinTest2.scala > f65cedbf44f5fa9e674833a20aae8de6d2537834 > repository/src/test/scala/org/apache/atlas/query/HiveTitanSample.scala > 2dfb67a2b7c36028954304e284eab9da7326a244 > repository/src/test/scala/org/apache/atlas/query/LineageQueryTest.scala > c8b635a9f3710a0de7991f67dd919195a8dd4f7a > repository/src/test/scala/org/apache/atlas/query/QueryTestsUtils.scala > b5faaf33cd5fd1a63bac4fd41d67588ef519dc11 > > typesystem/src/main/java/org/apache/atlas/typesystem/types/Multiplicity.java > 06da32e807aa4b8e4d1f49b3929c9f3c9a8d4846 > typesystem/src/test/resources/atlas-application.properties > fb31462ce9e90e16e5fd271de54268fe77e1b39e > webapp/pom.xml 5ef1a7f3878a4a2c43272a3b8299644fb08a8ac3 > webapp/src/main/java/org/apache/atlas/web/listeners/GuiceServletConfig.java > a1d3187cea0422988500195191de37732c7df56f > webapp/src/main/java/org/apache/atlas/web/resources/BaseService.java > d43c8cc64a89ded2348b6760eb6e7f52593c7444 > > webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerKafkaTest.java > 683a028be9b117b950d3f7962134b86ad2a805b6 > > webapp/src/test/java/org/apache/atlas/web/listeners/TestGuiceServletConfig.java > 08bb125241012b6a1c1852efc6443cc7a4ebecc3 > > Diff: https://reviews.apache.org/r/47810/diff/ > > > Testing > ------- > > Built entire Atlas project, ran all unit/integration tests. No issues found. > > > Thanks, > > Jeff Hagelberg > >