[jira] [Commented] (ATLAS-3337) Update Spring Framework/Security library version
[ https://issues.apache.org/jira/browse/ATLAS-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885813#comment-16885813 ] ASF subversion and git services commented on ATLAS-3337: Commit 28aec35e51de4cde01996b40568ef5103cdc5653 in atlas's branch refs/heads/branch-2.0 from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=28aec35 ] ATLAS-3337: Update Spring Framework/Security library version (cherry picked from commit c1f95d172db383c865a6d70bb5d1d1af3f329c50) > Update Spring Framework/Security library version > > > Key: ATLAS-3337 > URL: https://issues.apache.org/jira/browse/ATLAS-3337 > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: > 0001-ATLAS-7-Update-Spring-Framework-Security-library.patch > > > ||Library||current version||new version|| > |Spring Framework|4.3.18.RELEASE|4.3.20.RELEASE| > |Spring Security|4.2.7|4.2.13| > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3286) Populate the dynamic attribute flag for each AtlasAttribute in each AltasEntityType along with attributes which might trigger re evaluation of Dynamic Attributes
[ https://issues.apache.org/jira/browse/ATLAS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885814#comment-16885814 ] ASF subversion and git services commented on ATLAS-3286: Commit fceafbc75f5b5af52a095612620cbe0d51a84cd6 in atlas's branch refs/heads/branch-2.0 from Merryle Wang [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=fceafbc ] ATLAS-3286: Populate the dynamic attribute flag for each AtlasAttribute in each AltasEntityType Signed-off-by: Sarath Subramanian (cherry picked from commit 85f9b502e883d3d4870dd201c98aee257a3efa1a) > Populate the dynamic attribute flag for each AtlasAttribute in each > AltasEntityType along with attributes which might trigger re evaluation of > Dynamic Attributes > - > > Key: ATLAS-3286 > URL: https://issues.apache.org/jira/browse/ATLAS-3286 > Project: Atlas > Issue Type: Sub-task >Reporter: Aadarsh Jajodia >Assignee: Merryle Wang >Priority: Major > Original Estimate: 168h > Remaining Estimate: 168h > > We aim to implement the following methods in this Jira > AtlasAttributes > isDynAttribute() - An example of this is qualifiedName for hive_db > isDynAttributeEvalTrigger() - An example of this is clusterName for hive_db > For AtlasEntityTypes - > getDynEvalAttributes() -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3286) Populate the dynamic attribute flag for each AtlasAttribute in each AltasEntityType along with attributes which might trigger re evaluation of Dynamic Attributes
[ https://issues.apache.org/jira/browse/ATLAS-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885808#comment-16885808 ] ASF subversion and git services commented on ATLAS-3286: Commit 85f9b502e883d3d4870dd201c98aee257a3efa1a in atlas's branch refs/heads/master from Merryle Wang [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=85f9b50 ] ATLAS-3286: Populate the dynamic attribute flag for each AtlasAttribute in each AltasEntityType Signed-off-by: Sarath Subramanian > Populate the dynamic attribute flag for each AtlasAttribute in each > AltasEntityType along with attributes which might trigger re evaluation of > Dynamic Attributes > - > > Key: ATLAS-3286 > URL: https://issues.apache.org/jira/browse/ATLAS-3286 > Project: Atlas > Issue Type: Sub-task >Reporter: Aadarsh Jajodia >Assignee: Merryle Wang >Priority: Major > Original Estimate: 168h > Remaining Estimate: 168h > > We aim to implement the following methods in this Jira > AtlasAttributes > isDynAttribute() - An example of this is qualifiedName for hive_db > isDynAttributeEvalTrigger() - An example of this is clusterName for hive_db > For AtlasEntityTypes - > getDynEvalAttributes() -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3333) notification processing to provide an option to ignore Hive dummy databases and tables
[ https://issues.apache.org/jira/browse/ATLAS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885743#comment-16885743 ] ASF subversion and git services commented on ATLAS-: Commit 727b5bebf4cbd4bf52822f10b94127d0306aa94e in atlas's branch refs/heads/branch-1.0 from Madhan Neethiraj [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=727b5be ] ATLAS-: updated notification pre-process with an option to ignore dummy Hive database/table (cherry picked from commit 23eacbafcea2e58378271fa6dc7b56be08b7cac7) > notification processing to provide an option to ignore Hive dummy databases > and tables > -- > > Key: ATLAS- > URL: https://issues.apache.org/jira/browse/ATLAS- > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Reporter: Madhan Neethiraj >Assignee: Madhan Neethiraj >Priority: Major > Fix For: 2.1.0, 3.0.0, 1.3.0 > > Attachments: ATLAS-.patch > > > Apache Hive has few database and tables designated as 'dummy' or 'tmp' (used > while executing certain queries). Atlas Hive hook was updated in ATLAS-3033, > with an option to skip these databases and tables. Atlas server also should > support such option, to ignore these databases and tables referenced in > notifications (from earlier version hooks). -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3333) notification processing to provide an option to ignore Hive dummy databases and tables
[ https://issues.apache.org/jira/browse/ATLAS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885739#comment-16885739 ] ASF subversion and git services commented on ATLAS-: Commit 0fe67124169f5f72ba1a5dca47dac77330ee6927 in atlas's branch refs/heads/branch-2.0 from Madhan Neethiraj [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=0fe6712 ] ATLAS-: updated notification pre-process with an option to ignore dummy Hive database/table (cherry picked from commit 23eacbafcea2e58378271fa6dc7b56be08b7cac7) > notification processing to provide an option to ignore Hive dummy databases > and tables > -- > > Key: ATLAS- > URL: https://issues.apache.org/jira/browse/ATLAS- > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Reporter: Madhan Neethiraj >Assignee: Madhan Neethiraj >Priority: Major > Fix For: 2.1.0, 3.0.0, 1.3.0 > > Attachments: ATLAS-.patch > > > Apache Hive has few database and tables designated as 'dummy' or 'tmp' (used > while executing certain queries). Atlas Hive hook was updated in ATLAS-3033, > with an option to skip these databases and tables. Atlas server also should > support such option, to ignore these databases and tables referenced in > notifications (from earlier version hooks). -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3333) notification processing to provide an option to ignore Hive dummy databases and tables
[ https://issues.apache.org/jira/browse/ATLAS-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885738#comment-16885738 ] ASF subversion and git services commented on ATLAS-: Commit 23eacbafcea2e58378271fa6dc7b56be08b7cac7 in atlas's branch refs/heads/master from Madhan Neethiraj [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=23eacba ] ATLAS-: updated notification pre-process with an option to ignore dummy Hive database/table > notification processing to provide an option to ignore Hive dummy databases > and tables > -- > > Key: ATLAS- > URL: https://issues.apache.org/jira/browse/ATLAS- > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Reporter: Madhan Neethiraj >Assignee: Madhan Neethiraj >Priority: Major > Fix For: 2.1.0, 3.0.0, 1.3.0 > > Attachments: ATLAS-.patch > > > Apache Hive has few database and tables designated as 'dummy' or 'tmp' (used > while executing certain queries). Atlas Hive hook was updated in ATLAS-3033, > with an option to skip these databases and tables. Atlas server also should > support such option, to ignore these databases and tables referenced in > notifications (from earlier version hooks). -- This message was sent by Atlassian JIRA (v7.6.14#76016)
Re: Review Request 71070: ATLAS-3333: updated notification pre-process with an option to ignore dummy Hive database/table
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71070/#review216633 --- Ship it! Ship It! - Sarath Subramanian On July 13, 2019, 12:17 a.m., Madhan Neethiraj wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/71070/ > --- > > (Updated July 13, 2019, 12:17 a.m.) > > > Review request for atlas, Ashutosh Mestry, Nixon Rodrigues, and Sarath > Subramanian. > > > Bugs: ATLAS- > https://issues.apache.org/jira/browse/ATLAS- > > > Repository: atlas > > > Description > --- > > Added followig configurations to control whether/what databases and tables > Atlas server should ignore while processing notifications: > atlas.notification.consumer.preprocess.hive_db.ignore.dummy.enabled=true > > atlas.notification.consumer.preprocess.hive_db.ignore.dummy.names=_dummy_database > atlas.notification.consumer.preprocess.hive_table.ignore.dummy.enabled=true > > atlas.notification.consumer.preprocess.hive_table.ignore.dummy.names=_dummy_table > > atlas.notification.consumer.preprocess.hive_table.ignore.name.prefixes.enabled=true > > atlas.notification.consumer.preprocess.hive_table.ignore.name.prefixes=Values__Tmp__Table__ > > > Diffs > - > > > webapp/src/main/java/org/apache/atlas/notification/NotificationHookConsumer.java > 1c8d72bdc > > webapp/src/main/java/org/apache/atlas/notification/preprocessor/EntityPreprocessor.java > 9b620dd66 > > webapp/src/main/java/org/apache/atlas/notification/preprocessor/HivePreprocessor.java > cc31032b6 > > webapp/src/main/java/org/apache/atlas/notification/preprocessor/PreprocessorContext.java > 2db057413 > > > Diff: https://reviews.apache.org/r/71070/diff/1/ > > > Testing > --- > > Verified manually that Atlas server ignores the databases/tables as specified > in configurations. > > > Thanks, > > Madhan Neethiraj > >
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/ --- (Updated July 16, 2019, 12:12 a.m.) Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, Madhan Neethiraj, and Sarath Subramanian. Changes --- Reverted Hive model file to not include dynAttributes. Repository: atlas Description --- ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes Diffs (updated) - intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java d9ae9e36773146fad652a1e28fc8822bae5c8557 intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 0fe47bdcbe84c06545c517fec3177ef7e6487a6c intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 3c53c02b48747515217c9327c98209a48ee84237 repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java 4ff4206471bb8b2b4997c00dca3b4433626ae392 webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java bf7e182429d00ca668cbbd41277291ecc5d457e0 webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java edb45687712c7bb8941bc894e73423a463739a42 Diff: https://reviews.apache.org/r/70913/diff/14/ Changes: https://reviews.apache.org/r/70913/diff/13-14/ Testing --- Added unit test File Attachments (updated) Hive Model with dynAttributes https://reviews.apache.org/media/uploaded/files/2019/07/16/1f7bed33-0509-4aee-acbf-7ed1b0616c84__1030-hive_model.json Thanks, Merryle Wang
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/#review216632 --- Ship it! Thanks for uploading the model file. We can have that as a reference. - Aadarsh Jajodia On July 16, 2019, 12:12 a.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/70913/ > --- > > (Updated July 16, 2019, 12:12 a.m.) > > > Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, > Madhan Neethiraj, and Sarath Subramanian. > > > Repository: atlas > > > Description > --- > > ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes > > > Diffs > - > > intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java > d9ae9e36773146fad652a1e28fc8822bae5c8557 > intg/src/main/java/org/apache/atlas/type/AtlasStructType.java > 0fe47bdcbe84c06545c517fec3177ef7e6487a6c > intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION > intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java > 3c53c02b48747515217c9327c98209a48ee84237 > > repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java > 4ff4206471bb8b2b4997c00dca3b4433626ae392 > > webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java > bf7e182429d00ca668cbbd41277291ecc5d457e0 > > webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java > edb45687712c7bb8941bc894e73423a463739a42 > > > Diff: https://reviews.apache.org/r/70913/diff/14/ > > > Testing > --- > > Added unit test > > > File Attachments > > > Hive Model with dynAttributes > > https://reviews.apache.org/media/uploaded/files/2019/07/16/1f7bed33-0509-4aee-acbf-7ed1b0616c84__1030-hive_model.json > > > Thanks, > > Merryle Wang > >
[jira] [Commented] (ATLAS-3337) Update Spring Framework/Security library version
[ https://issues.apache.org/jira/browse/ATLAS-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885706#comment-16885706 ] ASF subversion and git services commented on ATLAS-3337: Commit c1f95d172db383c865a6d70bb5d1d1af3f329c50 in atlas's branch refs/heads/master from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=c1f95d1 ] ATLAS-3337: Update Spring Framework/Security library version > Update Spring Framework/Security library version > > > Key: ATLAS-3337 > URL: https://issues.apache.org/jira/browse/ATLAS-3337 > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: > 0001-ATLAS-7-Update-Spring-Framework-Security-library.patch > > > ||Library||current version||new version|| > |Spring Framework|4.3.18.RELEASE|4.3.20.RELEASE| > |Spring Security|4.2.7|4.2.13| > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/#review216630 --- Ship it! Ship It! - Aadarsh Jajodia On July 15, 2019, 11:09 p.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/70913/ > --- > > (Updated July 15, 2019, 11:09 p.m.) > > > Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, > Madhan Neethiraj, and Sarath Subramanian. > > > Repository: atlas > > > Description > --- > > ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes > > > Diffs > - > > addons/models/1000-Hadoop/1030-hive_model.json > 8901aa4aa86fb2802a9e9b1e65c2ff8aad8855ad > intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java > d9ae9e36773146fad652a1e28fc8822bae5c8557 > intg/src/main/java/org/apache/atlas/type/AtlasStructType.java > 0fe47bdcbe84c06545c517fec3177ef7e6487a6c > intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION > intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java > 3c53c02b48747515217c9327c98209a48ee84237 > > repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java > 4ff4206471bb8b2b4997c00dca3b4433626ae392 > > webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java > bf7e182429d00ca668cbbd41277291ecc5d457e0 > > webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java > edb45687712c7bb8941bc894e73423a463739a42 > > > Diff: https://reviews.apache.org/r/70913/diff/13/ > > > Testing > --- > > Added unit test > > > Thanks, > > Merryle Wang > >
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/#review216629 --- Ship it! Ship It! - Sarath Subramanian On July 15, 2019, 4:09 p.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/70913/ > --- > > (Updated July 15, 2019, 4:09 p.m.) > > > Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, > Madhan Neethiraj, and Sarath Subramanian. > > > Repository: atlas > > > Description > --- > > ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes > > > Diffs > - > > addons/models/1000-Hadoop/1030-hive_model.json > 8901aa4aa86fb2802a9e9b1e65c2ff8aad8855ad > intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java > d9ae9e36773146fad652a1e28fc8822bae5c8557 > intg/src/main/java/org/apache/atlas/type/AtlasStructType.java > 0fe47bdcbe84c06545c517fec3177ef7e6487a6c > intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION > intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java > 3c53c02b48747515217c9327c98209a48ee84237 > > repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java > 4ff4206471bb8b2b4997c00dca3b4433626ae392 > > webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java > bf7e182429d00ca668cbbd41277291ecc5d457e0 > > webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java > edb45687712c7bb8941bc894e73423a463739a42 > > > Diff: https://reviews.apache.org/r/70913/diff/13/ > > > Testing > --- > > Added unit test > > > Thanks, > > Merryle Wang > >
[jira] [Commented] (ATLAS-3337) Update Spring Framework/Security library version
[ https://issues.apache.org/jira/browse/ATLAS-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885689#comment-16885689 ] Madhan Neethiraj commented on ATLAS-3337: - +1 for the patch. Thanks [~sarath.ku...@gmail.com]! > Update Spring Framework/Security library version > > > Key: ATLAS-3337 > URL: https://issues.apache.org/jira/browse/ATLAS-3337 > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: > 0001-ATLAS-7-Update-Spring-Framework-Security-library.patch > > > ||Library||current version||new version|| > |Spring Framework|4.3.18.RELEASE|4.3.20.RELEASE| > |Spring Security|4.2.7|4.2.13| > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ATLAS-3337) Update Spring Framework/Security library version
[ https://issues.apache.org/jira/browse/ATLAS-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarath Subramanian updated ATLAS-3337: -- Attachment: 0001-ATLAS-7-Update-Spring-Framework-Security-library.patch > Update Spring Framework/Security library version > > > Key: ATLAS-3337 > URL: https://issues.apache.org/jira/browse/ATLAS-3337 > Project: Atlas > Issue Type: Improvement > Components: atlas-core >Affects Versions: 2.0.0 >Reporter: Sarath Subramanian >Assignee: Sarath Subramanian >Priority: Major > Fix For: 2.1.0 > > Attachments: > 0001-ATLAS-7-Update-Spring-Framework-Security-library.patch > > > ||Library||current version||new version|| > |Spring Framework|4.3.18.RELEASE|4.3.20.RELEASE| > |Spring Security|4.2.7|4.2.13| > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/ --- (Updated July 15, 2019, 11:09 p.m.) Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, Madhan Neethiraj, and Sarath Subramanian. Changes --- Forgot to change the variable at 1 place, fixed now. Repository: atlas Description --- ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes Diffs (updated) - addons/models/1000-Hadoop/1030-hive_model.json 8901aa4aa86fb2802a9e9b1e65c2ff8aad8855ad intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java d9ae9e36773146fad652a1e28fc8822bae5c8557 intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 0fe47bdcbe84c06545c517fec3177ef7e6487a6c intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 3c53c02b48747515217c9327c98209a48ee84237 repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java 4ff4206471bb8b2b4997c00dca3b4433626ae392 webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java bf7e182429d00ca668cbbd41277291ecc5d457e0 webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java edb45687712c7bb8941bc894e73423a463739a42 Diff: https://reviews.apache.org/r/70913/diff/13/ Changes: https://reviews.apache.org/r/70913/diff/12-13/ Testing --- Added unit test Thanks, Merryle Wang
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/ --- (Updated July 15, 2019, 11:06 p.m.) Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, Madhan Neethiraj, and Sarath Subramanian. Changes --- Renamed splitPath variable in DependentToken.java to objectPath Repository: atlas Description --- ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes Diffs (updated) - addons/models/1000-Hadoop/1030-hive_model.json 8901aa4aa86fb2802a9e9b1e65c2ff8aad8855ad intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java d9ae9e36773146fad652a1e28fc8822bae5c8557 intg/src/main/java/org/apache/atlas/type/AtlasStructType.java 0fe47bdcbe84c06545c517fec3177ef7e6487a6c intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java 3c53c02b48747515217c9327c98209a48ee84237 repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java 4ff4206471bb8b2b4997c00dca3b4433626ae392 webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java bf7e182429d00ca668cbbd41277291ecc5d457e0 webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java edb45687712c7bb8941bc894e73423a463739a42 Diff: https://reviews.apache.org/r/70913/diff/12/ Changes: https://reviews.apache.org/r/70913/diff/11-12/ Testing --- Added unit test Thanks, Merryle Wang
[jira] [Created] (ATLAS-3337) Update Spring Framework/Security library version
Sarath Subramanian created ATLAS-3337: - Summary: Update Spring Framework/Security library version Key: ATLAS-3337 URL: https://issues.apache.org/jira/browse/ATLAS-3337 Project: Atlas Issue Type: Improvement Components: atlas-core Affects Versions: 2.0.0 Reporter: Sarath Subramanian Assignee: Sarath Subramanian Fix For: 2.1.0 ||Library||current version||new version|| |Spring Framework|4.3.18.RELEASE|4.3.20.RELEASE| |Spring Security|4.2.7|4.2.13| -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Resolved] (ATLAS-3317) java.lang.Exception: Timeout scanning annotations while running Integration Tests
[
https://issues.apache.org/jira/browse/ATLAS-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sarath Subramanian resolved ATLAS-3317.
---
Resolution: Fixed
> java.lang.Exception: Timeout scanning annotations while running Integration
> Tests
> -
>
> Key: ATLAS-3317
> URL: https://issues.apache.org/jira/browse/ATLAS-3317
> Project: Atlas
> Issue Type: Bug
>Reporter: Nixon Rodrigues
>Assignee: Nixon Rodrigues
>Priority: Major
> Attachments:
> 0001-ATLAS-3317-Set-maxWait-systemProperty-in-jetty-maven.patch, maxWait.diff
>
>
> run :- *mvn clean install -DskipUTs*
>
> {noformat}
> [INFO] --- jetty-maven-plugin:9.3.14.v20161028:deploy-war (start-jetty) @
> atlas-webapp ---
> [INFO] Logging initialized @220653ms
> [INFO] Configuring Jetty for project: Apache Atlas Web Application
> [INFO] Context path = /
> [INFO] Tmp directory =
> /home/jenkins/jenkins-slave/workspace/PreCommit-ATLAS-Build-Test@2/webapp/target/tmp
> [INFO] Web defaults = org/eclipse/jetty/webapp/webdefault.xml
> [INFO] Web overrides = none
> [INFO] jetty-9.3.14.v20161028
> [INFO] Scanning elapsed time=67258ms
> [WARNING] Failed startup of context o.e.j.m.p.JettyWebAppContext@2eb2d10c{/,
> [file:///home/jenkins/jenkins-slave/workspace/PreCommit-ATLAS-Build-Test@2/webapp/target/atlas-webapp-3.0.0-SNAPSHOT/,UNAVAILABLE}\{/home/jenkins/jenkins-slave/workspace/PreCommit-ATLAS-Build-Test@2/webapp/target/atlas-webapp-3.0.0-SNAPSHOT.war}|file:///home/jenkins/jenkins-slave/workspace/PreCommit-ATLAS-Build-Test@2/webapp/target/atlas-webapp-3.0.0-SNAPSHOT/,UNAVAILABLE%7D%7B/home/jenkins/jenkins-slave/workspace/PreCommit-ATLAS-Build-Test@2/webapp/target/atlas-webapp-3.0.0-SNAPSHOT.war%7D]
> java.lang.Exception: Timeout scanning annotations
> at
> org.eclipse.jetty.annotations.AnnotationConfiguration.scanForAnnotations
> (AnnotationConfiguration.java:578)
> at org.eclipse.jetty.annotations.AnnotationConfiguration.configure
> (AnnotationConfiguration.java:447)
> at org.eclipse.jetty.webapp.WebAppContext.configure
> (WebAppContext.java:494)
> at org.eclipse.jetty.webapp.WebAppContext.startContext
> (WebAppContext.java:1361)
> at org.eclipse.jetty.server.handler.ContextHandler.doStart
> (ContextHandler.java:778)
> at org.eclipse.jetty.servlet.ServletContextHandler.doStart
> (ServletContextHandler.java:262)
> at org.eclipse.jetty.webapp.WebAppContext.doStart (WebAppContext.java:520)
> at org.eclipse.jetty.maven.plugin.JettyWebAppContext.doStart
> (JettyWebAppContext.java:398)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.start
> (AbstractLifeCycle.java:68)
> at org.eclipse.jetty.util.component.ContainerLifeCycle.start
> (ContainerLifeCycle.java:131)
> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart
> (ContainerLifeCycle.java:113)
> at org.eclipse.jetty.server.handler.AbstractHandler.doStart
> (AbstractHandler.java:61)
> at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart
> (ContextHandlerCollection.java:161)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.start
> (AbstractLifeCycle.java:68)
> at org.eclipse.jetty.util.component.ContainerLifeCycle.start
> (ContainerLifeCycle.java:131)
> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart
> (ContainerLifeCycle.java:113)
> at org.eclipse.jetty.server.handler.AbstractHandler.doStart
> (AbstractHandler.java:61)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.start
> (AbstractLifeCycle.java:68)
> at org.eclipse.jetty.util.component.ContainerLifeCycle.start
> (ContainerLifeCycle.java:131)
> at org.eclipse.jetty.server.Server.start (Server.java:422)
> at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart
> (ContainerLifeCycle.java:105)
> at org.eclipse.jetty.server.handler.AbstractHandler.doStart
> (AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart (Server.java:389)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.start
> (AbstractLifeCycle.java:68)
> at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.startJetty
> (AbstractJettyMojo.java:460)
> at org.eclipse.jetty.maven.plugin.AbstractJettyMojo.execute
> (AbstractJettyMojo.java:328)
> at org.eclipse.jetty.maven.plugin.JettyRunWarMojo.execute
> (JettyRunWarMojo.java:64)
> at org.eclipse.jetty.maven.plugin.JettyDeployWar.execute
> (JettyDeployWar.java:65)
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo
> (DefaultBuildPluginManager.java:137)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:210)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute
> (MojoExecutor.java:156)
> at
[jira] [Updated] (ATLAS-3336) Propagating Dynamic Attribute changes
[
https://issues.apache.org/jira/browse/ATLAS-3336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aadarsh Jajodia updated ATLAS-3336:
---
Description:
attr1
attr2 - \{attr1}_name
attr3 : \{attr2}_value
Here attr2 and attr3 are dynamic attributes
The order in which these should be computed is
# attr2
# attr3
The reason is attr3 is dependent on attr2
The same propagation logic should hold when we change a database name
table - \{db.name}..
column - \{table.db.name}.\{table.name}
Here table's qualifiedName should be updated first and then the column's name
was:
attr1
attr2 - \{attr1}_name
attr3 : \{attr2}_value
Here attr2 and attr3 are dynamic attributes
The order in which these should be computed is that first attr2 and then attr3.
The same propagation logic should hold when we change a database name
table - \{db.name}..
column - \{table.db.name}.\{table.name}
Here table's qualifiedName should be updated first and then the column's name
> Propagating Dynamic Attribute changes
> -
>
> Key: ATLAS-3336
> URL: https://issues.apache.org/jira/browse/ATLAS-3336
> Project: Atlas
> Issue Type: Bug
>Reporter: Aadarsh Jajodia
>Assignee: Merryle Wang
>Priority: Major
>
> attr1
> attr2 - \{attr1}_name
> attr3 : \{attr2}_value
>
> Here attr2 and attr3 are dynamic attributes
> The order in which these should be computed is
> # attr2
> # attr3
> The reason is attr3 is dependent on attr2
>
> The same propagation logic should hold when we change a database name
> table - \{db.name}..
> column - \{table.db.name}.\{table.name}
>
> Here table's qualifiedName should be updated first and then the column's name
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
[jira] [Created] (ATLAS-3336) Propagating Dynamic Attribute changes
Aadarsh Jajodia created ATLAS-3336:
--
Summary: Propagating Dynamic Attribute changes
Key: ATLAS-3336
URL: https://issues.apache.org/jira/browse/ATLAS-3336
Project: Atlas
Issue Type: Bug
Reporter: Aadarsh Jajodia
Assignee: Merryle Wang
attr1
attr2 - \{attr1}_name
attr3 : \{attr2}_value
Here attr2 and attr3 are dynamic attributes
The order in which these should be computed is that first attr2 and then attr3.
The same propagation logic should hold when we change a database name
table - \{db.name}..
column - \{table.db.name}.\{table.name}
Here table's qualifiedName should be updated first and then the column's name
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
Re: Review Request 70913: ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/70913/#review216618 --- Ship it! Ship It! - Madhan Neethiraj On July 15, 2019, 2:20 a.m., Merryle Wang wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/70913/ > --- > > (Updated July 15, 2019, 2:20 a.m.) > > > Review request for atlas, Ashutosh Mestry, Aadarsh Jajodia, Sridhar K, Le Ma, > Madhan Neethiraj, and Sarath Subramanian. > > > Repository: atlas > > > Description > --- > > ATLAS-3286: Populated dynamic attribute flags for AtlasAttributes > > > Diffs > - > > addons/models/1000-Hadoop/1030-hive_model.json > 8901aa4aa86fb2802a9e9b1e65c2ff8aad8855ad > intg/src/main/java/org/apache/atlas/type/AtlasEntityType.java > d9ae9e36773146fad652a1e28fc8822bae5c8557 > intg/src/main/java/org/apache/atlas/type/AtlasStructType.java > 0fe47bdcbe84c06545c517fec3177ef7e6487a6c > intg/src/main/java/org/apache/atlas/type/AttributeToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/ConstantToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/DependentToken.java PRE-CREATION > intg/src/main/java/org/apache/atlas/type/TemplateToken.java PRE-CREATION > intg/src/test/java/org/apache/atlas/type/TestAtlasEntityType.java > 3c53c02b48747515217c9327c98209a48ee84237 > > repository/src/main/java/org/apache/atlas/repository/store/graph/v2/AtlasEntityGraphDiscoveryV2.java > 4ff4206471bb8b2b4997c00dca3b4433626ae392 > > webapp/src/test/java/org/apache/atlas/notification/NotificationHookConsumerIT.java > bf7e182429d00ca668cbbd41277291ecc5d457e0 > > webapp/src/test/java/org/apache/atlas/web/integration/EntityJerseyResourceIT.java > edb45687712c7bb8941bc894e73423a463739a42 > > > Diff: https://reviews.apache.org/r/70913/diff/11/ > > > Testing > --- > > Added unit test > > > Thanks, > > Merryle Wang > >
[jira] [Updated] (ATLAS-3335) Update Sqoop/Storm hook to use relationship attributes
[ https://issues.apache.org/jira/browse/ATLAS-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mandar Ambawane updated ATLAS-3335: --- Summary: Update Sqoop/Storm hook to use relationship attributes (was: Update Sqoop hook to use relationship attributes) > Update Sqoop/Storm hook to use relationship attributes > -- > > Key: ATLAS-3335 > URL: https://issues.apache.org/jira/browse/ATLAS-3335 > Project: Atlas > Issue Type: Bug >Reporter: Nixon Rodrigues >Assignee: Mandar Ambawane >Priority: Major > > Currently in Sqoop Hook object the reference attributes are added as part of > "attributes" and we don't leverage relationshipAttributes. This JIRA will > update Sqoop hook to assign all object if references using relationship > attributes. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ATLAS-3335) Update Sqoop hook to use relationship attributes
Nixon Rodrigues created ATLAS-3335: -- Summary: Update Sqoop hook to use relationship attributes Key: ATLAS-3335 URL: https://issues.apache.org/jira/browse/ATLAS-3335 Project: Atlas Issue Type: Bug Reporter: Nixon Rodrigues Assignee: Mandar Ambawane Currently in Sqoop Hook object the reference attributes are added as part of "attributes" and we don't leverage relationshipAttributes. This JIRA will update Sqoop hook to assign all object if references using relationship attributes. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3329) Update usage of Servlets.getUserName method to AtlasAuthorizationUtils.getCurrentUserName()
[ https://issues.apache.org/jira/browse/ATLAS-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885114#comment-16885114 ] ASF subversion and git services commented on ATLAS-3329: Commit 3ad9016cd6f8fba0426262c90e5a97fe795d3843 in atlas's branch refs/heads/master from Nixon Rodrigues [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=3ad9016 ] ATLAS-3329 : Update usage of Servlets.getUserName method to AtlasAuthorizationUtils.getCurrentUserName() Change-Id: I6bb6649ec9c82690d81f457de051a72eb9812850 > Update usage of Servlets.getUserName method to > AtlasAuthorizationUtils.getCurrentUserName() > --- > > Key: ATLAS-3329 > URL: https://issues.apache.org/jira/browse/ATLAS-3329 > Project: Atlas > Issue Type: Bug >Reporter: Nixon Rodrigues >Assignee: Nixon Rodrigues >Priority: Major > Attachments: ATLAS-3329.patch > > > There are instance in code where User name is retrieved from > httpServletRequest.getRemoteUser() via Servlets.getUserName method. > If request are coming from proxy then doAs user is impersonate as valid Atlas > user, getting user name from remote will cause confusion. > So it make sense to update the usage of Servlets.getUserName to > AtlasAuthorizationUtils.getCurrentUserName(). -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (ATLAS-3329) Update usage of Servlets.getUserName method to AtlasAuthorizationUtils.getCurrentUserName()
[ https://issues.apache.org/jira/browse/ATLAS-3329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885116#comment-16885116 ] ASF subversion and git services commented on ATLAS-3329: Commit 022f2de8954382051a6ed53e4ae91a63f36d4bdd in atlas's branch refs/heads/branch-2.0 from Nixon Rodrigues [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=022f2de ] ATLAS-3329 : Update usage of Servlets.getUserName method to AtlasAuthorizationUtils.getCurrentUserName() Change-Id: I6bb6649ec9c82690d81f457de051a72eb9812850 (cherry picked from commit 3ad9016cd6f8fba0426262c90e5a97fe795d3843) > Update usage of Servlets.getUserName method to > AtlasAuthorizationUtils.getCurrentUserName() > --- > > Key: ATLAS-3329 > URL: https://issues.apache.org/jira/browse/ATLAS-3329 > Project: Atlas > Issue Type: Bug >Reporter: Nixon Rodrigues >Assignee: Nixon Rodrigues >Priority: Major > Attachments: ATLAS-3329.patch > > > There are instance in code where User name is retrieved from > httpServletRequest.getRemoteUser() via Servlets.getUserName method. > If request are coming from proxy then doAs user is impersonate as valid Atlas > user, getting user name from remote will cause confusion. > So it make sense to update the usage of Servlets.getUserName to > AtlasAuthorizationUtils.getCurrentUserName(). -- This message was sent by Atlassian JIRA (v7.6.14#76016)
Re: Review Request 71064: ATLAS-3326 Update Hbase hook/bridge to use relationship attribute
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/71064/ --- (Updated July 15, 2019, 11:17 a.m.) Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues, and Sarath Subramanian. Changes --- ATLAS-3326 Update Hbase hook/bridge to use relationship attribute and move conversion methods to class AtlasTypeUtil Repository: atlas Description --- ATLAS-3326 Update Hbase hook/bridge to use relationship attribute Diffs (updated) - addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseAtlasHook.java 6d062e2 addons/hbase-bridge/src/main/java/org/apache/atlas/hbase/bridge/HBaseBridge.java 4a4b4d9 addons/hive-bridge/src/main/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridge.java a61a3e6 addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/BaseHiveEvent.java a74273a addons/hive-bridge/src/main/java/org/apache/atlas/hive/hook/events/CreateHiveProcess.java 6b050d4 addons/hive-bridge/src/test/java/org/apache/atlas/hive/bridge/HiveMetaStoreBridgeTest.java 4403aaf intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 6ac176d Diff: https://reviews.apache.org/r/71064/diff/2/ Changes: https://reviews.apache.org/r/71064/diff/1-2/ Testing --- Steps done for updating 1. Disable hbase-hook from Ambari. 2. Create table in hbase. 3. Check whether table entity is created in Atlas side or not.(It should not be created) 4. Run script import-hbsae.sh 5. Check again in Atlas side, hbase table and namespace entities are created with relationship. Thanks, Mandar Ambawane
[jira] [Updated] (ATLAS-3334) Start atlas v2.0.0 with hbase1.3.0 error
[ https://issues.apache.org/jira/browse/ATLAS-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Zhao updated ATLAS-3334: -- Attachment: 20190715171348.png > Start atlas v2.0.0 with hbase1.3.0 error > > > Key: ATLAS-3334 > URL: https://issues.apache.org/jira/browse/ATLAS-3334 > Project: Atlas > Issue Type: Bug >Affects Versions: 2.0.0 >Reporter: Dylan Zhao >Priority: Major > Attachments: 20190715171348.png > > > hbase version: 1.3.0 > atlas version : 2.0.0 > The atlas service seems to be starting up with an error > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Updated] (ATLAS-3334) Start atlas v2.0.0 with hbase1.3.0 error
[ https://issues.apache.org/jira/browse/ATLAS-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dylan Zhao updated ATLAS-3334: -- Description: hbase version: 1.3.0 atlas version : 2.0.0 The atlas service seems to be starting up with an error was: hbase version: 1.3.0 atlas version : 2.0.0 The atlas service seems to be starting up with an error !image-2019-07-15-17-06-23-414.png! > Start atlas v2.0.0 with hbase1.3.0 error > > > Key: ATLAS-3334 > URL: https://issues.apache.org/jira/browse/ATLAS-3334 > Project: Atlas > Issue Type: Bug >Affects Versions: 2.0.0 >Reporter: Dylan Zhao >Priority: Major > > hbase version: 1.3.0 > atlas version : 2.0.0 > The atlas service seems to be starting up with an error > -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (ATLAS-3334) Start atlas v2.0.0 with hbase1.3.0 error
Dylan Zhao created ATLAS-3334: - Summary: Start atlas v2.0.0 with hbase1.3.0 error Key: ATLAS-3334 URL: https://issues.apache.org/jira/browse/ATLAS-3334 Project: Atlas Issue Type: Bug Affects Versions: 2.0.0 Reporter: Dylan Zhao hbase version: 1.3.0 atlas version : 2.0.0 The atlas service seems to be starting up with an error !image-2019-07-15-17-06-23-414.png! -- This message was sent by Atlassian JIRA (v7.6.14#76016)
