[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988468#comment-16988468 ] ASF subversion and git services commented on ATLAS-3545: Commit 6b96a40d1787ebeae247140c49af5de2fd59b1d4 in atlas's branch refs/heads/branch-2.0 from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=6b96a40 ] ATLAS-3545: NullPointerException while trying to delete classification (cherry picked from commit c95aba218b9318ce44abf574faff62908f24916d) > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Assignee: Sarath Subramanian >Priority: Critical > Attachments: ATLAS-3545.002.patch, Screenshot 2019-11-30 at > 22.16.44.png, Screenshot 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at > 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988467#comment-16988467 ] ASF subversion and git services commented on ATLAS-3545: Commit c95aba218b9318ce44abf574faff62908f24916d in atlas's branch refs/heads/master from Sarath Subramanian [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=c95aba2 ] ATLAS-3545: NullPointerException while trying to delete classification > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Assignee: Sarath Subramanian >Priority: Critical > Attachments: ATLAS-3545.002.patch, Screenshot 2019-11-30 at > 22.16.44.png, Screenshot 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at > 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987628#comment-16987628 ] Bolke de Bruin commented on ATLAS-3545: --- Thanks [~sarath]. We will apply the patch and observe the behavior. Please note that this only removes the symptom from search/retrieval. On entity update an invalid propagating classification is still being evaluated. That problem is worse as it creates performance issues. The question thus also becomes, apart from the race condition, how to delete the invalid vertex? > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Assignee: Sarath Subramanian >Priority: Critical > Attachments: ATLAS-3545.001.patch, Screenshot 2019-11-30 at > 22.16.44.png, Screenshot 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at > 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987617#comment-16987617 ] Sarath Subramanian commented on ATLAS-3545: --- [~bolke], while we continue to investigate the cause of corrupt classification vertex being created (due to race condition). Attached patch should avoid NPE and print the corrupt classification vertex id in the logs and continue entity search/retrieval. > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Assignee: Sarath Subramanian >Priority: Critical > Attachments: ATLAS-3545.001.patch, Screenshot 2019-11-30 at > 22.16.44.png, Screenshot 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at > 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987301#comment-16987301 ] Sarath Subramanian commented on ATLAS-3545: --- [~bolke] thanks for the repro steps, this is useful. I will investigate this issue. > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Assignee: Sarath Subramanian >Priority: Critical > Attachments: Screenshot 2019-11-30 at 22.16.44.png, Screenshot > 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987118#comment-16987118 ] Bolke de Bruin commented on ATLAS-3545: --- [~ayubpathan] they were included above, but just to get it clear: 1. Add a propagating classification to an entity with a large container (e.g. aws_s3_bucket). 2. Add the same propagating classification again before the UI shows the classification is applied 3. Observe 2 classifications have been applied with the same name 4. Remove one of the propagating classifications 5. A Try to remove the other one(s), this should fail B Observe that the count in the UI basic search view is 1 or higher (e.g. it reads something like MANAGED (2) ) C Try to search for this classification with basic search, this should fail with an error message D Try to read classification properties in the classification view, this should fail E Observer that the propagating classification still is applied to derived entities (e.g. aws_s3_objects) Obviously we are seeing multiple issues here (race condition, null pointer). Our goal is first to remove the “orphan” propagating classification 4. Observer > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Priority: Critical > Attachments: Screenshot 2019-11-30 at 22.16.44.png, Screenshot > 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987104#comment-16987104 ] Ayub Pathan commented on ATLAS-3545: [~bolke] Can you please add the repro steps here? > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Priority: Critical > Attachments: Screenshot 2019-11-30 at 22.16.44.png, Screenshot > 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986354#comment-16986354 ] Bolke de Bruin commented on ATLAS-3545: --- [~madhan] latest screenshot gives a stack trace > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Priority: Critical > Attachments: Screenshot 2019-11-30 at 22.16.44.png, Screenshot > 2019-11-30 at 22.28.00.png, Screenshot 2019-12-02 at 21.43.29.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985659#comment-16985659 ] Bolke de Bruin commented on ATLAS-3545: --- Stack trace is unavailable at the moment as Atlas swallows the exception. We will patch it to make sure the whole trace is available. We are observing 3 separate issues that are related. 1) we set a classification on a aws_s3_bucket with several thousands (200K+) of objects. As the UI wasn’t clear if the classification was applied so we tried it a couple of times. This resulted in the UI displaying it 3 (!) times. We then tried to remove one, which seemed to work but trying to remove the others fails. Moreover, the original classification still seems to be there as we face scaleability issues when updating the aws_s3_bucket in question: it then eagerly fetches all vertices that have a propagating tag which exponentially increases the time spend on this when s3_objects are added. This will be filed separately in a jira. > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Priority: Critical > Attachments: Screenshot 2019-11-30 at 22.16.44.png, Screenshot > 2019-11-30 at 22.28.00.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3545) NullPointerException while trying to delete classification
[ https://issues.apache.org/jira/browse/ATLAS-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16985584#comment-16985584 ] Madhan Neethiraj commented on ATLAS-3545: - [~bolke] - can you please add repro steps and/or stack trace? > NullPointerException while trying to delete classification > -- > > Key: ATLAS-3545 > URL: https://issues.apache.org/jira/browse/ATLAS-3545 > Project: Atlas > Issue Type: Bug >Affects Versions: trunk >Reporter: Bolke de Bruin >Priority: Critical > Attachments: Screenshot 2019-11-30 at 22.16.44.png, Screenshot > 2019-11-30 at 22.28.00.png > > > We see an issue where there is a NullPointerException while trying to delete > a classification that is propagating. > It seems (stack trace is as of yet unavailable) that it is caused due to a > typeName being NULL in AtlasTypeRegistry.getType. The UI looks fishy too see > screenshots. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
