[ https://issues.apache.org/jira/browse/SENTRY-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Na Li updated SENTRY-1964: -------------------------- Resolution: Won't Fix Status: Resolved (was: Patch Available) This approach does not work in some scenario. Need to find other way to reduce the memory usage. > HDFS sync does not need partition locations (usually) > ----------------------------------------------------- > > Key: SENTRY-1964 > URL: https://issues.apache.org/jira/browse/SENTRY-1964 > Project: Sentry > Issue Type: Improvement > Components: Sentry > Affects Versions: 2.0.0 > Reporter: Na Li > Assignee: Na Li > Priority: Critical > Attachments: SENTRY-1964.001.patch, SENTRY-1964.001.patch, > SENTRY-1964.002.patch > > > Right now, sentry saves partition info from HMS and send it to HDFS. HDFS > only needs database and table info, and does not need partition info for ACL > unless the partion location is not sharing the same prefix of its table. > The partition data amount is huge, and causes performance issue. We can > optimize it by not saving and not sending partition info if it shares the > same path of its table. -- This message was sent by Atlassian JIRA (v6.4.14#64029)