[ https://issues.apache.org/jira/browse/PHOENIX-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Daniel Wong updated PHOENIX-4966: --------------------------------- Labels: phoenix-spark spark (was: spark) > Implement unhandledFilters in PhoenixRelation so that spark only evaluates > filters when required > ------------------------------------------------------------------------------------------------ > > Key: PHOENIX-4966 > URL: https://issues.apache.org/jira/browse/PHOENIX-4966 > Project: Phoenix > Issue Type: Improvement > Affects Versions: 4.14.0 > Reporter: Thomas D'Silva > Assignee: Thomas D'Silva > Priority: Major > Labels: phoenix-spark, spark > Fix For: 4.15.0, 5.1.0 > > Attachments: PHOENIX-4966.patch > > > PhoenixRelation does not implement unhandledFilters so the data returned from > a scan is run through filters twice. > {code} > Project [ID#7L] > +- Filter (((isnotnull(COL1#8) && isnotnull(ID#7L)) && (COL1#8 = test_row_1)) > && (ID#7L = 1)) > +- Scan PhoenixRelation(TABLE1,localhost:50068:/hbase,false) > [ID#7L,COL1#8] PushedFilters: [IsNotNull(COL1), IsNotNull(ID), > EqualTo(COL1,test_row_1), EqualTo(ID,1)], ReadSchema: struct<ID:bigint> > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)