[ https://issues.apache.org/jira/browse/SPARK-12476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Takeshi Yamamuro updated SPARK-12476: ------------------------------------- Description: Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' {code} Current plan: == Optimized Logical Plan == Project [col0#0,col1#1] +- Filter (col0#0 = xxx) +- Relation[col0#0,col1#1] JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver}) == Physical Plan == +- Filter (col0#0 = xxx) +- Scan JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver})[col0#0,col1#1] PushedFilters: [EqualTo(col0,xxx)] {code} This patch enables a plan below; {code} == Optimized Logical Plan == Project [col0#0,col1#1] +- Filter (col0#0 = xxx) +- Relation[col0#0,col1#1] JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver}) == Physical Plan == +- Filter (col0#0 = xxx) +- Scan JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver})[col0#0,col1#1] PushedFilters: [EqualTo(col0,xxx)] {code} was: Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' {code} Current plan: == Optimized Logical Plan == Project [col0#0,col1#1] +- Filter (col0#0 = xxx) +- Relation[col0#0,col1#1] JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver}) == Physical Plan == +- Filter (col0#0 = xxx) +- Scan JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver})[col0#0,col1#1] PushedFilters: [EqualTo(col0,xxx)] {code} This patch enables a plan below; ``` == Optimized Logical Plan == Project [col0#0,col1#1] +- Filter (col0#0 = xxx) +- Relation[col0#0,col1#1] JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver}) == Physical Plan == +- Filter (col0#0 = xxx) +- Scan JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, password=, driver=org.postgresql.Driver})[col0#0,col1#1] PushedFilters: [EqualTo(col0,xxx)] ``` > Implement JdbcRelation#unhandledFilters for removing unnecessary Spark Fileter > ------------------------------------------------------------------------------ > > Key: SPARK-12476 > URL: https://issues.apache.org/jira/browse/SPARK-12476 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Takeshi Yamamuro > > Input: SELECT * FROM jdbcTable WHERE col0 = 'xxx' > {code} > Current plan: > == Optimized Logical Plan == > Project [col0#0,col1#1] > +- Filter (col0#0 = xxx) > +- Relation[col0#0,col1#1] > JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, > password=, driver=org.postgresql.Driver}) > == Physical Plan == > +- Filter (col0#0 = xxx) > +- Scan > JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, > password=, driver=org.postgresql.Driver})[col0#0,col1#1] PushedFilters: > [EqualTo(col0,xxx)] > {code} > This patch enables a plan below; > {code} > == Optimized Logical Plan == > Project [col0#0,col1#1] > +- Filter (col0#0 = xxx) > +- Relation[col0#0,col1#1] > JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, > password=, driver=org.postgresql.Driver}) > == Physical Plan == > +- Filter (col0#0 = xxx) > +- Scan > JDBCRelation(jdbc:postgresql:postgres,testRel,[Lorg.apache.spark.Partition;@2ac7c683,{user=maropu, > password=, driver=org.postgresql.Driver})[col0#0,col1#1] PushedFilters: > [EqualTo(col0,xxx)] > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org