Hi Pablo, Phoenix does support predicate pushdown so any filters specified on the data frame will be applied when the actual SELECT query is executed.
You can refer to the test cases at [1] for reference. Thanks Ravi [1] https://github.com/apache/phoenix/blob/master/phoenix-spark/src/it/scala/org/apache/phoenix/spark/PhoenixSparkIT.scala#L260 On Tue, Nov 29, 2016 at 8:23 AM, pablocastilla <[email protected]> wrote: > I would like to know how this exactly works, > > df = sqlContext.read \ > .format("org.apache.phoenix.spark") \ > .option("table", "TABLE") \ > .option("zkUrl", "10.0.0.11:2181:/hbase-unsecure") \ > .load() > > if this is loading the whole table or it will delay the loading to know if > a > filtering will be applied. > > In the first case, how is the way to tell phoenix to filter the table > before > loading in the spark dataframe? > > Thanks > > > > -- > View this message in context: http://apache-phoenix-user- > list.1124778.n5.nabble.com/Filtering-from-phoenix-when- > loading-a-table-tp2940.html > Sent from the Apache Phoenix User List mailing list archive at Nabble.com. >
