Hello All,
I'm creating a storage handler, and I want to get the filter information in
SerDe class.
However, it seems that the filters information are not pushed down into the
Serde.
When I set hive execution engine to MapReduce (MR), I can retrieve the
filter information, but null returns when I use Tez.
Why can't we get the filter information in SerDe when using Tez?
Tez:
in SerDe class:
@Override
public void initialize(Configuration conf, Properties tblProps, Properties
ptnProps) throws SerDeException {
conf.get("hive.io.file.read.all.columns")
-> returns null
..
MR:
in SerDe class:
@Override
public void initialize(Configuration conf, Properties tblProps, Properties
ptnProps) throws SerDeException {
conf.get("hive.io.file.read.all.columns")
-> returns true or false
Thank you,
Aki TANAKA
