Anmol Sundaram created HIVE-28831:
-------------------------------------
Summary: FS Initialisation for SerDeEncodedDataReader &
VectorDeserializeOrcWriter should be based on jobConf
Key: HIVE-28831
URL: https://issues.apache.org/jira/browse/HIVE-28831
Project: Hive
Issue Type: Bug
Components: llap
Affects Versions: 4.1.0
Environment: Passing configs by setting them in Hive code, when using
LLAP IO, these configs are not being honored by the FS being initialized by
{_}SerDeEncodedDataReader{_}. This is because _SerDeEncodedDataReader_ uses
LLAP IO's daemon config, rather than the jobConf (which typically contains
custom set of configs as well).
Reporter: Anmol Sundaram
Similar to what is currently being done in {_}OrcEncodedDataReader{_}, FS
Initialisation for _SerDeEncodedDataReader_ & _VectorDeserializeOrcWriter_
should be based on jobConf rather than {_}daemonConf{_}.
This will ensure that the FileSystems are being initiated with the
configurations being passed as part of _jobConf_ which could be different on a
Job basis instead of LLAP IO's {_}daemonConf{_}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)