all,
i'm running tez with the sql pattern:
* create table foo as select * from (select... UNION select... UNION
select...)
in the logs the final step is this:
* Moving data to directory hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4
from hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/.hive-staging_hive_2016-12-24_10-05-40_048_4896412314807355668-899/-ext-10002
when querying the table i got zero rows returned which made me curious. so
i queried the hdfs location and see this:
$ hdfs dfs -ls hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4
Found 3 items
drwxrwxrwx - dwr supergroup 0 2016-12-24 10:05 hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/1
drwxrwxrwx - dwr supergroup 0 2016-12-24 10:06 hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/2
drwxrwxrwx - dwr supergroup 0 2016-12-24 10:06 hdfs://
dwrnn1.sv2.trulia.com:8020/user/hive/warehouse/staging.db/tmp_pv_v4c__loc_4/3
and yes the data files are under these three dirs.
so i ask... i'm not used to seeing sub-directories under the tablename
unless the table is partitioned. is this legit? might there be some config
settings i need to set to see this data via sql?
thanks,
Stephen.