bvaradar commented on issue #647: Revert "Read and apply schema for each log block from the metadata header instead of the latest schema" URL: https://github.com/apache/incubator-hudi/pull/647#issuecomment-484394246 The max timestamp must be 2018-08-31 10:59:00 but it is not 0: jdbc:hive2://hiveserver:10000> select symbol, max(ts) from stock_ticks_mor_rt group by symbol HAVING symbol = 'GOOG'; WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. +---------+----------------------+--+ | symbol | _c1 | +---------+----------------------+--+ | GOOG | 2018-08-31 09:59:00 | +---------+----------------------+--+ 0: jdbc:hive2://hiveserver:10000> select * from stock_ticks_mor_rt where symbol = 'GOOG'; +-----------------------------------------+------------------------------------------+----------------------------------------+--------------------------------------------+----------------------------------------------------------------+----------------------------+------------------------+----------------------------+--------------------------+---------------------------+--------------------------+-------------------------+-------------------------+--------------------------+---------------------------+--------------------------+-------------------------+------------------------+--+ | stock_ticks_mor_rt._hoodie_commit_time | stock_ticks_mor_rt._hoodie_commit_seqno | stock_ticks_mor_rt._hoodie_record_key | stock_ticks_mor_rt._hoodie_partition_path | stock_ticks_mor_rt._hoodie_file_name | stock_ticks_mor_rt.volume | stock_ticks_mor_rt.ts | stock_ticks_mor_rt.symbol | stock_ticks_mor_rt.year | stock_ticks_mor_rt.month | stock_ticks_mor_rt.high | stock_ticks_mor_rt.low | stock_ticks_mor_rt.key | stock_ticks_mor_rt.date | stock_ticks_mor_rt.close | stock_ticks_mor_rt.open | stock_ticks_mor_rt.day | stock_ticks_mor_rt.dt | +-----------------------------------------+------------------------------------------+----------------------------------------+--------------------------------------------+----------------------------------------------------------------+----------------------------+------------------------+----------------------------+--------------------------+---------------------------+--------------------------+-------------------------+-------------------------+--------------------------+---------------------------+--------------------------+-------------------------+------------------------+--+ | 20190418072624 | 20190418072624_0_94 | GOOG_2018-08-31 09 | 2018/08/31 | bb864119-33ea-4dca-ba10-7287c880438e_0_20190418072624.parquet | 6330 | 2018-08-31 09:59:00 | GOOG | 2018 | 08 | 1230.5 | 1230.02 | GOOG_2018-08-31 09 | 2018/08/31 | 1230.02 | 1230.5 | 31 | 2018-08-31 | | 20190418072723 | 20190418072723_0_80 | GOOG_2018-08-31 10 | 2018/08/31 | bb864119-33ea-4dca-ba10-7287c880438e | 9021 | 2018-08-31 10:59:00 | GOOG | 2018 | 08 | 1227.34 | 1227.1993 | GOOG_2018-08-31 10 | 2018/08/31 | 1227.215 | 1227.1993 | 31 | 2018-08-31 | +-----------------------------------------+------------------------------------------+----------------------------------------+--------------------------------------------+----------------------------------------------------------------+----------------------------+------------------------+----------------------------+--------------------------+---------------------------+--------------------------+-------------------------+-------------------------+--------------------------+---------------------------+--------------------------+-------------------------+------------------------+--+
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
