Right. What is the underlying Hive table format? Is that Parquet, Avro, ORC
..?
Also do you store your time as raw time in Hive table?
For example this is the way I store timestamp it in an ORC table
TO_DATE(FROM_UNIXTIME(UNIX_TIMESTAMP(TransactionDate,'dd/MM/'),'-MM-dd'))
AS
Hi,
Do you have the equivalent of that operation in pure SQL.
---> This is my hive query: *select count(*) from u_data where unixtime
like '%888904884%'*
Query evaluates and results are correct. But point is that hive does not
give like operator during predicate push down to custom storage
Hi,
Do you have the equivalent of that operation in pure SQL. Also have you
tried Spark query tool with Hive table.
I gather you are doing this through Java?
Dr Mich Talebzadeh
LinkedIn *
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
Thanks Mich,
It does work, but with operators other than '=', '!=', '<', '<=', '>' and
'>=' , my code with custom storage handler gets null expression.
*final String expression = conf.get(TableScanDesc.FILTER_EXPR_CONF_STR); //
expression is null for hive query that has like operator*
Why does
On a normal query using sql in* Hive 2* LIKE predicate works fine. Case in
point in a 1 billion rows table with the column random_string of
varchar(50) I have one row that satisfies the followinh@
Hi All,
I have implemented custom storage-handler and able to get predicates from
hive for '=', '!=', '<', '<=', '>' and '>=' operators.
But I cannot get predicates from hive for 'like', 'between' operators.
Here's my code:
*final String expression =
