RE: Query fails if condition placed on Parquet struct field

2016-05-03 Thread Markovitz, Dudu
Hi Can you send the execution plans of both versions? Thanks Dudu From: Jose Rozanec [mailto:jose.roza...@mercadolibre.com] Sent: Tuesday, May 03, 2016 11:13 PM To: Haas, Nichole Cc: user@hive.apache.org Subject: Re: Query fails if condition placed on Parquet struct field Hi! Is not due to

Re: Query fails if condition placed on Parquet struct field

2016-05-03 Thread Jose Rozanec
Hi! Is not due to memory allocation. I found that I am able to perform que query ok, if I rewrite it as: select *a.user_agent* from (SELECT *device.user_agent* as *user_agent* FROM sometable WHERE ds >= '2016-03-30 00' AND ds <= '2016-03-30 01')a where *a.user_agent* LIKE 'Mozilla%' LIMIT 1; I

Re: Query fails if condition placed on Parquet struct field

2016-05-03 Thread Haas, Nichole
What are you memory allocations set to? When using something as expensive as LIKE and a date range together, I often have to increase my standard memory allocation. Try changing your memory allocation settings to: Key: ​mapreduce.map.memory.mb​ Value: ​2048​ and Key: ​mapreduce.map.java.opts​