need input for heavy duty string manipulation

2015-03-15 Thread Devopam Mittra
hi there, Need help / suggestion to formulate a hive-only best feasible/optimized strategy for: - I have a table with list of reserved words - one word per row - I have a string wherein I want to search the presence of each reserve word and take a count of it .e.g: If there are 5 matches

Re: Hive on Spark

2015-03-15 Thread Amith sha
Hi, I have already added the spark-assembly jar in hive lib & here is my hive log 2015-03-16 10:40:08,299 INFO [main]: SessionState (SessionState.java:printInfo(852)) - Added [/opt/spark-1.2.1/assembly/target/scala-2.10/spark-assembly-1.2.1-hadoop2.4.0.jar] to class path 2015-03-16 10:40:08,300

[hive on spark] Jline problem

2015-03-15 Thread wangzhenhua (G)
Hi, all I've deleted jline from the Hadoop lib directory (under hadoop_home/share/hadoop/yarn/lib?), and added "export HADOOP_USER_CLASSPATH_FIRST=true" into hive_home/conf/hive-env.sh, but when hive is started, it shows the following info: [INFO] Unable to bind key for unsupported operation: ba

RE: view over partitioned table

2015-03-15 Thread Mich Talebzadeh
OK, This is the way I read it. Crearte table t1 .. partitioned by date will use horizontal partitioning as per common with any RDBMS say Oracle. The view I will create it as follows: hive> create view v1 as select * from t1; OK Time taken: 0.073 seconds hive> analyze table t1 par

hive script execution

2015-03-15 Thread cobby cohen
hi,can i execute a hive script within another script?

view over partitioned table

2015-03-15 Thread cobby cohen
in the following case: create table T1(id string)partitioned by (date date); create view V1(id, date)select id, date from T1 if i do the followingselect id from V1 where date = '2015-04-04'will the query optimize on T1's partitioning? and what if V1 is a bit more complex, further depending on othe