job submitted but not running

2015-10-08 Thread Mich Talebzadeh
Hi, I am sure you have seen this many times. A simple hive query suddenly sits doing nothing. hive> select count(1) from t; Query ID = hduser_20151008095656_609106f0-d7e9-4d59-bacc-7e437537d9f6 Total jobs = 1 Launching Job 1 out of 1 Number of reduce tasks determined at compile time: 1

Strange HiveConf behaviour

2015-10-08 Thread Elliot West
I've been writing some unit tests around some extensions to Hive recently and came across an issue that left me perplexed. If I execute: System.err.println(new HiveConf().get(FileSystem.FS_DEFAULT_NAME_KEY, FileSystem.DEFAULT_FS)); this prints: core-site.xml I suspect I need to provide a

Hiveserver2 OOM

2015-10-08 Thread Sanjeev Verma
Even having enough heap size my hiveserver2 going outofmemory, I enable heap dump on error which producing 650MB of heap although I have hiveserver2 configured with 8GB Heap. here is the stacktrace of the thread which went in to OOM,could anybody let me know why it throwing OOM "pool-2-thread-4"

RE: Hive 1.2.1 installation troubleshooting - No known driver to handle "jdbc://hive2://:10000"

2015-10-08 Thread Timothy Garza
I should mention that all mentioned .jar files are located in the directories specified with the following privs: -rw-r--r-- 1 hadoop hadoop I’ve installed Hive 1.2.1 on Amazon Linux AMI release 2015.03, master-node of Hadoop cluster. I can successfully access the Beeline client but when

Alias vs Assignment

2015-10-08 Thread Furcy Pin
Hi folks, I would like to start a discussion with the Hive user and developper community about an element of syntax present in SQL Server that could be nice to have in Hive. Back in 2012, before I started Hive, and was using SQL Server, I came accross this post :

Hive 1.2.1 installation troubleshooting - No known driver to handle "jdbc://hive2://:10000"

2015-10-08 Thread Timothy Garza
I’ve installed Hive 1.2.1 on Amazon Linux AMI release 2015.03, master-node of Hadoop cluster. I can successfully access the Beeline client but when I try to connect to Hive-Server2… beeline Ø !connect jdbc://hive2:// :1 org.apache.hive.jdbc.HiveDriver I get the following error: No known

Re: Alias vs Assignment

2015-10-08 Thread Xuefu Zhang
It looks to me that this adds only syntactic suger which doesn't provide much additional value. On the contrary, it might even bring confusion to non-sql-server users. As you have already noted, it's not ISO standard. Writing queries this way actually make them less portable. Personally I'd

Re: truncating tables via hcatalog api?

2015-10-08 Thread Alan Gates
That's correct, HCatClient doesn't provide that feature at this time. It would be easy enough to add if you want to provide a patch for it. Alan. Nathan Bamford October 6, 2015 at 12:14 Hello all, The product I work on using the HCatalog api

Re: Help me, please

2015-10-08 Thread Alan Gates
Seems like the best place to start would be with email to the infra team. Alan. Navis Ryu October 7, 2015 at 0:29 After long vacation, I've found my account on apache JIRA is disabled. I think I've logged in somewhere and forgot to logout or it was just hacked

Re: Hive 1.2.1 installation troubleshooting - No known driver to handle "jdbc://hive2://:10000"

2015-10-08 Thread Nicholas Hakobian
The format of the jdbc connection string should be something like: beeline -u jdbc:hive2://localhost:1 Since you're connecting to localhost you can also try the embedded connection mode by starting beeline like: beeline -u jdbc:hive2:// The connection string format is documented here:

Re: Moving data from one table with a json column to one with a map<string,string>

2015-10-08 Thread Alex Newman
An easier question is how does one even insert into a table with a map insert overwrite table hivetablename select map("sdf","sdf") from table limit 1; gets me Diagnostic Messages for this Task: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:

Re: Hive 1.2.1 installation troubleshooting - No known driver to handle "jdbc://hive2://:10000"

2015-10-08 Thread Jörn Franke
You could edit the beeline script and add the driver there to the classpath Le jeu. 8 oct. 2015 à 16:02, Timothy Garza a écrit : > I’ve installed Hive 1.2.1 on Amazon Linux AMI release 2015.03, master-node > of Hadoop cluster. > > > > I can successfully access

Dynamic partitioned parquet tables

2015-10-08 Thread Yogesh Keshetty
Hello, I have a question regarding parquet tables. We have POS data, we want to store the data on per day partition basis. We sqoop the data into an external table which is in text file format and then try to insert into an external table which is partitioned by date and, due to some

Moving data from one table with a json column to one with a map<string,string>

2015-10-08 Thread Alex Newman
I have a table which has highly nested json which i create with . CREATE EXTERNAL TABLE table1 (item map) STORED BY 'org.apache.hadoop.hive.dynamodb.DynamoDBStorageHandler' TBLPROPERTIES (" dynamodb.table.name" = "..."); I have to have it be a map table because it is