Re: Hive On Spark - Using custom SerDe

Hi, How should I set it ? just a normal set in hive or add it via the safety valve to the hive or sparks configuartion? Thank you. Daniel On Mon, Nov 16, 2015 at 5:46 PM, Jimmy Xiang wrote: > Have you add your class to "spark.kryo.classesToRegister"? You also need > to

Re: Hive On Spark - Using custom SerDe

It is better to use safety valve for hive configuration. On Mon, Nov 16, 2015 at 8:03 AM, Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > Hi, > How should I set it ? just a normal set in hive or add it via the safety > valve to the hive or sparks configuartion? > > Thank you. > Daniel >

Re: Hive On Spark - Using custom SerDe

Have you add your class to "spark.kryo.classesToRegister"? You also need to make sure your jar is in ""hive.aux.jars.path". Thanks, Jimmy On Mon, Nov 16, 2015 at 1:44 AM, Daniel Haviv < daniel.ha...@veracity-group.com> wrote: > Hi, > We have a custom SerDe we would like to use with Hive on

hive locking doubt

Hi I have a doubt on hive locking mechanism. I have 0.13 deployed on my cluster. When I create explicit lock using lock table tablename partition(partitionname) exclusive. It acquires lock as expected. I have a requirement to release the lock if hive connection with process who created the lock

override log4j level

Hi, How can I override log4j level by using --hiveconf? I want to use ERROR level for some tasks. Thanks, Patcharee

Re: [VOTE] Hive 2.0 release plan

Including the user list. On 15/11/13, 17:54, "Lefty Leverenz" wrote: >The Hive bylaws require this to be submitted on the user@hive mailing list >(even though users don't get to vote). See Release Plan in Actions

Re: hive locking doubt

You are correct that DbTxnManager does not support the explicit locking of tables. Instead it obtains locks based on SQL statements that are being executed. If you use the DummyTxnManager (the default) and set concurrency to true and the lock manager to ZooKeeperHiveLockManager then your

Re: override log4j level

Hi Patcharee, Use *--hiveconf hive.root.logger=ERROR,console* Regards, Amey On Mon, Nov 16, 2015 at 10:57 PM, pth001 wrote: > Hi, > > How can I override log4j level by using --hiveconf? I want to use ERROR > level for some tasks. > > Thanks, > Patcharee >

Re: [VOTE] Hive 2.0 release plan

With 8 binding +1s and 0 -1s the vote passes. The release activities will now proceed according to the plan. I will look at the features that are targeted at 2.0 release and create the branch ~EOW balancing the waiting for large commits and avoiding too much delay. On 15/11/16, 10:32, "Sergey

ORC tables loading

Hi, I am using Hive 1.2 with ORC tables on Hadoop 2.6 on a cluster. I load data into an ORC table by reading the data from an external table on raw text files and using insert statement: INSERT into TABLE myorctab SELECT * FROM mytxttab; I ran a simple scale-up test to find out how the loading

Hive On Spark - Using custom SerDe

Hi, We have a custom SerDe we would like to use with Hive on Spark but I'm not sure how to. The error messages are pretty clear about the fact that it can't find my SerDE's class: Caused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: Unable to find class:

Failed to create HiveMetaStoreClient object in proxy user with Kerberos enabled

Hi, I wrote a Java client to talk with HiveMetaStore. (Hive 1.2.0) But found that it can't new a HiveMetaStoreClient object successfully via a proxy using in Kerberos env. === 15/10/13 00:14:38 ERROR transport.TSaslTransport: SASL negotiation failure