Re: Trying to create an HBase Table using HCatalog

2014-06-24 Thread D K
Can you change the storage handler classname in your query from "org.apache.hive.hcatalog.hbase.HBaseHCatStorageHandler" to "org.apache.hcatalog.hbase.HBaseHCatStorageHandler" and try? -Deepesh On Tue, Jun 24, 2014 at 12:40 PM, Carlotta Hicks wrote: > I am submitting the following with HCatal

Re: hive/hbase integration

2014-06-24 Thread D K
If the MR job is failing can you try the following on Hive CLI before running the query? add jar $HBASE_HOME/lib/hbase-client--hadoop2.jar; add jar $HBASE_HOME/lib/hbase-protocol--hadoop2.jar; add jar $HBASE_HOME/lib/hbase-server--hadoop2.jar; add jar $HBASE_HOME/lib/htrace-core-2.01.jar replace

Re: Storage handler guidance

2014-06-24 Thread Dean Arnold
Nevermind, after scraping the sources I found the relevant bits to answer my own question. InputFormat generates arbitrary InputSplit's which define the partitioning of input data sources, and OutputFormat's just get spun up in mappers/reducers, resulting in implicit partitioning. On Thu, Jun 19

回复:Reg: Merging Rows

2014-06-24 Thread snv
select id, SUM(COALESCE(col1, 0))‍, SUM(COALESCE(col2, 0))‍, SUM(COALESCE(col3, 0))‍, SUM(COALESCE(col4, 0)) from example group by id ‍ -- 原始邮件 -- 发件人: "usha hive";; 发送时间: 2014年6月25日(星期三) 凌晨4:23 收件人: "user"; 主题: Reg: Merging Rows Hi, I am trying to merg

Re: Reg: Merging Rows

2014-06-24 Thread Andre Araujo
...SUM(COALESCE(col1, 0)), ... On 25 June 2014 08:01, Krishnan Narayanan wrote: > Try coalesce > > > On Tue, Jun 24, 2014 at 2:49 PM, sumit ghosh wrote: > >> Did you try sum(col1), sum(col2) ... group by id >> >> >> On Tuesday, 24 June 2014 1:23 PM, usha hive wrote: >> >> >> Hi, >> >> I

Re: Reg: Merging Rows

2014-06-24 Thread Krishnan Narayanan
Try coalesce On Tue, Jun 24, 2014 at 2:49 PM, sumit ghosh wrote: > Did you try sum(col1), sum(col2) ... group by id > > > On Tuesday, 24 June 2014 1:23 PM, usha hive wrote: > > > Hi, > > I am trying to merge few rows in to 1 row. I am stuck. Please help me. > > Example > id col1 col2

Re: Reg: Merging Rows

2014-06-24 Thread sumit ghosh
Did you try sum(col1), sum(col2) ...   group by id  On Tuesday, 24 June 2014 1:23 PM, usha hive wrote: Hi, I am trying to merge few rows in to 1 row. I am stuck. Please help me. Example id  col1      col2      col3        col4  1   44       NULL    NULL    NULL 1  NULL     37       NULL

Reg: Merging Rows

2014-06-24 Thread usha hive
Hi, I am trying to merge few rows in to 1 row. I am stuck. Please help me. Example id col1 col2 col3col4 1 44 NULLNULLNULL 1 NULL 37 NULL NULL 1 NULLNULL 88NULL 1 NULLNULL NULL99 to id col1 col2 col3co

edit permissions to wiki

2014-06-24 Thread Nitin Pawar
Hi, can someone add me to hive wiki editors? My userid is : nitinpawar432 -- Nitin Pawar

Trying to create an HBase Table using HCatalog

2014-06-24 Thread Carlotta Hicks
I am submitting the following with HCatalog: CREATE TABLE usTestHB (fname string, lname string, cname string) STORED BY 'org.apache.hive.hcatalog.hbase.HBaseHCatStorageHandler ' TBLPROPERTIES ( 'hbase.table.name'='usTest', 'hbase.columns.mapping'='fname:fname, lname:lname, cname:cname' ); but I k

Re: how to load json with nested array into hive?

2014-06-24 Thread Christian Link
ok - same results...so at least this seems to be stable ;) I try to find a clever way to get the values of "integrations". On Tue, Jun 24, 2014 at 12:37 PM, Christian Link wrote: > Nope! > Still not working...new error > > Caused by: java.lang.ClassCastException: > org.apache.hadoop.io.DoubleW

Re: how to load json with nested array into hive?

2014-06-24 Thread Christian Link
Nope! Still not working...new error Caused by: java.lang.ClassCastException: org.apache.hadoop.io.DoubleWritable cannot be cast to org.apache.hadoop.hive.serde2.io.DoubleWritable Caused by query: SELECT DISTINCT a.context.device.brand as brand, a.context.device.manufacturer as manufacturer,

Re: how to load json with nested array into hive?

2014-06-24 Thread Christian Link
I've got 1.1.9.2 (thanks to Roberto) and the data is looking better... I'll test the "doubel/int" thingie, now. Best, Chris On Mon, Jun 23, 2014 at 8:51 PM, Swagatika Tripathy wrote: > Hi, > Use 1.9.3 Jason serde with dependencies jar. Its the latest one I suppose. > > Thanks > Swagatika > On