[jira] [Commented] (HIVE-10276) Implement date_format(timestamp, fmt) UDF

2015-04-22 Thread Alexander Pivovarov (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507869#comment-14507869
 ] 

Alexander Pivovarov commented on HIVE-10276:


The function description was added to Language Manual
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-DateFunctions

 Implement date_format(timestamp, fmt) UDF
 -

 Key: HIVE-10276
 URL: https://issues.apache.org/jira/browse/HIVE-10276
 Project: Hive
  Issue Type: Improvement
  Components: UDF
Reporter: Alexander Pivovarov
Assignee: Alexander Pivovarov
 Fix For: 1.2.0

 Attachments: HIVE-10276.01.patch


 date_format(date/timestamp/string, fmt) converts a date/timestamp/string to a 
 value of String in the format specified by the java date format fmt.
 Supported formats listed here:
 https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-10276) Implement date_format(timestamp, fmt) UDF

2015-04-22 Thread Alexander Pivovarov (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alexander Pivovarov updated HIVE-10276:
---
Labels:   (was: TODOC1.2)

 Implement date_format(timestamp, fmt) UDF
 -

 Key: HIVE-10276
 URL: https://issues.apache.org/jira/browse/HIVE-10276
 Project: Hive
  Issue Type: Improvement
  Components: UDF
Reporter: Alexander Pivovarov
Assignee: Alexander Pivovarov
 Fix For: 1.2.0

 Attachments: HIVE-10276.01.patch


 date_format(date/timestamp/string, fmt) converts a date/timestamp/string to a 
 value of String in the format specified by the java date format fmt.
 Supported formats listed here:
 https://docs.oracle.com/javase/7/docs/api/java/text/SimpleDateFormat.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-8307) null character in columns.comments schema property breaks jobconf.xml

2015-04-22 Thread Jason Dere (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507960#comment-14507960
 ] 

Jason Dere commented on HIVE-8307:
--

I had created HIVE-10428 and added a patch, but I see that this also relates to 
columns.comments. So this fix will basically revert the changes from HIVE-6681?
Can you re-submit the patch so we can see that the patch still works on trunk?

 null character in columns.comments schema property breaks jobconf.xml
 -

 Key: HIVE-8307
 URL: https://issues.apache.org/jira/browse/HIVE-8307
 Project: Hive
  Issue Type: Bug
  Components: Metastore
Affects Versions: 0.13.0, 0.14.0, 0.13.1
Reporter: Carl Laird
Assignee: Ashutosh Chauhan
 Attachments: HIVE-8307.1.patch, HIVE-8307.2.patch, HIVE-8307.patch


 It would appear that the fix for 
 https://issues.apache.org/jira/browse/HIVE-6681 is causing the null character 
 to show up in job config xml files:
 I get the following when trying to insert into an elasticsearch backed table:
 [Fatal Error] :336:51: Character reference #
 14/06/17 14:40:11 FATAL conf.Configuration: error parsing conf file: 
 org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character 
 reference #
 Exception in thread main java.lang.RuntimeException: 
 org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; Character 
 reference #
 at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1263)
 at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1129)
 at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1063)
 at org.apache.hadoop.conf.Configuration.get(Configuration.java:416)
 at org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:604)
 at org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1273)
 at org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:667)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
 at 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:606)
 at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
 Caused by: org.xml.sax.SAXParseException; lineNumber: 336; columnNumber: 51; 
 Character reference #
 at 
 com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:251)
 at 
 com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:300)
 at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:121)
 at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181)
 ... 11 more
 Execution failed with exit status: 1
 Line 336 of jobconf.xml:
 propertynamecolumns.comments/namevalue#0;#0;#0;#0;#0;#0;#0;#0;#0;#0;#0;#0;/value/property
 See 
 https://groups.google.com/forum/#!msg/mongodb-user/lKbha0SzMP8/jvE8ZrJom4AJ 
 for more discussion.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9824) LLAP: Native Vectorization of Map Join

2015-04-22 Thread Sergey Shelukhin (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sergey Shelukhin updated HIVE-9824:
---
Summary: LLAP: Native Vectorization of Map Join  (was: LLAP: Native 
Vectorization of Map Join so previously CPU bound queries shift their 
bottleneck to I/O and make it possible for the rest of LLAP to shine ;))

 LLAP: Native Vectorization of Map Join
 --

 Key: HIVE-9824
 URL: https://issues.apache.org/jira/browse/HIVE-9824
 Project: Hive
  Issue Type: Sub-task
Reporter: Matt McCline
Assignee: Matt McCline
Priority: Critical
 Attachments: HIVE-9824.01.patch, HIVE-9824.02.patch, 
 HIVE-9824.04.patch, HIVE-9824.06.patch, HIVE-9824.07.patch, 
 HIVE-9824.08.patch, HIVE-9824.09.patch


 Today's VectorMapJoinOperator is a pass-through that converts each row from a 
 vectorized row batch in a Java Object[] row and passes it to the 
 MapJoinOperator superclass.
 This enhancement creates specialized vectorized map join operator classes 
 that are optimized.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10382) Aggregate stats cache for RDBMS based metastore codepath

2015-04-22 Thread Vaibhav Gumashta (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14508094#comment-14508094
 ] 

Vaibhav Gumashta commented on HIVE-10382:
-

[~thejas] [~mmokhtar] thanks for feedback on RB. In addition to that, as 
discussed offline, it is better to have the user specify a memory size for the 
cache rather than number of objects. I'll have a new patch soon.

 Aggregate stats cache for RDBMS based metastore codepath
 

 Key: HIVE-10382
 URL: https://issues.apache.org/jira/browse/HIVE-10382
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Affects Versions: 1.2.0
Reporter: Vaibhav Gumashta
Assignee: Vaibhav Gumashta
 Fix For: 1.2.0

 Attachments: HIVE-10382.1.patch, HIVE-10382.1.patch


 Similar to the work done on the HBase branch (HIVE-9693), the stats cache can 
 potentially have performance gains.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10403) Add n-way join support for Hybrid Grace Hash Join

2015-04-22 Thread Wei Zheng (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506609#comment-14506609
 ] 

Wei Zheng commented on HIVE-10403:
--

Sure, I will add one when the patch is stable.

 Add n-way join support for Hybrid Grace Hash Join
 -

 Key: HIVE-10403
 URL: https://issues.apache.org/jira/browse/HIVE-10403
 Project: Hive
  Issue Type: Improvement
Affects Versions: 1.2.0
Reporter: Wei Zheng
Assignee: Wei Zheng
 Attachments: HIVE-10403.01.patch


 Currently Hybrid Grace Hash Join only supports 2-way join (one big table and 
 one small table). This task will enable n-way join (one big table and 
 multiple small tables).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-10403) Add n-way join support for Hybrid Grace Hash Join

2015-04-22 Thread Wei Zheng (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-10403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wei Zheng updated HIVE-10403:
-
Attachment: HIVE-10403.02.patch

Upload patch 02 for testing

 Add n-way join support for Hybrid Grace Hash Join
 -

 Key: HIVE-10403
 URL: https://issues.apache.org/jira/browse/HIVE-10403
 Project: Hive
  Issue Type: Improvement
Affects Versions: 1.2.0
Reporter: Wei Zheng
Assignee: Wei Zheng
 Attachments: HIVE-10403.01.patch, HIVE-10403.02.patch


 Currently Hybrid Grace Hash Join only supports 2-way join (one big table and 
 one small table). This task will enable n-way join (one big table and 
 multiple small tables).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10417) Parallel Order By return wrong results for partitioned tables

2015-04-22 Thread Nemon Lou (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506648#comment-14506648
 ] 

Nemon Lou commented on HIVE-10417:
--

There are 2 major issues in ExecDriver's handleSampling method
1, mWork.getPartitionDescs() desn't return enough number of PartitionDescs
2, job's inputdir is overwritten during samping

 Parallel Order By return wrong results for partitioned tables
 -

 Key: HIVE-10417
 URL: https://issues.apache.org/jira/browse/HIVE-10417
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.14.0, 0.13.1, 1.0.0
Reporter: Nemon Lou
Assignee: Nemon Lou

 Following is the script that reproduce this bug.
 set hive.optimize.sampling.orderby=true;
 set mapreduce.job.reduces=10;
 select * from src order by key desc limit 10;
 +--++
 | src.key  | src.value  |
 +--++
 | 98   | val_98 |
 | 98   | val_98 |
 | 97   | val_97 |
 | 97   | val_97 |
 | 96   | val_96 |
 | 95   | val_95 |
 | 95   | val_95 |
 | 92   | val_92 |
 | 90   | val_90 |
 | 90   | val_90 |
 +--++
 10 rows selected (47.916 seconds)
 reset;
 create table src_orc_p (key string ,value string )
 partitioned by (kp string)
 stored as orc
 tblproperties(orc.compress=SNAPPY);
 set hive.exec.dynamic.partition.mode=nonstrict;
 set hive.exec.max.dynamic.partitions.pernode=1;
 set hive.exec.max.dynamic.partitions=1;
 insert into table src_orc_p partition(kp) select *,substring(key,1) from src 
 distribute by substring(key,1);
 set mapreduce.job.reduces=10;
 set hive.optimize.sampling.orderby=true;
 select * from src_orc_p order by key desc limit 10;
 ++--+-+
 | src_orc_p.key  | src_orc_p.value  | src_orc_p.kend  |
 ++--+-+
 | 0  | val_0| 0   |
 | 0  | val_0| 0   |
 | 0  | val_0| 0   |
 ++--+-+
 3 rows selected (39.861 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-10416) CBO (Calcite Return Path): Fix return columns if Sort operator is on top of plan returned by Calcite

2015-04-22 Thread Jesus Camacho Rodriguez (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-10416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jesus Camacho Rodriguez updated HIVE-10416:
---
Attachment: HIVE-10416.01.patch

New patch addresses [~jpullokkaran] and [~ashutoshc] comments.

 CBO (Calcite Return Path): Fix return columns if Sort operator is on top of 
 plan returned by Calcite
 

 Key: HIVE-10416
 URL: https://issues.apache.org/jira/browse/HIVE-10416
 Project: Hive
  Issue Type: Sub-task
  Components: CBO
Reporter: Jesus Camacho Rodriguez
Assignee: Jesus Camacho Rodriguez
 Fix For: 1.2.0

 Attachments: HIVE-10416.01.patch, HIVE-10416.patch


 When return path is on, if the plan's top operator is a Sort, we need to 
 produce a SelectOp that will output exactly the columns needed by the FS.
 The following query reproduces the problem:
 {noformat}
 select cbo_t3.c_int, c, count(*)
 from (select key as a, c_int+1 as b, sum(c_int) as c from cbo_t1
 where (cbo_t1.c_int + 1 = 0) and (cbo_t1.c_int  0 or cbo_t1.c_float = 0)
 group by c_float, cbo_t1.c_int, key order by a) cbo_t1
 join (select key as p, c_int+1 as q, sum(c_int) as r from cbo_t2
 where (cbo_t2.c_int + 1 = 0) and (cbo_t2.c_int  0 or cbo_t2.c_float = 0)
 group by c_float, cbo_t2.c_int, key order by q/10 desc, r asc) cbo_t2 on 
 cbo_t1.a=p
 join cbo_t3 on cbo_t1.a=key
 where (b + cbo_t2.q = 0) and (b  0 or c_int = 0)
 group by cbo_t3.c_int, c order by cbo_t3.c_int+c desc, c;
 {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9824) LLAP: Native Vectorization of Map Join so previously CPU bound queries shift their bottleneck to I/O and make it possible for the rest of LLAP to shine ;)

2015-04-22 Thread Matt McCline (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matt McCline updated HIVE-9824:
---
Attachment: HIVE-9824.09.patch

Improve some error messages.

 LLAP: Native Vectorization of Map Join so previously CPU bound queries shift 
 their bottleneck to I/O and make it possible for the rest of LLAP to shine ;)
 --

 Key: HIVE-9824
 URL: https://issues.apache.org/jira/browse/HIVE-9824
 Project: Hive
  Issue Type: Sub-task
Reporter: Matt McCline
Assignee: Matt McCline
Priority: Critical
 Attachments: HIVE-9824.01.patch, HIVE-9824.02.patch, 
 HIVE-9824.04.patch, HIVE-9824.06.patch, HIVE-9824.07.patch, 
 HIVE-9824.08.patch, HIVE-9824.09.patch


 Today's VectorMapJoinOperator is a pass-through that converts each row from a 
 vectorized row batch in a Java Object[] row and passes it to the 
 MapJoinOperator superclass.
 This enhancement creates specialized vectorized map join operator classes 
 that are optimized.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10417) Parallel Order By return wrong results for partitioned tables

2015-04-22 Thread Nemon Lou (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506650#comment-14506650
 ] 

Nemon Lou commented on HIVE-10417:
--

Issue 1 raise the following error and makes sampling failed:
{quote}
2015-04-21 17:23:48,425 | ERROR | HiveServer2-Background-Pool: Thread-771 | 
Sampling error | 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:389)
java.io.IOException: java.util.NoSuchElementException
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:636)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:534)
at 
org.apache.hadoop.hive.ql.exec.PartitionKeySampler$FetchSampler.pushRow(PartitionKeySampler.java:153)
at 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.handleSampling(ExecDriver.java:552)
at 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.execute(ExecDriver.java:382)
at 
org.apache.hadoop.hive.ql.exec.mr.MapRedTask.execute(MapRedTask.java:160)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1549)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1318)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1136)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:959)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:954)
at 
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:157)
at 
org.apache.hive.service.cli.operation.SQLOperation.access$000(SQLOperation.java:72)
at 
org.apache.hive.service.cli.operation.SQLOperation$1$1.run(SQLOperation.java:231)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1612)
at 
org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:493)
at 
org.apache.hive.service.cli.operation.SQLOperation$1.run(SQLOperation.java:241)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.NoSuchElementException
at java.util.ArrayList$Itr.next(ArrayList.java:834)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextPath(FetchOperator.java:364)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:389)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:465)
at 
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:561)
... 25 more
{quote}

 Parallel Order By return wrong results for partitioned tables
 -

 Key: HIVE-10417
 URL: https://issues.apache.org/jira/browse/HIVE-10417
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.14.0, 0.13.1, 1.0.0
Reporter: Nemon Lou
Assignee: Nemon Lou

 Following is the script that reproduce this bug.
 set hive.optimize.sampling.orderby=true;
 set mapreduce.job.reduces=10;
 select * from src order by key desc limit 10;
 +--++
 | src.key  | src.value  |
 +--++
 | 98   | val_98 |
 | 98   | val_98 |
 | 97   | val_97 |
 | 97   | val_97 |
 | 96   | val_96 |
 | 95   | val_95 |
 | 95   | val_95 |
 | 92   | val_92 |
 | 90   | val_90 |
 | 90   | val_90 |
 +--++
 10 rows selected (47.916 seconds)
 reset;
 create table src_orc_p (key string ,value string )
 partitioned by (kp string)
 stored as orc
 tblproperties(orc.compress=SNAPPY);
 set hive.exec.dynamic.partition.mode=nonstrict;
 set hive.exec.max.dynamic.partitions.pernode=1;
 set hive.exec.max.dynamic.partitions=1;
 insert into table src_orc_p partition(kp) select *,substring(key,1) from src 
 distribute by substring(key,1);
 set mapreduce.job.reduces=10;
 set hive.optimize.sampling.orderby=true;
 select * from src_orc_p order by key desc limit 10;
 ++--+-+
 | src_orc_p.key  | src_orc_p.value  | src_orc_p.kend  |
 ++--+-+
 | 0   

[jira] [Commented] (HIVE-10324) Hive metatool should take table_param_key to allow for changes to avro serde's schema url key

2015-04-22 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506693#comment-14506693
 ] 

Lefty Leverenz commented on HIVE-10324:
---

[~Ferd], a first draft of the metatool doc is ready for review in the wiki:

* [Hive MetaTool | 
https://cwiki.apache.org/confluence/display/Hive/Hive+MetaTool]

 Hive metatool should take table_param_key to allow for changes to avro 
 serde's schema url key
 -

 Key: HIVE-10324
 URL: https://issues.apache.org/jira/browse/HIVE-10324
 Project: Hive
  Issue Type: Bug
  Components: Metastore
Affects Versions: 1.1.0
Reporter: Szehon Ho
Assignee: Ferdinand Xu
 Fix For: 1.2.0

 Attachments: HIVE-10324.1.patch, HIVE-10324.patch, 
 HIVE-10324.patch.WIP


 HIVE-3443 added support to change the serdeParams from 'metatool 
 updateLocation' command.
 However, in avro it is possible to specify the schema via the tableParams:
 {noformat}
 CREATE  TABLE `testavro`(
   `test` string COMMENT 'from deserializer')
 ROW FORMAT SERDE 
   'org.apache.hadoop.hive.serde2.avro.AvroSerDe' 
 STORED AS INPUTFORMAT 
   'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' 
 OUTPUTFORMAT 
   'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
 TBLPROPERTIES (
   'avro.schema.url'='hdfs://namenode:8020/tmp/test.avsc', 
   'kite.compression.type'='snappy', 
   'transient_lastDdlTime'='1427996456')
 {noformat}
 Hence for those tables the 'metatool updateLocation' will not help.
 This is necessary in case like upgrade the namenode to HA where the absolute 
 paths have changed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10435) Make HiveSession implementation pluggable through configuration

2015-04-22 Thread Amareshwari Sriramadasu (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506692#comment-14506692
 ] 

Amareshwari Sriramadasu commented on HIVE-10435:


Usecase :
In Apache Lens, we would like to use CLIService and SessionManager directly and 
give an implementation as LensSessionImpl.

Here is a commit on forked repo of hive - 
https://github.com/InMobi/hive/commit/ed79ba365cfff4cc485d4ffb546453472c25ca86. 
If nobody objects, we would like to port it into hive itself.

 Make HiveSession implementation pluggable through configuration
 ---

 Key: HIVE-10435
 URL: https://issues.apache.org/jira/browse/HIVE-10435
 Project: Hive
  Issue Type: Improvement
  Components: HiveServer2
Reporter: Amareshwari Sriramadasu

 SessionManager in CLIService creates and keeps track of HiveSession. 
 Right now, it creates HiveSessionImpl which is one implementation of 
 HiveSession. This improvement request is to make it pluggable through a 
 configuration sothat other implementations can be passed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-10403) Add n-way join support for Hybrid Grace Hash Join

2015-04-22 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-10403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14506697#comment-14506697
 ] 

Hive QA commented on HIVE-10403:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12727151/HIVE-10403.02.patch

{color:red}ERROR:{color} -1 due to 17 failed/errored test(s), 8729 tests 
executed
*Failed tests:*
{noformat}
TestMinimrCliDriver-bucketmapjoin6.q-constprog_partitioner.q-infer_bucket_sort_dyn_part.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-external_table_with_space_in_location_path.q-infer_bucket_sort_merge.q-auto_sortmerge_join_16.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-groupby2.q-import_exported_table.q-bucketizedhiveinputformat.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-index_bitmap3.q-stats_counter_partitioned.q-temp_table_external.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-infer_bucket_sort_map_operators.q-join1.q-bucketmapjoin7.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-infer_bucket_sort_num_buckets.q-disable_merge_for_bucketing.q-uber_reduce.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q-scriptfile1.q-scriptfile1_win.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-leftsemijoin_mr.q-load_hdfs_file_with_space_in_the_name.q-root_dir_external_table.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-list_bucket_dml_10.q-bucket_num_reducers.q-bucket6.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-load_fs2.q-file_with_header_footer.q-ql_rewrite_gbtoidx_cbo_1.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-parallel_orderby.q-reduce_deduplicate.q-ql_rewrite_gbtoidx_cbo_2.q-and-1-more
 - did not produce a TEST-*.xml file
TestMinimrCliDriver-ql_rewrite_gbtoidx.q-smb_mapjoin_8.q - did not produce a 
TEST-*.xml file
TestMinimrCliDriver-schemeAuthority2.q-bucket4.q-input16_cc.q-and-1-more - did 
not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udaf_histogram_numeric
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_auto_sortmerge_join_13
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_join_hash
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_smb_main
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3525/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/3525/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-3525/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 17 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12727151 - PreCommit-HIVE-TRUNK-Build

 Add n-way join support for Hybrid Grace Hash Join
 -

 Key: HIVE-10403
 URL: https://issues.apache.org/jira/browse/HIVE-10403
 Project: Hive
  Issue Type: Improvement
Affects Versions: 1.2.0
Reporter: Wei Zheng
Assignee: Wei Zheng
 Attachments: HIVE-10403.01.patch, HIVE-10403.02.patch


 Currently Hybrid Grace Hash Join only supports 2-way join (one big table and 
 one small table). This task will enable n-way join (one big table and 
 multiple small tables).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


<    1   2