TestMiniAccumuloCliDriver hangs

Hi. Seems like something has broken MiniAccumulo tests, making them time out; that, in turn, makes the whole HiveQA run slower. Anyone familiar with Accumulo stuff? I’ve heard rumors that it might get removed as a first class part of Hive in 3.0, should we just disable the test? I cannot find any

Review Request 34443: HIVE-10723 better logging/etc. for stuck metastore

/apache/hadoop/hive/ql/exec/DefaultFetchFormatter.java 37852ef ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java 20d0304 Diff: https://reviews.apache.org/r/34443/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 34443: HIVE-10723 better logging/etc. for stuck metastore

/TUGIBasedProcessor.java ec8d608 ql/src/java/org/apache/hadoop/hive/ql/exec/DefaultFetchFormatter.java 37852ef ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java 20d0304 Diff: https://reviews.apache.org/r/34443/diff/ Testing --- Thanks, Sergey Shelukhin

Re: [DISCUSS] Supporting Hadoop-1 and experimental features

posal is the opportunity to evaluate and >clean up alot of the old code. >Thanks, >chris > > > > On Monday, May 18, 2015 11:48 AM, Sergey Shelukhin > wrote: > > > Note: by “cannot” I mean “are unwilling to”; upgrade paths exist, but >some >people are set

Re: [VOTE] Stable releases from branch-1 and experimental releases from master

+1. I want to clarify about being not production ready though. That shouldn’t mean known shortage of functionality (other than the deprecated parts like hadoop-1), imho, just the fact that they are recent with big features enabled. They should be production ready modulo the higher expected bug coun

Re: How to debug hive unit test in eclipse ?

-Dmaven.surefire.debug when you run a test. Then attach eclipse to remote process on port 5005 (default). Breakpoints will be hit in unit tests and regular q file tests. In MiniMr/MiniTez/etc., not sure. On 14/12/16, 00:17, "Jeff Zhang" wrote: >The wiki page looks like already out-dated, >https:

normalizing spark tarball dependency in Hive build

Hi. I was trying to build Hive on a slow connection (or I could have no connection for that matter), and pulling "http://d3jw87u4immizc.cloudfront.net/spark-tarball/spark-1.3.0-bin-hadoop2 -without-hive.tgz” was taking forever (I ctrl-c-ed it eventually). On a good note it did appear to respect “-o

Re: normalizing spark tarball dependency in Hive build

ed anywhere in public maven repositories. That's why we hosted it >at >cloudfront. > >I think this is a general problem for any binaries required by tests. We >are open to suggestions though. > >Thanks, >Xuefu > >On Tue, May 26, 2015 at 1:35 PM, Sergey Shelukhin

Re: Big Lock in Driver.compileInternal

Hi. As luck would have it, we are currently looking at this issue :) I have a small patch up at https://issues.apache.org/jira/browse/HIVE-4239; I tested it a bit w/a unit test and some manual cluster testing. Would you be willing to test it on your setup? On 15/5/25, 20:54, "Loudongfeng" wrote:

Review Request 34776: HIVE-4239 : Remove lock on compilation stage

/HiveServer2.java 58e8e49 service/src/test/org/apache/hive/service/cli/CLIServiceTest.java b4d517f Diff: https://reviews.apache.org/r/34776/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Slow JIRA

Same here. On 15/5/28, 13:45, "Xuefu Zhang" wrote: >Anyone else found JIRA site is extremely slow? Loading a single JIRA takes >a long time, and not to mention doing a search. > >Has this been reported yet? I'm having the problem since yesterday. > >Thanks, >Xuefu

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

, Sergey Shelukhin

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

/HiveSessionImplwithUGI.java a29e5d1 service/src/java/org/apache/hive/service/server/HiveServer2.java 58e8e49 service/src/test/org/apache/hive/service/cli/CLIServiceTest.java b4d517f testutils/ptest/hivetest.py ccc4537 Diff: https://reviews.apache.org/r/34776/diff/ Testing --- Thanks, Sergey

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

service/src/test/org/apache/hive/service/cli/CLIServiceTest.java b4d517f Diff: https://reviews.apache.org/r/34776/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34776/#review86129 --- On June 1, 2015, 8:25 p.m., Sergey Shelukhin wrote: > > --

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

service/src/test/org/apache/hive/service/cli/CLIServiceTest.java b4d517f Diff: https://reviews.apache.org/r/34776/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

cal. - Sergey --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/34776/#review86144 --- On June 2, 2015, 12:53 a.m., Se

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

b4d517f Diff: https://reviews.apache.org/r/34776/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Creating branch-1

Meanwhile, should we switch trunk HiveQA builds to use hadoop-2 profile? I see they are still running hadoop-1 :) From: Vinod Kumar Vavilapalli mailto:vino...@hortonworks.com>> Reply-To: "dev@hive.apache.org" mailto:dev@hive.apache.org>> Date: Wednesday, June 3, 2015

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

rg/apache/hadoop/hive/ql/parse/GenTezWork.java 6db8220 > ql/src/java/org/apache/hadoop/hive/ql/parse/TezCompiler.java 56707af > ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 37b6d6f > service/src/java/org/apache/hive/service/cli/session/HiveSessionImpl.java > 343c68e > > service/src/java/org/apache/hive/service/cli/session/HiveSessionImplwithUGI.java > a29e5d1 > service/src/test/org/apache/hive/service/cli/CLIServiceTest.java b4d517f > > Diff: https://reviews.apache.org/r/34776/diff/ > > > Testing > --- > > > Thanks, > > Sergey Shelukhin > >

Re: Review Request 35181: HIVE-10944 : Fix HS2 for Metrics

<https://reviews.apache.org/r/35181/#comment139315> nit: getInstance could be called once - Sergey Shelukhin On June 7, 2015, 11:47 p.m., Szehon Ho wrote: > > --- > This is an automatically generated e-mail. To reply,

Re: [ANNOUNCE] New Hive PMC Members - Chao Sun and Gopal Vijayaraghavan

Congrats! On 15/6/12, 09:30, "Eugene Koifman" wrote: >congratulations! > >On 6/10/15, 5:39 PM, "Xu, Cheng A" wrote: > >>Congrats！ >> >>-Original Message- >>From: Naveen Gangam [mailto:ngan...@cloudera.com] >>Sent: Thursday, June 11, 2015 8:30 AM >>To: dev@hive.apache.org >>Subject: Re:

Re: Review Request 34776: HIVE-4239 : Remove lock on compilation stage

b4d517f Diff: https://reviews.apache.org/r/34776/diff/ Testing --- Thanks, Sergey Shelukhin

problems running spark tests

Hi. I am trying to run TestSparkCliDriver. 1) Spark tests do not appear to support specifying a query like other tests; when I run mvn test -Phadoop-2 -Dtest=TestSparkCliDriver tests run, but with mvn test -Phadoop-2 -Dtest=TestSparkCliDriver -Dqfile=foo.q,bar.q,.. test just instantly succeeds w/

Re: problems running spark tests

t. > >I haven't seen that error, did you run from itests directory? There are >some steps in pom to copy over the spark scripts needed to run, that look >like they were skipped as that script is not available in your run. > >Thanks >Szehon > >On Thu, Jul 2, 2015 at 10

is HiveQA broken?

Looks like all the runs are failing with: Exception in thread "main" java.lang.RuntimeException: 404 Not Found at org.apache.hive.ptest.api.client.PTestClient.downloadTestResults(PTestClien t.java:181) at org.apache.hive.ptest.api.client.PTestClient.testStart(PTestClient.java:129

Re: is HiveQA broken?

er. > >On Mon, Jul 6, 2015 at 1:02 PM, Sergey Shelukhin >wrote: > >> Looks like all the runs are failing with: >> >> Exception in thread "main" java.lang.RuntimeException: 404 Not Found >> at >> >>org.apache.hive.ptest.api.client.PTe

Re: is HiveQA broken?

15/7/6, 19:03, "Sergey Shelukhin" wrote: >Looks like last HiveQA failed again in the same way, not sure if it was >before or after restart, what time zone is it in? >May that be related to recent Apache infra build changes? > >On 15/7/6, 17:24, "Szehon Ho" wro

Re: Only a small subset of Hive UTs are executed when running mvn test

Can you file a bug? I noticed this too under itests when trying to run q file tests locally when HiveQA was down. On 15/7/9, 17:59, "Eugene Koifman" wrote: >I¹ve noticed that not all test are run. > >For example ³mvn test -Phadoop-2² from ql/ only runs 30-40 Test*.java >files while there are 245

Re: [Discuss] Patch submission and commit format

The existing approach appears to be “HIVE-X : fix the bugs (John Doe, reviewed by John Smith)” or something like that in the commit message. I think the new approach is better… +1 Can you create a detailed instruction? Is it enforceable in git? On 15/7/10, 11:08, "Ashutosh Chauhan" wrote: >T

Re: [ANNOUNCE] New Hive Committer - Pengcheng Xiong

Congrats! On 15/7/16, 13:50, "Lefty Leverenz" wrote: >Kudos to Pengcheng! > >-- Lefty > >On Thu, Jul 16, 2015 at 2:44 PM, Sushanth Sowmyan >wrote: > >> Congrats, Pengcheng! >> On Jul 16, 2015 11:17, "Prasanth Jayachandran" < >> pjayachand...@hortonworks.com> wrote: >> >> > Congrats Pengcheng! >

Re: [ANNOUNCE] New Hive PMC Member - Sushanth Sowmyan

Congrats! On 15/7/22, 11:12, "Xuefu Zhang" wrote: >Congrats, Sushanth! > >--Xuefu > >On Wed, Jul 22, 2015 at 11:11 AM, Hari Subramaniyan < >hsubramani...@hortonworks.com> wrote: > >> Congrats Sushanth! >> >> From: Szehon Ho >> Sent: Wednesday, July 22, 2

Re: [ANNOUNCE] New Hive Committer - Dmitry Tolpeko

Congrats! On 15/8/3, 12:57, "Vaibhav Gumashta" wrote: >Congrats Dmitry! > >‹Vaibhav > >On 8/3/15, 12:31 PM, "Lefty Leverenz" wrote: > >>Congratulations Dmitry! >> >>-- Lefty >> >>On Mon, Aug 3, 2015 at 2:33 PM, Carl Steinbach wrote: >> >>> The Apache Hive PMC has voted to make Dmitry Tolpeko a

Review Request 37425: HIVE-11542 fileId port

/main/java/org/apache/hadoop/hive/shims/HadoopShims.java 74785e5 Diff: https://reviews.apache.org/r/37425/diff/ Testing --- Thanks, Sergey Shelukhin

too many 1.*.* unreleased versions on the JIRA

On the JIRA, we currently have 1.1.0 marked as unreleased even though 1.2.0 is released (and 1.1.1 is also present); then, we have both 1.0.1 and 1.0.2, plus 1.2.1 and 1.2.2 showing in unreleased. I poked around and cannot see where this can be changed. Release managers for respective releases shou

Re: Hive CBO - Calcite Interface

You can also take a look at https://issues.apache.org/jira/browse/HIVE-11471 (although there’s no patch yet). From: John Pullokkaran mailto:jpullokka...@hortonworks.com>> Reply-To: "u...@hive.apache.org" mailto:u...@hive.apache.org>> Date: Friday, August 14, 2015 at

Re: Review Request 37425: HIVE-11542 fileId port

Remove it? it will be used by future patches :) - Sergey --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37425/#review95474 --- On Aug.

Re: too many 1.*.* unreleased versions on the JIRA

Anyone? :) On 15/8/13, 14:52, "Sergey Shelukhin" wrote: >On the JIRA, we currently have 1.1.0 marked as unreleased even though >1.2.0 is released (and 1.1.1 is also present); then, we have both 1.0.1 >and 1.0.2, plus 1.2.1 and 1.2.2 showing in unreleased. >I poked aroun

Review Request 37852: HIVE-11668 make sure directsql calls pre-query init when needed

Description --- blah Diffs - metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreDirectSql.java 522fcc2 Diff: https://reviews.apache.org/r/37852/diff/ Testing --- Thanks, Sergey Shelukhin

Review Request 37917: HIVE-11689 minor flow changes to ORC split generation

Description --- see JIRA Diffs - ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 8c138b9 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java ce86cd8 Diff: https://reviews.apache.org/r/37917/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 37930: HIVE-11609 Fix filter logic for hbase scans via composite keys

lass objects? - Sergey Shelukhin On Aug. 31, 2015, 5:51 a.m., Swarnim Kulkarni wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://re

Re: Review Request 37917: HIVE-11689 minor flow changes to ORC split generation

---- On Aug. 29, 2015, 1:47 a.m., Sergey Shelukhin wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/37917/ > -

Re: Review Request 37917: HIVE-11689 minor flow changes to ORC split generation

://reviews.apache.org/r/37917/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 37620: Hive Parser to Support multi col in clause (x, y..) in ((..), ..., ())

(line 475) <https://reviews.apache.org/r/37620/#comment153002> phase 4? :) - Sergey Shelukhin On Aug. 21, 2015, 10:07 p.m., pengcheng xiong wrote: > > --- > This is an automatically generated e-mail. To reply,

Review Request 37980: HIVE-11657 HIVE-2573 introduces some issues during metastore init (and CLI init)

://reviews.apache.org/r/37980/diff/ Testing --- Thanks, Sergey Shelukhin

Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

--- see jira Diffs - ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java 8c138b9 ql/src/java/org/apache/hadoop/hive/ql/io/sarg/ConvertAstToSearchArg.java e034650 Diff: https://reviews.apache.org/r/37985/diff/ Testing --- Thanks, Sergey Shelukhin

Re: windows line endings and git

Set core.autocrlf to false in git config. On 15/9/1, 10:17, "Alan Gates" wrote: >After Dmitry checked in HIVE-11536 and I fetched and merged, I had >issues in my git repository with line endings. It insisted on modifying >the files without me so much as opening the files, and would not let me >

Re: windows line endings and git

@hive.apache.org>> Subject: Re: windows line endings and git Me, or Dmitry, or both? Alan. [cid:part1.03060807.01010804@gmail.com] Sergey Shelukhin<mailto:ser...@hortonworks.com> September 1, 2015 at 10:38 Set core.autocrlf to false in git config. On 15/9/1, 10:17, "Alan Gates&q

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

d27ac16 Diff: https://reviews.apache.org/r/37985/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 37925: HIVE-11487: Add getNumPartitionsByFilter api in metastore api

/reviews.apache.org/r/37925/#comment153466> that doesn't seem efficient. It just returns a list and then takes size. - Sergey Shelukhin On Sept. 2, 2015, 11:14 a.m., Akshay Goyal wrote: > > --- > This is an automaticall

Re: [ANNOUNCE] New Hive Committer - Lars Francke

Congrats! From: Daniel Lopes mailto:dan...@bankfacil.com.br>> Reply-To: "u...@hive.apache.org" mailto:u...@hive.apache.org>> Date: Tuesday, September 8, 2015 at 15:02 To: "u...@hive.apache.org" mailto:u...@hive.apache.org>> Cc: "kulkarni.

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

rated e-mail. To reply, visit: https://reviews.apache.org/r/37985/#review97385 ------- On Sept. 2, 2015, 1:06 a.m., Sergey Shelukhin wrote: > > --- > This is a

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

names, the it will be easy to map sarg column > > names to internal column index. i1 -> 1 (after ripping off _col) how can we map to internal column name? We are working against a file we have not read (in split generation), these names could be anything - Sergey

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

d27ac16 Diff: https://reviews.apache.org/r/37985/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 37985: HIVE-11705 refactor SARG stripe filtering for ORC into a method

d27ac16 Diff: https://reviews.apache.org/r/37985/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38429: HIVE-11786: Deprecate the use of redundant column in colunm stats related tables

(line 317) <https://reviews.apache.org/r/38429/#comment156213> that may have perf impact... why not change the queries on metastore instead ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java (line 327) <https://reviews.apache.org/r/38429/#comment156212> more wh

BONECP

Hi. Does anyone remember why we are using BONECP by default? 0.8 version (the latest) has unfixed bugs since 2013 that we are hitting, and the github page says: “BoneCP …. should now be considered deprecated in favour of HikariCP"

Re: Hive Start Up Time Manifolds Greater than Execution Time

Which version of the Hive, and file format, are you using? It could be either reading file footers for ORC - in recent version there’s way to disable that (set hive.exec.orc.split.strategy=BI); or some similar feature for other formats that I’m not immediately familiar with. It could also be slow

Re: Hive Start Up Time Manifolds Greater than Execution Time

:46, "Sergey Shelukhin" wrote: >Which version of the Hive, and file format, are you using? >It could be either reading file footers for ORC - in recent version >there’s way to disable that (set hive.exec.orc.split.strategy=BI); or >some similar feature for other formats th

HIVE_DEFAULT_PARTITION

Hi. While investigating some issue, I noticed that direct SQL in Hive would usually fail if default partition is involved, and fall back to JDO; JDO filter pruning will exclude the default partition. I didn’t realize the latter was the case… Is it the expected behavior with the default partition? I

HiveQA is getting annoyingly slow

HiveQA is taking too long to run. I browsed test results a bit, the main offenders are obviously various CliDrivers. I think there’s a JIRA to speed up Tez CLI driver that is being worked on; and Spark and HBase have tolerable runtimes. That leaves us base CliDriver and MR. Base tests generally ta

Review Request 38702: HIVE-11553 use basic file metadata cache in ETLSplitStrategy-related paths

2500fb6 ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcSplit.java cc03df7 ql/src/java/org/apache/hadoop/hive/ql/io/orc/ReaderImpl.java ab539c4 ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 99896c6 Diff: https://reviews.apache.org/r/38702/diff/ Testing --- Thanks, Sergey

Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

://reviews.apache.org/r/38783/diff/ Testing --- Thanks, Sergey Shelukhin

Avro column type in Hive

Hi. I noticed that when I create an Avro table using a very large schema file, mysql metastore silently truncates the TYPE_NAME in COLUMNS_V2 table to the size of varchar (4000); however, when I do describe on the table, it still displays the whole type name (around 100Kb long) that I presume it g

Re: Avro column type in Hive

as a metastore backed SerDe. But that it has its columns >> populated to DB (e.g. HIVE-6308 >> <https://issues.apache.org/jira/browse/HIVE-6308>) is mainly for column >> statistics purpose, which obviously is not applicable to your case which >> has a type name > 100kb. >&g

Review Request 38862: HIVE-11985 handle long typenames from Avro schema in metastore

/hive/ql/metadata/Partition.java 9f9b5bc ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java 52ed4a3 ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java dda28b0 Diff: https://reviews.apache.org/r/38862/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38702: HIVE-11553 use basic file metadata cache in ETLSplitStrategy-related paths

27;t think it's necessary to have a generic interface. - Sergey ------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38702/#review100363 -

Re: Review Request 38702: HIVE-11553 use basic file metadata cache in ETLSplitStrategy-related paths

This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/38702/#review101051 ------- On Sept. 24, 2015, 1:03 a.m., Sergey Shelukhin wrote: > > -

Re: Review Request 38702: HIVE-11553 use basic file metadata cache in ETLSplitStrategy-related paths

/org/apache/hadoop/hive/ql/metadata/Hive.java 10cafb6 Diff: https://reviews.apache.org/r/38702/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

eviews.apache.org/r/38783/#review101167 --- On Sept. 26, 2015, 1:36 a.m., Sergey Shelukhin wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/38783/ > ---

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

/SessionState.java dc8c336 Diff: https://reviews.apache.org/r/38783/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

/SessionState.java dc8c336 Diff: https://reviews.apache.org/r/38783/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

--- Thanks, Sergey Shelukhin

Review Request 38968: HIVE-11856 allow split strategies to run on threadpool

--- . Diffs - ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java ef62a23 Diff: https://reviews.apache.org/r/38968/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38969: HIVE-11777 implement an option to have single ETL strategy for multiple directories

/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java ef62a23 ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java 69cb6ff0414aec8903abc38da96b28111f805efb Diff: https://reviews.apache.org/r/38969/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38969: HIVE-11777 implement an option to have single ETL strategy for multiple directories

(line 1159) <https://reviews.apache.org/r/38969/#comment158769> should start with a capital latter... next iteration - Sergey Shelukhin On Oct. 2, 2015, 10:42 p.m., Sergey Shelukhin wrote: > > --- > This is an automati

Re: Review Request 38783: HIVE-11969 start Tez session in background when starting CLI

--- Thanks, Sergey Shelukhin

Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

/hadoop/hive/ql/optimizer/ppr/PartitionExpressionForMetastore.java 9ffa177 Diff: https://reviews.apache.org/r/39026/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

/PartitionExpressionForMetastore.java 9ffa177 Diff: https://reviews.apache.org/r/39026/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

/PartitionExpressionForMetastore.java 9ffa177 Diff: https://reviews.apache.org/r/39026/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38862: HIVE-11985 handle long typenames from Avro schema in metastore

--- Thanks, Sergey Shelukhin

proxy errors from HiveQA Jenkins?

I am trying to look at slow tests on HiveQA and tests’ history. I keep getting 502 proxy error - often from history of any kind, rarely from test results, sometimes just from random pages. E.g. Proxy ErrorThe proxy server received an invalid response from an upstream server. The proxy server could

Re: proxy errors from HiveQA Jenkins?

tp response.. I can try bump the >timeout, but other than that I dont have that many ideas. > >Thanks >Szehon > >On Tue, Oct 13, 2015 at 11:58 AM, Sergey Shelukhin > >wrote: > >> I am trying to look at slow tests on HiveQA and tests’ history. >> I keep gettin

Re: proxy errors from HiveQA Jenkins?

Actually, it is possible to get database dump, or something similar, of test stats from wherever they are stored? On 15/10/13, 12:14, "Sergey Shelukhin" wrote: >Sure… how did you find out about large http response? It seems like a >history page with one chart would not be much

parallelizing a test in HiveQA

Hi. After the branch merge, we’d like the newly added CliDriver test to be parallelized like other such tests. What do we need to provide for this to be configured? The test name is TestMiniLlapCliDriver; it currently uses the same variable as some other test in testconfiguration.properties, but I

Re: Review Request 39199: HIVE-12084 : Hive queries with ORDER BY and large LIMIT fails with OutOfMemoryError Java heap space

109) <https://reviews.apache.org/r/39199/#comment160466> should this use JavaDataModel? - Sergey Shelukhin On Oct. 14, 2015, 6:10 p.m., Hari Sankar Sivarama Subramaniyan wrote: > > --- > This is an automatically gener

Re: Review Request 38862: HIVE-11985 handle long typenames from Avro schema in metastore

3262887 serde/src/java/org/apache/hadoop/hive/serde2/AbstractSerDe.java c5e78c5 serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java 0e4e4c6 Diff: https://reviews.apache.org/r/38862/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

/diff/ Testing --- Thanks, Sergey Shelukhin

Review Request 39333: HIVE-11777 implement an option to have single ETL strategy for multiple directories

://reviews.apache.org/r/39333/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

------- On Oct. 15, 2015, 1:47 a.m., Sergey Shelukhin wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/39026/ > --

Re: Review Request 39026: HIVE-11676 implement metastore API to do file footer PPD

/ql/optimizer/ppr/PartitionExpressionForMetastore.java 9ffa177 Diff: https://reviews.apache.org/r/39026/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 38862: HIVE-11985 handle long typenames from Avro schema in metastore

3262887 serde/src/java/org/apache/hadoop/hive/serde2/AbstractSerDe.java c5e78c5 serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java 0e4e4c6 Diff: https://reviews.apache.org/r/38862/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Review Request 39333: HIVE-11777 implement an option to have single ETL strategy for multiple directories

/TestInputOutputFormat.java c61d615 Diff: https://reviews.apache.org/r/39333/diff/ Testing --- Thanks, Sergey Shelukhin

Review Request 39409: HIVE-12061 : add file type support to file metadata by expr call

/apache/hadoop/hive/metastore/DummyRawStoreForJdoConnection.java 2de049a Diff: https://reviews.apache.org/r/39409/diff/ Testing --- Thanks, Sergey Shelukhin

Re: Profiling the internal of Hive

For Tez containers, you can specify JVM args via hive.tez.java.opts config setting, there’s probably a similar setting for MR. You can add the profiler agent to this setting, there e.g. for Yourkit something like: "-agentpath:/opt/yourkit/bin/linux-x86-64/libyjpagent.so=disablej2ee,disabl etracing,

parallelizing tests on ptest

Hi. We have merged the llap branch into master and would like to parallelize the llap test the same way the CliDriver, Minimr, Spark, HBase, etc. tests are parallelized. The test currently only runs ~20 tests from a separate variable (otherwise it times out). https://issues.apache.org/jira/browse

Review Request 39522: HIVE-12220 LLAP: Usability issues with hive.llap.io.cache.orc.size

/ Testing --- Thanks, Sergey Shelukhin

[ANNOUNCE] New Hive Committer - Siddharth Seth

The Apache Hive PMC has voted to make Siddharth Seth a committer on the Apache Hive Project. Please join me in congratulating Sid! Thanks, Sergey.

Re: [ANNOUNCE] New Hive Committer- Aihua Xu

Congrats! On 15/10/21, 14:30, "Chaoyu Tang" wrote: >Congratulations to Aihua. > >On Wed, Oct 21, 2015 at 5:12 PM, Zhuoluo (Clark) Yang >> wrote: > >> Congrats >> >> Thanks, >> Zhuoluo (Clark) Yang >> >> On Wed, Oct 21, 2015 at 2:09 PM, Szehon Ho wrote: >> >> > The Apache Hive PMC has voted to m

Re: Review Request 38862: HIVE-11985 handle long typenames from Avro schema in metastore

3262887 serde/src/java/org/apache/hadoop/hive/serde2/AbstractSerDe.java c5e78c5 serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroSerDe.java 0e4e4c6 Diff: https://reviews.apache.org/r/38862/diff/ Testing --- Thanks, Sergey Shelukhin

<    2   3   4   5   6   7   8   9   10   11   >