[jira] [Created] (HIVE-19967) SMB Join : ReduceSink should use correct keys in optraits

2018-06-21 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19967: - Summary: SMB Join : ReduceSink should use correct keys in optraits Key: HIVE-19967 URL: https://issues.apache.org/jira/browse/HIVE-19967 Project: Hive

Re: [ANNOUNCE] New committer: Adam Szita

2018-06-20 Thread Deepak Jaiswal
Congratulations Adam. On 6/20/18, 12:02 PM, "Ashutosh Chauhan" wrote: Apache Hive's Project Management Committee (PMC) has invited Adam Szita to become a committer, and we are pleased to announce that he has accepted. Adam, welcome, thank you for your contributions, and we

Re: New committer announcement : Marta Kuczora

2018-06-20 Thread Deepak Jaiswal
Congratulations Marta. On 6/20/18, 12:06 PM, "Ashutosh Chauhan" wrote: Apache Hive's Project Management Committee (PMC) has invited Marta Kuczora to become a committer, and we are pleased to announce that he has accepted. Marta, welcome, thank you for your contributions, and

[jira] [Created] (HIVE-19947) Load Data Rewrite : Explore better way to create temp table object to maintain consistency.

2018-06-19 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19947: - Summary: Load Data Rewrite : Explore better way to create temp table object to maintain consistency. Key: HIVE-19947 URL: https://issues.apache.org/jira/browse/HIVE-19947

[jira] [Created] (HIVE-19928) Load Data for managed tables should set the owner of loaded files to a configurable user

2018-06-17 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19928: - Summary: Load Data for managed tables should set the owner of loaded files to a configurable user Key: HIVE-19928 URL: https://issues.apache.org/jira/browse/HIVE-19928

Re: Review Request 67612: HIVE-19904 : Load data rewrite into Tez job fails for ACID

2018-06-15 Thread Deepak Jaiswal
/load_data_using_job.q.out 7a62be23dd Diff: https://reviews.apache.org/r/67612/diff/2/ Changes: https://reviews.apache.org/r/67612/diff/1-2/ Testing --- Thanks, Deepak Jaiswal

Review Request 67612: HIVE-19904 : Load data rewrite into Tez job fails for ACID

2018-06-14 Thread Deepak Jaiswal
/org/apache/hadoop/hive/ql/TestTxnLoadData.java fb88f25285 storage-api/src/java/org/apache/hadoop/hive/common/ValidTxnWriteIdList.java 9867a81a7b Diff: https://reviews.apache.org/r/67612/diff/1/ Testing --- Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-19904) Load data rewrite into Tez job fails for ACID

2018-06-14 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19904: - Summary: Load data rewrite into Tez job fails for ACID Key: HIVE-19904 URL: https://issues.apache.org/jira/browse/HIVE-19904 Project: Hive Issue Type

[jira] [Created] (HIVE-19849) ReduceRecordSource should flush the last record when reader runs out of records

2018-06-10 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19849: - Summary: ReduceRecordSource should flush the last record when reader runs out of records Key: HIVE-19849 URL: https://issues.apache.org/jira/browse/HIVE-19849

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-09 Thread Deepak Jaiswal
: https://reviews.apache.org/r/67296/diff/4-5/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-09 Thread Deepak Jaiswal
Line 460 (original), 460 (patched) > > <https://reviews.apache.org/r/67296/diff/4/?file=2036608#file2036608line460> > > > > these diffs are weird... but ok. yeah, I got a merge conflict due to these when rebased. Weird. - Deepak -

[jira] [Created] (HIVE-19840) SMB : Make sure additional checks added in HIVE-18875 in ConvertJoinMapJoin are actually needed.

2018-06-09 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19840: - Summary: SMB : Make sure additional checks added in HIVE-18875 in ConvertJoinMapJoin are actually needed. Key: HIVE-19840 URL: https://issues.apache.org/jira/browse/HIVE-19840

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-08 Thread Deepak Jaiswal
/src/test/results/clientpositive/spark/smb_mapjoin_6.q.out 7445135159 ql/src/test/results/clientpositive/spark/subquery_notin.q.out a53c31353b Diff: https://reviews.apache.org/r/67296/diff/4/ Changes: https://reviews.apache.org/r/67296/diff/3-4/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-05 Thread Deepak Jaiswal
er branch in the inner loop also. might have perf > > implications. > > Deepak Jaiswal wrote: > Sure, will find a way to avoid it. On code inspection, I just made it part of the main if..else. - Deepak --- This is an

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-05 Thread Deepak Jaiswal
ll don't think this code should be here. This seems to be doing > > the exact same thing as the "checkColEquality" below. If not can you tell > > me how this is different and why the calls below don't suffice? Otherwise > > let's remove this? > > Deepak Jaiswal

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-04 Thread Deepak Jaiswal
gt; Lines 299 (patched) > > <https://reviews.apache.org/r/67296/diff/3/?file=2034853#file2034853line299> > > > > This is a nit, feel free to ignore: I don't think it's necessarily a > > "parent gby" that creates the bucketing. Just drop after "than".

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-06-03 Thread Deepak Jaiswal
/67296/diff/2-3/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-05-24 Thread Deepak Jaiswal
/clientpositive/spark/smb_mapjoin_6.q.out 7445135159 ql/src/test/results/clientpositive/spark/subquery_notin.q.out ea473c3b40 Diff: https://reviews.apache.org/r/67296/diff/2/ Changes: https://reviews.apache.org/r/67296/diff/1-2/ Testing --- Thanks, Deepak Jaiswal

Review Request 67296: HIVE-18875 : Enable SMB Join by default in Tez

2018-05-24 Thread Deepak Jaiswal
/subquery_notin.q.out ea473c3b40 Diff: https://reviews.apache.org/r/67296/diff/1/ Testing --- Thanks, Deepak Jaiswal

Re: [VOTE] Stricter commit guidelines

2018-05-15 Thread Deepak Jaiswal
+1 On 5/15/18, 4:06 PM, "Jesus Camacho Rodriguez" wrote: That is already part of the policy although it apparently remained unnoticed: *If a commit introduces new test failures, the preferred process is to revert the patch, rather than opening a new JIRA to

Re: ptest queue

2018-05-14 Thread Deepak Jaiswal
art >> working on this one then (unless any objections of course). >> >> Adam >> >> On 26 April 2018 at 05:48, Deepak Jaiswal <djais...@hortonworks.com> >> wrote: >> >>> +1 for option 3. Thanks Adam for taking

[jira] [Created] (HIVE-19492) Update Wiki with load data extension syntax

2018-05-10 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19492: - Summary: Update Wiki with load data extension syntax Key: HIVE-19492 URL: https://issues.apache.org/jira/browse/HIVE-19492 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-19491) Branch-3 Start using storage-api 2.6.1 once available.

2018-05-10 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19491: - Summary: Branch-3 Start using storage-api 2.6.1 once available. Key: HIVE-19491 URL: https://issues.apache.org/jira/browse/HIVE-19491 Project: Hive Issue

Re: [VOTE] Should we release storage-api 2.6.1 rc0?

2018-05-10 Thread Deepak Jaiswal
Thanks. I will wait then. On 5/10/18, 8:39 AM, "Owen O'Malley" <owen.omal...@gmail.com> wrote: Deepak, you need to let 72 hours go by. .. Owen On Wed, May 9, 2018 at 11:40 PM, Deepak Jaiswal <djais...@hortonworks.com> wrote: > With

Re: [VOTE] Should we release storage-api 2.6.1 rc0?

2018-05-10 Thread Deepak Jaiswal
jcamachorodrig...@hortonworks.com> wrote: > +1 > - compiled from src > - ran unit tests > > -Jesús > > > On 5/9/18, 11:48 AM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote: > > Ping! >

Re: [VOTE] Should we release storage-api 2.6.1 rc0?

2018-05-09 Thread Deepak Jaiswal
Ping! On 5/8/18, 12:59 PM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote: All, I would like to make a new release of the storage-api. It contains key changes related to Murmur3 hash. Artifacts: Tag: https://github.com/apache/hive/releases/tag

[jira] [Created] (HIVE-19478) Load Data extension should be able to take more SerDe information

2018-05-09 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19478: - Summary: Load Data extension should be able to take more SerDe information Key: HIVE-19478 URL: https://issues.apache.org/jira/browse/HIVE-19478 Project: Hive

Re: Review Request 66999: HIVE-19453

2018-05-09 Thread Deepak Jaiswal
eful to be able to pass in SerDe params which are used to > > initialize the SerDe - this could be useful for some SerDes. For example > > LazySimpleSerDe allows you to pass in the field separator, or set the > > timestamp format etc. > > Deepak Jaiswal wrote: > I wil

[jira] [Created] (HIVE-19473) Add Negative tests for extended load data satatement

2018-05-08 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19473: - Summary: Add Negative tests for extended load data satatement Key: HIVE-19473 URL: https://issues.apache.org/jira/browse/HIVE-19473 Project: Hive Issue

Re: Review Request 66999: HIVE-19453

2018-05-08 Thread Deepak Jaiswal
formation for file op but sufficient information to launch an insert job, it would launch one. - Deepak --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66999/#review202699 --

[VOTE] Should we release storage-api 2.6.1 rc0?

2018-05-08 Thread Deepak Jaiswal
All, I would like to make a new release of the storage-api. It contains key changes related to Murmur3 hash. Artifacts: Tag: https://github.com/apache/hive/releases/tag/storage-release-2.6.1-rc0 Tar ball : http://home.apache.org/~djaiswal/hive-storage-2.6.1/ Thanks, Deepak

Re: Review Request 66999: HIVE-19453

2018-05-08 Thread Deepak Jaiswal
/LoadSemanticAnalyzer.java Lines 481 (patched) <https://reviews.apache.org/r/66999/#comment284505> Please ignore this commented code, I removed it in my patch locally. - Deepak Jaiswal On May 8, 2018, 6:12 a.m., Deepak Jaiswal

Review Request 66999: HIVE-19453

2018-05-08 Thread Deepak Jaiswal
, Deepak Jaiswal

[jira] [Created] (HIVE-19453) Extend Load Data statement to take Input file format and Serde as parameters

2018-05-08 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19453: - Summary: Extend Load Data statement to take Input file format and Serde as parameters Key: HIVE-19453 URL: https://issues.apache.org/jira/browse/HIVE-19453 Project

Re: [DISCUSS] Storage-API 2.6.1 release

2018-05-07 Thread Deepak Jaiswal
mp values in UTC 624e464a2cc4fe4dd9395edf8b377fd7323a299e HIVE-19126: CachedStore: Use memory estimation to limit cache size during prewarm so those are the ones to consider. .. Owen On Mon, May 7, 2018 at 4:19 PM, Deepak Jaiswal <djais...@hortonworks.com>

[DISCUSS] Storage-API 2.6.1 release

2018-05-07 Thread Deepak Jaiswal
All, Branch 3 contains changes to migrate from JAVA hash to Murmur hash (HIVE-18910) which required addition of couple of APIs keeping the backward compatibility. Since 2.6.0 is already released, I propose a new branch-3 only release of storage-api. Please let me know your thoughts on this. I

Re: Apache Hive 3.0.0 release preparation

2018-05-07 Thread Deepak Jaiswal
Owen, thanks for bringing this to attention. It is definitely me who made those changes. The good thing is the change is backward compatible and the new API is needed to keep Vectorized mode performant while using Murmur hash. We can treat this as a bug fix and I can work on a new point-point

[jira] [Created] (HIVE-19420) Support LOAD from SeqFile to ORC table

2018-05-04 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19420: - Summary: Support LOAD from SeqFile to ORC table Key: HIVE-19420 URL: https://issues.apache.org/jira/browse/HIVE-19420 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19386) Move TABLE_BUCKETING_VERSION to hive_metastore.thrift

2018-05-02 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19386: - Summary: Move TABLE_BUCKETING_VERSION to hive_metastore.thrift Key: HIVE-19386 URL: https://issues.apache.org/jira/browse/HIVE-19386 Project: Hive Issue

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-05-01 Thread Deepak Jaiswal
/ Changes: https://reviews.apache.org/r/66805/diff/8-9/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-05-01 Thread Deepak Jaiswal
ges: https://reviews.apache.org/r/66805/diff/7-8/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-05-01 Thread Deepak Jaiswal
ges: https://reviews.apache.org/r/66805/diff/6-7/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-05-01 Thread Deepak Jaiswal
. I can add multi column bucketing. Eric was talking about multi column partitioning which creates multi-level subdirs. Currently load fails if it sees a subdirs. It is now handled in latest patch. - Deepak ------- This is

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-04-30 Thread Deepak Jaiswal
rg/r/66805/diff/5-6/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-19367) Load Data should fail for empty Parquet files.

2018-04-30 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19367: - Summary: Load Data should fail for empty Parquet files. Key: HIVE-19367 URL: https://issues.apache.org/jira/browse/HIVE-19367 Project: Hive Issue Type

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-04-30 Thread Deepak Jaiswal
ntpositive/llap/load_data_using_job.q.out PRE-CREATION Diff: https://reviews.apache.org/r/66805/diff/5/ Changes: https://reviews.apache.org/r/66805/diff/4-5/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-19361) Backport HIVE-18910 to branch -3

2018-04-30 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19361: - Summary: Backport HIVE-18910 to branch -3 Key: HIVE-19361 URL: https://issues.apache.org/jira/browse/HIVE-19361 Project: Hive Issue Type: Bug

[jira] [Created] (HIVE-19356) TestNegativeMinimrCliDriver (cluster_tasklog_retrieval, mapreduce_stack_trace, mapreduce_stack_trace_turnoff, and minimr_broken_pipe) are failing

2018-04-28 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19356: - Summary: TestNegativeMinimrCliDriver (cluster_tasklog_retrieval, mapreduce_stack_trace, mapreduce_stack_trace_turnoff, and minimr_broken_pipe) are failing Key: HIVE-19356 URL

[jira] [Created] (HIVE-19355) Test TestJdbcWithDBTokenStoreNoDoAs has multiple failures

2018-04-28 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19355: - Summary: Test TestJdbcWithDBTokenStoreNoDoAs has multiple failures Key: HIVE-19355 URL: https://issues.apache.org/jira/browse/HIVE-19355 Project: Hive

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-04-28 Thread Deepak Jaiswal
itive/llap/load_data_using_job.q.out PRE-CREATION Diff: https://reviews.apache.org/r/66805/diff/4/ Changes: https://reviews.apache.org/r/66805/diff/3-4/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-04-28 Thread Deepak Jaiswal
E-CREATION ql/src/test/results/clientpositive/spark/load_data_using_job.q.out PRE-CREATION Diff: https://reviews.apache.org/r/66805/diff/3/ Changes: https://reviews.apache.org/r/66805/diff/2-3/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-27 Thread Deepak Jaiswal
this UDF will probably need to mention that this uses the old > > hashing/bucketing scheme which and that a new one has replaced it. > > Deepak Jaiswal wrote: > Should I open a documentation JIRA to track this? opened https

[jira] [Created] (HIVE-19342) Update Wiki with new murmur hash UDF

2018-04-27 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19342: - Summary: Update Wiki with new murmur hash UDF Key: HIVE-19342 URL: https://issues.apache.org/jira/browse/HIVE-19342 Project: Hive Issue Type: Bug

Re: Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-04-27 Thread Deepak Jaiswal
tive/spark/load_data_using_job.q.out PRE-CREATION Diff: https://reviews.apache.org/r/66805/diff/2/ Changes: https://reviews.apache.org/r/66805/diff/1-2/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-26 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/ --- (Updated April 27, 2018, 1:14 a.m.) Review request for hive, Ashutosh Chauhan,

Re: ptest queue

2018-04-25 Thread Deepak Jaiswal
+1 for option 3. Thanks Adam for taking this up again. Regards, Deepak On 4/25/18, 4:54 PM, "Thejas Nair" wrote: Option 3 seems reasonable. I believe that used to be the state a while back (maybe 12 months back or so). When 2nd ptest for same jira runs, it

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-25 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/#review201975 --- On April 25, 2018, 7:21 a.m., Deepak Jaiswal wr

Review Request 66805: HIVE-19311 : Partition and bucketing support for “load data” statement

2018-04-25 Thread Deepak Jaiswal
st/results/clientpositive/llap/load_data_using_job.q.out PRE-CREATION Diff: https://reviews.apache.org/r/66805/diff/1/ Testing --- Added a unit test. Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-19311) Partition and bucketing support for “load data” statement

2018-04-25 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19311: - Summary: Partition and bucketing support for “load data” statement Key: HIVE-19311 URL: https://issues.apache.org/jira/browse/HIVE-19311 Project: Hive

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-25 Thread Deepak Jaiswal
r the old-style bucketing, to make sure that > > previously created bucketed tables still work properly? > > Deepak Jaiswal wrote: > That is a good point. Will work on it. TestAcidOnTez#testMapJoinOnTez is one such test. - Deepak --

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-25 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/ --- (Updated April 25, 2018, 7:21 a.m.) Review request for hive, Ashutosh Chauhan,

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-24 Thread Deepak Jaiswal
> What is the point of the conf and HIVE_BUCKETING_JAVA_HASH, is it > > supposed to be for testing? I don't see this setting being used anywhere. > > Deepak Jaiswal wrote: > The setting lets user to use old bucketing logic if they want to. I am > working on a testcase to cover it. >

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-24 Thread Deepak Jaiswal
------ This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/#review201866 --- On April 23, 2018, 5:26 p.m., Deepak Jaiswal wrote: > > --

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-23 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/ --- (Updated April 23, 2018, 5:26 p.m.) Review request for hive, Ashutosh Chauhan,

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-23 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/ --- (Updated April 23, 2018, 4:36 p.m.) Review request for hive, Ashutosh Chauhan,

Builds failing in ptest

2018-04-19 Thread Deepak Jaiswal
Hi All, The builds are failing on Jenkins with this exception. Checking PreCommit-HIVE-Build queue... Exception in thread "main" java.lang.IllegalStateException: 502 Proxy Error at org.apache.hive.ptest.api.client.JenkinsQueueUtil.httpGet(JenkinsQueueUtil.java:130) at

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-18 Thread Deepak Jaiswal
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/ --- (Updated April 19, 2018, 1:44 a.m.) Review request for hive, Ashutosh Chauhan,

Re: Build page not accessible

2018-04-18 Thread Deepak Jaiswal
Looks like we are back online! Thanks for the help. On 4/18/18, 1:01 PM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote: Just tried on phone using cellular connection and it works. On 4/18/18, 12:36 PM, "Deepak Jaiswal" <djais...@hortonworks

Re: Build page not accessible

2018-04-18 Thread Deepak Jaiswal
Just tried on phone using cellular connection and it works. On 4/18/18, 12:36 PM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote: Yes. It wont open for me. I tried different browsers as well. On 4/18/18, 12:29 PM, "Vihang Karajgaonkar" &

Re: Build page not accessible

2018-04-18 Thread Deepak Jaiswal
On Wed, Apr 18, 2018 at 12:13 PM, Deepak Jaiswal <djais...@hortonworks.com> wrote: > Hi all, > > I am not able to access the Hive Jenkins page. Is that happening to others > too? > > Regards, > Deepak >

Build page not accessible

2018-04-18 Thread Deepak Jaiswal
Hi all, I am not able to access the Hive Jenkins page. Is that happening to others too? Regards, Deepak

[jira] [Created] (HIVE-19234) Fix flaky tests (see description)

2018-04-17 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19234: - Summary: Fix flaky tests (see description) Key: HIVE-19234 URL: https://issues.apache.org/jira/browse/HIVE-19234 Project: Hive Issue Type: Bug

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-16 Thread Deepak Jaiswal
/src/test/org/apache/hive/common/util/TestMurmur3.java 9a01255610 Diff: https://reviews.apache.org/r/66567/diff/2/ Changes: https://reviews.apache.org/r/66567/diff/1-2/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-16 Thread Deepak Jaiswal
For these primitive types, might make sense to pre-allocate fixed size > > ByteBuffers of size 2/4/8 which can be used here rather than having to > > allocate new ones for every value. > > Deepak Jaiswal wrote: > That is how I did it before but it would send a byte

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-15 Thread Deepak Jaiswal
; > > Faster to do hashcode based on the underlying values (totalMonths) > > rather than toString Thanks. Will look into this. > On April 14, 2018, 1:13 a.m., Jason Dere wrote: > > serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectI

Re: Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-13 Thread Deepak Jaiswal
This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/66567/#review201121 --- On April 12, 2018, 6:24 p.m., Deepak Jaiswal wrote: > > ---

Re: Recent change to skip tests

2018-04-13 Thread Deepak Jaiswal
I reopened HIVE-19077 to remove the future instance instead of the current one. On 4/13/18, 11:10 AM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote: Hi, It seems someone committed a patch to modify ptests. I see this on the ptest console output,

Recent change to skip tests

2018-04-13 Thread Deepak Jaiswal
Hi, It seems someone committed a patch to modify ptests. I see this on the ptest console output, “Checking PreCommit-HIVE-Build queue... PreCommit-HIVE-Build has the following jira(s) in queue: [18845, 19161, 19054, 19161, 19126, 19184, 18652, 19184, 19187, 19175, 18902, 19104, 16041, 12369,

Review Request 66567: Migrate to Murmur hash for shuffle and bucketing

2018-04-11 Thread Deepak Jaiswal
6848a59563 storage-api/src/test/org/apache/hive/common/util/TestMurmur3.java 9a01255610 Diff: https://reviews.apache.org/r/66567/diff/1/ Testing --- Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-19162) SMB : Test tez_smb_1.q stops making SMB join for a query

2018-04-10 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-19162: - Summary: SMB : Test tez_smb_1.q stops making SMB join for a query Key: HIVE-19162 URL: https://issues.apache.org/jira/browse/HIVE-19162 Project: Hive

Re: PTest stuck

2018-03-23 Thread Deepak Jaiswal
The tests still seem to be stuck. Does it need a restart? Regards, Deepak On 3/23/18, 6:41 AM, "Peter Vary" wrote: Pushed the change to master. > On Mar 23, 2018, at 2:30 PM, Adam Szita wrote: > > This is caused by a whitespace

[jira] [Created] (HIVE-18910) Migrate to Murmur hash for shuffle and bucketing

2018-03-08 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-18910: - Summary: Migrate to Murmur hash for shuffle and bucketing Key: HIVE-18910 URL: https://issues.apache.org/jira/browse/HIVE-18910 Project: Hive Issue Type

[jira] [Created] (HIVE-18875) Enable SMB Join by default in Tez

2018-03-06 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-18875: - Summary: Enable SMB Join by default in Tez Key: HIVE-18875 URL: https://issues.apache.org/jira/browse/HIVE-18875 Project: Hive Issue Type: Bug

Review Request 65908: HIVE-17552

2018-03-05 Thread Deepak Jaiswal
Diff: https://reviews.apache.org/r/65908/diff/1/ Testing --- Thanks, Deepak Jaiswal

Review Request 65668: HIVE-18721

2018-02-15 Thread Deepak Jaiswal
Diff: https://reviews.apache.org/r/65668/diff/1/ Testing --- Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-18721) Bucket Map Join : Handle empty buckets

2018-02-15 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-18721: - Summary: Bucket Map Join : Handle empty buckets Key: HIVE-18721 URL: https://issues.apache.org/jira/browse/HIVE-18721 Project: Hive Issue Type: Bug

Re: Review Request 64688: HIVE-18218

2018-02-09 Thread Deepak Jaiswal
/clientpositive/spark/auto_sortmerge_join_16.q.out_spark 91408df129 Diff: https://reviews.apache.org/r/64688/diff/5/ Changes: https://reviews.apache.org/r/64688/diff/4-5/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 64688: HIVE-18218

2018-02-09 Thread Deepak Jaiswal
https://reviews.apache.org/r/64688/#review197216 ------- On Feb. 10, 2018, 12:41 a.m., Deepak Jaiswal wrote: > > --- > This is an automatically generated e-ma

Re: Review Request 64688: HIVE-18218

2018-02-09 Thread Deepak Jaiswal
/clientpositive/spark/auto_sortmerge_join_16.q.out_spark 91408df129 Diff: https://reviews.apache.org/r/64688/diff/4/ Changes: https://reviews.apache.org/r/64688/diff/3-4/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 64688: HIVE-18218

2018-02-09 Thread Deepak Jaiswal
/auto_sortmerge_join_16.q.out 91408df129 ql/src/test/results/clientpositive/spark/auto_sortmerge_join_16.q.out_spark 91408df129 Diff: https://reviews.apache.org/r/64688/diff/3/ Changes: https://reviews.apache.org/r/64688/diff/2-3/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 64688: HIVE-18218

2018-02-08 Thread Deepak Jaiswal
, Deepak Jaiswal

Re: Review Request 65130: HIVE-18350 : load data should rename files consistent with insert statements

2018-02-07 Thread Deepak Jaiswal
/metastore/client/TestTablesCreateDropAlterTruncate.java 00f38eeec5 Diff: https://reviews.apache.org/r/65130/diff/13/ Changes: https://reviews.apache.org/r/65130/diff/12-13/ Testing --- Thanks, Deepak Jaiswal

[jira] [Created] (HIVE-18648) Investigate SMB related test failures in llap_smb and auto_sortmerge_join_2

2018-02-07 Thread Deepak Jaiswal (JIRA)
Deepak Jaiswal created HIVE-18648: - Summary: Investigate SMB related test failures in llap_smb and auto_sortmerge_join_2 Key: HIVE-18648 URL: https://issues.apache.org/jira/browse/HIVE-18648 Project

Review Request 65539: HIVE-17063

2018-02-06 Thread Deepak Jaiswal
/insert_after_drop_partition.q PRE-CREATION ql/src/test/results/clientpositive/llap/insert_after_drop_partition.q.out PRE-CREATION Diff: https://reviews.apache.org/r/65539/diff/1/ Testing --- Thanks, Deepak Jaiswal

Re: [DISCUSS] 26 Unit tests failing regularly

2018-02-06 Thread Deepak Jaiswal
I already have JIRA for org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucket_map_join_tez1] Will pick up these two, org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[llap_smb] org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2] On

Re: Review Request 65130: HIVE-18350 : load data should rename files consistent with insert statements

2018-02-06 Thread Deepak Jaiswal
/ Changes: https://reviews.apache.org/r/65130/diff/11-12/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 65130: HIVE-18350 : load data should rename files consistent with insert statements

2018-02-05 Thread Deepak Jaiswal
/metastore/client/TestTablesCreateDropAlterTruncate.java 00f38eeec5 Diff: https://reviews.apache.org/r/65130/diff/11/ Changes: https://reviews.apache.org/r/65130/diff/10-11/ Testing --- Thanks, Deepak Jaiswal

Re: Review Request 65130: HIVE-18350 : load data should rename files consistent with insert statements

2018-02-05 Thread Deepak Jaiswal
ypes.py > 25e9a889b2 > standalone-metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb > 3a11a0582a > > standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java > b3d99a1da5 > > standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/model/MTable.java > 6c40ae8753 > standalone-metastore/src/main/thrift/hive_metastore.thrift 93f3e53de2 > > standalone-metastore/src/test/java/org/apache/hadoop/hive/metastore/cache/TestCachedStore.java > b9a8f61c69 > > standalone-metastore/src/test/java/org/apache/hadoop/hive/metastore/client/TestTablesCreateDropAlterTruncate.java > abc400a928 > > > Diff: https://reviews.apache.org/r/65130/diff/10/ > > > Testing > --- > > > Thanks, > > Deepak Jaiswal > >

Re: Review Request 65130: HIVE-18350 : load data should rename files consistent with insert statements

2018-02-03 Thread Deepak Jaiswal
, Deepak Jaiswal

ptest seems stuck

2018-02-02 Thread Deepak Jaiswal
Hi All, It looks like ptest is stuck. Cant figure out the cause. Regards, Deepak

<    1   2   3   4   5   >