Deepak Jaiswal created HIVE-19967:
-
Summary: SMB Join : ReduceSink should use correct keys in optraits
Key: HIVE-19967
URL: https://issues.apache.org/jira/browse/HIVE-19967
Project: Hive
Congratulations Adam.
On 6/20/18, 12:02 PM, "Ashutosh Chauhan" wrote:
Apache Hive's Project Management Committee (PMC) has invited Adam Szita
to become a committer, and we are pleased to announce that he has accepted.
Adam, welcome, thank you for your contributions, and we
Congratulations Marta.
On 6/20/18, 12:06 PM, "Ashutosh Chauhan" wrote:
Apache Hive's Project Management Committee (PMC) has invited Marta Kuczora
to become a committer, and we are pleased to announce that he has accepted.
Marta, welcome, thank you for your contributions, and
Deepak Jaiswal created HIVE-19947:
-
Summary: Load Data Rewrite : Explore better way to create temp
table object to maintain consistency.
Key: HIVE-19947
URL: https://issues.apache.org/jira/browse/HIVE-19947
Deepak Jaiswal created HIVE-19928:
-
Summary: Load Data for managed tables should set the owner of
loaded files to a configurable user
Key: HIVE-19928
URL: https://issues.apache.org/jira/browse/HIVE-19928
/load_data_using_job.q.out 7a62be23dd
Diff: https://reviews.apache.org/r/67612/diff/2/
Changes: https://reviews.apache.org/r/67612/diff/1-2/
Testing
---
Thanks,
Deepak Jaiswal
/org/apache/hadoop/hive/ql/TestTxnLoadData.java fb88f25285
storage-api/src/java/org/apache/hadoop/hive/common/ValidTxnWriteIdList.java
9867a81a7b
Diff: https://reviews.apache.org/r/67612/diff/1/
Testing
---
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-19904:
-
Summary: Load data rewrite into Tez job fails for ACID
Key: HIVE-19904
URL: https://issues.apache.org/jira/browse/HIVE-19904
Project: Hive
Issue Type
Deepak Jaiswal created HIVE-19849:
-
Summary: ReduceRecordSource should flush the last record when
reader runs out of records
Key: HIVE-19849
URL: https://issues.apache.org/jira/browse/HIVE-19849
: https://reviews.apache.org/r/67296/diff/4-5/
Testing
---
Thanks,
Deepak Jaiswal
Line 460 (original), 460 (patched)
> > <https://reviews.apache.org/r/67296/diff/4/?file=2036608#file2036608line460>
> >
> > these diffs are weird... but ok.
yeah, I got a merge conflict due to these when rebased. Weird.
- Deepak
-
Deepak Jaiswal created HIVE-19840:
-
Summary: SMB : Make sure additional checks added in HIVE-18875 in
ConvertJoinMapJoin are actually needed.
Key: HIVE-19840
URL: https://issues.apache.org/jira/browse/HIVE-19840
/src/test/results/clientpositive/spark/smb_mapjoin_6.q.out 7445135159
ql/src/test/results/clientpositive/spark/subquery_notin.q.out a53c31353b
Diff: https://reviews.apache.org/r/67296/diff/4/
Changes: https://reviews.apache.org/r/67296/diff/3-4/
Testing
---
Thanks,
Deepak Jaiswal
er branch in the inner loop also. might have perf
> > implications.
>
> Deepak Jaiswal wrote:
> Sure, will find a way to avoid it.
On code inspection, I just made it part of the main if..else.
- Deepak
---
This is an
ll don't think this code should be here. This seems to be doing
> > the exact same thing as the "checkColEquality" below. If not can you tell
> > me how this is different and why the calls below don't suffice? Otherwise
> > let's remove this?
>
> Deepak Jaiswal
gt; Lines 299 (patched)
> > <https://reviews.apache.org/r/67296/diff/3/?file=2034853#file2034853line299>
> >
> > This is a nit, feel free to ignore: I don't think it's necessarily a
> > "parent gby" that creates the bucketing. Just drop after "than".
/67296/diff/2-3/
Testing
---
Thanks,
Deepak Jaiswal
/clientpositive/spark/smb_mapjoin_6.q.out 7445135159
ql/src/test/results/clientpositive/spark/subquery_notin.q.out ea473c3b40
Diff: https://reviews.apache.org/r/67296/diff/2/
Changes: https://reviews.apache.org/r/67296/diff/1-2/
Testing
---
Thanks,
Deepak Jaiswal
/subquery_notin.q.out ea473c3b40
Diff: https://reviews.apache.org/r/67296/diff/1/
Testing
---
Thanks,
Deepak Jaiswal
+1
On 5/15/18, 4:06 PM, "Jesus Camacho Rodriguez" wrote:
That is already part of the policy although it apparently remained
unnoticed:
*If a commit introduces new test failures, the preferred process is to
revert the patch, rather than opening a new JIRA to
art
>> working on this one then (unless any objections of course).
>>
>> Adam
>>
>> On 26 April 2018 at 05:48, Deepak Jaiswal <djais...@hortonworks.com>
>> wrote:
>>
>>> +1 for option 3. Thanks Adam for taking
Deepak Jaiswal created HIVE-19492:
-
Summary: Update Wiki with load data extension syntax
Key: HIVE-19492
URL: https://issues.apache.org/jira/browse/HIVE-19492
Project: Hive
Issue Type: Sub
Deepak Jaiswal created HIVE-19491:
-
Summary: Branch-3 Start using storage-api 2.6.1 once available.
Key: HIVE-19491
URL: https://issues.apache.org/jira/browse/HIVE-19491
Project: Hive
Issue
Thanks. I will wait then.
On 5/10/18, 8:39 AM, "Owen O'Malley" <owen.omal...@gmail.com> wrote:
Deepak, you need to let 72 hours go by.
.. Owen
On Wed, May 9, 2018 at 11:40 PM, Deepak Jaiswal <djais...@hortonworks.com>
wrote:
> With
jcamachorodrig...@hortonworks.com> wrote:
> +1
> - compiled from src
> - ran unit tests
>
> -Jesús
>
>
> On 5/9/18, 11:48 AM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote:
>
> Ping!
>
Ping!
On 5/8/18, 12:59 PM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote:
All,
I would like to make a new release of the storage-api. It contains key
changes related to Murmur3 hash.
Artifacts:
Tag: https://github.com/apache/hive/releases/tag
Deepak Jaiswal created HIVE-19478:
-
Summary: Load Data extension should be able to take more SerDe
information
Key: HIVE-19478
URL: https://issues.apache.org/jira/browse/HIVE-19478
Project: Hive
eful to be able to pass in SerDe params which are used to
> > initialize the SerDe - this could be useful for some SerDes. For example
> > LazySimpleSerDe allows you to pass in the field separator, or set the
> > timestamp format etc.
>
> Deepak Jaiswal wrote:
> I wil
Deepak Jaiswal created HIVE-19473:
-
Summary: Add Negative tests for extended load data satatement
Key: HIVE-19473
URL: https://issues.apache.org/jira/browse/HIVE-19473
Project: Hive
Issue
formation for file op but sufficient
information to launch an insert job, it would launch one.
- Deepak
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66999/#review202699
--
All,
I would like to make a new release of the storage-api. It contains key changes
related to Murmur3 hash.
Artifacts:
Tag: https://github.com/apache/hive/releases/tag/storage-release-2.6.1-rc0
Tar ball : http://home.apache.org/~djaiswal/hive-storage-2.6.1/
Thanks,
Deepak
/LoadSemanticAnalyzer.java
Lines 481 (patched)
<https://reviews.apache.org/r/66999/#comment284505>
Please ignore this commented code, I removed it in my patch locally.
- Deepak Jaiswal
On May 8, 2018, 6:12 a.m., Deepak Jaiswal
,
Deepak Jaiswal
Deepak Jaiswal created HIVE-19453:
-
Summary: Extend Load Data statement to take Input file format and
Serde as parameters
Key: HIVE-19453
URL: https://issues.apache.org/jira/browse/HIVE-19453
Project
mp values in UTC
624e464a2cc4fe4dd9395edf8b377fd7323a299e HIVE-19126: CachedStore: Use
memory estimation to limit cache size during prewarm
so those are the ones to consider.
.. Owen
On Mon, May 7, 2018 at 4:19 PM, Deepak Jaiswal <djais...@hortonworks.com>
All,
Branch 3 contains changes to migrate from JAVA hash to Murmur hash (HIVE-18910)
which required addition of couple of APIs keeping the backward compatibility.
Since 2.6.0 is already released, I propose a new branch-3 only release of
storage-api.
Please let me know your thoughts on this. I
Owen, thanks for bringing this to attention. It is definitely me who made those
changes.
The good thing is the change is backward compatible and the new API is needed
to keep Vectorized mode performant while using Murmur hash.
We can treat this as a bug fix and I can work on a new point-point
Deepak Jaiswal created HIVE-19420:
-
Summary: Support LOAD from SeqFile to ORC table
Key: HIVE-19420
URL: https://issues.apache.org/jira/browse/HIVE-19420
Project: Hive
Issue Type: Bug
Deepak Jaiswal created HIVE-19386:
-
Summary: Move TABLE_BUCKETING_VERSION to hive_metastore.thrift
Key: HIVE-19386
URL: https://issues.apache.org/jira/browse/HIVE-19386
Project: Hive
Issue
/
Changes: https://reviews.apache.org/r/66805/diff/8-9/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
ges: https://reviews.apache.org/r/66805/diff/7-8/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
ges: https://reviews.apache.org/r/66805/diff/6-7/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
.
I can add multi column bucketing.
Eric was talking about multi column partitioning which creates multi-level
subdirs. Currently load fails if it sees a subdirs. It is now handled in latest
patch.
- Deepak
-------
This is
rg/r/66805/diff/5-6/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-19367:
-
Summary: Load Data should fail for empty Parquet files.
Key: HIVE-19367
URL: https://issues.apache.org/jira/browse/HIVE-19367
Project: Hive
Issue Type
ntpositive/llap/load_data_using_job.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/66805/diff/5/
Changes: https://reviews.apache.org/r/66805/diff/4-5/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-19361:
-
Summary: Backport HIVE-18910 to branch -3
Key: HIVE-19361
URL: https://issues.apache.org/jira/browse/HIVE-19361
Project: Hive
Issue Type: Bug
Deepak Jaiswal created HIVE-19356:
-
Summary: TestNegativeMinimrCliDriver (cluster_tasklog_retrieval,
mapreduce_stack_trace, mapreduce_stack_trace_turnoff, and minimr_broken_pipe)
are failing
Key: HIVE-19356
URL
Deepak Jaiswal created HIVE-19355:
-
Summary: Test TestJdbcWithDBTokenStoreNoDoAs has multiple failures
Key: HIVE-19355
URL: https://issues.apache.org/jira/browse/HIVE-19355
Project: Hive
itive/llap/load_data_using_job.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/66805/diff/4/
Changes: https://reviews.apache.org/r/66805/diff/3-4/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
E-CREATION
ql/src/test/results/clientpositive/spark/load_data_using_job.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/66805/diff/3/
Changes: https://reviews.apache.org/r/66805/diff/2-3/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
this UDF will probably need to mention that this uses the old
> > hashing/bucketing scheme which and that a new one has replaced it.
>
> Deepak Jaiswal wrote:
> Should I open a documentation JIRA to track this?
opened https
Deepak Jaiswal created HIVE-19342:
-
Summary: Update Wiki with new murmur hash UDF
Key: HIVE-19342
URL: https://issues.apache.org/jira/browse/HIVE-19342
Project: Hive
Issue Type: Bug
tive/spark/load_data_using_job.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/66805/diff/2/
Changes: https://reviews.apache.org/r/66805/diff/1-2/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/
---
(Updated April 27, 2018, 1:14 a.m.)
Review request for hive, Ashutosh Chauhan,
+1 for option 3. Thanks Adam for taking this up again.
Regards,
Deepak
On 4/25/18, 4:54 PM, "Thejas Nair" wrote:
Option 3 seems reasonable. I believe that used to be the state a while
back (maybe 12 months back or so).
When 2nd ptest for same jira runs, it
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/#review201975
---
On April 25, 2018, 7:21 a.m., Deepak Jaiswal wr
st/results/clientpositive/llap/load_data_using_job.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/66805/diff/1/
Testing
---
Added a unit test.
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-19311:
-
Summary: Partition and bucketing support for “load data” statement
Key: HIVE-19311
URL: https://issues.apache.org/jira/browse/HIVE-19311
Project: Hive
r the old-style bucketing, to make sure that
> > previously created bucketed tables still work properly?
>
> Deepak Jaiswal wrote:
> That is a good point. Will work on it.
TestAcidOnTez#testMapJoinOnTez is one such test.
- Deepak
--
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/
---
(Updated April 25, 2018, 7:21 a.m.)
Review request for hive, Ashutosh Chauhan,
> What is the point of the conf and HIVE_BUCKETING_JAVA_HASH, is it
> > supposed to be for testing? I don't see this setting being used anywhere.
>
> Deepak Jaiswal wrote:
> The setting lets user to use old bucketing logic if they want to. I am
> working on a testcase to cover it.
>
------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/#review201866
---
On April 23, 2018, 5:26 p.m., Deepak Jaiswal wrote:
>
> --
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/
---
(Updated April 23, 2018, 5:26 p.m.)
Review request for hive, Ashutosh Chauhan,
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/
---
(Updated April 23, 2018, 4:36 p.m.)
Review request for hive, Ashutosh Chauhan,
Hi All,
The builds are failing on Jenkins with this exception.
Checking PreCommit-HIVE-Build queue...
Exception in thread "main" java.lang.IllegalStateException: 502 Proxy Error
at
org.apache.hive.ptest.api.client.JenkinsQueueUtil.httpGet(JenkinsQueueUtil.java:130)
at
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/
---
(Updated April 19, 2018, 1:44 a.m.)
Review request for hive, Ashutosh Chauhan,
Looks like we are back online!
Thanks for the help.
On 4/18/18, 1:01 PM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote:
Just tried on phone using cellular connection and it works.
On 4/18/18, 12:36 PM, "Deepak Jaiswal" <djais...@hortonworks
Just tried on phone using cellular connection and it works.
On 4/18/18, 12:36 PM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote:
Yes. It wont open for me. I tried different browsers as well.
On 4/18/18, 12:29 PM, "Vihang Karajgaonkar" &
On Wed, Apr 18, 2018 at 12:13 PM, Deepak Jaiswal <djais...@hortonworks.com>
wrote:
> Hi all,
>
> I am not able to access the Hive Jenkins page. Is that happening to others
> too?
>
> Regards,
> Deepak
>
Hi all,
I am not able to access the Hive Jenkins page. Is that happening to others too?
Regards,
Deepak
Deepak Jaiswal created HIVE-19234:
-
Summary: Fix flaky tests (see description)
Key: HIVE-19234
URL: https://issues.apache.org/jira/browse/HIVE-19234
Project: Hive
Issue Type: Bug
/src/test/org/apache/hive/common/util/TestMurmur3.java 9a01255610
Diff: https://reviews.apache.org/r/66567/diff/2/
Changes: https://reviews.apache.org/r/66567/diff/1-2/
Testing
---
Thanks,
Deepak Jaiswal
For these primitive types, might make sense to pre-allocate fixed size
> > ByteBuffers of size 2/4/8 which can be used here rather than having to
> > allocate new ones for every value.
>
> Deepak Jaiswal wrote:
> That is how I did it before but it would send a byte
;
> > Faster to do hashcode based on the underlying values (totalMonths)
> > rather than toString
Thanks. Will look into this.
> On April 14, 2018, 1:13 a.m., Jason Dere wrote:
> > serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectI
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66567/#review201121
---
On April 12, 2018, 6:24 p.m., Deepak Jaiswal wrote:
>
> ---
I reopened HIVE-19077 to remove the future instance instead of the current one.
On 4/13/18, 11:10 AM, "Deepak Jaiswal" <djais...@hortonworks.com> wrote:
Hi,
It seems someone committed a patch to modify ptests. I see this on the
ptest console output,
Hi,
It seems someone committed a patch to modify ptests. I see this on the ptest
console output,
“Checking PreCommit-HIVE-Build queue...
PreCommit-HIVE-Build has the following jira(s) in queue: [18845, 19161, 19054,
19161, 19126, 19184, 18652, 19184, 19187, 19175, 18902, 19104, 16041, 12369,
6848a59563
storage-api/src/test/org/apache/hive/common/util/TestMurmur3.java 9a01255610
Diff: https://reviews.apache.org/r/66567/diff/1/
Testing
---
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-19162:
-
Summary: SMB : Test tez_smb_1.q stops making SMB join for a query
Key: HIVE-19162
URL: https://issues.apache.org/jira/browse/HIVE-19162
Project: Hive
The tests still seem to be stuck. Does it need a restart?
Regards,
Deepak
On 3/23/18, 6:41 AM, "Peter Vary" wrote:
Pushed the change to master.
> On Mar 23, 2018, at 2:30 PM, Adam Szita wrote:
>
> This is caused by a whitespace
Deepak Jaiswal created HIVE-18910:
-
Summary: Migrate to Murmur hash for shuffle and bucketing
Key: HIVE-18910
URL: https://issues.apache.org/jira/browse/HIVE-18910
Project: Hive
Issue Type
Deepak Jaiswal created HIVE-18875:
-
Summary: Enable SMB Join by default in Tez
Key: HIVE-18875
URL: https://issues.apache.org/jira/browse/HIVE-18875
Project: Hive
Issue Type: Bug
Diff: https://reviews.apache.org/r/65908/diff/1/
Testing
---
Thanks,
Deepak Jaiswal
Diff: https://reviews.apache.org/r/65668/diff/1/
Testing
---
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-18721:
-
Summary: Bucket Map Join : Handle empty buckets
Key: HIVE-18721
URL: https://issues.apache.org/jira/browse/HIVE-18721
Project: Hive
Issue Type: Bug
/clientpositive/spark/auto_sortmerge_join_16.q.out_spark
91408df129
Diff: https://reviews.apache.org/r/64688/diff/5/
Changes: https://reviews.apache.org/r/64688/diff/4-5/
Testing
---
Thanks,
Deepak Jaiswal
https://reviews.apache.org/r/64688/#review197216
-------
On Feb. 10, 2018, 12:41 a.m., Deepak Jaiswal wrote:
>
> ---
> This is an automatically generated e-ma
/clientpositive/spark/auto_sortmerge_join_16.q.out_spark
91408df129
Diff: https://reviews.apache.org/r/64688/diff/4/
Changes: https://reviews.apache.org/r/64688/diff/3-4/
Testing
---
Thanks,
Deepak Jaiswal
/auto_sortmerge_join_16.q.out
91408df129
ql/src/test/results/clientpositive/spark/auto_sortmerge_join_16.q.out_spark
91408df129
Diff: https://reviews.apache.org/r/64688/diff/3/
Changes: https://reviews.apache.org/r/64688/diff/2-3/
Testing
---
Thanks,
Deepak Jaiswal
,
Deepak Jaiswal
/metastore/client/TestTablesCreateDropAlterTruncate.java
00f38eeec5
Diff: https://reviews.apache.org/r/65130/diff/13/
Changes: https://reviews.apache.org/r/65130/diff/12-13/
Testing
---
Thanks,
Deepak Jaiswal
Deepak Jaiswal created HIVE-18648:
-
Summary: Investigate SMB related test failures in llap_smb and
auto_sortmerge_join_2
Key: HIVE-18648
URL: https://issues.apache.org/jira/browse/HIVE-18648
Project
/insert_after_drop_partition.q PRE-CREATION
ql/src/test/results/clientpositive/llap/insert_after_drop_partition.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/65539/diff/1/
Testing
---
Thanks,
Deepak Jaiswal
I already have JIRA for
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[bucket_map_join_tez1]
Will pick up these two,
org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[llap_smb]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2]
On
/
Changes: https://reviews.apache.org/r/65130/diff/11-12/
Testing
---
Thanks,
Deepak Jaiswal
/metastore/client/TestTablesCreateDropAlterTruncate.java
00f38eeec5
Diff: https://reviews.apache.org/r/65130/diff/11/
Changes: https://reviews.apache.org/r/65130/diff/10-11/
Testing
---
Thanks,
Deepak Jaiswal
ypes.py
> 25e9a889b2
> standalone-metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb
> 3a11a0582a
>
> standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/ObjectStore.java
> b3d99a1da5
>
> standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/model/MTable.java
> 6c40ae8753
> standalone-metastore/src/main/thrift/hive_metastore.thrift 93f3e53de2
>
> standalone-metastore/src/test/java/org/apache/hadoop/hive/metastore/cache/TestCachedStore.java
> b9a8f61c69
>
> standalone-metastore/src/test/java/org/apache/hadoop/hive/metastore/client/TestTablesCreateDropAlterTruncate.java
> abc400a928
>
>
> Diff: https://reviews.apache.org/r/65130/diff/10/
>
>
> Testing
> ---
>
>
> Thanks,
>
> Deepak Jaiswal
>
>
,
Deepak Jaiswal
Hi All,
It looks like ptest is stuck. Cant figure out the cause.
Regards,
Deepak
101 - 200 of 406 matches
Mail list logo