Karen Coppage created HIVE-26280:
Summary: Copy more data into COMPLETED_COMPACTIONS for better
supportability
Key: HIVE-26280
URL: https://issues.apache.org/jira/browse/HIVE-26280
Project: Hive
1] HIVE-5317: Implement insert, update, and delete in Hive with full ACID
> support
> [2] HIVE-6319: Add compactor for ACID tables (Apr, 2014)
> [3] HIVE-20699: Query based compactor for full CRUD Acid tables (Feb, 2019)
> [4] HIVE-24015: Disable query-based compaction on MR execution en
Karen Coppage created HIVE-25716:
Summary: Fix flaky test
TestCompactionMetrics#testOldestReadyForCleaningAge
Key: HIVE-25716
URL: https://issues.apache.org/jira/browse/HIVE-25716
Project: Hive
Karen Coppage created HIVE-25578:
Summary: Tests are failing because operators can't be closed
Key: HIVE-25578
URL: https://issues.apache.org/jira/browse/HIVE-25578
Project: Hive
Issue Type
Karen Coppage created HIVE-25549:
Summary: Need to transient init partition expressions in
vectorized PTFs
Key: HIVE-25549
URL: https://issues.apache.org/jira/browse/HIVE-25549
Project: Hive
Karen Coppage created HIVE-25513:
Summary: Delta metrics collection may cause NPE
Key: HIVE-25513
URL: https://issues.apache.org/jira/browse/HIVE-25513
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-25492:
Summary: Major query-based compaction is skipped if partition is
empty
Key: HIVE-25492
URL: https://issues.apache.org/jira/browse/HIVE-25492
Project: Hive
Karen Coppage created HIVE-25450:
Summary: Delta metrics keys should contain database name
Key: HIVE-25450
URL: https://issues.apache.org/jira/browse/HIVE-25450
Project: Hive
Issue Type: Sub
Karen Coppage created HIVE-25430:
Summary: compactor.Worker.markFailed should catch and log any kind
of exception
Key: HIVE-25430
URL: https://issues.apache.org/jira/browse/HIVE-25430
Project: Hive
Karen Coppage created HIVE-25429:
Summary: Delta metrics collection may cause number of tez counters
to exceed tez.counters.max limit
Key: HIVE-25429
URL: https://issues.apache.org/jira/browse/HIVE-25429
Congratulations!!
Karen
> On 2021. Aug 3., at 6:50, Ashutosh Chauhan wrote:
>
> Hi all,
>
> It's an honor to announce that Apache Hive PMC has recently voted to invite
> Marta Kuczora as a new Hive PMC member. Marta is a long time Hive
> contributor and committer, and has made significant
Karen Coppage created HIVE-25390:
Summary: Metrics compaction_failed_initiator_ratio and
compaction_failed_cleaner_ratio should be counters
Key: HIVE-25390
URL: https://issues.apache.org/jira/browse/HIVE-25390
Karen Coppage created HIVE-25371:
Summary: Add myself to thrift file reviewers
Key: HIVE-25371
URL: https://issues.apache.org/jira/browse/HIVE-25371
Project: Hive
Issue Type: Task
Karen Coppage created HIVE-25363:
Summary: Fix TestStatsUpdaterThread#testQueueingWithThreads
Key: HIVE-25363
URL: https://issues.apache.org/jira/browse/HIVE-25363
Project: Hive
Issue Type
Karen Coppage created HIVE-25359:
Summary: Changes to metastore API in HIVE-24880 are not backwards
compatible
Key: HIVE-25359
URL: https://issues.apache.org/jira/browse/HIVE-25359
Project: Hive
Karen Coppage created HIVE-25348:
Summary: Skip metrics collection about writes to tables with
tblproperty no_auto_compaction=true if CTAS
Key: HIVE-25348
URL: https://issues.apache.org/jira/browse/HIVE-25348
Karen Coppage created HIVE-25323:
Summary: Fix TestVectorCastStatement
Key: HIVE-25323
URL: https://issues.apache.org/jira/browse/HIVE-25323
Project: Hive
Issue Type: Task
Karen Coppage created HIVE-25318:
Summary: Number of initiator hosts metric should ignore manually
initiated compactions
Key: HIVE-25318
URL: https://issues.apache.org/jira/browse/HIVE-25318
Project
Karen Coppage created HIVE-25115:
Summary: Compaction queue entries may accumulate in "ready for
cleaning" state
Key: HIVE-25115
URL: https://issues.apache.org/jira/browse/HIVE-25115
Pro
Karen Coppage created HIVE-25022:
Summary: Metric about incomplete compactions
Key: HIVE-25022
URL: https://issues.apache.org/jira/browse/HIVE-25022
Project: Hive
Issue Type: Sub-task
Karen Coppage created HIVE-24980:
Summary: Add timeout for failed and "not initiated" compaction
cleanup
Key: HIVE-24980
URL: https://issues.apache.org/jira/browse/HIVE-24980
Pro
Karen Coppage created HIVE-24955:
Summary: New metrics about aborted transactions
Key: HIVE-24955
URL: https://issues.apache.org/jira/browse/HIVE-24955
Project: Hive
Issue Type: Sub-task
Karen Coppage created HIVE-24881:
Summary: Abort old open replication txns
Key: HIVE-24881
URL: https://issues.apache.org/jira/browse/HIVE-24881
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-24860:
Summary: DbTxnManager$HeartbeaterThread thread leak
Key: HIVE-24860
URL: https://issues.apache.org/jira/browse/HIVE-24860
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-24858:
Summary: UDFClassLoader leak in session HiveConf
Key: HIVE-24858
URL: https://issues.apache.org/jira/browse/HIVE-24858
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-24719:
Summary: There's a getAcidState() without impersonation in
compactor.Worker
Key: HIVE-24719
URL: https://issues.apache.org/jira/browse/HIVE-24719
Project: Hive
Karen Coppage created HIVE-24652:
Summary: If compactor worker times out, compaction is not cleared
from queue
Key: HIVE-24652
URL: https://issues.apache.org/jira/browse/HIVE-24652
Project: Hive
Karen Coppage created HIVE-24587:
Summary: DataFileReader is not closed in
AvroGenericRecordReader#extractWriterProlepticFromMetadata
Key: HIVE-24587
URL: https://issues.apache.org/jira/browse/HIVE-24587
Karen Coppage created HIVE-24586:
Summary: Rename compaction "attempted" status
Key: HIVE-24586
URL: https://issues.apache.org/jira/browse/HIVE-24586
Project: Hive
Issue Type: I
Karen Coppage created HIVE-24474:
Summary: Failed compaction always throws TxnAbortedException
(again)
Key: HIVE-24474
URL: https://issues.apache.org/jira/browse/HIVE-24474
Project: Hive
Karen Coppage created HIVE-24459:
Summary: Qtest to simulate query-based compaction
Key: HIVE-24459
URL: https://issues.apache.org/jira/browse/HIVE-24459
Project: Hive
Issue Type: Test
Karen Coppage created HIVE-2:
Summary: compactor.Cleaner should not set state "mark cleaned" if
there are obsolete files in the FS
Key: HIVE-2
URL: https://issues.apache.org/jira/browse/
Karen Coppage created HIVE-24429:
Summary: Figure out a better way to test failed compactions
Key: HIVE-24429
URL: https://issues.apache.org/jira/browse/HIVE-24429
Project: Hive
Issue Type
Karen Coppage created HIVE-24410:
Summary: Query-based compaction hangs because of doAs
Key: HIVE-24410
URL: https://issues.apache.org/jira/browse/HIVE-24410
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-24347:
Summary: Fix failing test:
TestMiniLlapLocalCliDriver.testCliDriver[cardinality_preserving_join_opt2]
Key: HIVE-24347
URL: https://issues.apache.org/jira/browse/HIVE-24347
Karen Coppage created HIVE-24345:
Summary: Flaky test:
TestCleanupService#testEventualCleanupService_finishesCleanupBeforeExit is f
Key: HIVE-24345
URL: https://issues.apache.org/jira/browse/HIVE-24345
Karen Coppage created HIVE-24314:
Summary: compactor.Cleaner should not set state "mark cleaned" if
it didn't remove any files
Key: HIVE-24314
URL: https://issues.apache.org/jira/browse/
Karen Coppage created HIVE-24302:
Summary: Cleaner should not mark compaction queue entry as cleaned
if it doesn't remove obsolete files
Key: HIVE-24302
URL: https://issues.apache.org/jira/browse/HIVE-24302
Karen Coppage created HIVE-24235:
Summary: Drop and recreate table during MR compaction leaves
behind base/delta directory
Key: HIVE-24235
URL: https://issues.apache.org/jira/browse/HIVE-24235
Karen Coppage created HIVE-24191:
Summary: Introduce configurable user to run compaction as
Key: HIVE-24191
URL: https://issues.apache.org/jira/browse/HIVE-24191
Project: Hive
Issue Type
Karen Coppage created HIVE-24168:
Summary: Disable hdfsEncryptionShims cache during query-based
compaction
Key: HIVE-24168
URL: https://issues.apache.org/jira/browse/HIVE-24168
Project: Hive
Karen Coppage created HIVE-24158:
Summary: Cleanup isn't complete in OrcFileMergeOperator#closeOp
Key: HIVE-24158
URL: https://issues.apache.org/jira/browse/HIVE-24158
Project: Hive
Issue
Karen Coppage created HIVE-24135:
Summary: Drop database doesn't delete directory in managed location
Key: HIVE-24135
URL: https://issues.apache.org/jira/browse/HIVE-24135
Project: Hive
Karen Coppage created HIVE-24096:
Summary: Abort failed compaction's txn on TException|IOException
Key: HIVE-24096
URL: https://issues.apache.org/jira/browse/HIVE-24096
Project: Hive
Issue
Karen Coppage created HIVE-24089:
Summary: Run QB compaction as table directory user with
impersonation
Key: HIVE-24089
URL: https://issues.apache.org/jira/browse/HIVE-24089
Project: Hive
Karen Coppage created HIVE-24024:
Summary: Improve logging around CompactionTxnHandler
Key: HIVE-24024
URL: https://issues.apache.org/jira/browse/HIVE-24024
Project: Hive
Issue Type
Karen Coppage created HIVE-24023:
Summary: Hive parquet reader can't read files with length=0
Key: HIVE-24023
URL: https://issues.apache.org/jira/browse/HIVE-24023
Project: Hive
Issue Type
Karen Coppage created HIVE-24021:
Summary: Read insert-only tables truncated by Impala correctly
Key: HIVE-24021
URL: https://issues.apache.org/jira/browse/HIVE-24021
Project: Hive
Issue
Karen Coppage created HIVE-24015:
Summary: Disable query-based compaction on MR execution engine
Key: HIVE-24015
URL: https://issues.apache.org/jira/browse/HIVE-24015
Project: Hive
Issue
Karen Coppage created HIVE-24001:
Summary: Don't cache MapWork in tez/ObjectCache during query-based
compaction
Key: HIVE-24001
URL: https://issues.apache.org/jira/browse/HIVE-24001
Project: Hive
Karen Coppage created HIVE-23966:
Summary: Minor query-based compaction always results in delta dirs
with minWriteId=1
Key: HIVE-23966
URL: https://issues.apache.org/jira/browse/HIVE-23966
Project
Karen Coppage created HIVE-23838:
Summary: KafkaRecordIteratorTest is flaky
Key: HIVE-23838
URL: https://issues.apache.org/jira/browse/HIVE-23838
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-23703:
Summary: Major QB compaction with multiple FileSinkOperators
results in data loss and one original file
Key: HIVE-23703
URL: https://issues.apache.org/jira/browse/HIVE-23703
Karen Coppage created HIVE-23678:
Summary: Don't enforce ASF license headers on target files
Key: HIVE-23678
URL: https://issues.apache.org/jira/browse/HIVE-23678
Project: Hive
Issue Type
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72532/#review220990
---
Ship it!
Ship It!
- Karen Coppage
On June 8, 2020, 10:58
> On June 5, 2020, 2:04 p.m., Karen Coppage wrote:
> > ql/src/java/org/apache/hadoop/hive/ql/io/AcidUtils.java
> > Line 1411 (original)
> > <https://reviews.apache.org/r/72532/diff/2/?file=2232788#file2232788line1418>
> >
> > Are these originals not nee
), 1880 (patched)
<https://reviews.apache.org/r/72532/#comment309689>
Does this need to be public?
- Karen Coppage
On June 4, 2020, 7:35 a.m., Peter Varga wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visi
Karen Coppage created HIVE-23608:
Summary: Change an FS#exists call to FS#isFile call in AcidUtils
Key: HIVE-23608
URL: https://issues.apache.org/jira/browse/HIVE-23608
Project: Hive
Issue
/compactor/Worker.java
Lines 374 (patched)
<https://reviews.apache.org/r/72553/#comment309619>
Naming the thread masterThread.getName() + "_timeout_executor" would be
more descriptive.
- Karen Coppage
On May 28, 2020, 8:58 a.m.,
Karen Coppage created HIVE-23533:
Summary: Remove an FS#exists call from AcidUtils#getLogicalLength
Key: HIVE-23533
URL: https://issues.apache.org/jira/browse/HIVE-23533
Project: Hive
Issue
Karen Coppage created HIVE-23531:
Summary: Major CRUD QB compaction failing with ClassCastException
when vectorization off
Key: HIVE-23531
URL: https://issues.apache.org/jira/browse/HIVE-23531
Karen Coppage created HIVE-23506:
Summary: Move getAcidVersionFrom...File utility methods to
TestTxnCommands
Key: HIVE-23506
URL: https://issues.apache.org/jira/browse/HIVE-23506
Project: Hive
Lines 305 (patched)
> > <https://reviews.apache.org/r/72281/diff/1/?file=2216347#file2216347line305>
> >
> > Migth want to add asserts here to check non-null argument
>
> Karen Coppage wrote:
> I think if the StorageDescriptor is null, a NPE *should* be thrown
>
: https://reviews.apache.org/r/72281/diff/1-2/
Testing
---
Thanks,
Karen Coppage
it a private method in the next patch.
- Karen
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72281/#review220805
-----------
Karen Coppage created HIVE-23492:
Summary: Remove unnecessary FileSystem#exists calls from ql module
Key: HIVE-23492
URL: https://issues.apache.org/jira/browse/HIVE-23492
Project: Hive
Issue
Karen Coppage created HIVE-23405:
Summary: Bump org.scala-lang:scala-library version to 2.11.12
Key: HIVE-23405
URL: https://issues.apache.org/jira/browse/HIVE-23405
Project: Hive
Issue Type
Karen Coppage created HIVE-23344:
Summary: Remove org.scala-lang:scala-compiler 2.11.0 transitive
dependency
Key: HIVE-23344
URL: https://issues.apache.org/jira/browse/HIVE-23344
Project: Hive
Karen Coppage created HIVE-23338:
Summary: Bump jackson-databind version up to 2.9.10.4
Key: HIVE-23338
URL: https://issues.apache.org/jira/browse/HIVE-23338
Project: Hive
Issue Type
/hadoop/hive/metastore/txn/TxnStore.java
87130a519d
Diff: https://reviews.apache.org/r/72444/diff/2/
Changes: https://reviews.apache.org/r/72444/diff/1-2/
Testing
---
Thanks,
Karen Coppage
ght wrongly that System.currentTimeMillis was somehow
timezone dependendent)
- Karen
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72444/#review220514
-
: https://reviews.apache.org/r/72444/diff/1/
Testing
---
Thanks,
Karen Coppage
Karen Coppage created HIVE-23284:
Summary: Remove dependency on mariadb-java-client
Key: HIVE-23284
URL: https://issues.apache.org/jira/browse/HIVE-23284
Project: Hive
Issue Type
Karen Coppage created HIVE-23280:
Summary: Trigger compaction with old aborted txns
Key: HIVE-23280
URL: https://issues.apache.org/jira/browse/HIVE-23280
Project: Hive
Issue Type
Karen Coppage created HIVE-23109:
Summary: Query-based compaction omits database
Key: HIVE-23109
URL: https://issues.apache.org/jira/browse/HIVE-23109
Project: Hive
Issue Type: Bug
/ql/txn/compactor/QueryCompactor.java
7f3ccfa04e
ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/QueryCompactorFactory.java
6542eef58a
Diff: https://reviews.apache.org/r/72281/diff/1/
Testing
---
Thanks,
Karen Coppage
s like these arguments are switched up:
deltaNumThreshold
noBase ? "without" : "with"
- Karen Coppage
On March 26, 2020, 2:43 p.m., Laszlo Pinter wrote:
>
> ---
> This is an automatically generated e-mail. To reply,
Karen Coppage created HIVE-23072:
Summary: Can't select from table after minor compaction of MM
table with original files
Key: HIVE-23072
URL: https://issues.apache.org/jira/browse/HIVE-23072
Project
Karen Coppage created HIVE-23023:
Summary: MR compaction ignores column schema evolution
Key: HIVE-23023
URL: https://issues.apache.org/jira/browse/HIVE-23023
Project: Hive
Issue Type: Bug
Karen Coppage created HIVE-22985:
Summary: Failed compaction always throws TxnAbortedException
Key: HIVE-22985
URL: https://issues.apache.org/jira/browse/HIVE-22985
Project: Hive
Issue Type
ider debug/info log message about merge starting
ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/QueryCompactor.java
Lines 318 (patched)
<https://reviews.apache.org/r/72193/#comment308019>
nit: rename e to something meaningful like listO
Karen Coppage created HIVE-22981:
Summary: DataFileReader is not closed in
AvroGenericRecordReader#extractWriterTimezoneFromMetadata
Key: HIVE-22981
URL: https://issues.apache.org/jira/browse/HIVE-22981
Karen Coppage created HIVE-22971:
Summary: Eliminate file rename in insert-only compactor
Key: HIVE-22971
URL: https://issues.apache.org/jira/browse/HIVE-22971
Project: Hive
Issue Type
Karen Coppage created HIVE-22968:
Summary: Set hive.parquet.timestamp.time.unit default to micros
Key: HIVE-22968
URL: https://issues.apache.org/jira/browse/HIVE-22968
Project: Hive
Issue
Karen Coppage created HIVE-22902:
Summary: Incorrect Spark/SparkOnYarn result for
auto_sortmerge_join_16.q
Key: HIVE-22902
URL: https://issues.apache.org/jira/browse/HIVE-22902
Project: Hive
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72145/#review219606
---
Ship it!
Ship It!
- Karen Coppage
On Feb. 17, 2020, 3:30
ched)
<https://reviews.apache.org/r/72145/#comment307792>
Parameter isn't used
- Karen Coppage
On Feb. 17, 2020, 9:42 a.m., Laszlo Pinter wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
>
specifically. The unit tests
added here cover that functionality as well as compaction, and rendered the old
unit tests obsolete.
Thanks,
Karen Coppage
Karen Coppage created HIVE-22875:
Summary: Refactor query creation in QueryCompactor implementations
Key: HIVE-22875
URL: https://issues.apache.org/jira/browse/HIVE-22875
Project: Hive
Issue
Karen Coppage created HIVE-22863:
Summary: Commit compaction txn if it is opened but compaction is
skipped
Key: HIVE-22863
URL: https://issues.apache.org/jira/browse/HIVE-22863
Project: Hive
Karen Coppage created HIVE-22862:
Summary: Remove unnecessary calls to isEnoughToCompact
Key: HIVE-22862
URL: https://issues.apache.org/jira/browse/HIVE-22862
Project: Hive
Issue Type
ql/src/test/results/clientpositive/spark/orc_merge_diff_fs.q.out b7d3dd725d
Diff: https://reviews.apache.org/r/72063/diff/4/
Changes: https://reviews.apache.org/r/72063/diff/3-4/
Testing
---
Thanks,
Karen Coppage
://reviews.apache.org/r/72063/diff/3/
Changes: https://reviews.apache.org/r/72063/diff/2-3/
Testing
---
There were changes in query output in two spark auto_sortmerge_join_16.q.out
files. They now match the query output of llap/auto_sortmerge_join_16.q.out.
Thanks,
Karen Coppage
/parquet_int64_timestamp_int96_compatibility.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/72084/diff/2/
Changes: https://reviews.apache.org/r/72084/diff/1-2/
Testing
---
Thanks,
Karen Coppage
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72063/#review219486
---
On Jan. 30, 2020, 3:30 p.m., Karen Coppage wrote:
>
> --
Karen Coppage created HIVE-22826:
Summary: ALTER TABLE RENAME COLUMN doesn't update list of
bucketed column names
Key: HIVE-22826
URL: https://issues.apache.org/jira/browse/HIVE-22826
Project: Hive
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72074/#review219469
---
Ship it!
Ship It!
- Karen Coppage
On Feb. 3, 2020, 12:31
to have a unit test that reads a date before October 1582,
so it's clear that we're using the Proleptic Gregorian calendar.
2. ParquetTimestampUtils would be more readable if the big multipliers were
declared as constants and/or in this format: e.g. 1_000_000.
Thanks!
- Karen Coppage
On Jan
/orc_merge_diff_fs.q.out b7d3dd725d
Diff: https://reviews.apache.org/r/72063/diff/1/
Testing
---
There were changes in query output in two spark auto_sortmerge_join_16.q.out
files. They now match the query output of llap/auto_sortmerge_join_16.q.out.
Thanks,
Karen Coppage
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72028/#review219420
---
Ship it!
Ship It!
- Karen Coppage
On Jan. 29, 2020, 9:20
1 - 100 of 165 matches
Mail list logo
