[ https://issues.apache.org/jira/browse/HIVE-23103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071493#comment-17071493 ]
Hive QA commented on HIVE-23103: -------------------------------- Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12998250/HIVE-23103.patch {color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified. {color:red}ERROR:{color} -1 due to 179 failed/errored test(s), 18142 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.metastore.TestHiveMetaStoreTxns.testGetValidWriteIds (batchId=241) org.apache.hadoop.hive.metastore.TestHiveMetaStoreTxns.testOpenTxnNotExcluded (batchId=241) org.apache.hadoop.hive.metastore.TestHiveMetaStoreTxns.testTxns (batchId=241) org.apache.hadoop.hive.metastore.client.TestDropPartitions.otherCatalog[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionArchivedPartition[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionBogusCatalog[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameBogusCatalog[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameEmptyName[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameInvalidNameFormat[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameInvalidNameNoValues[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameInvalidName[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameLessValue[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameMoreValue[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameNonExistingDB[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameNonExistingPart[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameNonExistingTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByNameNullName[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionByName[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionDeleteDataAndPurgeExternalTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionDeleteDataAndPurge[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionDeleteDataNoPurge[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionDeleteDataPurge[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionDeleteData[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionDeleteParentDir[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionEmptyDB[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionEmptyPartVals[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionEmptyTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionEmptyVal[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionExternalTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionLessValsInList[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionMoreValsInList[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNonExistingDB[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNonExistingPartVals[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNonExistingTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNotDeleteDataPurge[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNotDeleteData[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNullDB[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNullPartDropOptions[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNullPartVals[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNullTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionNullVal[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartitionPurgeSetInTable[Remote] (batchId=230) org.apache.hadoop.hive.metastore.client.TestDropPartitions.testDropPartition[Remote] (batchId=230) org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testAbortTxn (batchId=318) org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testAbortTxns (batchId=318) org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testReplAllocWriteId (batchId=318) org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testReplOpenTxn (batchId=318) org.apache.hadoop.hive.metastore.txn.TestTxnHandler.testReplTimeouts (batchId=318) org.apache.hadoop.hive.metastore.txn.TestTxnUtils.testCleanString (batchId=230) org.apache.hadoop.hive.ql.TestTxnCommands2.testOpenTxnsCounter (batchId=344) org.apache.hadoop.hive.ql.TestTxnCommands2WithSplitUpdateAndVectorization.testOpenTxnsCounter (batchId=358) org.apache.hadoop.hive.ql.parse.TestReplAcidTablesBootstrapWithJsonMessage.testAcidTablesBootstrapDuringIncrementalWithOpenTxnsTimeout (batchId=259) org.apache.hadoop.hive.ql.parse.TestReplAcidTablesWithJsonMessage.testAcidTablesBootstrapWithOpenTxnsTimeout (batchId=277) org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTables.testAcidTablesBootstrapWithOpenTxnsTimeout (batchId=279) org.apache.hadoop.hive.ql.parse.TestReplicationScenariosAcidTablesBootstrap.testAcidTablesBootstrapDuringIncrementalWithOpenTxnsTimeout (batchId=257) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMajorPartitionCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMajorPartitionCompactionNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMajorTableCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMinorPartitionCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.cleanupAfterMinorTableCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.droppedPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner.droppedTable (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.cleanupAfterMajorPartitionCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.cleanupAfterMajorPartitionCompactionNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.cleanupAfterMajorTableCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.cleanupAfterMinorPartitionCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.cleanupAfterMinorTableCompaction (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.droppedPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleaner2.droppedTable (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestCleanerWithReplication.cleanupAfterMajorPartitionCompaction (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCleanerWithReplication.cleanupAfterMajorTableCompaction (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCleanerWithReplication.cleanupAfterMinorPartitionCompaction (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCleanerWithReplication.cleanupAfterMinorTableCompaction (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.majorCompactAfterAbort (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.majorCompactAfterAbortNew (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.majorCompactWhileStreaming (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.majorCompactWhileStreamingForSplitUpdate (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.majorCompactWhileStreamingForSplitUpdateNew (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.minorCompactAfterAbort (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.minorCompactAfterAbortNew (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.minorCompactWhileStreaming (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.minorCompactWhileStreamingWithSplitUpdate (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.minorCompactWhileStreamingWithSplitUpdateNew (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCompactor.testStatsAfterCompactionPartTbl (batchId=255) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testMinorCompactionWhileStreaming (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testMinorCompactionWhileStreamingAfterAbort (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testMinorCompactionWhileStreamingWithAbort (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestCrudCompactorOnTez.testMinorCompactionWhileStreamingWithSplitUpdate (batchId=264) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.chooseMajorOverMinorWhenBothValid (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.cleanEmptyAbortedTxns (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.compactPartitionHighDeltaPct (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.compactPartitionTooManyDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.compactTableHighDeltaPct (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.compactTableTooManyDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.dropPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.dropTable (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.enoughDeltasNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.noCompactTableDeltaPctNotHighEnough (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.noCompactTableDynamicPartitioning (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.noCompactTableNotEnoughDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.processCompactionCandidatesInParallel (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestInitiator.twoTxnsOnSamePartitionGenerateOneCompactionRequest (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.droppedPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.droppedTable (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorNoBaseLotsOfDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorPartitionWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorPartitionWithBaseMissingBuckets (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorTableLegacy (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorTableNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorTableWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorWithAborted (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.majorWithOpenInMiddle (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorNoBaseLotsOfDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorPartitionWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorTableLegacy (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorTableNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorTableWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorWithAborted (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.minorWithOpenInMiddle (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.oneDeltaWithAbortedTxn (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.sortedPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker.sortedTable (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.droppedPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.droppedTable (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorNoBaseLotsOfDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorPartitionWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorPartitionWithBaseMissingBuckets (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorTableLegacy (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorTableNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorTableWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorWithAborted (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.majorWithOpenInMiddle (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorNoBaseLotsOfDeltas (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorPartitionWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorTableLegacy (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorTableNoBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorTableWithBase (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorWithAborted (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.minorWithOpenInMiddle (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.oneDeltaWithAbortedTxn (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.sortedPartition (batchId=329) org.apache.hadoop.hive.ql.txn.compactor.TestWorker2.sortedTable (batchId=329) org.apache.hive.hcatalog.streaming.TestStreaming.testBucketing (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testBucketingWhereBucketColIsNotFirstCol (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testConcurrentTransactionBatchCommits (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testErrorHandling (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testFileDump (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testFileDumpCorruptDataFiles (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testFileDumpCorruptSideFiles (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testHeartbeat (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testInterleavedTransactionBatchCommits (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testMultipleTransactionBatchCommits (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testNoBuckets (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testRemainingTransactions (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTimeOutReaper (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbort (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbortAndCommit (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Delimited (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_DelimitedUGI (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Json (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Regex (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_RegexUGI (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyAbort (batchId=226) org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchEmptyCommit (batchId=226) org.apache.hive.streaming.TestStreaming.testAllTypesDelimitedWriter (batchId=370) org.apache.hive.streaming.TestStreaming.testAllTypesDelimitedWriterInputStream (batchId=370) org.apache.hive.streaming.TestStreaming.testAutoRollTransactionBatch (batchId=370) org.apache.hive.streaming.TestStreaming.testCommitWithKeyValue (batchId=370) org.apache.hive.streaming.TestStreaming.testErrorHandling (batchId=370) org.apache.hive.streaming.TestStreaming.testFileDumpCorruptDataFiles (batchId=370) org.apache.hive.streaming.TestStreaming.testFileDumpCorruptSideFiles (batchId=370) org.apache.hive.streaming.TestStreaming.testHeartbeat (batchId=370) org.apache.hive.streaming.TestStreaming.testInterleavedTransactionBatchCommits (batchId=370) org.apache.hive.streaming.TestStreaming.testMultipleTransactionBatchCommits (batchId=370) org.apache.hive.streaming.TestStreaming.testNoBuckets (batchId=370) org.apache.hive.streaming.TestStreaming.testTransactionBatchAbortAndCommit (batchId=370) org.apache.hive.streaming.TestStreaming.testTransactionBatchCommitDelimited (batchId=370) org.apache.hive.streaming.TestStreaming.testTransactionBatchCommitJson (batchId=370) org.apache.hive.streaming.TestStreaming.testTransactionBatchCommitRegex (batchId=370) {noformat} Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/21346/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/21346/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-21346/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 179 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12998250 - PreCommit-HIVE-Build > Oracle statement batching > ------------------------- > > Key: HIVE-23103 > URL: https://issues.apache.org/jira/browse/HIVE-23103 > Project: Hive > Issue Type: Improvement > Components: Transactions > Reporter: Peter Vary > Assignee: Peter Vary > Priority: Major > Attachments: HIVE-23103.patch > > > Examine how to really get better performance for oracle statement batches. > [Oracle JDBC > doc|https://docs.oracle.com/cd/E11882_01/java.112/e16548/oraperf.htm#JJDBC28752] > describes: > {quote}The Oracle implementation of standard update batching does not > implement true batching for generic statements and callable statements. Even > though Oracle JDBC supports the use of standard batching for {{Statement}} > and {{CallableStatement}} objects, you are unlikely to see performance > improvement. > {quote} > I would look for connection properties to set, so it is handled anyway, or if > not, then use: > {code} > begin > query1; > query2; > query3; > end; > {code} > to we will have only a single roundtrip for the db. -- This message was sent by Atlassian Jira (v8.3.4#803005)