[ https://issues.apache.org/jira/browse/HIVE-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014164#comment-14014164 ]
Hive QA commented on HIVE-7072: ------------------------------- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12647274/HIVE-7072.2.patch {color:red}ERROR:{color} -1 due to 67 failed/errored test(s), 5542 tests executed *Failed tests:* {noformat} org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_scriptfile1 org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testSubmit org.apache.hive.hcatalog.mapreduce.TestHCatHiveCompatibility.testPartedRead org.apache.hive.hcatalog.mapreduce.TestHCatHiveCompatibility.testUnpartedReadWrite org.apache.hive.hcatalog.mapreduce.TestHCatHiveThriftCompatibility.testDynamicCols org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteRead org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteReadMR org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteRead org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteReadMR org.apache.hive.hcatalog.pig.TestE2EScenarios.testReadOrcAndRCFromPig org.apache.hive.hcatalog.pig.TestHCatLoader.testColumnarStorePushdown org.apache.hive.hcatalog.pig.TestHCatLoader.testConvertBooleanToInt org.apache.hive.hcatalog.pig.TestHCatLoader.testGetInputBytes org.apache.hive.hcatalog.pig.TestHCatLoader.testProjectionsBasic org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataBasic org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes org.apache.hive.hcatalog.pig.TestHCatLoader.testReadPartitionedBasic org.apache.hive.hcatalog.pig.TestHCatLoaderComplexSchema.testMapWithComplexData org.apache.hive.hcatalog.pig.TestHCatLoaderComplexSchema.testSyntheticComplexSchema org.apache.hive.hcatalog.pig.TestHCatLoaderComplexSchema.testTupleInBagInTupleInBag org.apache.hive.hcatalog.pig.TestHCatLoaderStorer.testReadWrite org.apache.hive.hcatalog.pig.TestHCatLoaderStorer.testSmallTinyInt org.apache.hive.hcatalog.pig.TestHCatStorer.testDateCharTypes org.apache.hive.hcatalog.pig.TestHCatStorer.testPartColsInData org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreFuncAllSimpleTypes org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreInPartiitonedTbl org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteChar org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDate org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDate2 org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDate3 org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDecimal org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDecimalX org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDecimalXY org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteSmallint org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteTimestamp org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteTinyint org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteVarchar org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testColumnarStorePushdown org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testConvertBooleanToInt org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testGetInputBytes org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testProjectionsBasic org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadDataBasic org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadDataPrimitiveTypes org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadPartitionedBasic org.apache.hive.hcatalog.pig.TestOrcHCatLoaderComplexSchema.testMapWithComplexData org.apache.hive.hcatalog.pig.TestOrcHCatLoaderComplexSchema.testSyntheticComplexSchema org.apache.hive.hcatalog.pig.TestOrcHCatLoaderComplexSchema.testTupleInBagInTupleInBag org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testDateCharTypes org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testPartColsInData org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testStoreFuncAllSimpleTypes org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testStoreInPartiitonedTbl org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteChar org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDate org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDate2 org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDate3 org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteSmallint org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteTimestamp org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteTinyint org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteVarchar org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/337/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/337/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-337/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 67 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12647274 > HCatLoader only loads first region of hbase table > ------------------------------------------------- > > Key: HIVE-7072 > URL: https://issues.apache.org/jira/browse/HIVE-7072 > Project: Hive > Issue Type: Bug > Affects Versions: 0.14.0 > Reporter: Sushanth Sowmyan > Assignee: Sushanth Sowmyan > Attachments: HIVE-7072.2.patch > > > Pig needs a config parameter 'pig.noSplitCombination' set to 'true' for it to > be able to read HBaseStorageHandler-based tables. > This is done in the HBaseLoader at getSplits time, but HCatLoader does not do > so, which results in only a partial data load. > Thus, we need one more special case definition in HCat, that sets this > parameter in the job properties if we detect that we're loading a > HBaseStorageHandler based table. (Note, also, that we should not depend > directly on the HBaseStorageHandler class, and instead depend on the name of > the class, since we do not want a mvn dependency on hive-hbase-handler to be > able to compile HCatalog core, since it's conceivable that at some time, > there might be a reverse dependency.) The primary issue is one of where this > code should go, since it doesn't belong in pig (pig does not know what loader > behaviour should be, and this parameter is its interface to a loader), and > doesn't belong in the HBaseStorageHandler either, since that's implementing a > HiveStorageHandler and is connecting up the two. Thus, this should belong to > HCatLoader. Setting this parameter across the board results in poor > performance for HCatLoader, so it must only be set when using with HBase. > Thus, it belongs in the SpecialCases definition as that was created > specifically for these kinds of odd cases, and can be called from within > HCatLoader. -- This message was sent by Atlassian JIRA (v6.2#6252)