[ 
https://issues.apache.org/jira/browse/HIVE-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014164#comment-14014164
 ] 

Hive QA commented on HIVE-7072:
-------------------------------



{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12647274/HIVE-7072.2.patch

{color:red}ERROR:{color} -1 due to 67 failed/errored test(s), 5542 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_insert1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_scriptfile1
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_tez_dml
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_ctas
org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testSubmit
org.apache.hive.hcatalog.mapreduce.TestHCatHiveCompatibility.testPartedRead
org.apache.hive.hcatalog.mapreduce.TestHCatHiveCompatibility.testUnpartedReadWrite
org.apache.hive.hcatalog.mapreduce.TestHCatHiveThriftCompatibility.testDynamicCols
org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteRead
org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testSequenceTableWriteReadMR
org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteRead
org.apache.hive.hcatalog.mapreduce.TestSequenceFileReadWrite.testTextTableWriteReadMR
org.apache.hive.hcatalog.pig.TestE2EScenarios.testReadOrcAndRCFromPig
org.apache.hive.hcatalog.pig.TestHCatLoader.testColumnarStorePushdown
org.apache.hive.hcatalog.pig.TestHCatLoader.testConvertBooleanToInt
org.apache.hive.hcatalog.pig.TestHCatLoader.testGetInputBytes
org.apache.hive.hcatalog.pig.TestHCatLoader.testProjectionsBasic
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataBasic
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadDataPrimitiveTypes
org.apache.hive.hcatalog.pig.TestHCatLoader.testReadPartitionedBasic
org.apache.hive.hcatalog.pig.TestHCatLoaderComplexSchema.testMapWithComplexData
org.apache.hive.hcatalog.pig.TestHCatLoaderComplexSchema.testSyntheticComplexSchema
org.apache.hive.hcatalog.pig.TestHCatLoaderComplexSchema.testTupleInBagInTupleInBag
org.apache.hive.hcatalog.pig.TestHCatLoaderStorer.testReadWrite
org.apache.hive.hcatalog.pig.TestHCatLoaderStorer.testSmallTinyInt
org.apache.hive.hcatalog.pig.TestHCatStorer.testDateCharTypes
org.apache.hive.hcatalog.pig.TestHCatStorer.testPartColsInData
org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreFuncAllSimpleTypes
org.apache.hive.hcatalog.pig.TestHCatStorer.testStoreInPartiitonedTbl
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteChar
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDate
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDate2
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDate3
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteDecimalXY
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteSmallint
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteTimestamp
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteTinyint
org.apache.hive.hcatalog.pig.TestHCatStorer.testWriteVarchar
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testColumnarStorePushdown
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testConvertBooleanToInt
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testGetInputBytes
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testProjectionsBasic
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadDataBasic
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadDataPrimitiveTypes
org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadPartitionedBasic
org.apache.hive.hcatalog.pig.TestOrcHCatLoaderComplexSchema.testMapWithComplexData
org.apache.hive.hcatalog.pig.TestOrcHCatLoaderComplexSchema.testSyntheticComplexSchema
org.apache.hive.hcatalog.pig.TestOrcHCatLoaderComplexSchema.testTupleInBagInTupleInBag
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testDateCharTypes
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testPartColsInData
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testStoreFuncAllSimpleTypes
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testStoreInPartiitonedTbl
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteChar
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDate
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDate2
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDate3
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimal
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalX
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteDecimalXY
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteSmallint
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteTimestamp
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteTinyint
org.apache.hive.hcatalog.pig.TestOrcHCatPigStorer.testWriteVarchar
org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/337/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/337/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-337/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 67 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12647274

> HCatLoader only loads first region of hbase table
> -------------------------------------------------
>
>                 Key: HIVE-7072
>                 URL: https://issues.apache.org/jira/browse/HIVE-7072
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-7072.2.patch
>
>
> Pig needs a config parameter 'pig.noSplitCombination' set to 'true' for it to 
> be able to read HBaseStorageHandler-based tables.
> This is done in the HBaseLoader at getSplits time, but HCatLoader does not do 
> so, which results in only a partial data load.
> Thus, we need one more special case definition in HCat, that sets this 
> parameter in the job properties if we detect that we're loading a 
> HBaseStorageHandler based table. (Note, also, that we should not depend 
> directly on the HBaseStorageHandler class, and instead depend on the name of 
> the class, since we do not want a mvn dependency on hive-hbase-handler to be 
> able to compile HCatalog core, since it's conceivable that at some time, 
> there might be a reverse dependency.) The primary issue is one of where this 
> code should go, since it doesn't belong in pig (pig does not know what loader 
> behaviour should be, and this parameter is its interface to a loader), and 
> doesn't belong in the HBaseStorageHandler either, since that's implementing a 
> HiveStorageHandler and is connecting up the two. Thus, this should belong to 
> HCatLoader. Setting this parameter across the board results in poor 
> performance for HCatLoader, so it must only be set when using with HBase.
> Thus, it belongs in the SpecialCases definition as that was created 
> specifically for these kinds of odd cases, and can be called from within 
> HCatLoader.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to