[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[
https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785482#comment-13785482
]
Hive QA commented on HIVE-4734:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12606510/HIVE-4734.4.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 4047 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_serde
org.apache.hadoop.hive.serde2.avro.TestAvroDeserializer.verifyCaching
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1013/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1013/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
> Use custom ObjectInspectors for AvroSerde
> -
>
> Key: HIVE-4734
> URL: https://issues.apache.org/jira/browse/HIVE-4734
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
>Reporter: Mark Wagner
>Assignee: Mark Wagner
> Fix For: 0.12.0
>
> Attachments: HIVE-4734.1.patch, HIVE-4734.2.patch, HIVE-4734.3.patch,
> HIVE-4734.4.patch
>
>
> Currently, the AvroSerde recursively copies all fields of a record from the
> GenericRecord to a List row object and provides the standard
> ObjectInspectors. Performance can be improved by providing ObjectInspectors
> to the Avro record itself.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[ https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749836#comment-13749836 ] Jakob Homan commented on HIVE-4734: --- Reviewed last patch on RB. Everything looks good except for a change in the handling of [T1,Tn,NULL] types. > Use custom ObjectInspectors for AvroSerde > - > > Key: HIVE-4734 > URL: https://issues.apache.org/jira/browse/HIVE-4734 > Project: Hive > Issue Type: Improvement > Components: Serializers/Deserializers >Reporter: Mark Wagner >Assignee: Mark Wagner > Fix For: 0.12.0 > > Attachments: HIVE-4734.1.patch, HIVE-4734.2.patch, HIVE-4734.3.patch > > > Currently, the AvroSerde recursively copies all fields of a record from the > GenericRecord to a List row object and provides the standard > ObjectInspectors. Performance can be improved by providing ObjectInspectors > to the Avro record itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[
https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13723422#comment-13723422
]
Hive QA commented on HIVE-4734:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12594789/HIVE-4734.3.patch
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/228/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/228/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Tests failed with: NonZeroExitCodeException: Command 'bash
/data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and
output '+ [[ -n '' ]]
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-Build-228/source-prep.txt
+ mkdir -p maven ivy
+ [[ svn = \s\v\n ]]
+ [[ -n '' ]]
+ [[ -d apache-svn-trunk-source ]]
+ [[ ! -d apache-svn-trunk-source/.svn ]]
+ [[ ! -d apache-svn-trunk-source ]]
+ cd apache-svn-trunk-source
+ svn revert -R .
Reverted 'bin/ext/debug.sh'
Reverted 'bin/hive'
++ egrep -v '^X|^Performing status on external'
++ awk '{print $2}'
++ svn status --no-ignore
+ rm -rf build hcatalog/build hcatalog/core/build
hcatalog/storage-handlers/hbase/build hcatalog/server-extensions/build
hcatalog/webhcat/svr/build hcatalog/webhcat/java-client/build
hcatalog/hcatalog-pig-adapter/build common/src/gen
+ svn update
Fetching external item into 'hcatalog/src/test/e2e/harness'
External at revision 1508304.
At revision 1508304.
+ patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hive-ptest/working/scratch/build.patch
+ [[ -f /data/hive-ptest/working/scratch/build.patch ]]
+ chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
+ /data/hive-ptest/working/scratch/smart-apply-patch.sh
/data/hive-ptest/working/scratch/build.patch
The patch does not appear to apply with p0 to p2
+ exit 1
'
{noformat}
This message is automatically generated.
> Use custom ObjectInspectors for AvroSerde
> -
>
> Key: HIVE-4734
> URL: https://issues.apache.org/jira/browse/HIVE-4734
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
>Reporter: Mark Wagner
>Assignee: Mark Wagner
> Fix For: 0.12.0
>
> Attachments: HIVE-4734.1.patch, HIVE-4734.2.patch, HIVE-4734.3.patch
>
>
> Currently, the AvroSerde recursively copies all fields of a record from the
> GenericRecord to a List row object and provides the standard
> ObjectInspectors. Performance can be improved by providing ObjectInspectors
> to the Avro record itself.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[ https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13722675#comment-13722675 ] Jakob Homan commented on HIVE-4734: --- Added comments into the rb. > Use custom ObjectInspectors for AvroSerde > - > > Key: HIVE-4734 > URL: https://issues.apache.org/jira/browse/HIVE-4734 > Project: Hive > Issue Type: Improvement > Components: Serializers/Deserializers >Reporter: Mark Wagner >Assignee: Mark Wagner > Fix For: 0.12.0 > > Attachments: HIVE-4734.1.patch, HIVE-4734.2.patch > > > Currently, the AvroSerde recursively copies all fields of a record from the > GenericRecord to a List row object and provides the standard > ObjectInspectors. Performance can be improved by providing ObjectInspectors > to the Avro record itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[ https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13722637#comment-13722637 ] Jakob Homan commented on HIVE-4734: --- Sorry, above comment was for HIVE-3264. Still reviewing this one. > Use custom ObjectInspectors for AvroSerde > - > > Key: HIVE-4734 > URL: https://issues.apache.org/jira/browse/HIVE-4734 > Project: Hive > Issue Type: Improvement > Components: Serializers/Deserializers >Reporter: Mark Wagner >Assignee: Mark Wagner > Fix For: 0.12.0 > > Attachments: HIVE-4734.1.patch, HIVE-4734.2.patch > > > Currently, the AvroSerde recursively copies all fields of a record from the > GenericRecord to a List row object and provides the standard > ObjectInspectors. Performance can be improved by providing ObjectInspectors > to the Avro record itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[ https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13722635#comment-13722635 ] Jakob Homan commented on HIVE-4734: --- +1. Looks good. > Use custom ObjectInspectors for AvroSerde > - > > Key: HIVE-4734 > URL: https://issues.apache.org/jira/browse/HIVE-4734 > Project: Hive > Issue Type: Improvement > Components: Serializers/Deserializers >Reporter: Mark Wagner >Assignee: Mark Wagner > Fix For: 0.12.0 > > Attachments: HIVE-4734.1.patch, HIVE-4734.2.patch > > > Currently, the AvroSerde recursively copies all fields of a record from the > GenericRecord to a List row object and provides the standard > ObjectInspectors. Performance can be improved by providing ObjectInspectors > to the Avro record itself. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4734) Use custom ObjectInspectors for AvroSerde
[
https://issues.apache.org/jira/browse/HIVE-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721535#comment-13721535
]
Hive QA commented on HIVE-4734:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12594507/HIVE-4734.2.patch
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/203/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/203/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.CleanupPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests failed with: NonZeroExitCodeException: Command 'bash
/data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and
output '+ [[ -n '' ]]
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost
-Dhttp.proxyPort=3128'
+ cd /data/hive-ptest/working/
+ tee /data/hive-ptest/logs/PreCommit-HIVE-Build-203/source-prep.txt
+ mkdir -p maven ivy
+ [[ svn = \s\v\n ]]
+ [[ -n '' ]]
+ [[ -d apache-svn-trunk-source ]]
+ [[ ! -d apache-svn-trunk-source/.svn ]]
+ [[ ! -d apache-svn-trunk-source ]]
+ cd apache-svn-trunk-source
+ svn revert -R .
Reverted 'conf/hive-default.xml.template'
Reverted 'common/src/java/org/apache/hadoop/hive/conf/HiveConf.java'
Reverted 'ql/src/test/results/clientpositive/auto_join13.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join22.q.out'
Reverted 'ql/src/test/results/clientpositive/mapjoin_filter_on_outerjoin.q.out'
Reverted 'ql/src/test/results/clientpositive/join33.q.out'
Reverted 'ql/src/test/results/clientpositive/mapjoin_mapjoin.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_9.q.out'
Reverted 'ql/src/test/results/clientpositive/multi_join_union.q.out'
Reverted 'ql/src/test/results/clientpositive/correlationoptimizer3.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join29.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join15.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join24.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join10.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join33.q.out'
Reverted 'ql/src/test/results/clientpositive/union34.q.out'
Reverted 'ql/src/test/results/clientpositive/mapjoin_subquery2.q.out'
Reverted 'ql/src/test/results/clientpositive/mapjoin_subquery.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join26.q.out'
Reverted 'ql/src/test/results/clientpositive/mapjoin_test_outer.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join12.q.out'
Reverted 'ql/src/test/results/clientpositive/join28.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join21.q.out'
Reverted 'ql/src/test/results/clientpositive/join32.q.out'
Reverted 'ql/src/test/results/clientpositive/join_star.q.out'
Reverted 'ql/src/test/results/clientpositive/correlationoptimizer7.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_10.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join28.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join23.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join32.q.out'
Reverted 'ql/src/test/results/clientpositive/correlationoptimizer4.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join0.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join16.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join11.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join20.q.out'
Reverted 'ql/src/test/results/clientpositive/multiMapJoin1.q.out'
Reverted 'ql/src/test/results/clientpositive/correlationoptimizer6.q.out'
Reverted 'ql/src/test/results/clientpositive/auto_join2.q.out'
Reverted 'ql/src/test/results/clientpositive/correlationoptimizer1.q.out'
Reverted 'ql/src/test/queries/clientpositive/correlationoptimizer4.q'
Reverted 'ql/src/test/queries/clientpositive/correlationoptimizer6.q'
Reverted 'ql/src/test/queries/clientpositive/union34.q'
Reverted 'ql/src/test/queries/clientpositive/multiMapJoin1.q'
Reverted 'ql/src/test/queries/clientpositive/auto_join33.q'
Reverted 'ql/src/test/queries/clientpositive/correlationoptimizer1.q'
Reverted 'ql/src/test/queries/clientpositive/correlationoptimizer3.q'
Reverted 'ql/src/test/queries/clientpositive/correlationoptimizer5.q'
Reverted 'ql/src/test/queries/clientpositive/correlationoptimizer7.q'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java'
Reverted
'ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/CommonJoinTaskDispatcher.java'
Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/OperatorUtils.java'
++ egrep -v '^X|^Performing status on external'
++
