[
https://issues.apache.org/jira/browse/PIG-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13475740#comment-13475740
]
Cheolsoo Park commented on PIG-2579:
------------------------------------
@Santhosh,
Thank you very much.
Btw, regarding the other test failures, I realized that I was hitting
MAPREDUCE-3933, and I was able to fix them by setting MALLOC_ARENA_MAX to 4 on
my CentOS 6 VM. Please see PIG-2966.
But I cannot reproduce the same failures on my Mac, which seems correct as this
issue is CentOS-6-specific. Are you setting JAVA_HOME=`/usr/libexec/java_home`
on your Mac? As far as I understand, those 3 tests are only ones that use
MiniCluster, and not setting JAVA_HOME will make them fail.
> Support for multiple input schemas in AvroStorage
> -------------------------------------------------
>
> Key: PIG-2579
> URL: https://issues.apache.org/jira/browse/PIG-2579
> Project: Pig
> Issue Type: New Feature
> Components: piggybank
> Affects Versions: 0.9.2, 0.11
> Reporter: Stan Rosenberg
> Assignee: Cheolsoo Park
> Priority: Minor
> Fix For: 0.11
>
> Attachments: avro_storage_union_schema.patch,
> avro_storage_union_schema_test.tar.gz, PIG-2579-2-avro_test_files.tar.gz,
> PIG-2579-2.patch, PIG-2579-3.patch, PIG-2579-4.patch, PIG-2579-5.patch,
> PIG-2579-6.patch
>
>
> This is a barebones patch for AvroStorage which enables support of multiple
> input schemas. The assumption is that the input consists of avro files
> having different schemas that can be unioned, e.g., flat records.
> A simple illustrative example is attached
> (avro_storage_union_schema_test.tar.gz): run create_avro1.pig, followed by
> create_avro2.pig, followed by read_avro.pig.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira