[
https://issues.apache.org/jira/browse/PIG-4554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14908891#comment-14908891
]
Rohini Palaniswamy commented on PIG-4554:
-----------------------------------------
[~sandyridgeracer],
Was just about to commit, but the tests TestPigStats.testPigScriptInConf and
TestPigStats.testJythonScriptInConf failed as they are checking of base64
encoded script instead of compressed script. You need to fix them. Ensure below
tests pass.
ant clean test -Dtestcase=TestPigStatsMR -Dhadoopversion=23 and ant clean test
-Dtestcase=TestPigStatsTez -Dhadoopversion=23
> Compress pig.script before encoding
> -----------------------------------
>
> Key: PIG-4554
> URL: https://issues.apache.org/jira/browse/PIG-4554
> Project: Pig
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Rohini Palaniswamy
> Assignee: Sandeep Samdaria
> Labels: newbie
> Fix For: 0.16.0
>
> Attachments: PIG-4554-2.patch, PIG-4554-3.patch, PIG-4554.patch
>
>
> Currently we truncate the pig script (maxScriptSize = 10240) and base64
> encode it and store in config. We should remove the truncation and store the
> full script by compressing and then doing base64 encoding. We already do that
> for udfcontext, etc. It will save space as it will compress really well and
> will also give the full pig script while debugging.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
