[jira] [Commented] (PIG-3672) Pig should not check for hardcoded file system implementations

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980606#comment-13980606 ] Daniel Dai commented on PIG-3672: - +1 for PIG-3672-3.patch > Pig should not check for har

[jira] Subscription: PIG patch available

2014-04-24 Thread jira
Issue Subscription Filter: PIG patch available (15 issues) Subscriber: pigdaily Key Summary PIG-3901Organize the Pig properties file and document all properties https://issues.apache.org/jira/browse/PIG-3901 PIG-3877Getting Geo Latitude/Longitude from Address Lines

[jira] [Updated] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2014-04-24 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis updated PIG-3891: -- Attachment: PIG-3891-branch-0.11.patch Attaching fix for class JobStats.java (pig 0.11) > FileBasedOutpu

[jira] [Updated] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2014-04-24 Thread Mona Chitnis (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mona Chitnis updated PIG-3891: -- Attachment: PIG-3891-1.patch Attaching patch. End-to-end test done - using MultiStorage, split and both.

[jira] [Commented] (PIG-3904) Pig support windows i18n

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980526#comment-13980526 ] Daniel Dai commented on PIG-3904: - The patch does not apply in trunk. There is quite a few c

[jira] [Updated] (PIG-3865) Remodel the XMLLoader to work to be faster and more maintainable

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3865: Resolution: Fixed Fix Version/s: 0.13.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Created] (PIG-3911) Define unique fields with @OutputSchema

2014-04-24 Thread Lorand Bendig (JIRA)
Lorand Bendig created PIG-3911: -- Summary: Define unique fields with @OutputSchema Key: PIG-3911 URL: https://issues.apache.org/jira/browse/PIG-3911 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-3880) After compiling trunk, I am seeing ClassLoaderObjectInputStream ClassNotFoundException.

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980488#comment-13980488 ] Daniel Dai commented on PIG-3880: - Not sure what happen but here is something might be relat

[jira] [Commented] (PIG-3910) Cannot use DUMP command in macro

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980474#comment-13980474 ] Daniel Dai commented on PIG-3910: - Dump is in grunt parser which cannot be included in Macro

Re: Predicate pushdown in columnar file formats

2014-04-24 Thread Daniel Dai
We need a new interface for predicate pushdown. Current interface only support partition pushdown which consume the filter condition into loader. AFAIK, ORC predicate pushdown only support simple types. I discussed briefly with Aniket before, and we are open to the choice of interface design. There

[jira] [Updated] (PIG-3737) Bundle dependent jars in distribution in %PIG_HOME%/lib folder

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3737: Resolution: Fixed Fix Version/s: 0.13.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Resolved] (PIG-3905) 0.12.1 release can't be build for Hadoop2

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-3905. - Resolution: Fixed Fix Version/s: 0.13.0 Assignee: Daniel Dai Hadoop Flags: Reviewed Co

[jira] [Assigned] (PIG-3909) Type Casting issue

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-3909: --- Assignee: Daniel Dai > Type Casting issue > -- > > Key: PIG-3909 >

[jira] [Updated] (PIG-3909) Type Casting issue

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3909: Attachment: PIG-3909-1.patch In ProjectExpression we forget clone the fieldSchema. Attach the patch. > Type

[jira] [Updated] (PIG-3909) Type Casting issue

2014-04-24 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3909: Fix Version/s: 0.13.0 > Type Casting issue > -- > > Key: PIG-3909 >

Predicate pushdown in columnar file formats

2014-04-24 Thread Rohini Palaniswamy
Hi, Both Parquet and ORC both support predicate pushdown. Was looking at whether we can make use of the existing PartitionFilterOptimizer and report whether columns supported for predicate pushdown can be reported as partition columns. Dmitriy was talking about the PartitionFilterOptimizer push

[jira] [Commented] (PIG-3880) After compiling trunk, I am seeing ClassLoaderObjectInputStream ClassNotFoundException.

2014-04-24 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980341#comment-13980341 ] Josh Elser commented on PIG-3880: - I'm not sure what to say at this point. PIG_CLASSPATH sho

[jira] [Commented] (PIG-3891) FileBasedOutputSizeReader does not calculate size of files in sub-directories

2014-04-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980106#comment-13980106 ] Rohini Palaniswamy commented on PIG-3891: - bq. 0.11 shows the correct number of tota

[jira] [Commented] (PIG-3796) PigStats output bytes written not collected for relative paths

2014-04-24 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980104#comment-13980104 ] Rohini Palaniswamy commented on PIG-3796: - Addressing this as part of PIG-3672 > Pi

[jira] [Commented] (PIG-3737) Bundle dependent jars in distribution in %PIG_HOME%/lib folder

2014-04-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979926#comment-13979926 ] Cheolsoo Park commented on PIG-3737: +1 > Bundle dependent jars in distribution in %PIG

[jira] [Work started] (PIG-3898) Refactor PPNL for non-MR execution engine

2014-04-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on PIG-3898 started by Cheolsoo Park. > Refactor PPNL for non-MR execution engine > - > > Key: PIG-3898 >

[jira] [Commented] (PIG-3905) 0.12.1 release can't be build for Hadoop2

2014-04-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979914#comment-13979914 ] Cheolsoo Park commented on PIG-3905: +1. Good catch. > 0.12.1 release can't be build fo

[jira] [Resolved] (PIG-3898) Refactor PPNL for non-MR execution engine

2014-04-24 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park resolved PIG-3898. Resolution: Fixed Fix Version/s: tez-branch Committed to trunk and tez branch. Thank you Anik