[jira] Updated: (PIG-496) project of bags from complex data causes failures

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-496: --- Attachment: PIG-496-1.patch PIG-496-1.patch is depended on PIG-730. Otherwise there will be frontend exception.

[jira] Commented: (PIG-496) project of bags from complex data causes failures

2011-01-10 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979909#action_12979909 ] Olga Natkovich commented on PIG-496: This looks good with on modification - the fields don

[jira] Commented: (PIG-496) project of bags from complex data causes failures

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979904#action_12979904 ] Daniel Dai commented on PIG-496: We need to decide how to load empty bag, eg. {code} A = load

[jira] Commented: (PIG-1717) pig needs to call setPartitionFilter if schema is null but getPartitionKeys is not

2011-01-10 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979902#action_12979902 ] Ashutosh Chauhan commented on PIG-1717: --- @Gerrit, bq. The problem is that this user de

[jira] Commented: (PIG-1787) Error in logical plan generated

2011-01-10 Thread Richard Ding (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979897#action_12979897 ] Richard Ding commented on PIG-1787: --- +1. > Error in logical plan generated > -

[jira] Created: (PIG-1796) need to document what is supported in nested foreach

2011-01-10 Thread Olga Natkovich (JIRA)
need to document what is supported in nested foreach Key: PIG-1796 URL: https://issues.apache.org/jira/browse/PIG-1796 Project: Pig Issue Type: Improvement Components: documentat

Re: PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

2011-01-10 Thread Julien Le Dem
I was calling result("").getNumberRecords() from a script. I¹ve tried several of the methods but they all returned empty lists: getOutputLocations() getOutputNames() If this is a known issue, is there a JIRA open ? This should work independently of the mode. Julien On 1/10/11 2:41 PM, "Richard D

[jira] Commented: (PIG-1787) Error in logical plan generated

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979854#action_12979854 ] Daniel Dai commented on PIG-1787: - Note the test case only works in mapreduce mode. In local

[jira] Commented: (PIG-1717) pig needs to call setPartitionFilter if schema is null but getPartitionKeys is not

2011-01-10 Thread Gerrit Jansen van Vuuren (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979846#action_12979846 ] Gerrit Jansen van Vuuren commented on PIG-1717: --- I agree, option A would be ide

[jira] Commented: (PIG-1717) pig needs to call setPartitionFilter if schema is null but getPartitionKeys is not

2011-01-10 Thread Olga Natkovich (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979847#action_12979847 ] Olga Natkovich commented on PIG-1717: - Seems reasonable. > pig needs to call setPartitio

Re: PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

2011-01-10 Thread Richard Ding
The related jira is PIG-1286. We're waiting for a fix from hadoop team. The methods getOutputLocations() and getOutputNames() don't use counters and they shouldn't return empty list. On 1/10/11 2:52 PM, "Julien Le Dem" wrote: I was calling result("").getNumberRecords() from a script. I've tri

Re: PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

2011-01-10 Thread Richard Ding
What method did you call to check if a dataset is empty? It's known that the counters don't work in local mode. On 1/9/11 3:15 PM, "Julien Le Dem" wrote: However, it works fine in mini cluster. I'm not sure what causes it. The consequence is that I can not check if a dataset is empty in the en

[jira] Resolved: (PIG-694) Schema merge should take into account bags with tuples and bags with schemas

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-694. Resolution: Fixed After PIG-767, bag schema always contains tuple. This is no longer an issue. > Schema merge

[jira] Resolved: (PIG-723) Pig generates incorrect schema for generated bags after FOREACH.

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-723. Resolution: Duplicate It is a duplication of PIG-767. > Pig generates incorrect schema for generated bags aft

[jira] Resolved: (PIG-1112) FLATTEN eliminates the alias

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-1112. - Resolution: Fixed It is fixed on the current trunk. > FLATTEN eliminates the alias > -

[jira] Commented: (PIG-1717) pig needs to call setPartitionFilter if schema is null but getPartitionKeys is not

2011-01-10 Thread Alan Gates (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979808#action_12979808 ] Alan Gates commented on PIG-1717: - Ideally I would like to pick A, since that is the clean so

[jira] Updated: (PIG-730) problem combining schema from a union of several LOAD expressions, with a nested bag inside the schema.

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-730: --- Attachment: (was: PIG-730-1.patch) > problem combining schema from a union of several LOAD expressions, with

[jira] Updated: (PIG-730) problem combining schema from a union of several LOAD expressions, with a nested bag inside the schema.

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-730: --- Attachment: PIG-730-1.patch > problem combining schema from a union of several LOAD expressions, with a > neste

[jira] Updated: (PIG-730) problem combining schema from a union of several LOAD expressions, with a nested bag inside the schema.

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-730: --- Attachment: PIG-730-1.patch This is because after mergeSchema(union will call mergeSchema), we lose twoLevelAcc

[jira] Updated: (PIG-767) Schema reported from DESCRIBE and actual schema of inner bags are different.

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-767: --- Attachment: PIG-767-1.patch The only place we generate bag schema without tuple inside is LOGroup. Attach PIG-7

[jira] Commented: (PIG-1785) New logical plan: uid conflict in flattened fields

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979712#action_12979712 ] Daniel Dai commented on PIG-1785: - Review request: https://reviews.apache.org/r/269/ > New l

Review Request: New logical plan: uid conflict in flattened fields

2011-01-10 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/269/ --- Review request for pig and Xuefu Zhang. Summary --- The following script pro

[jira] Commented: (PIG-1787) Error in logical plan generated

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12979685#action_12979685 ] Daniel Dai commented on PIG-1787: - Review request: https://reviews.apache.org/r/265/ > Error

Re: Review Request: Error in logical plan generated

2011-01-10 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/265/ --- (Updated 2011-01-10 10:58:06.188077) Review request for pig and Richard Ding. S

Review Request: Error in logical plan generated

2011-01-10 Thread Daniel Dai
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/265/ --- Review request for pig and Richard Ding. Summary --- Test case: a = load '1

[jira] Updated: (PIG-1787) Error in logical plan generated

2011-01-10 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-1787: Attachment: PIG-1787-2.patch PIG-1787-2.patch fix unit test failures. > Error in logical plan generated > --

[jira] Created: (PIG-1795) new parser : duplicate ConstantExpressions created in inner plan

2011-01-10 Thread Thejas M Nair (JIRA)
new parser : duplicate ConstantExpressions created in inner plan Key: PIG-1795 URL: https://issues.apache.org/jira/browse/PIG-1795 Project: Pig Issue Type: Sub-task C

PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

2011-01-10 Thread Julien Le Dem
However, it works fine in mini cluster. I'm not sure what causes it. The consequence is that I can not check if a dataset is empty in the end condition for the transitive closure in javascript. Julien