Re: distributed cache in pig

Thanks Olga. But what it running in mapreduce mode? Once the distributed cache is enable in this mode, there should still be some way to read these cached files. Actually, searching all the source files in pig-0.7, I can't find 'DistributedCache.getLocalCacheFiles' anywhere and I soppose there i

[jira] Commented: (PIG-1441) New test targets: unit and smoke

[ https://issues.apache.org/jira/browse/PIG-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876537#action_12876537 ] Olga Natkovich commented on PIG-1441: - I uploaded the patch. Unit test target runs in ab

[jira] Updated: (PIG-1441) New test targets: unit and smoke

[ https://issues.apache.org/jira/browse/PIG-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich updated PIG-1441: Attachment: PIG-1441.patch > New test targets: unit and smoke > > >

RE: distributed cache in pig

This is because Hadoop 20 does not support distributed cache in local mode. My understanding is that it would be part of Hadoop 22. Olga -Original Message- From: Gang Luo [mailto:lgpub...@yahoo.com.cn] Sent: Monday, June 07, 2010 3:40 PM To: pig-dev@hadoop.apache.org Subject: distributed

distributed cache in pig

HI all, I notice that whether pig use distributed cache depends on the context (local or mapreduce). When running in mapreduce mode, the distributed cache is always enable (e.g. replicated join). However, I never find such method, DistributedCache.getLocalCacheFiles(job), which get the cached fi

[jira] Updated: (PIG-1295) Binary comparator for secondary sort

[ https://issues.apache.org/jira/browse/PIG-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmarco De Francisci Morales updated PIG-1295: Attachment: PIG-1295_0.2.patch I added some simple performance tests.

[jira] Assigned: (PIG-1405) Need to move many standard functions from piggybank into Pig

[ https://issues.apache.org/jira/browse/PIG-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1405: --- Assignee: Aniket Mokashi > Need to move many standard functions from piggybank into Pig > -

[jira] Assigned: (PIG-928) UDFs in scripting languages

[ https://issues.apache.org/jira/browse/PIG-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-928: -- Assignee: Aniket Mokashi > UDFs in scripting languages > --- > >

[jira] Assigned: (PIG-1434) Allow casting relations to scalars

[ https://issues.apache.org/jira/browse/PIG-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1434: --- Assignee: Aniket Mokashi > Allow casting relations to scalars > ---

[jira] Assigned: (PIG-1436) Print number of records outputted at each step of a Pig script

[ https://issues.apache.org/jira/browse/PIG-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1436: --- Assignee: Richard Ding I think Richard is already doing this as part of his stats work > Print

[jira] Assigned: (PIG-1435) make sure dependent jobs fail when a jon in multiquery fails

[ https://issues.apache.org/jira/browse/PIG-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-1435: --- Assignee: Richard Ding > make sure dependent jobs fail when a jon in multiquery fails > ---

[jira] Assigned: (PIG-490) Combiner not used when group elements referred to in tuple notation instead of flatten.

[ https://issues.apache.org/jira/browse/PIG-490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olga Natkovich reassigned PIG-490: -- Assignee: Thejas M Nair > Combiner not used when group elements referred to in tuple notation inst

[jira] Commented: (PIG-1295) Binary comparator for secondary sort

[ https://issues.apache.org/jira/browse/PIG-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876354#action_12876354 ] Daniel Dai commented on PIG-1295: - I briefly review the patch, looks good. This is the approa

[jira] Commented: (PIG-1429) Add Boolean Data Type to Pig

[ https://issues.apache.org/jira/browse/PIG-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876326#action_12876326 ] Alan Gates commented on PIG-1429: - Is this patch ready for review or does it need more work?

[jira] Created: (PIG-1442) java.lang.OutOfMemoryError: Java heap space (Reopen of PIG-766)

java.lang.OutOfMemoryError: Java heap space (Reopen of PIG-766) --- Key: PIG-1442 URL: https://issues.apache.org/jira/browse/PIG-1442 Project: Pig Issue Type: Bug Componen