[jira] Commented: (PIG-1309) Sort Merge Cogroup

2010-09-03 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12905859#action_12905859 ] Mridul Muralidharan commented on PIG-1309: -- Condition (1) refers to only expl

Re: [jira] Updated: (PIG-1309) Map-side Cogroup

2010-09-03 Thread Mridul Muralidharan
Condition (1) refers to only explicit (user specified) statements right ? Not implicit project introduced by pig to conform to schema ? Regards, Mridul On Saturday 21 August 2010 12:59 AM, Ashutosh Chauhan (JIRA) wrote: [ https://issues.apache.org/jira/browse/PIG-1309?page=com.atlass

[jira] Commented: (PIG-1321) Logical Optimizer: Merge cascading foreach

2010-08-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902392#action_12902392 ] Mridul Muralidharan commented on PIG-1321: -- Is the merge prevented only if fla

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-25 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12902350#action_12902350 ] Mridul Muralidharan commented on PIG-1518: -- Might be a good idea to con

[jira] Commented: (PIG-1518) multi file input format for loaders

2010-08-18 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1292#action_1292 ] Mridul Muralidharan commented on PIG-1518: -- if optimizer is turned off, does

[jira] Commented: (PIG-365) Map side optimization for Limit (top k case)

2010-08-18 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1280#action_1280 ] Mridul Muralidharan commented on PIG-365: - collecting only top k per mappe

[jira] Commented: (PIG-1530) PIG Logical Optimization: Push LOFilter above LOCogroup

2010-08-01 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894388#action_12894388 ] Mridul Muralidharan commented on PIG-1530: -- Cant edit comments .. to ad

[jira] Commented: (PIG-1530) PIG Logical Optimization: Push LOFilter above LOCogroup

2010-08-01 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12894368#action_12894368 ] Mridul Muralidharan commented on PIG-1530: -- This looks more like a developer co

[jira] Commented: (PIG-566) Dump and store outputs do not match for PigStorage

2010-05-17 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12868155#action_12868155 ] Mridul Muralidharan commented on PIG-566: - Just to point out an error in the com

Re: optimizer hints in Pig

2009-11-14 Thread Mridul Muralidharan
This should be interesting to pursue. For non-trivial plans, it can be used to model how join's are to be optimized for example - instead of having users specify it, infer based on the hints from various stages. Similarly, an oft-repeated request is making pig infer the value of PARALLEL - w

[jira] Commented: (PIG-940) Cross site HDFS access using the default.fs.name not possible in Pig

2009-09-01 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749905#action_12749905 ] Mridul Muralidharan commented on PIG-940: - Is this supported in hadoop ? As in,

[jira] Created: (PIG-912) Rename/Add 'string' as a type in place of chararray - and deprecate (and probably eventually remove) the use of 'chararray'

2009-08-06 Thread Mridul Muralidharan (JIRA)
Key: PIG-912 URL: https://issues.apache.org/jira/browse/PIG-912 Project: Pig Issue Type: Bug Reporter: Mridul Muralidharan The type 'chararray' in pig does not refer to an array of characters (char []) but rather to java.lang.String This is inc

[jira] Commented: (PIG-826) DISTINCT as "Function/Operator" rather than statement/operator - High Level Pig

2009-06-02 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715745#action_12715745 ] Mridul Muralidharan commented on PIG-826: - This would be a welcome change ! Ano

Re: A proposal for changing pig's memory management

2009-06-01 Thread Mridul Muralidharan
Alan Gates wrote: On May 19, 2009, at 10:30 PM, Mridul Muralidharan wrote: I am still not very convinced about the value about this implementation - particularly considering the advances made since 1.3 in memory allocators and garbage collection. My fundamental concern is not with the

Re: A proposal for changing pig's memory management

2009-05-19 Thread Mridul Muralidharan
I am still not very convinced about the value about this implementation - particularly considering the advances made since 1.3 in memory allocators and garbage collection. The side effect of this proposal is many, and sometimes non-obvious. Like implicitly moving young generation data into ol

[jira] Commented: (PIG-807) PERFORMANCE: Provide a way for UDFs to use read-once bags (backed by the Hadoop values iterator)

2009-05-19 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12710901#action_12710901 ] Mridul Muralidharan commented on PIG-807: - I think I am missing something here.

[jira] Commented: (PIG-788) Proposal to remove float from Pig data types

2009-05-11 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708341#action_12708341 ] Mridul Muralidharan commented on PIG-788: - We do use floats quite a bit in

[jira] Commented: (PIG-738) Regexp passed from pigscript fails in UDF

2009-03-30 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12693758#action_12693758 ] Mridul Muralidharan commented on PIG-738: - As a workaround, you can use the hex

Re: [jira] Created: (PIG-723) Pig generates incorrect schema for generated bags after FOREACH.

2009-03-18 Thread Mridul Muralidharan
Hi, I think the schema generated is right. It might a problem with declaring complex types (bags only ?) in terms of scalars in the script which you might be hitting (iirc there is a bug for it already). From what I recall, even I have faced issues with things like "foreach A generate $0

Re: [jira] Updated: (PIG-690) UNION doesn't work in the latest code

2009-03-03 Thread Mridul Muralidharan
Great, thanks ! I am assuming this might also fix load related schema issues too (with BinStorage) ? Looked kind of similar issue as I reported in pig usergroup. - Mridul Pradeep Kamath (JIRA) wrote: [ https://issues.apache.org/jira/browse/PIG-690?page=com.atlassian.jira.plugin.system.

Re: Pig compile error

2009-02-13 Thread Mridul Muralidharan
You need jdk 1.6. Maybe that will help ? - Mridul nitesh bhatia wrote: Hi I've downloaded latest Pig code from trunk today. It is not getting compiled using 'ant' command. Trace: nitesh-bhatias-macbook:trunk niteshbhatia$ ant Buildfile: build.xml init: cc-compile: compile: [echo] ***

Re: switching to different parser in Pig

2009-02-12 Thread Mridul Muralidharan
This sounds like a great idea ! Would be great if other means of generating ast's for pig was possible. Regards, Mridul Ted Dunning wrote: In general, it would be really, really nice if it were easy to build abstract Pig syntax trees outside of the normal parser. For instance, I find the fact

Re: [jira] Created: (PIG-555) ORDER by requires write access to /tmp

2008-12-04 Thread Mridul Muralidharan
Shouldn't pig not check if the directory exists and if it does, use another one ? Or does 'asContainer' already do it ? (I guess not ...). Regards, Mridul Ian Holsman (JIRA) wrote: ORDER by requires write access to /tmp -- Key: PIG-555

[jira] Commented: (PIG-539) unable to control parallelism of Map tasks

2008-11-20 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/PIG-539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649457#action_12649457 ] Mridul Muralidharan commented on PIG-539: - Hi Chris, We had a similar require