[jira] [Commented] (PIG-2643) Use bytecode generation to make a performance replacement for InvokeForLong, InvokeForString, etc

2012-04-12 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13252706#comment-13252706 ] Scott Carey commented on PIG-2643: -- Another thought for this sort of thing: This might be

[jira] [Commented] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-04-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250999#comment-13250999 ] Scott Carey commented on PIG-2632: -- Avro has a pure Java code generator that uses the Veloc

[jira] [Commented] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-04-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13250831#comment-13250831 ] Scott Carey commented on PIG-2632: -- {quote} should "a:int,b:int" really generate a differen

[jira] [Commented] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-04-06 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13249120#comment-13249120 ] Scott Carey commented on PIG-2632: -- I completely agree, for a 1.0 version, it doesn't need

[jira] [Commented] (PIG-2632) Create a SchemaTuple which generates efficient Tuples via code gen

2012-04-06 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13248657#comment-13248657 ] Scott Carey commented on PIG-2632: -- {quote}varints is a good idea. general question of wher

[jira] [Commented] (PIG-2492) AvroStorage should recognize globs and commas

2012-03-23 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236730#comment-13236730 ] Scott Carey commented on PIG-2492: -- Something seems way off here. I have a custom LoadFunc

[jira] [Commented] (PIG-2511) Enable '*' to skip any fields that have already been generated and cast in other parts of the GENERATE, as in: foo = FOREACH my_relation GENERATE manipulate(foo1) as foo1

2012-03-22 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235816#comment-13235816 ] Scott Carey commented on PIG-2511: -- "All I want to do is flatten it and project out two tup

[jira] [Commented] (PIG-2511) Enable '*' to skip any fields that have already been generated and cast in other parts of the GENERATE, as in: foo = FOREACH my_relation GENERATE manipulate(foo1) as foo1

2012-03-22 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235810#comment-13235810 ] Scott Carey commented on PIG-2511: -- This one is annoying me again today. I have a relation

[jira] [Commented] (PIG-2511) Enable '*' to skip any fields that have already been generated and cast in other parts of the GENERATE, as in: foo = FOREACH my_relation GENERATE manipulate(foo1) as foo1

2012-02-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205927#comment-13205927 ] Scott Carey commented on PIG-2511: -- {quote} Pig should already "just work" when you use fie

[jira] [Commented] (PIG-2511) Enable '*' to skip any fields that have already been generated and cast in other parts of the GENERATE, as in: foo = FOREACH my_relation GENERATE manipulate(foo1) as foo1

2012-02-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205646#comment-13205646 ] Scott Carey commented on PIG-2511: -- Wiki text got the better of my last comment. Here is my

[jira] [Commented] (PIG-2511) Enable '*' to skip any fields that have already been generated and cast in other parts of the GENERATE, as in: foo = FOREACH my_relation GENERATE manipulate(foo1) as foo1

2012-02-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205642#comment-13205642 ] Scott Carey commented on PIG-2511: -- I have the same pain point. 65% of the LOC of my pig (

[jira] [Commented] (PIG-2359) Support more efficient Tuples when schemas are known

2012-01-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183690#comment-13183690 ] Scott Carey commented on PIG-2359: -- bq. The JVM will detect your checks and not do its own

[jira] [Commented] (PIG-2359) Support more efficient Tuples when schemas are known

2012-01-10 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183639#comment-13183639 ] Scott Carey commented on PIG-2359: -- Performance comments: bq. In PrimitiveTuple.get(), I w

[jira] [Commented] (PIG-2406) Improve double precision

2011-12-11 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167296#comment-13167296 ] Scott Carey commented on PIG-2406: -- The above example of adding 2.51 many times and the res

[jira] [Commented] (PIG-2359) Support more efficient Tuples when schemas are known

2011-11-29 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159739#comment-13159739 ] Scott Carey commented on PIG-2359: -- Yes, codegen should probably be a different ticket. I'

[jira] [Commented] (PIG-2359) Support more efficient Tuples when schemas are known

2011-11-29 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159696#comment-13159696 ] Scott Carey commented on PIG-2359: -- Yes, using something like ASM (http://asm.ow2.org/) to

[jira] [Commented] (PIG-2359) Support more efficient Tuples when schemas are known

2011-11-28 Thread Scott Carey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158616#comment-13158616 ] Scott Carey commented on PIG-2359: -- One approach is to create a class on the fly, extendin