[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-656: --- Attachment: pigusergroup656.patch > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.3.0 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, pigusergroup656.patch, reserved.patch, > TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Santhosh Srinivasan updated PIG-656: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Patch has been committed. Milind, thanks for fixing this issue. > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, reserved.patch, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated PIG-656: -- Attachment: reserved.patch Uploading a modified patch that now includes a test case. The findbugs warning is not new to this patch. > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, reserved.patch, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated PIG-656: -- Status: Patch Available (was: Open) > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, reserved.patch, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated PIG-656: -- Attachment: (was: reserved.patch) > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated PIG-656: -- Status: Open (was: Patch Available) modifying patch to include test case. > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated PIG-656: -- Fix Version/s: (was: 0.2.0) 0.3.0 Affects Version/s: (was: 0.2.0) 0.2.1 Status: Patch Available (was: In Progress) > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, reserved.patch, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated PIG-656: -- Attachment: reserved.patch This patch allows the use of reserved words in function names. To avoid parsing ambiguity, the first part of the fully qualified function name (i.e. test before the first ".") cannot be a reserved word. But the rest of the parts in fully qualified function names can be any identifier, including a reserved word. So, for example, with this patch, the statement: {code} define X com.yahoo.load(); {code} or {code} modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); {code} Now compiles and runs perfectly well. > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.1 >Reporter: Viraj Bhat >Assignee: Milind Bhandarkar > Fix For: 0.3.0 > > Attachments: mywordcount.txt, reserved.patch, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (PIG-656) Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception
[ https://issues.apache.org/jira/browse/PIG-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Bhat updated PIG-656: --- Summary: Use of eval or any other keyword in the package hierarchy of a UDF causes parse exception (was: Use of eval word in the package hierarchy of a UDF causes parse exception) > Use of eval or any other keyword in the package hierarchy of a UDF causes > parse exception > - > > Key: PIG-656 > URL: https://issues.apache.org/jira/browse/PIG-656 > Project: Pig > Issue Type: Bug > Components: documentation, grunt >Affects Versions: 0.2.0 >Reporter: Viraj Bhat > Fix For: 0.2.0 > > Attachments: mywordcount.txt, TOKENIZE.jar > > > Consider a Pig script which does something similar to a word count. It uses > the built-in TOKENIZE function, but packages it inside a class hierarchy such > as "mypackage.eval" > {code} > register TOKENIZE.jar > my_src = LOAD '/user/viraj/mywordcount.txt' USING PigStorage('\t') AS > (mlist: chararray); > modules = FOREACH my_src GENERATE FLATTEN(mypackage.eval.TOKENIZE(mlist)); > describe modules; > grouped = GROUP modules BY $0; > describe grouped; > counts = FOREACH grouped GENERATE COUNT(modules), group; > ordered = ORDER counts BY $0; > dump ordered; > {code} > The parser complains: > === > 2009-02-05 01:17:29,231 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR > 1000: Error during parsing. Invalid alias: mypackage in {mlist: chararray} > === > I looked at the following source code at > (src/org/apache/pig/impl/logicalLayer/parser/QueryParser.jjt) and it seems > that : EVAL is a keyword in Pig. Here are some clarifications: > 1) Is there documentation on what the EVAL keyword actually is? > 2) Is EVAL keyword actually implemented? > Viraj -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.