Hi Cheolsoo,
Before we use parquet thing in pig grunt, we should add parquet-pig-bundle jar into pig classpath. For commands in pig grunt, seems we should use ParquetLoader/ParquetStorer classes pig has provided but not parquet.pig.ParquetLoader. Right? Besides, seems only parquet format file can be loaded when USING ParquetLoader(), right? Thanks At 2014-03-04 11:08:59,"Cheolsoo Park" <piaozhe...@gmail.com> wrote: >>> grunt> A = LOAD '/region.parquet' USING parquet.pig.ParquetLoader AS >(R_REGIONKEY:int,R_NAME:chararray,R_COMMENT:chararray); > >It should be just "ParquetLoad" since its fully qualified name is >org.apache.pig.builtin.ParquetLader- >http://pig.apache.org/docs/r0.12.0/api/org/apache/pig/builtin/ParquetLoader.html > >Your job is failing because it cannot find "parquet.pig.ParquetLoader" in >the default import lists- >org.apache.pig.backend.executionengine.ExecException: ERROR 1070: >Could not resolve >parquet.pig.ParquetLoader using imports: [, java.lang.,org.apache.pig.builtin., >org.apache.pig.impl.builtin.] > > >On Mon, Mar 3, 2014 at 6:00 PM, Suhas Satish <suhas.sat...@gmail.com> wrote: > >> Shouldn't the jar containing parquetLoader and parquetStorer classes >> be directly on pig's classpath by default in pig0.12? >> >> When I try using parquet load: >> >> grunt> A = LOAD '/region.parquet' USING parquet.pig.ParquetLoader AS >> (R_REGIONKEY:int,R_NAME:chararray,R_COMMENT:chararray); >> 2014-03-03 13:42:44,799 [main] ERROR org.apache.pig.tools.grunt.Grunt - >> ERROR >> 1070: Could not resolve parquet.pig.ParquetLoader using imports: [, >> java.lang., >> org.apache.pig.builtin., org.apache.pig.impl.builtin.] >> Details at logfile: >> /home/MAPRTECH/qa/chun/parquet-jars/pig_1393882961333.log >> >> ERROR 1070: Could not resolve parquet.pig.ParquetLoader using imports: [, >> java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.] >> >> Failed to parse: Pig script failed to parse: >> <line 1, column 33> pig script failed to validate: >> org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not >> resolve parquet.pig.ParquetLoader using imports: [, java.lang., >> org.apache.pig.builtin., org.apache.pig.impl.builtin.] >> at >> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:196) >> at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1648) >> at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1621) >> at org.apache.pig.PigServer.registerQuery(PigServer.java:575) >> at >> org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:1093) >> at >> >> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:501) >> at >> >> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198) >> at >> >> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173) >> at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69) >> at org.apache.pig.Main.run(Main.java:541) >> at org.apache.pig.Main.main(Main.java:156) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:197) >> Caused by: >> <line 1, column 33> pig script failed to validate: >> org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not >> resolve parquet.pig.ParquetLoader using imports: [, java.lang., >> org.apache.pig.builtin., org.apache.pig.impl.builtin.] >> at >> >> org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1260) >> at >> >> org.apache.pig.parser.LogicalPlanBuilder.buildFuncSpec(LogicalPlanBuilder.java:1245) >> at >> >> org.apache.pig.parser.LogicalPlanGenerator.func_clause(LogicalPlanGenerator.java:4989) >> at >> >> org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3426) >> at >> >> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1536) >> at >> >> org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:1013) >> at >> >> org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:553) >> at >> >> org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:421) >> at >> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:188) >> ... 15 more >> Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR >> 1070: >> Could not resolve parquet.pig.ParquetLoader using imports: [, java.lang., >> org.apache.pig.builtin., org.apache.pig.impl.builtin.] >> at org.apache.pig.impl.PigContext.resolveClassName(PigContext.java:653) >> at >> >> org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1257) >> ... 23 more >> >> >> Once I add the parquet jars it does seem to go beyond this stage. >>
