> > Hi,
As a beginner ,I have below queries on Spork(Pig on Spark). I have cloned git clone https://github.com/apache/pig -b spark . 1.On which version of Pig and Spark , Spork is being built ? 2. I followed the steps mentioned in https://issues.apache.org/ji ra/browse/PIG-4059 and try to run simple pig script just like Load the file and dump/store it. Getting errors : > grunt> A = load '/tmp/words_tb.txt' using PigStorage('\t') as (empNo:chararray,empName:chararray,salary:chararray); grunt> Store A into '/tmp/spork'; 2015-11-25 05:35:52,502 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: UNKNOWN 2015-11-25 05:35:52,875 [main] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized 2015-11-25 05:35:52,883 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - Not MR mode. RollupHIIOptimizer is disabled 2015-11-25 05:35:52,894 [main] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, ConstantCalculator, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PredicatePushdownOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter]} 2015-11-25 05:35:52,966 [main] INFO org.apache.pig.data.SchemaTupleBackend - Key [pig.schematuple] was not set... will not generate code. 2015-11-25 05:35:52,983 [main] INFO org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - add Files Spark Job 2015-11-25 05:35:53,137 [main] INFO org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - Added jar pig-0.15.0-SNAPSHOT-core-h2.jar 2015-11-25 05:35:53,138 [main] INFO org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - Added jar pig-0.15.0-SNAPSHOT-core-h2.jar 2015-11-25 05:35:53,138 [main] INFO org.apache.pig.backend.hadoop.executionengine.spark.SparkLauncher - Converting operator POLoad (Name: A: Load(/tmp/words_tb.txt:PigStorage(' ')) - scope-29 Operator Key: scope-29) 2015-11-25 05:35:53,205 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. Could not initialize class org.apache.spark.rdd.RDDOperationScope$ Details at logfile: /home/pig/pig_1448425672112.log Can you please help me in pointing whats wrong ? Appreciate your help . Thanks, Regards, Divya
