I am trying to store data into this table:
CREATE TABLE IF NOT EXISTS BEACONING_ACTIVITY (
EVENT_TIME VARCHAR NOT NULL,
C_IP VARCHAR NOT NULL,
CS_HOST VARCHAR NOT NULL,
SLD VARCHAR NOT NULL,
CONFIDENCE DOUBLE NOT NULL,
RISK DOUBLE NOT NULL,
ANOMOLY DOUBLE NOT NULL,
INTERVAL DOUBLE NOT NULL
CONSTRAINT PK PRIMARY KEY (EVENT_TIME, C_IP, CS_HOST)
);
Using this Pig:
hosts_and_risks = FOREACH hosts_and_anomaly GENERATE hour, c_ip, cs_host,
sld, confidence, (confidence * anomaly) AS risk:double, anomaly, interval;
--hosts_and_risks = ORDER hosts_and_risks BY risk DESC;
--STORE hosts_and_risks INTO '/tmp/beacons.txt';
STORE hosts_and_risks into 'hbase://BEACONING_ACTIVITY' using
com.salesforce.phoenix.pig.PhoenixHBaseStorage('hiveapp1','-batchSize
5000');
And the most helpful error message I get is this:
2014-02-11 16:24:13,831 FATAL org.apache.hadoop.mapred.Child: Error
running child : java.lang.IncompatibleClassChangeError: Found
interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class
was expected
at
com.salesforce.phoenix.pig.hadoop.PhoenixOutputFormat.getRecordWriter(PhoenixOutputFormat.java:75)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:597)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:444)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
What am I to do?
--
Russell Jurney twitter.com/rjurney [email protected] datasyndrome.com
