Hi,
This issue is fixed with the following patch, and using the resulting
'client-spark' JAR after compilation:
https://issues.apache.org/jira/browse/PHOENIX-2503
As an alternative, you may have some luck also including updated
com.fasterxml.jackson jackson-databind JARs in your app that are in s
ncubating.jar, \
/data/public/spark/libs/phoenix-4.6.0-HBase-1.1-client.jar, \
/data/public/spark/libs/phoenix-core-4.6.0-HBase-1.1.jar, \
/data/public/spark/libs/phoenix-spark-4.6.0-HBase-1.1.jar
Thank you
sac...@outlook.com
From: Josh Mahonin
Date: 2015-12-30 00:56
To: user
Subject: Re: error whe
-3.1.0-incubating.jar, \
>
> /data/public/spark/libs/phoenix-4.6.0-HBase-1.1-client.jar, \
>
> /data/public/spark/libs/phoenix-core-4.6.0-HBase-1.1.jar, \
>
> /data/public/spark/libs/phoenix-spark-4.6.0-HBase-1.1.jar
>
>
> Thank you
> --
> sac...@outlook.com
>
>
>
hi josh:thank you for your advice,and it did work .
i build the client-spark jar refreed the patch with thr CDH code and it
succeed.Then i run some code with the "local" mode ,and the
result is correct. But when it comes to the "yarn-client" mode ,som
rk.jar"
> \
>
> --conf
> "spark.executor.extraClassPath=/opt/cloudera/parcels/CLABS_PHOENIX/lib/phoenix/phoenix-1.2.0-client-spark.jar"
> \
>
> --conf
> "spark.driver.extraClassPath=/opt/cloudera/parcels/CLABS_PHOENIX/lib/phoenix/phoenix-1.2.0-clie
aClassPath=/opt/cloudera/parcels/CLABS_PHOENIX/lib/phoenix/phoenix-1.2.0-client-spark.jar"
\
--jars
/opt/cloudera/parcels/CLABS_PHOENIX/lib/phoenix/phoenix-1.2.0-client-spark.jar
ps: i did copied the jar to every node,and give the even the 777 rghts.
sac...@outlook.com
From: Josh Mahon
org.apache.phoenix.jdbc.PhoenixDriver");
> val pred = s"RID like 'wtwb2%' and TIME between 1325440922 and 1336440922"
> val rdd = sc.phoenixTableAsRDD(
> "AIS_AREA",
> Seq("MMSI","LON","LAT","RID"),
>
to do it fastly.I have tried to do
this by spark, but it seems not fast.
Best wishes for you!
sac...@outlook.com
From: Josh Mahonin
Date: 2016-01-06 23:02
To: user
Subject: Re: Re: error when get data from Phoenix 4.5.2 on CDH 5.5.x by spark
1.5
Hi,
Is it still the
l.SQLContext
>> import org.apache.phoenix.jdbc.PhoenixDriver
>> import java.sql.DriverManager
>> DriverManager.registerDriver(new PhoenixDriver)
>> Class.forName("org.apache.phoenix.jdbc.PhoenixDriver");
>> val pred = s"RID like 'wtwb2%' and TIME b
.etc.
create table ais_mmsi (
mmsi varchar(9) not null,
time INTEGER(10) not null,
c1.rid varchar(10),
c3.nav_status INTEGER(2),..etc.
Yours very sincerely
sac...@outlook.com
From: Josh Mahonin
Date: 2016-01-08 23:23
To: user
Subject: Re: Re: error when get data from Phoenix 4.5.2
10 matches
Mail list logo