I am trying to Parsing the data from XML file through Spark using databrics
library
Here is my code:
import org.apache.spark.SparkConfimport
org.apache.spark.SparkContextimport
org.apache.spark.sql.SQLContextimport
org.apache.spark.sql.functionsimport java.text.Formatimport
Hello..,
I am trying to execute the mondrian schema which is integrated with Apache
Drill. While running this schema i am getting *customer_w_ter *table not
found exception.
here is my schema example:
**
**
**
**
**
*
:30 PM, Dhaval Modi <dhavalmod...@gmail.com>
wrote:
> Hi Sateesh,
>
> If you are running from spark shell, then please include Phoenix spark jar
> in classpath.
>
> Kindly refer to url that Sandeep provide.
>
>
> Regards,
> Dhaval
>
>
> On Mar 27, 2
.option("table", "TABLE1") \
> .option("zkUrl", "localhost:2181") \
> .save()
>
>
>
> On Mon, Mar 27, 2017 at 10:19 AM, Sateesh Karuturi <
> sateesh.karutu...@gmail.com> wrote:
>
>> Please anyone help me out how t
Please anyone help me out how to write dataframe to phoenix in java?
here is my code:
pos_offer_new_join.write().format("org.apache.phoenix.spark").mode(SaveMode.Overwrite)
.options(ImmutableMap.of("driver",
"org.apache.phoenix.jdbc.PhoenixDriver","zkUrl",
oject has dependency on phoenix-spark jar? : )
> See Spark setup at http://phoenix.apache.org/phoenix_spark.html
>
> Regards,
> NaHeon
>
> 2017-03-20 15:31 GMT+09:00 Sateesh Karuturi <sateesh.karutu...@gmail.com>:
>
>>
>> I am trying to write Dataframe to Phoenix.
>&
I am trying to write Dataframe to Phoenix.
Here is my code:
1. df.write.format("org.apache.phoenix.spark").mode(SaveMode.Overwrite).
options(collection.immutable.Map(
2. "zkUrl" -> "localhost:2181/hbase-unsecure",
3. "table" -> "TEST")).save();
and i am getting following exception:
Hello friends..,
I am very new to Apache Phoenix and i just started running sample phoenix
spark example in spark 1.6 version. it was successful and now i want to run
this example in spark version 2.0.0. Is phoenix provides support for
spark-2.0.0?
previously i used this command:
DataFrame
Hello folks..,
i am trying to run sample phoenix spark application, while i am trying to
run i am getting following exception:
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/phoenix/jdbc/PhoenixDriver
Here is my sample code:
package com.inndata.spark.sparkphoenix;
Hello folks..,
I am trying to execute sample spark-phoenix application.
but i am getting
Exception in thread "main" java.lang.ClassNotFoundException: Failed to
find data source: org.apache.phoenix.spark. Please find packages at
http://spark-packages.org exception.
here is my code:
package
I need to process spark Broadcast variables using Java RDD API. This is my
code what i have tried so far:
This is only sample code to check whether its works or not? In my case i
need to work on two csvfiles.
SparkConf conf = new
SparkConf().setAppName("BroadcastVariable").setMaster("local");
i am very new to *Spark streaming* and i am implementing small exercise
like sending *XML* data from *kafka* and need to receive that *streaming* data
through *spark streaming.* I tried in all possible ways.. but every time i
am getting *empty values.*
*There is no problem in Kafka side, only
Anyone please help me out how to create a DStream from existing RDD. My
code is:
JavaSparkContext ctx = new JavaSparkContext(conf);JavaRDD rddd
= ctx.parallelize(arraylist);
Now i need to use these *rddd* as input to *JavaStreamingContext*.
Hello Anyone... please help me to how to Stream the XML files from S3
server to cassandra db using Spark Streaming java. presently iam using
Spark core to do that job..but problem is i have to to run for every 15
mints.. thats why iam looking for Spark Streaming.
Hello...
Anyone please help me how to delete empty rows from hive table through java?
Thanks in advance
Hello experts... i am new to spark, anyone please explain me how to fetch
data from hbase table in spark java
Thanks in Advance...
Guys... I am new to Spark..
Please anyone please explain me how flatMap function works with a little
sample example...
Thanks in advance...
Hello Spark experts...
Iam new to Apache Spark..Can anyone send me the proper Documentation to
learn RDD functions.
Thanks in advance...
user-sc.1449231970.fbaoamghkloiongfhbbg-sateesh.karuturi9=
gmail@spark.apache.org
hello...,
iam using hive 1.1 and tez 0.7...
Whenever iam trying to INSERT
hello...,
iam using hive 1.1 and tez 0.7...
Whenever iam trying to INSERT data into hive table using tez via java iam
getting following error:
*Exception in thread "main" org.apache.hive.service.cli.HiveSQLException:
Error while compiling statement: FAILED: SemanticException [Error 10293]:
hello...,
iam using hive 1.1 and tez 0.7...
Whenever iam trying to INSERT data into hive table using tez via java iam
getting following error:
*Exception in thread "main" org.apache.hive.service.cli.HiveSQLException:
Error while compiling statement: FAILED: SemanticException [Error 10293]:
I am trying to connect hive database(execution.engine value changed to tez)
using Java code... In case of select query its working But in the case
of INSERT getting an error:
The error looks like.
Error while processing statement: FAILED: Execution Error, return code 1
from
I am trying to connect hive database(execution.engine value changed to tez)
using Java code... In case of select query its working But in the case
of INSERT getting an error:
The error looks like.
Error while processing statement: FAILED: Execution Error, return code 1
from
i want create a hive table using java code. my code is
package com.inndata.services;
import java.sql.ResultSet;
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.Statement;
import java.sql.DriverManager;
public class HiveCreateTable {
private static String driverName =
i want create a hive table using java code. my code is
package com.inndata.services;
import java.sql.ResultSet;
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.Statement;
import java.sql.DriverManager;
public class HiveCreateTable {
private static String driverName =
I would like to create a table in hive using Java. Using the following way
to do it:
public class HiveCreateTable {
private static String driverName = com.facebook.presto.jdbc.PrestoDriver;
public static void main(String[] args) throws SQLException {
// Register driver and create
iam using hive 1.0 and tez 0.7 whenever iam performing insert query its
returns following error:
execution error, return code 1 from
org.apache.hadoop.hive.ql.exec.tez.teztask
i have a small doubt towards tez installation
which version of hive is required for apache tez 0.7.0?
iam using *hive 1.2.0* and *hadoop 2.6.0*. whenever iam running hive on my
machine... *select* query works fine but in case of *count(*)* it shows
following *error*:
Diagnostic Messages for this Task: Container launch failed for
container_1434646588807_0001_01_05
iam using *hive 1.0.0* and *tez 0.5.2.* when i set
*hive.execution.engine* value
in hive-site.xml to *tez*select query works well... but in case of
*insert* getting
error. the query is :
*insert into table tablename values(intvalue,'string value');*
and the error is :
*FAILED: Execution Error,
iam using hive 1.0.0 and tez 0.5.2.. whenever iam trying to open the hive
getting following error:
Exception in thread main java.lang.RuntimeException: java.io.IOException:
Previous writer likely failed to write
:9000
ESTABLISHED 8157/java
On Tue, Jun 16, 2015 at 1:36 AM, Steve Howard stevedhow...@gmail.com
wrote:
What does netstat -anp | grep 9000 show?
On Mon, Jun 15, 2015 at 3:47 PM, Sateesh Karuturi
sateesh.karutu...@gmail.com wrote:
iam using hive 1.0.0 and tez 0.5.2.. whenever iam trying
iam using hive 1.0.0 and tez 0.5.2.. whenever iam trying to open the hive
getting following error:
Exception in thread main java.lang.RuntimeException: java.io.IOException:
Previous writer likely failed to write
to the app id. If still could not find
it, then please refer to the Resource Manager UI.
Best Regard,
Jeff Zhang
From: Sateesh Karuturi sateesh.karutu...@gmail.com
Reply-To: user@tez.apache.org user@tez.apache.org
Date: Wednesday, June 10, 2015 at 7:51 PM
To: user@tez.apache.org user
--
r7raul1...@163.com
*From:* Sateesh Karuturi sateesh.karutu...@gmail.com
*Date:* 2015-06-10 17:10
*To:* user user@tez.apache.org
*Subject:* Re: Re: hive on tez error
configuration
property
nametez.lib.uris/name
value${fs.defaultFS}/tez,${fs.defaultFS}/tez/lib/value
/property
getting FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.tez.TezTask
error... when iam trying to perform insert operation on hive(set
hive.execution.engine=tez).
whenever hive.execution.engine value is set to mr its works fine
please help me out
,
Jeff Zhang
From: Sateesh Karuturi sateesh.karutu...@gmail.com
Reply-To: user@hive.apache.org user@hive.apache.org
Date: Monday, June 8, 2015 at 3:45 PM
To: user@hive.apache.org user@hive.apache.org
Subject: hive tez error
getting FAILED: Execution Error, return code 1 from
I am using *hive 1.0.0* and *apache tez 0.5.2* When I configure hive to use
tez I get an exception.
In *hive-site.xml* when the *hive.execution.engine* value is mr its works
fine. But if I set it to tez I get this error:
Exception in thread main java.lang.RuntimeException: java.io.IOException:
anyone help me please... how to write insert statement in hive 1.0.0?
, 2015 at 7:09 PM, Sateesh Karuturi
sateesh.karutu...@gmail.com wrote:
I am using *hive 1.0.0* and *apache tez 0.4.1* When I configure hive to
use tez I get an exception.
In *hive-site.xml* when the *hive.execution.engine* value is mr its works
fine. But if I set it to tez I get this error
I am using *hive 1.0.0* and *apache tez 0.4.1* When I configure hive to use
tez I get an exception.
In *hive-site.xml* when the *hive.execution.engine* value is mr its works
fine. But if I set it to tez I get this error:
Exception in thread main java.lang.NoSuchMethodError:
42 matches
Mail list logo
