Re: Loading already existing tables in spark shell
Hi Jeetendra,
Please try the following in spark shell. it is like executing an sql command.
sqlContext.sql("use ")
Regards,
Ishwardeep
From: Jeetendra Gangele
Sent: Tuesday, August 25, 2015 12:57 PM
To: Ishwardeep Singh
Cc: user
Subject: Re: Loading already existing tables in spark shell
In spark shell "use database " not working saying use not found in the shell?
did you ran this with scala shell ?
On 24 August 2015 at 18:26, Ishwardeep Singh
mailto:ishwardeep.si...@impetus.co.in>> wrote:
Hi Jeetendra,
I faced this issue. I did not specify the database where this table exists.
Please set the database by using "use " command before executing the
query.
Regards,
Ishwardeep
From: Jeetendra Gangele mailto:gangele...@gmail.com>>
Sent: Monday, August 24, 2015 5:47 PM
To: user
Subject: Loading already existing tables in spark shell
Hi All I have few tables in hive and I wanted to run query against them with
spark as execution engine.
Can I direct;y load these tables in spark shell and run query?
I tried with
1.val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
2.qlContext.sql("FROM event_impressions select count(*)") where
event_impressions is the table name.
It give me error saying "org.apache.spark.sql.AnalysisException: no such table
event_impressions; line 1 pos 5"
Does anybody hit similar issues?
regards
jeetendra
NOTE: This message may contain information that is confidential, proprietary,
privileged or otherwise protected by law. The message is intended solely for
the named addressee. If received in error, please destroy and notify the
sender. Any use of this email is prohibited when received in error. Impetus
does not represent, warrant and/or guarantee, that the integrity of this
communication has been maintained nor that the communication is free of errors,
virus, interception or interference.
NOTE: This message may contain information that is confidential, proprietary,
privileged or otherwise protected by law. The message is intended solely for
the named addressee. If received in error, please destroy and notify the
sender. Any use of this email is prohibited when received in error. Impetus
does not represent, warrant and/or guarantee, that the integrity of this
communication has been maintained nor that the communication is free of errors,
virus, interception or interference.
Re: Loading already existing tables in spark shell
In spark shell "use database " not working saying use not found in the
shell?
did you ran this with scala shell ?
On 24 August 2015 at 18:26, Ishwardeep Singh wrote:
> Hi Jeetendra,
>
>
> I faced this issue. I did not specify the database where this table
> exists. Please set the database by using "use " command before
> executing the query.
>
>
> Regards,
>
> Ishwardeep
>
> --
> *From:* Jeetendra Gangele
> *Sent:* Monday, August 24, 2015 5:47 PM
> *To:* user
> *Subject:* Loading already existing tables in spark shell
>
> Hi All I have few tables in hive and I wanted to run query against them
> with spark as execution engine.
>
> Can I direct;y load these tables in spark shell and run query?
>
> I tried with
> 1.val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
> 2.qlContext.sql("FROM event_impressions select count(*)") where
> event_impressions is the table name.
>
> It give me error saying "org.apache.spark.sql.AnalysisException: no such
> table event_impressions; line 1 pos 5"
>
> Does anybody hit similar issues?
>
>
> regards
> jeetendra
>
> --
>
>
>
>
>
>
> NOTE: This message may contain information that is confidential,
> proprietary, privileged or otherwise protected by law. The message is
> intended solely for the named addressee. If received in error, please
> destroy and notify the sender. Any use of this email is prohibited when
> received in error. Impetus does not represent, warrant and/or guarantee,
> that the integrity of this communication has been maintained nor that the
> communication is free of errors, virus, interception or interference.
>
RE: Loading already existing tables in spark shell
And be sure the hive-site.xml is under the classpath or under the path of
$SPARK_HOME/conf
Hao
From: Ishwardeep Singh [mailto:ishwardeep.si...@impetus.co.in]
Sent: Monday, August 24, 2015 8:57 PM
To: user
Subject: Re: Loading already existing tables in spark shell
Hi Jeetendra,
I faced this issue. I did not specify the database where this table exists.
Please set the database by using "use " command before executing the
query.
Regards,
Ishwardeep
From: Jeetendra Gangele mailto:gangele...@gmail.com>>
Sent: Monday, August 24, 2015 5:47 PM
To: user
Subject: Loading already existing tables in spark shell
Hi All I have few tables in hive and I wanted to run query against them with
spark as execution engine.
Can I direct;y load these tables in spark shell and run query?
I tried with
1.val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
2.qlContext.sql("FROM event_impressions select count(*)") where
event_impressions is the table name.
It give me error saying "org.apache.spark.sql.AnalysisException: no such table
event_impressions; line 1 pos 5"
Does anybody hit similar issues?
regards
jeetendra
NOTE: This message may contain information that is confidential, proprietary,
privileged or otherwise protected by law. The message is intended solely for
the named addressee. If received in error, please destroy and notify the
sender. Any use of this email is prohibited when received in error. Impetus
does not represent, warrant and/or guarantee, that the integrity of this
communication has been maintained nor that the communication is free of errors,
virus, interception or interference.
Re: Loading already existing tables in spark shell
Hi Jeetendra,
I faced this issue. I did not specify the database where this table exists.
Please set the database by using "use " command before executing the
query.
Regards,
Ishwardeep
From: Jeetendra Gangele
Sent: Monday, August 24, 2015 5:47 PM
To: user
Subject: Loading already existing tables in spark shell
Hi All I have few tables in hive and I wanted to run query against them with
spark as execution engine.
Can I direct;y load these tables in spark shell and run query?
I tried with
1.val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
2.qlContext.sql("FROM event_impressions select count(*)") where
event_impressions is the table name.
It give me error saying "org.apache.spark.sql.AnalysisException: no such table
event_impressions; line 1 pos 5"
Does anybody hit similar issues?
regards
jeetendra
NOTE: This message may contain information that is confidential, proprietary,
privileged or otherwise protected by law. The message is intended solely for
the named addressee. If received in error, please destroy and notify the
sender. Any use of this email is prohibited when received in error. Impetus
does not represent, warrant and/or guarantee, that the integrity of this
communication has been maintained nor that the communication is free of errors,
virus, interception or interference.
Loading already existing tables in spark shell
Hi All I have few tables in hive and I wanted to run query against them
with spark as execution engine.
Can I direct;y load these tables in spark shell and run query?
I tried with
1.val sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
2.qlContext.sql("FROM event_impressions select count(*)") where
event_impressions is the table name.
It give me error saying "org.apache.spark.sql.AnalysisException: no such
table event_impressions; line 1 pos 5"
Does anybody hit similar issues?
regards
jeetendra
