Re: Spark Select Statement

[Mich Talebzadeh]

which database is that table, a Hive database?

Dr Mich Talebzadeh



LinkedIn * 
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
*



http://talebzadehmich.wordpress.com



On 4 May 2016 at 14:44, Ted Yu  wrote:

> Please take a look
> at 
> sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
> :
>
>   } else if (key.startsWith("use:")) {
> SessionState.get().setCurrentDatabase(entry.getValue());
>
> bq. no such table winbox_prod_action_logs_1
>
> The above doesn't match the table name shown in your code.
>
> On Wed, May 4, 2016 at 2:39 AM, Sree Eedupuganti  wrote:
>
>> Hello Spark users, can we query the SQL SELECT statement in Spark using
>> Java.
>> if it is possible any suggestions please. I tried like this.How to pass
>> the database name.
>> Here my database name is nimbus and table name is winbox_opens.
>>
>> *Source Code :*
>>
>> *public class Select { public static class SquareKey implements
>> Function {   public Integer call(Row row) throws Exception {
>>return row.getInt(0) * row.getInt(0);   } } public static void
>> main(String[] args) throws Exception {  SparkConf s = new
>> SparkConf().setMaster("local[2]").setAppName("Select");  SparkContext sc =
>> new SparkContext(s);  HiveContext hc = new HiveContext(sc);   DataFrame rdd
>> = hc.sql("SELECT * FROM winbox_opens");   JavaRDD squaredKeys =
>> rdd.toJavaRDD().map(new SquareKey());   List result =
>> squaredKeys.collect();   for (Integer elem : result) {
>>  System.out.println(elem);   }  }}*
>>
>> *Error: Exception in thread "main"
>> org.apache.spark.sql.AnalysisException: no such table
>> winbox_prod_action_logs_1; line 1 pos 14*
>>
>> --
>> Best Regards,
>> Sreeharsha Eedupuganti
>> Data Engineer
>> innData Analytics Private Limited
>>
>
>

Re: Spark Select Statement

[Ted Yu]

Please take a look
at 
sql/hive-thriftserver/src/main/java/org/apache/hive/service/cli/session/HiveSessionImpl.java
:

  } else if (key.startsWith("use:")) {
SessionState.get().setCurrentDatabase(entry.getValue());

bq. no such table winbox_prod_action_logs_1

The above doesn't match the table name shown in your code.

On Wed, May 4, 2016 at 2:39 AM, Sree Eedupuganti  wrote:

> Hello Spark users, can we query the SQL SELECT statement in Spark using
> Java.
> if it is possible any suggestions please. I tried like this.How to pass
> the database name.
> Here my database name is nimbus and table name is winbox_opens.
>
> *Source Code :*
>
> *public class Select { public static class SquareKey implements
> Function {   public Integer call(Row row) throws Exception {
>return row.getInt(0) * row.getInt(0);   } } public static void
> main(String[] args) throws Exception {  SparkConf s = new
> SparkConf().setMaster("local[2]").setAppName("Select");  SparkContext sc =
> new SparkContext(s);  HiveContext hc = new HiveContext(sc);   DataFrame rdd
> = hc.sql("SELECT * FROM winbox_opens");   JavaRDD squaredKeys =
> rdd.toJavaRDD().map(new SquareKey());   List result =
> squaredKeys.collect();   for (Integer elem : result) {
>  System.out.println(elem);   }  }}*
>
> *Error: Exception in thread "main" org.apache.spark.sql.AnalysisException:
> no such table winbox_prod_action_logs_1; line 1 pos 14*
>
> --
> Best Regards,
> Sreeharsha Eedupuganti
> Data Engineer
> innData Analytics Private Limited
>

Spark Select Statement

[Sree Eedupuganti]

Hello Spark users, can we query the SQL SELECT statement in Spark using
Java.
if it is possible any suggestions please. I tried like this.How to pass the
database name.
Here my database name is nimbus and table name is winbox_opens.

*Source Code :*

*public class Select { public static class SquareKey implements
Function {   public Integer call(Row row) throws Exception {
   return row.getInt(0) * row.getInt(0);   } } public static void
main(String[] args) throws Exception {  SparkConf s = new
SparkConf().setMaster("local[2]").setAppName("Select");  SparkContext sc =
new SparkContext(s);  HiveContext hc = new HiveContext(sc);   DataFrame rdd
= hc.sql("SELECT * FROM winbox_opens");   JavaRDD squaredKeys =
rdd.toJavaRDD().map(new SquareKey());   List result =
squaredKeys.collect();   for (Integer elem : result) {
 System.out.println(elem);   }  }}*

*Error: Exception in thread "main" org.apache.spark.sql.AnalysisException:
no such table winbox_prod_action_logs_1; line 1 pos 14*

-- 
Best Regards,
Sreeharsha Eedupuganti
Data Engineer
innData Analytics Private Limited