Recall: spark sql in-clause problem

2018-05-23 Thread Shiva Prashanth Vallabhaneni
Shiva Prashanth Vallabhaneni would like to recall the message, "spark sql in-clause problem". Any comments or statements made in this email are not necessarily those of Tavant Technologies. The information transmitted is intended only for the person

RE: spark sql in-clause problem

2018-05-22 Thread Shiva Prashanth Vallabhaneni
uery; Table coordinates ( Integer X, Integer Y ) sparkSqlContext.sql(select * from mytable where key = 1 and (X,Y) IN (select X, Y from coordinates)) From: onmstester onmstester <onmstes...@zoho.com> Sent: Wednesday, May 23, 2018 10:33 AM To: user <user@spark.apache.org> Subject: spa

spark sql in-clause problem

2018-05-22 Thread onmstester onmstester
I'm reading from this table in cassandra: Table mytable ( Integer Key, Integer X, Interger Y Using: sparkSqlContext.sql(select * from mytable where key = 1 and (X,Y) in ((1,2),(3,4))) Encountered error: StructType(StructField((X,IntegerType,true),StructField((Y,IntegerType,true))

Re: Spark SQL IN Clause

2015-12-04 Thread Xiao Li
K-8077] [SQL] Optimization for TreeNodes with large numbers of >> children >> >> From the numbers Michael published, 1 million numbers would still need >> 250 seconds to parse. >> >> On Fri, Dec 4, 2015 at 10:14 AM, Madabhattula Rajesh Kumar < >> mrajaf...@gmai

Re: Spark SQL IN Clause

2015-12-04 Thread Ted Yu
A ? >>> >>> [SPARK-8077] [SQL] Optimization for TreeNodes with large numbers of >>> children >>> >>> From the numbers Michael published, 1 million numbers would still need >>> 250 seconds to parse. >>> >>> On Fri, Dec 4, 201

Spark SQL IN Clause

2015-12-04 Thread Madabhattula Rajesh Kumar
Hi, How to use/best practices "IN" clause in Spark SQL. Use Case :- Read the table based on number. I have a List of numbers. For example, 1million. Regards, Rajesh

Re: Spark SQL IN Clause

2015-12-04 Thread Ted Yu
te: > Hi, > > How to use/best practices "IN" clause in Spark SQL. > > Use Case :- Read the table based on number. I have a List of numbers. For > example, 1million. > > Regards, > Rajesh >

Re: Spark SQL IN Clause

2015-12-04 Thread Michael Armbrust
abhattula Rajesh Kumar < > mrajaf...@gmail.com> wrote: > >> Hi, >> >> How to use/best practices "IN" clause in Spark SQL. >> >> Use Case :- Read the table based on number. I have a List of numbers. >> For example, 1million. >> >> Regards, >> Rajesh >> > >

Re: Spark SQL Exists Clause

2014-10-27 Thread Nicholas Chammas
) group by o_orderpriority order by o_orderpriority; Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Exists-Clause-tp17307.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Spark SQL Exists Clause

2014-10-26 Thread agg212
l_orderkey = o_orderkey and l_commitdate l_receiptdate ) group by o_orderpriority order by o_orderpriority; Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-Exists-Clause-tp17307