Implement "LIKE" in SparkSQL

2015-09-11 Thread liam
Hi, Imaging this: the value of one column is the substring of another column, when using Oracle,I got many ways to do the query like the following statement,but how to do in SparkSQL since this no "concat(), instr(), locate()..." select * from table t where t.a like '%'||t.b||'%'; Thanks.

Re: Implement "LIKE" in SparkSQL

2015-09-12 Thread liam
: > concat and locate are available as of version 1.5.0, according to the > Scaladocs. For earlier versions of Spark, and for the operations that are > still not supported, it's pretty straightforward to define your own > UserDefinedFunctions in either Scala or Java (I don'

RDD size in memory - Array[String] vs. case classes

2014-10-10 Thread Liam Clarke-Hutchinson
them as strings? Cheers, Liam Clarke

Re: Questions for platform to choose

2019-08-22 Thread Liam Clarke-Hutchinson
Hi Eliza, As I mentioned to you in the Kafka mailing list when you asked this there, there are pros and cons to all of the technologies you've mentioned, and you really need to sit down and try each solution to see what suits your needs best. Kind regards, Liam Clarke On Wed, Aug 21, 2019