Hi Eliza,
As I mentioned to you in the Kafka mailing list when you asked this there,
there are pros and cons to all of the technologies you've mentioned, and
you really need to sit down and try each solution to see what suits your
needs best.
Kind regards,
Liam Clarke
On Wed, Aug 21, 2019 at 9
richard.egg...@gmail.com>:
> concat and locate are available as of version 1.5.0, according to the
> Scaladocs. For earlier versions of Spark, and for the operations that are
> still not supported, it's pretty straightforward to define your own
> UserDefinedFunctions in either Scala
?
Cheers,
Liam Clarke