Hi, Why are you doing the following two lines?
.select("id",lit(referenceFiltered)) .selectexpr( "id" ) What are you trying to achieve? What's lit and what's referenceFiltered? What's the difference between select and selectexpr? Please start at http://spark.apache.org/docs/latest/sql-programming-guide.html and then hop onto http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.package to know the Spark API better. I'm sure you'll quickly find out the answer(s). Pozdrawiam, Jacek Laskowski ---- https://about.me/JacekLaskowski The Internals of Spark SQL https://bit.ly/spark-sql-internals The Internals of Spark Structured Streaming https://bit.ly/spark-structured-streaming The Internals of Apache Kafka https://bit.ly/apache-kafka-internals Follow me at https://twitter.com/jaceklaskowski On Sat, Jun 8, 2019 at 12:53 PM anbutech <anbutec...@outlook.com> wrote: > Thanks Jacek Laskowski Sir.but i didn't get the point here > > please advise the below one are you expecting: > > dataset1.as("t1) > > join(dataset3.as("t2"), > > col(t1.col1) === col(t2.col1), JOINTYPE.Inner ) > > .join(dataset4.as("t3"), col(t3.col1) === col(t1.col1), > > JOINTYPE.Inner) > .select("id",lit(referenceFiltered)) > .selectexpr( > "id" > ) > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >