Could someone please help me to understand better..
On Thu, Oct 17, 2019 at 7:41 PM Chetan Khatri
wrote:
> Hi Users,
>
> I do submit *X* number of jobs with Airflow to Yarn as a part of workflow
> for *Y *customer. I could potentially run workflow for customer *Z *but I
> need to check that how
Could someone please help me.
On Thu, Oct 17, 2019 at 7:29 PM Chetan Khatri
wrote:
> Hi Users,
>
> I am setting spark configuration in below way;
>
> val spark = SparkSession.builder().appName(APP_NAME).getOrCreate()
>
> spark.conf.set("spark.speculation", "false")
>
Hi Amit,
I am able to run this test without any issue.
test("string translate with escape characters") {
val df = Seq(("ab\\\"ab", "")).toDF("a", "b")
checkAnswer(df.select(translate($"a", "\\\"", "\"")), Row("ab\"ab"))
checkAnswer(df.selectExpr("""translate(a, "\\\"", "\"")"""),
Hi Team,
I am trying to use regexp_replace in spark sql it throwing error
expected , but found Scalar
in 'reader', line 9, column 45:
... select translate(payload, '"', '"') as payload
i am trying to remove all character from \\\" with "
