Unsubscribe

2021-08-30 Thread Sandeep Patra
Unsubscribe

Unsubscribe

2021-08-19 Thread Sandeep Patra
Unsubscribe

Unsubscribe

2021-08-09 Thread Sandeep Patra
Unsubscribe

Re: Spark Application REST API, looking for a way to kill specific task or executor

2020-09-05 Thread Sandeep Patra
See if this helps: https://spark.apache.org/docs/latest/monitoring.html . On Sat, Sep 5, 2020 at 8:11 PM Ivan Petrov wrote: > Hi, is there any API to: > - get running tasks for a given Spark Application > - get available executors of a given Spark Application > - kill task or executor? >

Exception during writing a spark Dataframe to Redshift

2020-03-12 Thread Sandeep Patra
This is where the exception occurs: myAppDes.coalesce(1) .write .format("com.databricks.spark.redshift") .option("url", redshiftURL) .option("dbtable", redshiftTableName) .option("forward_spark_s3_credentials", "true") .option("tempdir",

Re: [Spark SQL] NegativeArraySizeException When Parse InternalRow to DTO Field with Type Array[String]

2020-02-23 Thread Sandeep Patra
This might be due to the serializer being used. This stackoverflow answer might help: https://stackoverflow.com/questions/44414429/spark-negativearraysizeexception On Sun, Feb 23, 2020 at 1:39 PM Proust (Feng Guizhou) [Travel Search & Discovery] wrote: > Hi, Spark Users > > I ecounter below