Messages by Date
-
2024/10/04
spark TLS connection to hive metastore
Stefano Bovina
-
2024/10/03
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
Nimrod Ofek
-
2024/10/02
Re: kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/02
Re: How to run spark connect in kubernetes?
kant kodali
-
2024/10/02
Re: How to run spark connect in kubernetes?
kant kodali
-
2024/10/01
How to run spark connect in kubernetes?
kant kodali
-
2024/10/01
kubeflow spark-operator - error in querying strimzi kafka using structured streaming
karan alang
-
2024/10/01
Re: Bugs with joins and SQL in Structured Streaming
Andrzej Zera
-
2024/09/30
Re: Bugs with joins and SQL in Structured Streaming
Jungtaek Lim
-
2024/09/30
Re: Rust Spark Connect
ed elliott
-
2024/09/29
Re: Bugs with joins and SQL in Structured Streaming
Jungtaek Lim
-
2024/09/28
Re: Bugs with joins and SQL in Structured Streaming
Jungtaek Lim
-
2024/09/26
Re: Help - Learning/Understanding spark web UI
Daniel Aronovic
-
2024/09/26
[ANNOUNCE] Announcing Apache Spark 4.0.0-preview2
Dongjoon Hyun
-
2024/09/26
Spark Job Opportunities !
sri hari kali charan Tummala
-
2024/09/26
Re: Help - Learning/Understanding spark web UI
Ilango
-
2024/09/26
Help - Learning/Understanding spark web UI
Karthick Nk
-
2024/09/25
When exactly does AQE coalesce small partitions or break up large partitions?
Perfect Stranger
-
2024/09/24
[ANNOUNCE] Apache Spark 3.5.3 released
Haejoon Lee
-
2024/09/23
Re: Structured Streaming and Spark Connect
刘唯
-
2024/09/23
Re: Structured Streaming and Spark Connect
Mich Talebzadeh
-
2024/09/23
Structured Streaming and Spark Connect
Anastasiia Sokhova
-
2024/09/23
Issues with CharType() and VarcharType() datatype
Souvik Saha
-
2024/09/21
Compatibility Issue: Spark 3.5.2 Schema Recognition vs. Spark 3.4.0 with Hive Metastore (Case Sensitivity)
Mich Talebzadeh
-
2024/09/21
Spark SQL readSideCharPadding issue while reading ENUM column from mysql
Suyash Ajmera
-
2024/09/20
Re: is it possible to run spark2 on EMR 7.2.0
Prem Sahoo
-
2024/09/17
Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser
joshita mishra
-
2024/09/17
Re: ERROR: GROUP BY position 0 is not in select list , when using catalyst parser
Sudhanshu
-
2024/09/11
ERROR: GROUP BY position 0 is not in select list , when using catalyst parser
Rommel Holmes
-
2024/09/10
[Spark Core]: Spark 3.5.0 incompatible with Embedded Kafka
Adesh Dsilva
-
2024/09/09
Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Nagatomi Yasukazu
-
2024/09/09
Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Prabodh Agarwal
-
2024/09/09
Re: [CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Nagatomi Yasukazu
-
2024/09/08
Spark 3.2.1 vs Spark 3.5.2
Stephen Coy
-
2024/09/08
[CONNECT] Why Can't We Specify Cluster Deploy Mode for Spark Connect?
Nagatomi Yasukazu
-
2024/09/05
Re: Spark Thrift Server - Not Scaling Down Executors 3.4.2+
Cheng Pan
-
2024/09/05
Spark Thrift Server - Not Scaling Down Executors 3.4.2+
Jayabindu Singh
-
2024/08/30
Setting forarch microbatch processing data count in structured streaming
Karthick Nk
-
2024/08/29
Re: Question about Releases and EOL
Mich Talebzadeh
-
2024/08/29
Question about Releases and EOL
Miles Fryhover (V)
-
2024/08/27
Fwd: [ANNOUNCE] Apache Sedona 1.6.1 released
Jia Yu
-
2024/08/27
Re: unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart
Mat Schaffer
-
2024/08/26
unable to deploy Pyspark application on GKE, Spark installed using bitnami helm chart
karan alang
-
2024/08/26
Job Opportunities in India or UK with Tier 2 Sponsorship - Spark Expert
sri hari kali charan Tummala
-
2024/08/24
Re: Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/23
Re: Batch to Kafka
Rommel Holmes
-
2024/08/23
Need support for vulnerability CVE-2023-39410
Ravichandran, Abhirami
-
2024/08/23
Expected Release date for Spark 4?
Vikash Lavaniya
-
2024/08/21
Re: Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/20
Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Cheng Pan
-
2024/08/20
Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Cheng Pan
-
2024/08/20
Re: Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Aaron Grubb
-
2024/08/19
Re: Handling load distribution and addressing data skew.
Raghavendra Ganesh
-
2024/08/19
Re: Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/19
Re: [External] Re: Redundant(?) shuffle after join
Ofir Manor
-
2024/08/19
Hitting SPARK-45858 on Kubernetes - Unavoidable bug or misconfiguration?
Aaron Grubb
-
2024/08/18
Spark Job Fails while writing data to a S3 location in Parquet
Nipuna Shantha
-
2024/08/16
Handling load distribution and addressing data skew.
Karthick
-
2024/08/16
Re: Redundant(?) shuffle after join
Mich Talebzadeh
-
2024/08/16
Re: Redundant(?) shuffle after join
Shay Elbaz
-
2024/08/16
Issue with pyspark : Add custom shutdown hook
aarushi agarwal
-
2024/08/15
Spark Reads from MapR and Write to MinIO fails for few batches
Prem Sahoo
-
2024/08/15
Re: Redundant(?) shuffle after join
Mich Talebzadeh
-
2024/08/15
Redundant(?) shuffle after join
Shay Elbaz
-
2024/08/14
Re: Need help understanding tuning docs
Subhasis Mukherjee
-
2024/08/14
Need help understanding tuning docs
Sreyan Chakravarty
-
2024/08/14
[Spark Connect ] Date Data type formatting issue
Ilango
-
2024/08/12
Re: [ANNOUNCE] Apache Spark 3.5.2 released
Xiao Li
-
2024/08/12
[ANNOUNCE] Apache Spark 3.5.2 released
Kent Yao
-
2024/08/08
Re: dynamically infer json data not working as expected
Perez
-
2024/08/08
Re: dynamically infer json data not working as expected
Perez
-
2024/08/07
Is it possible to configure batch size immutability between two `mapInPandas`?
Azamat G.
-
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Prabodh Agarwal
-
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Ilango
-
2024/08/06
Re: Spark 3.5.0 bug - Writing a small paraquet dataframe to storage using spark 3.5.0 taking too long
Bijoy Deb
-
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Prabodh Agarwal
-
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Ilango
-
2024/08/06
Re: [spark connect] unable to utilize stand alone cluster
Prabodh Agarwal
-
2024/08/06
[spark connect] unable to utilize stand alone cluster
Ilango
-
2024/08/06
Spark History CORS header ‘Access-Control-Allow-Origin’ missing
Thomas Mauran
-
2024/08/05
Re: dynamically infer json data not working as expected
Mich Talebzadeh
-
2024/08/05
Re: dynamically infer json data not working as expected
Perez
-
2024/08/05
dynamically infer json data not working as expected
Perez
-
2024/08/03
Feature Engineering for Data Engineers: Building Blocks for ML Success
Mich Talebzadeh
-
2024/08/01
Re: [Issue] Spark SQL - broadcast failure
Sudharshan V
-
2024/07/30
Error While Running Merge Statement With Iceberg
PRASHANT L
-
2024/07/30
A code change for spark ui in Sql tab
Donvi
-
2024/07/29
Re: [Spark Connect] connection issue
Prabodh Agarwal
-
2024/07/29
Re: [Spark Connect] connection issue
Ilango
-
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
Meena Rajani
-
2024/07/29
Re: [Spark Connect] connection issue
Prabodh Agarwal
-
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
Sadha Chilukoori
-
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
mike Jadoo
-
2024/07/29
Re: Question about installing Apache Spark [PySpark] computer requirements
Sadha Chilukoori
-
2024/07/29
Re: [Spark Connect] connection issue
Ilango
-
2024/07/29
Question about installing Apache Spark [PySpark] computer requirements
mike Jadoo
-
2024/07/29
[ANNOUNCE] Apache Celeborn 0.5.1 available
Ethan Feng
-
2024/07/29
Re: [Spark Connect] connection issue
Prabodh Agarwal
-
2024/07/29
[ANNOUNCE] Apache Celeborn 0.4.2 available
Fu Chen
-
2024/07/29
[Spark Connect] connection issue
Ilango
-
2024/07/26
Issue with comparing structs (possible bug)
Dhruv Singla
-
2024/07/26
Re: Issue with comparing structs (possible bug)
Dhruv Singla
-
2024/07/23
[ANNOUNCE] Apache Kyuubi v1.9.2 is available
Fu Chen
-
2024/07/23
Re: [Issue] Spark SQL - broadcast failure
Sudharshan V
-
2024/07/23
Re: [Issue] Spark SQL - broadcast failure
Sudharshan V
-
2024/07/22
[Spark SQL]: Why the OptimizeSkewedJoin rule does not optimize FullOuterJoin?
王仲轩(万章)
-
2024/07/20
Re: issue forwarding SPARK_CONF_DIR to start workers
Holden Karau
-
2024/07/20
Re: issue forwarding SPARK_CONF_DIR to start workers
Patrice Duroux
-
2024/07/19
[spark connect] issue in testing spark connect
Ilango
-
2024/07/18
Error on Spark history UI api when used with Apache Knox
thomas.mau...@etu.umontpellier.fr.INVALID
-
2024/07/18
problem using spark 3.4 with spots
wafa gabouj
-
2024/07/16
Re: [Issue] Spark SQL - broadcast failure
Meena Rajani
-
2024/07/16
Re: [Issue] Spark SQL - broadcast failure
Mich Talebzadeh
-
2024/07/12
binary stream
Jeff Pang
-
2024/07/12
heap fragmentation in G1
aka.fe2s
-
2024/07/12
Re: Help wanted on securing spark with Apache Knox / JWT
Adam Binford
-
2024/07/11
Help wanted on securing spark with Apache Knox / JWT
Thomas Mauran
-
2024/07/08
Sometimes TaskContext configuration is almost empty
Asaf Mesika
-
2024/07/08
[Issue] Spark SQL - broadcast failure
Sudharshan V
-
2024/07/07
running snowflake query using spark connect on a standalone cluster
Prabodh Agarwal
-
2024/07/04
Need help to confirm vulnerable issue
Will.Qin
-
2024/07/02
Assistance needed with PySpark Streaming for retrieving past messages.
Mai Trang
-
2024/06/30
How to use spark.connect.Plan from dependency in a custom Spark Connect RelationPlugin?
Sem
-
2024/06/26
AWS Glue and Python
Perez
-
2024/06/26
Does Spark 4.0 add Sparkstreaming SQL
????
-
2024/06/25
log4j2.properties file load fails when upgrading from 3.3.0 to 3.5.1
Edgar H
-
2024/06/24
Help Needed: Distributed Logging in Spark Application
Zsuzsanna D
-
2024/06/23
Re: AttributeError: 'MulticlassMetrics' object has no attribute '_sc'
Saurabh Kumar
-
2024/06/23
AttributeError: 'MulticlassMetrics' object has no attribute '_sc'
Azhuvath, RajeevX
-
2024/06/21
Pyspark DataFrame.drop wrong type hints
Oliver Beagley
-
2024/06/21
Pyspark DataFrame.drop wrong type hints
Oliver Beagley
-
2024/06/20
Re: Dstream HasOffsetRanges equivalent in Structured streaming
Anil Dasari
-
2024/06/20
Re: Spark Decommission
Rajesh Mahindra
-
2024/06/20
Re: Help in understanding Exchange in Spark UI
Mich Talebzadeh
-
2024/06/20
Help in understanding Exchange in Spark UI
Dhruv Singla
-
2024/06/19
Re: [SPARK-48423] Unable to save ML Pipeline to azure blob storage
Chhavi Bansal
-
2024/06/19
Re: Spark Decommission
Khaldi, Ahmed
-
2024/06/18
Spark Decommission
Rajesh Mahindra
-
2024/06/17
[K8S] Divergense in dockerfiles between official repositories.
Andrei L
-
2024/06/15
Re: Update mode in spark structured streaming
Mich Talebzadeh
-
2024/06/14
Update mode in spark structured streaming
Om Prakash
-
2024/06/11
Re: Re: OOM issue in Spark Driver
Mich Talebzadeh
-
2024/06/10
Re: Do we need partitioning while loading data from JDBC sources?
Gourav Sengupta
-
2024/06/09
Re: Unable to load MongoDB atlas data via PySpark because of BsonString error
Perez
-
2024/06/08
Unable to load MongoDB atlas data via PySpark because of BsonString error
Perez
-
2024/06/08
Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Someshwar Kale
-
2024/06/08
Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Chhavi Bansal
-
2024/06/08
Re: OOM issue in Spark Driver
Andrzej Zera
-
2024/06/07
OOM issue in Spark Driver
Karthick Nk
-
2024/06/07
Re: 7368396 - Apache Spark 3.5.1 (Support)
Sadha Chilukoori
-
2024/06/06
Re: Kubernetes cluster: change log4j configuration using uploaded `--files`
Mich Talebzadeh
-
2024/06/06
7368396 - Apache Spark 3.5.1 (Support)
SANTOS SOUZA, ALEX
-
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Perez
-
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Perez
-
2024/06/06
Re: [SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Someshwar Kale
-
2024/06/06
Kubernetes cluster: change log4j configuration using uploaded `--files`
Jennifer Wirth
-
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Mich Talebzadeh
-
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Perez
-
2024/06/06
Re: Do we need partitioning while loading data from JDBC sources?
Mich Talebzadeh
-
2024/06/05
[SPARK-48423] Unable to save ML Pipeline to azure blob storage
Chhavi Bansal
-
2024/06/05
[SPARK-48463] Mllib Feature transformer failing with nested dataset (Dot notation)
Chhavi Bansal
-
2024/06/05
Re: Terabytes data processing via Glue
Perez
-
2024/06/05
Do we need partitioning while loading data from JDBC sources?
Perez
-
2024/06/05
Inquiry Regarding Security Compliance of Apache Spark Docker Image
Tonmoy Sagar
-
2024/06/04
Re: Classification request
Dirk-Willem van Gulik
-
2024/06/04
Re: Classification request
Artemis User
-
2024/06/04
Classification request
VARGA, Sara
-
2024/06/03
[ANNOUNCE] Announcing Apache Spark 4.0.0-preview1
Wenchen Fan
-
2024/06/03
Re: Terabytes data processing via Glue
Russell Jurney
-
2024/06/02
Re: Terabytes data processing via Glue
Perez
-
2024/06/02
[ANNOUNCE] Apache Kyuubi released 1.9.1
Cheng Pan
-
2024/06/01
Terabytes data processing via Glue
Perez
-
2024/05/31
[apache-spark][spark-dataframe] DataFrameWriter.partitionBy does not guarantee previous sort result
leeyc0
-
2024/05/31
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
-
2024/05/31
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
-
2024/05/30
Re: Re: EXT: Dual Write to HDFS and MinIO in faster way
Subhasis Mukherjee
-
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
-
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
-
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
-
2024/05/30
Re: [s3a] Spark is not reading s3 object content
Mich Talebzadeh
-
2024/05/29
Re: [s3a] Spark is not reading s3 object content
Amin Mosayyebzadeh
-
2024/05/29
[Spark on k8s] A issue of k8s resource creation order
Tao Yang
-
2024/05/28
Tox and Pyspark
Perez
-
2024/05/28
Re: OOM concern
Perez
-
2024/05/28
Re: Re: EXT: Dual Write to HDFS and MinIO in faster way
Gera Shegalov
-
2024/05/28
Re: OOM concern
Russell Jurney
-
2024/05/28
Re: OOM concern
Mich Talebzadeh
-
2024/05/28
Re: OOM concern
Perez
-
2024/05/28
Re: OOM concern
Mich Talebzadeh
-
2024/05/27
Re: OOM concern
Perez
-
2024/05/27
Re: Spark Protobuf Deserialization
Sandish Kumar HN
-
2024/05/27
Re: OOM concern
Russell Jurney
-
2024/05/27
Re: OOM concern
Meena Rajani
-
2024/05/27
Re: [Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming?
Mich Talebzadeh
-
2024/05/27
Spark Protobuf Deserialization
Satyam Raj
-
2024/05/27
[Spark SQL]: Does Spark support processing records with timestamp NULL in stateful streaming?
Juan Casse
-
2024/05/27
OOM concern
Perez
-
2024/05/27
Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing
Shay Elbaz
-
2024/05/27
Re: Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing
Mich Talebzadeh
-
2024/05/27
Subject: [Spark SQL] [Debug] Spark Memory Issue with DataFrame Processing
Gaurav Madan