user

Messages by Date

2023/03/07 Online classes for spark topics [email protected]
2023/03/07 Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? Mich Talebzadeh
2023/03/07 Re: 回复：Re: Build SPARK from source with SBT failed Tufan Rakshit
2023/03/07 Re: 回复：Re: Build SPARK from source with SBT failed Sean Owen
2023/03/07 Re: 回复：Re: Build SPARK from source with SBT failed Artemis User
2023/03/07 回复：Re: Build SPARK from source with SBT failed ckgppl_yan
2023/03/07 Re: Pandas UDFs vs Inbuilt pyspark functions Sean Owen
2023/03/07 Re: Build SPARK from source with SBT failed Sean Owen
2023/03/07 Pandas UDFs vs Inbuilt pyspark functions neha garde
2023/03/06 Re: [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently and how to handle if achieve quotas of kinesis? Mich Talebzadeh
2023/03/06 unsubscribe Deepthi Sathia Raj
2023/03/06 unsubscribe William R
2023/03/05 [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently and how to handle if achieve quotas of kinesis? hueiyuan su
2023/03/05 Data duplication and loss occur after executing 'insert overwrite...' in Spark 3.1.1 周锋
2023/03/05 Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
2023/03/04 Re: Unable to handle bignumeric datatype in spark/pyspark Atheeth SH
2023/03/04 Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
2023/03/04 Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
2023/03/04 Re: How to pass variables across functions in spark structured streaming (PySpark) Sean Owen
2023/03/04 Re: How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
2023/03/04 Re: How to pass variables across functions in spark structured streaming (PySpark) Sean Owen
2023/03/04 How to pass variables across functions in spark structured streaming (PySpark) Mich Talebzadeh
2023/03/04 Re: SPIP architecture diagrams Mich Talebzadeh
2023/03/03 Re: Unable to handle bignumeric datatype in spark/pyspark Atheeth SH
2023/03/03 Re: Unsubscribe Atheeth SH
2023/03/03 Re: unsubscribe Atheeth SH
2023/03/01 [ANNOUNCE] Apache Celeborn(incubating) 0.2.0 available Ethan Feng
2023/02/27 Re: [New Project] sparksql-ml : Distributed Machine Learning using SparkSQL. Russell Jurney
2023/02/27 Fwd: [New Project] sparksql-ml : Distributed Machine Learning using SparkSQL. Chitral Verma
2023/02/27 Re: Spike on number of tasks - dynamic allocation Mich Talebzadeh
2023/02/27 Re: Spike on number of tasks - dynamic allocation murat migdisoglu
2023/02/27 Re: Spike on number of tasks - dynamic allocation Mich Talebzadeh
2023/02/27 Spike on number of tasks - dynamic allocation murat migdisoglu
2023/02/26 Fwd: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation Mich Talebzadeh
2023/02/26 [JDBC] [PySpark] Possible bug when comparing incoming data frame from mssql and empty delta table lennart
2023/02/25 Re: Unable to handle bignumeric datatype in spark/pyspark Mich Talebzadeh
2023/02/25 Re: Unable to handle bignumeric datatype in spark/pyspark Rajnil Guha
2023/02/25 Late arriving updates to fact tables rajat kumar
2023/02/24 Re: [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
2023/02/24 Re: [PySpark SQL] New column with the maximum of multiple terms? Russell Jurney
2023/02/24 Re: SPIP architecture diagrams Mich Talebzadeh
2023/02/24 Re: [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
2023/02/24 Re: Unable to handle bignumeric datatype in spark/pyspark Mich Talebzadeh
2023/02/23 Unable to handle bignumeric datatype in spark/pyspark nidhi kher
2023/02/23 unsubscribe Roberto Jr
2023/02/23 Re: [PySpark SQL] New column with the maximum of multiple terms? Sean Owen
2023/02/23 Re: [PySpark SQL] New column with the maximum of multiple terms? Bjørn Jørgensen
2023/02/23 Re: [PySpark SQL] New column with the maximum of multiple terms? Russell Jurney
2023/02/23 Re: [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
2023/02/23 Re: [PySpark SQL] New column with the maximum of multiple terms? Sean Owen
2023/02/23 [PySpark SQL] New column with the maximum of multiple terms? Oliver Ruebenacker
2023/02/22 Unsubscribe Tang Jinxin
2023/02/22 Unsubscribe Qijia Liu
2023/02/22 Re: Spark with bigquery : Data type issue Mich Talebzadeh
2023/02/22 Spark with bigquery : Data type issue nidhi kher
2023/02/22 Re: Spark with bigquery : Data type issue nidhi kher
2023/02/20 SPIP: Adding work load identity to Spark on Kubernetes documents (supersedes Secret Management) Mich Talebzadeh
2023/02/20 Re: Graceful shutdown SPARK Structured Streaming Mich Talebzadeh
2023/02/19 Re: How to explode array columns of a dataframe having the same length 404
2023/02/19 Re: Graceful shutdown SPARK Structured Streaming Bjørn Jørgensen
2023/02/19 Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process Mich Talebzadeh
2023/02/18 Re: Unsubscribe winnie hw
2023/02/18 Unsubscribe Sendil Chidambaram
2023/02/18 Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process Holden Karau
2023/02/18 Re: SPIP: Shutting down spark structured streaming when the streaming process completed current process Dongjoon Hyun
2023/02/18 SPIP: Shutting down spark structured streaming when the streaming process completed current process Mich Talebzadeh
2023/02/18 Vote SPIP Faisal Waris
2023/02/17 Update nested struct with null fields Vikas Kumar
2023/02/16 Re: [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently? Vikas Kumar
2023/02/16 [Spark Structured Streaming] Do spark structured streaming is support sink to AWS Kinesis currently? hueiyuan su
2023/02/16 Re: How to explode array columns of a dataframe having the same length Vikas Kumar
2023/02/16 Re: How to explode array columns of a dataframe having the same length sam smith
2023/02/16 Re: How to explode array columns of a dataframe having the same length Bjørn Jørgensen
2023/02/16 How can I set a value of Location with CustomDataSource ? Zhuolin Ji
2023/02/16 Re: How to explode array columns of a dataframe having the same length Navneet
2023/02/16 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Mich Talebzadeh
2023/02/16 Re: How to explode array columns of a dataframe having the same length Enrico Minack
2023/02/15 Re:Upgrading from Spark SQL 3.2 to 3.3 faild lk_spark
2023/02/15 Upgrading from Spark SQL 3.2 to 3.3 faild lk_spark
2023/02/15 Re: [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? Jack Goodson
2023/02/15 [Spark Structured Streaming] Could we apply new options of readStream/writeStream without stopping spark application (zero downtime)? hueiyuan su
2023/02/15 Re: ADLS Gen2 adfs sample yaml configuration Jayabindu Singh
2023/02/15 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit karan alang
2023/02/15 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Mich Talebzadeh
2023/02/15 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Mich Talebzadeh
2023/02/14 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit karan alang
2023/02/14 ADLS Gen2 adfs sample yaml configuration Kondala Ponnaboina (US)
2023/02/14 How to explode array columns of a dataframe having the same length sam smith
2023/02/14 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Ye Xianjin
2023/02/14 Re: Running Spark on Kubernetes (GKE) - failing on spark-submit Khalid Mammadov
2023/02/13 Executor tab missing information Prem Sahoo
2023/02/13 Re: Executor metrics are missing on Prometheus sink Qian Sun
2023/02/13 Running Spark on Kubernetes (GKE) - failing on spark-submit karan alang
2023/02/13 [Spark Core] Spark data loss/data duplication when executors die Erik Eklund
2023/02/13 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) Enrico Minack
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) Enrico Minack
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) Mich Talebzadeh
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
2023/02/12 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/11 Re: How to improve efficiency of this piece of code (returning distinct column values) Enrico Minack
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) Mich Talebzadeh
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) Apostolos N. Papadopoulos
2023/02/10 Re: How to improve efficiency of this piece of code (returning distinct column values) Sean Owen
2023/02/10 How to improve efficiency of this piece of code (returning distinct column values) sam smith
2023/02/10 Re: Sunil Prabhakara
2023/02/09 Fwd: [Spark SQL] : Delete is only supported on V2 tables. Jeevan Chhajed
2023/02/09 Executor metrics are missing on prometheus sink Qian Sun
2023/02/09 Jira Account for Contributions Jack Goodson
2023/02/09 Unsubscribe Patrik Medvedev
2023/02/08 Re: Unsubscribe LinuxGuy
2023/02/08 [Spark SQL]: Spark 3.2 generates different results to query when columns name have mixed casing vs when they have same casing Amit Singh Rathore
2023/02/08 Unsubscribe fuwei901
2023/02/08 Is sparkSession.sql now an action in Spark 3 and later? Sayeh Roshan
2023/02/08 Re: Graceful shutdown SPARK Structured Streaming Brian Wylie
2023/02/08 Unsubscribe fuwei901
2023/02/07 Unsubscribe Tushar Machavolu
2023/02/07 Re: Spark with GPU Alessandro Bellina
2023/02/07 Re: How to upgrade a spark structure streaming application Mich Talebzadeh
2023/02/07 Fwd: Graceful shutdown SPARK Structured Streaming Mich Talebzadeh
2023/02/07 [Spark SQL] : Delete is only supported on V2 tables. Jeevan Chhajed
2023/02/07 How to upgrade a spark structure streaming application Yoel Benharrous
2023/02/07 SQL GROUP BY alias with dots, was: Spark SQL question Enrico Minack
2023/02/07 Unsubscribe Spyros Gasteratos
2023/02/05 big data products LinuxGuy
2023/02/05 Re: Spark with GPU Jack Goodson
2023/02/05 Re: Spark with GPU Mich Talebzadeh
2023/02/05 Spark with GPU Irene Markelic
2023/02/02 Re: Create table before inserting in SQL Harut Martirosyan
2023/02/02 Re: Create table before inserting in SQL Mich Talebzadeh
2023/02/02 Re: Create table before inserting in SQL Harut Martirosyan
2023/02/02 Re: Create table before inserting in SQL Harut Martirosyan
2023/02/01 Re: Create table before inserting in SQL Mich Talebzadeh
2023/02/01 Create table before inserting in SQL Harut Martirosyan
2023/02/01 Spark Thrift Server issue with external HDFS table Kalhara Gurugamage
2023/01/31 What is DataFilters and while joining why is the filter isnotnull[joinKey] applied twice Nitin Siwach
2023/01/31 Fwd: [Spark Standalone Mode] How to read from kerberised HDFS in spark standalone mode Wei Yan
2023/01/31 [Spark/deeplyR] how come spark is caching tables read through jdbc connection from oracle, even when memory=false is chosen Joris Billen
2023/01/30 Re: Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast Artemis User
2023/01/30 Re: Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast Mich Talebzadeh
2023/01/30 Help needed regarding error with 5 node Spark cluster (shuffle error)- Comcast Jain, Sanchi
2023/01/30 Re: Re: spark+kafka+dynamic resource allocation Mich Talebzadeh
2023/01/29 Re: Re: spark+kafka+dynamic resource allocation Lingzhe Sun
2023/01/29 Re: Re: spark+kafka+dynamic resource allocation Mich Talebzadeh
2023/01/28 Re: Re: spark+kafka+dynamic resource allocation Lingzhe Sun
2023/01/28 Fwd: Spark-submit doesn't load all app classes in the classpath Soheil Pourbafrani
2023/01/28 Re: spark+kafka+dynamic resource allocation [email protected]
2023/01/28 Re: Spark SQL question Bjørn Jørgensen
2023/01/28 Re: Spark SQL question Mich Talebzadeh
2023/01/27 spark+kafka+dynamic resource allocation Lingzhe Sun
2023/01/27 Spark SQL question Kohki Nishio
2023/01/27 Re: Question regarding Spark 3.X performance Athanasios Kordelas
2023/01/27 Re: Question regarding Spark 3.X performance Mich Talebzadeh
2023/01/26 Re: Question regarding Spark 3.X performance Mich Talebzadeh
2023/01/26 Re: Question regarding Spark 3.X performance Mich Talebzadeh
2023/01/26 Question regarding Spark 3.X performance Athanasios Kordelas
2023/01/23 Re: Dynamic Scaling without Kubernetes Mich Talebzadeh
2023/01/23 Re: Duplicates in Collaborative Filtering Output Kartik Ohri
2023/01/23 Unsubscribe Calum
2023/01/22 Duplicates in Collaborative Filtering Output Kartik Ohri
2023/01/22 Re: Any advantages of using sql.adaptive.autoBroadcastJoinThreshold over sql.autoBroadcastJoinThreshold? Balakrishnan Ayyappan
2023/01/22 Any advantages of using sql.adaptive.autoBroadcastJoinThreshold over sql.autoBroadcastJoinThreshold? Soumyadeep Mukhopadhyay
2023/01/21 Re: Table created with saveAsTable behaves differently than a table created with spark.sql("CREATE TABLE....) krexos
2023/01/21 Re: Table created with saveAsTable behaves differently than a table created with spark.sql("CREATE TABLE....) Peyman Mohajerian
2023/01/21 Table created with saveAsTable behaves differently than a table created with spark.sql("CREATE TABLE....) krexos
2023/01/20 unsubscribe peng
2023/01/20 Writing protobuf RDD to parquet David Diebold
2023/01/19 unsubscribe 김병찬
2023/01/19 [Spark Standalone Mode] How to read from kerberised HDFS in spark standalone mode Bansal, Jaimita
2023/01/19 How to check the liveness of a SparkSession Yeachan Park
2023/01/18 Re: [PySPark] How to check if value of one column is in array of another column Oliver Ruebenacker
2023/01/17 Re: [PySPark] How to check if value of one column is in array of another column Sean Owen
2023/01/17 [PySPark] How to check if value of one column is in array of another column Oliver Ruebenacker
2023/01/15 Is there any Job/Career channel Chetan Khatri
2023/01/14 [Spark SQL] Data duplicate or data lost with non-deterministic function 李建伟
2023/01/13 Re: pyspark.sql.dataframe.DataFrame versus pyspark.pandas.frame.DataFrame Sean Owen
2023/01/12 pyspark.sql.dataframe.DataFrame versus pyspark.pandas.frame.DataFrame [email protected]
2023/01/11 unsubscribe Sebastian Schere
2023/01/11 [UNSUBSCRIBE] Sebastian Schere
2023/01/10 [pyspark/pandas] Pandas UDF accepting more than 2 pandas dataframe when cogroup + applyInPandas? [email protected]
2023/01/08 Re: Hive 3 has big performance improvement from my test Mich Talebzadeh
2023/01/07 Re: Hive 3 has big performance improvement from my test Mich Talebzadeh
2023/01/06 Re: [pyspark/sparksql]: How to overcome redundant/repetitive code? Is a for loop over an sql statement with a variable a bad idea? Sean Owen
2023/01/06 [pyspark/sparksql]: How to overcome redundant/repetitive code? Is a for loop over an sql statement with a variable a bad idea? Joris Billen
2023/01/06 Re: [PySpark] Error using SciPy: ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject Oliver Ruebenacker
2023/01/06 Re: [PySpark] Error using SciPy: ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject Bjørn Jørgensen
2023/01/06 Re: [PySpark] Error using SciPy: ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject Mich Talebzadeh
2023/01/06 Re: [PySpark] Error using SciPy: ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject Oliver Ruebenacker
2023/01/06 Re: [PySpark] Error using SciPy: ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject Bjørn Jørgensen
2023/01/06 [PySpark] Error using SciPy: ValueError: numpy.ndarray size changed, may indicate binary incompatibility. Expected 88 from C header, got 80 from PyObject Oliver Ruebenacker
2023/01/06 Re: Spark reading from HBase using hbase-connectors - any benefit from localization? Aaron Grubb
2023/01/05 Re: Spark reading from HBase using hbase-connectors - any benefit from localization? Mich Talebzadeh
2023/01/05 Re: Spark reading from HBase using hbase-connectors - any benefit from localization? Aaron Grubb