Unsubscribe

Android için Outlook uygulamasini edinin From: Darshan Pandya Sent: Saturday, October 14, 2017 11:55:06 AM To: user Subject: Spark Structured Streaming not connecting to Kafka using kerberos Hello, I'm using

Runnig multiple spark jobs on yarn

Hi, Where should i start to be able to run multiple spark jobs concurrent on 3 node spark cluster? Android için Outlook uygulamasını edinin

Re: Spark parquet file read problem !

t file read problem ! Kime: serkan taş, pandees waran Bilgi: user@spark.apache.org please add the schemaMerge to the option. ---Original--- From: "serkan taş"<serkan_...@hotmail.com> Date: 2017/7/31 13:54:14 To: "pandees waran"<pande...@gmail.com>; Cc: "u

Re: Spark parquet file read problem !

<pande...@gmail.com> Sent: Sunday, July 30, 2017 7:12:55 PM To: serkan taş Cc: user@spark.apache.org Subject: Re: Spark parquet file read problem ! I have encountered the similar error when the schema / datatypes are conflicting in those 2 parquet files. Are you sure that the 2 indi

Re: Spark parquet file read problem !

to fix this by enforcing the default values for the missing values to make the structure and data types identical. Sent from my iPhone On Jul 30, 2017, at 8:11 AM, serkan taş <serkan_...@hotmail.com<mailto:serkan_...@hotmail.com>> wrote: Hi, I have a problem while reading parquet f

Spark parquet file read problem !

Hi, I have a problem while reading parquet files located in hdfs. If i read the files individually nothing wrong and i can get the file content. parquetFile = spark.read.parquet(“hdfs://xxx/20170719/part-0-3a9c226f-4fef-44b8-996b-115a2408c746.snappy.parquet") and parquetFile =