[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2023-08-07 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: Step to reproduce: 1)Use SPak Streaming application. 2) inside foreachRDD of an

[jira] [Resolved] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2023-08-07 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev resolved SPARK-31427. Resolution: Invalid > Spark Structure streaming read data twice per every micro-batch. > -

[jira] [Resolved] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2023-08-07 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev resolved SPARK-34204. Fix Version/s: 3.1.1 Resolution: Fixed > When use input_file_name() func all column

[jira] [Commented] (SPARK-35094) Spark from_json(JsonToStruct) function return wrong value in permissive mode in case best effort

2023-08-07 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17751630#comment-17751630 ] Nick Hryhoriev commented on SPARK-35094: I miss understand, do the issue resolve

[jira] [Comment Edited] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-02-09 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686914#comment-17686914 ] Nick Hryhoriev edited comment on SPARK-42034 at 2/10/23 7:36 AM: -

[jira] [Commented] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-02-09 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17686914#comment-17686914 ] Nick Hryhoriev commented on SPARK-42034: I can do PR, but I need someone to targ

[jira] [Created] (SPARK-42034) QueryExecutionListener and Observation API, df.observe do not work with `foreach` action.

2023-01-12 Thread Nick Hryhoriev (Jira)
Nick Hryhoriev created SPARK-42034: -- Summary: QueryExecutionListener and Observation API, df.observe do not work with `foreach` action. Key: SPARK-42034 URL: https://issues.apache.org/jira/browse/SPARK-42034

[jira] [Commented] (SPARK-36263) Add Dataset.observe(Observation, Column, Column*) to PySpark

2023-01-12 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17676265#comment-17676265 ] Nick Hryhoriev commented on SPARK-36263: Hi, I find this feature does not work f

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-05-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344312#comment-17344312 ] Nick Hryhoriev commented on SPARK-11844: [~sungwy92] spark.hadoop.fs.s3a.fast.u

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-05-11 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342447#comment-17342447 ] Nick Hryhoriev commented on SPARK-11844: I turn off `fast.data.upload` in spark

[jira] [Commented] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2021-05-06 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340038#comment-17340038 ] Nick Hryhoriev commented on SPARK-34204: I write every simple code to avoid it,

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-28 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334577#comment-17334577 ] Nick Hryhoriev commented on SPARK-11844: [~Xu_Guang_Lv] My issue is also always

[jira] [Updated] (SPARK-35094) Spark from_json(JsonToStruct) function return wrong value in permissive mode in case best effort

2021-04-15 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-35094: --- Description: I use spark 3.1.1 and 3.0.2. Function `from_json` return wrong result with Pe

[jira] [Updated] (SPARK-35094) Spark from_json(JsonToStruct) function return wrong value in permissive mode in case best effort

2021-04-15 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-35094: --- Description: I use spark 3.1.1 and 3.0.2. Function `from_json` return wrong result with Per

[jira] [Created] (SPARK-35094) Spark from_json(JsonToStruct) function return wrong value in permissive mode in case best effort

2021-04-15 Thread Nick Hryhoriev (Jira)
Nick Hryhoriev created SPARK-35094: -- Summary: Spark from_json(JsonToStruct) function return wrong value in permissive mode in case best effort Key: SPARK-35094 URL: https://issues.apache.org/jira/browse/SPARK-35

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-12 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/12/21, 3:05 PM:

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-04-09 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317874#comment-17317874 ] Nick Hryhoriev commented on SPARK-31427: thx [~kabhwan], yes my only concern rea

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 2:22 PM: -

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 11:50 AM:

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 10:51 AM:

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 10:49 AM:

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/8/21, 10:35 AM:

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

2021-04-08 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17317066#comment-17317066 ] Nick Hryhoriev commented on SPARK-11844: I have experienced the same issue with

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-14 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301281#comment-17301281 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/14/21, 9:26 PM:

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-14 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301281#comment-17301281 ] Nick Hryhoriev commented on SPARK-31427: hi [~xccui] , after some deep investiga

[jira] [Updated] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-31427: --- Affects Version/s: 2.4.7 3.0.1 3.0.2 > Spark S

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:38 AM: ---

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:21 AM: ---

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:20 AM: ---

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 10:16 AM: ---

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 9:41 AM:

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300777#comment-17300777 ] Nick Hryhoriev commented on SPARK-31427: And even more strange, when I use only

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300775#comment-17300775 ] Nick Hryhoriev commented on SPARK-31427: In spark 3 on GUI, I even can see that

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300773#comment-17300773 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 9:24 AM:

[jira] [Comment Edited] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300773#comment-17300773 ] Nick Hryhoriev edited comment on SPARK-31427 at 3/13/21, 9:22 AM:

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2021-03-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17300773#comment-17300773 ] Nick Hryhoriev commented on SPARK-31427: I check spark 3, it's the same. Maybe i

[jira] [Updated] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2021-01-24 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Description: input_file_name() function damage applying projection to the physical plan of

[jira] [Updated] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2021-01-24 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Description: input_file_name() function damage applying projection to the physical plan of

[jira] [Commented] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2021-01-22 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270326#comment-17270326 ] Nick Hryhoriev commented on SPARK-34204: Look like `spark_partition_id` have sam

[jira] [Updated] (SPARK-34204) When use input_file_name() func all column from file appeared in physical plan of query, not only projection.

2021-01-22 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Summary: When use input_file_name() func all column from file appeared in physical plan of q

[jira] [Updated] (SPARK-34204) input_file_name() func damage applying projection to physical plan of query.

2021-01-22 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Description: input_file_name() function damage applying projection to the physical plan of

[jira] [Updated] (SPARK-34204) input_file_name() func damage applying projection to physical plan of query.

2021-01-22 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-34204: --- Description: input_file_name() function damage applying projection to the physical plan of

[jira] [Created] (SPARK-34204) input_file_name() func damage applying projection to physical plan of query.

2021-01-22 Thread Nick Hryhoriev (Jira)
Nick Hryhoriev created SPARK-34204: -- Summary: input_file_name() func damage applying projection to physical plan of query. Key: SPARK-34204 URL: https://issues.apache.org/jira/browse/SPARK-34204 Proj

[jira] [Comment Edited] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2020-09-01 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188342#comment-17188342 ] Nick Hryhoriev edited comment on SPARK-12837 at 9/1/20, 10:12 AM:

[jira] [Commented] (SPARK-12837) Spark driver requires large memory space for serialized results even there are no data collected to the driver

2020-09-01 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17188342#comment-17188342 ] Nick Hryhoriev commented on SPARK-12837: I have the same issue with the dataset.

[jira] [Commented] (SPARK-30364) The spark-streaming-kafka-0-10_2.11 test cases are failing on ppc64le

2020-04-15 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17084033#comment-17084033 ] Nick Hryhoriev commented on SPARK-30364: I have the same issue with the spark ap

[jira] [Commented] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2020-04-13 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082163#comment-17082163 ] Nick Hryhoriev commented on SPARK-31427: [~kabhwan] I will try to do it, but do

[jira] [Created] (SPARK-31427) Spark Structure streaming read data twice per every micro-batch.

2020-04-12 Thread Nick Hryhoriev (Jira)
Nick Hryhoriev created SPARK-31427: -- Summary: Spark Structure streaming read data twice per every micro-batch. Key: SPARK-31427 URL: https://issues.apache.org/jira/browse/SPARK-31427 Project: Spark

[jira] [Commented] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2019-11-06 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968226#comment-16968226 ] Nick Hryhoriev commented on SPARK-19407: [~uncleGen] > defaultFS is used FileSy

[jira] [Comment Edited] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2019-11-06 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968221#comment-16968221 ] Nick Hryhoriev edited comment on SPARK-19407 at 11/6/19 9:40 AM: -

[jira] [Comment Edited] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2019-11-06 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968221#comment-16968221 ] Nick Hryhoriev edited comment on SPARK-19407 at 11/6/19 9:39 AM: -

[jira] [Comment Edited] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2019-11-06 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968221#comment-16968221 ] Nick Hryhoriev edited comment on SPARK-19407 at 11/6/19 9:37 AM: -

[jira] [Commented] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2019-11-06 Thread Nick Hryhoriev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968221#comment-16968221 ] Nick Hryhoriev commented on SPARK-19407: I have the same issue with spark 2.4.4.

[jira] [Comment Edited] (SPARK-5594) SparkException: Failed to get broadcast (TorrentBroadcast)

2017-05-11 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004733#comment-16004733 ] Nick Hryhoriev edited comment on SPARK-5594 at 5/12/17 6:32 AM:

[jira] [Commented] (SPARK-5594) SparkException: Failed to get broadcast (TorrentBroadcast)

2017-05-10 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16004733#comment-16004733 ] Nick Hryhoriev commented on SPARK-5594: --- Hi, i have the same issue. But in spark 2.1

[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: Step to reproduce: 1)Use SPak Streaming application. 2) inside foreachRDD of any

[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: Step to reproduce: 1)Use SPak Streaming application. 2) inside foreachRDD of any

[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: Step to reproduce: 1)Use SPak Streaming application. 2) inside foreachRDD of any

[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: Step to reproduce: 1)Use SPak Streaming application. 2) inside foreachRDD of any

[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: Step to reproduce: 1)Use SPak Streaming application. 2) inside foreachRDD of any

[jira] [Commented] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940113#comment-15940113 ] Nick Hryhoriev commented on SPARK-20080: It's clear issue. Even with a link to co

[jira] [Updated] (SPARK-20080) Spak streaming application do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Summary: Spak streaming application do not throw serialisation exception in foreachRDD (was:

[jira] [Reopened] (SPARK-20080) Spak streaming up do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev reopened SPARK-20080: Problem with loosing exception still exist. > Spak streaming up do not throw serialisation exc

[jira] [Commented] (SPARK-20080) Spak streaming up do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940069#comment-15940069 ] Nick Hryhoriev commented on SPARK-20080: [~sowen] You don't understand problem. T

[jira] [Updated] (SPARK-20080) Spak streaming up do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: When i try use or init org.slf4j.Logger inside foreachPartition, that extracted

[jira] [Updated] (SPARK-20080) Spak streaming up do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: up vote 0 down vote favorite When i try use or init org.slf4j.Logger inside fore

[jira] [Updated] (SPARK-20080) Spak streaming up do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Hryhoriev updated SPARK-20080: --- Description: up vote 0 down vote favorite When i try use or init org.slf4j.Logger inside fore

[jira] [Created] (SPARK-20080) Spak streaming up do not throw serialisation exception in foreachRDD

2017-03-24 Thread Nick Hryhoriev (JIRA)
Nick Hryhoriev created SPARK-20080: -- Summary: Spak streaming up do not throw serialisation exception in foreachRDD Key: SPARK-20080 URL: https://issues.apache.org/jira/browse/SPARK-20080 Project: Spa