[jira] [Updated] (SPARK-24558) Driver prints the wrong info in the log when the executor which holds cacheBlock is IDLE.Time-out value displayed is not as per configuration value.

2018-07-15 Thread sandeep katta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeep katta updated SPARK-24558: -- Affects Version/s: 2.2.1 2.2.2 > Driver prints the wrong info in the lo

[jira] [Assigned] (SPARK-24558) Driver prints the wrong info in the log when the executor which holds cacheBlock is IDLE.Time-out value displayed is not as per configuration value.

2018-07-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24558: --- Assignee: sandeep katta > Driver prints the wrong info in the log when the executor which h

[jira] [Resolved] (SPARK-24558) Driver prints the wrong info in the log when the executor which holds cacheBlock is IDLE.Time-out value displayed is not as per configuration value.

2018-07-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24558. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21565 [https://gith

[jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24816: Description: SQL interface support {{repartitionByRange}} to improvement data pushdown. I have te

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.10.0

2018-07-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544841#comment-16544841 ] Xiao Li commented on SPARK-23874: - [~bryanc] [~icexelloss] I saw you are working on the

[jira] [Resolved] (SPARK-24810) Fix paths to resource files in AvroSuite

2018-07-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24810. - Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 > Fix paths to resource file

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

2018-07-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544825#comment-16544825 ] Xiao Li commented on SPARK-24498: - [~kiszk] Based on my initial understanding, the code

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544820#comment-16544820 ] James commented on SPARK-21097: --- Hi, [~bradkaiser]   Could you please let me know what i

[jira] [Issue Comment Deleted] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James updated SPARK-21097: -- Comment: was deleted (was: Hi, [~bradkaiser]   Could you please let me know what is the meaning of row proce

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread James (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544816#comment-16544816 ] James commented on SPARK-21097: --- Hi, [~bradkaiser]   Could you please let me know what i

[jira] [Issue Comment Deleted] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread donglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] donglin updated SPARK-21097: Comment: was deleted (was: Hi, [~bradkaiser]   Could you please let me know what is the meaning of row p

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

2018-07-15 Thread donglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544815#comment-16544815 ] donglin commented on SPARK-21097: - Hi, [~bradkaiser]   Could you please let me know wh

[jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24816: Description: SQL interface support {{repartitionByRange}} to improvement data pushdown. I have te

[jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24816: Description: SQL interface support {{repartitionByRange}} to improvement data pushdown. I have te

[jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24816: Description: SQL interface support Improvement data pushdown by .I have test this feather with a

[jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24816: Description: SQL interface support {{repartitionByRange}} to improvement data pushdown .I have te

[jira] [Updated] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24816: Summary: SQL interface support repartitionByRange (was: Improvement data pushdown by repartitionB

[jira] [Commented] (SPARK-24816) SQL interface support repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544813#comment-16544813 ] Yuming Wang commented on SPARK-24816: - I'm working on. > SQL interface support repa

[jira] [Created] (SPARK-24816) Improvement data pushdown by repartitionByRange

2018-07-15 Thread Yuming Wang (JIRA)
Yuming Wang created SPARK-24816: --- Summary: Improvement data pushdown by repartitionByRange Key: SPARK-24816 URL: https://issues.apache.org/jira/browse/SPARK-24816 Project: Spark Issue Type: Imp

[jira] [Resolved] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24813. -- Resolution: Fixed > HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

[jira] [Updated] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24813: - Fix Version/s: 2.2.3 > HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

[jira] [Resolved] (SPARK-24676) Project required data from parsed data when csvColumnPruning disabled

2018-07-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24676. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.4.0 > Project required dat

[jira] [Commented] (SPARK-23259) Clean up legacy code around hive external catalog

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544754#comment-16544754 ] Apache Spark commented on SPARK-23259: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544734#comment-16544734 ] Apache Spark commented on SPARK-24813: -- User 'srowen' has created a pull request fo

[jira] [Commented] (SPARK-20220) Add thrift scheduling pool config in scheduling docs

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544729#comment-16544729 ] Apache Spark commented on SPARK-20220: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24813: - Fix Version/s: 2.4.0 2.3.2 > HiveExternalCatalogVersionsSuite still flaky; fa

[jira] [Created] (SPARK-24815) Structured Streaming should support dynamic allocation

2018-07-15 Thread Karthik Palaniappan (JIRA)
Karthik Palaniappan created SPARK-24815: --- Summary: Structured Streaming should support dynamic allocation Key: SPARK-24815 URL: https://issues.apache.org/jira/browse/SPARK-24815 Project: Spark

[jira] [Created] (SPARK-24814) Relationship between catalog and datasources

2018-07-15 Thread Bruce Robbins (JIRA)
Bruce Robbins created SPARK-24814: - Summary: Relationship between catalog and datasources Key: SPARK-24814 URL: https://issues.apache.org/jira/browse/SPARK-24814 Project: Spark Issue Type: Ne

[jira] [Assigned] (SPARK-24498) Add JDK compiler for runtime codegen

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24498: Assignee: Apache Spark > Add JDK compiler for runtime codegen > -

[jira] [Commented] (SPARK-24498) Add JDK compiler for runtime codegen

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544714#comment-16544714 ] Apache Spark commented on SPARK-24498: -- User 'kiszk' has created a pull request for

[jira] [Assigned] (SPARK-24498) Add JDK compiler for runtime codegen

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24498: Assignee: (was: Apache Spark) > Add JDK compiler for runtime codegen > --

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

2018-07-15 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544703#comment-16544703 ] Bryan Cutler commented on SPARK-24632: -- Hi [~josephkb], would you mind clarifying w

[jira] [Commented] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544690#comment-16544690 ] Apache Spark commented on SPARK-24813: -- User 'srowen' has created a pull request fo

[jira] [Assigned] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24813: Assignee: Sean Owen (was: Apache Spark) > HiveExternalCatalogVersionsSuite still flaky;

[jira] [Assigned] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24813: Assignee: Apache Spark (was: Sean Owen) > HiveExternalCatalogVersionsSuite still flaky;

[jira] [Created] (SPARK-24813) HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

2018-07-15 Thread Sean Owen (JIRA)
Sean Owen created SPARK-24813: - Summary: HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive Key: SPARK-24813 URL: https://issues.apache.org/jira/browse/SPARK-24813 Project: Spark

[jira] [Updated] (SPARK-24624) Can not mix vectorized and non-vectorized UDFs

2018-07-15 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-24624: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-22216 > Can not mix vectorized and non-vector

[jira] [Updated] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF

2018-07-15 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-24721: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-22216 > Failed to call PythonUDF whose input

[jira] [Commented] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF

2018-07-15 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544656#comment-16544656 ] Li Jin commented on SPARK-24721: I am currently traveling but will try to take a look wh

[jira] [Updated] (SPARK-24796) Support GROUPED_AGG_PANDAS_UDF in Pivot

2018-07-15 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-24796: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-22216 > Support GROUPED_AGG_PANDAS_UDF in Piv

[jira] [Commented] (SPARK-24796) Support GROUPED_AGG_PANDAS_UDF in Pivot

2018-07-15 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544655#comment-16544655 ] Li Jin commented on SPARK-24796: Sorry I am traveling now but I will try to take a look

[jira] [Assigned] (SPARK-24812) Last Access Time in the table description is not valid

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24812: Assignee: Apache Spark > Last Access Time in the table description is not valid > ---

[jira] [Commented] (SPARK-24812) Last Access Time in the table description is not valid

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544651#comment-16544651 ] Apache Spark commented on SPARK-24812: -- User 'sujith71955' has created a pull reque

[jira] [Assigned] (SPARK-24812) Last Access Time in the table description is not valid

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24812: Assignee: (was: Apache Spark) > Last Access Time in the table description is not vali

[jira] [Resolved] (SPARK-24769) Support for parsing AVRO binary column

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-24769. Resolution: Duplicate > Support for parsing AVRO binary column > -

[jira] [Issue Comment Deleted] (SPARK-24770) Supporting to convert a column into binary of AVRO format

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-24770: --- Comment: was deleted (was: The function `from_avro` and `to_avro` can be added in one PR: #

[jira] [Resolved] (SPARK-24770) Supporting to convert a column into binary of AVRO format

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-24770. Resolution: Duplicate The function `from_avro` and `to_avro` can be added in one PR: # Th

[jira] [Commented] (SPARK-24769) Support for parsing AVRO binary column

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544640#comment-16544640 ] Gengliang Wang commented on SPARK-24769: [~felipesmmelo] Thank you. But I have c

[jira] [Commented] (SPARK-24770) Supporting to convert a column into binary of AVRO format

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544639#comment-16544639 ] Gengliang Wang commented on SPARK-24770: [~felipesmmelo] Thank you. But I have c

[jira] [Commented] (SPARK-24769) Support for parsing AVRO binary column

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544636#comment-16544636 ] Gengliang Wang commented on SPARK-24769: The function `from_avro` and `to_avro`

[jira] [Commented] (SPARK-24770) Supporting to convert a column into binary of AVRO format

2018-07-15 Thread Gengliang Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544637#comment-16544637 ] Gengliang Wang commented on SPARK-24770: The function `from_avro` and `to_avro`

[jira] [Commented] (SPARK-24811) Add function `from_avro` and `to_avro`

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544634#comment-16544634 ] Apache Spark commented on SPARK-24811: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-24812) Last Access Time in the table description is not valid

2018-07-15 Thread Sujith (JIRA)
Sujith created SPARK-24812: -- Summary: Last Access Time in the table description is not valid Key: SPARK-24812 URL: https://issues.apache.org/jira/browse/SPARK-24812 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-24811) Add function `from_avro` and `to_avro`

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24811: Assignee: (was: Apache Spark) > Add function `from_avro` and `to_avro` >

[jira] [Assigned] (SPARK-24811) Add function `from_avro` and `to_avro`

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24811: Assignee: Apache Spark > Add function `from_avro` and `to_avro` > ---

[jira] [Created] (SPARK-24811) Add function `from_avro` and `to_avro`

2018-07-15 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-24811: -- Summary: Add function `from_avro` and `to_avro` Key: SPARK-24811 URL: https://issues.apache.org/jira/browse/SPARK-24811 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-24457) Performance improvement while converting stringToTimestamp in DateTimeUtils

2018-07-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-24457: -- Priority: Minor (was: Major) > Performance improvement while converting stringToTimestamp in DateTime

[jira] [Commented] (SPARK-24810) Fix paths to resource files in AvroSuite

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544558#comment-16544558 ] Apache Spark commented on SPARK-24810: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-24810) Fix paths to resource files in AvroSuite

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24810: Assignee: Apache Spark > Fix paths to resource files in AvroSuite > -

[jira] [Assigned] (SPARK-24810) Fix paths to resource files in AvroSuite

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24810: Assignee: (was: Apache Spark) > Fix paths to resource files in AvroSuite > --

[jira] [Updated] (SPARK-24810) Fix paths to resource files in AvroSuite

2018-07-15 Thread Maxim Gekk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-24810: --- Attachment: Screen Shot 2018-07-15 at 15.28.13.png > Fix paths to resource files in AvroSuite >

[jira] [Created] (SPARK-24810) Fix paths to resource files in AvroSuite

2018-07-15 Thread Maxim Gekk (JIRA)
Maxim Gekk created SPARK-24810: -- Summary: Fix paths to resource files in AvroSuite Key: SPARK-24810 URL: https://issues.apache.org/jira/browse/SPARK-24810 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-24800) Refactor Avro Serializer and Deserializer

2018-07-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24800. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21762 [https://gith

[jira] [Assigned] (SPARK-24800) Refactor Avro Serializer and Deserializer

2018-07-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24800: --- Assignee: Gengliang Wang > Refactor Avro Serializer and Deserializer >

[jira] [Assigned] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24809: Assignee: Apache Spark > Serializing LongHashedRelation in executor may result in data er

[jira] [Commented] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544534#comment-16544534 ] Apache Spark commented on SPARK-24809: -- User 'liutang123' has created a pull reques

[jira] [Assigned] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error

2018-07-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24809: Assignee: (was: Apache Spark) > Serializing LongHashedRelation in executor may result

[jira] [Commented] (SPARK-24798) sortWithinPartitions(xx) will failed in java.lang.NullPointerException

2018-07-15 Thread Daniel Mateus Pires (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544528#comment-16544528 ] Daniel Mateus Pires commented on SPARK-24798: - +1 it's solved by using "Opti

[jira] [Created] (SPARK-24809) Serializing LongHashedRelation in executor may result in data error

2018-07-15 Thread Lijia Liu (JIRA)
Lijia Liu created SPARK-24809: - Summary: Serializing LongHashedRelation in executor may result in data error Key: SPARK-24809 URL: https://issues.apache.org/jira/browse/SPARK-24809 Project: Spark

[jira] [Commented] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2018-07-15 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16544453#comment-16544453 ] Li Yuanjian commented on SPARK-24295: - Could you give more detailed information abou