[jira] [Assigned] (SPARK-24715) sbt build brings a wrong jline versions

[ https://issues.apache.org/jira/browse/SPARK-24715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24715: Assignee: Apache Spark > sbt build brings a wrong jline versions > --

[jira] [Commented] (SPARK-24715) sbt build brings a wrong jline versions

[ https://issues.apache.org/jira/browse/SPARK-24715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529475#comment-16529475 ] Apache Spark commented on SPARK-24715: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-24715) sbt build brings a wrong jline versions

[ https://issues.apache.org/jira/browse/SPARK-24715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24715: Assignee: (was: Apache Spark) > sbt build brings a wrong jline versions > ---

[jira] [Commented] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String

[ https://issues.apache.org/jira/browse/SPARK-24673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529479#comment-16529479 ] Antonio Murgia commented on SPARK-24673: I have created a PR, I have added the o

[jira] [Assigned] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance

[ https://issues.apache.org/jira/browse/SPARK-24714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24714: Assignee: Apache Spark > AnalysisSuite should use ClassTag to check the runtime instance

[jira] [Commented] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance

[ https://issues.apache.org/jira/browse/SPARK-24714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529505#comment-16529505 ] Apache Spark commented on SPARK-24714: -- User 'chia7712' has created a pull request

[jira] [Assigned] (SPARK-24714) AnalysisSuite should use ClassTag to check the runtime instance

[ https://issues.apache.org/jira/browse/SPARK-24714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24714: Assignee: (was: Apache Spark) > AnalysisSuite should use ClassTag to check the runtim

[jira] [Commented] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529567#comment-16529567 ] Anuj Nagpall commented on SPARK-8614: - [~tygert] Can you take a look at the following

[jira] [Created] (SPARK-24716) Refactor ParquetFilters

Yuming Wang created SPARK-24716: --- Summary: Refactor ParquetFilters Key: SPARK-24716 URL: https://issues.apache.org/jira/browse/SPARK-24716 Project: Spark Issue Type: Improvement Compo

[jira] [Commented] (SPARK-24716) Refactor ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529603#comment-16529603 ] Yuming Wang commented on SPARK-24716: - I'm working on. > Refactor ParquetFilters >

[jira] [Assigned] (SPARK-24716) Refactor ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24716: Assignee: (was: Apache Spark) > Refactor ParquetFilters > --- > >

[jira] [Commented] (SPARK-24716) Refactor ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529618#comment-16529618 ] Apache Spark commented on SPARK-24716: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-24716) Refactor ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24716: Assignee: Apache Spark > Refactor ParquetFilters > --- > >

[jira] [Commented] (SPARK-24596) Non-cascading Cache Invalidation

[ https://issues.apache.org/jira/browse/SPARK-24596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529631#comment-16529631 ] ant_nebula commented on SPARK-24596: good!!! > Non-cascading Cache Invalidation > -

[jira] [Commented] (SPARK-24703) Unable to multiply calender interval with long/int

[ https://issues.apache.org/jira/browse/SPARK-24703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529656#comment-16529656 ] Priyanka Garg commented on SPARK-24703: --- Yeah... That's why I thought to add this.

[jira] [Comment Edited] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529567#comment-16529567 ] Anuj Nagpall edited comment on SPARK-8614 at 7/2/18 10:40 AM: -

[jira] [Comment Edited] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529567#comment-16529567 ] Anuj Nagpall edited comment on SPARK-8614 at 7/2/18 10:40 AM: -

[jira] [Comment Edited] (SPARK-8614) Row order preservation for operations on MLlib IndexedRowMatrix

[ https://issues.apache.org/jira/browse/SPARK-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529567#comment-16529567 ] Anuj Nagpall edited comment on SPARK-8614 at 7/2/18 10:41 AM: -

[jira] [Assigned] (SPARK-24711) Integration tests will not work with exclude/include tags

[ https://issues.apache.org/jira/browse/SPARK-24711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24711: Assignee: (was: Apache Spark) > Integration tests will not work with exclude/include

[jira] [Assigned] (SPARK-24711) Integration tests will not work with exclude/include tags

[ https://issues.apache.org/jira/browse/SPARK-24711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24711: Assignee: Apache Spark > Integration tests will not work with exclude/include tags >

[jira] [Commented] (SPARK-24711) Integration tests will not work with exclude/include tags

[ https://issues.apache.org/jira/browse/SPARK-24711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529707#comment-16529707 ] Apache Spark commented on SPARK-24711: -- User 'skonto' has created a pull request fo

[jira] [Commented] (SPARK-24712) TrainValidationSplit ignores label column name and forces to be "label"

[ https://issues.apache.org/jira/browse/SPARK-24712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529746#comment-16529746 ] Marco Gaido commented on SPARK-24712: - The problem is that you have not set the labe

[jira] [Resolved] (SPARK-24712) TrainValidationSplit ignores label column name and forces to be "label"

[ https://issues.apache.org/jira/browse/SPARK-24712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-24712. - Resolution: Not A Problem > TrainValidationSplit ignores label column name and forces to be "lab

[jira] [Commented] (SPARK-23243) Shuffle+Repartition on an RDD could lead to incorrect answers

[ https://issues.apache.org/jira/browse/SPARK-23243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529820#comment-16529820 ] Apache Spark commented on SPARK-23243: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-17181) [Spark2.0 web ui]The status of the certain jobs is still displayed as running even if all the stages of this job have already finished

[ https://issues.apache.org/jira/browse/SPARK-17181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529869#comment-16529869 ] Thomas Graves commented on SPARK-17181: --- that would be a question for [~marymwu]

[jira] [Created] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider

Jungtaek Lim created SPARK-24717: Summary: Split out min retain version of state for memory in HDFSBackedStateStoreProvider Key: SPARK-24717 URL: https://issues.apache.org/jira/browse/SPARK-24717 Proj

[jira] [Commented] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider

[ https://issues.apache.org/jira/browse/SPARK-24717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529962#comment-16529962 ] Jungtaek Lim commented on SPARK-24717: -- I have a patch for this, but now on top of

[jira] [Resolved] (SPARK-22008) Spark Streaming Dynamic Allocation auto fix maxNumExecutors

[ https://issues.apache.org/jira/browse/SPARK-22008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22008. --- Resolution: Not A Problem I don't think this is a problem, given the description and PR. > Spark St

[jira] [Assigned] (SPARK-24715) sbt build brings a wrong jline versions

[ https://issues.apache.org/jira/browse/SPARK-24715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24715: Assignee: Liang-Chi Hsieh > sbt build brings a wrong jline versions > ---

[jira] [Resolved] (SPARK-24715) sbt build brings a wrong jline versions

[ https://issues.apache.org/jira/browse/SPARK-24715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24715. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21692 [https://gi

[jira] [Resolved] (SPARK-24507) Description in "Level of Parallelism in Data Receiving" section of Spark Streaming Programming Guide in is not relevan for the recent Kafka direct apprach

[ https://issues.apache.org/jira/browse/SPARK-24507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24507. -- Resolution: Fixed Fix Version/s: 2.3.2 2.4.0 Issue resolved by pull

[jira] [Assigned] (SPARK-24507) Description in "Level of Parallelism in Data Receiving" section of Spark Streaming Programming Guide in is not relevan for the recent Kafka direct apprach

[ https://issues.apache.org/jira/browse/SPARK-24507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24507: Assignee: Rekha Joshi > Description in "Level of Parallelism in Data Receiving" section o

[jira] [Issue Comment Deleted] (SPARK-24716) Refactor ParquetFilters

[ https://issues.apache.org/jira/browse/SPARK-24716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24716: Comment: was deleted (was: I'm working on.) > Refactor ParquetFilters > --- >

[jira] [Updated] (SPARK-13343) speculative tasks that didn't commit shouldn't be marked as success

[ https://issues.apache.org/jira/browse/SPARK-13343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13343: -- Description: Currently Speculative tasks that didn't commit can show up as success  (dependin

[jira] [Commented] (SPARK-24718) Timestamp support pushdown to parquet data source

[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530095#comment-16530095 ] Yuming Wang commented on SPARK-24718: - I'm working on > Timestamp support pushdown

[jira] [Created] (SPARK-24718) Timestamp support pushdown to parquet data source

Yuming Wang created SPARK-24718: --- Summary: Timestamp support pushdown to parquet data source Key: SPARK-24718 URL: https://issues.apache.org/jira/browse/SPARK-24718 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source

[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24718: Description: Some thing like this: {code:java} // INT96 deprecated, doesn't support pushdown, see:

[jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source

[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24718: Description: Some thing like this: {code:java} case ParquetSchemaType(TIMESTAMP_MICROS, INT64, dec

[jira] [Updated] (SPARK-24718) Timestamp support pushdown to parquet data source

[ https://issues.apache.org/jira/browse/SPARK-24718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-24718: Description: Some thing like this: {code:java} case ParquetSchemaType(TIMESTAMP_MICROS, INT64, nul

[jira] [Created] (SPARK-24719) ClusteringEvaluator supports integer type labels

Xiangrui Meng created SPARK-24719: - Summary: ClusteringEvaluator supports integer type labels Key: SPARK-24719 URL: https://issues.apache.org/jira/browse/SPARK-24719 Project: Spark Issue Type

[jira] [Updated] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':'

[ https://issues.apache.org/jira/browse/SPARK-24681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-24681: Target Version/s: 2.4.0 > Cannot create a view from a table when a nested column name contains ':' > -

[jira] [Commented] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':'

[ https://issues.apache.org/jira/browse/SPARK-24681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530206#comment-16530206 ] Xiao Li commented on SPARK-24681: - cc [~maropu] [~dongjoon] Are you interested in this b

[jira] [Updated] (SPARK-24719) ClusteringEvaluator supports integer type labels

[ https://issues.apache.org/jira/browse/SPARK-24719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24719: -- Description: ClusterEvaluator should support integer labels because we output integer labels

[jira] [Updated] (SPARK-24719) ClusteringEvaluator supports integer type labels

[ https://issues.apache.org/jira/browse/SPARK-24719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24719: -- Description: ClusterEvaluator should support integer labels because we output integer labels

[jira] [Resolved] (SPARK-24683) SparkLauncher.NO_RESOURCE doesn't work with Java applications

[ https://issues.apache.org/jira/browse/SPARK-24683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-24683. Resolution: Fixed Fix Version/s: 2.4.0 > SparkLauncher.NO_RESOURCE doesn't work with Java a

[jira] [Updated] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true

[ https://issues.apache.org/jira/browse/SPARK-24720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Ambard updated SPARK-24720: --- External issue ID: SPARK-17147 > kafka transaction creates Non-consecutive Offsets (due to t

[jira] [Updated] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true

[ https://issues.apache.org/jira/browse/SPARK-24720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Ambard updated SPARK-24720: --- External issue ID: (was: SPARK-17147) > kafka transaction creates Non-consecutive Offsets

[jira] [Created] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true

Quentin Ambard created SPARK-24720: -- Summary: kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true Key: SPARK-24720 URL: https://issues.apac

[jira] [Created] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF

Xiao Li created SPARK-24721: --- Summary: Failed to call PythonUDF whose input is the output of another PythonUDF Key: SPARK-24721 URL: https://issues.apache.org/jira/browse/SPARK-24721 Project: Spark

[jira] [Updated] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true

[ https://issues.apache.org/jira/browse/SPARK-24720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Ambard updated SPARK-24720: --- Description: When kafka transactions are used, sending 1 message to kafka will result to 1

[jira] [Commented] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF

[ https://issues.apache.org/jira/browse/SPARK-24721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530241#comment-16530241 ] Xiao Li commented on SPARK-24721: - cc [~icexelloss] Are you interested in this? > Faile

[jira] [Commented] (SPARK-24530) Sphinx doesn't render autodoc_docstring_signature correctly (with Python 2?) and pyspark.ml docs are broken

[ https://issues.apache.org/jira/browse/SPARK-24530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530251#comment-16530251 ] Hyukjin Kwon commented on SPARK-24530: -- related PRs are also open in https://github

[jira] [Updated] (SPARK-24720) kafka transaction creates Non-consecutive Offsets (due to transaction offset) making streaming fail when failOnDataLoss=true

[ https://issues.apache.org/jira/browse/SPARK-24720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Quentin Ambard updated SPARK-24720: --- Description: When kafka transactions are used, sending 1 message to kafka will result to 1

[jira] [Commented] (SPARK-24719) ClusteringEvaluator supports integer type labels

[ https://issues.apache.org/jira/browse/SPARK-24719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530264#comment-16530264 ] Marco Gaido commented on SPARK-24719: - Sure,thanks. I'll submit a PR ASAP. > Cluste

[jira] [Updated] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-24668: Shepherd: holdenk Affects Version/s: 2.4.0 > PySpark crashes when getting the webui url if th

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530284#comment-16530284 ] holdenk commented on SPARK-24668: - So there is also the case where Spark is run without

[jira] [Assigned] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String

[ https://issues.apache.org/jira/browse/SPARK-24673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24673: Assignee: (was: Apache Spark) > scala sql function from_utc_timestamp second argument

[jira] [Assigned] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String

[ https://issues.apache.org/jira/browse/SPARK-24673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24673: Assignee: Apache Spark > scala sql function from_utc_timestamp second argument could be C

[jira] [Commented] (SPARK-24673) scala sql function from_utc_timestamp second argument could be Column instead of String

[ https://issues.apache.org/jira/browse/SPARK-24673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530317#comment-16530317 ] Apache Spark commented on SPARK-24673: -- User 'tmnd1991' has created a pull request

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530344#comment-16530344 ] Karthik Palaniappan commented on SPARK-24668: - Sounds good to me – I'll work

[jira] [Resolved] (SPARK-24428) Remove unused code and fix any related doc in K8s module

[ https://issues.apache.org/jira/browse/SPARK-24428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anirudh Ramanathan resolved SPARK-24428. Resolution: Fixed Fix Version/s: 2.4.0 > Remove unused code and fix any rel

[jira] [Commented] (SPARK-24428) Remove unused code and fix any related doc in K8s module

[ https://issues.apache.org/jira/browse/SPARK-24428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530391#comment-16530391 ] Anirudh Ramanathan commented on SPARK-24428: Resolved by https://github.com/

[jira] [Created] (SPARK-24722) Column-based API for pivoting

Maxim Gekk created SPARK-24722: -- Summary: Column-based API for pivoting Key: SPARK-24722 URL: https://issues.apache.org/jira/browse/SPARK-24722 Project: Spark Issue Type: Improvement C

[jira] [Commented] (SPARK-24722) Column-based API for pivoting

[ https://issues.apache.org/jira/browse/SPARK-24722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530443#comment-16530443 ] Apache Spark commented on SPARK-24722: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-24722) Column-based API for pivoting

[ https://issues.apache.org/jira/browse/SPARK-24722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24722: Assignee: Apache Spark > Column-based API for pivoting > - >

[jira] [Assigned] (SPARK-24722) Column-based API for pivoting

[ https://issues.apache.org/jira/browse/SPARK-24722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24722: Assignee: (was: Apache Spark) > Column-based API for pivoting > -

[jira] [Commented] (SPARK-24164) Support column list as the pivot column in Pivot

[ https://issues.apache.org/jira/browse/SPARK-24164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530448#comment-16530448 ] Maxim Gekk commented on SPARK-24164: [~maryannxue] Are you working on the feature, o

[jira] [Commented] (SPARK-24721) Failed to call PythonUDF whose input is the output of another PythonUDF

[ https://issues.apache.org/jira/browse/SPARK-24721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530462#comment-16530462 ] Li Jin commented on SPARK-24721: Yep I can take a look > Failed to call PythonUDF whose

[jira] [Commented] (SPARK-24719) ClusteringEvaluator supports integer type labels

[ https://issues.apache.org/jira/browse/SPARK-24719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530493#comment-16530493 ] Marco Gaido commented on SPARK-24719: - [~mengxr] I tried to pass integer values in t

[jira] [Assigned] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider

[ https://issues.apache.org/jira/browse/SPARK-24717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24717: Assignee: (was: Apache Spark) > Split out min retain version of state for memory in

[jira] [Assigned] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider

[ https://issues.apache.org/jira/browse/SPARK-24717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24717: Assignee: Apache Spark > Split out min retain version of state for memory in > HDFSBacke

[jira] [Commented] (SPARK-24717) Split out min retain version of state for memory in HDFSBackedStateStoreProvider

[ https://issues.apache.org/jira/browse/SPARK-24717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530508#comment-16530508 ] Apache Spark commented on SPARK-24717: -- User 'HeartSaVioR' has created a pull reque

[jira] [Commented] (SPARK-24681) Cannot create a view from a table when a nested column name contains ':'

[ https://issues.apache.org/jira/browse/SPARK-24681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530561#comment-16530561 ] Takeshi Yamamuro commented on SPARK-24681: -- ok, I'll look into this. > Cannot

[jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks

[ https://issues.apache.org/jira/browse/SPARK-24579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530563#comment-16530563 ] Xiangrui Meng commented on SPARK-24579: --- Addressed the inline comments in the doc.

[jira] [Created] (SPARK-24723) Discuss necessary info and access in barrier mode + YARN

Xiangrui Meng created SPARK-24723: - Summary: Discuss necessary info and access in barrier mode + YARN Key: SPARK-24723 URL: https://issues.apache.org/jira/browse/SPARK-24723 Project: Spark Is

[jira] [Created] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes

Xiangrui Meng created SPARK-24724: - Summary: Discuss necessary info and access in barrier mode + Kubernetes Key: SPARK-24724 URL: https://issues.apache.org/jira/browse/SPARK-24724 Project: Spark

[jira] [Updated] (SPARK-24724) Discuss necessary info and access in barrier mode + Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-24724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24724: -- Description: In barrier mode, to run hybrid distributed DL training jobs, we need to provide

[jira] [Updated] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos

[ https://issues.apache.org/jira/browse/SPARK-24725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24725: -- Description: In barrier mode, to run hybrid distributed DL training jobs, we need to provide

[jira] [Created] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos

Xiangrui Meng created SPARK-24725: - Summary: Discuss necessary info and access in barrier mode + Mesos Key: SPARK-24725 URL: https://issues.apache.org/jira/browse/SPARK-24725 Project: Spark I

[jira] [Updated] (SPARK-24615) Accelerator aware task scheduling for Spark

[ https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24615: -- Shepherd: Xiangrui Meng > Accelerator aware task scheduling for Spark > --

[jira] [Created] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone

Xiangrui Meng created SPARK-24726: - Summary: Discuss necessary info and access in barrier mode + Standalone Key: SPARK-24726 URL: https://issues.apache.org/jira/browse/SPARK-24726 Project: Spark

[jira] [Updated] (SPARK-24726) Discuss necessary info and access in barrier mode + Standalone

[ https://issues.apache.org/jira/browse/SPARK-24726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-24726: -- Description: In barrier mode, to run hybrid distributed DL training jobs, we need to provide

[jira] [Commented] (SPARK-24725) Discuss necessary info and access in barrier mode + Mesos

[ https://issues.apache.org/jira/browse/SPARK-24725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530627#comment-16530627 ] Xiangrui Meng commented on SPARK-24725: --- [~dbtsai] Apple Siri is a major user of S

[jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks

[ https://issues.apache.org/jira/browse/SPARK-24579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530633#comment-16530633 ] Seth Hendrickson commented on SPARK-24579: -- Hmm... Am I the only one who cannot

[jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks

[ https://issues.apache.org/jira/browse/SPARK-24579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530640#comment-16530640 ] Kazuaki Ishizaki commented on SPARK-24579: -- I cannot see comments on the doc, t

[jira] [Commented] (SPARK-24579) SPIP: Standardize Optimized Data Exchange between Spark and DL/AI frameworks

[ https://issues.apache.org/jira/browse/SPARK-24579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530643#comment-16530643 ] Reynold Xin commented on SPARK-24579: - I can't either.   > SPIP: Standardize Optim

[jira] [Created] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming

ant_nebula created SPARK-24727: -- Summary: The cache 100 in CodeGenerator is too small for streaming Key: SPARK-24727 URL: https://issues.apache.org/jira/browse/SPARK-24727 Project: Spark Issue T

[jira] [Updated] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming

[ https://issues.apache.org/jira/browse/SPARK-24727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24727: --- Description: private val cache = CacheBuilder.newBuilder().maximumSize(100).build The cache 100 in

[jira] [Updated] (SPARK-24727) The cache 100 in CodeGenerator is too small for streaming

[ https://issues.apache.org/jira/browse/SPARK-24727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24727: --- Description: private val cache = CacheBuilder.newBuilder().maximumSize(100).build The cache 100 in

[jira] [Created] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

ant_nebula created SPARK-24728: -- Summary: org.apache.spark.repl.ExecutorClassLoader with cache Key: SPARK-24728 URL: https://issues.apache.org/jira/browse/SPARK-24728 Project: Spark Issue Type:

[jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

[ https://issues.apache.org/jira/browse/SPARK-24728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24728: --- Description: My realtime platform with spark support sql coding and scala coding in jsp page. In or

[jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

[ https://issues.apache.org/jira/browse/SPARK-24728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24728: --- Description: My realtime platform with spark support sql coding and scala coding in jsp page. In or

[jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

[ https://issues.apache.org/jira/browse/SPARK-24728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24728: --- Description: My realtime platform with spark support sql coding and scala coding in jsp page. In or

[jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

[ https://issues.apache.org/jira/browse/SPARK-24728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24728: --- Description: My realtime platform with spark support sql coding and scala coding in jsp page. In or

[jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

[ https://issues.apache.org/jira/browse/SPARK-24728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24728: --- Description: My realtime platform with spark support sql coding and scala coding in jsp page. In or

[jira] [Updated] (SPARK-24728) org.apache.spark.repl.ExecutorClassLoader with cache

[ https://issues.apache.org/jira/browse/SPARK-24728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ant_nebula updated SPARK-24728: --- Description: My realtime platform with spark support sql coding and scala coding in jsp page. In or

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530737#comment-16530737 ] ant_nebula commented on SPARK-9219: --- I solve the problem.Look SPARK-24728 > ClassCastE

[jira] [Commented] (SPARK-18074) UDFs don't work on non-local environment

[ https://issues.apache.org/jira/browse/SPARK-18074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530738#comment-16530738 ] ant_nebula commented on SPARK-18074: I solve the problem.Look SPARK-24728 > UDFs do

[jira] [Commented] (SPARK-18015) CLONE - ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-18015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530739#comment-16530739 ] ant_nebula commented on SPARK-18015: I solve the problem.Look SPARK-24728 > CLONE -

[jira] [Commented] (SPARK-19938) java.lang.ClassCastException: cannot assign instance of scala.collection.immutable.List$SerializationProxy to field

[ https://issues.apache.org/jira/browse/SPARK-19938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16530741#comment-16530741 ] ant_nebula commented on SPARK-19938: I solve the problem.Look SPARK-24728 > java.la

  1   2   >