[jira] [Assigned] (SPARK-23386) Enable direct application links before replay

[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23386: Assignee: Apache Spark > Enable direct application links before replay > -

[jira] [Assigned] (SPARK-23386) Enable direct application links before replay

[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23386: Assignee: (was: Apache Spark) > Enable direct application links before replay > --

[jira] [Commented] (SPARK-23386) Enable direct application links before replay

[ https://issues.apache.org/jira/browse/SPARK-23386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359831#comment-16359831 ] Apache Spark commented on SPARK-23386: -- User 'gerashegalov' has created a pull reque

[jira] [Created] (SPARK-23386) Enable direct application links before replay

Gera Shegalov created SPARK-23386: - Summary: Enable direct application links before replay Key: SPARK-23386 URL: https://issues.apache.org/jira/browse/SPARK-23386 Project: Spark Issue Type: I

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23385: Assignee: (was: Apache Spark) > Allow SparkUITab to be customized adding in SparkConf

[jira] [Commented] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359825#comment-16359825 ] Apache Spark commented on SPARK-23385: -- User 'LantaoJin' has created a pull request

[jira] [Assigned] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

[ https://issues.apache.org/jira/browse/SPARK-23385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23385: Assignee: Apache Spark > Allow SparkUITab to be customized adding in SparkConf and loaded

[jira] [Created] (SPARK-23385) Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI

Lantao Jin created SPARK-23385: -- Summary: Allow SparkUITab to be customized adding in SparkConf and loaded when creating SparkUI Key: SPARK-23385 URL: https://issues.apache.org/jira/browse/SPARK-23385 Pr

[jira] [Commented] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359820#comment-16359820 ] Apache Spark commented on SPARK-23384: -- User 'guoxiaolongzte' has created a pull req

[jira] [Assigned] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23384: Assignee: (was: Apache Spark) > When it has no incomplete(completed) applications foun

[jira] [Assigned] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23384: Assignee: Apache Spark > When it has no incomplete(completed) applications found, the last

[jira] [Updated] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-23384: --- Description: When it has no incomplete(completed) applications found, the last updated time

[jira] [Updated] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

[ https://issues.apache.org/jira/browse/SPARK-23384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-23384: --- Attachment: 2.png 1.png > When it has no incomplete(completed) applications f

[jira] [Created] (SPARK-23384) When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui.

guoxiaolongzte created SPARK-23384: -- Summary: When it has no incomplete(completed) applications found, the last updated time is not formatted and client local time zone is not show in history server web ui. Key: SPARK-23384

[jira] [Comment Edited] (SPARK-10912) Improve Spark metrics executor.filesystem

[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359810#comment-16359810 ] Harel Ben Attia edited comment on SPARK-10912 at 2/11/18 6:25 AM: -

[jira] [Commented] (SPARK-10912) Improve Spark metrics executor.filesystem

[ https://issues.apache.org/jira/browse/SPARK-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359810#comment-16359810 ] Harel Ben Attia commented on SPARK-10912: - We would really be glad to see this ha

[jira] [Updated] (SPARK-23340) Update ORC to 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-23340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23340: -- Description: This issue updates Apache ORC dependencies to 1.4.3 released on February 9th. Apac

[jira] [Updated] (SPARK-23340) Update ORC to 1.4.3

[ https://issues.apache.org/jira/browse/SPARK-23340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-23340: -- Summary: Update ORC to 1.4.3 (was: Update ORC to 1.4.2) > Update ORC to 1.4.3 > ---

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359788#comment-16359788 ] Harleen Singh Mann commented on SPARK-23370: This goes as far as I understand

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359786#comment-16359786 ] Apache Spark commented on SPARK-17147: -- User 'koeninger' has created a pull request

[jira] [Assigned] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17147: Assignee: (was: Apache Spark) > Spark Streaming Kafka 0.10 Consumer Can't Handle Non-c

[jira] [Assigned] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17147: Assignee: Apache Spark > Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive

[jira] [Assigned] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23383: Assignee: (was: Apache Spark) > Make a distribution should exit with usage while detec

[jira] [Commented] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359763#comment-16359763 ] Apache Spark commented on SPARK-23383: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23383: Assignee: Apache Spark > Make a distribution should exit with usage while detecting wrong

[jira] [Updated] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

[ https://issues.apache.org/jira/browse/SPARK-23383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-23383: - Description: {code:java} ./dev/make-distribution.sh --name ne-1.0.0-SNAPSHOT xyz --tgz -Phadoop-2.7 +++

[jira] [Created] (SPARK-23383) Make a distribution should exit with usage while detecting wrong options

Kent Yao created SPARK-23383: Summary: Make a distribution should exit with usage while detecting wrong options Key: SPARK-23383 URL: https://issues.apache.org/jira/browse/SPARK-23383 Project: Spark

[jira] [Commented] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359720#comment-16359720 ] Apache Spark commented on SPARK-23382: -- User 'guoxiaolongzte' has created a pull req

[jira] [Assigned] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23382: Assignee: (was: Apache Spark) > Spark Streaming ui about the contents of the form need

[jira] [Assigned] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

[ https://issues.apache.org/jira/browse/SPARK-23382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23382: Assignee: Apache Spark > Spark Streaming ui about the contents of the form need to have hi

[jira] [Created] (SPARK-23382) Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much.

guoxiaolongzte created SPARK-23382: -- Summary: Spark Streaming ui about the contents of the form need to have hidden and show features, when the table records very much. Key: SPARK-23382 URL: https://issues.apache

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359690#comment-16359690 ] Shintaro Murakami commented on SPARK-23381: --- FeatureHasher in MLLib uses Murmur

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359639#comment-16359639 ] Sean Owen commented on SPARK-10697: --- Yes, I think it's OK to add. Go ahead and propose

[jira] [Commented] (SPARK-10697) Lift Calculation in Association Rule mining

[ https://issues.apache.org/jira/browse/SPARK-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359623#comment-16359623 ] Tristan Stevens commented on SPARK-10697: - [~srowen] a big +1 from me to implemen

[jira] [Commented] (SPARK-23240) PythonWorkerFactory issues unhelpful message when pyspark.daemon produces bogus stdout

[ https://issues.apache.org/jira/browse/SPARK-23240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359568#comment-16359568 ] Bruce Robbins commented on SPARK-23240: --- A little background. A Spark installation

[jira] [Assigned] (SPARK-23344) Add KMeans distanceMeasure param to PySpark

[ https://issues.apache.org/jira/browse/SPARK-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-23344: - Assignee: Marco Gaido > Add KMeans distanceMeasure param to PySpark > --

[jira] [Resolved] (SPARK-23344) Add KMeans distanceMeasure param to PySpark

[ https://issues.apache.org/jira/browse/SPARK-23344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23344. --- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20520 [https://github.co

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359501#comment-16359501 ] Sean Owen commented on SPARK-23381: --- ... what problem does this cause? > Murmur3 hash

[jira] [Commented] (SPARK-23370) Spark receives a size of 0 for an Oracle Number field and defaults the field type to be BigDecimal(30,10) instead of the actual precision and scale

[ https://issues.apache.org/jira/browse/SPARK-23370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359500#comment-16359500 ] Sean Owen commented on SPARK-23370: --- Overhead for the applications that will use Oracle

[jira] [Resolved] (SPARK-23374) Checkstyle/Scalastyle only work from top level build

[ https://issues.apache.org/jira/browse/SPARK-23374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-23374. --- Resolution: Not A Problem Agree, that's the right way to invoke a target on one module in a multi-mod

[jira] [Assigned] (SPARK-23360) SparkSession.createDataFrame timestamps can be incorrect with non-Arrow codepath

[ https://issues.apache.org/jira/browse/SPARK-23360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-23360: Assignee: Takuya Ueshin > SparkSession.createDataFrame timestamps can be incorrect with no

[jira] [Resolved] (SPARK-23360) SparkSession.createDataFrame timestamps can be incorrect with non-Arrow codepath

[ https://issues.apache.org/jira/browse/SPARK-23360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23360. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20559 [https://git

[jira] [Assigned] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23381: Assignee: Apache Spark > Murmur3 hash generates a different value from other implementatio

[jira] [Assigned] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23381: Assignee: (was: Apache Spark) > Murmur3 hash generates a different value from other im

[jira] [Commented] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359445#comment-16359445 ] Apache Spark commented on SPARK-23381: -- User 'mrkm4ntr' has created a pull request f

[jira] [Updated] (SPARK-23381) Murmur3 hash generates a different value from other implementations

[ https://issues.apache.org/jira/browse/SPARK-23381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shintaro Murakami updated SPARK-23381: -- Summary: Murmur3 hash generates a different value from other implementations (was: Mur

[jira] [Created] (SPARK-23381) Murmur3 hash generates a different value

Shintaro Murakami created SPARK-23381: - Summary: Murmur3 hash generates a different value Key: SPARK-23381 URL: https://issues.apache.org/jira/browse/SPARK-23381 Project: Spark Issue Typ

[jira] [Commented] (SPARK-23310) Perf regression introduced by SPARK-21113

[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359429#comment-16359429 ] Kazuaki Ishizaki commented on SPARK-23310: -- got it, thanks > Perf regression in

[jira] [Commented] (SPARK-22105) Dataframe has poor performance when computing on many columns with codegen

[ https://issues.apache.org/jira/browse/SPARK-22105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359420#comment-16359420 ] Marco Gaido commented on SPARK-22105: - [~WeichenXu123] which is the number of rows fo

[jira] [Commented] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359349#comment-16359349 ] Apache Spark commented on SPARK-23380: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23380: Assignee: (was: Apache Spark) > Make toPandas fall back to Arrow optimization disabled

[jira] [Assigned] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23380: Assignee: Apache Spark > Make toPandas fall back to Arrow optimization disabled when schem

[jira] [Updated] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is not supported in the Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-23380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23380: - Summary: Make toPandas fall back to Arrow optimization disabled when schema is not supported in t

[jira] [Created] (SPARK-23380) Make toPandas fall back to Arrow optimization disabled when schema is mismatched

Hyukjin Kwon created SPARK-23380: Summary: Make toPandas fall back to Arrow optimization disabled when schema is mismatched Key: SPARK-23380 URL: https://issues.apache.org/jira/browse/SPARK-23380 Proj

[jira] [Commented] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359340#comment-16359340 ] Apache Spark commented on SPARK-23377: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23377: Assignee: Apache Spark > Bucketizer with multiple columns persistence bug > --

[jira] [Assigned] (SPARK-23377) Bucketizer with multiple columns persistence bug

[ https://issues.apache.org/jira/browse/SPARK-23377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23377: Assignee: (was: Apache Spark) > Bucketizer with multiple columns persistence bug > ---