[jira] [Created] (SPARK-21951) Unable to add the new column and writing into the Hive using spark

jalendhar Baddam created SPARK-21951: Summary: Unable to add the new column and writing into the Hive using spark Key: SPARK-21951 URL: https://issues.apache.org/jira/browse/SPARK-21951 Project: S

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158202#comment-16158202 ] yiming.xu commented on SPARK-650: - I need a hook too. Some case, We need init something lik

[jira] [Commented] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158192#comment-16158192 ] xinzhang commented on SPARK-21067: -- hi [~dricard] do u have any solutions now? any sug

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158189#comment-16158189 ] cen yuhai commented on SPARK-18492: --- spark 2.1.1 also have this problem > GeneratedIte

[jira] [Resolved] (SPARK-21936) backward compatibility test framework for HiveExternalCatalog

[ https://issues.apache.org/jira/browse/SPARK-21936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21936. - Resolution: Fixed Fix Version/s: 2.3.0 > backward compatibility test framework for HiveExternalCat

[jira] [Assigned] (SPARK-21934) Expose Netty memory usage via Metrics System

[ https://issues.apache.org/jira/browse/SPARK-21934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21934: Assignee: (was: Apache Spark) > Expose Netty memory usage via Metrics System > ---

[jira] [Commented] (SPARK-21934) Expose Netty memory usage via Metrics System

[ https://issues.apache.org/jira/browse/SPARK-21934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158184#comment-16158184 ] Apache Spark commented on SPARK-21934: -- User 'jerryshao' has created a pull request

[jira] [Assigned] (SPARK-21934) Expose Netty memory usage via Metrics System

[ https://issues.apache.org/jira/browse/SPARK-21934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21934: Assignee: Apache Spark > Expose Netty memory usage via Metrics System > --

[jira] [Assigned] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21946: Assignee: (was: Apache Spark) > Flaky test: InMemoryCatalogedDDLSuite.`alter table: re

[jira] [Assigned] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21946: Assignee: Apache Spark > Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached

[jira] [Commented] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158176#comment-16158176 ] Apache Spark commented on SPARK-21946: -- User 'kiszk' has created a pull request for

[jira] [Resolved] (SPARK-21726) Check for structural integrity of the plan in QO in test mode

[ https://issues.apache.org/jira/browse/SPARK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21726. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.3.0 > Check for structural i

[jira] [Resolved] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21949. - Resolution: Fixed Assignee: liuxian Fix Version/s: 2.3.0 > Tables created in unit tests s

[jira] [Resolved] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-21950. --- Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.0.

[jira] [Assigned] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin reassigned SPARK-21950: - Assignee: Takuya Ueshin > pyspark.sql.tests.SQLTests2 should stop SparkContext. > --

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158100#comment-16158100 ] Anirudh Ramanathan commented on SPARK-18278: The plan is to support k8s featu

[jira] [Closed] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 closed SPARK-21948. --- > How to use spark streaming for deal two table from one topic of topic?? > -

[jira] [Closed] (SPARK-21776) How to use the memory-mapped file on Spark??

[ https://issues.apache.org/jira/browse/SPARK-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 closed SPARK-21776. --- > How to use the memory-mapped file on Spark?? > > >

[jira] [Comment Edited] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158055#comment-16158055 ] Kevin Zhang edited comment on SPARK-21944 at 9/8/17 2:51 AM: -

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158055#comment-16158055 ] Kevin Zhang commented on SPARK-21944: - I found the problem when I use kafka source co

[jira] [Comment Edited] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158051#comment-16158051 ] Cyanny edited comment on SPARK-18278 at 9/8/17 2:49 AM: Does spar

[jira] [Commented] (SPARK-18278) SPIP: Support native submission of spark jobs to a kubernetes cluster

[ https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158051#comment-16158051 ] Cyanny commented on SPARK-18278: Does spark-on-k8s have any plan to support priority when

[jira] [Assigned] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21950: Assignee: Apache Spark > pyspark.sql.tests.SQLTests2 should stop SparkContext. > -

[jira] [Assigned] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21950: Assignee: (was: Apache Spark) > pyspark.sql.tests.SQLTests2 should stop SparkContext.

[jira] [Commented] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-21950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158047#comment-16158047 ] Apache Spark commented on SPARK-21950: -- User 'ueshin' has created a pull request for

[jira] [Commented] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158046#comment-16158046 ] Dongjoon Hyun commented on SPARK-21946: --- Thanks! Go for it! :) > Flaky test: InMe

[jira] [Commented] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158044#comment-16158044 ] Kazuaki Ishizaki commented on SPARK-21946: -- If someone has not worked for this,

[jira] [Created] (SPARK-21950) pyspark.sql.tests.SQLTests2 should stop SparkContext.

Takuya Ueshin created SPARK-21950: - Summary: pyspark.sql.tests.SQLTests2 should stop SparkContext. Key: SPARK-21950 URL: https://issues.apache.org/jira/browse/SPARK-21950 Project: Spark Issue

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158017#comment-16158017 ] Hyukjin Kwon commented on SPARK-21914: -- I see. What do you think about controlling i

[jira] [Assigned] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21949: Assignee: Apache Spark > Tables created in unit tests should be dropped after use > --

[jira] [Assigned] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21949: Assignee: (was: Apache Spark) > Tables created in unit tests should be dropped after u

[jira] [Commented] (SPARK-21949) Tables created in unit tests should be dropped after use

[ https://issues.apache.org/jira/browse/SPARK-21949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16158003#comment-16158003 ] Apache Spark commented on SPARK-21949: -- User '10110346' has created a pull request f

[jira] [Created] (SPARK-21949) Tables created in unit tests should be dropped after use

liuxian created SPARK-21949: --- Summary: Tables created in unit tests should be dropped after use Key: SPARK-21949 URL: https://issues.apache.org/jira/browse/SPARK-21949 Project: Spark Issue Type: Te

[jira] [Assigned] (SPARK-21939) Use TimeLimits instead of Timeouts

[ https://issues.apache.org/jira/browse/SPARK-21939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-21939: --- Assignee: Dongjoon Hyun > Use TimeLimits instead of Timeouts > -

[jira] [Resolved] (SPARK-21939) Use TimeLimits instead of Timeouts

[ https://issues.apache.org/jira/browse/SPARK-21939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-21939. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19150 [https://githu

[jira] [Updated] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21948: Remaining Estimate: 12h Original Estimate: 12h > How to use spark streaming for deal two table from on

[jira] [Updated] (SPARK-21776) How to use the memory-mapped file on Spark??

[ https://issues.apache.org/jira/browse/SPARK-21776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21776: Remaining Estimate: 12h Original Estimate: 12h > How to use the memory-mapped file on Spark?? > --

[jira] [Commented] (SPARK-19090) Dynamic Resource Allocation not respecting spark.executor.cores

[ https://issues.apache.org/jira/browse/SPARK-19090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157932#comment-16157932 ] Carlos Vicenti commented on SPARK-19090: I have found the same issue while using

[jira] [Resolved] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21948. -- Resolution: Invalid Questions should go to the mailing list rather than describing it as a bug.

[jira] [Updated] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21948: Attachment: QQ图片20170908080946.png > How to use spark streaming for deal two table from one topic of topic?

[jira] [Updated] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21946: -- Priority: Minor (was: Major) > Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cach

[jira] [Issue Comment Deleted] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaP524 updated SPARK-21948: Comment: was deleted (was: !http://example.com/image.png!) > How to use spark streaming for deal two table

[jira] [Commented] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

[ https://issues.apache.org/jira/browse/SPARK-21948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157912#comment-16157912 ] zhaP524 commented on SPARK-21948: - !http://example.com/image.png! > How to use spark str

[jira] [Created] (SPARK-21948) How to use spark streaming for deal two table from one topic of topic??

zhaP524 created SPARK-21948: --- Summary: How to use spark streaming for deal two table from one topic of topic?? Key: SPARK-21948 URL: https://issues.apache.org/jira/browse/SPARK-21948 Project: Spark

[jira] [Created] (SPARK-21947) monotonically_increasing_id doesn't work in Structured Streaming

Shixiong Zhu created SPARK-21947: Summary: monotonically_increasing_id doesn't work in Structured Streaming Key: SPARK-21947 URL: https://issues.apache.org/jira/browse/SPARK-21947 Project: Spark

[jira] [Assigned] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-13656: --- Assignee: Dongjoon Hyun > Delete spark.sql.parquet.cacheMetadata > -

[jira] [Resolved] (SPARK-13656) Delete spark.sql.parquet.cacheMetadata

[ https://issues.apache.org/jira/browse/SPARK-13656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-13656. - Resolution: Fixed Fix Version/s: 2.3.0 > Delete spark.sql.parquet.cacheMetadata >

[jira] [Resolved] (SPARK-18769) Spark to be smarter about what the upper bound is and to restrict number of executor when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-18769. Resolution: Won't Fix See discussion in PR. The main driver for this was a request from YAR

[jira] [Updated] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

[ https://issues.apache.org/jira/browse/SPARK-21946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-21946: -- Description: According to the [Apache Spark Jenkins History|https://amplab.cs.berkeley.edu/jen

[jira] [Created] (SPARK-21946) Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table`

Dongjoon Hyun created SPARK-21946: - Summary: Flaky test: InMemoryCatalogedDDLSuite.`alter table: rename cached table` Key: SPARK-21946 URL: https://issues.apache.org/jira/browse/SPARK-21946 Project: S

[jira] [Created] (SPARK-21945) pyspark --py-files doesn't work in yarn client mode

Thomas Graves created SPARK-21945: - Summary: pyspark --py-files doesn't work in yarn client mode Key: SPARK-21945 URL: https://issues.apache.org/jira/browse/SPARK-21945 Project: Spark Issue T

[jira] [Commented] (SPARK-21914) Running examples as tests in SQL builtin function documentation

[ https://issues.apache.org/jira/browse/SPARK-21914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157542#comment-16157542 ] Reynold Xin commented on SPARK-21914: - Thanks for pinging me. Given the test coverage

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157531#comment-16157531 ] Holger Brandl commented on SPARK-9776: -- But isn't it a major flaw/bug, if the current

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157529#comment-16157529 ] Ruslan Shestopalyuk commented on SPARK-21942: - I can't comment on how common

[jira] [Commented] (SPARK-21842) Support Kerberos ticket renewal and creation in Mesos

[ https://issues.apache.org/jira/browse/SPARK-21842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157527#comment-16157527 ] Kalvin Chau commented on SPARK-21842: - Hey [~arand] no worries, I just recently got t

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:34 PM: --

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:33 PM: --

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:32 PM: --

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157503#comment-16157503 ] Sean Owen commented on SPARK-21942: --- It's possible that these files aren't touched for

[jira] [Comment Edited] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157489#comment-16157489 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 7:31 PM: --

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157489#comment-16157489 ] Ruslan Shestopalyuk commented on SPARK-21942: - Sean, OS won't ever delete the

[jira] [Commented] (SPARK-20589) Allow limiting task concurrency per stage

[ https://issues.apache.org/jira/browse/SPARK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157424#comment-16157424 ] Apache Spark commented on SPARK-20589: -- User 'dhruve' has created a pull request for

[jira] [Updated] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-21890: --- Fix Version/s: 2.2.1 > ObtainCredentials does not pass creds to addDelegationTokens > ---

[jira] [Resolved] (SPARK-21890) ObtainCredentials does not pass creds to addDelegationTokens

[ https://issues.apache.org/jira/browse/SPARK-21890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-21890. --- Resolution: Fixed Assignee: Sanket Reddy Fix Version/s: 2.3.0 > ObtainCredent

[jira] [Commented] (SPARK-18971) Netty issue may cause the shuffle client hang

[ https://issues.apache.org/jira/browse/SPARK-18971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157113#comment-16157113 ] niccolo becchi commented on SPARK-18971: We are facing the same issue, and we are

[jira] [Commented] (SPARK-21944) Watermark on window column is wrong

[ https://issues.apache.org/jira/browse/SPARK-21944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157091#comment-16157091 ] Marco Gaido commented on SPARK-21944: - May you please provide some sample data to rep

[jira] [Commented] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157041#comment-16157041 ] Sean Owen commented on SPARK-21942: --- I suppose my real doubt is whether this would actu

[jira] [Resolved] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21919. --- Resolution: Duplicate > inconsistent behavior of AFTsurvivalRegression algorithm > --

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157027#comment-16157027 ] Yanbo Liang commented on SPARK-21919: - [~srowen] You are right, that is caused by lin

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157013#comment-16157013 ] Sean Owen commented on SPARK-21919: --- Hm, yeah, I suppose I should have tried it too. On

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157002#comment-16157002 ] Cody Koeninger commented on SPARK-17147: Patch is there, if anyone wants to test

[jira] [Updated] (SPARK-21942) DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Summary: DiskBlockManager crashing when a root local folder has been externally del

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156983#comment-16156983 ] Ruslan Shestopalyuk commented on SPARK-21942: - I respectfully agree, just wan

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 2:02 PM: -

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 2:02 PM: -

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 1:59 PM: -

[jira] [Comment Edited] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156979#comment-16156979 ] Yanbo Liang edited comment on SPARK-21919 at 9/7/17 1:58 PM: -

[jira] [Commented] (SPARK-21919) inconsistent behavior of AFTsurvivalRegression algorithm

[ https://issues.apache.org/jira/browse/SPARK-21919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156979#comment-16156979 ] Yanbo Liang commented on SPARK-21919: - [~ashishchopra0308] [~srowen] I can't reproduc

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Updated] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Shestopalyuk updated SPARK-21942: Description: _DiskBlockManager_ has a notion of a "scratch" local folder(s), which

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156966#comment-16156966 ] Krzysztof Sobusiak commented on SPARK-20427: As far as Oracle is concerned th

[jira] [Commented] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descrip

[ https://issues.apache.org/jira/browse/SPARK-21943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156953#comment-16156953 ] Sean Owen commented on SPARK-21943: --- Is there no description, then? what does the UI sa

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156937#comment-16156937 ] Michal W commented on SPARK-17147: -- Hey, just wanted to check if there's any progress on

[jira] [Commented] (SPARK-19634) Feature parity for descriptive statistics in MLlib

[ https://issues.apache.org/jira/browse/SPARK-19634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156936#comment-16156936 ] Apache Spark commented on SPARK-19634: -- User 'WeichenXu123' has created a pull reque

[jira] [Commented] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156914#comment-16156914 ] Saisai Shao commented on SPARK-21942: - I think in a production environment, user shou

[jira] [Created] (SPARK-21944) Watermark on window column is wrong

Kevin Zhang created SPARK-21944: --- Summary: Watermark on window column is wrong Key: SPARK-21944 URL: https://issues.apache.org/jira/browse/SPARK-21944 Project: Spark Issue Type: Bug C

[jira] [Comment Edited] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156829#comment-16156829 ] Krzysztof Sobusiak edited comment on SPARK-20427 at 9/7/17 12:30 PM: --

[jira] [Closed] (SPARK-21937) Spark SQL DDL/DML docs non-existent

[ https://issues.apache.org/jira/browse/SPARK-21937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-21937. - Resolution: Duplicate > Spark SQL DDL/DML docs non-existent > ---

[jira] [Comment Edited] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156708#comment-16156708 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 11:49 AM: -

[jira] [Commented] (SPARK-20427) Issue with Spark interpreting Oracle datatype NUMBER

[ https://issues.apache.org/jira/browse/SPARK-20427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156829#comment-16156829 ] Krzysztof Sobusiak commented on SPARK-20427: You can have very big and very s

[jira] [Closed] (SPARK-21932) Add test CartesianProduct join case and BroadcastNestedLoop join case in JoinBenchmark

[ https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen closed SPARK-21932. - Resolution: Resolved > Add test CartesianProduct join case and BroadcastNestedLoop join case in > JoinBe

[jira] [Commented] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descrip

[ https://issues.apache.org/jira/browse/SPARK-21943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156808#comment-16156808 ] xianquan commented on SPARK-21943: -- I would like to know why the return of the two json

[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156784#comment-16156784 ] jincheng commented on SPARK-18085: -- thanks. it was ok! > SPIP: Better History Server sc

[jira] [Comment Edited] (SPARK-21942) ix DiskBlockManager crashing when a root local folder has been externally deleted by OS

[ https://issues.apache.org/jira/browse/SPARK-21942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156708#comment-16156708 ] Ruslan Shestopalyuk edited comment on SPARK-21942 at 9/7/17 10:09 AM: -

[jira] [Updated] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descripti

[ https://issues.apache.org/jira/browse/SPARK-21943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21943: -- Priority: Minor (was: Critical) What description do you expect? is there any? > When I use rest Api (

[jira] [Created] (SPARK-21943) When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “descripti

xianquan created SPARK-21943: Summary: When I use rest Api (/ applications / [app-id] / jobs / [job-id]) to view some of the jobs that are running jobs, the returned json information is missing the “description” field. Key: SPARK-219

[jira] [Assigned] (SPARK-7008) An implementation of Factorization Machine (LibFM)

[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7008: --- Assignee: (was: Apache Spark) > An implementation of Factorization Machine (LibFM) >

[jira] [Assigned] (SPARK-7008) An implementation of Factorization Machine (LibFM)

[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7008: --- Assignee: Apache Spark > An implementation of Factorization Machine (LibFM) > ---

  1   2   >