[jira] [Created] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

Brian Cho created SPARK-17620: - Summary: hive.default.fileformat=orc does not set OrcSerde Key: SPARK-17620 URL: https://issues.apache.org/jira/browse/SPARK-17620 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17610: - Description: We have a problem in our environment, in which the failed stage has not been resubmitted ev

[jira] [Updated] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

[ https://issues.apache.org/jira/browse/SPARK-17619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyanka Garg updated SPARK-17619: -- Target Version/s: (was: 2.2.0) Fix Version/s: (was: 2.2.0) > To add support for pa

[jira] [Commented] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

[ https://issues.apache.org/jira/browse/SPARK-17619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508861#comment-15508861 ] Priyanka Garg commented on SPARK-17619: --- I am working on it. > To add support for

[jira] [Created] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

Priyanka Garg created SPARK-17619: - Summary: To add support for pattern matching in ArrayContains Expression. Key: SPARK-17619 URL: https://issues.apache.org/jira/browse/SPARK-17619 Project: Spark

[jira] [Commented] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508696#comment-15508696 ] Apache Spark commented on SPARK-17502: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-6235) Address various 2G limits

[ https://issues.apache.org/jira/browse/SPARK-6235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508670#comment-15508670 ] Guoqiang Li commented on SPARK-6235: [~rxin] Any comments? > Address various 2G limit

[jira] [Created] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

Graeme Edwards created SPARK-17618: -- Summary: Dataframe except returns incorrect results when combined with coalesce Key: SPARK-17618 URL: https://issues.apache.org/jira/browse/SPARK-17618 Project: S

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508465#comment-15508465 ] Apache Spark commented on SPARK-15698: -- User 'jerryshao' has created a pull request

[jira] [Updated] (SPARK-13331) AES support for over-the-wire encryption

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13331: Summary: AES support for over-the-wire encryption (was: Spark network encryption optimization) >

[jira] [Commented] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508376#comment-15508376 ] Hyukjin Kwon commented on SPARK-17615: -- It seems something went wrong when creating

[jira] [Comment Edited] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508376#comment-15508376 ] Hyukjin Kwon edited comment on SPARK-17615 at 9/21/16 1:36 AM:

[jira] [Commented] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508362#comment-15508362 ] Tao Wang commented on SPARK-17610: -- cc [~rxin] [~andrewor14] > The failed stage caused

[jira] [Commented] (SPARK-13331) Spark network encryption optimization

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508355#comment-15508355 ] Apache Spark commented on SPARK-13331: -- User 'cjjnjust' has created a pull request f

[jira] [Assigned] (SPARK-13331) Spark network encryption optimization

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13331: Assignee: (was: Apache Spark) > Spark network encryption optimization > --

[jira] [Assigned] (SPARK-13331) Spark network encryption optimization

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13331: Assignee: Apache Spark > Spark network encryption optimization > -

[jira] [Resolved] (SPARK-17562) I think a little code is unnecessary to exist in ExternalSorter.spillMemoryIteratorToDisk

[ https://issues.apache.org/jira/browse/SPARK-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17562. Resolution: Not A Problem > I think a little code is unnecessary to exist in > ExternalSorter.spil

[jira] [Updated] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17617: --- Labels: correctness (was: ) > Remainder(%) expression.eval returns incorrect result > --

[jira] [Updated] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17617: --- Target Version/s: 1.6.3, 2.0.1, 2.1.0 > Remainder(%) expression.eval returns incorrect result > -

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508264#comment-15508264 ] Hyukjin Kwon commented on SPARK-17545: -- Fixing JIRA : SPARK-16216 Fixing PR : https:

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508260#comment-15508260 ] Frederick Reiss commented on SPARK-16407: - It looks like there is a general agree

[jira] [Commented] (SPARK-17562) I think a little code is unnecessary to exist in ExternalSorter.spillMemoryIteratorToDisk

[ https://issues.apache.org/jira/browse/SPARK-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508257#comment-15508257 ] Jianfei Wang commented on SPARK-17562: -- that sounds reasonable, thank you Josh Rosen

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508261#comment-15508261 ] Hyukjin Kwon commented on SPARK-17545: -- [~srowen] and [~nbeyer]. Just a gentle remin

[jira] [Assigned] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17617: Assignee: (was: Apache Spark) > Remainder(%) expression.eval returns incorrect result

[jira] [Assigned] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17617: Assignee: Apache Spark > Remainder(%) expression.eval returns incorrect result > -

[jira] [Commented] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508252#comment-15508252 ] Apache Spark commented on SPARK-17617: -- User 'clockfly' has created a pull request f

[jira] [Commented] (SPARK-6072) Enable hash joins for null-safe equality predicates

[ https://issues.apache.org/jira/browse/SPARK-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508247#comment-15508247 ] Chowdary Davuluri commented on SPARK-6072: -- Hello, Has this been fixed as part of

[jira] [Updated] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated SPARK-17617: --- Description: h2.Problem Remainder(%) expression returns incorrect result when using expression.eval

[jira] [Created] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

Sean Zhong created SPARK-17617: -- Summary: Remainder(%) expression.eval returns incorrect result Key: SPARK-17617 URL: https://issues.apache.org/jira/browse/SPARK-17617 Project: Spark Issue Type:

[jira] [Created] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

Egor Pahomov created SPARK-17616: Summary: Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate " Key: SPARK-17616 URL: https://issues.apache.org/jira/browse/SPARK-17616 Pro

[jira] [Created] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

Egor Pahomov created SPARK-17615: Summary: Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate " Key: SPARK-17615 URL: https://issues.apache.org/jira/browse/SPARK-17615 Pro

[jira] [Updated] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17592: --- Fix Version/s: 2.1.0 2.0.1 > SQL: CAST string as INT inconsistent with Hive >

[jira] [Commented] (SPARK-17562) I think a little code is unnecessary to exist in ExternalSorter.spillMemoryIteratorToDisk

[ https://issues.apache.org/jira/browse/SPARK-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508076#comment-15508076 ] Josh Rosen commented on SPARK-17562: I'm not sure that "zero objects written" necessa

[jira] [Commented] (SPARK-17602) PySpark - Performance Optimization Large Size of Broadcast Variable

[ https://issues.apache.org/jira/browse/SPARK-17602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508065#comment-15508065 ] Miao Wang commented on SPARK-17602: --- Does this change also benefit/impact Windows OS?

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508059#comment-15508059 ] Josh Rosen commented on SPARK-17614: You should be able to customize the "table exist

[jira] [Updated] (SPARK-17494) Floor/ceil of decimal returns wrong result if it's in compact format

[ https://issues.apache.org/jira/browse/SPARK-17494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17494: --- Target Version/s: 2.0.1, 2.1.0 > Floor/ceil of decimal returns wrong result if it's in compact format

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507950#comment-15507950 ] Paul Wu commented on SPARK-17614: - Work around: Rebuild the Cassandra JDBC wrapper by mod

[jira] [Commented] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507935#comment-15507935 ] Luciano Resende commented on SPARK-17418: - Thanks [~fielding]. It seems we are

[jira] [Comment Edited] (SPARK-17568) Add spark-submit option for user to override ivy settings used to resolve packages/artifacts

[ https://issues.apache.org/jira/browse/SPARK-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507249#comment-15507249 ] Bryan Cutler edited comment on SPARK-17568 at 9/20/16 10:00 PM: ---

[jira] [Comment Edited] (SPARK-11918) WLS can not resolve some kinds of equation

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021787#comment-15021787 ] Sean Owen edited comment on SPARK-11918 at 9/20/16 9:54 PM: [

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507914#comment-15507914 ] Sean Owen commented on SPARK-11918: --- Copying my comment from the other JIRA - yes we sh

[jira] [Resolved] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17588. --- Resolution: Duplicate Actually, I found a duplicate and will continue there. > java.lang.AssertionEr

[jira] [Commented] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507897#comment-15507897 ] Apache Spark commented on SPARK-17613: -- User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17613: Assignee: Apache Spark > PartitioningAwareFileCatalog.allFiles doesn't handle URI specifie

[jira] [Assigned] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17613: Assignee: (was: Apache Spark) > PartitioningAwareFileCatalog.allFiles doesn't handle U

[jira] [Commented] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507894#comment-15507894 ] Roy T. Fielding commented on SPARK-17418: - "Kinesis related" is not a useful term

[jira] [Updated] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17588: -- Assignee: Sean Owen Labels: (was: newbie) Priority: Minor (was: Major) Compone

[jira] [Reopened] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-17588: --- Ah, OK that makes sense. I can reproduce it. Did you set 0 for the regularization parameter? Setting som

[jira] [Resolved] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17611. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 > YarnShuff

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507787#comment-15507787 ] Felix Cheung commented on SPARK-17608: -- This is in fact problematic - R base support

[jira] [Updated] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17613: - Target Version/s: 2.0.1, 2.1.0 > PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path

[jira] [Closed] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sai pavan kumar chitti closed SPARK-17588. -- Resolution: Fixed > java.lang.AssertionError: assertion failed: lapack.dppsv re

[jira] [Commented] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507737#comment-15507737 ] sai pavan kumar chitti commented on SPARK-17588: we removed abspret_x_abs

[jira] [Created] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

Paul Wu created SPARK-17614: --- Summary: sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support Key: SPARK-17614 URL: https://issues.apache.org/jira/browse/SPARK-17614 P

[jira] [Resolved] (SPARK-16115) Improve output column name for SHOW PARTITIONS command and improve an error message

[ https://issues.apache.org/jira/browse/SPARK-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati resolved SPARK-16115. - Resolution: Resolved Fix Version/s: 2.1.0 > Improve output column name for

[jira] [Commented] (SPARK-16115) Improve output column name for SHOW PARTITIONS command and improve an error message

[ https://issues.apache.org/jira/browse/SPARK-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507726#comment-15507726 ] Sunitha Kambhampati commented on SPARK-16115: - Other pr's for SPARK-16543 and

[jira] [Commented] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507697#comment-15507697 ] Apache Spark commented on SPARK-17612: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17612: Assignee: Apache Spark > Support `DESCRIBE table PARTITION` SQL syntax > -

[jira] [Assigned] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17612: Assignee: (was: Apache Spark) > Support `DESCRIBE table PARTITION` SQL syntax > --

[jira] [Commented] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507695#comment-15507695 ] Apache Spark commented on SPARK-17418: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

Burak Yavuz created SPARK-17613: --- Summary: PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent Key: SPARK-17613 URL: https://issues.apache.org/jira/browse/SPARK-17613 Proje

[jira] [Created] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

Dongjoon Hyun created SPARK-17612: - Summary: Support `DESCRIBE table PARTITION` SQL syntax Key: SPARK-17612 URL: https://issues.apache.org/jira/browse/SPARK-17612 Project: Spark Issue Type: B

[jira] [Resolved] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15698. -- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507440#comment-15507440 ] Yin Huai commented on SPARK-17549: -- I have merged it to revert the original change. > I

[jira] [Commented] (SPARK-17513) StreamExecution should discard unneeded metadata

[ https://issues.apache.org/jira/browse/SPARK-17513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507401#comment-15507401 ] Apache Spark commented on SPARK-17513: -- User 'petermaxlee' has created a pull reques

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507313#comment-15507313 ] Shixiong Zhu commented on SPARK-15698: -- I just merged the PR and sent a backport for

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507257#comment-15507257 ] Miao Wang commented on SPARK-17608: --- http://stackoverflow.com/questions/2053397/long-bi

[jira] [Commented] (SPARK-17568) Add spark-submit option for user to override ivy settings used to resolve packages/artifacts

[ https://issues.apache.org/jira/browse/SPARK-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507249#comment-15507249 ] Bryan Cutler commented on SPARK-17568: -- I agree, in production there are better ways

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507227#comment-15507227 ] Miao Wang commented on SPARK-17608: --- Let me take a look. Thanks! > Long type has incor

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507223#comment-15507223 ] Apache Spark commented on SPARK-15698: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507192#comment-15507192 ] Apache Spark commented on SPARK-17386: -- User 'frreiss' has created a pull request fo

[jira] [Commented] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507185#comment-15507185 ] Apache Spark commented on SPARK-17611: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17611: Assignee: Apache Spark > YarnShuffleServiceSuite swallows exceptions, doesn't really test

[jira] [Assigned] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17611: Assignee: (was: Apache Spark) > YarnShuffleServiceSuite swallows exceptions, doesn't r

[jira] [Updated] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-17611: --- Component/s: Tests > YarnShuffleServiceSuite swallows exceptions, doesn't really test a few t

[jira] [Created] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

Marcelo Vanzin created SPARK-17611: -- Summary: YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things Key: SPARK-17611 URL: https://issues.apache.org/jira/browse/SPARK-17611 Pro

[jira] [Commented] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507146#comment-15507146 ] sai pavan kumar chitti commented on SPARK-17588: @swan owen - any suggest

[jira] [Updated] (SPARK-16757) Set up caller context to HDFS and Yarn

[ https://issues.apache.org/jira/browse/SPARK-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiqing Yang updated SPARK-16757: - Summary: Set up caller context to HDFS and Yarn (was: Set up caller context to HDFS) > Set up c

[jira] [Resolved] (SPARK-16758) Set up caller context to YARN

[ https://issues.apache.org/jira/browse/SPARK-16758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiqing Yang resolved SPARK-16758. -- Resolution: Duplicate The code for this jira has been put into the PR of SPARK-16757. > Set up

[jira] [Resolved] (SPARK-17051) we should use hadoopConf in InsertIntoHiveTable

[ https://issues.apache.org/jira/browse/SPARK-17051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-17051. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request 1

[jira] [Assigned] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17549: Assignee: Apache Spark > InMemoryRelation doesn't scale to large tables >

[jira] [Resolved] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17502. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Multiple Bugs in DDL S

[jira] [Assigned] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17549: Assignee: (was: Apache Spark) > InMemoryRelation doesn't scale to large tables > -

[jira] [Commented] (SPARK-10057) Faill to load class org.slf4j.impl.StaticLoggerBinder

[ https://issues.apache.org/jira/browse/SPARK-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506972#comment-15506972 ] Semet commented on SPARK-10057: --- Hello I confirm we have this issue on Spark 1.6.1 when wr

[jira] [Updated] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17610: - Summary: The failed stage caused by FetchFailed may never be resubmitted (was: The failed stage caused F

[jira] [Reopened] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-17549: Assignee: (was: Marcelo Vanzin) > InMemoryRelation doesn't scale to large tables > --

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506949#comment-15506949 ] Marcelo Vanzin commented on SPARK-17549: Wouldn't hurt. > InMemoryRelation doesn

[jira] [Created] (SPARK-17610) The failed stage caused FetchFailed may never be resubmitted

Tao Wang created SPARK-17610: Summary: The failed stage caused FetchFailed may never be resubmitted Key: SPARK-17610 URL: https://issues.apache.org/jira/browse/SPARK-17610 Project: Spark Issue T

[jira] [Commented] (SPARK-10835) Change Output of NGram to Array(String, True)

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506806#comment-15506806 ] Sean Owen commented on SPARK-10835: --- [~yuhaoyan] just reviving this one because it came

[jira] [Reopened] (SPARK-10835) Change Output of NGram to Array(String, True)

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-10835: --- > Change Output of NGram to Array(String, True) > - > >

[jira] [Updated] (SPARK-17602) PySpark - Performance Optimization Large Size of Broadcast Variable

[ https://issues.apache.org/jira/browse/SPARK-17602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17602: -- Flags: (was: Patch) Affects Version/s: (was: 1.5.2) (wa

[jira] [Resolved] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17381. --- Resolution: Not A Problem As far as I can tell this is answered by spark.sql.ui.retainedExecutions >

[jira] [Resolved] (SPARK-17313) Support spark-shell on cluster mode

[ https://issues.apache.org/jira/browse/SPARK-17313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17313. --- Resolution: Not A Problem I think this is based on the misconception that client mode means running t

[jira] [Commented] (SPARK-17094) provide simplified API for ML pipeline

[ https://issues.apache.org/jira/browse/SPARK-17094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506649#comment-15506649 ] Sean Owen commented on SPARK-17094: --- Sure, consider a pipeline that needs to convert se

[jira] [Resolved] (SPARK-17584) Add test coverage for TaskState and ExecutorState

[ https://issues.apache.org/jira/browse/SPARK-17584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17584. --- Resolution: Won't Fix > Add test coverage for TaskState and ExecutorState > -

[jira] [Resolved] (SPARK-17493) Spark Job hangs while DataFrame writing to HDFS path with parquet mode

[ https://issues.apache.org/jira/browse/SPARK-17493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17493. --- Resolution: Cannot Reproduce > Spark Job hangs while DataFrame writing to HDFS path with parquet mode

[jira] [Assigned] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17609: Assignee: Apache Spark (was: Wenchen Fan) > SessionCatalog.tableExists should not check t

[jira] [Assigned] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17609: Assignee: Wenchen Fan (was: Apache Spark) > SessionCatalog.tableExists should not check t

[jira] [Commented] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15506533#comment-15506533 ] Apache Spark commented on SPARK-17609: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-17609) SessionCatalog.tableExists should not check temp view

Wenchen Fan created SPARK-17609: --- Summary: SessionCatalog.tableExists should not check temp view Key: SPARK-17609 URL: https://issues.apache.org/jira/browse/SPARK-17609 Project: Spark Issue Typ

  1   2   >