[jira] [Commented] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040321#comment-16040321 ] Liang-Chi Hsieh commented on SPARK-20998: - Can you provide a sample data to repro

[jira] [Commented] (SPARK-20691) Difference between Storage Memory as seen internally and in web UI

[ https://issues.apache.org/jira/browse/SPARK-20691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040294#comment-16040294 ] Maarten Kesselaers commented on SPARK-20691: OK, some components use the func

[jira] [Comment Edited] (SPARK-20691) Difference between Storage Memory as seen internally and in web UI

[ https://issues.apache.org/jira/browse/SPARK-20691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040263#comment-16040263 ] Maarten Kesselaers edited comment on SPARK-20691 at 6/7/17 6:24 AM: ---

[jira] [Commented] (SPARK-20691) Difference between Storage Memory as seen internally and in web UI

[ https://issues.apache.org/jira/browse/SPARK-20691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040263#comment-16040263 ] Maarten Kesselaers commented on SPARK-20691: [~srowen], I would like to work

[jira] [Resolved] (SPARK-20972) rename HintInfo.isBroadcastable to broadcast

[ https://issues.apache.org/jira/browse/SPARK-20972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20972. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18189 [https://githu

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040235#comment-16040235 ] Dayou Zhou commented on SPARK-11966: Hi [~hvanhovell], any examples on how this might

[jira] [Updated] (SPARK-20972) rename HintInfo.isBroadcastable to broadcast

[ https://issues.apache.org/jira/browse/SPARK-20972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-20972: Summary: rename HintInfo.isBroadcastable to broadcast (was: rename HintInfo.isBroadcastable to for

[jira] [Commented] (SPARK-21002) Syntax error regression when creating Hive storage handlers on Spark shell

[ https://issues.apache.org/jira/browse/SPARK-21002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040226#comment-16040226 ] Dayou Zhou commented on SPARK-21002: Hi [~viirya], thanks for pointing to SPARK-19360

[jira] [Commented] (SPARK-19360) Spark 2.X does not support stored by cluase

[ https://issues.apache.org/jira/browse/SPARK-19360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040223#comment-16040223 ] Dayou Zhou commented on SPARK-19360: Same here... Since STORED BY is **essential** f

[jira] [Commented] (SPARK-20997) spark-submit's --driver-cores marked as "YARN-only" but listed under "Spark standalone with cluster deploy mode only"

[ https://issues.apache.org/jira/browse/SPARK-20997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040210#comment-16040210 ] guoxiaolongzte commented on SPARK-20997: Can i fix this jira? Because i found a s

[jira] [Assigned] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamingContext.

[ https://issues.apache.org/jira/browse/SPARK-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20935: Assignee: (was: Apache Spark) > A daemon thread, "BatchedWriteAheadLog Writer", left b

[jira] [Assigned] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamingContext.

[ https://issues.apache.org/jira/browse/SPARK-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20935: Assignee: Apache Spark > A daemon thread, "BatchedWriteAheadLog Writer", left behind after

[jira] [Commented] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamingContext.

[ https://issues.apache.org/jira/browse/SPARK-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040176#comment-16040176 ] Apache Spark commented on SPARK-20935: -- User 'HyukjinKwon' has created a pull reques

[jira] [Comment Edited] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040112#comment-16040112 ] Binzi Cao edited comment on SPARK-20760 at 6/7/17 3:47 AM: --- Hi

[jira] [Updated] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binzi Cao updated SPARK-20760: -- Attachment: Storage in spark 2.1.1.png RDD blocks in spark 2.1.1.png Spark 2.1.1 Test R

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040112#comment-16040112 ] Binzi Cao commented on SPARK-20760: --- Hi David, Thanks very much for the message, I di

[jira] [Resolved] (SPARK-21002) Syntax error regression when creating Hive storage handlers on Spark shell

[ https://issues.apache.org/jira/browse/SPARK-21002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21002. -- Resolution: Duplicate > Syntax error regression when creating Hive storage handlers on Spark sh

[jira] [Commented] (SPARK-21002) Syntax error regression when creating Hive storage handlers on Spark shell

[ https://issues.apache.org/jira/browse/SPARK-21002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040057#comment-16040057 ] Liang-Chi Hsieh commented on SPARK-21002: - This is duplicate to SPARK-19360. > S

[jira] [Commented] (SPARK-21002) Syntax error regression when creating Hive storage handlers on Spark shell

[ https://issues.apache.org/jira/browse/SPARK-21002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040055#comment-16040055 ] Liang-Chi Hsieh commented on SPARK-21002: - Seems that we don't support {{STORED B

[jira] [Comment Edited] (SPARK-20977) NPE in CollectionAccumulator

[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039870#comment-16039870 ] Boris Capitanu edited comment on SPARK-20977 at 6/6/17 11:35 PM: --

[jira] [Commented] (SPARK-20977) NPE in CollectionAccumulator

[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039870#comment-16039870 ] Boris Capitanu commented on SPARK-20977: I am seeing this problem as well. I h

[jira] [Commented] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039862#comment-16039862 ] Liang-Chi Hsieh commented on SPARK-20969: - [~pletelli] I don't find an api doc fo

[jira] [Issue Comment Deleted] (SPARK-20973) insert table fail caused by unable to fetch data definition file from remote hdfs

[ https://issues.apache.org/jira/browse/SPARK-20973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunjian Zhang updated SPARK-20973: -- Comment: was deleted (was: I did check the source code and add a patch to fix the insert issue

[jira] [Updated] (SPARK-20973) insert table fail caused by unable to fetch data definition file from remote hdfs

[ https://issues.apache.org/jira/browse/SPARK-20973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunjian Zhang updated SPARK-20973: -- Attachment: spark-sql-insert.patch > insert table fail caused by unable to fetch data definitio

[jira] [Created] (SPARK-21002) Syntax error regression when creating Hive storage handlers on Spark shell

Dayou Zhou created SPARK-21002: -- Summary: Syntax error regression when creating Hive storage handlers on Spark shell Key: SPARK-21002 URL: https://issues.apache.org/jira/browse/SPARK-21002 Project: Spark

[jira] [Commented] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039762#comment-16039762 ] Dayou Zhou commented on SPARK-19878: Hello, just checking will this be shipped to Spa

[jira] [Commented] (SPARK-20960) make ColumnVector public

[ https://issues.apache.org/jira/browse/SPARK-20960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039648#comment-16039648 ] Wes McKinney commented on SPARK-20960: -- [~cloud_fan] this will be very exciting to h

[jira] [Assigned] (SPARK-20655) In-memory key-value store implementation

[ https://issues.apache.org/jira/browse/SPARK-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20655: Assignee: Apache Spark > In-memory key-value store implementation > --

[jira] [Assigned] (SPARK-20655) In-memory key-value store implementation

[ https://issues.apache.org/jira/browse/SPARK-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20655: Assignee: (was: Apache Spark) > In-memory key-value store implementation > ---

[jira] [Commented] (SPARK-20655) In-memory key-value store implementation

[ https://issues.apache.org/jira/browse/SPARK-20655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039619#comment-16039619 ] Apache Spark commented on SPARK-20655: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-20357) Expose Calendar.getWeekYear() as Spark SQL date function to be consistent with weekofyear()

[ https://issues.apache.org/jira/browse/SPARK-20357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039496#comment-16039496 ] Cam Mach commented on SPARK-20357: -- I can work on this issue. Can someone assign it to m

[jira] [Commented] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039499#comment-16039499 ] Takeshi Yamamuro commented on SPARK-20998: -- How about v2.1? The version has the

[jira] [Resolved] (SPARK-20641) Key-value store abstraction and implementation for storing application data

[ https://issues.apache.org/jira/browse/SPARK-20641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-20641. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 17902 [https://git

[jira] [Commented] (SPARK-20760) Memory Leak of RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-20760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039375#comment-16039375 ] David Lewis commented on SPARK-20760: - I believe this is fixed by this issue: https:

[jira] [Commented] (SPARK-18372) .Hive-staging folders created from Spark hiveContext are not getting cleaned up

[ https://issues.apache.org/jira/browse/SPARK-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039330#comment-16039330 ] Ajay Cherukuri commented on SPARK-18372: I have this issue in Spark 2.0.2 > .Hiv

[jira] [Created] (SPARK-21001) Staging folders from Hive table are not being cleared.

Ajay Cherukuri created SPARK-21001: -- Summary: Staging folders from Hive table are not being cleared. Key: SPARK-21001 URL: https://issues.apache.org/jira/browse/SPARK-21001 Project: Spark Is

[jira] [Assigned] (SPARK-21000) Add labels support to the Spark Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-21000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21000: Assignee: (was: Apache Spark) > Add labels support to the Spark Dispatcher > -

[jira] [Commented] (SPARK-21000) Add labels support to the Spark Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-21000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039308#comment-16039308 ] Apache Spark commented on SPARK-21000: -- User 'mgummelt' has created a pull request f

[jira] [Assigned] (SPARK-21000) Add labels support to the Spark Dispatcher

[ https://issues.apache.org/jira/browse/SPARK-21000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21000: Assignee: Apache Spark > Add labels support to the Spark Dispatcher >

[jira] [Created] (SPARK-21000) Add labels support to the Spark Dispatcher

Michael Gummelt created SPARK-21000: --- Summary: Add labels support to the Spark Dispatcher Key: SPARK-21000 URL: https://issues.apache.org/jira/browse/SPARK-21000 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20926) Exposure to Guava libraries by directly accessing tableRelationCache in SessionCatalog caused failures

[ https://issues.apache.org/jira/browse/SPARK-20926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-20926: --- Fix Version/s: 2.2.1 > Exposure to Guava libraries by directly accessing tableRelationCache i

[jira] [Commented] (SPARK-20926) Exposure to Guava libraries by directly accessing tableRelationCache in SessionCatalog caused failures

[ https://issues.apache.org/jira/browse/SPARK-20926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039249#comment-16039249 ] Marcelo Vanzin commented on SPARK-20926: Turns out I didn't notice the PR was aga

[jira] [Commented] (SPARK-18085) Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16039223#comment-16039223 ] Marcelo Vanzin commented on SPARK-18085: Yes, https://github.com/vanzin/spark/com

[jira] [Issue Comment Deleted] (SPARK-18085) Better History Server scalability for many / large applications

[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-18085: --- Comment: was deleted (was: Your contact with NYSE has changed, please visit https://www.nyse

[jira] [Updated] (SPARK-20712) [SQL] Spark can't read Hive table when column type has length greater than 4000 bytes

[ https://issues.apache.org/jira/browse/SPARK-20712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-20712: --- Affects Version/s: 2.1.2 > [SQL] Spark can't read Hive table when column type has length grea

[jira] [Resolved] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Perrine Letellier resolved SPARK-20969. --- Resolution: Not A Problem > last() aggregate function fails returning the right answe

[jira] [Comment Edited] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038825#comment-16038825 ] Perrine Letellier edited comment on SPARK-20969 at 6/6/17 1:00 PM:

[jira] [Comment Edited] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038825#comment-16038825 ] Perrine Letellier edited comment on SPARK-20969 at 6/6/17 1:00 PM:

[jira] [Comment Edited] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038825#comment-16038825 ] Perrine Letellier edited comment on SPARK-20969 at 6/6/17 12:59 PM: ---

[jira] [Comment Edited] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038825#comment-16038825 ] Perrine Letellier edited comment on SPARK-20969 at 6/6/17 12:59 PM: ---

[jira] [Commented] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038825#comment-16038825 ] Perrine Letellier commented on SPARK-20969: --- [~viirya] Thanks for your answer !

[jira] [Closed] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

[ https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen closed SPARK-20999. - Not A Problem > No failure Stages, no log 'DAGScheduler: failed: Set()' output. > --

[jira] [Resolved] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

[ https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20999. --- Resolution: Not A Problem > No failure Stages, no log 'DAGScheduler: failed: Set()' output. > ---

[jira] [Commented] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

[ https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038793#comment-16038793 ] Sean Owen commented on SPARK-20999: --- As I've already commented, there doesn't seem to b

[jira] [Assigned] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

[ https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20999: Assignee: (was: Apache Spark) > No failure Stages, no log 'DAGScheduler: failed: Set()

[jira] [Commented] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

[ https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038789#comment-16038789 ] Apache Spark commented on SPARK-20999: -- User 'heary-cao' has created a pull request

[jira] [Assigned] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

[ https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20999: Assignee: Apache Spark > No failure Stages, no log 'DAGScheduler: failed: Set()' output. >

[jira] [Created] (SPARK-20999) No failure Stages, no log 'DAGScheduler: failed: Set()' output.

caoxuewen created SPARK-20999: - Summary: No failure Stages, no log 'DAGScheduler: failed: Set()' output. Key: SPARK-20999 URL: https://issues.apache.org/jira/browse/SPARK-20999 Project: Spark Is

[jira] [Updated] (SPARK-13669) Job will always fail in the external shuffle service unavailable situation

[ https://issues.apache.org/jira/browse/SPARK-13669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13669: Description: Currently we are running into an issue with Yarn work preserving enabled + external s

[jira] [Updated] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit updated SPARK-20998: -- Description: I have a hive table : _eagle_edw_batch.DistributionAttributes_, with *Schema*: root |-- distr

[jira] [Updated] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit updated SPARK-20998: -- Description: I have a hive table : _eagle_edw_batch.DistributionAttributes_, with *Schema*: root |-- distr

[jira] [Updated] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit updated SPARK-20998: -- Description: I have a hive table : _eagle_edw_batch.DistributionAttributes_, with schema: root |-- distributi

[jira] [Comment Edited] (SPARK-18791) Stream-Stream Joins

[ https://issues.apache.org/jira/browse/SPARK-18791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038690#comment-16038690 ] xianyao jiang edited comment on SPARK-18791 at 6/6/17 12:15 PM: ---

[jira] [Updated] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit updated SPARK-20998: -- Summary: BroadcastHashJoin producing wrong results (was: BroadcastHashJoin producing different results) > Bro

[jira] [Updated] (SPARK-20998) BroadcastHashJoin producing wrong results

[ https://issues.apache.org/jira/browse/SPARK-20998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit updated SPARK-20998: -- Affects Version/s: (was: 2.0.1) 2.0.0 > BroadcastHashJoin producing wrong results >

[jira] [Created] (SPARK-20998) BroadcastHashJoin producing different results

Mohit created SPARK-20998: - Summary: BroadcastHashJoin producing different results Key: SPARK-20998 URL: https://issues.apache.org/jira/browse/SPARK-20998 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-20969) last() aggregate function fails returning the right answer with ordered windows

[ https://issues.apache.org/jira/browse/SPARK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Perrine Letellier updated SPARK-20969: -- Description: The column on which `orderBy` is performed is considered as another column

[jira] [Comment Edited] (SPARK-18791) Stream-Stream Joins

[ https://issues.apache.org/jira/browse/SPARK-18791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038690#comment-16038690 ] xianyao jiang edited comment on SPARK-18791 at 6/6/17 12:09 PM: ---

[jira] [Commented] (SPARK-18791) Stream-Stream Joins

[ https://issues.apache.org/jira/browse/SPARK-18791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038690#comment-16038690 ] xianyao jiang commented on SPARK-18791: --- We have the draft design for the stream-

[jira] [Commented] (SPARK-20854) extend hint syntax to support any expression, not just identifiers or strings

[ https://issues.apache.org/jira/browse/SPARK-20854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038671#comment-16038671 ] Apache Spark commented on SPARK-20854: -- User 'bogdanrdc' has created a pull request

[jira] [Commented] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038648#comment-16038648 ] lyc commented on SPARK-19878: - See [contributing|https://cwiki.apache.org/confluence/display

[jira] [Updated] (SPARK-20997) spark-submit's --driver-cores marked as "YARN-only" but listed under "Spark standalone with cluster deploy mode only"

[ https://issues.apache.org/jira/browse/SPARK-20997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20997: -- Priority: Trivial (was: Minor) Component/s: Documentation I suppose this should be removed from

[jira] [Created] (SPARK-20997) spark-submit's --driver-cores marked as "YARN-only" but listed under "Spark standalone with cluster deploy mode only"

Jacek Laskowski created SPARK-20997: --- Summary: spark-submit's --driver-cores marked as "YARN-only" but listed under "Spark standalone with cluster deploy mode only" Key: SPARK-20997 URL: https://issues.apache.or

[jira] [Commented] (SPARK-20920) ForkJoinPool pools are leaked when writing hive tables with many partitions

[ https://issues.apache.org/jira/browse/SPARK-20920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038583#comment-16038583 ] Apache Spark commented on SPARK-20920: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-20920) ForkJoinPool pools are leaked when writing hive tables with many partitions

[ https://issues.apache.org/jira/browse/SPARK-20920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20920: Assignee: (was: Apache Spark) > ForkJoinPool pools are leaked when writing hive tables

[jira] [Assigned] (SPARK-20920) ForkJoinPool pools are leaked when writing hive tables with many partitions

[ https://issues.apache.org/jira/browse/SPARK-20920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20920: Assignee: Apache Spark > ForkJoinPool pools are leaked when writing hive tables with many

[jira] [Commented] (SPARK-20935) A daemon thread, "BatchedWriteAheadLog Writer", left behind after terminating StreamingContext.

[ https://issues.apache.org/jira/browse/SPARK-20935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038549#comment-16038549 ] Sean Owen commented on SPARK-20935: --- Sounds OK to me [~hyukjin.kwon] if you're up for i

[jira] [Assigned] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20985: - Assignee: jin xing > Improve KryoSerializerResizableOutputSuite > --

[jira] [Resolved] (SPARK-20985) Improve KryoSerializerResizableOutputSuite

[ https://issues.apache.org/jira/browse/SPARK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20985. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18204 [https://github.co

[jira] [Commented] (SPARK-20914) Javadoc contains code that is invalid

[ https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038518#comment-16038518 ] Apache Spark commented on SPARK-20914: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-20914) Javadoc contains code that is invalid

[ https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20914: Assignee: Apache Spark > Javadoc contains code that is invalid > -

[jira] [Assigned] (SPARK-20914) Javadoc contains code that is invalid

[ https://issues.apache.org/jira/browse/SPARK-20914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20914: Assignee: (was: Apache Spark) > Javadoc contains code that is invalid > --

[jira] [Commented] (SPARK-20162) Reading data from MySQL - Cannot up cast from decimal(30,6) to decimal(38,18)

[ https://issues.apache.org/jira/browse/SPARK-20162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038515#comment-16038515 ] Yuming Wang commented on SPARK-20162: - [~mspehar] How to reproduce it? read a table l

[jira] [Updated] (SPARK-20995) 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

[ https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20995: -- Priority: Trivial (was: Minor) > 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration inst

[jira] [Resolved] (SPARK-20884) Spark' masters will be both standby due to the bug of curator

[ https://issues.apache.org/jira/browse/SPARK-20884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20884. --- Resolution: Won't Fix We can't merge this change, because Curator 2.8 won't work with Curator 2.6 en

[jira] [Commented] (SPARK-20851) Drop spark table failed if a column name is a numeric string

[ https://issues.apache.org/jira/browse/SPARK-20851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038445#comment-16038445 ] Ben P commented on SPARK-20851: --- This issue seems to be handled/prevented in v2.0.1 as 2.0.

[jira] [Resolved] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20943. --- Resolution: Not A Problem If there's no (other) support for a request to change the wording, and no

[jira] [Assigned] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

[ https://issues.apache.org/jira/browse/SPARK-20996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20996: Assignee: Apache Spark > Better handling AM reattempt based on exit code in yarn mode > --

[jira] [Commented] (SPARK-20199) GradientBoostedTreesModel doesn't have featureSubsetStrategy parameter

[ https://issues.apache.org/jira/browse/SPARK-20199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038403#comment-16038403 ] Kedarnath Reddy commented on SPARK-20199: - Please look into this feature , as I n

[jira] [Assigned] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

[ https://issues.apache.org/jira/browse/SPARK-20996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20996: Assignee: (was: Apache Spark) > Better handling AM reattempt based on exit code in yar

[jira] [Commented] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

[ https://issues.apache.org/jira/browse/SPARK-20996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038404#comment-16038404 ] Apache Spark commented on SPARK-20996: -- User 'jerryshao' has created a pull request

[jira] [Resolved] (SPARK-20499) Spark MLlib, GraphX 2.2 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-20499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20499. Resolution: Done > Spark MLlib, GraphX 2.2 QA umbrella > --

[jira] [Resolved] (SPARK-20507) Update MLlib, GraphX websites for 2.2

[ https://issues.apache.org/jira/browse/SPARK-20507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-20507. Resolution: Done Assignee: Nick Pentreath No updates to MLlib project website require

[jira] [Created] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

Saisai Shao created SPARK-20996: --- Summary: Better handling AM reattempt based on exit code in yarn mode Key: SPARK-20996 URL: https://issues.apache.org/jira/browse/SPARK-20996 Project: Spark I

[jira] [Assigned] (SPARK-20995) 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

[ https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20995: Assignee: Apache Spark > 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration

[jira] [Assigned] (SPARK-20995) 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

[ https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20995: Assignee: (was: Apache Spark) > 'Spark-env.sh.template' should add 'YARN_CONF_DIR' con

[jira] [Commented] (SPARK-20995) 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

[ https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16038361#comment-16038361 ] Apache Spark commented on SPARK-20995: -- User 'guoxiaolongzte' has created a pull req

[jira] [Updated] (SPARK-20995) 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

[ https://issues.apache.org/jira/browse/SPARK-20995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20995: --- Description: Ensure that HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory which cont

[jira] [Updated] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

[ https://issues.apache.org/jira/browse/SPARK-20996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-20996: Description: Yarn provides max attempt configuration for applications running on it, application h

[jira] [Created] (SPARK-20995) 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions.

guoxiaolongzte created SPARK-20995: -- Summary: 'Spark-env.sh.template' should add 'YARN_CONF_DIR' configuration instructions. Key: SPARK-20995 URL: https://issues.apache.org/jira/browse/SPARK-20995 Pr

  1   2   >