[jira] [Assigned] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12102: Assignee: (was: Apache Spark) > Cast a non-nullable struct field to a nullable field d

[jira] [Commented] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042717#comment-15042717 ] Apache Spark commented on SPARK-12102: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-12102) Cast a non-nullable struct field to a nullable field during analysis

[ https://issues.apache.org/jira/browse/SPARK-12102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12102: Assignee: Apache Spark > Cast a non-nullable struct field to a nullable field during analy

[jira] [Commented] (SPARK-12140) Support Streaming UI in HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042681#comment-15042681 ] Jean-Baptiste Onofré commented on SPARK-12140: -- It's just to know if you did

[jira] [Commented] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042618#comment-15042618 ] Yin Huai commented on SPARK-12155: -- We can take a look at task {{136}}. {code} 15/12/05

[jira] [Commented] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042616#comment-15042616 ] Yin Huai commented on SPARK-12155: -- I have some new logs. {code} 15/12/05 02:51:33 INFO

[jira] [Commented] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042612#comment-15042612 ] Apache Spark commented on SPARK-12138: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12138: Assignee: Apache Spark > Escape \u in the generated comments. > --

[jira] [Assigned] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12138: Assignee: (was: Apache Spark) > Escape \u in the generated comments. > ---

[jira] [Commented] (SPARK-12134) Spark Streaming Kinesis: Allow a mechanism to bypass validateRegion

[ https://issues.apache.org/jira/browse/SPARK-12134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042610#comment-15042610 ] Gabor Liptak commented on SPARK-12134: -- Would only checking Amazon against Amazon wo

[jira] [Commented] (SPARK-12149) Executor UI improvement suggestions - Color UI

[ https://issues.apache.org/jira/browse/SPARK-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042605#comment-15042605 ] Apache Spark commented on SPARK-12149: -- User 'ajbozarth' has created a pull request

[jira] [Assigned] (SPARK-12149) Executor UI improvement suggestions - Color UI

[ https://issues.apache.org/jira/browse/SPARK-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12149: Assignee: Apache Spark > Executor UI improvement suggestions - Color UI >

[jira] [Assigned] (SPARK-12149) Executor UI improvement suggestions - Color UI

[ https://issues.apache.org/jira/browse/SPARK-12149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12149: Assignee: (was: Apache Spark) > Executor UI improvement suggestions - Color UI > -

[jira] [Commented] (SPARK-10123) Cannot set "--deploy-mode" in default configuration

[ https://issues.apache.org/jira/browse/SPARK-10123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042598#comment-15042598 ] Saisai Shao commented on SPARK-10123: - Just confirm if it is on your plan, in case du

[jira] [Commented] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042582#comment-15042582 ] Apache Spark commented on SPARK-12155: -- User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12155: Assignee: (was: Apache Spark) > Execution OOM after a relative large dataset cached in

[jira] [Assigned] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

[ https://issues.apache.org/jira/browse/SPARK-12155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12155: Assignee: Apache Spark > Execution OOM after a relative large dataset cached in the cluste

[jira] [Created] (SPARK-12155) Execution OOM after a relative large dataset cached in the cluster.

Yin Huai created SPARK-12155: Summary: Execution OOM after a relative large dataset cached in the cluster. Key: SPARK-12155 URL: https://issues.apache.org/jira/browse/SPARK-12155 Project: Spark

[jira] [Commented] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042541#comment-15042541 ] Xiao Li commented on SPARK-12138: - Sure. Will try it tonight or tomorrow. Thanks! : ) >

[jira] [Commented] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042539#comment-15042539 ] Yin Huai commented on SPARK-12138: -- Yeah. It will be great if you can work on it. To rep

[jira] [Resolved] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah resolved SPARK-11081. Resolution: Not A Problem Ok, I filed SPARK-12154 to track it. > Make spark-core pull in Jersey an

[jira] [Created] (SPARK-12154) Upgrade to Jersey 2

Matt Cheah created SPARK-12154: -- Summary: Upgrade to Jersey 2 Key: SPARK-12154 URL: https://issues.apache.org/jira/browse/SPARK-12154 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042519#comment-15042519 ] Marcelo Vanzin commented on SPARK-11081: Opening a new one or re-purposing this o

[jira] [Commented] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042516#comment-15042516 ] Matt Cheah commented on SPARK-11081: Upgrading to Jersey 2 definitely sounds more rea

[jira] [Commented] (SPARK-11046) Pass schema from R to JVM using JSON format

[ https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042513#comment-15042513 ] Nakul Jindal commented on SPARK-11046: -- Hi, I am trying to look into this. When you

[jira] [Resolved] (SPARK-12084) Fix codes that uses ByteBuffer.array incorrectly

[ https://issues.apache.org/jira/browse/SPARK-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12084. Resolution: Fixed Fix Version/s: 2.0.0 > Fix codes that uses ByteBuffer.array incorr

[jira] [Resolved] (SPARK-12080) Kryo - Support multiple user registrators

[ https://issues.apache.org/jira/browse/SPARK-12080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12080. Resolution: Fixed Assignee: Rotem Fix Version/s: 2.0.0 > Kryo - Support mul

[jira] [Resolved] (SPARK-12142) Can't request executor when container allocator is not ready

[ https://issues.apache.org/jira/browse/SPARK-12142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12142. Resolution: Fixed Assignee: meiyoula Fix Version/s: 2.0.0 > Can't request e

[jira] [Commented] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042492#comment-15042492 ] Xiao Li commented on SPARK-12138: - If nobody takes it, I can make a try. [~yhuai] Could y

[jira] [Updated] (SPARK-12153) Word2Vec uses a fixed length for sentences which is not reasonable for reality, and similarity functions and fields are not accessible

[ https://issues.apache.org/jira/browse/SPARK-12153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YongGang Cao updated SPARK-12153: - Description: sentence boundary matters for sliding window, we shouldn't train model from a windo

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042482#comment-15042482 ] Evan Chen commented on SPARK-10931: --- Hey Joseph, Just wanted to give a status update.

[jira] [Resolved] (SPARK-12112) Upgrade to SBT 0.13.9

[ https://issues.apache.org/jira/browse/SPARK-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12112. - Resolution: Fixed Fix Version/s: 2.0.0 > Upgrade to SBT 0.13.9 > - > >

[jira] [Created] (SPARK-12153) Word2Vec uses a fixed length for sentences which is not reasonable for reality, and similarity functions and fields are not accessible

YongGang Cao created SPARK-12153: Summary: Word2Vec uses a fixed length for sentences which is not reasonable for reality, and similarity functions and fields are not accessible Key: SPARK-12153 URL: https://issue

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042462#comment-15042462 ] Andrew Philpot commented on SPARK-4036: --- Hi, what is the maturity of this code? Are

[jira] [Comment Edited] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042438#comment-15042438 ] Justin Bailey edited comment on SPARK-8118 at 12/4/15 11:48 PM:

[jira] [Commented] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042438#comment-15042438 ] Justin Bailey commented on SPARK-8118: -- Can this issue be re-opened? It's really terr

[jira] [Assigned] (SPARK-12152) Speed up Scalastyle by only running one SBT command instead of four

[ https://issues.apache.org/jira/browse/SPARK-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12152: Assignee: Josh Rosen (was: Apache Spark) > Speed up Scalastyle by only running one SBT co

[jira] [Commented] (SPARK-12152) Speed up Scalastyle by only running one SBT command instead of four

[ https://issues.apache.org/jira/browse/SPARK-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042381#comment-15042381 ] Apache Spark commented on SPARK-12152: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12152) Speed up Scalastyle by only running one SBT command instead of four

[ https://issues.apache.org/jira/browse/SPARK-12152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12152: Assignee: Apache Spark (was: Josh Rosen) > Speed up Scalastyle by only running one SBT co

[jira] [Created] (SPARK-12152) Speed up Scalastyle by only running one SBT command instead of four

Josh Rosen created SPARK-12152: -- Summary: Speed up Scalastyle by only running one SBT command instead of four Key: SPARK-12152 URL: https://issues.apache.org/jira/browse/SPARK-12152 Project: Spark

[jira] [Assigned] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11944: Assignee: (was: Apache Spark) > Python API for mllib.clustering.BisectingKMeans >

[jira] [Assigned] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11944: Assignee: Apache Spark > Python API for mllib.clustering.BisectingKMeans > ---

[jira] [Commented] (SPARK-11944) Python API for mllib.clustering.BisectingKMeans

[ https://issues.apache.org/jira/browse/SPARK-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042339#comment-15042339 ] Apache Spark commented on SPARK-11944: -- User 'holdenk' has created a pull request fo

[jira] [Updated] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

[ https://issues.apache.org/jira/browse/SPARK-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12148: - Component/s: SparkR > SparkR: rename DataFrame to SparkDataFrame > --

[jira] [Created] (SPARK-12151) Improve PySpark MLLib prediction performance when using pickled vectors

holdenk created SPARK-12151: --- Summary: Improve PySpark MLLib prediction performance when using pickled vectors Key: SPARK-12151 URL: https://issues.apache.org/jira/browse/SPARK-12151 Project: Spark

[jira] [Updated] (SPARK-11255) R Test build should run on R 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11255: --- Assignee: shane knapp > R Test build should run on R 3.1.1 > -- > >

[jira] [Commented] (SPARK-11823) HiveThriftBinaryServerSuite tests timing out, leaves hanging processes

[ https://issues.apache.org/jira/browse/SPARK-11823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042260#comment-15042260 ] shane knapp commented on SPARK-11823: - it looks like it's this particular test that's

[jira] [Updated] (SPARK-12138) Escape \u in the generated comments.

[ https://issues.apache.org/jira/browse/SPARK-12138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12138: - Summary: Escape \u in the generated comments. (was: [SPARK-11352][SQL] Escape \u in the generated commen

[jira] [Comment Edited] (SPARK-1832) Executor UI improvement suggestions

[ https://issues.apache.org/jira/browse/SPARK-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041936#comment-15041936 ] Alexander Bozarth edited comment on SPARK-1832 at 12/4/15 8:49 PM: -

[jira] [Assigned] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12150: Assignee: (was: Apache Spark) > numPartitions argument to sqlContext.range() should b

[jira] [Commented] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042194#comment-15042194 ] Apache Spark commented on SPARK-12150: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12150: Assignee: Apache Spark > numPartitions argument to sqlContext.range() should be optional

[jira] [Resolved] (SPARK-12058) Fix KinesisStreamTests in python/pyspark/streaming/tests.py and enable it

[ https://issues.apache.org/jira/browse/SPARK-12058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12058. --- Resolution: Fixed Fix Version/s: 1.6.0 > Fix KinesisStreamTests in python/pyspark/stre

[jira] [Commented] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042156#comment-15042156 ] Xiao Li commented on SPARK-12150: - Yeah, you are right. Will deliver a PR soon. Thanks!

[jira] [Resolved] (SPARK-6990) Add Java linting script

[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6990. --- Resolution: Fixed Fix Version/s: 2.0.0 Fixed by https://github.com/apache/spark/pull/9867 > Ad

[jira] [Commented] (SPARK-12038) Add support for pickle protocol to graphite sink

[ https://issues.apache.org/jira/browse/SPARK-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042124#comment-15042124 ] Apache Spark commented on SPARK-12038: -- User 'alberskib' has created a pull request

[jira] [Assigned] (SPARK-12038) Add support for pickle protocol to graphite sink

[ https://issues.apache.org/jira/browse/SPARK-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12038: Assignee: (was: Apache Spark) > Add support for pickle protocol to graphite sink > ---

[jira] [Assigned] (SPARK-12038) Add support for pickle protocol to graphite sink

[ https://issues.apache.org/jira/browse/SPARK-12038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12038: Assignee: Apache Spark > Add support for pickle protocol to graphite sink > --

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042103#comment-15042103 ] Felix Cheung commented on SPARK-12144: -- +1 [~shivaram] The style {code} read.format

[jira] [Commented] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042048#comment-15042048 ] Andrew Ash commented on SPARK-11081: Agreed, Spark 2.0 is the main opportunity to bum

[jira] [Commented] (SPARK-11081) Make spark-core pull in Jersey and javax.ws.rs dependencies separately for easier overriding

[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042045#comment-15042045 ] Marcelo Vanzin commented on SPARK-11081: BTW, given all the Spark 2.0 talk, if mi

[jira] [Commented] (SPARK-12128) Multiplication on decimals in dataframe returns null

[ https://issues.apache.org/jira/browse/SPARK-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15042041#comment-15042041 ] kevin yu commented on SPARK-12128: -- Hello Philip: I see, yah, seems other DBs could happ

[jira] [Updated] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henri DF updated SPARK-12150: - Component/s: SQL > numPartitions argument to sqlContext.range() should be optional > ---

[jira] [Created] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

Henri DF created SPARK-12150: Summary: numPartitions argument to sqlContext.range() should be optional Key: SPARK-12150 URL: https://issues.apache.org/jira/browse/SPARK-12150 Project: Spark Iss

[jira] [Updated] (SPARK-12150) numPartitions argument to sqlContext.range() should be optional

[ https://issues.apache.org/jira/browse/SPARK-12150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henri DF updated SPARK-12150: - Description: It's a little inconsistent that the first two sqlContext.range() methods don't take a numPa

[jira] [Commented] (SPARK-11314) Add service API and test service for Yarn Cluster schedulers

[ https://issues.apache.org/jira/browse/SPARK-11314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041998#comment-15041998 ] Apache Spark commented on SPARK-11314: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-12128) Multiplication on decimals in dataframe returns null

[ https://issues.apache.org/jira/browse/SPARK-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041986#comment-15041986 ] Philip Dodds commented on SPARK-12128: -- Hey [~kevinyu98], actually I closed the iss

[jira] [Commented] (SPARK-12128) Multiplication on decimals in dataframe returns null

[ https://issues.apache.org/jira/browse/SPARK-12128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041954#comment-15041954 ] kevin yu commented on SPARK-12128: -- Hello Philip: Thanks for reporting this problem, thi

[jira] [Commented] (SPARK-10509) Excessive param boiler plate code

[ https://issues.apache.org/jira/browse/SPARK-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041937#comment-15041937 ] holdenk commented on SPARK-10509: - So I'm thinking a pretty simple option would be just h

[jira] [Commented] (SPARK-1832) Executor UI improvement suggestions

[ https://issues.apache.org/jira/browse/SPARK-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041936#comment-15041936 ] Alexander Bozarth commented on SPARK-1832: -- I've split off a subtask for the Colo

[jira] [Commented] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041899#comment-15041899 ] Yin Huai commented on SPARK-12089: -- [~tyro89] https://github.com/apache/spark/pull/10142

[jira] [Created] (SPARK-12149) Executor UI improvement suggestions - Color UI

Alexander Bozarth created SPARK-12149: - Summary: Executor UI improvement suggestions - Color UI Key: SPARK-12149 URL: https://issues.apache.org/jira/browse/SPARK-12149 Project: Spark Issu

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12089: - Assignee: Nong Li > java.lang.NegativeArraySizeException when growing BufferHolder >

[jira] [Updated] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12089: - Fix Version/s: (was: 2.0.0) > java.lang.NegativeArraySizeException when growing BufferHolder > --

[jira] [Resolved] (SPARK-12089) java.lang.NegativeArraySizeException when growing BufferHolder

[ https://issues.apache.org/jira/browse/SPARK-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12089. Resolution: Fixed Fix Version/s: 1.6.0 2.0.0 Issue resolved by pull reque

[jira] [Created] (SPARK-12148) SparkR: rename DataFrame to SparkDataFrame

Michael Lawrence created SPARK-12148: Summary: SparkR: rename DataFrame to SparkDataFrame Key: SPARK-12148 URL: https://issues.apache.org/jira/browse/SPARK-12148 Project: Spark Issue Type

[jira] [Commented] (SPARK-12140) Support Streaming UI in HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-12140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041820#comment-15041820 ] Marcelo Vanzin commented on SPARK-12140: You don't need to ask permission to work

[jira] [Commented] (SPARK-10123) Cannot set "--deploy-mode" in default configuration

[ https://issues.apache.org/jira/browse/SPARK-10123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041817#comment-15041817 ] Marcelo Vanzin commented on SPARK-10123: Bug is not assigned to anyone, so no nee

[jira] [Commented] (SPARK-12147) Off heap storage and dynamicAllocation operation

[ https://issues.apache.org/jira/browse/SPARK-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041789#comment-15041789 ] Rares Mirica commented on SPARK-12147: -- Yes, I am talking about the executor stoppin

[jira] [Comment Edited] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041742#comment-15041742 ] Jiri Syrovy edited comment on SPARK-8513 at 12/4/15 4:47 PM: -

[jira] [Comment Edited] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041742#comment-15041742 ] Jiri Syrovy edited comment on SPARK-8513 at 12/4/15 4:45 PM: -

[jira] [Commented] (SPARK-8513) _temporary may be left undeleted when a write job committed with FileOutputCommitter fails due to a race condition

[ https://issues.apache.org/jira/browse/SPARK-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041742#comment-15041742 ] Jiri Syrovy commented on SPARK-8513: The same thing happens when writing partitioned f

[jira] [Commented] (SPARK-12147) Off heap storage and dynamicAllocation operation

[ https://issues.apache.org/jira/browse/SPARK-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041740#comment-15041740 ] Sean Owen commented on SPARK-12147: --- To be honest, the priority doesn't matter much at

[jira] [Commented] (SPARK-12147) Off heap storage and dynamicAllocation operation

[ https://issues.apache.org/jira/browse/SPARK-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041683#comment-15041683 ] Rares Mirica commented on SPARK-12147: -- I would also like to object on setting this

[jira] [Commented] (SPARK-12147) Off heap storage and dynamicAllocation operation

[ https://issues.apache.org/jira/browse/SPARK-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041679#comment-15041679 ] Rares Mirica commented on SPARK-12147: -- Sorry, I wasn't specific enough about the us

[jira] [Updated] (SPARK-12147) Off heap storage and dynamicAllocation operation

[ https://issues.apache.org/jira/browse/SPARK-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rares Mirica updated SPARK-12147: - Attachment: spark-defaults.conf > Off heap storage and dynamicAllocation operation >

[jira] [Updated] (SPARK-12147) Off heap storage and dynamicAllocation operation

[ https://issues.apache.org/jira/browse/SPARK-12147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12147: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) (Make the title more specific?)

[jira] [Created] (SPARK-12147) Off heap storage and dynamicAllocation operation

Rares Mirica created SPARK-12147: Summary: Off heap storage and dynamicAllocation operation Key: SPARK-12147 URL: https://issues.apache.org/jira/browse/SPARK-12147 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041623#comment-15041623 ] Sean Owen commented on SPARK-11707: --- [~jlewandowski] any chance you can try this with t

[jira] [Commented] (SPARK-2489) Unsupported parquet datatype optional fixed_len_byte_array

[ https://issues.apache.org/jira/browse/SPARK-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041626#comment-15041626 ] Jorge Sanchez commented on SPARK-2489: -- This functionality would be very helpful. Is

[jira] [Assigned] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12026: Assignee: (was: Apache Spark) > ChiSqTest gets slower and slower over time when number

[jira] [Commented] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041620#comment-15041620 ] Apache Spark commented on SPARK-12026: -- User 'hhbyyh' has created a pull request for

[jira] [Assigned] (SPARK-12026) ChiSqTest gets slower and slower over time when number of features is large

[ https://issues.apache.org/jira/browse/SPARK-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12026: Assignee: Apache Spark > ChiSqTest gets slower and slower over time when number of feature

[jira] [Resolved] (SPARK-7999) Graph complement function in GraphX

[ https://issues.apache.org/jira/browse/SPARK-7999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7999. -- Resolution: Won't Fix > Graph complement function in GraphX > --- > >

[jira] [Resolved] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7893. -- Resolution: Won't Fix > Complex Operators between Graphs > > >

[jira] [Resolved] (SPARK-7894) Graph Union Operator

[ https://issues.apache.org/jira/browse/SPARK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7894. -- Resolution: Won't Fix > Graph Union Operator > > > Key: SPARK-7894

[jira] [Commented] (SPARK-11868) wrong results returned from dataframe create from Rows without consistent schma on pyspark

[ https://issues.apache.org/jira/browse/SPARK-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041497#comment-15041497 ] Yuval Tanny commented on SPARK-11868: - No. I think there should be a decision on the

[jira] [Commented] (SPARK-12137) Spark Streaming State Recovery limitations

[ https://issues.apache.org/jira/browse/SPARK-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041500#comment-15041500 ] Sean Owen commented on SPARK-12137: --- The checkpoint mechanism works for recovering afte

[jira] [Resolved] (SPARK-12122) Recovered streaming context can sometimes run a batch twice

[ https://issues.apache.org/jira/browse/SPARK-12122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-12122. --- Resolution: Fixed Fix Version/s: 1.6.0 > Recovered streaming context can sometimes run

[jira] [Updated] (SPARK-12146) SparkR jsonFile should support multiple input files

[ https://issues.apache.org/jira/browse/SPARK-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12146: Description: This bug is easy to reproduce, jsonFile did not support character vector as arguments

  1   2   >