[jira] [Commented] (SPARK-12059) Standalone Master assertion error

2015-11-30 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033268#comment-15033268 ] Saisai Shao commented on SPARK-12059: - Hi [~andrewor14], when will this be happened?

[jira] [Commented] (SPARK-12046) Visibility and format issues in ScalaDoc/JavaDoc for branch-1.6

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033260#comment-15033260 ] Apache Spark commented on SPARK-12046: -- User 'liancheng' has created a pull request

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033250#comment-15033250 ] Joseph K. Bradley commented on SPARK-11605: --- Those are private APIs. > ML 1.6

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033242#comment-15033242 ] Joseph K. Bradley commented on SPARK-11605: --- There is already a Java-friendly v

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033241#comment-15033241 ] Joseph K. Bradley commented on SPARK-11605: --- There are already Java-friendly ve

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033239#comment-15033239 ] Joseph K. Bradley commented on SPARK-11605: --- We could add Java-friendly version

[jira] [Assigned] (SPARK-12070) PySpark implementation of Slicing operator incorrect

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12070: Assignee: (was: Apache Spark) > PySpark implementation of Slicing operator incorrect >

[jira] [Assigned] (SPARK-12070) PySpark implementation of Slicing operator incorrect

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12070: Assignee: Apache Spark > PySpark implementation of Slicing operator incorrect > --

[jira] [Commented] (SPARK-12070) PySpark implementation of Slicing operator incorrect

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033233#comment-15033233 ] Apache Spark commented on SPARK-12070: -- User 'zjffdu' has created a pull request for

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033230#comment-15033230 ] Joseph K. Bradley commented on SPARK-11605: --- We don't need to worry about Attri

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033228#comment-15033228 ] Joseph K. Bradley commented on SPARK-11605: --- This is a problem we should fix fo

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

2015-11-30 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033229#comment-15033229 ] Miao Wang commented on SPARK-10798: --- These two lines: byte[] data= Kryo.serialize(List

[jira] [Comment Edited] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033227#comment-15033227 ] Felix Cheung edited comment on SPARK-12071 at 12/1/15 7:07 AM:

[jira] [Commented] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033227#comment-15033227 ] Felix Cheung commented on SPARK-12071: -- See PR https://github.com/apache/spark/comm

[jira] [Created] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

2015-11-30 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-12071: Summary: Programming guide should explain NULL in JVM translate to NA in R Key: SPARK-12071 URL: https://issues.apache.org/jira/browse/SPARK-12071 Project: Spark

[jira] [Commented] (SPARK-12070) PySpark implementation of Slicing operator incorrect

2015-11-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033218#comment-15033218 ] Jeff Zhang commented on SPARK-12070: The root cause is that when using syntax like th

[jira] [Comment Edited] (SPARK-12070) PySpark implementation of Slicing operator incorrect

2015-11-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033218#comment-15033218 ] Jeff Zhang edited comment on SPARK-12070 at 12/1/15 6:59 AM: -

[jira] [Created] (SPARK-12070) PySpark implementation of Slicing operator incorrect

2015-11-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-12070: -- Summary: PySpark implementation of Slicing operator incorrect Key: SPARK-12070 URL: https://issues.apache.org/jira/browse/SPARK-12070 Project: Spark Issue Type:

[jira] [Commented] (SPARK-11605) ML 1.6 QA: API: Java compatibility, docs

2015-11-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033213#comment-15033213 ] Joseph K. Bradley commented on SPARK-11605: --- private[ml] functions can be ignor

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033209#comment-15033209 ] Apache Spark commented on SPARK-11206: -- User 'carsonwang' has created a pull request

[jira] [Commented] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

2015-11-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033187#comment-15033187 ] Reynold Xin commented on SPARK-12032: - [~marmbrus] do you mean the selinger algo? >

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12031: - Priority: Critical (was: Major) > Integer overflow when do sampling. > -

[jira] [Updated] (SPARK-6280) Remove Akka systemName from Spark

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6280: Target Version/s: (was: 1.6.0) > Remove Akka systemName from Spark > -

[jira] [Created] (SPARK-12069) Documentation update for Datasets

2015-11-30 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-12069: Summary: Documentation update for Datasets Key: SPARK-12069 URL: https://issues.apache.org/jira/browse/SPARK-12069 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-12069) Documentation update for Datasets

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12069: Assignee: Apache Spark (was: Michael Armbrust) > Documentation update for Datasets >

[jira] [Assigned] (SPARK-12069) Documentation update for Datasets

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12069: Assignee: Michael Armbrust (was: Apache Spark) > Documentation update for Datasets >

[jira] [Commented] (SPARK-12069) Documentation update for Datasets

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033183#comment-15033183 ] Apache Spark commented on SPARK-12069: -- User 'marmbrus' has created a pull request f

[jira] [Updated] (SPARK-11954) Encoder for JavaBeans / POJOs

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11954: - Assignee: Wenchen Fan > Encoder for JavaBeans / POJOs > - > >

[jira] [Assigned] (SPARK-12068) use a single column in Dataset.groupBy and count will fail

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12068: Assignee: (was: Apache Spark) > use a single column in Dataset.groupBy and count will

[jira] [Commented] (SPARK-12068) use a single column in Dataset.groupBy and count will fail

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033175#comment-15033175 ] Apache Spark commented on SPARK-12068: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-12068) use a single column in Dataset.groupBy and count will fail

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12068: Assignee: Apache Spark > use a single column in Dataset.groupBy and count will fail >

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-11-30 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033172#comment-15033172 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Hi Phil, it's on my bucket.

[jira] [Created] (SPARK-12068) use a single column in Dataset.groupBy and count will fail

2015-11-30 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12068: --- Summary: use a single column in Dataset.groupBy and count will fail Key: SPARK-12068 URL: https://issues.apache.org/jira/browse/SPARK-12068 Project: Spark Issu

[jira] [Commented] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033124#comment-15033124 ] Michael Armbrust commented on SPARK-12010: -- Thanks for working on this, but we'v

[jira] [Updated] (SPARK-12010) Spark JDBC requires support for column-name-free INSERT syntax

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12010: - Target Version/s: (was: 1.6.0) > Spark JDBC requires support for column-name-free INSER

[jira] [Resolved] (SPARK-12017) Java Doc Publishing Broken

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12017. -- Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 1.6.0 > Java Doc

[jira] [Commented] (SPARK-12017) Java Doc Publishing Broken

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033119#comment-15033119 ] Michael Armbrust commented on SPARK-12017: -- Fixed in https://github.com/apache/s

[jira] [Updated] (SPARK-11796) Docker JDBC integration tests fail in Maven build due to dependency issue

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11796: - Component/s: Tests > Docker JDBC integration tests fail in Maven build due to dependency

[jira] [Updated] (SPARK-11601) ML 1.6 QA: API: Binary incompatible changes

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11601: - Component/s: Documentation > ML 1.6 QA: API: Binary incompatible changes > --

[jira] [Updated] (SPARK-11607) Update MLlib website for 1.6

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11607: - Component/s: Documentation > Update MLlib website for 1.6 >

[jira] [Updated] (SPARK-11603) ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11603: - Component/s: Documentation > ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed au

[jira] [Updated] (SPARK-11315) Add YARN extension service to publish Spark events to YARN timeline service

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11315: - Target Version/s: (was: 1.6.0) > Add YARN extension service to publish Spark events to

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11600: - Component/s: Documentation > Spark MLlib 1.6 QA umbrella > --- >

[jira] [Commented] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033103#comment-15033103 ] Michael Armbrust commented on SPARK-8414: - Still planning to do this for 1.6? > E

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7348: Target Version/s: (was: 1.6.0) > DAG visualization: add links to RDD page > --

[jira] [Updated] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11985: - Component/s: Documentation > Update Spark Streaming - Kinesis Library Documentation regar

[jira] [Updated] (SPARK-6518) Add example code and user guide for bisecting k-means

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6518: Component/s: Documentation > Add example code and user guide for bisecting k-means > ---

[jira] [Updated] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12060: - Priority: Critical (was: Major) > Avoid memory copy in JavaSerializerInstance.serialize

[jira] [Updated] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8966: Target Version/s: (was: 1.6.0) > Design a mechanism to ensure that temporary files created

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12031: - Description: In my case, some partitions contain too much items. When do range partition,

[jira] [Commented] (SPARK-7729) Executor which has been killed should also be displayed on Executors Tab.

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033095#comment-15033095 ] Apache Spark commented on SPARK-7729: - User 'lianhuiwang' has created a pull request f

[jira] [Updated] (SPARK-11966) Spark API for UDTFs

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11966: - Target Version/s: 1.7.0 > Spark API for UDTFs > --- > > K

[jira] [Resolved] (SPARK-12018) Refactor common subexpression elimination code

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12018. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10009 [htt

[jira] [Assigned] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

2015-11-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12032: -- Assignee: Davies Liu > Filter can't be pushed down to correct Join because of bad order of Joi

[jira] [Assigned] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10647: Assignee: Apache Spark (was: Timothy Chen) > Mesos HA mode misuses spark.deploy.zookeeper

[jira] [Commented] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033076#comment-15033076 ] Apache Spark commented on SPARK-10647: -- User 'tnachen' has created a pull request fo

[jira] [Assigned] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10647: Assignee: Timothy Chen (was: Apache Spark) > Mesos HA mode misuses spark.deploy.zookeeper

[jira] [Resolved] (SPARK-12064) Make the SqlParser as trait for better integrated with extensions

2015-11-30 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao resolved SPARK-12064. --- Resolution: Won't Fix DBX has plan to remove the SqlParser in 2.0. > Make the SqlParser as trait for

[jira] [Commented] (SPARK-6521) Bypass network shuffle read if both endpoints are local

2015-11-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033016#comment-15033016 ] Takeshi Yamamuro commented on SPARK-6521: - Performance of the current Spark heavil

[jira] [Updated] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-11-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12067: Description: * SPARK-11947 has deprecated DataFrame.isNaN, DataFrame.isNull and replaced by DataFr

[jira] [Assigned] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12067: Assignee: (was: Apache Spark) > Fix usage of isnan, isnull, isnotnull of Column and Da

[jira] [Assigned] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12067: Assignee: Apache Spark > Fix usage of isnan, isnull, isnotnull of Column and DataFrame > -

[jira] [Commented] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033013#comment-15033013 ] Apache Spark commented on SPARK-12067: -- User 'yanboliang' has created a pull request

[jira] [Created] (SPARK-12067) Fix usage of isnan, isnull, isnotnull of Column and DataFrame

2015-11-30 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12067: --- Summary: Fix usage of isnan, isnull, isnotnull of Column and DataFrame Key: SPARK-12067 URL: https://issues.apache.org/jira/browse/SPARK-12067 Project: Spark

[jira] [Created] (SPARK-12066) spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join

2015-11-30 Thread Ricky Yang (JIRA)
Ricky Yang created SPARK-12066: -- Summary: spark sql throw java.lang.ArrayIndexOutOfBoundsException when use table.* with join Key: SPARK-12066 URL: https://issues.apache.org/jira/browse/SPARK-12066 Pro

[jira] [Assigned] (SPARK-12065) Upgrade Tachyon dependency to 0.8.2

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12065: Assignee: Josh Rosen (was: Apache Spark) > Upgrade Tachyon dependency to 0.8.2 >

[jira] [Commented] (SPARK-12065) Upgrade Tachyon dependency to 0.8.2

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032993#comment-15032993 ] Apache Spark commented on SPARK-12065: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12065) Upgrade Tachyon dependency to 0.8.2

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12065: Assignee: Apache Spark (was: Josh Rosen) > Upgrade Tachyon dependency to 0.8.2 >

[jira] [Updated] (SPARK-12065) Upgrade Tachyon dependency to 0.8.2

2015-11-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12065: --- Issue Type: Improvement (was: Bug) > Upgrade Tachyon dependency to 0.8.2 > -

[jira] [Created] (SPARK-12065) Upgrade Tachyon dependency to 0.8.2

2015-11-30 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-12065: -- Summary: Upgrade Tachyon dependency to 0.8.2 Key: SPARK-12065 URL: https://issues.apache.org/jira/browse/SPARK-12065 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Henri DF (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032960#comment-15032960 ] Henri DF commented on SPARK-11941: -- I wasn't trying to serialize to/from using the Spark

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2015-11-30 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032952#comment-15032952 ] Jeff Zhang commented on SPARK-11940: Thanks [~yanboliang] I will work on it. > Pyth

[jira] [Commented] (SPARK-11940) Python API for ml.clustering.LDA

2015-11-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032948#comment-15032948 ] Yanbo Liang commented on SPARK-11940: - [~zjffdu] I'm not working on this, you can ta

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032946#comment-15032946 ] Michael Armbrust commented on SPARK-11941: -- Sorry, maybe I'm misunderstanding.

[jira] [Comment Edited] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032939#comment-15032939 ] Xiao Li edited comment on SPARK-12030 at 12/1/15 2:16 AM: -- Let m

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032939#comment-15032939 ] Xiao Li commented on SPARK-12030: - Let me post a simple case that can trigger the data co

[jira] [Comment Edited] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Henri DF (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032931#comment-15032931 ] Henri DF edited comment on SPARK-11941 at 12/1/15 2:14 AM: --- I t

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Henri DF (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032931#comment-15032931 ] Henri DF commented on SPARK-11941: -- I think "might be nicer if it was flat' is a bit of

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032927#comment-15032927 ] Yin Huai commented on SPARK-12030: -- [~smilegator] Can you post the case that triggers th

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032925#comment-15032925 ] Michael Armbrust commented on SPARK-11966: -- Ah, I was proposing the DataFrame fu

[jira] [Updated] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12032: - Issue Type: Improvement (was: Bug) > Filter can't be pushed down to correct Join because

[jira] [Commented] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032921#comment-15032921 ] Michael Armbrust commented on SPARK-11873: -- What about with Spark 1.6? > Regres

[jira] [Comment Edited] (SPARK-11966) Spark API for UDTFs

2015-11-30 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032906#comment-15032906 ] Jaka Jancar edited comment on SPARK-11966 at 12/1/15 1:59 AM: -

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2015-11-30 Thread Jaka Jancar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032906#comment-15032906 ] Jaka Jancar commented on SPARK-11966: - Not sure I understand. I would like to do {{SE

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Issue Type: Improvement (was: Bug) > JSON representation of nested StructTypes could be

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032899#comment-15032899 ] Michael Armbrust commented on SPARK-11941: -- /cc [~lian cheng] > JSON represent

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032902#comment-15032902 ] Xiao Li commented on SPARK-12030: - I already excluded Exchange and Partitioning. It shoul

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Summary: JSON representation of nested StructTypes could be more uniform (was: JSON repr

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes is incorrect

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032889#comment-15032889 ] Michael Armbrust commented on SPARK-11941: -- While I can appreciate that this mig

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032887#comment-15032887 ] Xiao Li commented on SPARK-12030: - [SPARK-7542][SQL] Support off-heap index/sort buffer h

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

2015-11-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032877#comment-15032877 ] Michael Armbrust commented on SPARK-11966: -- Have you seen [explode|https://gith

[jira] [Resolved] (SPARK-12049) User JVM shutdown hook can cause deadlock at shutdown

2015-11-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-12049. Resolution: Fixed Fix Version/s: 1.6.0 1.5.3 > User JVM shutdown

[jira] [Commented] (SPARK-12000) `sbt publishLocal` hits a Scala compiler bug caused by `Since` annotation

2015-11-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032863#comment-15032863 ] Josh Rosen commented on SPARK-12000: Here's the full stacktrace of the compiler crash

[jira] [Commented] (SPARK-12030) Incorrect results when aggregate joined data

2015-11-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032857#comment-15032857 ] Davies Liu commented on SPARK-12030: [~smilegator] Could you post the related PRs her

[jira] [Resolved] (SPARK-12007) Network library's RPC layer requires a lot of copying

2015-11-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12007. --- Resolution: Fixed Fix Version/s: 1.6.0 > Network library's RPC layer requires a lot of copying

[jira] [Resolved] (SPARK-12037) Executors use heartbeatReceiverRef to report heartbeats and task metrics that might not be initialized and leads to NullPointerException

2015-11-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12037. --- Resolution: Fixed Assignee: Nan Zhu Fix Version/s: 1.6.0 Target Version/s

[jira] [Resolved] (SPARK-12035) Add more debug information in include_example tag of Jekyll

2015-11-30 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12035. --- Resolution: Fixed Assignee: Xusen Yin Fix Version/s: 1.6.0 Target Version

[jira] [Assigned] (SPARK-12064) Make the SqlParser as trait for better integrated with extensions

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12064: Assignee: Apache Spark > Make the SqlParser as trait for better integrated with extensions

[jira] [Assigned] (SPARK-12064) Make the SqlParser as trait for better integrated with extensions

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12064: Assignee: (was: Apache Spark) > Make the SqlParser as trait for better integrated with

[jira] [Commented] (SPARK-12064) Make the SqlParser as trait for better integrated with extensions

2015-11-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032842#comment-15032842 ] Apache Spark commented on SPARK-12064: -- User 'chenghao-intel' has created a pull req

  1   2   3   >