[jira] [Resolved] (SPARK-10876) display total application time in spark history UI

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10876. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9059 [https://github.com

[jira] [Updated] (SPARK-10876) display total application time in spark history UI

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10876: -- Priority: Minor (was: Major) > display total application time in spark history UI > --

[jira] [Resolved] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8332. -- Resolution: Not A Problem > NoSuchMethodError: > com.fasterxml.jackson.module.scala.deser.BigDecimalDes

[jira] [Commented] (SPARK-11200) NettyRpcEnv endless message "cannot send ${message} because RpcEnv is closed"

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964729#comment-14964729 ] Sean Owen commented on SPARK-11200: --- I have never seen this message or heard reports of

[jira] [Resolved] (SPARK-11110) Scala 2.11 build fails due to compiler errors

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-0. --- Resolution: Fixed Fix Version/s: 1.6.0 Should be resolved by https://github.com/apache/spark/p

[jira] [Closed] (SPARK-10045) Add support for DataFrameStatFunctions in SparkR

2015-10-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-10045. --- Resolution: Fixed all sub-tasks are finished. > Add support for DataFrameStatFunctions in SparkR > -

[jira] [Commented] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964762#comment-14964762 ] Sean Owen commented on SPARK-11016: --- Yeah that's a good start. It's bridging Kryo with

[jira] [Updated] (SPARK-11179) Push filters through aggregate if filters are subset of 'group by' expressions

2015-10-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11179: Target Version/s: 1.6.0 > Push filters through aggregate if filters are subset of 'group by' expres

[jira] [Updated] (SPARK-10709) When loading a json dataset as a data frame, if the input path is wrong, the error message is very confusing

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10709: -- Target Version/s: (was: 1.6.0) Priority: Minor (was: Major) Issue Type: Improve

[jira] [Created] (SPARK-11204) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11204: -- Summary: Delegate to scala DataFrame API rather than print in python Key: SPARK-11204 URL: https://issues.apache.org/jira/browse/SPARK-11204 Project: Spark Issu

[jira] [Created] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-11205: -- Summary: Delegate to scala DataFrame API rather than print in python Key: SPARK-11205 URL: https://issues.apache.org/jira/browse/SPARK-11205 Project: Spark Issu

[jira] [Updated] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11205: --- Description: When I use DataFrame#explain(), I found the output is a little different from scala API

[jira] [Reopened] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-20 Thread yindu_asan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yindu_asan reopened SPARK-11166: The cause of the isse is not only resource not enough 1. jar error . eg : if build spark , add -P

[jira] [Created] (SPARK-11206) Support SQL UI on the history server

2015-10-20 Thread Carson Wang (JIRA)
Carson Wang created SPARK-11206: --- Summary: Support SQL UI on the history server Key: SPARK-11206 URL: https://issues.apache.org/jira/browse/SPARK-11206 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964821#comment-14964821 ] Jeff Zhang commented on SPARK-11205: Will create PR soon. > Delegate to scala DataF

[jira] [Assigned] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11205: Assignee: Apache Spark > Delegate to scala DataFrame API rather than print in python > ---

[jira] [Assigned] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11205: Assignee: (was: Apache Spark) > Delegate to scala DataFrame API rather than print in p

[jira] [Commented] (SPARK-11205) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964840#comment-14964840 ] Apache Spark commented on SPARK-11205: -- User 'zjffdu' has created a pull request for

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-10-20 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964841#comment-14964841 ] Carson Wang commented on SPARK-11206: - I am working on this. I plan to add an onOther

[jira] [Closed] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-11166. - Resolution: Invalid > HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough > resource.

[jira] [Commented] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964850#comment-14964850 ] Sean Owen commented on SPARK-11166: --- [~673310629] please do not reopen issues if it has

[jira] [Commented] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-20 Thread yindu_asan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964857#comment-14964857 ] yindu_asan commented on SPARK-11166: thinks @Marcelo Vanzin @Sean Owen sorry!!!

[jira] [Created] (SPARK-11207) Add test cases for normal LinearRegression solver as followup.

2015-10-20 Thread Kai Sasaki (JIRA)
Kai Sasaki created SPARK-11207: -- Summary: Add test cases for normal LinearRegression solver as followup. Key: SPARK-11207 URL: https://issues.apache.org/jira/browse/SPARK-11207 Project: Spark I

[jira] [Updated] (SPARK-11207) Add test cases for solver selection of LinearRegression as followup.

2015-10-20 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated SPARK-11207: --- Summary: Add test cases for solver selection of LinearRegression as followup. (was: Add test cases f

[jira] [Created] (SPARK-11208) Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config

2015-10-20 Thread Artem Aliev (JIRA)
Artem Aliev created SPARK-11208: --- Summary: Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config Key: SPARK-11208 URL: https://issues.apache.org/jira/browse/SPARK-11208 Project:

[jira] [Commented] (SPARK-4368) Ceph integration?

2015-10-20 Thread Serge Smertin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964970#comment-14964970 ] Serge Smertin commented on SPARK-4368: -- here you go - Hadoop Filesystem implementatio

[jira] [Commented] (SPARK-4368) Ceph integration?

2015-10-20 Thread Serge Smertin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964972#comment-14964972 ] Serge Smertin commented on SPARK-4368: -- if it's decided to be hosted outside of proje

[jira] [Assigned] (SPARK-11208) Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11208: Assignee: Apache Spark > Filter out 'hive.metastore.rawstore.impl' from executionHive temp

[jira] [Commented] (SPARK-11208) Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964974#comment-14964974 ] Apache Spark commented on SPARK-11208: -- User 'artem-aliev' has created a pull reques

[jira] [Assigned] (SPARK-11208) Filter out 'hive.metastore.rawstore.impl' from executionHive temporary config

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11208: Assignee: (was: Apache Spark) > Filter out 'hive.metastore.rawstore.impl' from executi

[jira] [Assigned] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10971: Assignee: Apache Spark > sparkR: RRunner should allow setting path to Rscript > --

[jira] [Assigned] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10971: Assignee: (was: Apache Spark) > sparkR: RRunner should allow setting path to Rscript >

[jira] [Updated] (SPARK-11182) HDFS Delegation Token will be expired when calling "UserGroupInformation.getCurrentUser.addCredentials" in HA mode

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated SPARK-11182: --- Affects Version/s: 1.5.1 > HDFS Delegation Token will be expired when calling > "UserGroupIn

[jira] [Commented] (SPARK-10971) sparkR: RRunner should allow setting path to Rscript

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964983#comment-14964983 ] Apache Spark commented on SPARK-10971: -- User 'sun-rui' has created a pull request fo

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2015-10-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964990#comment-14964990 ] Sun Rui commented on SPARK-10043: - Break this issue down to 2 sub-issues. > Add window f

[jira] [Created] (SPARK-11209) Add window functions into SparkR [step 1]

2015-10-20 Thread Sun Rui (JIRA)
Sun Rui created SPARK-11209: --- Summary: Add window functions into SparkR [step 1] Key: SPARK-11209 URL: https://issues.apache.org/jira/browse/SPARK-11209 Project: Spark Issue Type: Bug Com

[jira] [Created] (SPARK-11210) Add window functions into SparkR [step 2]

2015-10-20 Thread Sun Rui (JIRA)
Sun Rui created SPARK-11210: --- Summary: Add window functions into SparkR [step 2] Key: SPARK-11210 URL: https://issues.apache.org/jira/browse/SPARK-11210 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-4368) Ceph integration?

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964994#comment-14964994 ] Steve Loughran commented on SPARK-4368: --- Looking at the ceph code, the strategy is

[jira] [Commented] (SPARK-11209) Add window functions into SparkR [step 1]

2015-10-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964995#comment-14964995 ] Sun Rui commented on SPARK-11209: - I am working on this. > Add window functions into Spa

[jira] [Commented] (SPARK-11206) Support SQL UI on the history server

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964997#comment-14964997 ] Steve Loughran commented on SPARK-11206: There's another strategy which would hav

[jira] [Commented] (SPARK-11166) HIVE ON SPARK : yarn-cluster mode , if memory is busy,have no enough resource. app wil failed

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964998#comment-14964998 ] Steve Loughran commented on SPARK-11166: see also http://wiki.apache.org/hadoop/I

[jira] [Commented] (SPARK-6527) sc.binaryFiles can not access files on s3

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965006#comment-14965006 ] Steve Loughran commented on SPARK-6527: --- try using s3a instead of S3n (ideally, hado

[jira] [Commented] (SPARK-11177) sc.wholeTextFiles throws ArrayIndexOutOfBoundsException when S3 file has zero bytes

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965007#comment-14965007 ] Steve Loughran commented on SPARK-11177: 0-byte files are a troublespot in object

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965016#comment-14965016 ] Steve Loughran commented on SPARK-11128: Which Hadoop version is this? This JIRA

[jira] [Updated] (SPARK-11119) cleanup unsafe array and map

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9: -- Assignee: Wenchen Fan > cleanup unsafe array and map > > >

[jira] [Updated] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11190: -- Target Version/s: (was: 1.5.1) Fix Version/s: (was: 1.5.2) Component/s: SparkR [~

[jira] [Commented] (SPARK-4368) Ceph integration?

2015-10-20 Thread Serge Smertin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965026#comment-14965026 ] Serge Smertin commented on SPARK-4368: -- Thank you Steve for bunch of details > Ceph

[jira] [Created] (SPARK-11211) Kafka - offsetOutOfRange forces to largest

2015-10-20 Thread Daniel Strassler (JIRA)
Daniel Strassler created SPARK-11211: Summary: Kafka - offsetOutOfRange forces to largest Key: SPARK-11211 URL: https://issues.apache.org/jira/browse/SPARK-11211 Project: Spark Issue Type

[jira] [Commented] (SPARK-11195) Exception thrown on executor throws ClassNotFound on driver

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965044#comment-14965044 ] Sean Owen commented on SPARK-11195: --- What is in your assembly jar? I assume you're sure

[jira] [Updated] (SPARK-11195) Exception thrown on executor throws ClassNotFound on driver

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11195: -- Component/s: Spark Core > Exception thrown on executor throws ClassNotFound on driver > ---

[jira] [Updated] (SPARK-11192) Spark sql seems to leak org.apache.spark.sql.execution.ui.SQLTaskMetrics objects over time

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11192: -- Target Version/s: (was: 1.5.1) [~blivingston] don't set Target; it can't target a released version an

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965094#comment-14965094 ] Jean-Baptiste Onofré commented on SPARK-11193: -- Unfortunately, my amazon aws

[jira] [Assigned] (SPARK-11207) Add test cases for solver selection of LinearRegression as followup.

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11207: Assignee: Apache Spark > Add test cases for solver selection of LinearRegression as follow

[jira] [Commented] (SPARK-11207) Add test cases for solver selection of LinearRegression as followup.

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965117#comment-14965117 ] Apache Spark commented on SPARK-11207: -- User 'Lewuathe' has created a pull request f

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965118#comment-14965118 ] Jean-Baptiste Onofré commented on SPARK-11193: -- To thread safe, the HashMap

[jira] [Assigned] (SPARK-11207) Add test cases for solver selection of LinearRegression as followup.

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11207: Assignee: (was: Apache Spark) > Add test cases for solver selection of LinearRegressio

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965125#comment-14965125 ] Jean-Baptiste Onofré commented on SPARK-11193: -- By the way, with spark 1.4.x

[jira] [Reopened] (SPARK-11173) Cannot save data via MSSQL JDBC

2015-10-20 Thread Gianluca Salvo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianluca Salvo reopened SPARK-11173: Hi, I suppose I've found the problem: I downloaded the source code and followed the stack trac

[jira] [Created] (SPARK-11212) Make RDD's preferred locations support the executor location and fix ReceiverTracker for multiple executors in a host

2015-10-20 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11212: Summary: Make RDD's preferred locations support the executor location and fix ReceiverTracker for multiple executors in a host Key: SPARK-11212 URL: https://issues.apache.org/ji

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965133#comment-14965133 ] Jean-Baptiste Onofré commented on SPARK-11193: -- I guess you used Scala 2.10.

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965133#comment-14965133 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/20/15 1:58 PM: ---

[jira] [Commented] (SPARK-11212) Make RDD's preferred locations support the executor location and fix ReceiverTracker for multiple executors in a host

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965136#comment-14965136 ] Apache Spark commented on SPARK-11212: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11212) Make RDD's preferred locations support the executor location and fix ReceiverTracker for multiple executors in a host

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11212: Assignee: (was: Apache Spark) > Make RDD's preferred locations support the executor lo

[jira] [Assigned] (SPARK-11212) Make RDD's preferred locations support the executor location and fix ReceiverTracker for multiple executors in a host

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11212: Assignee: Apache Spark > Make RDD's preferred locations support the executor location and

[jira] [Created] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-20 Thread Ankit (JIRA)
Ankit created SPARK-11213: - Summary: Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4 Key: SPARK-11213 URL: https://issues.apache.org/jira/browse/SPARK-11213 Project: Spark Is

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965210#comment-14965210 ] Jean-Baptiste Onofré commented on SPARK-11193: -- It looks to work fine to me:

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965210#comment-14965210 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/20/15 2:50 PM: ---

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965210#comment-14965210 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 10/20/15 2:53 PM: ---

[jira] [Created] (SPARK-11214) Join with Unicode-String results wrong empty

2015-10-20 Thread Hans Fischer (JIRA)
Hans Fischer created SPARK-11214: Summary: Join with Unicode-String results wrong empty Key: SPARK-11214 URL: https://issues.apache.org/jira/browse/SPARK-11214 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965230#comment-14965230 ] Apache Spark commented on SPARK-1537: - User 'steveloughran' has created a pull request

[jira] [Closed] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-11213. - > Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4 > -

[jira] [Updated] (SPARK-9735) Auto infer partition schema of HadoopFsRelation should should respected the user specified one

2015-10-20 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Hao updated SPARK-9735: - Description: This code is copied from the hadoopFsRelationSuite.scala {code} partitionedTestDF = (for {

[jira] [Created] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11215: --- Summary: Add multiple columns support to StringIndexer Key: SPARK-11215 URL: https://issues.apache.org/jira/browse/SPARK-11215 Project: Spark Issue Type: Impro

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965249#comment-14965249 ] Jean-Baptiste Onofré commented on SPARK-11193: -- I confirm that it works fine

[jira] [Updated] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated SPARK-11193: - Attachment: screen.png > Spark 1.5+ Kinesis Streaming - ClassCastException when s

[jira] [Resolved] (SPARK-11213) Documentation for remote spark Submit for R Scripts from 1.5 on CDH 5.4

2015-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11213. --- Resolution: Invalid This is not a bug, but a question. Please use the mailing list u...@spark.apache

[jira] [Assigned] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11215: Assignee: Apache Spark > Add multiple columns support to StringIndexer > -

[jira] [Commented] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965261#comment-14965261 ] Apache Spark commented on SPARK-11215: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-11215) Add multiple columns support to StringIndexer

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11215: Assignee: (was: Apache Spark) > Add multiple columns support to StringIndexer > --

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

2015-10-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965268#comment-14965268 ] Yanbo Liang commented on SPARK-8418: [~josephkb] I have implemented StringIndexer supp

[jira] [Comment Edited] (SPARK-8418) Add single- and multi-value support to ML Transformers

2015-10-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965268#comment-14965268 ] Yanbo Liang edited comment on SPARK-8418 at 10/20/15 3:43 PM: --

[jira] [Commented] (SPARK-10646) Bivariate Statistics: Pearson's Chi-Squared goodness of fit test

2015-10-20 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965298#comment-14965298 ] Jihong MA commented on SPARK-10646: --- [~mengxr] to add chi-squared test support through

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread Phil Kallos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965311#comment-14965311 ] Phil Kallos commented on SPARK-11193: - Ah yes, I have a different scala and Java vers

[jira] [Commented] (SPARK-9506) DataFrames Postgresql JDBC unable to support most of the Postgresql's Data Type

2015-10-20 Thread Marius Van Niekerk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965319#comment-14965319 ] Marius Van Niekerk commented on SPARK-9506: --- This is related to SPARK-10186 > D

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965320#comment-14965320 ] Bilind Hajer commented on SPARK-11190: -- Sorry about that Sean Owen. So I'm assuming

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965327#comment-14965327 ] Shivaram Venkataraman commented on SPARK-11190: --- The changes I mentioned ar

[jira] [Resolved] (SPARK-10463) remove PromotePrecision during optimization

2015-10-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10463. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8621 [https://github.c

[jira] [Created] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-11216: --- Summary: add encoder/decoder for external row Key: SPARK-11216 URL: https://issues.apache.org/jira/browse/SPARK-11216 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11216: Assignee: Apache Spark > add encoder/decoder for external row > --

[jira] [Assigned] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11216: Assignee: (was: Apache Spark) > add encoder/decoder for external row > ---

[jira] [Commented] (SPARK-11216) add encoder/decoder for external row

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965346#comment-14965346 ] Apache Spark commented on SPARK-11216: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

2015-10-20 Thread mathieu despriee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965351#comment-14965351 ] mathieu despriee commented on SPARK-11128: -- hadoop 2.4 just tested right now wi

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

2015-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965358#comment-14965358 ] Steve Loughran commented on SPARK-11128: nothing to worry about then: problem is

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965363#comment-14965363 ] Bilind Hajer commented on SPARK-11190: -- How can I get access to the master branch? W

[jira] [Resolved] (SPARK-11204) Delegate to scala DataFrame API rather than print in python

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11204. Resolution: Duplicate > Delegate to scala DataFrame API rather than print in python > -

[jira] [Commented] (SPARK-11192) Spark sql seems to leak org.apache.spark.sql.execution.ui.SQLTaskMetrics objects over time

2015-10-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965371#comment-14965371 ] Josh Rosen commented on SPARK-11192: Hi [~blivingston], this sounds like it might be

[jira] [Commented] (SPARK-11190) SparkR support for cassandra collection types.

2015-10-20 Thread Bilind Hajer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965391#comment-14965391 ] Bilind Hajer commented on SPARK-11190: -- Nvm, answered my own question. Will test on

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

2015-10-20 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965415#comment-14965415 ] Jean-Baptiste Onofré commented on SPARK-11193: -- I did the tests with Scala 2

[jira] [Assigned] (SPARK-3842) Remove the hacks for Python callback server in py4j

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3842: --- Assignee: Apache Spark (was: Davies Liu) > Remove the hacks for Python callback server in py

[jira] [Commented] (SPARK-3842) Remove the hacks for Python callback server in py4j

2015-10-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965446#comment-14965446 ] Apache Spark commented on SPARK-3842: - User 'holdenk' has created a pull request for t

  1   2   3   >