[jira] [Comment Edited] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982024#comment-14982024 ] Russell Alexander Spitzer edited comment on SPARK-11415 at 10/30/15 7:14 AM: --

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982024#comment-14982024 ] Russell Alexander Spitzer commented on SPARK-11415: --- I added another co

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982030#comment-14982030 ] Jacek Lewandowski commented on SPARK-11402: --- That's right, this is not only int

[jira] [Comment Edited] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982030#comment-14982030 ] Jacek Lewandowski edited comment on SPARK-11402 at 10/30/15 7:18 AM: --

[jira] [Created] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread holdenk (JIRA)
holdenk created SPARK-11421: --- Summary: Add the ability to add a jar to the current class loader Key: SPARK-11421 URL: https://issues.apache.org/jira/browse/SPARK-11421 Project: Spark Issue Type: Im

[jira] [Updated] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11421: Component/s: Spark Core > Add the ability to add a jar to the current class loader > --

[jira] [Commented] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982037#comment-14982037 ] Apache Spark commented on SPARK-11421: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11421: Assignee: Apache Spark > Add the ability to add a jar to the current class loader > --

[jira] [Assigned] (SPARK-11421) Add the ability to add a jar to the current class loader

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11421: Assignee: (was: Apache Spark) > Add the ability to add a jar to the current class load

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982043#comment-14982043 ] Sean Owen commented on SPARK-11416: --- [~hozawa] as you may see from a number of other is

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982044#comment-14982044 ] Sean Owen commented on SPARK-11413: --- How about updating joda time to 2.8.1 everywhere?

[jira] [Resolved] (SPARK-11417) @Override is not supported by older version of Janino

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-11417. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Updated] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-11385: Assignee: Nakul Jindal > Add foreach API to MLLib's vector API > - > >

[jira] [Commented] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982070#comment-14982070 ] DB Tsai commented on SPARK-11385: - ++Sean. I think `foreach` doesn't make sense for spar

[jira] [Updated] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11385: Summary: Make foreachActive public in MLLib's vector API (was: Add foreach API to MLLib's vector API) > M

[jira] [Commented] (SPARK-11385) Add foreach API to MLLib's vector API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982073#comment-14982073 ] holdenk commented on SPARK-11385: - ah my misunderstanding then. > Add foreach API to MLL

[jira] [Updated] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-11385: Description: Make foreachActive public in MLLib's vector API (was: Add a foreach API to MLLib's vector.)

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982076#comment-14982076 ] holdenk commented on SPARK-11138: - I also ran it again a few thousand times without strac

[jira] [Closed] (SPARK-11386) Refactor appropriate uses of Vector to use the new foreach API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-11386. --- Resolution: Fixed > Refactor appropriate uses of Vector to use the new foreach API >

[jira] [Comment Edited] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982070#comment-14982070 ] DB Tsai edited comment on SPARK-11385 at 10/30/15 7:48 AM: --- I t

[jira] [Reopened] (SPARK-11386) Refactor appropriate uses of Vector to use the new foreach API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reopened SPARK-11386: - closed with wrong status > Refactor appropriate uses of Vector to use the new foreach API >

[jira] [Closed] (SPARK-11386) Refactor appropriate uses of Vector to use the new foreach API

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-11386. --- Resolution: Invalid > Refactor appropriate uses of Vector to use the new foreach API > --

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982087#comment-14982087 ] Marcelo Vanzin commented on SPARK-11138: The logs should be available on the "Bui

[jira] [Commented] (SPARK-11385) Make foreachActive public in MLLib's vector API

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982090#comment-14982090 ] Sean Owen commented on SPARK-11385: --- OK the new description makes more sense, yes > Ma

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Hitoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982094#comment-14982094 ] Hitoshi Ozawa commented on SPARK-11416: --- Sean, we have already tested and using kry

[jira] [Comment Edited] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982030#comment-14982030 ] Jacek Lewandowski edited comment on SPARK-11402 at 10/30/15 8:04 AM: --

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982103#comment-14982103 ] holdenk commented on SPARK-11138: - So with a non logged in view I don't see it on https:

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982112#comment-14982112 ] Marcelo Vanzin commented on SPARK-11138: Hmm, interesting. I clicked on a few rec

[jira] [Commented] (SPARK-11138) Flaky pyspark test: test_add_py_file

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982135#comment-14982135 ] holdenk commented on SPARK-11138: - Makes sense, I guess I'll wait for it to fail again an

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982138#comment-14982138 ] somil deshmukh commented on SPARK-10946: I would like to work on this .pls assign

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982140#comment-14982140 ] somil deshmukh commented on SPARK-10946: Pull request is https://github.com/somi

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982145#comment-14982145 ] Sean Owen commented on SPARK-11416: --- That's good, but it doesn't mean it doesn't break

[jira] [Commented] (SPARK-10962) DataFrame "except" method...

2015-10-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982160#comment-14982160 ] Herman van Hovell commented on SPARK-10962: --- Do you want to know which row had

[jira] [Commented] (SPARK-11416) Upgrade kryo package to version 3.0

2015-10-30 Thread Hitoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982171#comment-14982171 ] Hitoshi Ozawa commented on SPARK-11416: --- OK. Will do more checks and come back when

[jira] [Commented] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982206#comment-14982206 ] Apache Spark commented on SPARK-11188: -- User 'dilipbiswal' has created a pull reques

[jira] [Commented] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982209#comment-14982209 ] Apache Spark commented on SPARK-11188: -- User 'dilipbiswal' has created a pull reques

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982224#comment-14982224 ] Sean Owen commented on SPARK-10946: --- [~somi...@us.ibm.com] you just need to open a pull

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982240#comment-14982240 ] Russell Alexander Spitzer commented on SPARK-11415: --- I think the underl

[jira] [Updated] (SPARK-7673) DataSourceStrategy's buildPartitionedTableScan always list file status for all data files

2015-10-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-7673: -- Summary: DataSourceStrategy's buildPartitionedTableScan always list file status for all data files (wa

[jira] [Comment Edited] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-10-30 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982001#comment-14982001 ] Russell Alexander Spitzer edited comment on SPARK-11415 at 10/30/15 9:44 AM: --

[jira] [Updated] (SPARK-11422) Restarting a Spark Streaming Job from a checkpoint fails

2015-10-30 Thread Abbass Marouni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abbass Marouni updated SPARK-11422: --- Description: A Spark Streaming job (with checkpointing enabled) that does a simple transform

[jira] [Created] (SPARK-11422) Restarting a Spark Streaming Job from a checkpoint fails

2015-10-30 Thread Abbass Marouni (JIRA)
Abbass Marouni created SPARK-11422: -- Summary: Restarting a Spark Streaming Job from a checkpoint fails Key: SPARK-11422 URL: https://issues.apache.org/jira/browse/SPARK-11422 Project: Spark

[jira] [Updated] (SPARK-11422) Spark Streaming job which does a transformation involving a DStream and a RDD cannot be restarted from a checkpoint

2015-10-30 Thread Abbass Marouni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abbass Marouni updated SPARK-11422: --- Summary: Spark Streaming job which does a transformation involving a DStream and a RDD cannot

[jira] [Resolved] (SPARK-11207) Add test cases for solver selection of LinearRegression as followup.

2015-10-30 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-11207. - Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9180 [https://github.com/apa

[jira] [Commented] (SPARK-11405) ROW_NUMBER function does not adhere to window ORDER BY, when joining

2015-10-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982272#comment-14982272 ] Herman van Hovell commented on SPARK-11405: --- Hi I have tried to reproduce this

[jira] [Resolved] (SPARK-11103) Parquet filters push-down may cause exception when schema merging is turned on

2015-10-30 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11103. Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved by pull reque

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982328#comment-14982328 ] somil deshmukh commented on SPARK-10946: https://github.com/somideshmukh/spark-ma

[jira] [Assigned] (SPARK-11408) Display scientific notation correctly in DataFrame.show()

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11408: Assignee: (was: Apache Spark) > Display scientific notation correctly in DataFrame.sho

[jira] [Commented] (SPARK-11408) Display scientific notation correctly in DataFrame.show()

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982485#comment-14982485 ] Apache Spark commented on SPARK-11408: -- User 'pravingadakh' has created a pull reque

[jira] [Assigned] (SPARK-11408) Display scientific notation correctly in DataFrame.show()

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11408: Assignee: Apache Spark > Display scientific notation correctly in DataFrame.show() > -

[jira] [Commented] (SPARK-10946) JDBC - Use Statement.executeUpdate instead of PreparedStatement.executeUpdate for DDLs

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982506#comment-14982506 ] Sean Owen commented on SPARK-10946: --- That is not a pull request opened vs apache/master

[jira] [Commented] (SPARK-11326) Split networking in standalone mode

2015-10-30 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982544#comment-14982544 ] Jacek Lewandowski commented on SPARK-11326: --- Working on tests and docs > Split

[jira] [Commented] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-10-30 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982554#comment-14982554 ] Brian ONeill commented on SPARK-11198: -- Hey guys, we are running against streams wit

[jira] [Comment Edited] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-10-30 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982554#comment-14982554 ] Brian ONeill edited comment on SPARK-11198 at 10/30/15 1:33 PM: ---

[jira] [Commented] (SPARK-11402) Allow to define a custom driver runner and executor runner

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982575#comment-14982575 ] Sean Owen commented on SPARK-11402: --- The refactoring itself is probably valuable, as ar

[jira] [Comment Edited] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-10-30 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982554#comment-14982554 ] Brian ONeill edited comment on SPARK-11198 at 10/30/15 2:05 PM: ---

[jira] [Updated] (SPARK-11411) Use the space at end of pages

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11411: -- Priority: Minor (was: Major) Component/s: Web UI > Use the space at end of pages >

[jira] [Updated] (SPARK-11412) mergeSchema option not working for orc format?

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11412: -- Component/s: SQL > mergeSchema option not working for orc format? > ---

[jira] [Resolved] (SPARK-11422) Spark Streaming job which does a transformation involving a DStream and a RDD cannot be restarted from a checkpoint

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11422. --- Resolution: Invalid Pretty certain this is invalid. You can't hold on to a reference to an RDD acros

[jira] [Updated] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11188: -- Labels: backport-needed (was: ) > Elide stacktraces in bin/spark-sql for AnalysisExceptions >

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982662#comment-14982662 ] Yongjia Wang commented on SPARK-11413: -- yea, the fix is to update the joda.version n

[jira] [Commented] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-10-30 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982667#comment-14982667 ] Brian ONeill commented on SPARK-11198: -- Woo hoo! Confirmed that de-aggregation work

[jira] [Commented] (SPARK-11422) Spark Streaming job which does a transformation involving a DStream and a RDD cannot be restarted from a checkpoint

2015-10-30 Thread Prada Souvanlasy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982672#comment-14982672 ] Prada Souvanlasy commented on SPARK-11422: -- Hello, thanks for your quick answer.

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982755#comment-14982755 ] Yongjia Wang commented on SPARK-11413: -- My last statement was wrong. It's a problem

[jira] [Comment Edited] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982755#comment-14982755 ] Yongjia Wang edited comment on SPARK-11413 at 10/30/15 4:02 PM: ---

[jira] [Comment Edited] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982755#comment-14982755 ] Yongjia Wang edited comment on SPARK-11413 at 10/30/15 4:02 PM: ---

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982802#comment-14982802 ] Yongjia Wang commented on SPARK-11413: -- I see. I don't know, is it safe to assume jo

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982790#comment-14982790 ] Sean Owen commented on SPARK-11413: --- I understand all that, but my question is about th

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982854#comment-14982854 ] Sean Owen commented on SPARK-11413: --- To assume? no, that's why I'm suggesting you try i

[jira] [Resolved] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10986. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9282 [https://github.com

[jira] [Updated] (SPARK-10986) ClassNotFoundException when running on Client mode, with a Mesos master.

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10986: -- Assignee: Iulian Dragos > ClassNotFoundException when running on Client mode, with a Mesos master. > --

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982874#comment-14982874 ] Yongjia Wang commented on SPARK-11413: -- I can follow up with a PR first. The latest

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982883#comment-14982883 ] Sean Owen commented on SPARK-11413: --- I imagine it will be as well to update to 2.9, but

[jira] [Assigned] (SPARK-11382) Replace example code in mllib-decision-tree.md/mllib-ensembles.md using include_example

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11382: Assignee: Apache Spark > Replace example code in mllib-decision-tree.md/mllib-ensembles.md

[jira] [Commented] (SPARK-11382) Replace example code in mllib-decision-tree.md/mllib-ensembles.md using include_example

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982888#comment-14982888 ] Apache Spark commented on SPARK-11382: -- User 'gliptak' has created a pull request fo

[jira] [Assigned] (SPARK-11382) Replace example code in mllib-decision-tree.md/mllib-ensembles.md using include_example

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11382: Assignee: (was: Apache Spark) > Replace example code in mllib-decision-tree.md/mllib-e

[jira] [Commented] (SPARK-10785) Scale QuantileDiscretizer using distributed binning

2015-10-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982903#comment-14982903 ] holdenk commented on SPARK-10785: - I'll start working on this :) > Scale QuantileDiscret

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982906#comment-14982906 ] Apache Spark commented on SPARK-11413: -- User 'yongjiaw' has created a pull request f

[jira] [Commented] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982905#comment-14982905 ] Yanbo Liang commented on SPARK-9836: [~mengxr] After survey I found that "Deviance Res

[jira] [Assigned] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11413: Assignee: (was: Apache Spark) > Java 8 build has problem with joda-time and s3 request

[jira] [Assigned] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11413: Assignee: Apache Spark > Java 8 build has problem with joda-time and s3 request, should bu

[jira] [Comment Edited] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982905#comment-14982905 ] Yanbo Liang edited comment on SPARK-9836 at 10/30/15 5:18 PM: --

[jira] [Comment Edited] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982905#comment-14982905 ] Yanbo Liang edited comment on SPARK-9836 at 10/30/15 5:19 PM: --

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2015-10-30 Thread Yongjia Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982909#comment-14982909 ] Yongjia Wang commented on SPARK-11413: -- There is no more transitive dependencies fro

[jira] [Assigned] (SPARK-11420) Changing Stddev support with Imperative Aggregate

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11420: Assignee: (was: Apache Spark) > Changing Stddev support with Imperative Aggregate > --

[jira] [Assigned] (SPARK-11420) Changing Stddev support with Imperative Aggregate

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11420: Assignee: Apache Spark > Changing Stddev support with Imperative Aggregate > -

[jira] [Commented] (SPARK-11420) Changing Stddev support with Imperative Aggregate

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982924#comment-14982924 ] Apache Spark commented on SPARK-11420: -- User 'JihongMA' has created a pull request f

[jira] [Commented] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-10-30 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982926#comment-14982926 ] Burak Yavuz commented on SPARK-11198: - [~boneill42], did you need to do anything spec

[jira] [Comment Edited] (SPARK-9836) Provide R-like summary statistics for ordinary least squares via normal equation solver

2015-10-30 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982905#comment-14982905 ] Yanbo Liang edited comment on SPARK-9836 at 10/30/15 5:27 PM: --

[jira] [Updated] (SPARK-11278) PageRank fails with unified memory manager

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11278: --- Priority: Blocker (was: Major) > PageRank fails with unified memory manager > --

[jira] [Commented] (SPARK-11198) Support record de-aggregation in KinesisReceiver

2015-10-30 Thread Brian ONeill (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982938#comment-14982938 ] Brian ONeill commented on SPARK-11198: -- Nothing special, works right out of the box.

[jira] [Updated] (SPARK-11278) PageRank fails with unified memory manager

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11278: --- Target Version/s: 1.6.0 > PageRank fails with unified memory manager > --

[jira] [Updated] (SPARK-11411) Use the space at end of pages

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-11411: --- Component/s: (was: Web UI) SQL > Use the space at end of pages > ---

[jira] [Updated] (SPARK-4849) Pass partitioning information (distribute by) to In-memory caching

2015-10-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-4849: -- Priority: Critical (was: Minor) > Pass partitioning information (distribute by) to In-memory caching >

[jira] [Created] (SPARK-11423) Remove PrepareRDD

2015-10-30 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11423: -- Summary: Remove PrepareRDD Key: SPARK-11423 URL: https://issues.apache.org/jira/browse/SPARK-11423 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-11392) GroupedIterator's hasNext is not idempotent

2015-10-30 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982949#comment-14982949 ] Nakul Jindal commented on SPARK-11392: -- I will work on this > GroupedIterator's has

[jira] [Commented] (SPARK-11423) Remove PrepareRDD

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982953#comment-14982953 ] Apache Spark commented on SPARK-11423: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-11423) Remove PrepareRDD

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11423: Assignee: Apache Spark (was: Davies Liu) > Remove PrepareRDD > -- > >

[jira] [Assigned] (SPARK-11423) Remove PrepareRDD

2015-10-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11423: Assignee: Davies Liu (was: Apache Spark) > Remove PrepareRDD > -- > >

[jira] [Resolved] (SPARK-11414) Forgot to update usage of "spark.sparkr.r.command" in RRDD in the PR for SPARK-10971

2015-10-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11414. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

  1   2   >