[jira] [Assigned] (SPARK-6894) typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6894: --- Assignee: Apache Spark typo spark.executor.extraLibraryOptions =

[jira] [Commented] (SPARK-6894) typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493684#comment-14493684 ] Apache Spark commented on SPARK-6894: - User 'WangTaoTheTonic' has created a pull

[jira] [Assigned] (SPARK-6894) typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6894: --- Assignee: (was: Apache Spark) typo spark.executor.extraLibraryOptions =

[jira] [Commented] (SPARK-6376) Subqueries are thrown away too early in dataframes

2015-04-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493648#comment-14493648 ] Reynold Xin commented on SPARK-6376: Note that SPARK-6865 will break this since $x.str

[jira] [Created] (SPARK-6894) typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath

2015-04-14 Thread Tao Wang (JIRA)
Tao Wang created SPARK-6894: --- Summary: typo spark.executor.extraLibraryOptions = spark.executor.extraLibraryPath Key: SPARK-6894 URL: https://issues.apache.org/jira/browse/SPARK-6894 Project: Spark

[jira] [Created] (SPARK-6895) JobScheduler doesn't update the status of JobSet when a Job fails.

2015-04-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-6895: --- Summary: JobScheduler doesn't update the status of JobSet when a Job fails. Key: SPARK-6895 URL: https://issues.apache.org/jira/browse/SPARK-6895 Project: Spark

[jira] [Assigned] (SPARK-6156) Not cache in memory again if put memory_and_disk level block after put it in disk after unroll unsuccess in memory.

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6156: --- Assignee: (was: Apache Spark) Not cache in memory again if put memory_and_disk level

[jira] [Assigned] (SPARK-6156) Not cache in memory again if put memory_and_disk level block after put it in disk after unroll unsuccess in memory.

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6156: --- Assignee: Apache Spark Not cache in memory again if put memory_and_disk level block after

[jira] [Commented] (SPARK-6865) Decide on semantics for string identifiers in DataFrame API

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493646#comment-14493646 ] Apache Spark commented on SPARK-6865: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-6379) Support a functon to call user-defined functions registered in SQLContext

2015-04-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6379: --- Description: This is useful for using pre-defined UDFs in SQLContext; {code} val df = Seq((id1, 1),

[jira] [Updated] (SPARK-6379) Support a functon to call user-defined functions registered in SQLContext

2015-04-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6379: --- Description: This is useful for using pre-defined UDFs in SQLContext; {code} val df = Seq((id1, 1),

[jira] [Closed] (SPARK-6895) JobScheduler doesn't update the status of JobSet when a Job fails.

2015-04-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu closed SPARK-6895. --- Resolution: Not A Problem I didn't notice that when an error happens, StreamingContext will exit.

[jira] [Assigned] (SPARK-6896) building error because of guava import

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6896: --- Assignee: Apache Spark building error because of guava import

[jira] [Commented] (SPARK-6896) building error because of guava import

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493726#comment-14493726 ] Apache Spark commented on SPARK-6896: - User 'adrian-wang' has created a pull request

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493775#comment-14493775 ] Sean Owen commented on SPARK-6889: -- [~pwendell] Yeah, Affects Version only makes sense

[jira] [Updated] (SPARK-6896) building error because of guava import

2015-04-14 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang updated SPARK-6896: --- Description: [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493749#comment-14493749 ] Sean Owen commented on SPARK-6847: -- Yeah, doesn't quite help since it is not clear where

[jira] [Updated] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-6898: --- Description: This function is added a long time ago, but it's not complete, it will fail if we have

[jira] [Created] (SPARK-6896) building error because of guava import

2015-04-14 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-6896: -- Summary: building error because of guava import Key: SPARK-6896 URL: https://issues.apache.org/jira/browse/SPARK-6896 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6889: - Attachment: faq.html.patch (Patch for the site's FAQ to point to the wiki too.) Streamline contribution

[jira] [Updated] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-6898: --- Description: This function is added a long time ago, but it's not complete, it will fail if we have

[jira] [Updated] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-6898: --- Description: This function is added a long time ago, but it's not complete, it will fail if we have

[jira] [Created] (SPARK-6899) Type mismatch when user codegen

2015-04-14 Thread Chen Song (JIRA)
Chen Song created SPARK-6899: Summary: Type mismatch when user codegen Key: SPARK-6899 URL: https://issues.apache.org/jira/browse/SPARK-6899 Project: Spark Issue Type: Bug Components:

[jira] [Closed] (SPARK-6374) Add getter for GeneralizedLinearAlgorithm

2015-04-14 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang closed SPARK-6374. - fix merged. Thanks. Add getter for GeneralizedLinearAlgorithm -

[jira] [Commented] (SPARK-3624) Failed to find Spark assembly in /usr/share/spark/lib for RELEASED debian packages

2015-04-14 Thread Erich Schubert (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493799#comment-14493799 ] Erich Schubert commented on SPARK-3624: ---

[jira] [Created] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-6898: -- Summary: Special chars in column names is broken Key: SPARK-6898 URL: https://issues.apache.org/jira/browse/SPARK-6898 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-6693) add toString with max lines and width for matrix

2015-04-14 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang closed SPARK-6693. - Fix merged. Thanks. add toString with max lines and width for matrix

[jira] [Comment Edited] (SPARK-6808) Checkpointing after zipPartitions results in NODE_LOCAL execution

2015-04-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493769#comment-14493769 ] Liang-Chi Hsieh edited comment on SPARK-6808 at 4/14/15 8:18 AM:

[jira] [Comment Edited] (SPARK-6808) Checkpointing after zipPartitions results in NODE_LOCAL execution

2015-04-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493769#comment-14493769 ] Liang-Chi Hsieh edited comment on SPARK-6808 at 4/14/15 8:18 AM:

[jira] [Assigned] (SPARK-6897) Remove volatile from BlockingGenerator.currentBuffer

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6897: --- Assignee: (was: Apache Spark) Remove volatile from BlockingGenerator.currentBuffer

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2015-04-14 Thread Jack Hu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493804#comment-14493804 ] Jack Hu commented on SPARK-6847: Hi, [~sowen] The checkpoint interval can not be turn

[jira] [Commented] (SPARK-6846) Stage kill URL easy to accidentally trigger and possibility for security issue.

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494000#comment-14494000 ] Sean Owen commented on SPARK-6846: -- [~devl.development] would you like to propose a PR

[jira] [Reopened] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-6847: -- I think it's worth reopening although I still don't know what the issue is, but it's not obviously a usage

[jira] [Resolved] (SPARK-6731) Upgrade Apache commons-math3 to 3.4.1

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6731. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5380

[jira] [Created] (SPARK-6900) spark ec2 script enters infinite loop when run-instance fails

2015-04-14 Thread Guodong Wang (JIRA)
Guodong Wang created SPARK-6900: --- Summary: spark ec2 script enters infinite loop when run-instance fails Key: SPARK-6900 URL: https://issues.apache.org/jira/browse/SPARK-6900 Project: Spark

[jira] [Updated] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Chen Song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Song updated SPARK-6899: - Summary: Type mismatch when using codegen (was: Type mismatch when user codegen) Type mismatch when

[jira] [Assigned] (SPARK-6878) Sum on empty RDD fails with exception

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-6878: Assignee: Erik van Oosten Sum on empty RDD fails with exception

[jira] [Resolved] (SPARK-6878) Sum on empty RDD fails with exception

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6878. -- Resolution: Fixed Fix Version/s: 1.2.2 1.4.0 1.3.2 Issue

[jira] [Commented] (SPARK-6846) Stage kill URL easy to accidentally trigger and possibility for security issue.

2015-04-14 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494012#comment-14494012 ] Dev Lakhani commented on SPARK-6846: [~srowen] please go ahead, I wont have time for

[jira] [Updated] (SPARK-6888) Make DriverQuirks editable

2015-04-14 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rene Treffer updated SPARK-6888: Flags: Patch Make DriverQuirks editable -- Key:

[jira] [Updated] (SPARK-6731) Upgrade Apache commons-math3 to 3.4.1

2015-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6731: - Priority: Minor (was: Major) Assignee: Punya Biswal Upgrade Apache commons-math3 to 3.4.1

[jira] [Commented] (SPARK-6888) Make DriverQuirks editable

2015-04-14 Thread Rene Treffer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493859#comment-14493859 ] Rene Treffer commented on SPARK-6888: - I've changed the Quirks for my personal use and

[jira] [Assigned] (SPARK-6888) Make DriverQuirks editable

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6888: --- Assignee: Apache Spark Make DriverQuirks editable --

[jira] [Commented] (SPARK-6888) Make DriverQuirks editable

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494136#comment-14494136 ] Apache Spark commented on SPARK-6888: - User 'rtreffer' has created a pull request for

[jira] [Assigned] (SPARK-6888) Make DriverQuirks editable

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6888: --- Assignee: (was: Apache Spark) Make DriverQuirks editable --

[jira] [Commented] (SPARK-6890) Local cluster mode is broken on OSX

2015-04-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494473#comment-14494473 ] Marcelo Vanzin commented on SPARK-6890: --- FYI it's broken on Linux too (and most

[jira] [Commented] (SPARK-5081) Shuffle write increases

2015-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494478#comment-14494478 ] Josh Rosen commented on SPARK-5081: --- The snappy-java issue has been fixed upstream (see

[jira] [Assigned] (SPARK-4340) add java opts argument substitute to avoid gc log overwritten

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4340: --- Assignee: Apache Spark add java opts argument substitute to avoid gc log overwritten

[jira] [Updated] (SPARK-6890) Local cluster mode is broken on OSX

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6890: - Summary: Local cluster mode is broken on OSX (was: Local cluster mode is broken on Mac) Local cluster

[jira] [Assigned] (SPARK-4340) add java opts argument substitute to avoid gc log overwritten

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4340: --- Assignee: (was: Apache Spark) add java opts argument substitute to avoid gc log

[jira] [Commented] (SPARK-6903) Eliminate partition filters from execution

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494193#comment-14494193 ] Apache Spark commented on SPARK-6903: - User 'yijieshen' has created a pull request for

[jira] [Created] (SPARK-6904) SparkSql - HiveContext - optimize reading partition data from metastore

2015-04-14 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-6904: Summary: SparkSql - HiveContext - optimize reading partition data from metastore Key: SPARK-6904 URL: https://issues.apache.org/jira/browse/SPARK-6904 Project: Spark

[jira] [Updated] (SPARK-6890) Local cluster mode is broken on Mac

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6890: - Summary: Local cluster mode is broken on Mac (was: Local cluster mode is broken) Local cluster mode is

[jira] [Updated] (SPARK-6901) ParamGridBuilder.build with no grids should return an empty array

2015-04-14 Thread Peter Rudenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Rudenko updated SPARK-6901: - Description: ParamGridBuilder.build with no grids returns array with an empty param map. {code}

[jira] [Assigned] (SPARK-6901) ParamGridBuilder.build with no grids should return an empty array

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6901: --- Assignee: Apache Spark ParamGridBuilder.build with no grids should return an empty array

[jira] [Commented] (SPARK-6901) ParamGridBuilder.build with no grids should return an empty array

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494242#comment-14494242 ] Apache Spark commented on SPARK-6901: - User 'petro-rudenko' has created a pull request

[jira] [Assigned] (SPARK-6901) ParamGridBuilder.build with no grids should return an empty array

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6901: --- Assignee: (was: Apache Spark) ParamGridBuilder.build with no grids should return an

[jira] [Updated] (SPARK-6899) Type mismatch when using codegen

2015-04-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6899: --- Target Version/s: 1.4.0 Type mismatch when using codegen

[jira] [Updated] (SPARK-6890) Local cluster mode is broken with SPARK_PREPEND_CLASSES

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6890: - Summary: Local cluster mode is broken with SPARK_PREPEND_CLASSES (was: Local cluster mode is broken on

[jira] [Commented] (SPARK-6890) Local cluster mode is broken on OSX

2015-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494481#comment-14494481 ] Andrew Or commented on SPARK-6890: -- ah I see. I will update the title again Local

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2015-04-14 Thread David Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494428#comment-14494428 ] David Ross commented on SPARK-2087: --- Makes sense, thanks for the response. Clean

[jira] [Created] (SPARK-6905) Upgrade Snappy Java to 1.1.1.7 to fix bug that resulted in worse compression

2015-04-14 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-6905: - Summary: Upgrade Snappy Java to 1.1.1.7 to fix bug that resulted in worse compression Key: SPARK-6905 URL: https://issues.apache.org/jira/browse/SPARK-6905 Project: Spark

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2015-04-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494422#comment-14494422 ] Michael Armbrust commented on SPARK-2087: - No, unfortunately we can only backport

[jira] [Issue Comment Deleted] (SPARK-6905) Upgrade Snappy Java to 1.1.1.7 to fix bug that resulted in worse compression

2015-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6905: -- Comment: was deleted (was: The snappy-java issue has been fixed upstream (see

[jira] [Commented] (SPARK-6905) Upgrade Snappy Java to 1.1.1.7 to fix bug that resulted in worse compression

2015-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494476#comment-14494476 ] Josh Rosen commented on SPARK-6905: --- The snappy-java issue has been fixed upstream (see

[jira] [Commented] (SPARK-6873) Some Hive-Catalyst comparison tests fail due to unimportant order of some printed elements

2015-04-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494351#comment-14494351 ] Cheng Lian commented on SPARK-6873: --- I had once hit this recently, but unfortunately

[jira] [Commented] (SPARK-2087) Clean Multi-user semantics for thrift JDBC/ODBC server.

2015-04-14 Thread David Ross (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494410#comment-14494410 ] David Ross commented on SPARK-2087: --- Any chance this will be back-ported to the 1.3

[jira] [Commented] (SPARK-6905) Upgrade Snappy Java to 1.1.1.7 to fix bug that resulted in worse compression

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494460#comment-14494460 ] Apache Spark commented on SPARK-6905: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-6905) Upgrade Snappy Java to 1.1.1.7 to fix bug that resulted in worse compression

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6905: --- Assignee: Apache Spark (was: Josh Rosen) Upgrade Snappy Java to 1.1.1.7 to fix bug that

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

2015-04-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494557#comment-14494557 ] Joseph K. Bradley commented on SPARK-6889: -- [~srowen] Thanks for initiating

[jira] [Assigned] (SPARK-6911) API for access MapType in DataFrame

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6911: --- Assignee: Davies Liu (was: Apache Spark) API for access MapType in DataFrame

[jira] [Commented] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494555#comment-14494555 ] Takeshi Yamamuro commented on SPARK-6912: - After SPARK-6747 resolved, I'll make a

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

2015-04-14 Thread Yu Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494509#comment-14494509 ] Yu Gao commented on SPARK-5111: --- OK. Thank you Zhan Zhang, for the patch. HiveContext and

[jira] [Created] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

2015-04-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6910: --- Summary: Support for pushing predicates down to metastore for partition pruning Key: SPARK-6910 URL: https://issues.apache.org/jira/browse/SPARK-6910 Project:

[jira] [Created] (SPARK-6909) Remove Hive Shim code

2015-04-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6909: --- Summary: Remove Hive Shim code Key: SPARK-6909 URL: https://issues.apache.org/jira/browse/SPARK-6909 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494528#comment-14494528 ] Joseph K. Bradley commented on SPARK-5256: -- [~avulanov] I wonder, though, if SGD

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2015-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494527#comment-14494527 ] Josh Rosen commented on SPARK-2243: --- This was done in SPARK-4180, which was included in

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Description: The current implementation can't handle MapK,V as a return type in Hive UDF.

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Description: The current implementation can't handle MapK,V as a return type in Hive UDF.

[jira] [Updated] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6912: Environment: (was: The current implementation can't handle MapK,V as a return type in

[jira] [Commented] (SPARK-6911) API for access MapType in DataFrame

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494558#comment-14494558 ] Apache Spark commented on SPARK-6911: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-6911) API for access MapType in DataFrame

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6911: --- Assignee: Apache Spark (was: Davies Liu) API for access MapType in DataFrame

[jira] [Created] (SPARK-6912) Support MapK,V as a return type in Hive UDF

2015-04-14 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-6912: --- Summary: Support MapK,V as a return type in Hive UDF Key: SPARK-6912 URL: https://issues.apache.org/jira/browse/SPARK-6912 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-14 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494518#comment-14494518 ] Alexander Ulanov commented on SPARK-5256: - Probably the main issue for MLlib is

[jira] [Created] (SPARK-6908) Refactor existing code to use the isolated client

2015-04-14 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-6908: --- Summary: Refactor existing code to use the isolated client Key: SPARK-6908 URL: https://issues.apache.org/jira/browse/SPARK-6908 Project: Spark Issue

[jira] [Created] (SPARK-6911) API for access MapType in DataFrame

2015-04-14 Thread Davies Liu (JIRA)
Davies Liu created SPARK-6911: - Summary: API for access MapType in DataFrame Key: SPARK-6911 URL: https://issues.apache.org/jira/browse/SPARK-6911 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-5256) Improving MLlib optimization APIs

2015-04-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494562#comment-14494562 ] Shivaram Venkataraman commented on SPARK-5256: -- FWIW I also think that API

[jira] [Assigned] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5259: --- Assignee: Apache Spark Fix endless retry stage by add task equal() and hashcode() to avoid

[jira] [Assigned] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5259: --- Assignee: (was: Apache Spark) Fix endless retry stage by add task equal() and

[jira] [Created] (SPARK-6903) Eliminate partition filters from execution

2015-04-14 Thread Yijie Shen (JIRA)
Yijie Shen created SPARK-6903: - Summary: Eliminate partition filters from execution Key: SPARK-6903 URL: https://issues.apache.org/jira/browse/SPARK-6903 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-4286) Support External Shuffle Service with Mesos integration

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4286: --- Assignee: Timothy Chen (was: Apache Spark) Support External Shuffle Service with Mesos

[jira] [Created] (SPARK-6902) Row() object can be mutated even though it should be immutable

2015-04-14 Thread Jonathan Arfa (JIRA)
Jonathan Arfa created SPARK-6902: Summary: Row() object can be mutated even though it should be immutable Key: SPARK-6902 URL: https://issues.apache.org/jira/browse/SPARK-6902 Project: Spark

[jira] [Updated] (SPARK-6902) Row() object can be mutated even though it should be immutable

2015-04-14 Thread Jonathan Arfa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Arfa updated SPARK-6902: - Description: See the below code snippet, IMHO it shouldn't let you assign {{x.c = 5}} and should

[jira] [Assigned] (SPARK-6903) Eliminate partition filters from execution

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6903: --- Assignee: Apache Spark Eliminate partition filters from execution

[jira] [Assigned] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6898: --- Assignee: (was: Apache Spark) Special chars in column names is broken

[jira] [Assigned] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6898: --- Assignee: Apache Spark Special chars in column names is broken

[jira] [Commented] (SPARK-6898) Special chars in column names is broken

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494251#comment-14494251 ] Apache Spark commented on SPARK-6898: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-4286) Support External Shuffle Service with Mesos integration

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4286: --- Assignee: Apache Spark (was: Timothy Chen) Support External Shuffle Service with Mesos

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

2015-04-14 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494168#comment-14494168 ] Nicholas Chammas commented on SPARK-6889: - {quote} I also agree that most projects

[jira] [Assigned] (SPARK-6903) Eliminate partition filters from execution

2015-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6903: --- Assignee: (was: Apache Spark) Eliminate partition filters from execution

  1   2   3   >