[jira] [Updated] (SPARK-12857) Streaming tab in web UI uses records and events interchangeably

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12857: -- Component/s: Documentation Issue Type: Improvement (was: Bug) It looks like "records" is used

[jira] [Commented] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103150#comment-15103150 ] Sean Owen commented on SPARK-12846: --- The title isn't descriptive [~jeffzhang] -- what docs? it's

[jira] [Updated] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11293: -- Fix Version/s: (was: 1.6.0) > Spillable collections leak shuffle memory >

[jira] [Updated] (SPARK-12831) akka.remote.OversizedPayloadException on DirectTaskResult

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12831: -- Component/s: Spark Core > akka.remote.OversizedPayloadException on DirectTaskResult >

[jira] [Updated] (SPARK-12827) Configurable bind address for WebUI

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12827: -- Component/s: Web UI Issue Type: Improvement (was: Bug) > Configurable bind address for WebUI >

[jira] [Updated] (SPARK-12825) Spark-submit Jar URL loading fails on redirect

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12825: -- Component/s: Spark Submit > Spark-submit Jar URL loading fails on redirect >

[jira] [Updated] (SPARK-12831) akka.remote.OversizedPayloadException on DirectTaskResult

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12831: -- Target Version/s: (was: 1.5.2) > akka.remote.OversizedPayloadException on DirectTaskResult >

[jira] [Updated] (SPARK-12834) Use type conversion instead of Ser/De of Pickle to transform JavaArray and JavaList

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12834: -- Component/s: PySpark > Use type conversion instead of Ser/De of Pickle to transform JavaArray and >

[jira] [Commented] (SPARK-1910) Add onBlockComplete API to receiver

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103185#comment-15103185 ] Sean Owen commented on SPARK-1910: -- [~hshreedharan] is this still active, do you think? > Add

[jira] [Resolved] (SPARK-1972) Add support for setting and visualizing custom task-related metrics

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1972. -- Resolution: Won't Fix > Add support for setting and visualizing custom task-related metrics >

[jira] [Resolved] (SPARK-2008) Enhance spark-ec2 to be able to add and remove slaves to an existing cluster

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2008. -- Resolution: Won't Fix > Enhance spark-ec2 to be able to add and remove slaves to an existing cluster >

[jira] [Resolved] (SPARK-2095) sc.getExecutorCPUCounts()

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2095. -- Resolution: Won't Fix > sc.getExecutorCPUCounts() > - > > Key:

[jira] [Resolved] (SPARK-12856) speed up hashCode of unsafe array

2016-01-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12856. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10784

[jira] [Commented] (SPARK-6166) Add config to limit number of concurrent outbound connections for shuffle fetch

2016-01-16 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103065#comment-15103065 ] Mridul Muralidharan commented on SPARK-6166: We actually dont care about number of sockets or

[jira] [Resolved] (SPARK-967) start-slaves.sh uses local path from master on remote slave nodes

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-967. - Resolution: Not A Problem I think this is obsolete, or no longer a problem; these scripts always respond

[jira] [Resolved] (SPARK-2389) globally shared SparkContext / shared Spark "application"

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2389. -- Resolution: Won't Fix > globally shared SparkContext / shared Spark "application" >

[jira] [Updated] (SPARK-12845) During join Spark should pushdown predicates on joining column to both tables

2016-01-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12845: --- Summary: During join Spark should pushdown predicates on joining column to both tables

[jira] [Commented] (SPARK-10735) CatalystTypeConverters MatchError converting RDD with custom object to dataframe

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103076#comment-15103076 ] Apache Spark commented on SPARK-10735: -- User 'davies' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12748) Failed to create HiveContext in SparkSql

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12748. --- Resolution: Not A Problem > Failed to create HiveContext in SparkSql >

[jira] [Created] (SPARK-12857) Streaming tab in web UI uses records and events interchangeably

2016-01-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12857: --- Summary: Streaming tab in web UI uses records and events interchangeably Key: SPARK-12857 URL: https://issues.apache.org/jira/browse/SPARK-12857 Project: Spark

[jira] [Resolved] (SPARK-925) Allow ec2 scripts to load default options from a json file

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-925. - Resolution: Won't Fix > Allow ec2 scripts to load default options from a json file >

[jira] [Resolved] (SPARK-593) Send last few lines of failed standalone mode or Mesos task to master

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-593. - Resolution: Won't Fix > Send last few lines of failed standalone mode or Mesos task to master >

[jira] [Commented] (SPARK-1747) check for Spark on Yarn ApplicationMaster split brain

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103184#comment-15103184 ] Sean Owen commented on SPARK-1747: -- [~tgraves] is there a chance this is going to result in a change? >

[jira] [Resolved] (SPARK-7703) Task failure caused by block fetch failure in BlockManager.doGetRemote() when using TorrentBroadcast

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7703. -- Resolution: Duplicate Fix Version/s: (was: 1.6.0) Please resolve as duplicate then > Task

[jira] [Reopened] (SPARK-7703) Task failure caused by block fetch failure in BlockManager.doGetRemote() when using TorrentBroadcast

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-7703: -- > Task failure caused by block fetch failure in BlockManager.doGetRemote() when > using TorrentBroadcast >

[jira] [Updated] (SPARK-12846) Follow up SPARK-12707, Update documentation and other related code

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12846: -- Target Version/s: (was: 2.0.0) Component/s: Documentation > Follow up SPARK-12707, Update

[jira] [Updated] (SPARK-9297) covar_pop and covar_samp aggregate functions

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9297: - Assignee: Liang-Chi Hsieh > covar_pop and covar_samp aggregate functions >

[jira] [Updated] (SPARK-12856) speed up hashCode of unsafe array

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12856: -- Assignee: Wenchen Fan > speed up hashCode of unsafe array > - > >

[jira] [Resolved] (SPARK-1200) Make it possible to use unmanaged AM in yarn-client mode

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1200. -- Resolution: Won't Fix I think Sandy (Ryza) reported this too but I doubt this is still on the radar >

[jira] [Resolved] (SPARK-1153) Generalize VertexId in GraphX so that UUIDs can be used as vertex IDs.

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1153. -- Resolution: Won't Fix No activity in 2 years > Generalize VertexId in GraphX so that UUIDs can be used

[jira] [Resolved] (SPARK-1270) An optimized gradient descent implementation

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1270. -- Resolution: Won't Fix > An optimized gradient descent implementation >

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103187#comment-15103187 ] Sean Owen commented on SPARK-2243: -- I don't think this itself is a good argument for lots of contexts.

[jira] [Resolved] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2243. -- Resolution: Won't Fix > Support multiple SparkContexts in the same JVM >

[jira] [Resolved] (SPARK-2335) k-Nearest Neighbor classification and regression for MLLib

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2335. -- Resolution: Duplicate Sounds like this is subsumed by discussion of the approximate version >

[jira] [Resolved] (SPARK-2262) Extreme Learning Machines (ELM) for MLLib

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2262. -- Resolution: Won't Fix > Extreme Learning Machines (ELM) for MLLib >

[jira] [Reopened] (SPARK-12748) Failed to create HiveContext in SparkSql

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-12748: --- > Failed to create HiveContext in SparkSql > > >

[jira] [Closed] (SPARK-12748) Failed to create HiveContext in SparkSql

2016-01-16 Thread Ujjal Satpathy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ujjal Satpathy closed SPARK-12748. -- Resolution: Fixed > Failed to create HiveContext in SparkSql >

[jira] [Commented] (SPARK-12748) Failed to create HiveContext in SparkSql

2016-01-16 Thread Ujjal Satpathy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103092#comment-15103092 ] Ujjal Satpathy commented on SPARK-12748: Issue is resolved > Failed to create HiveContext in

[jira] [Updated] (SPARK-12722) Typo in Spark Pipeline example

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12722: -- Assignee: Jeff Lam > Typo in Spark Pipeline example > -- > >

[jira] [Resolved] (SPARK-12722) Typo in Spark Pipeline example

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12722. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11293: -- Target Version/s: (was: 1.6.0) > Spillable collections leak shuffle memory >

[jira] [Commented] (SPARK-11507) Error thrown when using BlockMatrix.add

2016-01-16 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103576#comment-15103576 ] yuhao yang commented on SPARK-11507: A fix has been merged into Breeze.

[jira] [Commented] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103589#comment-15103589 ] Apache Spark commented on SPARK-11518: -- User 'tritab' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11518: Assignee: (was: Apache Spark) > The script spark-submit.cmd can not handle spark

[jira] [Assigned] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11518: Assignee: Apache Spark > The script spark-submit.cmd can not handle spark directory with

[jira] [Updated] (SPARK-12845) During join Spark should pushdown predicates on joining column to both tables

2016-01-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12845: --- Description: I have following issue. I'm connecting two tables with where condition {code}

[jira] [Updated] (SPARK-12845) During join Spark should pushdown predicates on joining column to both tables

2016-01-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12845: --- Description: I have following issue. I'm connecting two tables with where condition {code}

[jira] [Resolved] (SPARK-1018) take and collect don't work on HadoopRDD

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1018. -- Resolution: Not A Problem > take and collect don't work on HadoopRDD >

[jira] [Resolved] (SPARK-2698) RDD pages shows negative bytes remaining for some executors

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2698. -- Resolution: Not A Problem We fixed a number of negative values in the UI in about 1.5; reopen if this

[jira] [Resolved] (SPARK-2401) AdaBoost.MH, a multi-class multi-label classifier

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2401. -- Resolution: Duplicate > AdaBoost.MH, a multi-class multi-label classifier >

[jira] [Created] (SPARK-12858) Remove duplicated code in metrics

2016-01-16 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-12858: --- Summary: Remove duplicated code in metrics Key: SPARK-12858 URL: https://issues.apache.org/jira/browse/SPARK-12858 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103272#comment-15103272 ] Sean Owen commented on SPARK-2243: -- You say you're concerned with over-utilizing a cluster for steps that

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103298#comment-15103298 ] Sean Owen commented on SPARK-2243: -- Yes, dynamic allocation operates in units of executors. You can make

[jira] [Created] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-12859: --- Summary: Names of input streams with receivers don't fit in Streaming page Key: SPARK-12859 URL: https://issues.apache.org/jira/browse/SPARK-12859 Project:

[jira] [Resolved] (SPARK-12796) initial prototype: projection/filter/range

2016-01-16 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12796. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10735

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Richard Marscher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103268#comment-15103268 ] Richard Marscher commented on SPARK-2243: - I fail to see how dynamic allocation would help, can

[jira] [Comment Edited] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Richard Marscher (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103268#comment-15103268 ] Richard Marscher edited comment on SPARK-2243 at 1/16/16 5:25 PM: -- I fail

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103289#comment-15103289 ] Jason Hubbard commented on SPARK-2243: -- I think what Richard is referring to and what we have seen as

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103348#comment-15103348 ] Jason Hubbard commented on SPARK-2243: -- Dynamic allocation allows executors to be started and stopped

[jira] [Assigned] (SPARK-12858) Remove duplicated code in metrics

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12858: Assignee: Apache Spark > Remove duplicated code in metrics >

[jira] [Commented] (SPARK-12858) Remove duplicated code in metrics

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103225#comment-15103225 ] Apache Spark commented on SPARK-12858: -- User 'BenFradet' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12858) Remove duplicated code in metrics

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12858: Assignee: (was: Apache Spark) > Remove duplicated code in metrics >

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12859: -- Priority: Trivial (was: Major) This can't be considered "Major". It's a mild cosmetic problem >

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103419#comment-15103419 ] Jason Hubbard commented on SPARK-2243: -- There is a limit to how small you can make the heap before

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103451#comment-15103451 ] Sean Owen commented on SPARK-2243: -- What do you mean? each context operates independently no matter where

[jira] [Commented] (SPARK-12747) Postgres JDBC ArrayType(DoubleType) 'Unable to find server array type'

2016-01-16 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103393#comment-15103393 ] Brandon Bradley commented on SPARK-12747: - Got a similar error for DecimalType.SYSTEM_DEFAULT. >

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103429#comment-15103429 ] Sean Owen commented on SPARK-2243: -- But the question isn't multiple JVMs or multiple contexts -- it's

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103476#comment-15103476 ] Jason Hubbard commented on SPARK-2243: -- It seems feasible to me to implement such functionality and

[jira] [Comment Edited] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-16 Thread Jon Maurer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103460#comment-15103460 ] Jon Maurer edited comment on SPARK-11518 at 1/16/16 9:57 PM: - Try adding

[jira] [Commented] (SPARK-11518) The script spark-submit.cmd can not handle spark directory with space.

2016-01-16 Thread Jon Maurer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103460#comment-15103460 ] Jon Maurer commented on SPARK-11518: Try adding quotes: rem cmd /V /E /C "%~dp0spark-submit2.cmd"

[jira] [Commented] (SPARK-12669) Organize options for default values

2016-01-16 Thread Mohit Jaggi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103441#comment-15103441 ] Mohit Jaggi commented on SPARK-12669: - Based on my experience working with CSV files, I think the

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Jason Hubbard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103446#comment-15103446 ] Jason Hubbard commented on SPARK-2243: -- The difference between N contexts in N JVMs and N contexts in

[jira] [Commented] (SPARK-2243) Support multiple SparkContexts in the same JVM

2016-01-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103407#comment-15103407 ] Sean Owen commented on SPARK-2243: -- Executors have the same heap size, yes, but the total heap available

[jira] [Commented] (SPARK-12669) Organize options for default values

2016-01-16 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103584#comment-15103584 ] Hossein Falaki commented on SPARK-12669: This looks like a good categorization. We have full

[jira] [Created] (SPARK-12860) speed up safe projection for primitive types

2016-01-16 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12860: --- Summary: speed up safe projection for primitive types Key: SPARK-12860 URL: https://issues.apache.org/jira/browse/SPARK-12860 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-12860) speed up safe projection for primitive types

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12860: Assignee: Apache Spark > speed up safe projection for primitive types >

[jira] [Commented] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

2016-01-16 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103604#comment-15103604 ] Xiao Li commented on SPARK-10777: - [~kevinyu98] My PR https://github.com/apache/spark/pull/10678 also

[jira] [Assigned] (SPARK-12860) speed up safe projection for primitive types

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12860: Assignee: (was: Apache Spark) > speed up safe projection for primitive types >

[jira] [Commented] (SPARK-12860) speed up safe projection for primitive types

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103603#comment-15103603 ] Apache Spark commented on SPARK-12860: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2016-01-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103259#comment-15103259 ] Apache Spark commented on SPARK-7780: - User 'holdenk' has created a pull request for this issue:

[jira] [Updated] (SPARK-12859) Names of input streams with receivers don't fit in Streaming page

2016-01-16 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Laskowski updated SPARK-12859: Attachment: spark-streaming-webui-names-too-long-to-fit.png > Names of input streams with