[
https://issues.apache.org/jira/browse/SPARK-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12857:
--
Component/s: Documentation
Issue Type: Improvement (was: Bug)
It looks like "records" is used
[
https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103150#comment-15103150
]
Sean Owen commented on SPARK-12846:
---
The title isn't descriptive [~jeffzhang] -- what docs? it's
[
https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-11293:
--
Fix Version/s: (was: 1.6.0)
> Spillable collections leak shuffle memory
>
[
https://issues.apache.org/jira/browse/SPARK-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12831:
--
Component/s: Spark Core
> akka.remote.OversizedPayloadException on DirectTaskResult
>
[
https://issues.apache.org/jira/browse/SPARK-12827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12827:
--
Component/s: Web UI
Issue Type: Improvement (was: Bug)
> Configurable bind address for WebUI
>
[
https://issues.apache.org/jira/browse/SPARK-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12825:
--
Component/s: Spark Submit
> Spark-submit Jar URL loading fails on redirect
>
[
https://issues.apache.org/jira/browse/SPARK-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12831:
--
Target Version/s: (was: 1.5.2)
> akka.remote.OversizedPayloadException on DirectTaskResult
>
[
https://issues.apache.org/jira/browse/SPARK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12834:
--
Component/s: PySpark
> Use type conversion instead of Ser/De of Pickle to transform JavaArray and
>
[
https://issues.apache.org/jira/browse/SPARK-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103185#comment-15103185
]
Sean Owen commented on SPARK-1910:
--
[~hshreedharan] is this still active, do you think?
> Add
[
https://issues.apache.org/jira/browse/SPARK-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1972.
--
Resolution: Won't Fix
> Add support for setting and visualizing custom task-related metrics
>
[
https://issues.apache.org/jira/browse/SPARK-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2008.
--
Resolution: Won't Fix
> Enhance spark-ec2 to be able to add and remove slaves to an existing cluster
>
[
https://issues.apache.org/jira/browse/SPARK-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2095.
--
Resolution: Won't Fix
> sc.getExecutorCPUCounts()
> -
>
> Key:
[
https://issues.apache.org/jira/browse/SPARK-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu resolved SPARK-12856.
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 10784
[
https://issues.apache.org/jira/browse/SPARK-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103065#comment-15103065
]
Mridul Muralidharan commented on SPARK-6166:
We actually dont care about number of sockets or
[
https://issues.apache.org/jira/browse/SPARK-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-967.
-
Resolution: Not A Problem
I think this is obsolete, or no longer a problem; these scripts always respond
[
https://issues.apache.org/jira/browse/SPARK-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2389.
--
Resolution: Won't Fix
> globally shared SparkContext / shared Spark "application"
>
[
https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Bryński updated SPARK-12845:
---
Summary: During join Spark should pushdown predicates on joining column to
both tables
[
https://issues.apache.org/jira/browse/SPARK-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103076#comment-15103076
]
Apache Spark commented on SPARK-10735:
--
User 'davies' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-12748.
---
Resolution: Not A Problem
> Failed to create HiveContext in SparkSql
>
Jacek Laskowski created SPARK-12857:
---
Summary: Streaming tab in web UI uses records and events
interchangeably
Key: SPARK-12857
URL: https://issues.apache.org/jira/browse/SPARK-12857
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-925.
-
Resolution: Won't Fix
> Allow ec2 scripts to load default options from a json file
>
[
https://issues.apache.org/jira/browse/SPARK-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-593.
-
Resolution: Won't Fix
> Send last few lines of failed standalone mode or Mesos task to master
>
[
https://issues.apache.org/jira/browse/SPARK-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103184#comment-15103184
]
Sean Owen commented on SPARK-1747:
--
[~tgraves] is there a chance this is going to result in a change?
>
[
https://issues.apache.org/jira/browse/SPARK-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-7703.
--
Resolution: Duplicate
Fix Version/s: (was: 1.6.0)
Please resolve as duplicate then
> Task
[
https://issues.apache.org/jira/browse/SPARK-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reopened SPARK-7703:
--
> Task failure caused by block fetch failure in BlockManager.doGetRemote() when
> using TorrentBroadcast
>
[
https://issues.apache.org/jira/browse/SPARK-12846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12846:
--
Target Version/s: (was: 2.0.0)
Component/s: Documentation
> Follow up SPARK-12707, Update
[
https://issues.apache.org/jira/browse/SPARK-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-9297:
-
Assignee: Liang-Chi Hsieh
> covar_pop and covar_samp aggregate functions
>
[
https://issues.apache.org/jira/browse/SPARK-12856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12856:
--
Assignee: Wenchen Fan
> speed up hashCode of unsafe array
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1200.
--
Resolution: Won't Fix
I think Sandy (Ryza) reported this too but I doubt this is still on the radar
>
[
https://issues.apache.org/jira/browse/SPARK-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1153.
--
Resolution: Won't Fix
No activity in 2 years
> Generalize VertexId in GraphX so that UUIDs can be used
[
https://issues.apache.org/jira/browse/SPARK-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1270.
--
Resolution: Won't Fix
> An optimized gradient descent implementation
>
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103187#comment-15103187
]
Sean Owen commented on SPARK-2243:
--
I don't think this itself is a good argument for lots of contexts.
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2243.
--
Resolution: Won't Fix
> Support multiple SparkContexts in the same JVM
>
[
https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2335.
--
Resolution: Duplicate
Sounds like this is subsumed by discussion of the approximate version
>
[
https://issues.apache.org/jira/browse/SPARK-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2262.
--
Resolution: Won't Fix
> Extreme Learning Machines (ELM) for MLLib
>
[
https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reopened SPARK-12748:
---
> Failed to create HiveContext in SparkSql
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ujjal Satpathy closed SPARK-12748.
--
Resolution: Fixed
> Failed to create HiveContext in SparkSql
>
[
https://issues.apache.org/jira/browse/SPARK-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103092#comment-15103092
]
Ujjal Satpathy commented on SPARK-12748:
Issue is resolved
> Failed to create HiveContext in
[
https://issues.apache.org/jira/browse/SPARK-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12722:
--
Assignee: Jeff Lam
> Typo in Spark Pipeline example
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-12722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-12722.
---
Resolution: Fixed
Fix Version/s: 1.6.1
2.0.0
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-11293:
--
Target Version/s: (was: 1.6.0)
> Spillable collections leak shuffle memory
>
[
https://issues.apache.org/jira/browse/SPARK-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103576#comment-15103576
]
yuhao yang commented on SPARK-11507:
A fix has been merged into Breeze.
[
https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103589#comment-15103589
]
Apache Spark commented on SPARK-11518:
--
User 'tritab' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-11518:
Assignee: (was: Apache Spark)
> The script spark-submit.cmd can not handle spark
[
https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-11518:
Assignee: Apache Spark
> The script spark-submit.cmd can not handle spark directory with
[
https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Bryński updated SPARK-12845:
---
Description:
I have following issue.
I'm connecting two tables with where condition
{code}
[
https://issues.apache.org/jira/browse/SPARK-12845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maciej Bryński updated SPARK-12845:
---
Description:
I have following issue.
I'm connecting two tables with where condition
{code}
[
https://issues.apache.org/jira/browse/SPARK-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1018.
--
Resolution: Not A Problem
> take and collect don't work on HadoopRDD
>
[
https://issues.apache.org/jira/browse/SPARK-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2698.
--
Resolution: Not A Problem
We fixed a number of negative values in the UI in about 1.5; reopen if this
[
https://issues.apache.org/jira/browse/SPARK-2401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-2401.
--
Resolution: Duplicate
> AdaBoost.MH, a multi-class multi-label classifier
>
Benjamin Fradet created SPARK-12858:
---
Summary: Remove duplicated code in metrics
Key: SPARK-12858
URL: https://issues.apache.org/jira/browse/SPARK-12858
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103272#comment-15103272
]
Sean Owen commented on SPARK-2243:
--
You say you're concerned with over-utilizing a cluster for steps that
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103298#comment-15103298
]
Sean Owen commented on SPARK-2243:
--
Yes, dynamic allocation operates in units of executors. You can make
Jacek Laskowski created SPARK-12859:
---
Summary: Names of input streams with receivers don't fit in
Streaming page
Key: SPARK-12859
URL: https://issues.apache.org/jira/browse/SPARK-12859
Project:
[
https://issues.apache.org/jira/browse/SPARK-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Davies Liu resolved SPARK-12796.
Resolution: Fixed
Fix Version/s: 2.0.0
Issue resolved by pull request 10735
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103268#comment-15103268
]
Richard Marscher commented on SPARK-2243:
-
I fail to see how dynamic allocation would help, can
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103268#comment-15103268
]
Richard Marscher edited comment on SPARK-2243 at 1/16/16 5:25 PM:
--
I fail
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103289#comment-15103289
]
Jason Hubbard commented on SPARK-2243:
--
I think what Richard is referring to and what we have seen as
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103348#comment-15103348
]
Jason Hubbard commented on SPARK-2243:
--
Dynamic allocation allows executors to be started and stopped
[
https://issues.apache.org/jira/browse/SPARK-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-12858:
Assignee: Apache Spark
> Remove duplicated code in metrics
>
[
https://issues.apache.org/jira/browse/SPARK-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103225#comment-15103225
]
Apache Spark commented on SPARK-12858:
--
User 'BenFradet' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-12858:
Assignee: (was: Apache Spark)
> Remove duplicated code in metrics
>
[
https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-12859:
--
Priority: Trivial (was: Major)
This can't be considered "Major". It's a mild cosmetic problem
>
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103419#comment-15103419
]
Jason Hubbard commented on SPARK-2243:
--
There is a limit to how small you can make the heap before
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103451#comment-15103451
]
Sean Owen commented on SPARK-2243:
--
What do you mean? each context operates independently no matter where
[
https://issues.apache.org/jira/browse/SPARK-12747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103393#comment-15103393
]
Brandon Bradley commented on SPARK-12747:
-
Got a similar error for DecimalType.SYSTEM_DEFAULT.
>
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103429#comment-15103429
]
Sean Owen commented on SPARK-2243:
--
But the question isn't multiple JVMs or multiple contexts -- it's
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103476#comment-15103476
]
Jason Hubbard commented on SPARK-2243:
--
It seems feasible to me to implement such functionality and
[
https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103460#comment-15103460
]
Jon Maurer edited comment on SPARK-11518 at 1/16/16 9:57 PM:
-
Try adding
[
https://issues.apache.org/jira/browse/SPARK-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103460#comment-15103460
]
Jon Maurer commented on SPARK-11518:
Try adding quotes:
rem cmd /V /E /C "%~dp0spark-submit2.cmd"
[
https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103441#comment-15103441
]
Mohit Jaggi commented on SPARK-12669:
-
Based on my experience working with CSV files, I think the
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103446#comment-15103446
]
Jason Hubbard commented on SPARK-2243:
--
The difference between N contexts in N JVMs and N contexts in
[
https://issues.apache.org/jira/browse/SPARK-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103407#comment-15103407
]
Sean Owen commented on SPARK-2243:
--
Executors have the same heap size, yes, but the total heap available
[
https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103584#comment-15103584
]
Hossein Falaki commented on SPARK-12669:
This looks like a good categorization. We have full
Wenchen Fan created SPARK-12860:
---
Summary: speed up safe projection for primitive types
Key: SPARK-12860
URL: https://issues.apache.org/jira/browse/SPARK-12860
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-12860:
Assignee: Apache Spark
> speed up safe projection for primitive types
>
[
https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103604#comment-15103604
]
Xiao Li commented on SPARK-10777:
-
[~kevinyu98] My PR https://github.com/apache/spark/pull/10678 also
[
https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-12860:
Assignee: (was: Apache Spark)
> speed up safe projection for primitive types
>
[
https://issues.apache.org/jira/browse/SPARK-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103603#comment-15103603
]
Apache Spark commented on SPARK-12860:
--
User 'cloud-fan' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103259#comment-15103259
]
Apache Spark commented on SPARK-7780:
-
User 'holdenk' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacek Laskowski updated SPARK-12859:
Attachment: spark-streaming-webui-names-too-long-to-fit.png
> Names of input streams with
81 matches
Mail list logo