[
https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5297:
---
Assignee: Saisai Shao
File Streams do not work with custom key/values
[
https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4996:
---
Priority: Major (was: Blocker)
Memory leak?
Key: SPARK-4996
[
https://issues.apache.org/jira/browse/SPARK-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285255#comment-14285255
]
Patrick Wendell commented on SPARK-4996:
I'm de-escalating this right now because
[
https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4959:
---
Target Version/s: 1.3.0, 1.2.1 (was: 1.3.0)
Attributes are case sensitive when using
[
https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4296:
---
Fix Version/s: 1.2.1
1.3.0
Throw Expression not in GROUP BY when using
[
https://issues.apache.org/jira/browse/SPARK-5275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5275.
Resolution: Fixed
Assignee: Davies Liu
pyspark.streaming is not included in assembly
[
https://issues.apache.org/jira/browse/SPARK-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4959:
---
Comment: was deleted
(was: Note that in the 1.2 branch this was fixed by
https://github.com
[
https://issues.apache.org/jira/browse/SPARK-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285263#comment-14285263
]
Patrick Wendell commented on SPARK-4296:
Note this was fixed in https://github.com
[
https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4660:
---
Assignee: Piotr Kołaczkowski
JavaSerializer uses wrong classloader
[
https://issues.apache.org/jira/browse/SPARK-4660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-4660.
Resolution: Fixed
Fix Version/s: 1.2.1
1.1.2
[
https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5297:
---
Description:
The following code:
{code}
stream_context.K,V,SequenceFileInputFormatK
[
https://issues.apache.org/jira/browse/SPARK-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5270:
---
Summary: Provide isEmpty utility function in RDD API (was: Elegantly check
if RDD is empty
[
https://issues.apache.org/jira/browse/SPARK-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5270:
---
Summary: Provide isEmpty() function in RDD API (was: Provide isEmpty
utility function in RDD
[
https://issues.apache.org/jira/browse/SPARK-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5270:
---
Assignee: Sean Owen
Provide isEmpty utility function in RDD API
[
https://issues.apache.org/jira/browse/SPARK-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5270.
Resolution: Fixed
Fix Version/s: 1.3.0
Provide isEmpty() function in RDD API
[
https://issues.apache.org/jira/browse/SPARK-2595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2595.
Resolution: Won't Fix
Per PR comment, closing this for now.
The driver run garbage
[
https://issues.apache.org/jira/browse/SPARK-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5088.
Resolution: Fixed
Assignee: Jongyoul Lee
Use spark-class for running executors
[
https://issues.apache.org/jira/browse/SPARK-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5217.
Resolution: Fixed
Fix Version/s: 1.3.0
Spark UI should report pending stages during
[
https://issues.apache.org/jira/browse/SPARK-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-4417.
Resolution: Won't Fix
Assignee: Ilya Ganelin
[~ilganeli] ended up taking a crack
[
https://issues.apache.org/jira/browse/SPARK-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3758.
Resolution: Won't Fix
This patch ended up being so large, I think we're gonna pass
[
https://issues.apache.org/jira/browse/SPARK-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3288.
Resolution: Fixed
Fix Version/s: 1.3.0
Target Version/s: 1.3.0 (was: 1.2.0
[
https://issues.apache.org/jira/browse/SPARK-3288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3288:
---
Assignee: Ilya Ganelin (was: Dale Richardson)
All fields in TaskMetrics should be private
The wiki does not seem to be operational ATM, but I will do this when
it is back up.
On Mon, Jan 19, 2015 at 12:00 PM, Patrick Wendell pwend...@gmail.com wrote:
Okay - so given all this I was going to put the following on the wiki
tentatively:
## Reviewing Code
Community code review
the latter unless qualified in some other
way.
I don't have any opinion on the specific characters, but I agree with
Aaron that it would be nice to have some sort of abbreviation for both
the
strong and weak forms of approval.
-Sandy
On Jan 17, 2015, at 7:25 PM, Patrick Wendell
[
https://issues.apache.org/jira/browse/SPARK-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5249:
---
Summary: In SparkConf accept value with Any type and perform string
conversion (was: Added
[
https://issues.apache.org/jira/browse/SPARK-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282062#comment-14282062
]
Patrick Wendell commented on SPARK-5249:
I also updated the title to reflect what
[
https://issues.apache.org/jira/browse/SPARK-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5249.
Resolution: Won't Fix
Per discussion on the issue we've decided to just ask users
Akhil,
Those are handled by ASF infrastructure, not anyone in the Spark
project. So this list is not the appropriate place to ask for help.
- Patrick
On Sat, Jan 17, 2015 at 12:56 AM, Akhil Das ak...@sigmoidanalytics.com wrote:
My mails to the mailing list are getting rejected, have opened a
Akhil,
Those are handled by ASF infrastructure, not anyone in the Spark
project. So this list is not the appropriate place to ask for help.
- Patrick
On Sat, Jan 17, 2015 at 12:56 AM, Akhil Das ak...@sigmoidanalytics.com wrote:
My mails to the mailing list are getting rejected, have opened a
[
https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3694.
Resolution: Duplicate
Allow printing object graph of tasks/RDD's with a debug flag
[
https://issues.apache.org/jira/browse/SPARK-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5096.
Resolution: Fixed
Fix Version/s: 1.3.0
SparkBuild.scala assumes you
[
https://issues.apache.org/jira/browse/SPARK-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5096:
---
Target Version/s: (was: 1.0.3)
SparkBuild.scala assumes you are at the spark root dir
[
https://issues.apache.org/jira/browse/SPARK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5289.
Resolution: Fixed
Backport publishing of repl, yarn into branch-1.2
Hey All,
Just wanted to ping about a minor issue - but one that ends up having
consequence given Spark's volume of reviews and commits. As much as
possible, I think that we should try and gear towards Google Style
LGTM on reviews. What I mean by this is that LGTM has the following
semantics:
I
[
https://issues.apache.org/jira/browse/SPARK-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-4357.
Resolution: Fixed
Sorry this is actually working now. We now publish artifacts for Scala
[
https://issues.apache.org/jira/browse/SPARK-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5270:
---
Target Version/s: 1.3.0
Elegantly check if RDD is empty
[
https://issues.apache.org/jira/browse/SPARK-5260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5260:
---
Fix Version/s: (was: 1.3.0)
Expose JsonRDD.allKeysWithValueTypes() in a utility class
Patrick Wendell created SPARK-5289:
--
Summary: Backport publishing of repl, yarn, and hive-thriftserver
into branch-1.2
Key: SPARK-5289
URL: https://issues.apache.org/jira/browse/SPARK-5289
Project
[
https://issues.apache.org/jira/browse/SPARK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5289:
---
Summary: Backport publishing of repl, yarn into branch-1.2 (was: Backport
publishing of repl
[
https://issues.apache.org/jira/browse/SPARK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5289:
---
Description:
In SPARK-3452 we did some clean-up of published artifacts that turned out
[
https://issues.apache.org/jira/browse/SPARK-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5289:
---
Description: In SPARK-3452 we did some clean-up of published artifacts that
turned out
[
https://issues.apache.org/jira/browse/SPARK-4857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-4857.
Resolution: Fixed
Fix Version/s: 1.3.0
Add Executor Events to SparkListener
[
https://issues.apache.org/jira/browse/SPARK-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-2630.
Resolution: Duplicate
I think this is a dup of SPARK-4092.
Input data size
[
https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4955:
---
Priority: Blocker (was: Critical)
Dynamic allocation doesn't work in YARN cluster mode
[
https://issues.apache.org/jira/browse/SPARK-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4955:
---
Target Version/s: 1.3.0
Dynamic allocation doesn't work in YARN cluster mode
[
https://issues.apache.org/jira/browse/SPARK-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279863#comment-14279863
]
Patrick Wendell commented on SPARK-5216:
This has been proposed before
[
https://issues.apache.org/jira/browse/SPARK-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5176:
---
Labels: starter (was: )
Thrift server fails with confusing error message when deploy-mode
[
https://issues.apache.org/jira/browse/SPARK-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279869#comment-14279869
]
Patrick Wendell commented on SPARK-5176:
Yes, we should add a check here similar
[
https://issues.apache.org/jira/browse/SPARK-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279869#comment-14279869
]
Patrick Wendell edited comment on SPARK-5176 at 1/16/15 6:28 AM
It should appear in the page for any stage in which accumulators are updated.
On Wed, Jan 14, 2015 at 6:46 PM, Justin Yip yipjus...@prediction.io wrote:
Hello,
From accumulator documentation, it says that if the accumulator is named, it
will be displayed in the WebUI. However, I cannot find
[
https://issues.apache.org/jira/browse/SPARK-5078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5078.
Resolution: Fixed
Fix Version/s: 1.2.1
1.3.0
Allow setting Akka
[
https://issues.apache.org/jira/browse/SPARK-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5102.
Resolution: Fixed
Fix Version/s: 1.2.1
1.3.0
Fixed by: https
[
https://issues.apache.org/jira/browse/SPARK-5172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5172.
Resolution: Fixed
Fix Version/s: 1.3.0
Assignee: Sean Owen
spark-examples
[
https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274239#comment-14274239
]
Patrick Wendell commented on SPARK-4923:
Hey All,
Sorry this has caused
[
https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274239#comment-14274239
]
Patrick Wendell edited comment on SPARK-4923 at 1/12/15 9:58 PM
[
https://issues.apache.org/jira/browse/SPARK-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274263#comment-14274263
]
Patrick Wendell commented on SPARK-4923:
[~senkwich] definitely prefer github
[
https://issues.apache.org/jira/browse/SPARK-5102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5102:
---
Target Version/s: 1.2.1
Assignee: Lianhui Wang
CompressedMapStatus needs
[
https://issues.apache.org/jira/browse/SPARK-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3340:
---
Labels: starter (was: )
Deprecate ADD_JARS and ADD_FILES
[
https://issues.apache.org/jira/browse/SPARK-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-3450.
Resolution: Won't Fix
I'd prefer not to do this one, it complicates our parsing
Priority scheduling isn't something we've supported in Spark and we've
opted to support FIFO and Fair scheduling and asked users to try and
fit these to the needs of their applications.
In practice from what I've seen of priority schedulers, such as the
linux CPU scheduler, is that strict
[
https://issues.apache.org/jira/browse/SPARK-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273178#comment-14273178
]
Patrick Wendell commented on SPARK-1422:
Good call NIck - yeah let's close
[
https://issues.apache.org/jira/browse/SPARK-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1422.
Resolution: Won't Fix
Add scripts for launching Spark on Google Compute Engine
[
https://issues.apache.org/jira/browse/SPARK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-4399.
Resolution: Won't Fix
We'll let the community take this one on.
Support multiple cloud
[
https://issues.apache.org/jira/browse/SPARK-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5166:
---
Priority: Blocker (was: Critical)
Stabilize Spark SQL APIs
[
https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273225#comment-14273225
]
Patrick Wendell commented on SPARK-3561:
So if the question is: Is Spark only API
[
https://issues.apache.org/jira/browse/SPARK-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5032.
Resolution: Fixed
Fix Version/s: 1.3.0
MimaExcludes should not exclude GraphX
[
https://issues.apache.org/jira/browse/SPARK-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272214#comment-14272214
]
Patrick Wendell commented on SPARK-4737:
It's great to see this go in. Thanks
[
https://issues.apache.org/jira/browse/SPARK-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-1143.
Resolution: Fixed
Assignee: Kay Ousterhout (was: Nan Zhu)
ClusterSchedulerSuite
[
https://issues.apache.org/jira/browse/SPARK-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5163.
Resolution: Won't Fix
I'd prefer not to accept this patch for now - the spark-defaults.conf
[
https://issues.apache.org/jira/browse/SPARK-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5073:
---
Summary: spark.storage.memoryMapThreshold has two default values
[
https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-5136.
Resolution: Fixed
Fix Version/s: 1.2.1
1.3.0
Improve
[
https://issues.apache.org/jira/browse/SPARK-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5073:
---
Summary: spark.storage.memoryMapThreshold has two default value
[
https://issues.apache.org/jira/browse/SPARK-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell resolved SPARK-4048.
Resolution: Fixed
Fix Version/s: 1.3.0
Enhance and extend hadoop-provided profile
[
https://issues.apache.org/jira/browse/SPARK-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270616#comment-14270616
]
Patrick Wendell edited comment on SPARK-5152 at 1/9/15 6:19 AM
Nick - yes. Do you mind moving it? I should have put it in the
Contributing to Spark page.
On Thu, Jan 8, 2015 at 3:22 PM, Nicholas Chammas
nicholas.cham...@gmail.com wrote:
Side question: Should this section
Actually I went ahead and did it.
On Thu, Jan 8, 2015 at 10:25 PM, Patrick Wendell pwend...@gmail.com wrote:
Nick - yes. Do you mind moving it? I should have put it in the
Contributing to Spark page.
On Thu, Jan 8, 2015 at 3:22 PM, Nicholas Chammas
nicholas.cham...@gmail.com wrote:
Side
[
https://issues.apache.org/jira/browse/SPARK-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270616#comment-14270616
]
Patrick Wendell commented on SPARK-5152:
Should we be loading the metrics
[
https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-2620:
---
Assignee: Tobias Schlatter
case class cannot be used as key for reduce
[
https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270626#comment-14270626
]
Patrick Wendell commented on SPARK-5136:
I've updated it to be in the new location
[
https://issues.apache.org/jira/browse/SPARK-5136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270624#comment-14270624
]
Patrick Wendell commented on SPARK-5136:
Hey Guys,
I wrote that on the wiki quite
Patrick Wendell created SPARK-5158:
--
Summary: Allow for keytab-based HDFS security in Standalone mode
Key: SPARK-5158
URL: https://issues.apache.org/jira/browse/SPARK-5158
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5158:
---
Description:
There have been a handful of patches for allowing access to Kerberized HDFS
[
https://issues.apache.org/jira/browse/SPARK-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5097:
---
Priority: Critical (was: Major)
Adding data frame APIs to SchemaRDD
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267419#comment-14267419
]
Patrick Wendell commented on SPARK-1529:
Hey Sean,
From what I remember
[
https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267424#comment-14267424
]
Patrick Wendell commented on SPARK-1529:
BTW - I think if MapR wants to have
Patrick Wendell created SPARK-5113:
--
Summary: Audit and document use of hostnames and IP addresses in
Spark
Key: SPARK-5113
URL: https://issues.apache.org/jira/browse/SPARK-5113
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5113:
---
Description:
Spark has multiple network components that start servers and advertise
[
https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5113:
---
Description:
Spark has multiple network components that start servers and advertise
[
https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5113:
---
Description:
Spark has multiple network components that start servers and advertise
[
https://issues.apache.org/jira/browse/SPARK-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5113:
---
Description:
Spark has multiple network components that start servers and advertise
[
https://issues.apache.org/jira/browse/SPARK-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4737:
---
Affects Version/s: 1.0.2
1.1.1
Prevent serialization errors from ever
[
https://issues.apache.org/jira/browse/SPARK-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265416#comment-14265416
]
Patrick Wendell commented on SPARK-4687:
I spent some more time looking
Thanks for reporting this - it definitely sounds like a bug. Please
open a JIRA for it. My guess is that we define the start or end time
of the job based on the current time instead of looking at data
encoded in the underlying event stream. That would cause it to not
work properly when loading
Hi Alessandro,
Can you create a JIRA for this rather than reporting it on the dev
list? That's where we track issues like this. Thanks!.
- Patrick
On Wed, Dec 31, 2014 at 8:48 PM, Alessandro Baretta
alexbare...@gmail.com wrote:
Here's what the console shows:
15/01/01 01:12:29 INFO
[
https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5008:
---
Component/s: EC2
Persistent HDFS does not recognize EBS Volumes
[
https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-5008:
---
Labels: (was: amazon aws ec2 hdfs persistent)
Persistent HDFS does not recognize EBS
Patrick Wendell created SPARK-5025:
--
Summary: Write a guide for creating well-formed packages for Spark
Key: SPARK-5025
URL: https://issues.apache.org/jira/browse/SPARK-5025
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-4908:
---
Target Version/s: 1.2.1
Spark SQL built for Hive 13 fails under concurrent metadata queries
What do you mean when you say the overhead of spark shuffles start to
accumulate? Could you elaborate more?
In newer versions of Spark shuffle data is cleaned up automatically
when an RDD goes out of scope. It is safe to remove shuffle data at
this point because the RDD can no longer be
Hey Eric,
I'm just curious - which specific features in 1.2 do you find most
help with usability? This is a theme we're focusing on for 1.3 as
well, so it's helpful to hear what makes a difference.
- Patrick
On Sun, Dec 28, 2014 at 1:36 AM, Eric Friedman
eric.d.fried...@gmail.com wrote:
Hi
1101 - 1200 of 4069 matches
Mail list logo