Hi,
Recently I was working on a PR to use Tachyon as OFF_HEAP store for Spark
Streaming and make sure Spark Streaming can recover from Driver failure and
recover the blocks form Tachyon.
The The Motivation for this PR is :
If Streaming application stores the blocks OFF_HEAP, it may not need any
Hi! First time poster, long time reader.
I'm wondering if there is a way to let cataylst know that it doesn't need
to repeat a filter on the spark side after a filter has been applied by the
Source Implementing PrunedFilterScan.
This is for a usecase in which we except a filter on a non-existant
Ignoring my previous question, +1. Tested several different jobs on
YARN and standalone with dynamic allocation on.
On Fri, Sep 25, 2015 at 11:32 AM, Marcelo Vanzin wrote:
> Mostly for my education (I hope), but I was testing
> "spark-1.5.1-bin-without-hadoop.tgz" assuming it would contain
> ever
Mostly for my education (I hope), but I was testing
"spark-1.5.1-bin-without-hadoop.tgz" assuming it would contain
everything (including HiveContext support), just without the Hadoop
common jars in the assembly. But HiveContext is not there.
Is this expected?
On Thu, Sep 24, 2015 at 12:27 AM, Rey
+1 - Ran TPCDS and some other micro benchmarks
On Fri, Sep 25, 2015 at 11:09 AM, Tom Graves
wrote:
> +1. Tested Spark on Yarn on Hadoop 2.6 and 2.7.
>
> Tom
>
>
>
> On Thursday, September 24, 2015 2:34 AM, Reynold Xin
> wrote:
>
>
> Please vote on releasing the following candidate as Apache Spa
+1. Tested Spark on Yarn on Hadoop 2.6 and 2.7.
Tom
On Thursday, September 24, 2015 2:34 AM, Reynold Xin
wrote:
Please vote on releasing the following candidate as Apache Spark version
1.5.1. The vote is open until Sun, Sep 27, 2015 at 10:00 UTC and passes if a
majority of at leas
On Wed, Sep 23, 2015 at 4:43 PM, Patrick Wendell wrote:
> For me a key step in moving away would be to fully audit/understand
> all compatibility implications of removing it. If other people are
> supportive of this plan I can offer to help spend some time thinking
> about any potential corner cas
+1 (non-binding)
Regards,
Vaquar khan
On 25 Sep 2015 18:28, "Eugene Zhulenev" wrote:
> +1
>
> Running latest build from 1.5 branch, SO much more stable than 1.5.0
> release.
>
> On Fri, Sep 25, 2015 at 8:55 AM, Doug Balog
> wrote:
>
>> +1 (non-binding)
>>
>> Tested on secure YARN cluster with H
Work underway at ...
https://issues.apache.org/jira/browse/SPARK-10833
https://github.com/apache/spark/pull/8919
On Fri, Sep 25, 2015 at 8:54 AM, Sean Owen wrote:
> Update: I *think* the conclusion was indeed that nothing needs to
> happen with NOTICE.
> However, along the way in
> https://iss
+1
Running latest build from 1.5 branch, SO much more stable than 1.5.0
release.
On Fri, Sep 25, 2015 at 8:55 AM, Doug Balog wrote:
> +1 (non-binding)
>
> Tested on secure YARN cluster with HIVE.
>
> Notes: SPARK-10422, SPARK-10737 were causing us problems with 1.5.0. We
> see 1.5.1 as a big i
+1 (non-binding)
Tested on secure YARN cluster with HIVE.
Notes: SPARK-10422, SPARK-10737 were causing us problems with 1.5.0. We see
1.5.1 as a big improvement.
Cheers,
Doug
> On Sep 24, 2015, at 3:27 AM, Reynold Xin wrote:
>
> Please vote on releasing the following candidate as Apache
Send an email to dev-unsubscr...@spark.apache.org instead of
dev@spark.apache.org
Thanks
Best Regards
On Fri, Sep 25, 2015 at 4:00 PM, Nirmal R Kumar
wrote:
>
On Fri, Sep 25, 2015 at 10:06 AM, Steve Loughran wrote:
> regarding the spark one, I don't see that you need to refer to transitive
> dependencies for the non-binary distros, and, for any binaries, to bother
> listing the licensing of all the ASF dependencies. Things pulled in from
> elsewhere
> On 24 Sep 2015, at 21:11, Sean Owen wrote:
>
> Yes, but the ASF's reading seems to be clear:
> http://www.apache.org/dev/licensing-howto.html#permissive-deps
> "In LICENSE, add a pointer to the dependency's license within the
> source tree and a short note summarizing its licensing:"
>
> I'd
Update: I *think* the conclusion was indeed that nothing needs to
happen with NOTICE.
However, along the way in
https://issues.apache.org/jira/browse/LEGAL-226 it emerged that the
BSD/MIT licenses should be inlined into LICENSE (or copied in the
distro somewhere). I can get on that -- just some gru
16 matches
Mail list logo
