A related question - what is the expected release cadence? At least for the
next 12-18 months?
Since this is a new subproject, I am personally hoping it would have a faster
cadence at first, maybe one a month or once every couple of months... If so,
that would affect versioning.
Also, if it
lumn
I hope that helps, it strengthens your point!
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Fri, Dec 22, 2017 at 1:11 PM, Marco Gaido <marcogaid...@gmail.com> wrote:
> Hi Xiao, hi all,
>
> I checked the DB2 documentation f
be JDK 9
support.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Tue, Nov 28, 2017 at 9:20 AM, Zhang, Liyun <liyun.zh...@intel.com> wrote:
> Hi all:
>
> Does anyone know how to build spark with scala12.4? I want to test
>
localhost:9092 --date-format
HH:mm:ss:SSS
start.time, end.time, data.consumed.in.MB, MB.sec,
data.consumed.in.nMsg, nMsg.sec
19:32:53:408, 19:33:35:523, 9765.6250, 231.8800, 1000, 237445.0908
If you / someone has followup questions, might be best to do it off
Spark dev list...
Ofir Manor
Co
and incompatibilities.
Regarding the current behaviour, if I remember correctly I had to force our
spark O/S user into UTC so Spark wont change my timestamps.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Thu, May 25, 2017 at 1:33 PM, Reynold Xi
://equalum.atlassian.net/wiki/display/EQ/Kafka+performance+test+tool
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
ease cycle - but it seems SPARK-18350
was just introduced a couple of weeks ago. Maybe it should be reverted to
unblock the 2.2 release, and a more proper solution could be implemented
for the next release after a more comprehensive discussion?
Just my two cents,
Ofir Manor
Co-Founder & CTO | E
Looking good...
one small things - the documentation on the web site is still 2.1.0
Specifically, the home page has a link (under Documentation menu) labeled
Latest Release (Spark 2.1.1), but when I click it, I get the 2.1.0
documentation.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +97
I agree with you, I think that once we will have sessionization, we could
aim for richer processing capabilities per session. As far as I image it, a
session is an ordered sequence of data, that we could apply computation on
it (like CEP).
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +97
Assaf, I think what you are describing is actually sessionizing, by user,
where a session is ended by a successful login event.
On each session, you want to count number of failed login events.
If so, this is tracked by https://issues.apache.org/jira/browse/SPARK-10816
(didn't start yet)
Ofir
The discussion is whether Scala 2.10 should also be marked as deprecated
(no one is objecting that), and more importantly, when to actually move
from deprecation to actually dropping support for any combination of JDK /
Scala / Hadoop / Python.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +97
he app may want to access very old windows, unless it would
explicitly say otherwise.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Thu, Oct 27, 2016 at 9:46 AM, assaf.mendelson <assaf.mendel...@rsa.com>
wrote:
> Hi,
>
&
2.11 on JDK8.
Cody - Scala 2.12 will likely be released before Spark 2.1, maybe even
later this week: http://scala-lang.org/news/2.12.0-RC2
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Tue, Oct 25, 2016 at 7:28 PM, Cody Koeninge
of commiters
focusing on it?) and just fix it (recruit new commiters to work on it?) to
have a competitive streaming offering in a few quarters.
Just my two cents,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Wed, Oct 19, 2016 at 10:4
.
Any visibility / sharing will be highly appreciated!
thanks in advance,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
it a challenge to troubleshoot cases where submit fails,
especially when users tries our app on their own spark environment. He
hoped to get a more decent / specific exception if submit failed, or be
able to debug it in an IDE (the actual calling to the master, its response
etc).
Ofir Manor
Co-Founder
one of the open issues and write a sample
proposal? A concrete example might make it clearer for those who see this
for the first time. Maybe the Kafka offset discussion or some other
Kafka/Structured Streaming open issue? Will that be helpful?
Ofir Manor
Co-Founder & CTO | Equalum
Mobile:
full-time contributors work at a single company,
but they manage as a community to have a very transparent design and
development process, which seems to work great.
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Mon, Aug 29, 2016 at 10:3
t;old" Spark Streaming Programming Guide, as I
think many users will look for them. I had a "deep link" to that page so I
haven't noticed that it is very hard to find until now. I'm referring to
this page:
http://spark.apache.org/docs/latest/structured-streaming-programming-guide.ht
BTW - "signalling ahead of time" is called deprecating, not dropping
support...
(personally I only use JDK 8 / Scala 2.11 so I'm for it)
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Sun, Jul 24, 2016 at 1:50 AM, Koe
to hdfs or JDBC *stream("path")*,
where the path will be some sort of Kafka URI (maybe protocol + broker list
+ topic list). Is that the current thinking?
Thanks,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
2.0, so I think any backlash won't be dramatic
or lasting.
Just my two cents,
Ofir Manor
Co-Founder & CTO | Equalum
Mobile: +972-54-7801286 | Email: ofir.ma...@equalum.io
On Mon, Apr 4, 2016 at 6:48 PM, Luciano Resende <luckbr1...@gmail.com>
wrote:
> Reynold,
>
> Considering
22 matches
Mail list logo
