+1 thank you for putting this up, Sijie.
- KN
On Tue, Jan 31, 2017 at 11:17 PM, Xi Liu wrote:
> lgtm. +1
>
> it might be good to mention the slack channel for community development.
>
> - Xi
>
> On Tue, Jan 31, 2017 at 2:01 PM, Sijie Guo wrote:
>
> > Hi, all,
> >
> > Here is the draft of podli
+1
Excited to see this happen!
- kn
On Tue, Jan 17, 2017 at 9:12 AM, Leigh Stewart wrote:
> +1
>
> On Mon, Jan 16, 2017 at 8:13 AM, Jon Derrick
> wrote:
>
> > +1
> >
> > LGTM. compiled the source packages and ran dbench. the license files look
> > good.
> >
> > - jd
> >
> > On Tue, Jan 10, 20
Thanks Sijie for working on this. A couple of comments:
- do we need to publish artifacts for both scala 2.10 and 2.11 (probably
also 2.12)? as DL uses some scala libraries as the dependencies.
- the source jar is also missing. do we need it? it is usually useful to
have a source jar so that peopl
one question - bk is using protobuf 2.x while gRPC is using 3.x. IMO, they
are not backward compatible. Are you also considering moving bk's protobuf
to 3.x?
On Thu, Jan 5, 2017 at 10:29 PM, Gerrit Sundaram
wrote:
> Hello all,
>
> for the comment in
> https://github.com/apache/incubator-distribu
Either works for me.
- KN
On Thu, Dec 15, 2016 at 9:59 AM, Asko Kauppi wrote:
> Either works for me, too.
>
> > On 14 Dec 2016, at 10.32, Stevo Slavić wrote:
> >
> > Either works for me, as long as it's documented in project website and
> > readme file.
>
>
+1 for this idea.
- KN
On Mon, Dec 5, 2016 at 9:59 PM, Sijie Guo wrote:
> Sounds a good idea! Let's create one for that purpose.
>
> Sijie
>
> On Dec 5, 2016 6:00 PM, "Jia Zhai" wrote:
>
> > Yes. That is what I mean. By it, we may get more direct info about who
> is
> > intresting and want to
+1 also excited about the first release.
- KN
On Tue, Dec 6, 2016 at 5:51 PM, Jia Zhai wrote:
> +1 LGTM.
> looking foward for the first release.
>
> On Wed, Dec 7, 2016 at 12:19 AM, Sijie Guo wrote:
>
> > Hi, all,
> >
> > Here is the draft of podling report. Please help review it.
> >
> >
://github.com/apache/incubator-beam/pull/1464
- KN
On Thu, Sep 1, 2016 at 9:41 PM, Sijie Guo wrote:
> Wow. This sounds interesting. Look forward to this. Let us know if you need
> any helps.
>
> - Sijie
>
> On Wed, Aug 31, 2016 at 2:02 AM, Khurrum Nasim
> wrote:
>
> > He
Khurrum Nasim created DL-69:
---
Summary: Integrate DistributedLog with a tracing framework
Key: DL-69
URL: https://issues.apache.org/jira/browse/DL-69
Project: DistributedLog
Issue Type: New Feature
Khurrum Nasim created DL-68:
---
Summary: Erasure Coding for cold data
Key: DL-68
URL: https://issues.apache.org/jira/browse/DL-68
Project: DistributedLog
Issue Type: New Feature
Reporter
Khurrum Nasim created DL-67:
---
Summary: Crypto in DL
Key: DL-67
URL: https://issues.apache.org/jira/browse/DL-67
Project: DistributedLog
Issue Type: New Feature
Components: distributedlog
Khurrum Nasim created DL-66:
---
Summary: Resource Quota
Key: DL-66
URL: https://issues.apache.org/jira/browse/DL-66
Project: DistributedLog
Issue Type: New Feature
Components
+1 (non-binding)
I am also interested in participating.
- kn
On Tue, Nov 8, 2016 at 11:08 PM, Sijie Guo wrote:
> I'd like to start the discussion about the first release. There are still a
> few discussions and pull requests outstanding. I think we need to pick up a
> few items and cut the fir
Khurrum Nasim created DL-65:
---
Summary: Expose offset of records in the DL stream
Key: DL-65
URL: https://issues.apache.org/jira/browse/DL-65
Project: DistributedLog
Issue Type: Bug
[
https://issues.apache.org/jira/browse/DL-37?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Khurrum Nasim resolved DL-37.
-
Resolution: Won't Fix
As discussed in the pull request, it is a bit tricky to get a reliable way to
gen
e we can work something out.
>
> On Wed, Nov 2, 2016 at 8:15 AM, Leigh Stewart
> wrote:
>
> > We have in fact built something like this. No plans as yet to release,
> but
> > I think we would like to eventually.
> >
> > On Wed, Nov 2, 2016 at 2:43 AM, Khurrum Nasim
&
As part of implementing the kafka subscriber interface, I am wondering is
there anyone use DL stream for storing the offsets?
For example, if I have N streams (0..N-1), I need to track the read offset
for each stream and store them somewhere. I can probably use other external
services (like any ke
Khurrum Nasim created DL-64:
---
Summary: DL reader should handle and retry errors infinitely
Key: DL-64
URL: https://issues.apache.org/jira/browse/DL-64
Project: DistributedLog
Issue Type
back to you soon.
>
> - Sijie
>
> On Fri, Oct 21, 2016 at 2:41 AM, Khurrum Nasim
> wrote:
>
> > Forgot the pull request -
> > https://github.com/apache/incubator-distributedlog/pull/41
> >
> > - KN
> >
> > On Fri, Oct 21, 2016 at 2:41
+1 from me (non-binding).
- KN
On Tue, Nov 1, 2016 at 7:18 PM, Jia Zhai wrote:
> Thanks so much for your suggestions. Here is a new draft:
>
> ===
> DistributedLog
>
> DistributedLog is a high-performance replicated log service. It offers
> durability, replication and strong consistency
Forgot the pull request -
https://github.com/apache/incubator-distributedlog/pull/41
- KN
On Fri, Oct 21, 2016 at 2:41 AM, Khurrum Nasim
wrote:
> I just sent a pull request - repacked the package from
> com.twitter.distributedlog to org.apache.distributedlog.
>
> (basically just r
nyone is working on this now. Feel free to pick it
> up.
>
> - Sijie
>
> On Fri, Oct 7, 2016 at 10:37 AM, Khurrum Nasim
> wrote:
>
> > Is anyone working on repackaging? If no, can I pick this up?
> >
> > - KN
> >
> > On Sat, Sep 17, 2016 at 10:27
I just created a lira https://issues.apache.org/jira/browse/DL-60 for this.
A pull request will be sent out soon.
- KN
On Fri, Oct 7, 2016 at 6:32 AM, Khurrum Nasim
wrote:
> Cool. Thanks, Leigh.
>
> - KN
>
> On Fri, Sep 30, 2016 at 11:11 AM, Leigh Stewart <
> lstew..
e release as an item under “most important issues” and mention that
> the repackaging topic is under discussion under “how has the project
> developed”.
>
> After those changes, I would be ready to enter my mentor sign-off.
>
> --Chris Nauroth
>
> On 10/7/16, 6:34 AM, "Kh
Is anyone working on repackaging? If no, can I pick this up?
- KN
On Sat, Sep 17, 2016 at 10:27 PM, Khurrum Nasim
wrote:
> +1
>
> On Mon, Sep 12, 2016 at 6:16 PM, Stevo Slavić wrote:
>
>> + 1 (non-binding) for doing it asap
>>
>> On Mon, Sep 12, 2016 at 11:40
I think the bk version is available in github. I added the following repo
in my pom file (
https://github.com/apache/incubator-distributedlog/blob/master/pom.xml#L203).
Does it work for you?
- KN
On Fri, Sep 23, 2016 at 11:21 PM, john.lonergan
wrote:
> Sure thanks
> Original message --
I am interested in a road map about the first apache release. I think it is
worth having first apache release go out as soon as possible. especially
the repackaging decision.
- KN
On Wed, Oct 5, 2016 at 1:21 PM, Chris Nauroth wrote:
> I have reviewed the current draft of the next podling report
pull/30
>
> On Thu, Sep 29, 2016 at 9:50 PM, Khurrum Nasim
> wrote:
>
> > I confirmed that I can subscribe to the user@d.i.a.o list. Thanks Chris.
> >
> > I think we should also update the website to add the new user list.
> Anyone
> > knows how to update t
7/16, 8:18 PM, "Jay Juma" wrote:
>
> +1 for a separated user mail list.
>
> It is convient for newbies like me. And most of the development
> discussion
> are irrelevant to me.
>
> - Jay
>
> On Sun, Sep 18, 2016 at 10:12 AM, Khurrum Nasim &
+1
On Mon, Sep 12, 2016 at 6:16 PM, Stevo Slavić wrote:
> + 1 (non-binding) for doing it asap
>
> On Mon, Sep 12, 2016 at 11:40 AM, Flavio Junqueira wrote:
>
> > It isn't strictly necessary, here is what the documentation says:
> >
> > On Repackaging
> >
> > It is recommended - but not mandated
dded to the namespace metadata binding and
> loaded via reflection.
>
> Any thoughts? I will send out a pull request soon.
>
> - jd
>
>
> On Tue, Aug 23, 2016 at 9:07 AM, Khurrum Nasim
> wrote:
>
> > On Thu, Aug 18, 2016 at 2:30 AM, Sijie Guo wrote:
> >
>
Xi,
The "stream level" transaction makes more sense to me. It is an extension
of 'atomic write' records over the size limitation. I can see the value of
having such ability.
But I am not convinced by the namespace level transaction. Do you have any
concrente use cases that you can talk about more
like was it one or more?
> > >>>>
> > >>>> It is not a big issue to not report these things early on, but I
> find
> > it
> > >>>> good practice to do it even if the numbers aren't impressive at this
> > >> point
&g
Awesome. The website looks good.
Sijie, it would be good if you can add a documentation on how to build the
website and the documentation.
- KN
On Tue, Sep 13, 2016 at 5:29 PM, Sijie Guo wrote:
> We shipped the website and it is live under
> http://distributedlog.incubator.apache.org/
>
> The
Chris & Sijie,
I felt it is worth separating the user and dev discussion into two mail
lists. As from subscribers' perspective, I can easily setup filtering rules
on two different mail lists and get all the information that I really care
about.
I'd prefer setting up a separated user list if we c
Good job, Jia.
- KN
On Wed, Sep 14, 2016 at 1:10 PM, Sijie Guo wrote:
> FYI.
>
> All the ci jobs are green now (both Travis CI and Jenkins). Huge shout out
> to Zhaijia for his work on helping improving the CI status.
>
> https://github.com/sijie/incubator-distributedlog/tree/sijie/update_readm
It seems that I have troubles with my account. Can anyone submit the report?
KN
On Wed, Sep 7, 2016 at 9:26 PM, Khurrum Nasim
wrote:
> If no objection, I will update the wiki to submit the report.
>
> KN
>
> On Tue, Sep 6, 2016 at 11:43 PM, Khurrum Nasim
> wrote:
>
>
If no objection, I will update the wiki to submit the report.
KN
On Tue, Sep 6, 2016 at 11:43 PM, Khurrum Nasim
wrote:
> Thank you Sijie. I've requested the wiki permission at the incubator list.
>
> - KN
>
> On Tue, Sep 6, 2016 at 6:48 PM, Sijie Guo wrote:
>
>>
ission.
>
> Sijie
>
> On Tuesday, September 6, 2016, Khurrum Nasim
> wrote:
>
> > DistributedLog
> >
> > DistributedLog (DL) is a high-performance, replicated log service,
> offering
> > durability, replication and strong consistency as essentials for
DistributedLog
DistributedLog (DL) is a high-performance, replicated log service, offering
durability, replication and strong consistency as essentials for building
reliable distributed systems.
Three most important issues to address in the move towards graduation:
* Getting an Apache release out
I can help. I will write one.
KN
On Thu, Sep 1, 2016 at 9:43 PM, Sijie Guo wrote:
> Anyone want to help come up a board report for this month?
>
> - Sijie
>
> On Tue, Aug 30, 2016 at 3:46 AM, wrote:
>
> > Dear podling,
> >
> > This email was sent by an automated system on behalf of the Apache
Hello beam folks,
We are evaluating a new solution to unify our streaming and batching data
pipeline, from storage, computing engine to programming model. The idea is
basically to implement the Kappa architecture, using DistributedLog as a
unified stream store for both streaming and batching, usin
; confusions. Any thoughts, Leigh?
> >
> > Also, Khurrum, did you talk with Kafka community? I am not sure if DL is
> > the right repo to host this. Does anyone else have better suggestions on
> > this?
> >
> > - Sijie
> >
> >
> >
> >
> >
&
Hi all,
We are investigating running write proxy together with bookie server. Does
anyone run DL in this way before? Any suggestions? Is there any concerns?
- KN
On Thu, Aug 25, 2016 at 1:28 AM, Khurrum Nasim
wrote:
> I sent out a pull request about the offset sequencer. https://github.com/
> apache/incubator-distributedlog/pull/15
>
> I am not sure if there is any code guideline to follow. I tried my best to
> follow existing code style
at 9:38 AM, Khurrum Nasim
wrote:
> Hi All,
>
> After read the DL code, we have a better idea on how to use distributed
> log as the kafka implementation. There are two approaches to do that: one
> is to use distributedlog-core library directly in kafka broker, while the
> other
+1 it looks good to me.
- KN
On Tue, Aug 23, 2016 at 10:00 PM, Sijie Guo wrote:
> Hi all,
>
> I put up a website following other apache project to use jekyll and
> bootstrap.
>
> the demo is here https://sijie.github.io/incubator-distributedlog/
> and the git pull request:
> https://github.com/
count. I can grant the permission to you, then you
> can edit.
>
> - Sijie
>
> On Mon, Aug 1, 2016 at 9:01 AM, Khurrum Nasim
> wrote:
>
> > Sijie,
> >
> > Thank you so much for your quick reply. We are using Kafka now and we are
> > interested in the
On Thu, Aug 18, 2016 at 2:30 AM, Sijie Guo wrote:
> Jon,
>
> Sorry for late response. This is a very good question. Comments in line.
>
> Sijie
>
> On Monday, August 15, 2016, Jon Derrick
> wrote:
>
> > Hello all,
> >
> > I read the distributed log code closely. I found that the DL namespace
> i
27;d be happy to
> guide and offer any helps.
>
> Also, it might be good if you can explain more about what you are planning
> to do. Other people in the community can chime in and discuss.
>
> Please let us know your thoughts. You are very welcome to make any
> contributions.
&g
Hello folks,
I saw there is a 'distributedlog-kafka' module in tutorials. But it seems
not complete yet. I am wondering if there is a plan to fully implement the
kafka's interface. It would be great if we can use kafka's interface to
access distributed log. I'd like to contribute if there is a pla
51 matches
Mail list logo
