Re: Incubator report for July

I can help. Sijie On Saturday, July 9, 2016, Henry Saputra wrote: > Hi All, > > Any volunteer to write report for July [1]? > > It is overdue but I think we could still make it. > > - Henry > > [1] https://wiki.apache.org/incubator/July2016 >

[DRAFT] DistributedLog Report

Hello all, Below is the draft of incubator report for DistributedLog. Let me know if it looks good. --- DistributedLogDistributedLog is a high-performance replicated log service. It offersdurability, replication and strong consistency, which provides a fundamentalbuilding block for building rel

Re: Incubator report for July

I wrote a draft. let me know if it works. - Sijie On Sun, Jul 10, 2016 at 9:20 AM, Sijie Guo wrote: > I can help. > > Sijie > > > On Saturday, July 9, 2016, Henry Saputra wrote: > >> Hi All, >> >> Any volunteer to write report for July [1]? >> >

Re: Board Report?

Thank you John! Sijie On Monday, July 11, 2016, John D. Ament wrote: > Hi Flavio, > > At this point I'd recommend that you guys wait. Reports were due last > Wednesday, we usually give a little bit of buffer. At this point, all sign > offs should have happened so you'll be really late. Its n

Create resources for DistributedLog Incubator Podling

FYI. https://issues.apache.org/jira/browse/INFRA-12242 for tracking the resources creation for DistributedLog, including git repo, github integration, confluence space, jira project and svn directories for hosting distributions and website. Let me know if I missed anything. - Sijie

Re: Create resources for DistributedLog Incubator Podling

Thanks Henry for reminds. I will follow up with our legal people for signing SGA. - Sijie On Fri, Jul 15, 2016 at 7:47 AM, Henry Saputra wrote: > Looks like https://issues.apache.org/jira/browse/INFRA-12196 is waiting > for > Twitter SGA > > On Tue, Jul 12, 2016 at 12:37 AM, S

DistributedLog Jira

The jira space for DistributedLog is created : https://issues.apache.org/jira/browse/DL I have created the components here: https://issues.apache.org/jira/browse/DL/?selectedTab=com.atlassian.jira.jira-projects-plugin:components-panel Also created the first release '0.4.0' : https://issues.apache

DistributedLog Confluence Space

The confluence space for DistributedLog is created : https://cwiki.apache.org/confluence/display/DL I've updated the home page to fill some basic information there. Please check and let me know if it makes sense. https://cwiki.apache.org/confluence/display/DL/Apache+DistributedLog+Home Ideally a

Re: Source code and contribution

Sethuraman, Cool. Glad that you are interested in this project. We just entered the incubator. We are still bootstrapping the infrastructure. Here are some information: wiki page: https://cwiki.apache.org/confluence/display/DL JIRA queue: https://issues.apache.org/jira/browse/DL Git repo: https

Re: Source code and contribution

On Thu, Jul 21, 2016 at 2:01 PM, Sijie Guo wrote: > Sethuraman, > > Cool. Glad that you are interested in this project. > > We just entered the incubator. We are still bootstrapping the > infrastructure. > > Here are some information: > > wiki page: https://cwiki.ap

Git repo

FYI. The git repo has been cloned from https://github.com/twitter/distributedlog. The incubator repo: https://git-wip-us.apache.org/repos/asf/incubator-distributedlog.git The github mirror: https://github.com/apache/incubator-distributedlog - Sijie

Git workflow

Hello all, Since the git repo has been cloned to apache and also mirrored on GitHub, we need to add a confluence page (we haven't moved the website yet) to describe the workflow to manage the pull requests and merge the code changes for both contributors and committers. I am thinking of two thing

Moved issues from twitter/distributedlog GitHub repo to Apache Jira

FYI. Since we moved DistributedLog to Apache Incubator, I moved all the issues from twitter/distributedlog GitHub repo https://github.com/twitter/distributedlog/issues to Apache Jira: https://issues.apache.org/jira/browse/DL We will move all the development work to Apache Incubator. - Sijie

Jenkins CI for DistributedLog

Hello all, I have created a nightly-build jenkins job for building distributedlog. https://builds.apache.org/job/distributedlog-nightly-build/ Also document the setup steps here at: https://cwiki.apache.org/confluence/display/DL/Continuous+Integration+Setup . Please take a look and let me know if

[DISCUSS] DEP-0: DistributedLog Enhancement Proposal

Hello all, Based on my previous email about workflow on managing the ideas/improvements, I am proposing to add a formal process for how we deal with major changes (design docs) to DL. I'd like to have such

Project Ideas

FYI. I threw a list of ideas in a confluence page. If you have any ideas, feel free to add to that page. If you are interested in contributions, feel to pick one and start the discussion with DL folks :-) https://cwiki.apache.org/confluence/display/DL/Project+Ideas - Sijie

Re: [draft] Podling report for August 2016

Franck, do you get a chance to incorporate Flavio and Chris and comments and update the draft? - Sijie On Thu, Jul 28, 2016 at 11:36 AM, Flavio Junqueira wrote: > Thanks for putting this together, Franck. A few things that might be worth > adding: > > - Status page is up and we have started fil

Re: Distributed Log as Kafka's backend

Khurrum, Interesting. Thank you for your interests in DistributedLog. Three years ago when we started the project internally at Twitter, we did have a plan to use it as a backend for both kestrel (Twitter's in-house queue system) and Kafka. However, we didn't go down that direction. Instead, we b

Re: [draft] Podling report for August 2016

org/jira/browse/DL) > * Repository has been created (and mirrored on GitHub) > * Existing issues have been migrated from the old GitHub repository to JIRA > > > On Sun, Jul 31, 2016 at 11:30 PM, Sijie Guo wrote: > > > Franck, do you get a chance to incorporate Flavio and Chris

Re: First release?

I was setting a 3-month release for 0.4.0. But I agreed with Flavio. It might be worth releasing a first apache release ASAP after sorting out any issues related to apache. - Sijie On Sun, Aug 7, 2016 at 8:27 AM, Flavio Junqueira wrote: > No pressure, really, but I was wondering what the plan f

Re: gRPC

The proxy layer isn't really tied to any protocol. It should be able to support any network wire protocol. Can you file a DL jira for this? - Sijie On Mon, Aug 1, 2016 at 2:07 PM, Jon Derrick wrote: > I saw the write proxy is using finagle and thrift for the wire protocol. > but the finagle thr

Re: Distributed Log as Kafka's backend

ow? > > KN > > On Sunday, July 31, 2016, Sijie Guo > wrote: > > > Khurrum, > > > > Interesting. Thank you for your interests in DistributedLog. > > > > Three years ago when we started the project internally at Twitter, we did > > have a plan to use

Re: question about DL namespace

Jon, Sorry for late response. This is a very good question. Comments in line. Sijie On Monday, August 15, 2016, Jon Derrick wrote: > Hello all, > > I read the distributed log code closely. I found that the DL namespace is a > flat namespace. There will be a potential issue if there are a lot o

Re: gRPC

github. But after you guys moved to Apache, not very sure how > does it work here. > > On Tue, Aug 9, 2016 at 12:58 PM, Sijie Guo > wrote: > > > The proxy layer isn't really tied to any protocol. It should be able to > > support any network wire protocol. Can

Re: JIRA board for DistributedLog?

Hello Fernando, First sorry for the inconvenience. We are still bootstrapping the website for the project. But yes, we have the jira queue and confluence page now. Jira queue: https://issues.apache.org/jira/browse/DL Confluence page: https://cwiki.apache.org/confluence/display/DL/Apache+Distribut

Re: Namespace in global replacation setup

FYI. We were discussing with https://github.com/twitter/distributedlog/issues/41 I also created https://issues.apache.org/jira/browse/DL-35 to document how to setup a global cluster. Since you almost got to setup a global cluster, are you willing to contribute to the documentation? - Sijie On

Website

Hi all, I put up a website following other apache project to use jekyll and bootstrap. the demo is here https://sijie.github.io/incubator-distributedlog/ and the git pull request: https://github.com/apache/incubator-distributedlog/pull/13 most of the links are pointed to http://distributedlog.io

Re: Website

nt to *asf-site *branch. Any thoughts? - Sijie On Tue, Aug 23, 2016 at 10:00 PM, Sijie Guo wrote: > Hi all, > > I put up a website following other apache project to use jekyll and > bootstrap. > > the demo is here https://sijie.github.io/incubator-distributedlog/ > and the

A few wiki pages

FYI. I copied a few wiki pages from BookKeeper wiki, hence I can use to point to people for making contributions. Contributing to DistributedLog : https://cwiki.apache.org/confluence/display/DL/Contributing+to+DistributedLog Coding Guide: https://cwiki.apache.org/confluence/pages/viewpage.action?

Re: Distributed Log as Kafka's backend

gt;> namespace/topic/subscriptions : storing all the subscriptions > >> namespace/topic/subscriptions/S : storing the information of > >> subscription `S` > >> > >> both `namespace/topic/partitions/N` and `namespace/topic/subscriptions > /S` > >>

Repackaging the package namespace

Does anyone know if it is required to repackage the namespace to under org.apache for the first release? Any suggestions from mentors? - Sijie

Re: Add DistributedLog IO

Wow. This sounds interesting. Look forward to this. Let us know if you need any helps. - Sijie On Wed, Aug 31, 2016 at 2:02 AM, Khurrum Nasim wrote: > Hello beam folks, > > We are evaluating a new solution to unify our streaming and batching data > pipeline, from storage, computing engine to pr

Re: Podling Report Reminder - September 2016

Anyone want to help come up a board report for this month? - Sijie On Tue, Aug 30, 2016 at 3:46 AM, wrote: > Dear podling, > > This email was sent by an automated system on behalf of the Apache > Incubator PMC. It is an initial reminder to give you plenty of time to > prepare your quarterly boa

Re: Website

I pushed old content to asf-site branch to current repo and enabled gitpubsub. So the content of distributedlog.io is alive at distributedlog.incubator.apache.org now. The new site will come up soon. Sijie On Thursday, August 25, 2016, Sijie Guo wrote: > Based on the post ht

Re: [DRAFT] Podling report for September 2016

LGTM +1 Btw you might need to request the permission to edit the incubator wiki. You can send an email to general@i.a.o to ask for the permission. Sijie On Tuesday, September 6, 2016, Khurrum Nasim wrote: > DistributedLog > > DistributedLog (DL) is a high-performance, replicated log service, o

Re: [DRAFT] Podling report for September 2016

> wrote: > > > If no objection, I will update the wiki to submit the report. > > > > KN > > > > On Tue, Sep 6, 2016 at 11:43 PM, Khurrum Nasim > > wrote: > > > >> Thank you Sijie. I've requested the wiki permission at the incubator &

Re: Website

release) and build the whole site. Let me know if the structure looks good. If it is okay, we can push the website and iterate from there. - Sijie On Mon, Sep 5, 2016 at 6:02 PM, Sijie Guo wrote: > I pushed old content to asf-site branch to current repo and enabled > gitpubsub. So the cont

Re: [DRAFT] Podling report for September 2016

t; > On 09 Sep 2016, at 16:20, Chris Nauroth > wrote: > > > > I entered my sign-off. Nice job, Khurrum! > > > > --Chris Nauroth > > > > On 9/7/16, 11:59 PM, "Sijie Guo" wrote: > > > >I submitted the podling report. > >

Re: Question about the sequence numbers

Hello Jay, There is an explanation in the API page - http://distributedlog.io/api/core.html#sequence-numbers In short, the transaction id is an application supplied sequence number. It is required to be non-decreasing. Users usually use either timestamp or offset (bytes written so far) as the tra

Re: Repackaging the package namespace

Any suggestions from mentors for the first release? - Sijie On Tue, Aug 30, 2016 at 11:18 PM, Sijie Guo wrote: > Does anyone know if it is required to repackage the namespace to under > org.apache for the first release? Any suggestions from mentors? > > - Sijie >

Re: user mail list

Jay, Thank you for asking. Unfortunately we don't have a user mail list yet. Since you are asking, it might be a good chance to have one. I need to ask the podling mentors to see if we can create one. Thank you, Sijie On Sat, Sep 10, 2016 at 2:52 PM, Jay Juma wrote: > Hello, > > Is there a us

Re: dev@distributedlog.incubator.apache.org

hello thinker0, if you want to join dev@d.i.a.o mail list, you need to send the email to dev-subscr...@distributedlog.incubator.apache.org , then you will receive an email and you can follow the instruction in that email to confirm. - Sijie On Sat, Sep 10, 2016 at 11:38 PM, thinker0 wrote: >

Re: Single writer and fencing

We had discussed about this feature internally at Twitter before. But we haven't got the chance to implement this. I listed it in the 'Project Ideas' page - https://cwiki.apache.org/confluence/display/DL/Project+Ideas If you are interested in this feature, would you like to contribute? - Sijie

Re: question about DL namespace

. > > A namespace resolver will be added to the namespace metadata binding and > loaded via reflection. > > Any thoughts? I will send out a pull request soon. > > - jd > > > On Tue, Aug 23, 2016 at 9:07 AM, Khurrum Nasim > wrote: > > > On Thu,

Re: [Discuss] Transaction Support

This sounds interesting ... I will take a closer look and give my comments later. At the same time, do you mind creating a wiki page to put your idea there? You can add your wiki page under https://cwiki.apache.org/confluence/display/DL/Project+Proposals You might need to ask in the dev list to g

Re: [DRAFT] Podling report for September 2016

tributions would be great. > > -Flavio > > > On 10 Sep 2016, at 20:20, Sijie Guo wrote: > > > > Yup. +1 on Flavio's suggestion. We should start report these things on > next > > report. > > > > - Sijie > > > > On Fri, Sep 9, 2016 at 2:2

Re: user mail list

Any suggestions from mentors? Maybe it is a good time to have a user mail list? - Sijie On Sat, Sep 10, 2016 at 11:21 PM, Sijie Guo wrote: > Jay, > > Thank you for asking. Unfortunately we don't have a user mail list yet. > > Since you are asking, it might be a good chance

Re: Website

s related to user-guide <https://issues.apache.org/jira/browse/DL-53> and admin-guide <https://issues.apache.org/jira/browse/DL-54>. - Sijie On Fri, Sep 9, 2016 at 12:41 AM, Sijie Guo wrote: > I played with jekyll-rst plugin to build the documentation and pushed the > latest built we

Status of Travis CI and Jenkins Nightly Build

FYI. All the ci jobs are green now (both Travis CI and Jenkins). Huge shout out to Zhaijia for his work on helping improving the CI status. https://github.com/sijie/incubator-distributedlog/tree/sijie/update_readme - Sijie

Re: [DRAFT] Podling report for September 2016

Ah. sorry. I forgot to update the podling report. - Sijie On Wed, Sep 14, 2016 at 11:12 AM, Flavio Junqueira wrote: > I have signed off even though it hasn't been updated. Let's leave the > improvements to the next report. > > -Flavio > > > On 13 Sep 2

Re: Wrong email list to sent Git and JIRA updates?

No objection from me. Thank you, Henry. - Sijie On Sat, Sep 17, 2016 at 3:01 PM, Henry Saputra wrote: > The JIRA issues for infra are these: > > https://issues.apache.org/jira/browse/INFRA-12243 > https://issues.apache.org/jira/browse/INFRA-12245 > > It didnt specify the target list so I assume

Re: Duplicate transaction ids

On Wed, Sep 21, 2016 at 2:17 AM, Leigh Stewart wrote: > > > > Perhaps they are not equivalent or perhaps I have the wrong idea? > > > They are not equivalent. Txnid is just a handy user defined sequence id. > > The unique id is the DLSN. Uniqueness of this id is guaranteed by DLOG. > > Thx > > On

Re: Repackaging the package namespace

; consider > >> > carefully how they will approach this transition. > >> > > >> > > >> > > >> > My suggestion is to repackage before the first release, though. This > way > >> > applications written against the early release

Re: [Discuss] Transaction Support

> > > I attempted to create a wiki page under that space. I found that I am not > > authorized with edit permission. > > > > Can any of the committers grant me the wiki edit permission? My account > is > > "xi.liu.ant". > > > > - Xi > &g

Re: Proxy Client - Batch Ordering / Commit

Cameron, I think both Leigh and Xi had made a few good points about your question. To add one more point to your question - "but I am not 100% of how all of the futures in the code handle failures. If not, where in the code would be the relevant places to add the ability to do this, and would the

Re: October 2016 Podling Report Draft Feedback

Ah, Chris, thank you so much. Leigh was helping with the report. Leigh, can you incorporate Chris's comments? - Sijie On Fri, Oct 7, 2016 at 6:00 PM, Chris Nauroth wrote: > Thank you, Khurrum. > > I suspect it will be difficult to finalize this roadmap before the report > is due. For now, I s

Fwd: BookKeeper Meetup on Nov 15th

FYI. If you are interested in this event. -- Forwarded message -- From: Matteo Merli Date: Thu, Oct 13, 2016 at 11:53 PM Subject: BookKeeper Meetup on Nov 15th To: Bookkeeper-Dev Hi all, we're in the process to organize a BookKeeper meetup for the next Tue. November 15th. Th

Re: Best practices

When using core api, there can be only one writer at a given time. so when the writer issues two writes, the two writes will be in the time order of when they were written. However when using thin client, there can be multiple writers. the order of the writes coming from different writers is deter

Re: Proxy Client - Batch Ordering / Commit

. I think it should not be very difficult to support. There might be some changes in the server side. Let's figure out what will the changes be. Are you guys interested in contributing? > > Thanks, > Cameron > > > On Sat, Oct 8, 2016 at 7:35 AM, Leigh Stewart > &

Re: Python

Hello Poule, There is no python client available at this point. There is a ticket about creating a c++ client : https://issues.apache.org/jira/browse/DL-6 After that, it might be easier to create a python binding. - Sijie On Tue, Oct 18, 2016 at 11:05 AM, Poule Dodue wrote: > hi > > what woul

Re: A global cluster for both global streams and local streams

On Fri, Oct 14, 2016 at 2:16 AM, Jay Juma wrote: > based on my understanding, a global cluster can be setup to spread over > multiple datacenters and the data placement policy will place the data over > multiple datacenters. > > My question is "is it possible to create a log stream on a global cl

Re: [Discuss] Transaction Support

details. At the same > time, any comments are welcome. > > - Xi > > > > On Sat, Oct 8, 2016 at 6:58 AM, Sijie Guo > > wrote: > > > Xi, > > > > I just granted you the edit permission. > > > > - Sijie > > > > On Fri, Oct 7

Proxy Client - Batch Ordering / Commit

On Monday, October 17, 2016, Cameron Hatfield wrote: > Answer inline: > > On Mon, Oct 17, 2016 at 11:46 AM, Sijie Guo wrote: > > > Cameron, > > > > Thank you for your summary. I liked the discussion here. I also liked the > > summary of your requirement -

Re: Proxy Client - Batch Ordering / Commit

On Wed, Oct 19, 2016 at 7:17 PM, Sijie Guo wrote: > > > On Monday, October 17, 2016, Cameron Hatfield wrote: > >> Answer inline: >> >> On Mon, Oct 17, 2016 at 11:46 AM, Sijie Guo wrote: >> >> > Cameron, >> > >> > Thank you for

Re: Wrong email list to sent Git and JIRA updates?

Henry, Thank you for noticing this. I just created two jiras to update JIRA and GitHub to send comments/updates to dev@ . https://issues.apache.org/jira/browse/INFRA-12795 https://issues.apache.org/jira/browse/INFRA-12796 - Sijie On Sat, Sep 17, 2016 at 12:01 AM, Henry Saputra wrote: > The J

Re: Proxy Client - Batch Ordering / Commit

onal, so that if I client doesn't care about dupes > they don't have to deal with the process of getting a new epoch. > Yup. This should be optional. I can start a wiki page on how we want to implement this. Are you interested in contributing to this? > > -Cameron > &

Re: Distributedlog Podling Report Draft - November 2016

Thank you Jia and Flavio. Comments inline. On Tue, Nov 1, 2016 at 1:54 AM, Jia Zhai wrote: > Hi Sijie, > Would you please help address some of Flavio's comments first, You may have > more information for story behind the result. I would like to handle this > after your comments. > > Thanks a lot

Re: Proxy Client - Batch Ordering / Commit

I created https://issues.apache.org/jira/browse/DL-63 for tracking the proposed idea here. On Wed, Oct 26, 2016 at 4:53 PM, Sijie Guo wrote: > On Tue, Oct 25, 2016 at 11:30 AM, Cameron Hatfield > wrote: > > > Yes, we are reading the HBase WAL (from their replication p

Re: hundreds of millions of streams?

Poule, how long do you expect to keep the events for your 1 cart or 1 user? or in the words, how large is your event stream per cart or per user. it seems that you want some very lightweight stream/queue solutions - like support very large amount of streams and per stream throughput is not very hi

Re: Repackaging the package namespace

et me know if it is okay. > > > > - KN > > > > On Sat, Oct 8, 2016 at 6:55 AM, Sijie Guo wrote: > > > >> Khurrum, I don't think anyone is working on this now. Feel free to pick > it > >> up. > >> > >> - Sijie > >

Re: Distributedlog Podling Report Draft - November 2016

quests for repackaging. > - The major blocker is https://issues.apache.org/jira/browse/DL-2. We were > expecting to let DL depends on an official bk version. > > > > On Tue, Nov 1, 2016 at 5:54 PM, Sijie Guo wrote: > > > Thank you Jia and Flavio. Comments inline. &g

Fwd: BookKeeper Meetup at Yahoo - Tuesday, Nov 15, 2016

-- Forwarded message -- From: Sijie Guo Date: Tue, Nov 1, 2016 at 10:12 PM Subject: BookKeeper Meetup at Yahoo - Tuesday, Nov 15, 2016 To: d...@bookkeeper.apache.org, u...@bookkeeper.apache.org http://www.meetup.com/Apache-BookKeeper/events/235098921/ Community participation is greatly

Re: FileSystem API over distributedlog logs

On Wed, Nov 2, 2016 at 3:14 AM, Gerrit Sundaram wrote: > FYI - I tried to use the AppendOnlyStreamWriter and AppendOnlyStreamReader > to demonstrate the idea : https://github.com/apache/ > incubator-distributedlog/pulls/43 Let me know if this is a good direction > to go after. > > - Gerrit > > On

Re: Use DL stream to store offsets?

On Wed, Nov 2, 2016 at 2:43 AM, Khurrum Nasim wrote: > As part of implementing the kafka subscriber interface, I am wondering is > there anyone use DL stream for storing the offsets? > > For example, if I have N streams (0..N-1), I need to track the read offset > for each stream and store them so

Re: Repackaging the package namespace

e On Wed, Nov 2, 2016 at 2:25 AM, Khurrum Nasim wrote: > Any updates on this? Can we get this change in ASAP? so I can rebase my > branches to the new package namespace. Appreciate any updates. > > - KN > > On Tue, Nov 1, 2016 at 3:19 AM, Sijie Guo wrote: > > > Khurrum

Re: Distributedlog Podling Report Draft - November 2016

nfluence/display/DL/Developer+Guide > > >> https://cwiki.apache.org/confluence/display/DL/Committer+Guide > > >> 2. Involved more discussion of new ideas and bring in new features. > Include > > >> major discussions like 'transaction support', 'batch co

[DISCUSSION] First Release

I'd like to start the discussion about the first release. There are still a few discussions and pull requests outstanding. I think we need to pick up a few items and cut the first release and then iterate from there. Here is a list of items that I think we should include: - DL-4

Re: Proxy Client - Batch Ordering / Commit

osal page - > https://cwiki.apache.org/confluence/display/DL/DP-2+-+Epoch+Write+Support > Maybe we can work together with this. > > Sijie, Leigh, > > can you guys help review this to make sure our proposal is in the right > direction? > > - Xi > > On Tue, Nov 1, 2016 at

Re: FileSystem API over distributedlog logs

; - Gerrit > > > On Wed, Nov 2, 2016 at 10:35 AM, Sijie Guo wrote: > >> >> >> On Wed, Nov 2, 2016 at 3:14 AM, Gerrit Sundaram > > wrote: >> >>> FYI - I tried to use the AppendOnlyStreamWriter and >>> AppendOnlyStreamReader to demonstrate th

Re: [DISCUSS] DL Stream Operation Primitives

I liked this topic. A better name might be 'stream storage primitives', as we treat DL as a stream storage. Comments inline. On Wed, Nov 9, 2016 at 3:09 AM, Gerrit Sundaram wrote: > As what Sijie suggested in the other email thread, I started this email > thread for discussing the stream operati

Re: [DISCUSS] DL Stream Operation Primitives

On Sat, Nov 12, 2016 at 2:30 AM, Gerrit Sundaram wrote: > On Fri, Nov 11, 2016 at 1:09 PM, Sijie Guo wrote: > > > I liked this topic. A better name might be 'stream storage primitives', > as > > we treat DL as a stream storage. Comments inline. > > >

Re: Proxy Client - Batch Ordering / Commit

cases such as outstanding/buffered requests to the old stream, etc. > > The call could also return the new sessionid, making it a good call for > > storing or debugging the value. > > > > Session Fenced failure: > > Will this put the client into a failure state, sto

Re: Proxy Client - Batch Ordering / Commit

> > On Wed, Nov 16, 2016 at 12:14 PM, Sijie Guo > wrote: > > > Cameron, > > > > Can you send me your wiki account name? I can grant you the permission to > > edit it. > > > > - Sijie > > > > On Wed, Nov 16, 2016 at 12:11 PM, Cameron Hatfi

Re: [DISCUSSION] First Release

cker. >> >> On Tue, Nov 15, 2016 at 2:02 AM, Xi Liu wrote: >> >>> +1 especially on DL-23. >>> >>> - Xi >>> >>> On Sat, Nov 12, 2016 at 2:22 AM, Khurrum Nasim >>> wrote: >>> >>>> +1 (non-binding) >>>>

Re: [DISCUSS] DL Stream Operation Primitives

> > On Tue, Nov 15, 2016 at 2:14 AM, Sijie Guo wrote: > > > >> On Sat, Nov 12, 2016 at 2:30 AM, Gerrit Sundaram < > >> gerritsunda...@gmail.com> > >> wrote: > >> > >> > On Fri, Nov 11, 2016 at 1:09 PM, Sijie Guo wrote: > >>

Re: Proxy Client - Batch Ordering / Commit

o explicitly retrieve a new session id. > +1 for separating session from connection. Especially the 'session' here is more a lifecycle concept for a stream. > > > > > > Session Fenced failure: > > Will this put the client into a failure state, s

Fwd: Re: A bookkeeper DCOS/mesos package

is a new > > > release of bookkeeper, is there anything we need to update? Is it worth > > > adding to the release process? > > > > > > Thanks, > > > -Flavio > > > > > > > On 08 Nov 2016, at 19:43, Enrico Olivelli > wrote: > &g

Fwd: Re: A bookkeeper DCOS/mesos package

DCOS Universe package for DL proxy package. They are on my head currently, feel free to take it if you are interest. Regards. -Jia On Wed, Nov 23, 2016 at 1:04 AM, Sijie Guo wrote: > Flavio and JV raised a good point. I think we can investigate making > pushing a docker image as part o

Re: [DISCUSS] DL Stream Operation Primitives

Thanks in advance. > > - Gerrit > > On Thu, Nov 17, 2016 at 10:03 AM, Sijie Guo > wrote: > > > Gerrit, > > > > Can you send me your wiki account? > > > > - Sijie > > > > On Thu, Nov 17, 2016 at 1:38 AM, Gerrit Sundaram < > gerritsunda.

Re: Add DistributedLog IO

ttps://github.com/apache/incubator-beam/pull/1464 > > - KN > > On Thu, Sep 1, 2016 at 9:41 PM, Sijie Guo wrote: > >> Wow. This sounds interesting. Look forward to this. Let us know if you >> need >> any helps. >> >> - Sijie >> >> On Wed, A

Re: Some errors in building DL, help

That's my suspect too. Xiaoyuan, The maven might be hanging connecting to maven.twttr.com. Is your web browser using any proxy settings to access maven.twttr.com? You might try to configure your maven to use same proxy settings if it can't connect to maven.twttr.com. https://maven.apache.org/gu

Re: Some errors in building DL, help

> my-proxy > true > socks5 > my.host > 3633 > > password > aes-256-cfb > > I am sorry. I am not very familiar with the encryption setting. > > but failed, any idea? > I appreciate your help. > > Xiaoyua

Re: [DISCUSSION] First Release

t; > > > -Flavio > > > > > On 17 Nov 2016, at 05:12, Sijie Guo wrote: > > > > > > Flavio, > > > > > > I totally agreed that not using an official Apache version is not > great > > > for the community. We had a bookkeeper meetup

Re: [DISCUSSION] First Release

FYI. https://issues.apache.org/jira/browse/DL-81 is created for tracking building the process. https://issues.apache.org/jira/browse/INFRA-13024 and https://issues.apache.org/jira/browse/INFRA-13023 for setting the dists for DL. - Sijie On Fri, Dec 2, 2016 at 8:05 PM, Sijie Guo wrote

Re: Is there a page like "who is using BK/DL"?

I think both BK and DL have the poweredby cwiki page. Do you mean we open a dummy github issue for people to comment to register themselves? - Sijie On Sun, Dec 4, 2016 at 6:50 PM, Jia Zhai wrote: > Hi guys, > I found that in project RocketMQ, there is an open issue: > https://github.com/alibab

Re: Is there a page like "who is using BK/DL"?

Tue, Dec 6, 2016 at 4:21 AM, Sijie Guo wrote: > > > I think both BK and DL have the poweredby cwiki page. Do you mean we > open a > > dummy github issue for people to comment to register themselves? > > > > - Sijie > > > > On Sun, Dec 4, 2016 at 6:50 PM, Jia Z

DistributedLog Podling Report Draft - December 2016

Hi, all, Here is the draft of podling report. Please help review it. = DistributedLog DistributedLog is a high-performance replicated log service. It offers durability, replication and strong consistency, which provides a fundamental building block for buildi

Re: Is there a page like "who is using BK/DL"?

PM, Jia Zhai wrote: > > > Got it. I will open a ticket on Jira first. > > > > On Wed, Dec 7, 2016 at 11:05 AM, Khurrum Nasim > > wrote: > > > >> +1 for this idea. > >> > >> - KN > >> > >> On Mon, Dec 5, 2016 at 9:59 PM, Si

Re: DistributedLog Podling Report Draft - December 2016

first release. > > > > On Wed, Dec 7, 2016 at 12:19 AM, Sijie Guo wrote: > > > > > Hi, all, > > > > > > Here is the draft of podling report. Please help review it. > > > > > > = > > > &

Re: Etcd as the metadata store

Yes. we abstract all the metadata operations and data operations into interface. DL-117 is one of the jiras for abstracting metadata operations. After DL-117 is landed, it will be very easy to integrate etcd as the metadata store. - Sijie On Thu, Dec 8, 2016 at 9:36 AM, Jon Derrick wrote: > Hi,

  1   2   3   4   >