[GitHub] incubator-distributedlog pull request #80: Add namespace watch tool

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-distributedlog/pull/80


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Error starting Bookeeper

[Henry Saputra]

Glad to hear you able to resolve it

- Henry

On Fri, Dec 23, 2016 at 11:01 AM, Arun Khetarpal 
wrote:

> Cancel that! It was a problem with my setup.
>
> Regards,
> Arun
>
> On Fri, Dec 23, 2016 at 11:26 PM, Arun Khetarpal <
> arunkhetarpa...@gmail.com>
> wrote:
>
> > I'm reading http://distributedlog.incubator.apache.org/docs/
> > latest/deployment/cluster.html.
> >
> > And i am running into the following error while starting Bookeeper [Its
> > the embedded instance, as in tutorial]
> >
> > $> SERVICE_PORT=3181 ./distributedlog-service/bin/dlog-daemon.sh start
> > bookie --conf ${DL_HOME}/distributedlog-service/conf/bookie-1.conf
> >
> > Couldn't find configured class(org.apache.bookkeeper.stats.
> > CodahaleMetricsServletProvider)
> > ...
> >
> > Any hints?
> >
> > Regards,
> > Arun
> >
> >
> >
>

Re: ZK subscription store

[Jay Juma]

Sijie,

Thank you for your reply.

I created a proposal about using log segment to store the subscription
updates for the subscription store.
https://cwiki.apache.org/confluence/display/DL/DP-7+-+LogSegment+based+subscription+store

Let me know if you have any suggestions.

- Jay

On Thu, Dec 15, 2016 at 11:34 AM, Sijie Guo  wrote:

> Hmm, this is a good idea. yes, we can use a log segment to store the DLSN
> changes for the subscription store. And I think that's basically how Pulsar
> is doing with its cursors.
>
> beside this, I had a brief discussion with Matteo Merli (who is the TL of
> Pulsar) about distributedlog and managedledger in Pulsar to see if we can
> standardize the 'log stream' representation over BookKeeper, so that Pulsar
> and the DL proxy services can use the same 'log stream' representation.
> However It requires more discussions between DL and Pulsar.
>
> If you are going to implement this, you might check pulsar's managedledger.
>
> - Sijie
>
>
> On Wed, Dec 14, 2016 at 6:21 PM, Jay Juma  wrote:
>
>> Hi,
>>
>> Currently there is a zookeeper based subscription store in DL. Why can't
>> DL store it using a log segment (ledger) and offer this capability in
>> distributedlog service?
>>
>> - Jay
>>
>
>

Re: [Discuss] Transaction Support

[Xi Liu]

Ping?

On Mon, Dec 19, 2016 at 8:28 AM, Xi Liu  wrote:

> Sijie,
>
> No. I thought it might be easier for people to comment on a google doc to
> gather the initial feedback. I will put the content back to wiki page once
> addressing the comments. Does that sound good to you?
>
> And thank you in advance.
>
> - Xi
>
>
>
> On Sun, Dec 18, 2016 at 8:48 AM, Sijie Guo  wrote:
>
>> Hi Xi,
>>
>> sorry for late response. I will review it soon.
>>
>> regarding this, a separate question "are we going to use google doc
>> instead
>> of email thread for any discussion"? I am a bit worried that the
>> discussion
>> will become lost after moving to google doc. No idea on how other apache
>> projects are doing.
>>
>> - Sijie
>>
>> On Wed, Dec 14, 2016 at 11:41 PM, Xi Liu  wrote:
>>
>> > Hi all,
>> >
>> > I finalized the first version of the design. This time I used a google
>> doc
>> > so that it is easier for commenting and add a link the wiki page. I will
>> > update this to the wiki page once we come to the finalized design.
>> >
>> > https://docs.google.com/document/d/14Ns05M8Z5a6DF6fHmWQwISyD5jjeK
>> > bSIGgSzXuTI5BA/edit
>> >
>> > Let me know if you have any questions. Appreciate your reviews!
>> >
>> > - Xi
>> >
>> >
>> >
>> >
>> >
>> > On Fri, Oct 28, 2016 at 7:58 AM, Leigh Stewart
>> > > > > wrote:
>> >
>> > > Interesting proposal. A couple quick notes while you continue to flesh
>> > this
>> > > out.
>> > >
>> > > a. just to be sure - does this eliminate the need to save seqno with
>> > > checkpoint?
>> > >
>> > > b. i.e. another way to describe this kind of improvement is "support
>> > > records (atomic writes) larger than 1MB", iiuc. the advantage being it
>> > > avoids the baggage of transactions. disadvantages include inability
>> to do
>> > > cross stream transactions, and flexibility (interleaving, etc) (are
>> there
>> > > others?).
>> > >
>> > > c. proxy use case is for supporting multiple writers - have you
>> thought
>> > > about how this would work with multiple writers?
>> > >
>> > > Thanks!
>> > >
>> > >
>> > > On Tue, Oct 18, 2016 at 6:45 PM, Sijie Guo > >
>> > > wrote:
>> > >
>> > > > Sound good to me. look forward to the detailed proposal.
>> > > >
>> > > > (I don't mind the format if it makes things easier to you)
>> > > >
>> > > > Sijie
>> > > >
>> > > > On Friday, October 14, 2016, Xi Liu  wrote:
>> > > >
>> > > > > Thank you, Sijie
>> > > > >
>> > > > > We have some internal discussions to sort out some details. We are
>> > > ready
>> > > > to
>> > > > > collaborate with the community for adding the transaction support
>> in
>> > > DL.
>> > > > > We'd like to share more.
>> > > > >
>> > > > > I created a proposal wiki here -
>> > > > > https://cwiki.apache.org/confluence/display/DL/DP-1+-+
>> > > > > DistributedLog+Transaction+Support
>> > > > >
>> > > > > (I followed KIP format and named it as DP (DistributedLog
>> Proposal -
>> > DP
>> > > > is
>> > > > > also short for Dynamic Programming). I don't know if you guys like
>> > this
>> > > > > name or not. Feel free to change it :D)
>> > > > >
>> > > > > I basically put my initial email as the content there so far.
>> Once we
>> > > > > finished our final discussion, I will update with more details. At
>> > the
>> > > > same
>> > > > > time, any comments are welcome.
>> > > > >
>> > > > > - Xi
>> > > > >
>> > > > >
>> > > > >
>> > > > > On Sat, Oct 8, 2016 at 6:58 AM, Sijie Guo > > > > >
>> > > > > wrote:
>> > > > >
>> > > > > > Xi,
>> > > > > >
>> > > > > > I just granted you the edit permission.
>> > > > > >
>> > > > > > - Sijie
>> > > > > >
>> > > > > > On Fri, Oct 7, 2016 at 10:34 AM, Xi Liu > > > > > > wrote:
>> > > > > >
>> > > > > > > I still can not edit the wiki. Can any of the pmc members
>> grant
>> > me
>> > > > the
>> > > > > > > permissions?
>> > > > > > >
>> > > > > > > - Xi
>> > > > > > >
>> > > > > > > On Sat, Sep 17, 2016 at 10:35 PM, Xi Liu <
>> xi.liu@gmail.com
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > > Sijie,
>> > > > > > > >
>> > > > > > > > I attempted to create a wiki page under that space. I found
>> > that
>> > > I
>> > > > am
>> > > > > > not
>> > > > > > > > authorized with edit permission.
>> > > > > > > >
>> > > > > > > > Can any of the committers grant me the wiki edit
>> permission? My
>> > > > > account
>> > > > > > > is
>> > > > > > > > "xi.liu.ant".
>> > > > > > > >
>> > > > > > > > - Xi
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > On Tue, Sep 13, 2016 at 9:26 AM, Sijie Guo <
>> si...@apache.org
>> > > > > > wrote:
>> > > > > > > >
>> > > > > > > >> This sounds interesting ... I will take a closer look and
>> give
>> > > my
>> > > > > > > comments
>> > > > > > > >> later.
>> > > > > > > >>
>> > > > > > > >> At the same time, do you mind creating a 

[GitHub] incubator-distributedlog issue #80: Add namespace watch tool

[sijie]

Github user sijie commented on the issue:

https://github.com/apache/incubator-distributedlog/pull/80
  
the tests failures are unrelated. +1 and will merge it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-distributedlog pull request #81: Add routing service to write prox...

[leighst]

Github user leighst closed the pull request at:

https://github.com/apache/incubator-distributedlog/pull/81


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---