Re: Region Server Info Port
bq. for reaching RS's webservices What information do you want to collect from region servers ? Have you considered using jmx ? See 8.3.5. JMX under http://hbase.apache.org/book.html#important_configurations Cheers On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer wrote: > Hi folks, > > I try to create new command for hbase client. It will show processlist > on RSs. I have a problem. I need RS's info port for reaching RS's > webservices. In testing side I can reach it with > > TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName). > However I can not reach Hmaster on client side. Is there anyway > learning RS infoport on client side ? > > P.s. Maybe you will say why you do not use regionserver.info.port. If > Hbase run on single machine as a pseduo distrubuted mod. the > configuration is not sample with real info port. > > Thanks > > -- > Talat >
Re: Region Server Info Port
I think you'll need to get the status info from the active master... which means going to ZK to find the active master. I guess you could also iterate the RS's in ZK directly, but this may be fragile as we don't consider ZK structure as part of our API compatibility guidelines. Can you use the shell's `status` command to get this info? I guess we don't guarantee compatibility on the output it produces either, but at least it does all the poking around on your behalf. Ted has been into this part of the code recently as part of his work on Apache Slider. Maybe he has some ideas for you. -n On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer wrote: > Hi folks, > > I try to create new command for hbase client. It will show processlist > on RSs. I have a problem. I need RS's info port for reaching RS's > webservices. In testing side I can reach it with > > TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName). > However I can not reach Hmaster on client side. Is there anyway > learning RS infoport on client side ? > > P.s. Maybe you will say why you do not use regionserver.info.port. If > Hbase run on single machine as a pseduo distrubuted mod. the > configuration is not sample with real info port. > > Thanks > > -- > Talat >
Re: Region Server Info Port
Hi Ted, I work on HBASE-4368. I try to reach "http://[rs-server]:[info_port]/rs-status?format=json&filter=all url fro getting task list on region server. But rs info_port can be change depends on hbase installation.Is it possible learning rs's info port ? 2015-01-21 19:26 GMT+02:00 Ted Yu : > bq. for reaching RS's webservices > > What information do you want to collect from region servers ? > Have you considered using jmx ? > See 8.3.5. JMX under > http://hbase.apache.org/book.html#important_configurations > > Cheers > > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer wrote: > >> Hi folks, >> >> I try to create new command for hbase client. It will show processlist >> on RSs. I have a problem. I need RS's info port for reaching RS's >> webservices. In testing side I can reach it with >> >> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName). >> However I can not reach Hmaster on client side. Is there anyway >> learning RS infoport on client side ? >> >> P.s. Maybe you will say why you do not use regionserver.info.port. If >> Hbase run on single machine as a pseduo distrubuted mod. the >> configuration is not sample with real info port. >> >> Thanks >> >> -- >> Talat >> -- Talat UYARER Websitesi: http://talat.uyarer.com Twitter: http://twitter.com/talatuyarer Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
Re: Region Server Info Port
HBaseAdmin provides this method:
public int getMasterInfoPort() throws IOException {
However, there is no counterpart for region server info port.
There're two options I can think of:
1. parse corresponding znode to extract this information
2. parse master UI to retrieve this information
Cheers
On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer wrote:
> Hi Ted,
>
> I work on HBASE-4368. I try to reach
> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all url
> fro getting task list on region server. But rs info_port can be change
> depends on hbase installation.Is it possible learning rs's info port ?
>
> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> > bq. for reaching RS's webservices
> >
> > What information do you want to collect from region servers ?
> > Have you considered using jmx ?
> > See 8.3.5. JMX under
> > http://hbase.apache.org/book.html#important_configurations
> >
> > Cheers
> >
> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer wrote:
> >
> >> Hi folks,
> >>
> >> I try to create new command for hbase client. It will show processlist
> >> on RSs. I have a problem. I need RS's info port for reaching RS's
> >> webservices. In testing side I can reach it with
> >>
> >>
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> >> However I can not reach Hmaster on client side. Is there anyway
> >> learning RS infoport on client side ?
> >>
> >> P.s. Maybe you will say why you do not use regionserver.info.port. If
> >> Hbase run on single machine as a pseduo distrubuted mod. the
> >> configuration is not sample with real info port.
> >>
> >> Thanks
> >>
> >> --
> >> Talat
> >>
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>
Re: Region Server Info Port
Is there any extraction for zk connection frpm client side ?
2015-01-22 0:42 GMT+02:00 Ted Yu :
> HBaseAdmin provides this method:
>
> public int getMasterInfoPort() throws IOException {
>
> However, there is no counterpart for region server info port.
>
> There're two options I can think of:
>
> 1. parse corresponding znode to extract this information
>
> 2. parse master UI to retrieve this information
>
> Cheers
>
> On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer wrote:
>
>> Hi Ted,
>>
>> I work on HBASE-4368. I try to reach
>> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all url
>> fro getting task list on region server. But rs info_port can be change
>> depends on hbase installation.Is it possible learning rs's info port ?
>>
>> 2015-01-21 19:26 GMT+02:00 Ted Yu :
>> > bq. for reaching RS's webservices
>> >
>> > What information do you want to collect from region servers ?
>> > Have you considered using jmx ?
>> > See 8.3.5. JMX under
>> > http://hbase.apache.org/book.html#important_configurations
>> >
>> > Cheers
>> >
>> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer wrote:
>> >
>> >> Hi folks,
>> >>
>> >> I try to create new command for hbase client. It will show processlist
>> >> on RSs. I have a problem. I need RS's info port for reaching RS's
>> >> webservices. In testing side I can reach it with
>> >>
>> >>
>> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
>> >> However I can not reach Hmaster on client side. Is there anyway
>> >> learning RS infoport on client side ?
>> >>
>> >> P.s. Maybe you will say why you do not use regionserver.info.port. If
>> >> Hbase run on single machine as a pseduo distrubuted mod. the
>> >> configuration is not sample with real info port.
>> >>
>> >> Thanks
>> >>
>> >> --
>> >> Talat
>> >>
>>
>>
>>
>> --
>> Talat UYARER
>> Websitesi: http://talat.uyarer.com
>> Twitter: http://twitter.com/talatuyarer
>> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>>
--
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
Re: Region Server Info Port
getRegionServerInfoPort() calls regionServerTracker.getRegionServerInfo(sn)
but RegionServerTracker is in hbase-server module :-(
On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer wrote:
> Is there any extraction for zk connection frpm client side ?
>
>
>
> 2015-01-22 0:42 GMT+02:00 Ted Yu :
> > HBaseAdmin provides this method:
> >
> > public int getMasterInfoPort() throws IOException {
> >
> > However, there is no counterpart for region server info port.
> >
> > There're two options I can think of:
> >
> > 1. parse corresponding znode to extract this information
> >
> > 2. parse master UI to retrieve this information
> >
> > Cheers
> >
> > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer wrote:
> >
> >> Hi Ted,
> >>
> >> I work on HBASE-4368. I try to reach
> >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all url
> >> fro getting task list on region server. But rs info_port can be change
> >> depends on hbase installation.Is it possible learning rs's info port ?
> >>
> >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> >> > bq. for reaching RS's webservices
> >> >
> >> > What information do you want to collect from region servers ?
> >> > Have you considered using jmx ?
> >> > See 8.3.5. JMX under
> >> > http://hbase.apache.org/book.html#important_configurations
> >> >
> >> > Cheers
> >> >
> >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer
> wrote:
> >> >
> >> >> Hi folks,
> >> >>
> >> >> I try to create new command for hbase client. It will show
> processlist
> >> >> on RSs. I have a problem. I need RS's info port for reaching RS's
> >> >> webservices. In testing side I can reach it with
> >> >>
> >> >>
> >>
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> >> >> However I can not reach Hmaster on client side. Is there anyway
> >> >> learning RS infoport on client side ?
> >> >>
> >> >> P.s. Maybe you will say why you do not use regionserver.info.port. If
> >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> >> >> configuration is not sample with real info port.
> >> >>
> >> >> Thanks
> >> >>
> >> >> --
> >> >> Talat
> >> >>
> >>
> >>
> >>
> >> --
> >> Talat UYARER
> >> Websitesi: http://talat.uyarer.com
> >> Twitter: http://twitter.com/talatuyarer
> >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >>
>
>
>
> --
> Talat UYARER
> Websitesi: http://talat.uyarer.com
> Twitter: http://twitter.com/talatuyarer
> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>
Re: Region Server Info Port
IMHO reaching rs info port impossible in client side.
Should I do accepting about info port ? If I do that my code does not work
with pseduo installation.
On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
> getRegionServerInfoPort() calls regionServerTracker.getRegionServerInfo(sn)
> but RegionServerTracker is in hbase-server module :-(
>
> On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer wrote:
>
> > Is there any extraction for zk connection frpm client side ?
> >
> >
> >
> > 2015-01-22 0:42 GMT+02:00 Ted Yu :
> > > HBaseAdmin provides this method:
> > >
> > > public int getMasterInfoPort() throws IOException {
> > >
> > > However, there is no counterpart for region server info port.
> > >
> > > There're two options I can think of:
> > >
> > > 1. parse corresponding znode to extract this information
> > >
> > > 2. parse master UI to retrieve this information
> > >
> > > Cheers
> > >
> > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer
> wrote:
> > >
> > >> Hi Ted,
> > >>
> > >> I work on HBASE-4368. I try to reach
> > >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all url
> > >> fro getting task list on region server. But rs info_port can be change
> > >> depends on hbase installation.Is it possible learning rs's info port ?
> > >>
> > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> > >> > bq. for reaching RS's webservices
> > >> >
> > >> > What information do you want to collect from region servers ?
> > >> > Have you considered using jmx ?
> > >> > See 8.3.5. JMX under
> > >> > http://hbase.apache.org/book.html#important_configurations
> > >> >
> > >> > Cheers
> > >> >
> > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer
> > wrote:
> > >> >
> > >> >> Hi folks,
> > >> >>
> > >> >> I try to create new command for hbase client. It will show
> > processlist
> > >> >> on RSs. I have a problem. I need RS's info port for reaching RS's
> > >> >> webservices. In testing side I can reach it with
> > >> >>
> > >> >>
> > >>
> >
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> > >> >> However I can not reach Hmaster on client side. Is there anyway
> > >> >> learning RS infoport on client side ?
> > >> >>
> > >> >> P.s. Maybe you will say why you do not use regionserver.info.port.
> If
> > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> > >> >> configuration is not sample with real info port.
> > >> >>
> > >> >> Thanks
> > >> >>
> > >> >> --
> > >> >> Talat
> > >> >>
> > >>
> > >>
> > >>
> > >> --
> > >> Talat UYARER
> > >> Websitesi: http://talat.uyarer.com
> > >> Twitter: http://twitter.com/talatuyarer
> > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > >>
> >
> >
> >
> > --
> > Talat UYARER
> > Websitesi: http://talat.uyarer.com
> > Twitter: http://twitter.com/talatuyarer
> > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >
>
Re: Region Server Info Port
It's not clear to me why it's not showing the right port in
pseudo-distributed mode, Talat. Even when getting the value out of the
Configuration object it's getting out the wrong one?
-Dima
On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer wrote:
> IMHO reaching rs info port impossible in client side.
>
> Should I do accepting about info port ? If I do that my code does not work
> with pseduo installation.
> On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
>
> > getRegionServerInfoPort() calls
> regionServerTracker.getRegionServerInfo(sn)
> > but RegionServerTracker is in hbase-server module :-(
> >
> > On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer wrote:
> >
> > > Is there any extraction for zk connection frpm client side ?
> > >
> > >
> > >
> > > 2015-01-22 0:42 GMT+02:00 Ted Yu :
> > > > HBaseAdmin provides this method:
> > > >
> > > > public int getMasterInfoPort() throws IOException {
> > > >
> > > > However, there is no counterpart for region server info port.
> > > >
> > > > There're two options I can think of:
> > > >
> > > > 1. parse corresponding znode to extract this information
> > > >
> > > > 2. parse master UI to retrieve this information
> > > >
> > > > Cheers
> > > >
> > > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer
> > wrote:
> > > >
> > > >> Hi Ted,
> > > >>
> > > >> I work on HBASE-4368. I try to reach
> > > >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all
> url
> > > >> fro getting task list on region server. But rs info_port can be
> change
> > > >> depends on hbase installation.Is it possible learning rs's info
> port ?
> > > >>
> > > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> > > >> > bq. for reaching RS's webservices
> > > >> >
> > > >> > What information do you want to collect from region servers ?
> > > >> > Have you considered using jmx ?
> > > >> > See 8.3.5. JMX under
> > > >> > http://hbase.apache.org/book.html#important_configurations
> > > >> >
> > > >> > Cheers
> > > >> >
> > > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer
> > > wrote:
> > > >> >
> > > >> >> Hi folks,
> > > >> >>
> > > >> >> I try to create new command for hbase client. It will show
> > > processlist
> > > >> >> on RSs. I have a problem. I need RS's info port for reaching RS's
> > > >> >> webservices. In testing side I can reach it with
> > > >> >>
> > > >> >>
> > > >>
> > >
> >
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> > > >> >> However I can not reach Hmaster on client side. Is there anyway
> > > >> >> learning RS infoport on client side ?
> > > >> >>
> > > >> >> P.s. Maybe you will say why you do not use
> regionserver.info.port.
> > If
> > > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> > > >> >> configuration is not sample with real info port.
> > > >> >>
> > > >> >> Thanks
> > > >> >>
> > > >> >> --
> > > >> >> Talat
> > > >> >>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Talat UYARER
> > > >> Websitesi: http://talat.uyarer.com
> > > >> Twitter: http://twitter.com/talatuyarer
> > > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > > >>
> > >
> > >
> > >
> > > --
> > > Talat UYARER
> > > Websitesi: http://talat.uyarer.com
> > > Twitter: http://twitter.com/talatuyarer
> > > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > >
> >
>
Re: Region Server Info Port
On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer wrote:
> IMHO reaching rs info port impossible in client side.
>
>
You are right.
You want the Tasks as JSON?
> Should I do accepting about info port ? If I do that my code does not work
> with pseduo installation.
>
We should add an API that returns pb of cluster info with stuff like info
port in it. Info port has been a bit of a bastard child; it doesn't fit
anywhere. Liu Shaohui did some nice work getting the info port to the
master. What is missing is getting it over the last stretch to the client.
Thanks Talat,
St.Ack
> On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
>
> > getRegionServerInfoPort() calls
> regionServerTracker.getRegionServerInfo(sn)
> > but RegionServerTracker is in hbase-server module :-(
> >
> > On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer wrote:
> >
> > > Is there any extraction for zk connection frpm client side ?
> > >
> > >
> > >
> > > 2015-01-22 0:42 GMT+02:00 Ted Yu :
> > > > HBaseAdmin provides this method:
> > > >
> > > > public int getMasterInfoPort() throws IOException {
> > > >
> > > > However, there is no counterpart for region server info port.
> > > >
> > > > There're two options I can think of:
> > > >
> > > > 1. parse corresponding znode to extract this information
> > > >
> > > > 2. parse master UI to retrieve this information
> > > >
> > > > Cheers
> > > >
> > > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer
> > wrote:
> > > >
> > > >> Hi Ted,
> > > >>
> > > >> I work on HBASE-4368. I try to reach
> > > >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all
> url
> > > >> fro getting task list on region server. But rs info_port can be
> change
> > > >> depends on hbase installation.Is it possible learning rs's info
> port ?
> > > >>
> > > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> > > >> > bq. for reaching RS's webservices
> > > >> >
> > > >> > What information do you want to collect from region servers ?
> > > >> > Have you considered using jmx ?
> > > >> > See 8.3.5. JMX under
> > > >> > http://hbase.apache.org/book.html#important_configurations
> > > >> >
> > > >> > Cheers
> > > >> >
> > > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer
> > > wrote:
> > > >> >
> > > >> >> Hi folks,
> > > >> >>
> > > >> >> I try to create new command for hbase client. It will show
> > > processlist
> > > >> >> on RSs. I have a problem. I need RS's info port for reaching RS's
> > > >> >> webservices. In testing side I can reach it with
> > > >> >>
> > > >> >>
> > > >>
> > >
> >
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> > > >> >> However I can not reach Hmaster on client side. Is there anyway
> > > >> >> learning RS infoport on client side ?
> > > >> >>
> > > >> >> P.s. Maybe you will say why you do not use
> regionserver.info.port.
> > If
> > > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> > > >> >> configuration is not sample with real info port.
> > > >> >>
> > > >> >> Thanks
> > > >> >>
> > > >> >> --
> > > >> >> Talat
> > > >> >>
> > > >>
> > > >>
> > > >>
> > > >> --
> > > >> Talat UYARER
> > > >> Websitesi: http://talat.uyarer.com
> > > >> Twitter: http://twitter.com/talatuyarer
> > > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > > >>
> > >
> > >
> > >
> > > --
> > > Talat UYARER
> > > Websitesi: http://talat.uyarer.com
> > > Twitter: http://twitter.com/talatuyarer
> > > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > >
> >
>
Re: Region Server Info Port
On Wed, Jan 21, 2015 at 4:49 PM, Stack wrote:
> On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer wrote:
>
>> IMHO reaching rs info port impossible in client side.
>>
>>
> You are right.
>
> You want the Tasks as JSON?
>
>
>
>> Should I do accepting about info port ? If I do that my code does not work
>> with pseduo installation.
>>
>
>
> We should add an API that returns pb of cluster info with stuff like info
> port in it. Info port has been a bit of a bastard child; it doesn't fit
> anywhere. Liu Shaohui did some nice work getting the info port to the
> master. What is missing is getting it over the last stretch to the client.
>
> Or an easier-to-parse version of the master's /dump servlet. Has stats on
regionservers but doesn't show info port at the moment.
St.Ack
> Thanks Talat,
> St.Ack
>
>
>
>> On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
>>
>> > getRegionServerInfoPort() calls
>> regionServerTracker.getRegionServerInfo(sn)
>> > but RegionServerTracker is in hbase-server module :-(
>> >
>> > On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer wrote:
>> >
>> > > Is there any extraction for zk connection frpm client side ?
>> > >
>> > >
>> > >
>> > > 2015-01-22 0:42 GMT+02:00 Ted Yu :
>> > > > HBaseAdmin provides this method:
>> > > >
>> > > > public int getMasterInfoPort() throws IOException {
>> > > >
>> > > > However, there is no counterpart for region server info port.
>> > > >
>> > > > There're two options I can think of:
>> > > >
>> > > > 1. parse corresponding znode to extract this information
>> > > >
>> > > > 2. parse master UI to retrieve this information
>> > > >
>> > > > Cheers
>> > > >
>> > > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer
>> > wrote:
>> > > >
>> > > >> Hi Ted,
>> > > >>
>> > > >> I work on HBASE-4368. I try to reach
>> > > >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all
>> url
>> > > >> fro getting task list on region server. But rs info_port can be
>> change
>> > > >> depends on hbase installation.Is it possible learning rs's info
>> port ?
>> > > >>
>> > > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
>> > > >> > bq. for reaching RS's webservices
>> > > >> >
>> > > >> > What information do you want to collect from region servers ?
>> > > >> > Have you considered using jmx ?
>> > > >> > See 8.3.5. JMX under
>> > > >> > http://hbase.apache.org/book.html#important_configurations
>> > > >> >
>> > > >> > Cheers
>> > > >> >
>> > > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer
>> > > wrote:
>> > > >> >
>> > > >> >> Hi folks,
>> > > >> >>
>> > > >> >> I try to create new command for hbase client. It will show
>> > > processlist
>> > > >> >> on RSs. I have a problem. I need RS's info port for reaching
>> RS's
>> > > >> >> webservices. In testing side I can reach it with
>> > > >> >>
>> > > >> >>
>> > > >>
>> > >
>> >
>> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
>> > > >> >> However I can not reach Hmaster on client side. Is there anyway
>> > > >> >> learning RS infoport on client side ?
>> > > >> >>
>> > > >> >> P.s. Maybe you will say why you do not use
>> regionserver.info.port.
>> > If
>> > > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
>> > > >> >> configuration is not sample with real info port.
>> > > >> >>
>> > > >> >> Thanks
>> > > >> >>
>> > > >> >> --
>> > > >> >> Talat
>> > > >> >>
>> > > >>
>> > > >>
>> > > >>
>> > > >> --
>> > > >> Talat UYARER
>> > > >> Websitesi: http://talat.uyarer.com
>> > > >> Twitter: http://twitter.com/talatuyarer
>> > > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>> > > >>
>> > >
>> > >
>> > >
>> > > --
>> > > Talat UYARER
>> > > Websitesi: http://talat.uyarer.com
>> > > Twitter: http://twitter.com/talatuyarer
>> > > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
>> > >
>> >
>>
>
>
Re: Region Server Info Port
We do have
Admin.getClusterStatus().getLoad(serverName).getInfoServerPort() which
maybe what you want.
Enis
On Wed, Jan 21, 2015 at 5:05 PM, Stack wrote:
> On Wed, Jan 21, 2015 at 4:49 PM, Stack wrote:
>
> > On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer wrote:
> >
> >> IMHO reaching rs info port impossible in client side.
> >>
> >>
> > You are right.
> >
> > You want the Tasks as JSON?
> >
> >
> >
> >> Should I do accepting about info port ? If I do that my code does not
> work
> >> with pseduo installation.
> >>
> >
> >
> > We should add an API that returns pb of cluster info with stuff like info
> > port in it. Info port has been a bit of a bastard child; it doesn't fit
> > anywhere. Liu Shaohui did some nice work getting the info port to the
> > master. What is missing is getting it over the last stretch to the
> client.
> >
> > Or an easier-to-parse version of the master's /dump servlet. Has stats on
> regionservers but doesn't show info port at the moment.
> St.Ack
>
>
>
> > Thanks Talat,
> > St.Ack
> >
> >
> >
> >> On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
> >>
> >> > getRegionServerInfoPort() calls
> >> regionServerTracker.getRegionServerInfo(sn)
> >> > but RegionServerTracker is in hbase-server module :-(
> >> >
> >> > On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer
> wrote:
> >> >
> >> > > Is there any extraction for zk connection frpm client side ?
> >> > >
> >> > >
> >> > >
> >> > > 2015-01-22 0:42 GMT+02:00 Ted Yu :
> >> > > > HBaseAdmin provides this method:
> >> > > >
> >> > > > public int getMasterInfoPort() throws IOException {
> >> > > >
> >> > > > However, there is no counterpart for region server info port.
> >> > > >
> >> > > > There're two options I can think of:
> >> > > >
> >> > > > 1. parse corresponding znode to extract this information
> >> > > >
> >> > > > 2. parse master UI to retrieve this information
> >> > > >
> >> > > > Cheers
> >> > > >
> >> > > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer
> >> > wrote:
> >> > > >
> >> > > >> Hi Ted,
> >> > > >>
> >> > > >> I work on HBASE-4368. I try to reach
> >> > > >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all
> >> url
> >> > > >> fro getting task list on region server. But rs info_port can be
> >> change
> >> > > >> depends on hbase installation.Is it possible learning rs's info
> >> port ?
> >> > > >>
> >> > > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> >> > > >> > bq. for reaching RS's webservices
> >> > > >> >
> >> > > >> > What information do you want to collect from region servers ?
> >> > > >> > Have you considered using jmx ?
> >> > > >> > See 8.3.5. JMX under
> >> > > >> > http://hbase.apache.org/book.html#important_configurations
> >> > > >> >
> >> > > >> > Cheers
> >> > > >> >
> >> > > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer <
> ta...@uyarer.com>
> >> > > wrote:
> >> > > >> >
> >> > > >> >> Hi folks,
> >> > > >> >>
> >> > > >> >> I try to create new command for hbase client. It will show
> >> > > processlist
> >> > > >> >> on RSs. I have a problem. I need RS's info port for reaching
> >> RS's
> >> > > >> >> webservices. In testing side I can reach it with
> >> > > >> >>
> >> > > >> >>
> >> > > >>
> >> > >
> >> >
> >>
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> >> > > >> >> However I can not reach Hmaster on client side. Is there
> anyway
> >> > > >> >> learning RS infoport on client side ?
> >> > > >> >>
> >> > > >> >> P.s. Maybe you will say why you do not use
> >> regionserver.info.port.
> >> > If
> >> > > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> >> > > >> >> configuration is not sample with real info port.
> >> > > >> >>
> >> > > >> >> Thanks
> >> > > >> >>
> >> > > >> >> --
> >> > > >> >> Talat
> >> > > >> >>
> >> > > >>
> >> > > >>
> >> > > >>
> >> > > >> --
> >> > > >> Talat UYARER
> >> > > >> Websitesi: http://talat.uyarer.com
> >> > > >> Twitter: http://twitter.com/talatuyarer
> >> > > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >> > > >>
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > > Talat UYARER
> >> > > Websitesi: http://talat.uyarer.com
> >> > > Twitter: http://twitter.com/talatuyarer
> >> > > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> >> > >
> >> >
> >>
> >
> >
>
Re: Region Server Info Port
On Wed, Jan 21, 2015 at 6:50 PM, Enis Söztutar wrote:
> We do have
>
> Admin.getClusterStatus().getLoad(serverName).getInfoServerPort() which
> maybe what you want.
>
>
Thanks Enis.
St.Ack
> Enis
>
> On Wed, Jan 21, 2015 at 5:05 PM, Stack wrote:
>
> > On Wed, Jan 21, 2015 at 4:49 PM, Stack wrote:
> >
> > > On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer
> wrote:
> > >
> > >> IMHO reaching rs info port impossible in client side.
> > >>
> > >>
> > > You are right.
> > >
> > > You want the Tasks as JSON?
> > >
> > >
> > >
> > >> Should I do accepting about info port ? If I do that my code does not
> > work
> > >> with pseduo installation.
> > >>
> > >
> > >
> > > We should add an API that returns pb of cluster info with stuff like
> info
> > > port in it. Info port has been a bit of a bastard child; it doesn't fit
> > > anywhere. Liu Shaohui did some nice work getting the info port to the
> > > master. What is missing is getting it over the last stretch to the
> > client.
> > >
> > > Or an easier-to-parse version of the master's /dump servlet. Has stats
> on
> > regionservers but doesn't show info port at the moment.
> > St.Ack
> >
> >
> >
> > > Thanks Talat,
> > > St.Ack
> > >
> > >
> > >
> > >> On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
> > >>
> > >> > getRegionServerInfoPort() calls
> > >> regionServerTracker.getRegionServerInfo(sn)
> > >> > but RegionServerTracker is in hbase-server module :-(
> > >> >
> > >> > On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer
> > wrote:
> > >> >
> > >> > > Is there any extraction for zk connection frpm client side ?
> > >> > >
> > >> > >
> > >> > >
> > >> > > 2015-01-22 0:42 GMT+02:00 Ted Yu :
> > >> > > > HBaseAdmin provides this method:
> > >> > > >
> > >> > > > public int getMasterInfoPort() throws IOException {
> > >> > > >
> > >> > > > However, there is no counterpart for region server info port.
> > >> > > >
> > >> > > > There're two options I can think of:
> > >> > > >
> > >> > > > 1. parse corresponding znode to extract this information
> > >> > > >
> > >> > > > 2. parse master UI to retrieve this information
> > >> > > >
> > >> > > > Cheers
> > >> > > >
> > >> > > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer >
> > >> > wrote:
> > >> > > >
> > >> > > >> Hi Ted,
> > >> > > >>
> > >> > > >> I work on HBASE-4368. I try to reach
> > >> > > >> "http://
> [rs-server]:[info_port]/rs-status?format=json&filter=all
> > >> url
> > >> > > >> fro getting task list on region server. But rs info_port can be
> > >> change
> > >> > > >> depends on hbase installation.Is it possible learning rs's info
> > >> port ?
> > >> > > >>
> > >> > > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> > >> > > >> > bq. for reaching RS's webservices
> > >> > > >> >
> > >> > > >> > What information do you want to collect from region servers ?
> > >> > > >> > Have you considered using jmx ?
> > >> > > >> > See 8.3.5. JMX under
> > >> > > >> > http://hbase.apache.org/book.html#important_configurations
> > >> > > >> >
> > >> > > >> > Cheers
> > >> > > >> >
> > >> > > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer <
> > ta...@uyarer.com>
> > >> > > wrote:
> > >> > > >> >
> > >> > > >> >> Hi folks,
> > >> > > >> >>
> > >> > > >> >> I try to create new command for hbase client. It will show
> > >> > > processlist
> > >> > > >> >> on RSs. I have a problem. I need RS's info port for reaching
> > >> RS's
> > >> > > >> >> webservices. In testing side I can reach it with
> > >> > > >> >>
> > >> > > >> >>
> > >> > > >>
> > >> > >
> > >> >
> > >>
> >
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> > >> > > >> >> However I can not reach Hmaster on client side. Is there
> > anyway
> > >> > > >> >> learning RS infoport on client side ?
> > >> > > >> >>
> > >> > > >> >> P.s. Maybe you will say why you do not use
> > >> regionserver.info.port.
> > >> > If
> > >> > > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> > >> > > >> >> configuration is not sample with real info port.
> > >> > > >> >>
> > >> > > >> >> Thanks
> > >> > > >> >>
> > >> > > >> >> --
> > >> > > >> >> Talat
> > >> > > >> >>
> > >> > > >>
> > >> > > >>
> > >> > > >>
> > >> > > >> --
> > >> > > >> Talat UYARER
> > >> > > >> Websitesi: http://talat.uyarer.com
> > >> > > >> Twitter: http://twitter.com/talatuyarer
> > >> > > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > >> > > >>
> > >> > >
> > >> > >
> > >> > >
> > >> > > --
> > >> > > Talat UYARER
> > >> > > Websitesi: http://talat.uyarer.com
> > >> > > Twitter: http://twitter.com/talatuyarer
> > >> > > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
Re: Region Server Info Port
Thanks Enis.
I try reach rs's task web service for showing task list on shell like as
web ui. Rs web service generate json I get it and I show it now.
I wonder Is it possible getting tasks in api without using rs's web service
from client side.
Thanks
Talat
On Jan 22, 2015 2:49 AM, "Stack" wrote:
> On Wed, Jan 21, 2015 at 3:03 PM, Talat Uyarer wrote:
>
> > IMHO reaching rs info port impossible in client side.
> >
> >
> You are right.
>
> You want the Tasks as JSON?
>
>
>
> > Should I do accepting about info port ? If I do that my code does not
> work
> > with pseduo installation.
> >
>
>
> We should add an API that returns pb of cluster info with stuff like info
> port in it. Info port has been a bit of a bastard child; it doesn't fit
> anywhere. Liu Shaohui did some nice work getting the info port to the
> master. What is missing is getting it over the last stretch to the client.
>
> Thanks Talat,
> St.Ack
>
>
>
> > On Jan 22, 2015 12:59 AM, "Ted Yu" wrote:
> >
> > > getRegionServerInfoPort() calls
> > regionServerTracker.getRegionServerInfo(sn)
> > > but RegionServerTracker is in hbase-server module :-(
> > >
> > > On Wed, Jan 21, 2015 at 2:48 PM, Talat Uyarer
> wrote:
> > >
> > > > Is there any extraction for zk connection frpm client side ?
> > > >
> > > >
> > > >
> > > > 2015-01-22 0:42 GMT+02:00 Ted Yu :
> > > > > HBaseAdmin provides this method:
> > > > >
> > > > > public int getMasterInfoPort() throws IOException {
> > > > >
> > > > > However, there is no counterpart for region server info port.
> > > > >
> > > > > There're two options I can think of:
> > > > >
> > > > > 1. parse corresponding znode to extract this information
> > > > >
> > > > > 2. parse master UI to retrieve this information
> > > > >
> > > > > Cheers
> > > > >
> > > > > On Wed, Jan 21, 2015 at 2:25 PM, Talat Uyarer
> > > wrote:
> > > > >
> > > > >> Hi Ted,
> > > > >>
> > > > >> I work on HBASE-4368. I try to reach
> > > > >> "http://[rs-server]:[info_port]/rs-status?format=json&filter=all
> > url
> > > > >> fro getting task list on region server. But rs info_port can be
> > change
> > > > >> depends on hbase installation.Is it possible learning rs's info
> > port ?
> > > > >>
> > > > >> 2015-01-21 19:26 GMT+02:00 Ted Yu :
> > > > >> > bq. for reaching RS's webservices
> > > > >> >
> > > > >> > What information do you want to collect from region servers ?
> > > > >> > Have you considered using jmx ?
> > > > >> > See 8.3.5. JMX under
> > > > >> > http://hbase.apache.org/book.html#important_configurations
> > > > >> >
> > > > >> > Cheers
> > > > >> >
> > > > >> > On Wed, Jan 21, 2015 at 7:44 AM, Talat Uyarer >
> > > > wrote:
> > > > >> >
> > > > >> >> Hi folks,
> > > > >> >>
> > > > >> >> I try to create new command for hbase client. It will show
> > > > processlist
> > > > >> >> on RSs. I have a problem. I need RS's info port for reaching
> RS's
> > > > >> >> webservices. In testing side I can reach it with
> > > > >> >>
> > > > >> >>
> > > > >>
> > > >
> > >
> >
> TEST_UTIL.getMiniHBaseCluster.getMaster.getRegionServerInfoPort(ServerName).
> > > > >> >> However I can not reach Hmaster on client side. Is there anyway
> > > > >> >> learning RS infoport on client side ?
> > > > >> >>
> > > > >> >> P.s. Maybe you will say why you do not use
> > regionserver.info.port.
> > > If
> > > > >> >> Hbase run on single machine as a pseduo distrubuted mod. the
> > > > >> >> configuration is not sample with real info port.
> > > > >> >>
> > > > >> >> Thanks
> > > > >> >>
> > > > >> >> --
> > > > >> >> Talat
> > > > >> >>
> > > > >>
> > > > >>
> > > > >>
> > > > >> --
> > > > >> Talat UYARER
> > > > >> Websitesi: http://talat.uyarer.com
> > > > >> Twitter: http://twitter.com/talatuyarer
> > > > >> Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > Talat UYARER
> > > > Websitesi: http://talat.uyarer.com
> > > > Twitter: http://twitter.com/talatuyarer
> > > > Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
> > > >
> > >
> >
>
