[jira] [Created] (HBASE-26067) Change the way on how we track store file list

2021-07-05 Thread Duo Zhang (Jira)
Duo Zhang created HBASE-26067:
-

 Summary: Change the way on how we track store file list
 Key: HBASE-26067
 URL: https://issues.apache.org/jira/browse/HBASE-26067
 Project: HBase
  Issue Type: Umbrella
  Components: HFile
Reporter: Duo Zhang
Assignee: Duo Zhang


Open a separated jira to track the work since it can not be fully included in 
HBASE-24749.

I think this could be a landed prior to HBASE-24749, as if this works, we could 
have different implementations for tracking store file list.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [DISCUSS] Contribution of a thrift2 python api

2021-07-05 Thread Wei-Chiu Chuang
Hi
thanks for your interest in contributing the python api to the HBase
project.

I quickly check and it doesn't look like there's another active python
HBase thrift client project at this point.
I don't have a demand to use a python thrift hbase client library. If there
are people who will benefit from this library, then it's a good idea to
make sure the library is well maintained, by having it become part of the
Apache HBase project and that more developers can contribute to it.

As a hobbyist Python developer I can help review/commit the patch.

My two cents:
(1) license: the code is ASL 2.0 so it's compatible. The text "Copyright
2021 Yutong Sean" would need to be removed.
(2) Apache Infra does not manage PyPi. So we (the Apache HBase project
committers/PMC) will have to do that.
I suspect we will have to replicate this PyPi project and add the
interested HBase PMCs who's willing to do the release work.
(3) compatibility matrix: we need to document what versions of HBase server
is supported.
(3) code:
(3.1) You will need a requirements.txt and preferably specify the versions
of the dependencies.
(3.2) If the community accepts it, should it be part of the HBase main
repo, or a new, separate repo?



On Mon, Jul 5, 2021 at 7:12 PM Yutong Xiao  wrote:

> Hi,
>
> I used to have a demand to deploy hbase thrift2 service for python users.
> So that I developed a python clients API supporting python 2.7 and 3.x for
> hbase thrift2, named thbase  . Besides
> that, I also added some features to current thrift2 service (HBASE-26025
>  and
> HBASE-26037
> ). I
> deployed them in the prod environment of my company and are compatible with
> thbase and I will keep maintaining this python API and add new features.
>   I am glad to contribute thbase to the community, but I am not sure if it
> is possible that such a client could be contributed to the community. So
> that I would like to get some advice about this.
>
> Thanks,
> Yutong Sean
>


[jira] [Resolved] (HBASE-26065) StripeStoreFileManager does not need to throw IOException for most methods

2021-07-05 Thread Duo Zhang (Jira)


 [ 
https://issues.apache.org/jira/browse/HBASE-26065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Duo Zhang resolved HBASE-26065.
---
Fix Version/s: 3.0.0-alpha-2
   2.5.0
 Hadoop Flags: Reviewed
   Resolution: Fixed

Pushed to master and branch-2.

Thanks [~haxiaolin] for reviewing.

> StripeStoreFileManager does not need to throw IOException for most methods
> --
>
> Key: HBASE-26065
> URL: https://issues.apache.org/jira/browse/HBASE-26065
> Project: HBase
>  Issue Type: Improvement
>  Components: Compaction, HFile
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-2
>
>
> All the operations are in memory only, expect getSplitPoint.
> We just throw IOException when we do some checks in code and the checks fail. 
> In general, I think it is better to throw RuntimeException other than 
> IOException, 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[DISCUSS] Contribution of a thrift2 python api

2021-07-05 Thread Yutong Xiao
Hi,

I used to have a demand to deploy hbase thrift2 service for python users.
So that I developed a python clients API supporting python 2.7 and 3.x for
hbase thrift2, named thbase  . Besides
that, I also added some features to current thrift2 service (HBASE-26025
 and
HBASE-26037
). I
deployed them in the prod environment of my company and are compatible with
thbase and I will keep maintaining this python API and add new features.
  I am glad to contribute thbase to the community, but I am not sure if it
is possible that such a client could be contributed to the community. So
that I would like to get some advice about this.

Thanks,
Yutong Sean