Preparing for upcoming Pinot Release

2020-02-12 Thread Fu Xiang
Hi Pinot Community,

I'm preparing the upcoming release from current master branch commit (
7cca1442d7ad41705643862b7237f445e8803368
)
as of date: Wed Feb 12 15:58:31 PST 2020.

Please let me know if you still have any changes wanted to get in by
tomorrow Noon.

Best,

Xiang


Re: Preparing for upcoming Pinot Release

2020-02-13 Thread Fu Xiang
Sounds good.

Will wait and make text search an experimental feature in the upcoming
release.

Meanwhile I’m preparing the release notes, especially the backward
incompatibility. Will share with the team soon.

Best,

Xiang


On Thu, Feb 13, 2020 at 10:27 kishore g  wrote:

> @Siddharth Teotia  Lets get the text PR merged.
> Will
> be good to release it as experimental and collect feedback.
>
> @Subbu Subramaniam  We have moved all the docs from
> RTD
> to gitbook. I need to restructure a bit and it will be ready to go by the
> time we make the release.
> Let's call out all the major changes in 1.0.0
>
> On Thu, Feb 13, 2020 at 9:59 AM Subbu Subramaniam 
> wrote:
>
> > Hi Xiang,
> >
> > Thanks for taking on the release work.
> >
> > I suppose the version will be 1.0.0?
> >
> > Please make sure that:
> > 1. Either we are migrated fully to the new documentation, OR we have
> > documented all new features in the existing documentation. The current
> > situation is that neither of these is true. It will be unfortunate if we
> > make a release with documentation in two places, neither of which is
> > complete. I will be willing to help fix the doc issue. Please send out an
> > email to committers (or general) providing appropriate instructions, and
> we
> > can have the community fix the documents before the release.
> > 2. The release notes lists all the incompatiblities introduced, and
> > migration plans, etc.  I know of at least one incompatibility. You cannot
> > upgrade from 0.1 to 1.0 without going through 0.2, because of
> > incomaptibolituy introduced in
> > https://github.com/apache/incubator-pinot/pull/4346 (if you have those
> > queries, of course). There may be others, given that we have had a big
> > overhaul.
> >
> > thanks again
> >
> > -Subbu
> >
> >
> > On 2020/02/13 00:08:20, Fu Xiang  wrote:
> > > Hi Pinot Community,
> > >
> > > I'm preparing the upcoming release from current master branch commit (
> > > 7cca1442d7ad41705643862b7237f445e8803368
> > > <
> >
> https://github.com/apache/incubator-pinot/commit/7cca1442d7ad41705643862b7237f445e8803368
> > >)
> > > as of date: Wed Feb 12 15:58:31 PST 2020.
> > >
> > > Please let me know if you still have any changes wanted to get in by
> > > tomorrow Noon.
> > >
> > > Best,
> > >
> > > Xiang
> > >
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> > For additional commands, e-mail: dev-h...@pinot.apache.org
> >
> >
>
-- 
Xiang Fu


Re: What's the current status and plan on Java 11

2020-02-14 Thread Fu Xiang
Thanks for brining this up!

I've fixed all the compilation error with java 11 I got and also added
QuickStart tests to build Pinot with both JDK 8 and 11 for Travis.

Example: https://travis-ci.org/apache/incubator-pinot/builds/650497203

Could you try it again ?

H  于2020年2月14日周五 下午2:10写道:

> In Dec 2018, there was one Github issue
>  on compilation
> errors with Java 11, with few updates since then.
>
> Are there any known plans/blockers on moving to Java 11?
>


-- 
Xiang Fu


Some thoughts on SegmentPreProcessor

2020-02-14 Thread Fu Xiang
1. For large table, the segment reloading may take very long time during
server start up. Shall we consider load segment as it is during server
startup, then reload each segment afterward?
2 .Shall we consider when to regenerate the segment. E,g. indexing removal,
update dictionary type from dict to non-dict (not yet supported).

-- 
Xiang Fu


Re: Some thoughts on SegmentPreProcessor

2020-02-15 Thread Fu Xiang
For 1, It’s more about getting server startup faster. Otherwise it may take
long time to do rolling restart.

For 2, we can keep adding per column basis index to existing segment, just
need to support dictionary and non-dictionary conversion on the fly.
Meanwhile we can keep track of real size for used index size as well as
segment total size to decide when to do compaction.

On Sat, Feb 15, 2020 at 11:35 Mayank Shrivastava 
wrote:

> Good thought, but need more clarity. For cases that warrant reload
> anyways, how does faster server startup help?
> For 2, I see this as a precursor to adaptive indexing on the fly.
>
> Sent from my iPhone
>
> > On Feb 14, 2020, at 7:55 PM, Fu Xiang  wrote:
> >
> > 1. For large table, the segment reloading may take very long time during
> > server start up. Shall we consider load segment as it is during server
> > startup, then reload each segment afterward?
> > 2 .Shall we consider when to regenerate the segment. E,g. indexing
> removal,
> > update dictionary type from dict to non-dict (not yet supported).
> >
> > --
> > Xiang Fu
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> For additional commands, e-mail: dev-h...@pinot.apache.org
>
> --
Xiang Fu


Re: Preparing for upcoming Pinot Release

2020-02-15 Thread Fu Xiang
Regarding the version, I suggest to still call it 0.3.0 as the
PluginManager is still backward compatible from users' perspective in PR:
https://github.com/apache/incubator-pinot/pull/5035.

We can leave 1.0.0 for something bigger later.

On Thu, Feb 13, 2020 at 12:08 Subbu Subramaniam  wrote:

> Thanks, @kishore g 
> Please do send it out for a review when the docs are ready
>
> thanks
>
> -Subbu
>
>
> On Thu, Feb 13, 2020 at 10:27 AM kishore g  wrote:
>
> > @Siddharth Teotia  Lets get the text PR merged.
> > Will be good to release it as experimental and collect feedback.
> >
> > @Subbu Subramaniam  We have moved all the docs from
> > RTD to gitbook. I need to restructure a bit and it will be ready to go by
> > the time we make the release.
> > Let's call out all the major changes in 1.0.0
> >
> > On Thu, Feb 13, 2020 at 9:59 AM Subbu Subramaniam 
> > wrote:
> >
> >> Hi Xiang,
> >>
> >> Thanks for taking on the release work.
> >>
> >> I suppose the version will be 1.0.0?
> >>
> >> Please make sure that:
> >> 1. Either we are migrated fully to the new documentation, OR we have
> >> documented all new features in the existing documentation. The current
> >> situation is that neither of these is true. It will be unfortunate if we
> >> make a release with documentation in two places, neither of which is
> >> complete. I will be willing to help fix the doc issue. Please send out
> an
> >> email to committers (or general) providing appropriate instructions,
> and we
> >> can have the community fix the documents before the release.
> >> 2. The release notes lists all the incompatiblities introduced, and
> >> migration plans, etc.  I know of at least one incompatibility. You
> cannot
> >> upgrade from 0.1 to 1.0 without going through 0.2, because of
> >> incomaptibolituy introduced in
> >> https://github.com/apache/incubator-pinot/pull/4346 (if you have those
> >> queries, of course). There may be others, given that we have had a big
> >> overhaul.
> >>
> >> thanks again
> >>
> >> -Subbu
> >>
> >>
> >> On 2020/02/13 00:08:20, Fu Xiang  wrote:
> >> > Hi Pinot Community,
> >> >
> >> > I'm preparing the upcoming release from current master branch commit (
> >> > 7cca1442d7ad41705643862b7237f445e8803368
> >> > <
> >>
> https://github.com/apache/incubator-pinot/commit/7cca1442d7ad41705643862b7237f445e8803368
> >> >)
> >> > as of date: Wed Feb 12 15:58:31 PST 2020.
> >> >
> >> > Please let me know if you still have any changes wanted to get in by
> >> > tomorrow Noon.
> >> >
> >> > Best,
> >> >
> >> > Xiang
> >> >
> >>
> >> -
> >> To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> >> For additional commands, e-mail: dev-h...@pinot.apache.org
> >>
> >>
>


Re: Preparing for upcoming Pinot Release

2020-02-18 Thread Fu Xiang
Here is the draft
<https://docs.google.com/document/d/1zCY6KNma3WoHIju9Revp7JUlr4gtIYPPwu6xpJzlY3I/edit?usp=sharing>
for new release notes.

All comments are welcome.

Subbu Subramaniam  于2020年2月16日周日
下午1:02写道:

> The best way to communicate such major change in interface is by updating
> the major version number.
>
> We can say that the software has been restructured significantly to
> accommodate cloud readiness (blog coming up soon) and easy plug n play.
>
> Which was the objective of the re-factor anyway.
>
> What is the reaon NOT to call it 1.0?
>
> -Subbu
> 
> From: kishore g 
> Sent: Sunday, February 16, 2020 10:24 AM
> To: dev@pinot.apache.org 
> Subject: Re: Preparing for upcoming Pinot Release
>
> Hi Subbu,
>
> I am with you on significant changes to the package names and the need to
> recompile the code if anyone has the wrapper like LinkedIn. What do you
> think is the best way to communicate this without calling it 1.0.
>
> thanks,
> Kishore G
>
>
>
>
> On Sun, Feb 16, 2020 at 9:40 AM Subbu Subramaniam 
> wrote:
>
> > I disagree.
> >
> > In LinkedIn, we had to change our wrapper software significantly due to
> > the API (and package name) changes.
> >
> > Have you compiled the release notes? That should indicate the amount of
> > changes that went in.
> >
> > -Subbu
> >
> > On 2020/02/16 05:49:16, Fu Xiang  wrote:
> > > Regarding the version, I suggest to still call it 0.3.0 as the
> > > PluginManager is still backward compatible from users' perspective in
> PR:
> > >
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Fpull%2F5035&data=02%7C01%7Cssubramaniam%40linkedin.com%7C7fd26a7da6454a3e9cea08d7b30d8d73%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637174743102251978&sdata=o%2Fin2UJZYqX7gvCadZR4Bji4HhSQ1XQ0G8fUC7OkSc0%3D&reserved=0
> .
> > >
> > > We can leave 1.0.0 for something bigger later.
> > >
> > > On Thu, Feb 13, 2020 at 12:08 Subbu Subramaniam 
> > wrote:
> > >
> > > > Thanks, @kishore g 
> > > > Please do send it out for a review when the docs are ready
> > > >
> > > > thanks
> > > >
> > > > -Subbu
> > > >
> > > >
> > > > On Thu, Feb 13, 2020 at 10:27 AM kishore g 
> > wrote:
> > > >
> > > > > @Siddharth Teotia  Lets get the text PR
> > merged.
> > > > > Will be good to release it as experimental and collect feedback.
> > > > >
> > > > > @Subbu Subramaniam  We have moved all the docs
> > from
> > > > > RTD to gitbook. I need to restructure a bit and it will be ready to
> > go by
> > > > > the time we make the release.
> > > > > Let's call out all the major changes in 1.0.0
> > > > >
> > > > > On Thu, Feb 13, 2020 at 9:59 AM Subbu Subramaniam <
> > mcvsu...@apache.org>
> > > > > wrote:
> > > > >
> > > > >> Hi Xiang,
> > > > >>
> > > > >> Thanks for taking on the release work.
> > > > >>
> > > > >> I suppose the version will be 1.0.0?
> > > > >>
> > > > >> Please make sure that:
> > > > >> 1. Either we are migrated fully to the new documentation, OR we
> have
> > > > >> documented all new features in the existing documentation. The
> > current
> > > > >> situation is that neither of these is true. It will be unfortunate
> > if we
> > > > >> make a release with documentation in two places, neither of which
> is
> > > > >> complete. I will be willing to help fix the doc issue. Please send
> > out
> > > > an
> > > > >> email to committers (or general) providing appropriate
> instructions,
> > > > and we
> > > > >> can have the community fix the documents before the release.
> > > > >> 2. The release notes lists all the incompatiblities introduced,
> and
> > > > >> migration plans, etc.  I know of at least one incompatibility. You
> > > > cannot
> > > > >> upgrade from 0.1 to 1.0 without going through 0.2, because of
> > > > >> incomaptibolituy introduced in
> > > > >>
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Fpull%2F4346&data=02%7C01%7Css

Tooling for Segment level Kafka offsets management

2020-02-20 Thread Fu Xiang
Brought this up as some users are asking for this feature. E.g. to skip bad
data produced from upstream.

For high level consumer, users can change table config to make consumer
offset reset policy to latest then delete Kafka consumer group and bounce
table/server to achieve this.

For simple consumer, I don't see any easy way to handle this except for
modifying segment metadata content in zookeeper.

I feel we need to provide the tooling to operate on them.

-- 
Xiang Fu


Re: Preparing for upcoming Pinot Release

2020-02-28 Thread Fu Xiang
We finally got all the pending commits reviewed and merged!

The upcoming release(0.3.0) will be cut from current master branch commit (
9abf0a4b105d624ec310273c2bd7f52c1f3ce12a
<https://github.com/apache/incubator-pinot/commit/9abf0a4b105d624ec310273c2bd7f52c1f3ce12a>)
as of date: Wed Feb 27 16:09:51 PST 2020.

The release notes is here:
https://apache-pinot.gitbook.io/apache-pinot-cookbook/releases/0.3.0

Please let me know if you have any questions.

Best,

Xiang

Fu Xiang  于2020年2月18日周二 上午3:35写道:

> Here is the draft
> <https://docs.google.com/document/d/1zCY6KNma3WoHIju9Revp7JUlr4gtIYPPwu6xpJzlY3I/edit?usp=sharing>
> for new release notes.
>
> All comments are welcome.
>
> Subbu Subramaniam  于2020年2月16日周日
> 下午1:02写道:
>
>> The best way to communicate such major change in interface is by updating
>> the major version number.
>>
>> We can say that the software has been restructured significantly to
>> accommodate cloud readiness (blog coming up soon) and easy plug n play.
>>
>> Which was the objective of the re-factor anyway.
>>
>> What is the reaon NOT to call it 1.0?
>>
>> -Subbu
>> 
>> From: kishore g 
>> Sent: Sunday, February 16, 2020 10:24 AM
>> To: dev@pinot.apache.org 
>> Subject: Re: Preparing for upcoming Pinot Release
>>
>> Hi Subbu,
>>
>> I am with you on significant changes to the package names and the need to
>> recompile the code if anyone has the wrapper like LinkedIn. What do you
>> think is the best way to communicate this without calling it 1.0.
>>
>> thanks,
>> Kishore G
>>
>>
>>
>>
>> On Sun, Feb 16, 2020 at 9:40 AM Subbu Subramaniam 
>> wrote:
>>
>> > I disagree.
>> >
>> > In LinkedIn, we had to change our wrapper software significantly due to
>> > the API (and package name) changes.
>> >
>> > Have you compiled the release notes? That should indicate the amount of
>> > changes that went in.
>> >
>> > -Subbu
>> >
>> > On 2020/02/16 05:49:16, Fu Xiang  wrote:
>> > > Regarding the version, I suggest to still call it 0.3.0 as the
>> > > PluginManager is still backward compatible from users' perspective in
>> PR:
>> > >
>> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fincubator-pinot%2Fpull%2F5035&data=02%7C01%7Cssubramaniam%40linkedin.com%7C7fd26a7da6454a3e9cea08d7b30d8d73%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637174743102251978&sdata=o%2Fin2UJZYqX7gvCadZR4Bji4HhSQ1XQ0G8fUC7OkSc0%3D&reserved=0
>> .
>> > >
>> > > We can leave 1.0.0 for something bigger later.
>> > >
>> > > On Thu, Feb 13, 2020 at 12:08 Subbu Subramaniam 
>> > wrote:
>> > >
>> > > > Thanks, @kishore g 
>> > > > Please do send it out for a review when the docs are ready
>> > > >
>> > > > thanks
>> > > >
>> > > > -Subbu
>> > > >
>> > > >
>> > > > On Thu, Feb 13, 2020 at 10:27 AM kishore g 
>> > wrote:
>> > > >
>> > > > > @Siddharth Teotia  Lets get the text PR
>> > merged.
>> > > > > Will be good to release it as experimental and collect feedback.
>> > > > >
>> > > > > @Subbu Subramaniam  We have moved all the
>> docs
>> > from
>> > > > > RTD to gitbook. I need to restructure a bit and it will be ready
>> to
>> > go by
>> > > > > the time we make the release.
>> > > > > Let's call out all the major changes in 1.0.0
>> > > > >
>> > > > > On Thu, Feb 13, 2020 at 9:59 AM Subbu Subramaniam <
>> > mcvsu...@apache.org>
>> > > > > wrote:
>> > > > >
>> > > > >> Hi Xiang,
>> > > > >>
>> > > > >> Thanks for taking on the release work.
>> > > > >>
>> > > > >> I suppose the version will be 1.0.0?
>> > > > >>
>> > > > >> Please make sure that:
>> > > > >> 1. Either we are migrated fully to the new documentation, OR we
>> have
>> > > > >> documented all new features in the existing documentation. The
>> > current
>> > > > >> situation is that neither of these is true. It will be
>> unfortunate
>> > if we
>> > > > >> make a release

[VOTE] Apache Pinot (incubating) 0.3.0 RC0

2020-03-03 Thread Fu Xiang
Hi Pinot Community,

This is a call for vote to the release Apache Pinot (incubating) version
0.3.0.

The release candidate:
https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc0

Git tag for this release:
https://github.com/apache/incubator-pinot/tree/release-0.3.0-rc0

Git hash for this release:
ca35bc64929ff27683e5f72ec2691a5dff6e89cf

The artifacts have been signed with key: CDEDB21B862F6C66, which can be
found in the following KEYS file.
https://dist.apache.org/repos/dist/release/incubator/pinot/KEYS

Release notes:
GitHub:
https://github.com/apache/incubator-pinot/releases/tag/release-0.3.0-rc0
GitBook:
https://apache-pinot.gitbook.io/apache-pinot-cookbook/releases/0.3.0

Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1006

Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate


The vote will be open for at least 72 hours or until necessary number of
votes are reached.

Please vote accordingly,

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Thanks,
Apache Pinot (incubating) team


[VOTE] Apache Pinot (incubating) 0.3.0 RC1

2020-03-09 Thread Fu Xiang
Hi Pinot Community,

This is a call for vote to the release Apache Pinot (incubating) version
0.3.0.

The release candidate:
https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc1

Git tag for this release:
https://github.com/apache/incubator-pinot/tree/release-0.3.0-rc1

Git hash for this release:
4a878f21aac289c84f289e47958de64850b7bb81

The artifacts have been signed with key: CDEDB21B862F6C66, which can be
found in the following KEYS file.
https://dist.apache.org/repos/dist/release/incubator/pinot/KEYS

Release notes:
GitHub:
https://github.com/apache/incubator-pinot/releases/tag/release-0.3.0-rc1
GitBook:
https://apache-pinot.gitbook.io/apache-pinot-cookbook/releases/0.3.0

Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1008


Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate

Updates from 0.3.0 RC0
- Fixing the issue of thread local DocIdSet in ExpressionFilterOperator
- Fixing the issue of copying sample data from distribution jar for
PinotQuickStarts

The vote will be open for at least 72 hours or until necessary number of
votes are reached.

Please vote accordingly,

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Thanks,
Apache Pinot (incubating) team


[VOTE] Apache Pinot (incubating) 0.3.0 RC2

2020-03-16 Thread Fu Xiang
Hi Pinot Community,

This is a call for vote to the release Apache Pinot (incubating) version
0.3.0.

The release candidate:
https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.3.0-rc2

Git tag for this release:
https://github.com/apache/incubator-pinot/tree/release-0.3.0-rc2

Git hash for this release:
9b2dc20c07dec6cf33df08cd996e8202c3ba

The artifacts have been signed with key: CDEDB21B862F6C66, which can be
found in the following KEYS file.
https://dist.apache.org/repos/dist/release/incubator/pinot/KEYS

Release notes:
GitHub:
https://github.com/apache/incubator-pinot/releases/tag/release-0.3.0-rc2
GitBook:
https://apache-pinot.gitbook.io/apache-pinot-cookbook/releases/0.3.0

Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1010

Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate

*Updates from 0.3.0 RC0*:
- Fixing the issue of thread local DocIdSet in ExpressionFilterOperator.
- Fixing the issue of copying sample data from distribution jar for
PinotQuickStarts.

*Updates from 0.3.0 RC1*:
- Support schema evolution for consuming segment.
- Fixed the bug in default value provider classes.
- Fixed the bug when no segment exists in RealtimeSegmentSelector.
- Multiple tooling enhancements and fixes for QuickStarts.

The vote will be open for at least 72 hours or until necessary number of
votes are reached.

Please vote accordingly,

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Thanks,
Apache Pinot (incubating) team


Pinot Golang Query Client

2020-03-18 Thread Fu Xiang
Hi,

I've developed a Pinot Golang Client (
https://github.com/fx19880617/pinot-client-go).

Documentation is here: (
https://apache-pinot.gitbook.io/apache-pinot-cookbook/pinot-user-guide/pinot-clients/golang
)

Any feedback is welcome!

-- 
Xiang Fu


[RESULT][VOTE] Apache Pinot (incubating) 0.3.0 RC2

2020-03-19 Thread Fu Xiang
Thanks all for validating the release candidate and participating in the
vote.

Apache Pinot (incubating) 0.3.0 RC2 has passed with four +1. There is no +0
or -1 vote.

Vote details are as follows:
4 +1:
+1 Mayank Shrivastava
+1 Siddharth Teotia
+1 Neha Pawar
+1 Kishore Gopalakrishna

0 +0
0 -1

Cheers,

Xiang Fu


[ANNOUNCE] Apache Pinot (incubating) 0.3.0 released

2020-03-27 Thread Fu Xiang
Hello community,

We are pleased to announce that Apache Pinot (incubating) 0.3.0 is released!

Apache Pinot (incubating) is a distributed columnar storage engine that can
ingest data in realtime and serve analytical queries at low latency.

The release can be downloaded at: https://pinot.apache.org/download

The release note is available at:
https://docs.pinot.apache.org/releases/0.3.0


Additional resources -
Project website: https://pinot.apache.org
Getting started: https://docs.pinot.apache.org/getting-started
Mailing list: dev@pinot.apache.org
Slack channel: https://communityinviter.com/apps/apache-pinot/apache-pinot
Twitter: https://twitter.com/ApachePinot

Best Regards,

Apache Pinot (incubating) Team


Re: [Vote] Enabling html for Pinot related mailing lists

2020-06-13 Thread Fu Xiang
+1

On Sat, Jun 13, 2020 at 20:39 kishore g  wrote:

> +1
>
> On Sat, Jun 13, 2020 at 8:09 PM H  wrote:
>
> > +1
> >
> > On Sat, Jun 13, 2020 at 8:04 PM Mayank Shrivastava <
> > mayanks.apa...@gmail.com>
> > wrote:
> >
> > > +1
> > >
> > > > On Jun 13, 2020, at 8:01 PM, Seunghyun Lee  wrote:
> > > >
> > > > Hi all,
> > > >
> > > > While I was working on setting up the daily digest from slack
> > channels, I
> > > > found that the html rendering feature is turned off by default for
> > Pinot
> > > > mailing list.
> > > >
> > > > I tried to request to enable the feature from
> > > > https://issues.apache.org/jira/browse/INFRA-20423 and this needs the
> > > > project consensus.
> > > >
> > > > I would like to start the vote for "enabling html for Pinot mailing
> > > lists".
> > > >
> > > > Please vote accordingly:
> > > > [ ] +1 approve
> > > > [ ] +0 no opinion
> > > > [ ] -1 disapprove with the reason
> > > >
> > > > Thank you!
> > > > Seunghyun
> > >
> > > -
> > > To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> > > For additional commands, e-mail: dev-h...@pinot.apache.org
> > >
> > >
> >
>
-- 
Xiang Fu


Move thirdeye out from Pinot repo

2021-02-22 Thread Fu Xiang
Hi team,

As part of the Pinot 0.7.0 release effort, we will move
the thirdeye project out from the Pinot repo.

The new repo for thirdeye will be located at
https://github.com/project-thirdeye/thirdeye.

In order to keep all the commit history, I'm going to clone the entire
Pinot repo there and delete all Pinot stuff and move thirdeye directory to
root level along with the readme.

@thirdeye-dev, Please also ping me with your GitHub id, so I can add you to
project-thirdeye  organization.

I plan to finish this by tomorrow,  Please let me know if you have any
questions.

-- 
Xiang Fu


Re: [VOTE] Apache Pinot (incubating) 0.7.0 RC1

2021-03-11 Thread Fu Xiang
I think the commit hash in the email should be :
695ca390a8080409b3b76f250f2315b81b86b362

(See step 6 here:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
)

Verified other parts.
[Y] Verify if the bundle contains "incubating" in name
[Y] Verify signature, hash
[N]Verify if the released source matches with the provided git tag & hash
[Y]Verify if DISCLAIMER, LICENSE, NOTICE files are present
[Y]Check if the source distribution can compile (Do not skip the tests)
[Y]Run quick demo from both source and binary distributions

On Thu, Mar 11, 2021 at 9:36 AM kishore g  wrote:

> +1
>
> On Thu, Mar 11, 2021 at 9:34 AM Mayank Shrivastava <
> mayanks.apa...@gmail.com> wrote:
>
>> +1
>>
>> On Mar 10, 2021, at 5:27 PM, Yupeng Fu  wrote:
>>
>> 
>> I think there was some data transfer issue. Now the files are available.
>>
>>  wget
>> https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.7.0-rc1/apache-pinot-incubating-0.7.0-bin.tar.gz.sha512
>> --2021-03-10 17:26:03--
>> https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.7.0-rc1/apache-pinot-incubating-0.7.0-bin.tar.gz.sha512
>> Resolving dist.apache.org (dist.apache.org)... 13.90.137.153
>> Connecting to dist.apache.org (dist.apache.org)|13.90.137.153|:443...
>> connected.
>> HTTP request sent, awaiting response... 200 OK
>> Length: 128 [text/plain]
>> Saving to: ‘apache-pinot-incubating-0.7.0-bin.tar.gz.sha512’
>>
>> apache-pinot-incubating-0.7.0-bin.tar.
>> 100%[>]
>> 128  --.-KB/sin 0s
>>
>> 2021-03-10 17:26:03 (15.3 MB/s) -
>> ‘apache-pinot-incubating-0.7.0-bin.tar.gz.sha512’ saved [128/128]
>>
>> On Wed, Mar 10, 2021 at 3:49 PM Mayank Shrivastava 
>> wrote:
>>
>>> I get the following error with wget:
>>>
>>> wget
>>> https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-$VERSION-rc$RC/apache-pinot-incubating-$VERSION-bin.tar.gz.sha512
>>>
>>> --2021-03-10 15:47:25--
>>> https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.7.0-rc1/apache-pinot-incubating-0.7.0-bin.tar.gz.sha512
>>>
>>> Resolving dist.apache.org (dist.apache.org)... 13.90.137.153
>>>
>>> Connecting to dist.apache.org (dist.apache.org)|13.90.137.153|:443...
>>> connected.
>>>
>>> HTTP request sent, awaiting response... 404 Not Found
>>>
>>> 2021-03-10 15:47:25 ERROR 404: Not Found.
>>>
>>> On Wed, Mar 10, 2021 at 3:00 PM Yupeng Fu  wrote:
>>>
 Hi Pinot Community,

 This is a call for vote to the release Apache Pinot (incubating)
 version
 0.7.0.

 The release candidate:

 https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.7.0-rc1/


 Git tag for this release:
 
 https://github.com/apache/incubator-pinot/tree/release-0.7.0-rc1

 Git hash for this release:
 a18dc60dca09bd2a1d33a8bc6b787d7ceb8e1749

 The artifacts have been signed with key: F41AB2B856C6C29D, which can be
 found in the following KEYS file.
 https://dist.apache.org/repos/dist/release/incubator/pinot/KEYS

 Release notes:
 https://github.com/apache/incubator-pinot/releases/tag/release-0.7.0-rc1

 Staging repository:
 
 https://repository.apache.org/content/repositories/orgapachepinot-1024

 Documentation on verifying a release candidate:
 https://cwiki.apache.org/confluence/display/PINOT
 /Validating+a+release+candidate


 The vote will be open for at least 72 hours or until the necessary
 number of
 votes are reached.

 Please vote accordingly,

 [ ] +1 approve
 [ ] +0 no opinion
 [ ] -1 disapprove with the reason

 Thanks,
 Apache Pinot (incubating) team

 --
 --Yupeng

>>>
>>
>> --
>> --Yupeng
>>
>>

-- 
Xiang Fu


[VOTE] Apache Pinot (incubating) 0.7.1 RC0

2021-04-07 Thread Fu Xiang
Hi Pinot Community,

This is a call for a vote to release Apache Pinot (incubating) version
0.7.1.

The release candidate:
https://dist.apache.org/repos/dist/dev/incubator/pinot/apache-pinot-incubating-0.7.1-rc0/

Git tag for this release:
https://github.com/apache/incubator-pinot/tree/release-0.7.1-rc0

Git hash for this release:
*e22be7c3a39e840321d3658e7505f21768b228d6*

The artifacts have been signed with key: *CDEDB21B862F6C66*, which can be
found in the following KEYS file.
https://dist.apache.org/repos/dist/release/incubator/pinot/KEYS

Release notes:
https://github.com/apache/incubator-pinot/releases/tag/release-0.7.1-rc0

Staging repository:
https://repository.apache.org/content/repositories/orgapachepinot-1025

Documentation on verifying a release candidate:
https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate

The vote will be open for at least 72 hours or until the necessary number
of votes are reached.

Please vote accordingly,

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove with the reason

Thanks,
Apache Pinot (incubating) team


[RESULT][VOTE] Apache Pinot (incubating) 0.7.1 RC0

2021-04-10 Thread Fu Xiang
Thanks all for validating the release candidate and participating in the
vote.

Apache Pinot (incubating) 0.7.1 RC0 has passed with five +1. There is no +0
or -1 vote.

Vote details are as follows:
5 +1:
+1 Jackie Jiang
+1 Mayank Shrivastava
+1 Kishore Gopalakrishna
+1 Chinmay Soman
+1 Felix Cheung

0 +0
0 -1

Cheers,

Xiang Fu


[ANNOUNCE] Apache Pinot (incubating) 0.7.1 released

2021-04-14 Thread Fu Xiang
Hello Community,

We are pleased to announce that Apache Pinot (incubating) 0.7.1 is released!

Apache Pinot (incubating) is a distributed columnar storage engine that can
ingest data in real-time and serve analytical queries at low latency.

The release can be downloaded at https://pinot.apache.org/download

The release note is available at
https://docs.pinot.apache.org/basics/releases/0.7.1

Additional resources -
Project website: https://pinot.apache.org
Getting started: https://docs.pinot.apache.org/getting-started
Pinot developer blogs: https://medium.com/apache-pinot-developer-blog
Intro to Pinot Video: https://www.youtube.com/watch?v=T70jTTYhYyM

Join Pinot Community -
Twitter: https://twitter.com/ApachePinot
Meetup: https://www.meetup.com/apache-pinot/
Slack channel: https://communityinviter.com/apps/apache-pinot/apache-pinot


Best Regards,

Apache Pinot (incubating) Team


Re: DISCUSS Pinot Graduation

2021-05-10 Thread Fu Xiang
+1! Glad to see we've accomplished a lot and the community is pretty strong
and healthy!

On Mon, May 10, 2021 at 11:23 AM Subbu Subramaniam 
wrote:

> +1
>
> Let us know how we can help with the graduation, and if there are any
> pending items to be resolved.
>
> -Subbu
>
> On 2021/05/09 14:07:45, kishore g  wrote:
> > Hello,
> >
> >
> > I would like to start a conversation about the readiness of Apache Pinot
> to
> > graduate. We have come a long way since we incubated in Apache, with:
> >
> >
> >-
> >
> >7800+ contributions from 168 contributors
> >-
> >
> >7 releases by various committers
> >-
> >
> >6 new committers invited (all accepted)
> >-
> >
> >Apache website available at: https://pinot.apache.org
> >-
> >
> >Updated Apache Pinot (incubating) page
> >
> >-
> >
> >Updated Roster Page 
> >-
> >
> >Dev conversations at d...@pinot.incubator.org
> >-
> >
> >Diverse committers and PPMCs (from 7 companies / institutes)
> >-
> >
> >We have built a meritocratic and open collaborative progress (the
> Apache
> >way)
> >-
> >
> >A strong community of 1200+ members in Apache Pinot Slack
> >. All
> >conversations emailed to dev@ in the form of a digest
> >
> >
> > Please let us know if there are remaining steps involved in completing
> the
> > graduation process.
> >
> > Thanks,
> >
> > Kishore G
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> For additional commands, e-mail: dev-h...@pinot.apache.org
>
>

-- 
Xiang Fu


Re: [VOTE] Apache Pinot 0.12.1 RC0

2023-03-02 Thread Fu Xiang
+1


On Thu, Mar 2, 2023 at 4:57 PM Xiaotian Jiang  wrote:

> +1
>
> On Mon, Feb 27, 2023 at 10:24 PM Rong Rong  wrote:
>
>> Hi Pinot Community,
>>
>> This is a call for a vote to release Apache Pinot 0.12.1.
>>
>> The release candidate:
>> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-0.12.1-rc0
>>
>> Git tag for this release:
>> https://github.com/apache/pinot/tree/release-0.12.1-rc0
>>
>> Git hash for this release:
>> 6e235a4ec2a16006337da04e118a435b5bb8f6d8
>>
>> The artifacts have been signed with key: 0F912E9BA55E4F6E, which can be
>> found in
>> the following KEYS file.
>> https://dist.apache.org/repos/dist/release/pinot/KEYS
>>
>> Release notes:
>> https://github.com/apache/pinot/releases/tag/release-0.12.1-rc0
>>
>> Staging repository:
>> https://repository.apache.org/content/repositories/orgapachepinot-1044
>>
>> Documentation on verifying a release candidate:
>>
>> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
>>
>> The vote will be open for at least 72 hours or until a necessary number of
>> votes is reached.
>>
>> Please vote accordingly,
>>
>> [ ] +1 approve
>> [ ] +0 no opinion
>> [ ] -1 disapprove with the reason
>>
>> Thanks,
>> Apache Pinot team
>>
> --
Xiang Fu


Re: [VOTE] Apache Pinot 1.1.0 RC1

2024-03-16 Thread Fu Xiang
+1 (binding)

Xiang Fu


On Sun, Mar 17, 2024 at 06:24 Mayank Shrivastava 
wrote:

> +1 (binding)
>
> > On Mar 16, 2024, at 9:38 AM, Subbu Subramaniam 
> wrote:
> >
> > +1 (binding)
> >
> > -Subbu Subramaniam
> > Apache PMC
> >
> >> On 2024/03/07 04:03:58 Vivek Iyer Vaidyanathan Iyer wrote:
> >> Hi Pinot Community,
> >>
> >> This is a call for a vote to release Apache Pinot 1.1.0
> >>
> >> The release candidate:
> >> https://dist.apache.org/repos/dist/dev/pinot/apache-pinot-1.1.0-rc1/
> >>
> >> Git tag for this release:
> >> https://github.com/apache/pinot/tree/release-1.1.0-rc1
> >> 
> >> Git hash for this release:
> >> c2606742bbc4b15cff857eb0ffe7ec878ff181bb
> >>
> >> The artifact has been signed with key: 1D2B6F73AEA25682, which can be
> found
> >> in the following KEYS file:
> >> https://dist.apache.org/repos/dist/release/pinot/KEYS
> >>
> >> Release notes:
> >> https://github.com/apache/pinot/releases/tag/release-1.1.0-rc1
> >> 
> >> Staging repository:
> >> https://repository.apache.org/content/repositories/orgapachepinot-1061/
> >> <
> https://repository.apache.org/content/repositories/orgapachepinot-1060/>
> >> Documentation on verifying a release candidate:
> >>
> https://cwiki.apache.org/confluence/display/PINOT/Validating+a+release+candidate
> >>
> >> The vote will be open for at least 72 hours or until a necessary number
> of
> >> votes is reached.
> >>
> >> Please vote accordingly,
> >>
> >> [ ] +1 approve
> >> [ ] +0 no opinion
> >> [ ] -1 disapprove with the reason
> >>
> >> Thanks,
> >> Apache Pinot team
> >>
> >
> > -
> > To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> > For additional commands, e-mail: dev-h...@pinot.apache.org
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org
> For additional commands, e-mail: dev-h...@pinot.apache.org
>
>