Re: [PR] support S3 storage class [pinot]

2024-07-26 Thread via GitHub
xiangfu0 commented on PR #13613: URL: https://github.com/apache/pinot/pull/13613#issuecomment-2253839321 Thanks for adding this @sullis ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

(pinot) branch master updated: support Amazon S3 storage class (#13613)

2024-07-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new a6cf197bfa support Amazon S3 storage class (#136

Re: [PR] support S3 storage class [pinot]

2024-07-26 Thread via GitHub
xiangfu0 merged PR #13613: URL: https://github.com/apache/pinot/pull/13613 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

(pinot) branch SegmentProcessorFrameworkImprovement deleted (was 0022190559)

2024-07-26 Thread kharekartik
This is an automated email from the ASF dual-hosted git repository. kharekartik pushed a change to branch SegmentProcessorFrameworkImprovement in repository https://gitbox.apache.org/repos/asf/pinot.git was 0022190559 Added support to upload segments in batch mode with METADATA upload type

Re: [PR] [WIP]: refactor permission and access in controller rest api. [pinot]

2024-07-26 Thread via GitHub
codecov-commenter commented on PR #13696: URL: https://github.com/apache/pinot/pull/13696#issuecomment-2253685003 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/13696?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] [WIP]: refactor permission and access in controller rest api. [pinot]

2024-07-26 Thread via GitHub
abhioncbr opened a new pull request, #13696: URL: https://github.com/apache/pinot/pull/13696 TODO -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: co

Re: [PR] Facilitate asynchronous realtime ingestion on decoding & transformation [pinot]

2024-07-26 Thread via GitHub
codecov-commenter commented on PR #13695: URL: https://github.com/apache/pinot/pull/13695#issuecomment-2253663876 ## [Codecov](https://app.codecov.io/gh/apache/pinot/pull/13695?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&u

[PR] Facilitate asynchronous realtime ingestion on decoding & transformation [pinot]

2024-07-26 Thread via GitHub
lnbest0707-uber opened a new pull request, #13695: URL: https://github.com/apache/pinot/pull/13695 `ingestion` enhancement` `feature request` Resolving issues mentioned in https://github.com/apache/pinot/issues/13319. Pinot ingestion is currently using a strictly serial processing. It f

(pinot) branch master updated: Improve realtime Lucene text index freshness/cpu/disk io usage (#13503)

2024-07-26 Thread tingchen
This is an automated email from the ASF dual-hosted git repository. tingchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 8603164cc6 Improve realtime Lucene text index f

Re: [PR] Improve realtime Lucene text index freshness/cpu/disk io usage [pinot]

2024-07-26 Thread via GitHub
chenboat merged PR #13503: URL: https://github.com/apache/pinot/pull/13503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apa

(pinot) annotated tag release-1.2.0-rc0 updated (052ae5d9f2 -> 9fd2b41690)

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a change to annotated tag release-1.2.0-rc0 in repository https://gitbox.apache.org/repos/asf/pinot.git *** WARNING: tag release-1.2.0-rc0 was modified! *** from 052ae5d9f2 (commit) to 9fd2b41690 (

(pinot) branch release-1.2.0-rc updated: [maven-release-plugin] prepare for next development iteration

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a commit to branch release-1.2.0-rc in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/release-1.2.0-rc by this push: new 46fabddced [maven-relea

(pinot) branch release-1.2.0-rc updated: [maven-release-plugin] prepare release release-1.2.0-rc0

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a commit to branch release-1.2.0-rc in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/release-1.2.0-rc by this push: new 052ae5d9f2 [maven-relea

Re: [PR] Compatible dropwizard metrics [pinot]

2024-07-26 Thread via GitHub
real-mj-song commented on PR #9416: URL: https://github.com/apache/pinot/pull/9416#issuecomment-2253177639 @gortiz Is this PR still being worked on/active? The compound metrics plugin concept will also help for future open telemetry plugin (when/if it's added). -- This is an automated mes

(pinot) branch release-1.2.0-rc updated (5df94e42b4 -> 24775c147a)

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a change to branch release-1.2.0-rc in repository https://gitbox.apache.org/repos/asf/pinot.git discard 5df94e42b4 [maven-release-plugin] prepare for next development iteration This update removed existing

(pinot) annotated tag release-1.2.0-rc0 deleted (was 55da88b06d)

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a change to annotated tag release-1.2.0-rc0 in repository https://gitbox.apache.org/repos/asf/pinot.git *** WARNING: tag release-1.2.0-rc0 was deleted! *** tag was 55da88b06d The revisions that were on

(pinot) annotated tag release-1.2.0-rc0 updated (24775c147a -> 55da88b06d)

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a change to annotated tag release-1.2.0-rc0 in repository https://gitbox.apache.org/repos/asf/pinot.git *** WARNING: tag release-1.2.0-rc0 was modified! *** from 24775c147a (commit) to 55da88b06d (

(pinot) branch release-1.2.0-rc updated: [maven-release-plugin] prepare for next development iteration

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a commit to branch release-1.2.0-rc in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/release-1.2.0-rc by this push: new 5df94e42b4 [maven-relea

(pinot) 01/01: Added support to upload segments in batch mode with METADATA upload type (#13690)

2024-07-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch SegmentProcessorFrameworkImprovement in repository https://gitbox.apache.org/repos/asf/pinot.git commit 002219055986a8737601688ca2f379d889b0ec65 Author: Ragesh Rajagopalan AuthorDate: Thu Jul 25

(pinot) branch SegmentProcessorFrameworkImprovement updated (202216b5b7 -> 0022190559)

2024-07-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch SegmentProcessorFrameworkImprovement in repository https://gitbox.apache.org/repos/asf/pinot.git discard 202216b5b7 Added support to upload segments in batch mode with METADATA upload type (#1

Re: [I] GeoServer Compatibility [pinot]

2024-07-26 Thread via GitHub
PeterCorless commented on issue #12805: URL: https://github.com/apache/pinot/issues/12805#issuecomment-2253135571 @robertzych ☝️ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Add broker routing config: newSegmentExpirationTimeInSeconds [pinot]

2024-07-26 Thread via GitHub
ankitsultana merged PR #13686: URL: https://github.com/apache/pinot/pull/13686 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot

(pinot) branch master updated: Add Broker Node Level Config: newSegmentExpirationTimeInSeconds (#13686)

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 24e01c1c1b Add Broker Node Level Config: n

Re: [I] Improve InstanceSelector routing logic for new segments [pinot]

2024-07-26 Thread via GitHub
ankitsultana closed issue #13683: Improve InstanceSelector routing logic for new segments URL: https://github.com/apache/pinot/issues/13683 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

(pinot) branch release-1.2.0-rc updated: Update Notice and License for 1.2.0 Release (#13691)

2024-07-26 Thread ankitsultana
This is an automated email from the ASF dual-hosted git repository. ankitsultana pushed a commit to branch release-1.2.0-rc in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/release-1.2.0-rc by this push: new 24775c147a Update Notic

Re: [PR] Add broker routing config: newSegmentExpirationTimeInSeconds [pinot]

2024-07-26 Thread via GitHub
tibrewalpratik17 commented on code in PR #13686: URL: https://github.com/apache/pinot/pull/13686#discussion_r1693288782 ## pinot-spi/src/main/java/org/apache/pinot/spi/utils/CommonConstants.java: ## @@ -344,6 +345,9 @@ public static class Broker { // precedence over "query.

Re: [PR] Add broker routing config: newSegmentExpirationTimeInSeconds [pinot]

2024-07-26 Thread via GitHub
ankitsultana commented on code in PR #13686: URL: https://github.com/apache/pinot/pull/13686#discussion_r1693285417 ## pinot-spi/src/main/java/org/apache/pinot/spi/utils/CommonConstants.java: ## @@ -344,6 +345,9 @@ public static class Broker { // precedence over "query.resp

Re: [PR] Add broker routing config: newSegmentExpirationTimeInSeconds [pinot]

2024-07-26 Thread via GitHub
ankitsultana commented on code in PR #13686: URL: https://github.com/apache/pinot/pull/13686#discussion_r1693284438 ## pinot-spi/src/main/java/org/apache/pinot/spi/utils/CommonConstants.java: ## @@ -344,6 +345,9 @@ public static class Broker { // precedence over "query.resp

Re: [PR] Add broker routing config: newSegmentExpirationTimeInSeconds [pinot]

2024-07-26 Thread via GitHub
tibrewalpratik17 commented on PR #13686: URL: https://github.com/apache/pinot/pull/13686#issuecomment-2252945390 > Can we keep this a node level config only? I am hesitant in adding another config to table config since these are exposed to users one way or another. Sure works! We can

Re: [PR] Add broker routing config: newSegmentExpirationTimeInSeconds [pinot]

2024-07-26 Thread via GitHub
ankitsultana commented on PR #13686: URL: https://github.com/apache/pinot/pull/13686#issuecomment-2252920123 Can we keep this a node level config only? I am hesitant in adding another config to table config since these are exposed to users one way or another. -- This is an automated messa

Re: [PR] WB-NO-TICKET - Fix Events link in the footer [pinot-site]

2024-07-26 Thread via GitHub
xiangfu0 merged PR #126: URL: https://github.com/apache/pinot-site/pull/126 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.ap

(pinot-site) branch new-site-dev updated: WB-NO-TICKET - Fix Events link in the footer (#126)

2024-07-26 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch new-site-dev in repository https://gitbox.apache.org/repos/asf/pinot-site.git The following commit(s) were added to refs/heads/new-site-dev by this push: new 1874e407 WB-NO-TICKET - Fix Eve

[PR] WB-NO-TICKET - Fix Events link in the footer [pinot-site]

2024-07-26 Thread via GitHub
gio-startree opened a new pull request, #126: URL: https://github.com/apache/pinot-site/pull/126 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

Re: [PR] Build Profiles for aarch64 [pinot]

2024-07-26 Thread via GitHub
KKcorps merged PR #13648: URL: https://github.com/apache/pinot/pull/13648 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pinot.apac

(pinot) branch dependabot/maven/confluent.version-7.7.0 created (now 0cc1086a7f)

2024-07-26 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/confluent.version-7.7.0 in repository https://gitbox.apache.org/repos/asf/pinot.git at 0cc1086a7f Bump confluent.version from 7.6.2 to 7.7.0 No new revisions were adde

(pinot) branch master updated (8dd5b50b40 -> 9fd75c950d)

2024-07-26 Thread kharekartik
This is an automated email from the ASF dual-hosted git repository. kharekartik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git from 8dd5b50b40 Update Notice and License for 1.2.0 Release (#13691) add 9fd75c950d Build Profiles for aarch64 (#1

(pinot) branch dependabot/maven/org.apache.kafka-kafka-clients-7.7.0-ce created (now 3d693e0207)

2024-07-26 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.kafka-kafka-clients-7.7.0-ce in repository https://gitbox.apache.org/repos/asf/pinot.git at 3d693e0207 Bump org.apache.kafka:kafka-clients from 2.8.1 to 7.7

[PR] Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.25 [pinot]

2024-07-26 Thread via GitHub
dependabot[bot] opened a new pull request, #13692: URL: https://github.com/apache/pinot/pull/13692 Bumps software.amazon.awssdk:bom from 2.26.21 to 2.26.25. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=softwa

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.26.24 deleted (was 567a4645a0)

2024-07-26 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.26.24 in repository https://gitbox.apache.org/repos/asf/pinot.git was 567a4645a0 Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.24 T

Re: [PR] Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.24 [pinot]

2024-07-26 Thread via GitHub
dependabot[bot] commented on PR #13688: URL: https://github.com/apache/pinot/pull/13688#issuecomment-2252521424 Superseded by #13692. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(pinot) branch dependabot/maven/software.amazon.awssdk-bom-2.26.25 created (now 02939d35de)

2024-07-26 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/software.amazon.awssdk-bom-2.26.25 in repository https://gitbox.apache.org/repos/asf/pinot.git at 02939d35de Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.25 N

[PR] Bump confluent.version from 7.6.2 to 7.7.0 [pinot]

2024-07-26 Thread via GitHub
dependabot[bot] opened a new pull request, #13694: URL: https://github.com/apache/pinot/pull/13694 Bumps `confluent.version` from 7.6.2 to 7.7.0. Updates `io.confluent:kafka-schema-registry-client` from 7.6.2 to 7.7.0 Commits See full diff in https://github.com/confluentinc/s

Re: [PR] Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.24 [pinot]

2024-07-26 Thread via GitHub
dependabot[bot] closed pull request #13688: Bump software.amazon.awssdk:bom from 2.26.21 to 2.26.24 URL: https://github.com/apache/pinot/pull/13688 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[PR] Bump org.apache.kafka:kafka-clients from 2.8.1 to 7.7.0-ce [pinot]

2024-07-26 Thread via GitHub
dependabot[bot] opened a new pull request, #13693: URL: https://github.com/apache/pinot/pull/13693 Bumps org.apache.kafka:kafka-clients from 2.8.1 to 7.7.0-ce. [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=org

Re: [PR] Storage Quota imposition on Realtime tables [pinot]

2024-07-26 Thread via GitHub
shounakmk219 commented on PR #13584: URL: https://github.com/apache/pinot/pull/13584#issuecomment-2252520066 @sajjad-moradi can you please review the PR? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [I] Improve InstanceSelector routing logic for new segments [pinot]

2024-07-26 Thread via GitHub
tibrewalpratik17 commented on issue #13683: URL: https://github.com/apache/pinot/issues/13683#issuecomment-2252429945 > could we instead use a separate semaphore for blocking partial upsert table consumption in PartitionConsumer#run (or there might be some other better place)? The idea i

Re: [I] Upsert Compaction: Schema / Index updates [pinot]

2024-07-26 Thread via GitHub
tibrewalpratik17 commented on issue #13494: URL: https://github.com/apache/pinot/issues/13494#issuecomment-2252296012 Thanks @tarun11Mavani for confirming this! I see we use crc from `creation.meta` which is only updated during segment-creation time so it safes us from updates. Thank

Re: [I] Upsert Compaction: Schema / Index updates [pinot]

2024-07-26 Thread via GitHub
tibrewalpratik17 closed issue #13494: Upsert Compaction: Schema / Index updates URL: https://github.com/apache/pinot/issues/13494 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.