[GitHub] [incubator-pinot] fx19880617 opened a new pull request #6380: Adding a version option to pinot admin to show all the component versions

2020-12-22 Thread GitBox
fx19880617 opened a new pull request #6380: URL: https://github.com/apache/incubator-pinot/pull/6380 ## Description Adding a new option: -v into pinot-admin script to show all the component versions. Sample Output: ``` ➜ bin/pinot-admin.sh -v List All Pinot Component Versions

[incubator-pinot] 01/01: Adding a version option to pinot admin to show all the component versions

2020-12-22 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch adding_version_option_in_pinot_admin in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 23f7770ffc795b917c83efd3e36fcb369177bf01 Author: Xiang Fu AuthorDate: Tue Dec 22

[incubator-pinot] branch adding_version_option_in_pinot_admin created (now 23f7770)

2020-12-22 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_version_option_in_pinot_admin in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 23f7770 Adding a version option to pinot admin to show all the component ve

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547710745 ## File path: pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/geospatial/H3IndexReader.java ## @@ -0,0 +1,128 @@ +/** + * L

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547710349 ## File path: pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/invertedindex/H3IndexHandler.java ## @@ -0,0 +1,205 @@ +/** +

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547709207 ## File path: pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/geospatial/H3IndexCreator.java ## @@ -0,0 +1,344 @@ +/** + * L

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547705447 ## File path: pinot-core/src/main/java/org/apache/pinot/core/plan/FilterPlanNode.java ## @@ -120,6 +129,20 @@ private BaseFilterOperator constr

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547704563 ## File path: pinot-core/src/main/java/org/apache/pinot/core/operator/filter/H3IndexFilterOperator.java ## @@ -0,0 +1,148 @@ +/** + * Licensed t

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547703865 ## File path: pinot-core/src/main/java/org/apache/pinot/core/indexsegment/mutable/MutableSegmentImpl.java ## @@ -325,10 +326,10 @@ public long g

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
kishoreg commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547703614 ## File path: pinot-core/src/main/java/org/apache/pinot/core/geospatial/transform/function/ScalarFunctions.java ## @@ -72,4 +73,17 @@ public sta

[GitHub] [incubator-pinot] fx19880617 commented on pull request #6379: Adding s3 as default pinot fs for quickstart

2020-12-22 Thread GitBox
fx19880617 commented on pull request #6379: URL: https://github.com/apache/incubator-pinot/pull/6379#issuecomment-749960649 > why are we doing this? This is to allow user just run Quickstart and use S3 for ingestion Th

[GitHub] [incubator-pinot] kishoreg commented on pull request #6379: Adding s3 as default pinot fs for quickstart

2020-12-22 Thread GitBox
kishoreg commented on pull request #6379: URL: https://github.com/apache/incubator-pinot/pull/6379#issuecomment-749936861 why are we doing this? This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [incubator-pinot] codecov-io commented on pull request #6379: Adding s3 as default pinot fs for quickstart

2020-12-22 Thread GitBox
codecov-io commented on pull request #6379: URL: https://github.com/apache/incubator-pinot/pull/6379#issuecomment-749936428 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6379?src=pr&el=h1) Report > Merging [#6379](https://codecov.io/gh/apache/incubator-pinot/pull/6379?s

[GitHub] [incubator-pinot] fx19880617 opened a new pull request #6379: Adding s3 as default pinot fs for quickstart

2020-12-22 Thread GitBox
fx19880617 opened a new pull request #6379: URL: https://github.com/apache/incubator-pinot/pull/6379 ## Description Adding s3 as default pinot fs for quickstart. This is an automated message from the Apache Git Service. To

[incubator-pinot] branch adding_default_pinot_fs_to_quickstart created (now 1a42937)

2020-12-22 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch adding_default_pinot_fs_to_quickstart in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 1a42937 Adding s3 as default pinot fs for quickstart This branch includes

[incubator-pinot] 01/01: Adding s3 as default pinot fs for quickstart

2020-12-22 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch adding_default_pinot_fs_to_quickstart in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 1a42937d779bbd9319c269a269cf0fedc84bfea9 Author: Xiang Fu AuthorDate: Tue Dec 2

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6336: Segment reset API

2020-12-22 Thread GitBox
codecov-io edited a comment on pull request #6336: URL: https://github.com/apache/incubator-pinot/pull/6336#issuecomment-741130249 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6336?src=pr&el=h1) Report > Merging [#6336](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6336: Segment reset API

2020-12-22 Thread GitBox
codecov-io edited a comment on pull request #6336: URL: https://github.com/apache/incubator-pinot/pull/6336#issuecomment-741130249 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6336?src=pr&el=h1) Report > Merging [#6336](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] codecov-io edited a comment on pull request #6120: Add FST Index using lucene lib to speedup regexp queries

2020-12-22 Thread GitBox
codecov-io edited a comment on pull request #6120: URL: https://github.com/apache/incubator-pinot/pull/6120#issuecomment-705891235 # [Codecov](https://codecov.io/gh/apache/incubator-pinot/pull/6120?src=pr&el=h1) Report > Merging [#6120](https://codecov.io/gh/apache/incubator-pinot/pull

[GitHub] [incubator-pinot] SandishKumarHN commented on issue #5362: Add UDFs for String Transformation

2020-12-22 Thread GitBox
SandishKumarHN commented on issue #5362: URL: https://github.com/apache/incubator-pinot/issues/5362#issuecomment-74946 @KKcorps was thinking to add the below string functions 1) string1 + string2 = Concatenates (joins) string1 and string2 2) string * x = Returns the characters

[GitHub] [incubator-pinot] mcvsubbu merged pull request #6346: Introduce DimensionTableDataManager

2020-12-22 Thread GitBox
mcvsubbu merged pull request #6346: URL: https://github.com/apache/incubator-pinot/pull/6346 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-pinot] jihaozh merged pull request #6366: [TE]frontend - Integrate Performance Stats into Composite Anomalies

2020-12-22 Thread GitBox
jihaozh merged pull request #6366: URL: https://github.com/apache/incubator-pinot/pull/6366 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [incubator-pinot] chenboat opened a new issue #6378: Create a dashboard for most expensive queries per table

2020-12-22 Thread GitBox
chenboat opened a new issue #6378: URL: https://github.com/apache/incubator-pinot/issues/6378 In many production settings, a Pinot cluster can handle thousand of queries per second. Expensive queries can greatly impact the overall system performance. Right now, users of Pinot have to rely

[incubator-pinot] branch master updated (7580ae4 -> 33de6dc)

2020-12-22 Thread mcvsubbu
This is an automated email from the ASF dual-hosted git repository. mcvsubbu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 7580ae4 [TE]frontend - Integrate Performance Stats into Composite Anomalies (#6366) add 33de6dc In

[GitHub] [incubator-pinot] fx19880617 opened a new issue #6377: Adding /plugins APIs to show Pinot plugins status and support loading plugins at runtime

2020-12-22 Thread GitBox
fx19880617 opened a new issue #6377: URL: https://github.com/apache/incubator-pinot/issues/6377 The motivation of this is due to my recent test with S3 and other remote filesystems. If we want to use PinotFS in Pinot, the only way is to build a custom config file and set the configurations

[incubator-pinot] branch master updated (b8bc74f -> 7580ae4)

2020-12-22 Thread jihao
This is an automated email from the ASF dual-hosted git repository. jihao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from b8bc74f compatibility test: create/delete table operations (#6360) add 7580ae4 [TE]frontend - Integrat

[GitHub] [incubator-pinot] yupeng9 commented on a change in pull request #6376: Geo Indexing (WIP)

2020-12-22 Thread GitBox
yupeng9 commented on a change in pull request #6376: URL: https://github.com/apache/incubator-pinot/pull/6376#discussion_r547427987 ## File path: pinot-core/src/main/java/org/apache/pinot/core/geospatial/transform/function/ScalarFunctions.java ## @@ -72,4 +73,17 @@ public stat

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-22 Thread GitBox
mayankshriv commented on a change in pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#discussion_r547443037 ## File path: pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/OfflineClusterIntegrationTest.java ## @@ -236,7 +236,7

[GitHub] [incubator-pinot] samarth-gupta-traceable edited a comment on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-22 Thread GitBox
samarth-gupta-traceable edited a comment on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-749681512 @siddharthteotia I have made changes to make this part of QueryConfig. However I am not familiar with the code enough and not sure how to pass thi

[GitHub] [incubator-pinot] samarth-gupta-traceable commented on pull request #6375: make MAX_NUM_THREADS_PER_QUERY configurable for pinto server

2020-12-22 Thread GitBox
samarth-gupta-traceable commented on pull request #6375: URL: https://github.com/apache/incubator-pinot/pull/6375#issuecomment-749681512 @siddharthteotia I have made changes to make this part of QueryConfig. However I am familiar with the code enough and not sure how to pass this along an

[GitHub] [incubator-pinot] amarnathkarthik edited a comment on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

2020-12-22 Thread GitBox
amarnathkarthik edited a comment on issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-749460499 @fx19880617 Thanks for the clarification and suggestion. Shouldn't we just delete the files instead of deleting the output directory for both Tar and Ur

[GitHub] [incubator-pinot] amarnathkarthik commented on issue #6349: Standalone ingestion jobs do not clean up output files after completing loading

2020-12-22 Thread GitBox
amarnathkarthik commented on issue #6349: URL: https://github.com/apache/incubator-pinot/issues/6349#issuecomment-749460499 @fx19880617 Thanks for the clarification and suggestion. Shouldn't we just delete the files instead of deleting the output directory for both Tar and Uri push?

[incubator-pinot] branch h3-index updated (bab10b9 -> 561a905)

2020-12-22 Thread kishoreg
This is an automated email from the ASF dual-hosted git repository. kishoreg pushed a change to branch h3-index in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from bab10b9 Removing H3WITHIN UDF and adding logic to use h3 index for st_distance udf add 561a905 F