[incubator-pinot] branch controller-api-brokers updated (cda4c4f -> f4496ee)

2020-07-10 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch controller-api-brokers in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard cda4c4f Adding controller APIs to fetch brokers information add f4496ee Adding contr

[incubator-pinot] branch controller-api-brokers updated (1a2f8ff -> cda4c4f)

2020-07-10 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch controller-api-brokers in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. discard 1a2f8ff Adding controller APIs to fetch brokers information add cda4c4f Adding contr

[GitHub] [incubator-pinot] Jackie-Jiang opened a new pull request #5686: Early termination for combining selection order-by results

2020-07-10 Thread GitBox
Jackie-Jiang opened a new pull request #5686: URL: https://github.com/apache/incubator-pinot/pull/5686 Split `CombineOperator` into 3 different combine operators: - `SelectionOnlyCombineOperator` - `SelectionOrderByCombineOperator` - `AggregationOnlyOrderByCombineOperator` (For a

[GitHub] [incubator-pinot] fx19880617 opened a new pull request #5685: Adding controller APIs to fetch brokers information

2020-07-10 Thread GitBox
fx19880617 opened a new pull request #5685: URL: https://github.com/apache/incubator-pinot/pull/5685 ## Description Adding controller APIs to fetch brokers information Per issue: https://github.com/apache/incubator-pinot/issues/5682 ## Release Notes Adding Controller APIs to

[incubator-pinot] 01/01: Adding controller APIs to fetch brokers information

2020-07-10 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a commit to branch controller-api-brokers in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git commit 1a2f8fff33a5dccce1135ca13d00ad55b46786a5 Author: Xiang Fu AuthorDate: Fri Jul 10 20:01:58 2020

[incubator-pinot] branch controller-api-brokers created (now 1a2f8ff)

2020-07-10 Thread xiangfu
This is an automated email from the ASF dual-hosted git repository. xiangfu pushed a change to branch controller-api-brokers in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. at 1a2f8ff Adding controller APIs to fetch brokers information This branch includes the foll

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #5665: Re-implement TarGzCompressionUtils

2020-07-10 Thread GitBox
Jackie-Jiang commented on a change in pull request #5665: URL: https://github.com/apache/incubator-pinot/pull/5665#discussion_r453142136 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java ## @@ -18,225 +18,151 @@ */ package org

[GitHub] [incubator-pinot] Jackie-Jiang commented on a change in pull request #5665: Re-implement TarGzCompressionUtils

2020-07-10 Thread GitBox
Jackie-Jiang commented on a change in pull request #5665: URL: https://github.com/apache/incubator-pinot/pull/5665#discussion_r453141744 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java ## @@ -18,225 +18,151 @@ */ package org

[GitHub] [incubator-pinot] Jackie-Jiang commented on pull request #5672: Add SelectionQuerySegmentPruner to prune segments for simple selection queries

2020-07-10 Thread GitBox
Jackie-Jiang commented on pull request #5672: URL: https://github.com/apache/incubator-pinot/pull/5672#issuecomment-656960636 > Does the `LIMIT 0` query response just contains the projected columns or all columns from schema? If so, do we even need one segment there? We can simply refer to

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #5665: Re-implement TarGzCompressionUtils

2020-07-10 Thread GitBox
mayankshriv commented on a change in pull request #5665: URL: https://github.com/apache/incubator-pinot/pull/5665#discussion_r453103851 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java ## @@ -18,225 +18,151 @@ */ package org.

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #5665: Re-implement TarGzCompressionUtils

2020-07-10 Thread GitBox
mayankshriv commented on a change in pull request #5665: URL: https://github.com/apache/incubator-pinot/pull/5665#discussion_r453103440 ## File path: pinot-common/src/main/java/org/apache/pinot/common/utils/TarGzCompressionUtils.java ## @@ -18,225 +18,151 @@ */ package org.

[GitHub] [incubator-pinot] mayankshriv commented on pull request #5672: Add SelectionQuerySegmentPruner to prune segments for simple selection queries

2020-07-10 Thread GitBox
mayankshriv commented on pull request #5672: URL: https://github.com/apache/incubator-pinot/pull/5672#issuecomment-656919360 Does the `LIMIT 0` query response just contains the projected columns or all columns from schema? If so, do we even need one segment there? We can simply refer to th

[GitHub] [incubator-pinot] mayankshriv commented on pull request #5684: Cluster Manager UI & Query Console UI revamp

2020-07-10 Thread GitBox
mayankshriv commented on pull request #5684: URL: https://github.com/apache/incubator-pinot/pull/5684#issuecomment-656918270 A couple suggestions: * For cluster manager, we should be able to drill down at table level as well (apart from tenant). * It would be super awesome if the UI p

[GitHub] [incubator-pinot] shahsank3t opened a new pull request #5684: Cluster Manager UI & Query Console UI revamp

2020-07-10 Thread GitBox
shahsank3t opened a new pull request #5684: URL: https://github.com/apache/incubator-pinot/pull/5684 ## Description Complete revamp of existing UI containing Cluster Manager & Query Console. - This PR is against https://github.com/apache/incubator-pinot/issues/5649 - Cluster Manager

[GitHub] [incubator-pinot] grcevski opened a new pull request #5683: Add documentation for the Pinot/Druid benchmark

2020-07-10 Thread GitBox
grcevski opened a new pull request #5683: URL: https://github.com/apache/incubator-pinot/pull/5683 ## Description This is a documentation PR. It adds documentation about how to create the Apache Pinot data segments for the Pinot/Druid TPC-H benchmark in [contrib/pinot-druid-benchmark](h

[incubator-pinot] branch master updated: [TE] Updated README in ThirdEye Documentation (#5678)

2020-07-10 Thread kishoreg
This is an automated email from the ASF dual-hosted git repository. kishoreg pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git The following commit(s) were added to refs/heads/master by this push: new 07938ea [TE] Updated README in Third

[GitHub] [incubator-pinot] kishoreg merged pull request #5678: [TE] Updated README in ThirdEye Documentation

2020-07-10 Thread GitBox
kishoreg merged pull request #5678: URL: https://github.com/apache/incubator-pinot/pull/5678 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [incubator-pinot] yupeng9 commented on pull request #5681: TransformConfig in IngestionConfig for ingestion transformations

2020-07-10 Thread GitBox
yupeng9 commented on pull request #5681: URL: https://github.com/apache/incubator-pinot/pull/5681#issuecomment-656807868 > > With this, do you think it's possible to support placeholders of some intermediate transform result, without adding them to the schema? > > Also, can the filter us

[GitHub] [incubator-pinot] npawar commented on pull request #5681: TransformConfig in IngestionConfig for ingestion transformations

2020-07-10 Thread GitBox
npawar commented on pull request #5681: URL: https://github.com/apache/incubator-pinot/pull/5681#issuecomment-656802312 > With this, do you think it's possible to support placeholders of some intermediate transform result, without adding them to the schema? > Also, can the filter use the

[GitHub] [incubator-pinot] kishoreg merged pull request #5669: Fixing code to fetch the fsConfig from the right parent

2020-07-10 Thread GitBox
kishoreg merged pull request #5669: URL: https://github.com/apache/incubator-pinot/pull/5669 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[incubator-pinot] branch master updated (9196fcb -> 2dc72a5)

2020-07-10 Thread kishoreg
This is an automated email from the ASF dual-hosted git repository. kishoreg pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from 9196fcb fetch all columns and datatypes (#5673) add 2dc72a5 Fixing code to fetch the fsConfig from

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
mayankshriv commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452976876 ## File path: pinot-spi/src/test/java/org/apache/pinot/spi/env/PinotConfigurationTest.java ## @@ -24,24 +24,116 @@ import java.nio.file.File

[GitHub] [incubator-pinot] daniellavoie commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
daniellavoie commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452324220 ## File path: pinot-spi/src/test/java/org/apache/pinot/spi/env/PinotConfigurationTest.java ## @@ -24,24 +24,116 @@ import java.nio.file.Fil

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
mayankshriv commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452976876 ## File path: pinot-spi/src/test/java/org/apache/pinot/spi/env/PinotConfigurationTest.java ## @@ -24,24 +24,116 @@ import java.nio.file.File

[GitHub] [incubator-pinot] mayankshriv commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
mayankshriv commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452975868 ## File path: pinot-spi/src/test/java/org/apache/pinot/spi/env/PinotConfigurationTest.java ## @@ -24,24 +24,116 @@ import java.nio.file.File

[GitHub] [incubator-pinot] yupeng9 commented on pull request #5681: TransformConfig in IngestionConfig for ingestion transformations

2020-07-10 Thread GitBox
yupeng9 commented on pull request #5681: URL: https://github.com/apache/incubator-pinot/pull/5681#issuecomment-656758962 With this, do you think it's possible to support placeholders of some intermediate transform result, without adding them to the schema? Also, can the filter use the tr

[GitHub] [incubator-pinot] kishoreg merged pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
kishoreg merged pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[incubator-pinot] branch pinot-fs-bug-fix updated (c703924 -> e3900cf)

2020-07-10 Thread kishoreg
This is an automated email from the ASF dual-hosted git repository. kishoreg pushed a change to branch pinot-fs-bug-fix in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git. from c703924 addressing comments add e3900cf Pinot fs bug fix (#5674) No new revisions were a

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
kishoreg commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452879296 ## File path: pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmen

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
kishoreg commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452840350 ## File path: pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmen

[GitHub] [incubator-pinot] daniellavoie commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
daniellavoie commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452828229 ## File path: pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSe

[GitHub] [incubator-pinot] daniellavoie commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
daniellavoie commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452828229 ## File path: pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSe

[GitHub] [incubator-pinot] daniellavoie commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
daniellavoie commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452828229 ## File path: pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSe

[GitHub] [incubator-pinot] kishoreg commented on a change in pull request #5674: Pinot fs bug fix

2020-07-10 Thread GitBox
kishoreg commented on a change in pull request #5674: URL: https://github.com/apache/incubator-pinot/pull/5674#discussion_r452824754 ## File path: pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmen

[GitHub] [incubator-pinot] fx19880617 opened a new issue #5682: Adding Controller REST APIs to fetch Broker information.

2020-07-10 Thread GitBox
fx19880617 opened a new issue #5682: URL: https://github.com/apache/incubator-pinot/issues/5682 The motivation is to support a Pinot Client fully initialized by a pinot controller url (https://github.com/apache/incubator-pinot/issues/5660). The APIs to add: // Return all the {

[GitHub] [incubator-pinot] npawar opened a new pull request #5681: TransformConfig in IngestionConfig for ingestion transformations

2020-07-10 Thread GitBox
npawar opened a new pull request #5681: URL: https://github.com/apache/incubator-pinot/pull/5681 ## Description Add TransformConfigs list to IngestionConfig. This is based on discussion in Extensions in the Filtering design doc: https://docs.google.com/document/d/1Cahnas3nh0XErETH0KHLae

[GitHub] [incubator-pinot] npawar opened a new issue #5680: Move transformFunction from schema's field spec to tableConfig -> ingestionConfig

2020-07-10 Thread GitBox
npawar opened a new issue #5680: URL: https://github.com/apache/incubator-pinot/issues/5680 We added ingestionConfig in the tableConfig. This is the place for all ingestion related configs (such as filter function, transform, etc). Move the transform function from schema to ingestionConfig

[GitHub] [incubator-pinot] KKcorps opened a new pull request #5679: Adding column data type to result set interface

2020-07-10 Thread GitBox
KKcorps opened a new pull request #5679: URL: https://github.com/apache/incubator-pinot/pull/5679 This PR is related to #5673 Extending the current interface to support data types This is an automated message from the