[GitHub] [pinot] walterddr commented on a change in pull request #7621: add extra properties to the tuner,

2021-10-22 Thread GitBox
walterddr commented on a change in pull request #7621: URL: https://github.com/apache/pinot/pull/7621#discussion_r734927855 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/tuner/TableConfigTuner.java ## @@ -32,13 +33,13 @@ public interface TableConfig

[GitHub] [pinot] mqliang commented on a change in pull request #7624: Enhance BloomFilter rule to include IN predicate(#7444)

2021-10-22 Thread GitBox
mqliang commented on a change in pull request #7624: URL: https://github.com/apache/pinot/pull/7624#discussion_r734924360 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/recommender/rules/impl/BloomFilterRule.java ## @@ -109,7 +109,8 @@ private FixedLe

[pinot] branch master updated: Use maxEndTimeMs for merge/roll-up delay metrics. (#7617)

2021-10-22 Thread snlee
This is an automated email from the ASF dual-hosted git repository. snlee pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new 7bcbda1 Use maxEndTimeMs for merge/roll-up delay

[GitHub] [pinot] snleee merged pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
snleee merged pull request #7617: URL: https://github.com/apache/pinot/pull/7617 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [pinot] jtao15 commented on a change in pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
jtao15 commented on a change in pull request #7617: URL: https://github.com/apache/pinot/pull/7617#discussion_r734910389 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] snleee commented on a change in pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
snleee commented on a change in pull request #7617: URL: https://github.com/apache/pinot/pull/7617#discussion_r734900769 ## File path: pinot-plugins/pinot-minion-tasks/pinot-minion-builtin-tasks/src/main/java/org/apache/pinot/plugin/minion/tasks/mergerollup/MergeRollupTaskGenerator.ja

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7624: Enhance BloomFilter rule to include IN predicate(#7444)

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7624: URL: https://github.com/apache/pinot/pull/7624#issuecomment-950031307 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7624?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7624: Enhance BloomFilter rule to include IN predicate(#7444)

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7624: URL: https://github.com/apache/pinot/pull/7624#issuecomment-950031307 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7624?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7624: Enhance BloomFilter rule to include IN predicate(#7444)

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7624: URL: https://github.com/apache/pinot/pull/7624#issuecomment-950031307 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7624?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7624: Enhance BloomFilter rule to include IN predicate(#7444)

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7624: URL: https://github.com/apache/pinot/pull/7624#issuecomment-950031307 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7624?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] GSharayu opened a new issue #7625: Enhance MergeRangeFilterOptimizer to rewrite predicate A < 10 OR A = 10

2021-10-22 Thread GitBox
GSharayu opened a new issue #7625: URL: https://github.com/apache/pinot/issues/7625 Currently, MergeRangeFilterOptimizer don't support operations to optimize query with filter patterns consisting of predicate A < 10 OR A = 10 as A<=10. this issue will track removal of that limitation and p

[GitHub] [pinot] GSharayu opened a new pull request #7624: Enhance BloomFilter rule to include IN predicate(#7444)

2021-10-22 Thread GitBox
GSharayu opened a new pull request #7624: URL: https://github.com/apache/pinot/pull/7624 Support in the execution engine was added for bloom filter (#7005) based pruning using IN predicate. The index recommendation rule isn't yet updated to support IN predicate. The current implementation

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7622: URL: https://github.com/apache/pinot/pull/7622#issuecomment-950016231 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7622?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7623: Fix star-tree index map when column name contains '.'

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7623: URL: https://github.com/apache/pinot/pull/7623#issuecomment-950006202 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7623?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7622: URL: https://github.com/apache/pinot/pull/7622#issuecomment-950016231 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7622?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7619: avoid repeating column stats work when values are repeated

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7619: URL: https://github.com/apache/pinot/pull/7619#issuecomment-950007246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7619?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] richardstartin commented on pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
richardstartin commented on pull request #7622: URL: https://github.com/apache/pinot/pull/7622#issuecomment-950014357 > We are replacing the JDK implementation with our own, and I feel JIT might be able to optimize on the JDK default method, and the benchmark might have different result in

[GitHub] [pinot] richardstartin commented on a change in pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
richardstartin commented on a change in pull request #7622: URL: https://github.com/apache/pinot/pull/7622#discussion_r734886249 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/utils/ByteArray.java ## @@ -94,7 +94,23 @@ public boolean equals(Object o) { @Overrid

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7623: Fix star-tree index map when column name contains '.'

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7623: URL: https://github.com/apache/pinot/pull/7623#issuecomment-950006202 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7623?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] mqliang commented on a change in pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
mqliang commented on a change in pull request #7622: URL: https://github.com/apache/pinot/pull/7622#discussion_r734885268 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/utils/ByteArray.java ## @@ -94,7 +94,23 @@ public boolean equals(Object o) { @Override pu

[GitHub] [pinot] codecov-commenter commented on pull request #7619: avoid repeating column stats work when values are repeated

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7619: URL: https://github.com/apache/pinot/pull/7619#issuecomment-950007246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7619?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter commented on pull request #7623: Fix star-tree index map when column name contains '.'

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7623: URL: https://github.com/apache/pinot/pull/7623#issuecomment-950006202 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7623?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] richardstartin commented on a change in pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
richardstartin commented on a change in pull request #7622: URL: https://github.com/apache/pinot/pull/7622#discussion_r734883398 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/utils/ByteArray.java ## @@ -94,7 +94,23 @@ public boolean equals(Object o) { @Overrid

[GitHub] [pinot] mqliang commented on a change in pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
mqliang commented on a change in pull request #7622: URL: https://github.com/apache/pinot/pull/7622#discussion_r734883165 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/utils/ByteArray.java ## @@ -94,7 +94,23 @@ public boolean equals(Object o) { @Override pu

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7621: add extra properties to the tuner,

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7621: URL: https://github.com/apache/pinot/pull/7621#issuecomment-950002029 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7621?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] Jackie-Jiang commented on a change in pull request #7621: add extra properties to the tuner,

2021-10-22 Thread GitBox
Jackie-Jiang commented on a change in pull request #7621: URL: https://github.com/apache/pinot/pull/7621#discussion_r734877659 ## File path: pinot-controller/src/main/java/org/apache/pinot/controller/tuner/TableConfigTuner.java ## @@ -32,13 +33,13 @@ public interface TableCon

[GitHub] [pinot] mqliang commented on a change in pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
mqliang commented on a change in pull request #7622: URL: https://github.com/apache/pinot/pull/7622#discussion_r734881229 ## File path: pinot-spi/src/main/java/org/apache/pinot/spi/utils/ByteArray.java ## @@ -94,7 +94,23 @@ public boolean equals(Object o) { @Override pu

[GitHub] [pinot] codecov-commenter commented on pull request #7621: add extra properties to the tuner,

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7621: URL: https://github.com/apache/pinot/pull/7621#issuecomment-950002029 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7621?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] richardstartin opened a new pull request #7622: accelerate `ByteArray.hashCode`

2021-10-22 Thread GitBox
richardstartin opened a new pull request #7622: URL: https://github.com/apache/pinot/pull/7622 ## Description Speed up `ByteArray.hashCode` which speeds up building column statistics. Unfortunately the algorithm needs to be maintained in case it has been used for partitioning, but i

[GitHub] [pinot] walterddr opened a new pull request #7621: add extra properties to the tuner,

2021-10-22 Thread GitBox
walterddr opened a new pull request #7621: URL: https://github.com/apache/pinot/pull/7621 We made tuner stateless a while ago so now it is requires some extra properties for run. for example some of the unused properties set by `TunerConfig`. This adds additional map field at the en

[GitHub] [pinot] thealmightygrant commented on a change in pull request #7620: ThriftMessageDecoder for reading arbitrary thrift data from Kafka

2021-10-22 Thread GitBox
thealmightygrant commented on a change in pull request #7620: URL: https://github.com/apache/pinot/pull/7620#discussion_r734861988 ## File path: pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftMessageDecoder.java ##

[GitHub] [pinot] thealmightygrant opened a new pull request #7620: ThriftMessageDecoder for reading arbitrary thrift data from Kafka

2021-10-22 Thread GitBox
thealmightygrant opened a new pull request #7620: URL: https://github.com/apache/pinot/pull/7620 ## Description This is a WIP for adding a Stream Decoder that can read Thrift. I used the [SimpleAvroMessageDecoder](https://github.com/apache/pinot/blob/9275a430049ff0d2888cb353fc7ef369d

[GitHub] [pinot] richardstartin opened a new pull request #7619: avoid repeating column stats work when values are repeated

2021-10-22 Thread GitBox
richardstartin opened a new pull request #7619: URL: https://github.com/apache/pinot/pull/7619 ## Description By checking whether a value has been added to the `_values` set before, we can avoid doing things like UTF-8 encoding, evaluating partitioning functions and so on more than once

[pinot] branch master updated: (fix) Query console doesn't load (#7618)

2021-10-22 Thread mayanks
This is an automated email from the ASF dual-hosted git repository. mayanks pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new a114cd2 (fix) Query console doesn't load (#7618

[GitHub] [pinot] mayankshriv merged pull request #7618: (fix) Query console doesn't load

2021-10-22 Thread GitBox
mayankshriv merged pull request #7618: URL: https://github.com/apache/pinot/pull/7618 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsu

[GitHub] [pinot] mayankshriv closed issue #7614: Query console doesn't load

2021-10-22 Thread GitBox
mayankshriv closed issue #7614: URL: https://github.com/apache/pinot/issues/7614 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [pinot] mayankshriv commented on issue #7560: COUNT DISTINCT on multiple columns produces wrong result.

2021-10-22 Thread GitBox
mayankshriv commented on issue #7560: URL: https://github.com/apache/pinot/issues/7560#issuecomment-949960320 +1 to @Jackie-Jiang's suggestion. With the Theta-Sketches implementations we had enhanced the query execution engine to support aggregation functions multiple arguments, and this o

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7618: (fix) Query console doesn't load

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7618: URL: https://github.com/apache/pinot/pull/7618#issuecomment-949945745 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7618?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] richardstartin edited a comment on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
richardstartin edited a comment on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949950995 You're right, `System.nanoTime()` does not record wall time. ~`System.currentTimeMillis() - bufferTimeMs` is an elapsed time (a duration), unless I'm missing somethi

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7618: (fix) Query console doesn't load

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7618: URL: https://github.com/apache/pinot/pull/7618#issuecomment-949945745 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7618?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] richardstartin commented on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
richardstartin commented on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949950995 You're right, `System.nanoTime()` does not record wall time. `System.currentTimeMillis() - bufferTimeMs` is an elapsed time (a duration), unless I'm missing something? The

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7605: Update watermark if no segments present for a window. Fixes #6988

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7605: URL: https://github.com/apache/pinot/pull/7605#issuecomment-949929162 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7605?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] jtao15 commented on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
jtao15 commented on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949946633 > What happens if the system clock is adjusted backwards so that `bufferTimeMs` > `System.currentTimeMillis()`? Durations should be recorded using `System.nanoTime()`. @rich

[GitHub] [pinot] codecov-commenter commented on pull request #7618: (fix) Query console doesn't load

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7618: URL: https://github.com/apache/pinot/pull/7618#issuecomment-949945745 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7618?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7605: Update watermark if no segments present for a window. Fixes #6988

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7605: URL: https://github.com/apache/pinot/pull/7605#issuecomment-949929162 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7605?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949914591 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7617?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7605: Update watermark if no segments present for a window. Fixes #6988

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7605: URL: https://github.com/apache/pinot/pull/7605#issuecomment-949929162 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7605?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949914591 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7617?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] shahsank3t opened a new pull request #7618: (fix) Query console doesn't load

2021-10-22 Thread GitBox
shahsank3t opened a new pull request #7618: URL: https://github.com/apache/pinot/pull/7618 ## Description This fixes https://github.com/apache/pinot/issues/7614 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949914591 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7617?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949914591 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7617?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] weixiangsun commented on a change in pull request #7584: Add LASTWITHTIME aggregate function support #7315

2021-10-22 Thread GitBox
weixiangsun commented on a change in pull request #7584: URL: https://github.com/apache/pinot/pull/7584#discussion_r734793772 ## File path: pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/AggregationFunctionFactory.java ## @@ -156,6 +157,46 @@ public

[GitHub] [pinot] lakshmanan-v commented on a change in pull request #7584: Add LASTWITHTIME aggregate function support #7315

2021-10-22 Thread GitBox
lakshmanan-v commented on a change in pull request #7584: URL: https://github.com/apache/pinot/pull/7584#discussion_r734791697 ## File path: pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/AggregationFunctionFactory.java ## @@ -156,6 +157,46 @@ public

[GitHub] [pinot] richardstartin commented on pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
richardstartin commented on pull request #7617: URL: https://github.com/apache/pinot/pull/7617#issuecomment-949900593 What happens if the system clock is adjusted backwards so that `bufferTimeMs` > `System.currentTimeMillis()`? Durations should be recorded using `System.nanoTime()`. --

[GitHub] [pinot] jtao15 opened a new pull request #7617: Use maxEndTimeMs for merge/roll-up delay metrics.

2021-10-22 Thread GitBox
jtao15 opened a new pull request #7617: URL: https://github.com/apache/pinot/pull/7617 - For single level merge or the lowest merge level of multi-level, the equation is updated as ```(Math.min(System.currentTimeMillis() - bufferTimeMs, maxEndTimeMs) - watermarkMs) / bucketTimeMs```

[GitHub] [pinot] kriti-sc commented on pull request #7605: Update watermark if no segments present for a window. Fixes #6988

2021-10-22 Thread GitBox
kriti-sc commented on pull request #7605: URL: https://github.com/apache/pinot/pull/7605#issuecomment-949885810 @npawar If a segment is `CONSUMING` or `DONE`, this check is already being performed [here](https://github.com/apache/pinot/blob/1bd899c9ba45676d1ac25979274391431bdf5ce9/pinot-

[GitHub] [pinot] richardstartin opened a new issue #7616: Raw forward index enhancement proposal

2021-10-22 Thread GitBox
richardstartin opened a new issue #7616: URL: https://github.com/apache/pinot/issues/7616 We would like to introduce a new format for raw forward indexes, which does not need a constant number of documents per chunk, instead partitioning columns based on uncompressed size. It is expected t

[GitHub] [pinot] mayankshriv closed issue #7187: Issue with CSV ingestion with non-default delimiter

2021-10-22 Thread GitBox
mayankshriv closed issue #7187: URL: https://github.com/apache/pinot/issues/7187 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[GitHub] [pinot] mayankshriv commented on issue #7187: Issue with CSV ingestion with non-default delimiter

2021-10-22 Thread GitBox
mayankshriv commented on issue #7187: URL: https://github.com/apache/pinot/issues/7187#issuecomment-949770103 Thanks @suddendust for fixing the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [pinot] kishoreg closed issue #2270: Add support for Thrift record reader

2021-10-22 Thread GitBox
kishoreg closed issue #2270: URL: https://github.com/apache/pinot/issues/2270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7615: make it possible to specify raw index properties for columns with JSON and RANGE indexes

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7615: URL: https://github.com/apache/pinot/pull/7615#issuecomment-949637246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7615?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7615: make it possible to specify raw index properties for columns with JSON and RANGE indexes

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7615: URL: https://github.com/apache/pinot/pull/7615#issuecomment-949637246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7615?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7615: make it possible to specify raw index properties for columns with JSON and RANGE indexes

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7615: URL: https://github.com/apache/pinot/pull/7615#issuecomment-949637246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7615?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] thealmightygrant closed pull request #6427: Update mysql version and fix thirdeye helm chart to work with current pinot version.

2021-10-22 Thread GitBox
thealmightygrant closed pull request #6427: URL: https://github.com/apache/pinot/pull/6427 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits

[pinot] branch master updated: Add MV raw forward index and MV `BYTES` data type (#7595)

2021-10-22 Thread kishoreg
This is an automated email from the ASF dual-hosted git repository. kishoreg pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pinot.git The following commit(s) were added to refs/heads/master by this push: new aed1307 Add MV raw forward index and MV `BYTES

[GitHub] [pinot] kishoreg merged pull request #7595: Add MV raw forward index and MV `BYTES` data type

2021-10-22 Thread GitBox
kishoreg merged pull request #7595: URL: https://github.com/apache/pinot/pull/7595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7615: make it possible to specify raw index properties for columns with JSON and RANGE indexes

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7615: URL: https://github.com/apache/pinot/pull/7615#issuecomment-949637246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7615?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter commented on pull request #7615: make it possible to specify raw index properties for columns with JSON and RANGE indexes

2021-10-22 Thread GitBox
codecov-commenter commented on pull request #7615: URL: https://github.com/apache/pinot/pull/7615#issuecomment-949637246 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7615?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apac

[GitHub] [pinot] richardstartin opened a new pull request #7615: make it possible to specify raw index properties for columns with JSON and RANGE indexes

2021-10-22 Thread GitBox
richardstartin opened a new pull request #7615: URL: https://github.com/apache/pinot/pull/7615 ## Description Previously deserialising tableConfig with field config e.g. ```json "fieldConfigList": [ { "encodingType": "RAW", "indexType": "JSON",

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7595: Add MV raw forward index and MV `BYTES` data type

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7595: URL: https://github.com/apache/pinot/pull/7595#issuecomment-946634547 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7595?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] codecov-commenter edited a comment on pull request #7595: Add MV raw forward index and MV `BYTES` data type

2021-10-22 Thread GitBox
codecov-commenter edited a comment on pull request #7595: URL: https://github.com/apache/pinot/pull/7595#issuecomment-946634547 # [Codecov](https://codecov.io/gh/apache/pinot/pull/7595?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=T

[GitHub] [pinot] richardstartin opened a new issue #7614: Query console doesn't load

2021-10-22 Thread GitBox
richardstartin opened a new issue #7614: URL: https://github.com/apache/pinot/issues/7614 On the master branch when loading the query console an error is encountered https://user-images.githubusercontent.com/16439049/138432863-fe8dccc8-45bb-48e5-8a68-6752487fee8d.png";> Ste

[GitHub] [pinot] richardstartin commented on a change in pull request #7595: Add MV raw forward index and MV `BYTES` data type

2021-10-22 Thread GitBox
richardstartin commented on a change in pull request #7595: URL: https://github.com/apache/pinot/pull/7595#discussion_r734373632 ## File path: pinot-core/src/main/java/org/apache/pinot/core/minion/RawIndexConverter.java ## @@ -207,7 +207,7 @@ private void convertColumn(FieldSp

[GitHub] [pinot] richardstartin commented on a change in pull request #7595: Add MV raw forward index and MV `BYTES` data type

2021-10-22 Thread GitBox
richardstartin commented on a change in pull request #7595: URL: https://github.com/apache/pinot/pull/7595#discussion_r734373235 ## File path: pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/writer/impl/BaseChunkSVForwardIndexWriter.java ## @@ -151,8 +154,1

[GitHub] [pinot] richardstartin commented on a change in pull request #7595: Add MV raw forward index and MV `BYTES` data type

2021-10-22 Thread GitBox
richardstartin commented on a change in pull request #7595: URL: https://github.com/apache/pinot/pull/7595#discussion_r734372096 ## File path: pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/writer/impl/VarByteChunkSVForwardIndexWriter.java ## @@ -33,27 +33

[GitHub] [pinot] suddendust commented on issue #7187: Issue with CSV ingestion with non-default delimiter

2021-10-22 Thread GitBox
suddendust commented on issue #7187: URL: https://github.com/apache/pinot/issues/7187#issuecomment-949374038 Can this be closed? The PR was merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t