[GitHub] clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258367361 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -284,10 +310,1

[GitHub] clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258366117 ## File path: extensions-core/druid-bloom-filter/src/test/java/org/apache/druid/query/filter/sql/BloomDimFilte

[GitHub] clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258364440 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -284,10 +310,1

[GitHub] zhaojiandong commented on issue #6365: new feature: allows user to specify timeZone in TimestampSpec

2019-02-19 Thread GitBox
zhaojiandong commented on issue #6365: new feature: allows user to specify timeZone in TimestampSpec URL: https://github.com/apache/incubator-druid/pull/6365#issuecomment-465461771 I've merged remote/upsteam/master to my branch and triggered the TeamCity build @gianm

[GitHub] clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258363830 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuerySignature.java ## @@ -0,0

[GitHub] clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258363376 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuerySignature.java ## @@ -0,0

[GitHub] clintropolis commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values

2019-02-19 Thread GitBox
clintropolis commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values URL: https://github.com/apache/incubator-druid/issues/3878#issuecomment-465459575 I've also been lightly experimenting

[GitHub] QubitPi edited a comment on issue #6043: Faulty channel in resource pool

2019-02-19 Thread GitBox
QubitPi edited a comment on issue #6043: Faulty channel in resource pool URL: https://github.com/apache/incubator-druid/issues/6043#issuecomment-465459440 We concluded that the cause is our application had extremely high memory usage on heap, causing GC-pauses to over-kill Druid process re

[GitHub] QubitPi commented on issue #6043: Faulty channel in resource pool

2019-02-19 Thread GitBox
QubitPi commented on issue #6043: Faulty channel in resource pool URL: https://github.com/apache/incubator-druid/issues/6043#issuecomment-465459440 We concluded that the cause is we had extremely high memory usage on heap, causing GC-pauses to over-kill Druid process resources. We decided

[GitHub] clintropolis commented on issue #6865: Densify swapped hll buffer

2019-02-19 Thread GitBox
clintropolis commented on issue #6865: Densify swapped hll buffer URL: https://github.com/apache/incubator-druid/pull/6865#issuecomment-465452225 @leerho Thanks for looking so deeply into this and for the detailed explanation! I am not very familiar with this area of the code and am defini

[GitHub] hnakamor opened a new issue #7108: Data ingestion fails on Quantiles DoublesSketch containing NULL When usingDefaultValueForNull = false

2019-02-19 Thread GitBox
hnakamor opened a new issue #7108: Data ingestion fails on Quantiles DoublesSketch containing NULL When usingDefaultValueForNull = false URL: https://github.com/apache/incubator-druid/issues/7108 Hi All, In 0.13.0-incubating, setting usingDefaultValueForNull = false and using a quan

[GitHub] fjy merged pull request #7101: [Backport] add note on consistency of results for sys.segments queries (#7034)

2019-02-19 Thread GitBox
fjy merged pull request #7101: [Backport] add note on consistency of results for sys.segments queries (#7034) URL: https://github.com/apache/incubator-druid/pull/7101 This is an automated message from the Apache Git Service.

[incubator-druid] branch 0.14.0-incubating updated: add note on consistency of results for sys.segments queries (#7034) (#7101)

2019-02-19 Thread fjy
This is an automated email from the ASF dual-hosted git repository. fjy pushed a commit to branch 0.14.0-incubating in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/0.14.0-incubating by this push: new 9990e04 add note on

[GitHub] fjy merged pull request #7104: [Backport] Fix and improve doc for partitioning of local index

2019-02-19 Thread GitBox
fjy merged pull request #7104: [Backport] Fix and improve doc for partitioning of local index URL: https://github.com/apache/incubator-druid/pull/7104 This is an automated message from the Apache Git Service. To respond to t

[incubator-druid] branch 0.14.0-incubating updated: Fix and improve doc for partitioning of local index (#7064) (#7104)

2019-02-19 Thread fjy
This is an automated email from the ASF dual-hosted git repository. fjy pushed a commit to branch 0.14.0-incubating in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/0.14.0-incubating by this push: new aae0f10 Fix and imp

[GitHub] fjy merged pull request #7103: [Backport] Add doc for Hadoop-based ingestion vs Native batch ingestion

2019-02-19 Thread GitBox
fjy merged pull request #7103: [Backport] Add doc for Hadoop-based ingestion vs Native batch ingestion URL: https://github.com/apache/incubator-druid/pull/7103 This is an automated message from the Apache Git Service. To res

[GitHub] fjy merged pull request #7102: [Backport] Add an api to get all lookup specs

2019-02-19 Thread GitBox
fjy merged pull request #7102: [Backport] Add an api to get all lookup specs URL: https://github.com/apache/incubator-druid/pull/7102 This is an automated message from the Apache Git Service. To respond to the message, please

[incubator-druid] branch 0.14.0-incubating updated: Add doc for Hadoop-based ingestion vs Native batch ingestion (#7044) (#7103)

2019-02-19 Thread fjy
This is an automated email from the ASF dual-hosted git repository. fjy pushed a commit to branch 0.14.0-incubating in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/0.14.0-incubating by this push: new 510de41 Add doc for

[GitHub] fjy merged pull request #7106: [Backport] Missing Overlord and MiddleManager api docs

2019-02-19 Thread GitBox
fjy merged pull request #7106: [Backport] Missing Overlord and MiddleManager api docs URL: https://github.com/apache/incubator-druid/pull/7106 This is an automated message from the Apache Git Service. To respond to the messa

[incubator-druid] branch 0.14.0-incubating updated: Add an api to get all lookup specs (#7025) (#7102)

2019-02-19 Thread fjy
This is an automated email from the ASF dual-hosted git repository. fjy pushed a commit to branch 0.14.0-incubating in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/0.14.0-incubating by this push: new bd8fb92 Add an api

[incubator-druid] branch 0.14.0-incubating updated: Missing Overlord and MiddleManager api docs (#7042) (#7106)

2019-02-19 Thread fjy
This is an automated email from the ASF dual-hosted git repository. fjy pushed a commit to branch 0.14.0-incubating in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/0.14.0-incubating by this push: new 2f4acf5 Missing Ove

[GitHub] samarthjain commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
samarthjain commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258334781 ## File path: server/src/main/java/org/apache/druid/segment/loading/SegmentLoader

[GitHub] PandamanEX closed issue #7107: Failed to query data from REST sql

2019-02-19 Thread GitBox
PandamanEX closed issue #7107: Failed to query data from REST sql URL: https://github.com/apache/incubator-druid/issues/7107 This is an automated message from the Apache Git Service. To respond to the message, please log on G

[GitHub] PandamanEX opened a new issue #7107: Failed to query data from REST sql

2019-02-19 Thread GitBox
PandamanEX opened a new issue #7107: Failed to query data from REST sql URL: https://github.com/apache/incubator-druid/issues/7107 This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] QiuMM edited a comment on issue #6847: Coordinator await initialization before finishing startup

2019-02-19 Thread GitBox
QiuMM edited a comment on issue #6847: Coordinator await initialization before finishing startup URL: https://github.com/apache/incubator-druid/pull/6847#issuecomment-465405921 @jihoonson no, it's hard to do. I had tested these changes in my toy cluster, they works fine. -

[GitHub] clintropolis commented on a change in pull request #7100: Add commit ID milestone helper script

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #7100: Add commit ID milestone helper script URL: https://github.com/apache/incubator-druid/pull/7100#discussion_r258321494 ## File path: docs/_bin/get-milestone-prs.py ## @@ -0,0 +1,81 @@ +#!/usr/bin/env python3 + +# Lice

[GitHub] QiuMM commented on issue #6847: Coordinator await initialization before finishing startup

2019-02-19 Thread GitBox
QiuMM commented on issue #6847: Coordinator await initialization before finishing startup URL: https://github.com/apache/incubator-druid/pull/6847#issuecomment-465405921 @jihoonson no, it's hard to do. I have tested these changes in my toy cluster, they works fine. ---

[GitHub] clintropolis opened a new pull request #7106: [Backport] Missing Overlord and MiddleManager api docs

2019-02-19 Thread GitBox
clintropolis opened a new pull request #7106: [Backport] Missing Overlord and MiddleManager api docs URL: https://github.com/apache/incubator-druid/pull/7106 Backport of #7042 to 0.14.0-incubating. This is an automated messag

[GitHub] jon-wei opened a new pull request #7105: Add bug report GitHub template

2019-02-19 Thread GitBox
jon-wei opened a new pull request #7105: Add bug report GitHub template URL: https://github.com/apache/incubator-druid/pull/7105 This PR suggests a format for a bug report issue template, inspired somewhat by the Kafka issue structure: https://cwiki.apache.org/confluence/display/KAFKA/Repo

[GitHub] justinborromeo commented on issue #7036: [Proposal] K-Way Merge for Time-Ordered Scans

2019-02-19 Thread GitBox
justinborromeo commented on issue #7036: [Proposal] K-Way Merge for Time-Ordered Scans URL: https://github.com/apache/incubator-druid/issues/7036#issuecomment-465395152 @jihoonson Is it cool to proceed or are there still uncertainties/concerns that still need to be addressed? -

[GitHub] justinborromeo commented on a change in pull request #7024: Time Ordering Option on Small-Result-Set Scan Queries

2019-02-19 Thread GitBox
justinborromeo commented on a change in pull request #7024: Time Ordering Option on Small-Result-Set Scan Queries URL: https://github.com/apache/incubator-druid/pull/7024#discussion_r258310723 ## File path: processing/src/main/java/org/apache/druid/query/scan/ScanQueryQueryToolChes

[GitHub] gianm commented on issue #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on issue #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#issuecomment-465393266 @samarthjain - it's also good to know you tested it in prod 😃 --

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258299812 ## File path: server/src/main/java/org/apache/druid/server/coordinator/DruidCoordinator

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258299228 ## File path: server/src/main/java/org/apache/druid/server/coordinator/CuratorLoadQueue

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258305227 ## File path: server/src/main/java/org/apache/druid/server/coordinator/CuratorLoadQueue

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258304556 ## File path: server/src/main/java/org/apache/druid/server/coordination/ZkCoordinator.j

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258305191 ## File path: server/src/main/java/org/apache/druid/server/coordinator/CuratorLoadQueue

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258300040 ## File path: server/src/main/java/org/apache/druid/server/coordinator/LoadQueueTaskMas

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258298919 ## File path: server/src/main/java/org/apache/druid/server/coordination/ZkCoordinator.j

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258298649 ## File path: server/src/main/java/org/apache/druid/segment/loading/SegmentLoaderConfig

[GitHub] gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
gianm commented on a change in pull request #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#discussion_r258306927 ## File path: server/src/main/java/org/apache/druid/server/coordinator/CuratorLoadQueue

[GitHub] jihoonson opened a new pull request #7104: Fix and improve doc for partitioning of local index

2019-02-19 Thread GitBox
jihoonson opened a new pull request #7104: Fix and improve doc for partitioning of local index URL: https://github.com/apache/incubator-druid/pull/7104 Backport of #7064 to 0.14.0-incubating. This is an automated message from

[GitHub] jihoonson opened a new pull request #7103: [Backport] Add doc for Hadoop-based ingestion vs Native batch ingestion

2019-02-19 Thread GitBox
jihoonson opened a new pull request #7103: [Backport] Add doc for Hadoop-based ingestion vs Native batch ingestion URL: https://github.com/apache/incubator-druid/pull/7103 Backport of #7044 to 0.14.0-incubating. This is an au

[GitHub] jihoonson opened a new pull request #7102: [Backport] Add an api to get all lookup specs

2019-02-19 Thread GitBox
jihoonson opened a new pull request #7102: [Backport] Add an api to get all lookup specs URL: https://github.com/apache/incubator-druid/pull/7102 Backport of #7025 to 0.14.0-incubating. This is an automated message from the A

[GitHub] jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258306664 ## File path: extensions-core/druid-bloom-filter/src/test/java/org/apache/druid/query/filter/sql/BloomDimFilterSq

[GitHub] jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258286537 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuerySignature.java ## @@ -0,0 +1

[GitHub] jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258285536 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuerySignature.java ## @@ -0,0 +1

[GitHub] jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258286169 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuerySignature.java ## @@ -0,0 +1

[GitHub] jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns

2019-02-19 Thread GitBox
jihoonson commented on a change in pull request #6902: sql, filters, and virtual columns URL: https://github.com/apache/incubator-druid/pull/6902#discussion_r258306258 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -284,10 +310,11 @

[GitHub] surekhasaharan opened a new pull request #7101: [Backport] add note on consistency of results for sys.segments queries (#7034)

2019-02-19 Thread GitBox
surekhasaharan opened a new pull request #7101: [Backport] add note on consistency of results for sys.segments queries (#7034) URL: https://github.com/apache/incubator-druid/pull/7101 Backport of #7034 to 0.14.0-incubating T

[GitHub] mirkojotic commented on issue #6937: Select query failing if miliseconds used as time for indexing

2019-02-19 Thread GitBox
mirkojotic commented on issue #6937: Select query failing if miliseconds used as time for indexing URL: https://github.com/apache/incubator-druid/pull/6937#issuecomment-465389221 @gianm Yes. Will be working on it tomorrow. Th

[GitHub] clintropolis commented on a change in pull request #6911: Remove DataSegmentFinder, InsertSegmentToDb, and descriptor.json file in deep storage

2019-02-19 Thread GitBox
clintropolis commented on a change in pull request #6911: Remove DataSegmentFinder, InsertSegmentToDb, and descriptor.json file in deep storage URL: https://github.com/apache/incubator-druid/pull/6911#discussion_r258291052 ## File path: docs/content/dependencies/metadata-storage.md

[GitHub] jon-wei opened a new pull request #7100: Add commit ID milestone helper script

2019-02-19 Thread GitBox
jon-wei opened a new pull request #7100: Add commit ID milestone helper script URL: https://github.com/apache/incubator-druid/pull/7100 Adds a helper script for finding commit IDs in a release branch associated with PRs that have not been tagged with a milestone ---

[GitHub] jihoonson commented on issue #6883: Deprecate NoneShardSpec

2019-02-19 Thread GitBox
jihoonson commented on issue #6883: Deprecate NoneShardSpec URL: https://github.com/apache/incubator-druid/pull/6883#issuecomment-465358617 I've removed mergeTask because it wouldn't work anymore. The coordinator throws an exception if `druid.coordinator.merge.on` is true now.

[GitHub] gianm merged pull request #7031: Autoclose old PRs using stale bot.

2019-02-19 Thread GitBox
gianm merged pull request #7031: Autoclose old PRs using stale bot. URL: https://github.com/apache/incubator-druid/pull/7031 This is an automated message from the Apache Git Service. To respond to the message, please log on G

[GitHub] gianm commented on issue #7031: Autoclose old PRs using stale bot.

2019-02-19 Thread GitBox
gianm commented on issue #7031: Autoclose old PRs using stale bot. URL: https://github.com/apache/incubator-druid/pull/7031#issuecomment-465336642 It looks like people that responded on the dev list were generally in favor of this - so I will merge it. @Dylan1312 could you please pick up on

[incubator-druid] branch master updated: Autoclose old PRs using stale bot. (#7031)

2019-02-19 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new 554b014 Autoclose old PRs using stale bo

[GitHub] gianm commented on issue #6937: Select query failing if miliseconds used as time for indexing

2019-02-19 Thread GitBox
gianm commented on issue #6937: Select query failing if miliseconds used as time for indexing URL: https://github.com/apache/incubator-druid/pull/6937#issuecomment-465330147 @mirkojotic - are you able to adjust the test? If so we can get this into Druid 0.14.0. ---

[GitHub] pdeva opened a new issue #7099: broker metadata refresh failing

2019-02-19 Thread GitBox
pdeva opened a new issue #7099: broker metadata refresh failing URL: https://github.com/apache/incubator-druid/issues/7099 druid 0.13.0 seeing a ton of these exception in broker logs: ``` 2019-02-19 20:53:16,964 WARN o.a.d.s.c.s.DruidSchema [DruidSchema-Cache-0] Metadata re

[GitHub] pdeva opened a new issue #7098: KIS task keeps failing

2019-02-19 Thread GitBox
pdeva opened a new issue #7098: KIS task keeps failing URL: https://github.com/apache/incubator-druid/issues/7098 i see this in the task status: ``` {"task":"index_kafka_pctile-minute_7b5f9c031810364_hbnefjko","status":{"id":"index_kafka_pctile-minute_7b5f9c031810364_hbnefjko","ty

[GitHub] jihoonson commented on issue #7097: Add support for querying by long timestamp for sql

2019-02-19 Thread GitBox
jihoonson commented on issue #7097: Add support for querying by long timestamp for sql URL: https://github.com/apache/incubator-druid/issues/7097#issuecomment-465322625 Hi @bputt, I think the current way is the SQL standard. You can [cast](http://druid.io/docs/latest/querying/sql#other-fu

[GitHub] bputt opened a new issue #7097: Add support for querying by long timestamp for sql

2019-02-19 Thread GitBox
bputt opened a new issue #7097: Add support for querying by long timestamp for sql URL: https://github.com/apache/incubator-druid/issues/7097 When querying via SQL, our timestamps are stored as longs, but when we add ```WHERE timestampfield = LONG``` the query fails, but as soon as we modi

[GitHub] bputt opened a new issue #7096: Add mongo as metadata storage option

2019-02-19 Thread GitBox
bputt opened a new issue #7096: Add mongo as metadata storage option URL: https://github.com/apache/incubator-druid/issues/7096 While mysql/postgresql are great options to start with, it'd be nice to use mongo as an alternative option. We already have a mongo cluster and it's alread

[GitHub] bputt commented on issue #7090: [PROPOSAL] Adding offset to sql

2019-02-19 Thread GitBox
bputt commented on issue #7090: [PROPOSAL] Adding offset to sql URL: https://github.com/apache/incubator-druid/issues/7090#issuecomment-465317174 I guess this is a new issue, #7095 This is an automated message from the Apache

[GitHub] bputt commented on issue #7091: [PROPOSAL] Sorting by non timestamp fields for non-aggregation queries

2019-02-19 Thread GitBox
bputt commented on issue #7091: [PROPOSAL] Sorting by non timestamp fields for non-aggregation queries URL: https://github.com/apache/incubator-druid/issues/7091#issuecomment-465316921 I guess that means a regular issue, so #7094 ---

[GitHub] bputt opened a new issue #7095: Adding offset to sql

2019-02-19 Thread GitBox
bputt opened a new issue #7095: Adding offset to sql URL: https://github.com/apache/incubator-druid/issues/7095 We're looking to utilize druid to provide raw records and aggregations. While the aggregation portion is working well, we need the offset to be available within SQL in order to c

[GitHub] bputt closed issue #7090: [PROPOSAL] Adding offset to sql

2019-02-19 Thread GitBox
bputt closed issue #7090: [PROPOSAL] Adding offset to sql URL: https://github.com/apache/incubator-druid/issues/7090 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub an

[GitHub] bputt closed issue #7091: [PROPOSAL] Sorting by non timestamp fields for non-aggregation queries

2019-02-19 Thread GitBox
bputt closed issue #7091: [PROPOSAL] Sorting by non timestamp fields for non-aggregation queries URL: https://github.com/apache/incubator-druid/issues/7091 This is an automated message from the Apache Git Service. To respond

[GitHub] bputt opened a new issue #7094: Sorting by non timestamp fields for non-aggregation queries

2019-02-19 Thread GitBox
bputt opened a new issue #7094: Sorting by non timestamp fields for non-aggregation queries URL: https://github.com/apache/incubator-druid/issues/7094 We're looking to utilize druid to provide raw records and aggregations. While the aggregation portion is working well, we need the offset t

[GitHub] mohammadjkhan closed pull request #7049: pr for testing integration-test run success/failure

2019-02-19 Thread GitBox
mohammadjkhan closed pull request #7049: pr for testing integration-test run success/failure URL: https://github.com/apache/incubator-druid/pull/7049 This is an automated message from the Apache Git Service. To respond to th

[GitHub] gianm commented on issue #7085: Not enough direct memory

2019-02-19 Thread GitBox
gianm commented on issue #7085: Not enough direct memory URL: https://github.com/apache/incubator-druid/issues/7085#issuecomment-465313813 You probably need to edit the task startup options too: `druid.indexer.runner.javaOpts` in middleManager/runtime.properties. -

[incubator-druid] branch master updated: bugfix: when building materialized-view, if taskCount>1, may cause concurrentModificationException (#6690)

2019-02-19 Thread jihoonson
This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new 7d1e8f3 bugfix: when building mater

[GitHub] gianm commented on issue #7090: [PROPOSAL] Adding offset to sql

2019-02-19 Thread GitBox
gianm commented on issue #7090: [PROPOSAL] Adding offset to sql URL: https://github.com/apache/incubator-druid/issues/7090#issuecomment-465311085 Hi @bputt, to be a complete proposal this should include details of how you propose implementing the feature. Otherwise this should be a feature

[GitHub] jihoonson merged pull request #6690: bugfix: when building materialized-view, if taskCount>1, may cause concurrentModificationException

2019-02-19 Thread GitBox
jihoonson merged pull request #6690: bugfix: when building materialized-view, if taskCount>1, may cause concurrentModificationException URL: https://github.com/apache/incubator-druid/pull/6690 This is an automated message fr

[GitHub] jihoonson commented on issue #7087: Online aggregation / Interactive Query Session Protocol

2019-02-19 Thread GitBox
jihoonson commented on issue #7087: Online aggregation / Interactive Query Session Protocol URL: https://github.com/apache/incubator-druid/issues/7087#issuecomment-465310832 @gianm thanks. Good to know Splunk has a similar one. -

[GitHub] gianm commented on issue #7091: [PROPOSAL] Sorting by non timestamp fields for non-aggregation queries

2019-02-19 Thread GitBox
gianm commented on issue #7091: [PROPOSAL] Sorting by non timestamp fields for non-aggregation queries URL: https://github.com/apache/incubator-druid/issues/7091#issuecomment-465310891 Hi @bputt, to be a complete proposal this should include details of how you propose implementing the fea

[GitHub] gianm commented on issue #7087: Online aggregation / Interactive Query Session Protocol

2019-02-19 Thread GitBox
gianm commented on issue #7087: Online aggregation / Interactive Query Session Protocol URL: https://github.com/apache/incubator-druid/issues/7087#issuecomment-465310018 In the context of how Druid is usually used, I could see this functionality being useful for topNs that are used for au

[GitHub] gianm commented on issue #7087: Online aggregation / Interactive Query Session Protocol

2019-02-19 Thread GitBox
gianm commented on issue #7087: Online aggregation / Interactive Query Session Protocol URL: https://github.com/apache/incubator-druid/issues/7087#issuecomment-465309153 > I think this is why the online aggregation hasn't been implemented in any production systems even though it's been al

[GitHub] jihoonson commented on issue #7087: Online aggregation / Interactive Query Session Protocol

2019-02-19 Thread GitBox
jihoonson commented on issue #7087: Online aggregation / Interactive Query Session Protocol URL: https://github.com/apache/incubator-druid/issues/7087#issuecomment-465304294 > But I think that usually people don't know and/or don't care about error bounds. People want to see _something_ a

[GitHub] gianm commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values

2019-02-19 Thread GitBox
gianm commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values URL: https://github.com/apache/incubator-druid/issues/3878#issuecomment-465302581 It also depends on whether those filters mat

[incubator-druid] branch master updated: Exclude github issue templates from license check (#7070)

2019-02-19 Thread jonwei
This is an automated email from the ASF dual-hosted git repository. jonwei pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new 258485a Exclude github issue templates

[GitHub] jon-wei merged pull request #7070: Exclude github issue templates from license check

2019-02-19 Thread GitBox
jon-wei merged pull request #7070: Exclude github issue templates from license check URL: https://github.com/apache/incubator-druid/pull/7070 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] jon-wei commented on issue #7070: Exclude github issue templates from license check

2019-02-19 Thread GitBox
jon-wei commented on issue #7070: Exclude github issue templates from license check URL: https://github.com/apache/incubator-druid/pull/7070#issuecomment-465300396 Merging, TeamCity check isn't meaningful here This is an auto

[GitHub] leventov commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values

2019-02-19 Thread GitBox
leventov commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values URL: https://github.com/apache/incubator-druid/issues/3878#issuecomment-465295035 @egor-ryashin experiments should be run t

[GitHub] leventov commented on issue #7087: Online aggregation / Interactive Query Session Protocol

2019-02-19 Thread GitBox
leventov commented on issue #7087: Online aggregation / Interactive Query Session Protocol URL: https://github.com/apache/incubator-druid/issues/7087#issuecomment-465292651 > Is it the problem of "heavy queries blocking light queries"? No, that's an orthogonal issue. Online aggregat

[GitHub] egor-ryashin commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values

2019-02-19 Thread GitBox
egor-ryashin commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values URL: https://github.com/apache/incubator-druid/issues/3878#issuecomment-465288084 I wonder whether `a lot of them` mean

[GitHub] justinborromeo commented on issue #7075: [PROPOSAL] 7057 Add a Configurable Event Throttling Policy to Asynchronous Emitters

2019-02-19 Thread GitBox
justinborromeo commented on issue #7075: [PROPOSAL] 7057 Add a Configurable Event Throttling Policy to Asynchronous Emitters URL: https://github.com/apache/incubator-druid/issues/7075#issuecomment-465283757 Done: https://issues.apache.org/jira/browse/KAFKA-7953 ---

[GitHub] gianm commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values

2019-02-19 Thread GitBox
gianm commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values URL: https://github.com/apache/incubator-druid/issues/3878#issuecomment-465281068 > Do queries with simple `dim = 'VALUE'` fal

[GitHub] egor-ryashin commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values

2019-02-19 Thread GitBox
egor-ryashin commented on issue #3878: Filters on high cardinality dimensions should sometimes use dim index bitset + full scan instead of unioning bitsets of dim values URL: https://github.com/apache/incubator-druid/issues/3878#issuecomment-465280189 > Sometimes Filters/DimFilters (Like,

[GitHub] leventov commented on a change in pull request #7038: Fix and document concurrency of EventReceiverFirehose and TimedShutoffFirehose; Refine concurrency specification of Firehose

2019-02-19 Thread GitBox
leventov commented on a change in pull request #7038: Fix and document concurrency of EventReceiverFirehose and TimedShutoffFirehose; Refine concurrency specification of Firehose URL: https://github.com/apache/incubator-druid/pull/7038#discussion_r258198153 ## File path: server/sr

[GitHub] gianm commented on issue #7068: Improve performance of zookeeper based mechanism for loading/unloading segments to/from a Druid cluster

2019-02-19 Thread GitBox
gianm commented on issue #7068: Improve performance of zookeeper based mechanism for loading/unloading segments to/from a Druid cluster URL: https://github.com/apache/incubator-druid/issues/7068#issuecomment-465278829 > @fjy or @gianm - would you happen to remember if this was a deliberate

[GitHub] egor-ryashin commented on a change in pull request #7038: Fix and document concurrency of EventReceiverFirehose and TimedShutoffFirehose; Refine concurrency specification of Firehose

2019-02-19 Thread GitBox
egor-ryashin commented on a change in pull request #7038: Fix and document concurrency of EventReceiverFirehose and TimedShutoffFirehose; Refine concurrency specification of Firehose URL: https://github.com/apache/incubator-druid/pull/7038#discussion_r258196266 ## File path: serve

[GitHub] samarthjain commented on issue #7088: Improve parallelism of zookeeper based segment change processing

2019-02-19 Thread GitBox
samarthjain commented on issue #7088: Improve parallelism of zookeeper based segment change processing URL: https://github.com/apache/incubator-druid/pull/7088#issuecomment-465276736 We have been testing this patch internally for the last week and we have seen significant performance impro

[GitHub] leventov commented on a change in pull request #7038: Fix and document concurrency of EventReceiverFirehose and TimedShutoffFirehose; Refine concurrency specification of Firehose

2019-02-19 Thread GitBox
leventov commented on a change in pull request #7038: Fix and document concurrency of EventReceiverFirehose and TimedShutoffFirehose; Refine concurrency specification of Firehose URL: https://github.com/apache/incubator-druid/pull/7038#discussion_r258191637 ## File path: server/sr

[GitHub] leventov commented on issue #7075: [PROPOSAL] 7057 Add a Configurable Event Throttling Policy to Asynchronous Emitters

2019-02-19 Thread GitBox
leventov commented on issue #7075: [PROPOSAL] 7057 Add a Configurable Event Throttling Policy to Asynchronous Emitters URL: https://github.com/apache/incubator-druid/issues/7075#issuecomment-465272584 Could you please open an issue in the Kafka library? ---

[GitHub] gianm commented on issue #6794: Query vectorization.

2019-02-19 Thread GitBox
gianm commented on issue #6794: Query vectorization. URL: https://github.com/apache/incubator-druid/pull/6794#issuecomment-465268300 I have moved the proposal to #7093, used the new proposal template, and added a lot of info, including tables detailing changes to interfaces and calling out

[GitHub] gianm opened a new issue #7093: [PROPOSAL] Query vectorization

2019-02-19 Thread GitBox
gianm opened a new issue #7093: [PROPOSAL] Query vectorization URL: https://github.com/apache/incubator-druid/issues/7093 # Motivation Vectorized execution (operating on batches of rows at a time, instead of individual rows) is widely recognized as being crucial to maximizing perfor

[incubator-druid] branch master updated: add note on consistency of results for sys.segments queries (#7034)

2019-02-19 Thread jihoonson
This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new 2b04e6d add note on consistency of

[GitHub] jihoonson merged pull request #7034: add note on consistency of results for sys.segments queries

2019-02-19 Thread GitBox
jihoonson merged pull request #7034: add note on consistency of results for sys.segments queries URL: https://github.com/apache/incubator-druid/pull/7034 This is an automated message from the Apache Git Service. To respond t

[incubator-druid] branch master updated: Missing Overlord and MiddleManager api docs (#7042)

2019-02-19 Thread jihoonson
This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-druid.git The following commit(s) were added to refs/heads/master by this push: new cadb6c5 Missing Overlord and Middle

  1   2   >