[GitHub] [druid] clintropolis opened a new pull request #9836: low hanging fruit - presize hash map for DruidSegmentReader

2020-05-06 Thread GitBox
clintropolis opened a new pull request #9836: URL: https://github.com/apache/druid/pull/9836 I don't have an after flame graph, but here is the before: https://user-images.githubusercontent.com/1577461/81259389-b3cf9100-8fec-11ea-8e8c-75a64078035c.png;> where we are spending

[GitHub] [druid] averma111 commented on issue #9822: Docker Hub Builds are outdated

2020-05-06 Thread GitBox
averma111 commented on issue #9822: URL: https://github.com/apache/druid/issues/9822#issuecomment-625030072 You need to add appropriate tags to get the latest image. This is an automated message from the Apache Git Service.

[GitHub] [druid] averma111 commented on issue #9829: Druid start-micro-quickstart, Unrecognized VM option 'ExitOnOutOfMemoryError'

2020-05-06 Thread GitBox
averma111 commented on issue #9829: URL: https://github.com/apache/druid/issues/9829#issuecomment-625029430 You need to reduces the heap size of each druid nodes according to the memory available in your system. Check with free -g and find out the RAM available

[GitHub] [druid] averma111 opened a new issue #9835: Spark built in connector for Druid

2020-05-06 Thread GitBox
averma111 opened a new issue #9835: URL: https://github.com/apache/druid/issues/9835 ### Motivation In my current project there is a requirement to load HDFS data combined with Db2 data which is huge in number. The data volume is almost 1 TB per day. We need to join these two huge data

[GitHub] [druid] Wang949764788 opened a new issue #9834: Kafka ingetion datasource without data can't get schema

2020-05-06 Thread GitBox
Wang949764788 opened a new issue #9834: URL: https://github.com/apache/druid/issues/9834 Version: 0.16.0 Description: when I cleaned data or new a Kafka ingetion ,datasource not exist, we can't get the datasource schema ,Is there any solution?

[GitHub] [druid] gaohaoning commented on issue #5808: my druid has been wrong [Coordinator-Exec--0] WARN io.druid.server.coordinator.rules.LoadRule - No available [_default_tier] servers or node capa

2020-05-06 Thread GitBox
gaohaoning commented on issue #5808: URL: https://github.com/apache/druid/issues/5808#issuecomment-624991833 出现同类问题,我的集群结构是: 【data机器】2台, middleManager historical 【query机器】1台, router broker 【master机器】1台, coordinator 采用默认的

[GitHub] [druid] TerryTab commented on issue #5582: Druid Helm Chart

2020-05-06 Thread GitBox
TerryTab commented on issue #5582: URL: https://github.com/apache/druid/issues/5582#issuecomment-624989322 incubator druid helm charts have no router configurations, how do I add router to the druid cluster? This is an

[GitHub] [druid] a2l007 commented on pull request #9449: Add Sql InputSource

2020-05-06 Thread GitBox
a2l007 commented on pull request #9449: URL: https://github.com/apache/druid/pull/9449#issuecomment-624982976 @suneet-s Yeah good idea! I'm planning to add InputSource based equivalent for `CombiningFirehose` first as well as fix this bug: #9389 I'd take a stab at adding integration

[GitHub] [druid] gianm commented on a change in pull request #9773: Bad plan for table-lookup-lookup join with filter on first lookup and outer limit

2020-05-06 Thread GitBox
gianm commented on a change in pull request #9773: URL: https://github.com/apache/druid/pull/9773#discussion_r421173321 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidJoinQueryRel.java ## @@ -293,23 +293,17 @@ protected RelDataType deriveRowType()

[GitHub] [druid] gianm commented on a change in pull request #9773: Bad plan for table-lookup-lookup join with filter on first lookup and outer limit

2020-05-06 Thread GitBox
gianm commented on a change in pull request #9773: URL: https://github.com/apache/druid/pull/9773#discussion_r421173321 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidJoinQueryRel.java ## @@ -293,23 +293,17 @@ protected RelDataType deriveRowType()

[GitHub] [druid] suneet-s commented on pull request #9449: Add Sql InputSource

2020-05-06 Thread GitBox
suneet-s commented on pull request #9449: URL: https://github.com/apache/druid/pull/9449#issuecomment-624950140 @a2l007 have you thought about how to add integration tests for something like this? Can we add innodb or something in a docker container and run it as part of the integration

[druid] branch master updated: Add equivalent test coverage for all RHS join impls (#9831)

2020-05-06 Thread ccaominh
This is an automated email from the ASF dual-hosted git repository. ccaominh pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new accd710 Add equivalent test coverage for all

[druid] branch master updated: Avoid sorting values in InDimFilter if possible (#9800)

2020-05-06 Thread jihoonson
This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new 6674d72 Avoid sorting values in InDimFilter

[GitHub] [druid] averma111 opened a new issue #9833: Spark to ingest data into Drui

2020-05-06 Thread GitBox
averma111 opened a new issue #9833: URL: https://github.com/apache/druid/issues/9833 Hi Team, Could any redirect me to correct git hub rope where I can get a overview of data ingestion method using spark. I want to use JAVA as language to achieve the operations.

[GitHub] [druid] maytasm commented on a change in pull request #9831: Add equivalent test coverage for all RHS join impls

2020-05-06 Thread GitBox
maytasm commented on a change in pull request #9831: URL: https://github.com/apache/druid/pull/9831#discussion_r421118293 ## File path: processing/src/test/java/org/apache/druid/segment/join/table/LookupJoinMatcherTest.java ## @@ -0,0 +1,165 @@ +/* + * Licensed to the Apache

[GitHub] [druid] maytasm commented on a change in pull request #9831: Add equivalent test coverage for all RHS join impls

2020-05-06 Thread GitBox
maytasm commented on a change in pull request #9831: URL: https://github.com/apache/druid/pull/9831#discussion_r421118293 ## File path: processing/src/test/java/org/apache/druid/segment/join/table/LookupJoinMatcherTest.java ## @@ -0,0 +1,165 @@ +/* + * Licensed to the Apache

[GitHub] [druid] jihoonson commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
jihoonson commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421069133 ## File path: processing/src/main/java/org/apache/druid/query/filter/NotDimFilter.java ## @@ -60,10 +60,17 @@ public DimFilter getField() return

[GitHub] [druid] gianm commented on a change in pull request #9773: Bad plan for table-lookup-lookup join with filter on first lookup and outer limit

2020-05-06 Thread GitBox
gianm commented on a change in pull request #9773: URL: https://github.com/apache/druid/pull/9773#discussion_r421051659 ## File path: sql/src/test/java/org/apache/druid/sql/calcite/CalciteQueryTest.java ## @@ -8346,6 +8346,166 @@ public void

[GitHub] [druid] ccaominh commented on a change in pull request #9831: Add equivalent test coverage for all RHS join impls

2020-05-06 Thread GitBox
ccaominh commented on a change in pull request #9831: URL: https://github.com/apache/druid/pull/9831#discussion_r421046781 ## File path: processing/src/test/java/org/apache/druid/segment/join/table/LookupJoinMatcherTest.java ## @@ -0,0 +1,165 @@ +/* + * Licensed to the Apache

[GitHub] [druid] suneet-s commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
suneet-s commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421011961 ## File path: processing/src/main/java/org/apache/druid/query/filter/vector/FalseVectorMatcher.java ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] [druid] suneet-s commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
suneet-s commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421011554 ## File path: processing/src/main/java/org/apache/druid/query/filter/NotDimFilter.java ## @@ -60,10 +60,17 @@ public DimFilter getField() return

[GitHub] [druid] jihoonson commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
jihoonson commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421006641 ## File path: processing/src/main/java/org/apache/druid/query/filter/NotDimFilter.java ## @@ -60,10 +60,17 @@ public DimFilter getField() return

[GitHub] [druid] jihoonson commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
jihoonson commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421006133 ## File path: processing/src/main/java/org/apache/druid/query/filter/InDimFilter.java ## @@ -132,31 +145,40 @@ public FilterTuning getFilterTuning()

[GitHub] [druid] jihoonson commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
jihoonson commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421006298 ## File path: processing/src/main/java/org/apache/druid/query/filter/vector/FalseVectorMatcher.java ## @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache

[GitHub] [druid] jihoonson commented on a change in pull request #9800: Avoid sorting values in InDimFilter if possible

2020-05-06 Thread GitBox
jihoonson commented on a change in pull request #9800: URL: https://github.com/apache/druid/pull/9800#discussion_r421005456 ## File path: processing/src/main/java/org/apache/druid/query/filter/AndDimFilter.java ## @@ -72,8 +73,20 @@ public AndDimFilter(DimFilter... fields)

[GitHub] [druid-website-src] surekhasaharan opened a new pull request #131: update upcoming events

2020-05-06 Thread GitBox
surekhasaharan opened a new pull request #131: URL: https://github.com/apache/druid-website-src/pull/131 Add virtual meetup This is an automated message from the Apache Git Service. To respond to the message, please log on

[druid-website-src] 01/01: update upcoming events

2020-05-06 Thread surekha
This is an automated email from the ASF dual-hosted git repository. surekha pushed a commit to branch update_events in repository https://gitbox.apache.org/repos/asf/druid-website-src.git commit ccf8517ce3a3b8227a3149e458642c2012df691e Author: Surekha Saharan AuthorDate: Wed May 6 09:29:17 2020

[druid-website-src] branch update_events created (now ccf8517)

2020-05-06 Thread surekha
This is an automated email from the ASF dual-hosted git repository. surekha pushed a change to branch update_events in repository https://gitbox.apache.org/repos/asf/druid-website-src.git. at ccf8517 update upcoming events This branch includes the following new commits: new

[druid] branch master updated (1e857c5 -> ce03f31)

2020-05-06 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 1e857c5 Ignore druid-processing benchmarks in tests (#9821) add ce03f31 Clarifying workerThreads and a few other

[GitHub] [druid] gianm edited a comment on pull request #9830: Fail incorrectly constructed join queries

2020-05-06 Thread GitBox
gianm edited a comment on pull request #9830: URL: https://github.com/apache/druid/pull/9830#issuecomment-624730282 @suneet-s it looks like some tests are failing because Filter.equals is not always implemented. IIRC, nothing depended on that being implemented prior to this patch.

[druid] branch master updated: Ignore druid-processing benchmarks in tests (#9821)

2020-05-06 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new 1e857c5 Ignore druid-processing benchmarks in

[GitHub] [druid] suneet-s commented on pull request #9830: Fail incorrectly constructed join queries

2020-05-06 Thread GitBox
suneet-s commented on pull request #9830: URL: https://github.com/apache/druid/pull/9830#issuecomment-624734779 > @suneet-s it looks like some tests are failing because Filter.equals is not always implemented. IIRC, nothing depended on that being implemented prior to this patch. Ha

[GitHub] [druid] gianm commented on pull request #9830: Fail incorrectly constructed join queries

2020-05-06 Thread GitBox
gianm commented on pull request #9830: URL: https://github.com/apache/druid/pull/9830#issuecomment-624730282 @suneet-s it looks like some tests are failing because Filter.equals is not always implemented. IIRC, nothing depended on that being implemented prior to this patch.

[GitHub] [druid] a2l007 opened a new pull request #9832: Add option to toggle sending server version in response headers

2020-05-06 Thread GitBox
a2l007 opened a new pull request #9832: URL: https://github.com/apache/druid/pull/9832 ### Description This adds a new server configuration which can be used to toggle the jetty behavior of sending server version information as part of the response

[GitHub] [druid] gianm commented on issue #3892: Move from ByteBuffer to Memory

2020-05-06 Thread GitBox
gianm commented on issue #3892: URL: https://github.com/apache/druid/issues/3892#issuecomment-624728076 Let's keep this open, it's still interesting and relevant. Some recent work includes #9308 and #9314. IMO, as a next step, it'd be interesting to look at switching VectorAggregators and

[GitHub] [druid] stale[bot] commented on issue #3892: Move from ByteBuffer to Memory

2020-05-06 Thread GitBox
stale[bot] commented on issue #3892: URL: https://github.com/apache/druid/issues/3892#issuecomment-624728090 This issue is no longer marked as stale. This is an automated message from the Apache Git Service. To respond

[GitHub] [druid] stale[bot] commented on issue #5698: Oak: New Concurrent Key-Value Map

2020-05-06 Thread GitBox
stale[bot] commented on issue #5698: URL: https://github.com/apache/druid/issues/5698#issuecomment-624645401 This issue has been marked as stale due to 280 days of inactivity. It will be closed in 4 weeks if no further activity occurs. If this issue is still relevant, please simply write

[GitHub] [druid] 9553973 commented on issue #9524: druid-0.17-kafka-indexing-service how to ingest multiple partitions from one topic

2020-05-06 Thread GitBox
9553973 commented on issue #9524: URL: https://github.com/apache/druid/issues/9524#issuecomment-624526142 Multiple partitions can always be read. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [druid] maytasm opened a new pull request #9831: Add equivalent test coverage for all RHS join impls

2020-05-06 Thread GitBox
maytasm opened a new pull request #9831: URL: https://github.com/apache/druid/pull/9831 Add equivalent test coverage for all RHS join impls ### Description This PR adds unit tests to make sure that we have equal coverage for all RHS join impls. We currently have 2

[GitHub] [druid] suneet-s opened a new pull request #9830: Fail incorrectly constructed join queries

2020-05-06 Thread GitBox
suneet-s opened a new pull request #9830: URL: https://github.com/apache/druid/pull/9830 ### Description This change validates an assumption made HashJoinSegmentStorageAdapter. It was assumed that the filter used during join filter pre-analysis is the same as the filter passed to