Build failure on 0.13.SNAPSHOT

2018-07-18 Thread Dongjin Lee
Hello. I am trying to build druid, but it fails. My environment is like the following: - CPU: Intel(R) Core(TM) i7-7560U CPU @ 2.40GHz - RAM: 7704 MB - OS: ubuntu 18.04 - JDK: openjdk version "1.8.0_171" (default configuration, with MaxHeapSize = 1928 MB) - Branch: master (commit: cd8ea3d) The

Subscription Request

2018-07-18 Thread Dongjin Lee
-- *Dongjin Lee* *A hitchhiker in the mathematical world.* *github: github.com/dongjinleekr linkedin: kr.linkedin.com/in/dongjinleekr slideshare: www.slideshare.net/dongjinleekr

[GitHub] drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed

2018-07-18 Thread GitBox
drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed URL: https://github.com/apache/incubator-druid/pull/6014#issuecomment-40659 I refactored things a bit and am going to try out a slightly modified direct druid client which

[GitHub] leventov commented on issue #3236: gitter community channel?

2018-07-18 Thread GitBox
leventov commented on issue #3236: gitter community channel? URL: https://github.com/apache/incubator-druid/issues/3236#issuecomment-406110033 @gianm I'm against a Gitter channel for the same reasons as you mentioned, plus I dislike any chats for several more reasons (chats are time

[GitHub] jihoonson opened a new issue #6020: Race in taskMaster when the overlord becomes the leader

2018-07-18 Thread GitBox
jihoonson opened a new issue #6020: Race in taskMaster when the overlord becomes the leader URL: https://github.com/apache/incubator-druid/issues/6020 `TaskMaster` has the interfaces to return the variables (`taskRunner`, `taskQueue`, etc) which are initialized only when the overlord

Re: Late June/July podling reports

2018-07-18 Thread Jonathan Wei
Thanks for the info, Julian/Taylor. > It seems more useful to write about the current state today. > Since Druid has missed those reports, it’s due to report next month. I’d recommend merging them into one, and make sure they get posted on time. Sounds good, I'll submit a combined report

[GitHub] himanshug commented on issue #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
himanshug commented on issue #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-406096803 LGTM for the overall design and high level working. This is

[GitHub] jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
jihoonson edited a comment on issue #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-405766673 @himanshug thank you for reviewing this PR! Yes, I have tested in our cluster by ingesting 100 GB of TPC-H lineitem

[GitHub] himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#discussion_r203553781 ## File path: indexing-service/src/main/java/io/druid/indexing/common/Counters.java ## @@

[GitHub] himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#discussion_r203553472 ## File path: indexing-service/src/main/java/io/druid/indexing/common/task/ParallelIndexSubTask.java

[GitHub] himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#discussion_r203553320 ## File path:

[GitHub] himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#discussion_r203553220 ## File path:

[GitHub] himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle

2018-07-18 Thread GitBox
himanshug commented on a change in pull request #5492: Native parallel batch indexing without shuffle URL: https://github.com/apache/incubator-druid/pull/5492#discussion_r203552226 ## File path:

Re: Late June/July podling reports

2018-07-18 Thread P. Taylor Goetz
No need to panic, this not the end of the world. I’ll have to check, but reminders may not have gone out this month. If that’s the case, I’ll mention it it my sign off for the next report so the IPMC is aware of what happened. -Taylor > On Jul 18, 2018, at 5:45 PM, Gian Merlino wrote: > >

Re: Late June/July podling reports

2018-07-18 Thread P. Taylor Goetz
Thanks for putting together and sharing the reports on dev@ Jonathan. Since Druid has missed those reports, it’s due to report next month. I’d recommend merging them into one, and make sure they get posted on time. As a mentor I would recommend making every effort possible to report on time.

[GitHub] jihoonson opened a new issue #6019: Race in TaskQueue when updating status of complete tasks

2018-07-18 Thread GitBox
jihoonson opened a new issue #6019: Race in TaskQueue when updating status of complete tasks URL: https://github.com/apache/incubator-druid/issues/6019 In

[GitHub] jihoonson commented on issue #6019: Race in TaskQueue when updating status of complete tasks

2018-07-18 Thread GitBox
jihoonson commented on issue #6019: Race in TaskQueue when updating status of complete tasks URL: https://github.com/apache/incubator-druid/issues/6019#issuecomment-406085513 Related to https://github.com/apache/incubator-druid/issues/5523.

Re: Late June/July podling reports

2018-07-18 Thread Gian Merlino
OMG! I don't see a report reminder for July. Is that not something that is happening anymore? I was relying on getting one of those… IMO, there is no reason to write the older June report. We missed it, and that is sad, but it is probably not super interesting to look back and see what was

[GitHub] gianm commented on issue #5998: Add support to filter on datasource for active tasks

2018-07-18 Thread GitBox
gianm commented on issue #5998: Add support to filter on datasource for active tasks URL: https://github.com/apache/incubator-druid/pull/5998#issuecomment-406072235 LGTM after Travis. thanks @surekhasaharan! This is an

[GitHub] surekhasaharan commented on a change in pull request #5998: Add support to filter on datasource for active tasks

2018-07-18 Thread GitBox
surekhasaharan commented on a change in pull request #5998: Add support to filter on datasource for active tasks URL: https://github.com/apache/incubator-druid/pull/5998#discussion_r203514243 ## File path:

[GitHub] surekhasaharan commented on a change in pull request #5998: Add support to filter on datasource for active tasks

2018-07-18 Thread GitBox
surekhasaharan commented on a change in pull request #5998: Add support to filter on datasource for active tasks URL: https://github.com/apache/incubator-druid/pull/5998#discussion_r203513943 ## File path:

[GitHub] gianm closed pull request #5993: SQL: Add server-wide default time zone config.

2018-07-18 Thread GitBox
gianm closed pull request #5993: SQL: Add server-wide default time zone config. URL: https://github.com/apache/incubator-druid/pull/5993 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[GitHub] jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling

2018-07-18 Thread GitBox
jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling URL: https://github.com/apache/incubator-druid/pull/5958#discussion_r203510498 ## File path:

[GitHub] jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling

2018-07-18 Thread GitBox
jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling URL: https://github.com/apache/incubator-druid/pull/5958#discussion_r203510258 ## File path:

[GitHub] drcrallen edited a comment on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed

2018-07-18 Thread GitBox
drcrallen edited a comment on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed URL: https://github.com/apache/incubator-druid/pull/6014#issuecomment-406045358 I'm a bit baffled what is blocking here. There are a few competing threads for locks:

[GitHub] matanster commented on issue #3236: gitter community channel?

2018-07-18 Thread GitBox
matanster commented on issue #3236: gitter community channel? URL: https://github.com/apache/incubator-druid/issues/3236#issuecomment-406041657 Dangers? your comment left me curious This is an automated message from the

[GitHub] jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling

2018-07-18 Thread GitBox
jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling URL: https://github.com/apache/incubator-druid/pull/5958#discussion_r203492914 ## File path: common/src/main/java/io/druid/math/expr/ExprEval.java ## @@ -245,36

[GitHub] jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling

2018-07-18 Thread GitBox
jihoonson commented on a change in pull request #5958: Part 2 of changes for SQL Compatible Null Handling URL: https://github.com/apache/incubator-druid/pull/5958#discussion_r203490303 ## File path: common/src/main/java/io/druid/math/expr/Expr.java ## @@ -365,15 +371,21

[GitHub] gianm commented on issue #5993: SQL: Add server-wide default time zone config.

2018-07-18 Thread GitBox
gianm commented on issue #5993: SQL: Add server-wide default time zone config. URL: https://github.com/apache/incubator-druid/pull/5993#issuecomment-406035985 @asdf2014 @jihoonson @nishantmonu51 Thanks for your comments -- I fixed the call to DateTimeZone.forID and added the new config

[GitHub] gianm commented on a change in pull request #5993: SQL: Add server-wide default time zone config.

2018-07-18 Thread GitBox
gianm commented on a change in pull request #5993: SQL: Add server-wide default time zone config. URL: https://github.com/apache/incubator-druid/pull/5993#discussion_r203489841 ## File path: sql/src/test/java/io/druid/sql/calcite/CalciteQueryTest.java ## @@ -169,6 +169,14

[GitHub] drcrallen commented on issue #6018: RegisteredLookup java api

2018-07-18 Thread GitBox
drcrallen commented on issue #6018: RegisteredLookup java api URL: https://github.com/apache/incubator-druid/issues/6018#issuecomment-406028004 it should be in the druid server jar. Can you explain your use case some more?

[GitHub] drcrallen commented on issue #3236: gitter community channel?

2018-07-18 Thread GitBox
drcrallen commented on issue #3236: gitter community channel? URL: https://github.com/apache/incubator-druid/issues/3236#issuecomment-406027596 There are inherent dangers to communications regarding the project that are not part of official ASF channels (i.e. the mailing list). How do

[GitHub] drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed

2018-07-18 Thread GitBox
drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed URL: https://github.com/apache/incubator-druid/pull/6014#issuecomment-406020572 I'm looking to see if there's a fix

[GitHub] drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed

2018-07-18 Thread GitBox
drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed URL: https://github.com/apache/incubator-druid/pull/6014#issuecomment-406020525 This seems to cause deadlocks. Right now it looks like the "parallel merging" doesn't let the

Re: Multi-threaded Druid Tests/Benchmarks

2018-07-18 Thread Charles Allen
io.druid.benchmark.query.TopNBenchmark is the one that tore up heap when i was trying to test alternate strategies for https://github.com/apache/incubator-druid/pull/5913 and https://github.com/apache/incubator-druid/pull/6014 locally. You can control the number of segments created. On Wed, Jul

[GitHub] leventov commented on issue #3236: gitter community channel?

2018-07-18 Thread GitBox
leventov commented on issue #3236: gitter community channel? URL: https://github.com/apache/incubator-druid/issues/3236#issuecomment-406001070 I'm against creating a Gitter channel (or Slack, or IRC, FWIW). This is an

[GitHub] drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed

2018-07-18 Thread GitBox
drcrallen commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed URL: https://github.com/apache/incubator-druid/pull/6014#issuecomment-40550 @gianm yes, the main risk is blocking the http threads of historicals. Since results are merged

[GitHub] joshlemer commented on issue #3236: gitter community channel?

2018-07-18 Thread GitBox
joshlemer commented on issue #3236: gitter community channel? URL: https://github.com/apache/incubator-druid/issues/3236#issuecomment-405998680 @gianm nobody else can make the gitter channel except people who own this repository, can you just make one it takes 30 seconds

[GitHub] asdf2014 edited a comment on issue #5980: Various changes about a few coding specifications

2018-07-18 Thread GitBox
asdf2014 edited a comment on issue #5980: Various changes about a few coding specifications URL: https://github.com/apache/incubator-druid/pull/5980#issuecomment-405439513 @leventov PTAL. 1. Set the level of `ArraysAsListWithZeroOrOneArgument` inspection as `warning`, because use

[GitHub] asdf2014 commented on issue #5980: Various changes about a few coding specifications

2018-07-18 Thread GitBox
asdf2014 commented on issue #5980: Various changes about a few coding specifications URL: https://github.com/apache/incubator-druid/pull/5980#issuecomment-405974955 Hi, @leventov . It has been fixed. BTW, [jobs-405249198](https://travis-ci.org/apache/incubator-druid/jobs/405249198)

[GitHub] gianm commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed

2018-07-18 Thread GitBox
gianm commented on issue #6014: Optionally refuse to consume new data until the prior chunk is being consumed URL: https://github.com/apache/incubator-druid/pull/6014#issuecomment-405970508 Is this meant to be addressing https://github.com/apache/incubator-druid/issues/4933? What effect

Implementing "no-RollUp" (aka PlainFactsHolder) in Oak Incremental Index

2018-07-18 Thread Anastasia Braginsky
Hi Again, Just to summarize once again the way we are implementing the "no-RollUp" (aka PlainFactsHolder) in Oak Incremental Index. If someone is familiar with this part of incremental index, please see if we are wrong in some assumptions. As a reminder, in Oak Incremental Index we are not

[GitHub] nicolasblaye opened a new issue #6018: RegisteredLookup java api

2018-07-18 Thread GitBox
nicolasblaye opened a new issue #6018: RegisteredLookup java api URL: https://github.com/apache/incubator-druid/issues/6018 Hi everyone, We use registered lookup tables. I did a query using the json api and I could use it, but I can't find the correct ExtractionFn for the java api.

[GitHub] erankor opened a new issue #6017: Logging of invalid queries

2018-07-18 Thread GitBox
erankor opened a new issue #6017: Logging of invalid queries URL: https://github.com/apache/incubator-druid/issues/6017 Hi all, When Druid gets an invalid query, is there a way to see the query that was submitted? I don't see the query body in the broker log - I only see the

[GitHub] salman028 closed issue #6008: groupBy Query took too much time

2018-07-18 Thread GitBox
salman028 closed issue #6008: groupBy Query took too much time URL: https://github.com/apache/incubator-druid/issues/6008 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] hellobabygogo commented on issue #5871: fix push supervisor error

2018-07-18 Thread GitBox
hellobabygogo commented on issue #5871: fix push supervisor error URL: https://github.com/apache/incubator-druid/pull/5871#issuecomment-405858208 @jihoonson yes, it can avoid push continuously and cause the tasks failed.

Re: Multi-threaded Druid Tests/Benchmarks

2018-07-18 Thread Anastasia Braginsky
So this is probably where we can help with the Oak-based incremental index.Can you please give me any reference to those tests? Any descriptions? Thanks! On Tuesday, July 17, 2018, 8:59:57 PM GMT+3, Charles Allen wrote: Unfortunately I think multi-threaded test coverage is kind of