[druid] branch master updated (554f1ff -> 204901a)

This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 554f1ff ARRAY_AGG sql aggregator function (#11157) add 204901a Fix Smile encoding for HTTP response

[GitHub] [druid] jihoonson merged pull request #10980: Fix Smile encoding for HTTP response

jihoonson merged pull request #10980: URL: https://github.com/apache/druid/pull/10980 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] jihoonson closed issue #10945: Scan query throws and error when using smile encoding for response

jihoonson closed issue #10945: URL: https://github.com/apache/druid/issues/10945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [druid] clintropolis edited a comment on pull request #11188: SQL timeseries no longer skip empty buckets with all granularity

clintropolis edited a comment on pull request #11188: URL: https://github.com/apache/druid/pull/11188#issuecomment-831011596 ~~If #11157 goes in before this PR, this PR should be updated to add `ARRAY_AGG` to the non-vectorized built-in aggs test case. If #11182 is merged before this PR,

[GitHub] [druid] zachjsh commented on a change in pull request #11194: Hadoop segment index file rename

zachjsh commented on a change in pull request #11194: URL: https://github.com/apache/druid/pull/11194#discussion_r625519530 ## File path: indexing-hadoop/src/main/java/org/apache/druid/indexer/FileSystemHelper.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software

[GitHub] [druid] jihoonson commented on a change in pull request #11157: ARRAY_AGG sql aggregator function

jihoonson commented on a change in pull request #11157: URL: https://github.com/apache/druid/pull/11157#discussion_r625514785 ## File path: docs/querying/sql.md ## @@ -353,6 +353,8 @@ Only the COUNT aggregation can accept DISTINCT. |`ANY_VALUE(expr)`|Returns any value of

[druid] branch master updated (6f7701e -> 554f1ff)

This is an automated email from the ASF dual-hosted git repository. cwylie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 6f7701e fixed array syntax (#11191) add 554f1ff ARRAY_AGG sql aggregator function (#11157) No new revisions

[GitHub] [druid] clintropolis merged pull request #11157: ARRAY_AGG sql aggregator function

clintropolis merged pull request #11157: URL: https://github.com/apache/druid/pull/11157 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] clintropolis commented on pull request #11157: ARRAY_AGG sql aggregator function

clintropolis commented on pull request #11157: URL: https://github.com/apache/druid/pull/11157#issuecomment-831687994 thanks for review @jihoonson -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [druid] clintropolis commented on a change in pull request #11157: ARRAY_AGG sql aggregator function

clintropolis commented on a change in pull request #11157: URL: https://github.com/apache/druid/pull/11157#discussion_r625514097 ## File path: docs/querying/sql.md ## @@ -353,6 +353,8 @@ Only the COUNT aggregation can accept DISTINCT. |`ANY_VALUE(expr)`|Returns any value of

[GitHub] [druid] jihoonson commented on a change in pull request #11157: ARRAY_AGG sql aggregator function

jihoonson commented on a change in pull request #11157: URL: https://github.com/apache/druid/pull/11157#discussion_r625507597 ## File path: docs/querying/sql.md ## @@ -353,6 +353,8 @@ Only the COUNT aggregation can accept DISTINCT. |`ANY_VALUE(expr)`|Returns any value of

[druid] branch master updated (bef7cc9 -> 6f7701e)

This is an automated email from the ASF dual-hosted git repository. cwylie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from bef7cc9 Vectorize the cardinality aggregator. (#11182) add 6f7701e fixed array syntax (#11191) No new

[GitHub] [druid] clintropolis merged pull request #11191: fixed array syntax

clintropolis merged pull request #11191: URL: https://github.com/apache/druid/pull/11191 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] clintropolis commented on pull request #11191: fixed array syntax

clintropolis commented on pull request #11191: URL: https://github.com/apache/druid/pull/11191#issuecomment-831677458 skipping integration tests for doc only change -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[druid] branch master updated (ca1412d -> bef7cc9)

This is an automated email from the ASF dual-hosted git repository. cwylie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from ca1412d Reduce visibility of Tranquility documentation (#11134) add bef7cc9 Vectorize the cardinality

[GitHub] [druid] clintropolis merged pull request #11182: Vectorize the cardinality aggregator.

clintropolis merged pull request #11182: URL: https://github.com/apache/druid/pull/11182 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] jon-wei commented on a change in pull request #11194: Hadoop segment index file rename

jon-wei commented on a change in pull request #11194: URL: https://github.com/apache/druid/pull/11194#discussion_r625482521 ## File path: indexing-hadoop/src/main/java/org/apache/druid/indexer/FileSystemHelper.java ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software

[GitHub] [druid-website-src] rachelpedreschi opened a new pull request #233: Update index.md

rachelpedreschi opened a new pull request #233: URL: https://github.com/apache/druid-website-src/pull/233 Added new committers. Updated affliations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [druid] zachjsh edited a comment on pull request #11075: Adjust HadoopIndexTask temp segment renaming to avoid potential race conditions

zachjsh edited a comment on pull request #11075: URL: https://github.com/apache/druid/pull/11075#issuecomment-831624436 > > Hm, we don't have any existing unit tests for HadoopIndexTask, so I think it'd be fine to ignore the coverage failure from that. > > Can you run ITHadoopIndexTest

[GitHub] [druid] zachjsh opened a new pull request #11194: Hadoop segment index file rename2

zachjsh opened a new pull request #11194: URL: https://github.com/apache/druid/pull/11194 ### Description Segment index file zips are now renamed from the index task, rather than in the hadoop reduce job. When index file renaming occurs in the hadoop reduce job, it was found that

[GitHub] [druid] zachjsh commented on pull request #11075: Adjust HadoopIndexTask temp segment renaming to avoid potential race conditions

zachjsh commented on pull request #11075: URL: https://github.com/apache/druid/pull/11075#issuecomment-831624436 > > Hm, we don't have any existing unit tests for HadoopIndexTask, so I think it'd be fine to ignore the coverage failure from that. > > Can you run ITHadoopIndexTest locally

[GitHub] [druid] jon-wei commented on issue #11173: Auto cleanup of metadata tables to enable high frequency creation/deletion of data sources

jon-wei commented on issue #11173: URL: https://github.com/apache/druid/issues/11173#issuecomment-831607417  , I think this proposal makes sense -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] loquisgon commented on a change in pull request #11123: Avoid memory mapping hydrants after they are persisted & after they are merged for native batch ingestion

loquisgon commented on a change in pull request #11123: URL: https://github.com/apache/druid/pull/11123#discussion_r625437291 ## File path: server/src/main/java/org/apache/druid/segment/realtime/appenderator/AppenderatorImpl.java ## @@ -161,6 +164,13 @@ private volatile

[druid] branch master updated (84aac48 -> ca1412d)

This is an automated email from the ASF dual-hosted git repository. shetland pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 84aac48 Add feature to automatically remove rules based on retention period (#11164) add ca1412d Reduce

[GitHub] [druid] sthetland merged pull request #11134: Reduce visibility of Tranquility documentation

sthetland merged pull request #11134: URL: https://github.com/apache/druid/pull/11134 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] clintropolis opened a new pull request #11193: [Web Console] allow pollPeriod to be defined in JDBC lookup config

clintropolis opened a new pull request #11193: URL: https://github.com/apache/druid/pull/11193 [JDBC lookups can have a

[GitHub] [druid-website] rachelpedreschi opened a new pull request #128: Update index.html

rachelpedreschi opened a new pull request #128: URL: https://github.com/apache/druid-website/pull/128 added new committers, updated orgs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [druid] imply-jbalik opened a new pull request #11192: fixed syntax error in prefix lines

imply-jbalik opened a new pull request #11192: URL: https://github.com/apache/druid/pull/11192 Fixed a syntax error in "prefix" lines in docs/ingestion/native-batch.md This PR has: - [ X] been self-reviewed. @techdocsmith @sthetland -- This is an automated message from the

svn commit: r47528 - /release/druid/KEYS

Author: nishant Date: Mon May 3 22:07:48 2021 New Revision: 47528 Log: add key for nish...@apache.org Modified: release/druid/KEYS Modified: release/druid/KEYS == --- release/druid/KEYS (original) +++

[GitHub] [druid] jihoonson commented on pull request #11189: Fix idempotence of segment allocation and task report apis in native batch ingestion

jihoonson commented on pull request #11189: URL: https://github.com/apache/druid/pull/11189#issuecomment-831565132 I manually tested the behavior with `druid.indexer.task.useLineageBasedSegmentAllocation` during rolling upgrade. -- This is an automated message from the Apache Git

[GitHub] [druid] imply-jbalik opened a new pull request #11191: fixed array syntax

imply-jbalik opened a new pull request #11191: URL: https://github.com/apache/druid/pull/11191 Fixes an issue with syntax for multi-value string functions. This PR has: - [X ] been self-reviewed. @techdocsmith @sthetland @weishiuntsai -- This is an automated message from

[GitHub] [druid] mSitkovets commented on pull request #11170: Fix is null selector returning incorrect value for Long data type

mSitkovets commented on pull request #11170: URL: https://github.com/apache/druid/pull/11170#issuecomment-831495874 I added new variables `cachedIsNull` and `outputForNull` so that once we have cached the output for null once then any other time we see null as input we can use our cached

[GitHub] [druid] jihoonson commented on pull request #11189: Fix idempotence of segment allocation and task report apis in native batch ingestion

jihoonson commented on pull request #11189: URL: https://github.com/apache/druid/pull/11189#issuecomment-831479796 I added `druid.indexer.task.useLineageBasedSegmentAllocation` for middleManagers instead of taskContext. -- This is an automated message from the Apache Git Service. To

[GitHub] [druid] lgtm-com[bot] commented on pull request #11170: Fix is null selector returning incorrect value for Long data type

lgtm-com[bot] commented on pull request #11170: URL: https://github.com/apache/druid/pull/11170#issuecomment-831476533 This pull request **introduces 1 alert** when merging 8275ec259af2abbb862dcf10db6ad88f2ab4819e into 809e001939be9196a4c3c620037606ab6e5af3b8 - [view on

[druid] branch master updated (809e001 -> 84aac48)

This is an automated email from the ASF dual-hosted git repository. maytasm pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 809e001 Vectorize the DataSketches quantiles aggregator. (#11183) add 84aac48 Add feature to automatically

[GitHub] [druid] maytasm merged pull request #11164: Add feature to automatically remove rules based on retention period

maytasm merged pull request #11164: URL: https://github.com/apache/druid/pull/11164 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] maytasm commented on a change in pull request #11164: Add feature to automatically remove rules based on retention period

maytasm commented on a change in pull request #11164: URL: https://github.com/apache/druid/pull/11164#discussion_r625292642 ## File path: docs/configuration/index.md ## @@ -750,6 +750,9 @@ These Coordinator static configurations can be defined in the `coordinator/runti

[GitHub] [druid] maytasm commented on pull request #11164: Add feature to automatically remove rules based on retention period

maytasm commented on pull request #11164: URL: https://github.com/apache/druid/pull/11164#issuecomment-831459836 > Overall LGTM > > Is it possible for a user to create a segment with a custom version? What would happen in these cases? Do we need guardrails to prevent users from

[GitHub] [druid] clintropolis commented on a change in pull request #11188: SQL timeseries no longer skip empty buckets with all granularity

clintropolis commented on a change in pull request #11188: URL: https://github.com/apache/druid/pull/11188#discussion_r625279152 ## File path: docs/querying/sql.md ## @@ -313,46 +313,48 @@ possible for two aggregators in the same SQL query to have different filters. Only

[GitHub] [druid] clintropolis commented on a change in pull request #11188: SQL timeseries no longer skip empty buckets with all granularity

clintropolis commented on a change in pull request #11188: URL: https://github.com/apache/druid/pull/11188#discussion_r625277167 ## File path: docs/querying/sql.md ## @@ -313,46 +313,48 @@ possible for two aggregators in the same SQL query to have different filters. Only

[druid-website-src] branch master updated (f109e42 -> 382866a)

This is an automated email from the ASF dual-hosted git repository. pjain1 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git. from f109e42 Merge pull request #227 from jelenazanko/patch-11 add 26ce6b3 Update company affiliation

[GitHub] [druid-website-src] pjain1 merged pull request #232: Update company affiliation

pjain1 merged pull request #232: URL: https://github.com/apache/druid-website-src/pull/232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[druid-website-src] 01/01: Merge pull request #232 from apache/update-company

This is an automated email from the ASF dual-hosted git repository. pjain1 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git commit 382866a11aeb061306557e4668509e8724680390 Merge: f109e42 26ce6b3 Author: Parag Jain AuthorDate: Mon May 3

[druid-website-src] branch master updated: Update druid-powered.md to add Finin

This is an automated email from the ASF dual-hosted git repository. nishant pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new f9d9e1e Update druid-powered.md to

[GitHub] [druid-website-src] nishantmonu51 merged pull request #227: Update druid-powered.md to add Finin

nishantmonu51 merged pull request #227: URL: https://github.com/apache/druid-website-src/pull/227 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[druid-website-src] branch master updated: Remove 1 event; add 3 new events

This is an automated email from the ASF dual-hosted git repository. nishant pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new 290e8e1 Remove 1 event; add 3 new

[GitHub] [druid-website-src] nishantmonu51 merged pull request #226: Remove 1 event; add 3 new events

nishantmonu51 merged pull request #226: URL: https://github.com/apache/druid-website-src/pull/226 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[druid-website-src] branch master updated: Add rovio-ingest to list of libraries

This is an automated email from the ASF dual-hosted git repository. nishant pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new 492b10c Add rovio-ingest to list

[GitHub] [druid-website-src] nishantmonu51 merged pull request #231: Add rovio-ingest to list of libraries

nishantmonu51 merged pull request #231: URL: https://github.com/apache/druid-website-src/pull/231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[GitHub] [druid-website-src] nishantmonu51 opened a new pull request #232: Update company affiliation

nishantmonu51 opened a new pull request #232: URL: https://github.com/apache/druid-website-src/pull/232 Update my company affiliation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[druid-website-src] 01/01: Update company affiliation

This is an automated email from the ASF dual-hosted git repository. nishant pushed a commit to branch update-company in repository https://gitbox.apache.org/repos/asf/druid-website-src.git commit 26ce6b321face0ad77d1c76f8851d21090f8d05d Author: Nishant AuthorDate: Mon May 3 21:47:17 2021 +0530

[druid-website-src] branch update-company created (now 26ce6b3)

This is an automated email from the ASF dual-hosted git repository. nishant pushed a change to branch update-company in repository https://gitbox.apache.org/repos/asf/druid-website-src.git. at 26ce6b3 Update company affiliation This branch includes the following new commits: new

[GitHub] [druid] kfaraz opened a new pull request #11190: Temporarily skip compaction for locked intervals

kfaraz opened a new pull request #11190: URL: https://github.com/apache/druid/pull/11190 Compaction Tasks, both auto and manual, try to acquire locks on the Datasource Intervals which they need to compact. If a higher priority ingestion task is in progress for an overlapping interval, the

[GitHub] [druid] gianm commented on pull request #11188: SQL timeseries no longer skip empty buckets with all granularity

gianm commented on pull request #11188: URL: https://github.com/apache/druid/pull/11188#issuecomment-831354373 The concept LGTM (I'm pleasantly surprised it seems so easy), my comments at this point are all about the docs. -- This is an automated message from the Apache Git Service. To

[GitHub] [druid] gianm commented on a change in pull request #11188: SQL timeseries no longer skip empty buckets with all granularity

gianm commented on a change in pull request #11188: URL: https://github.com/apache/druid/pull/11188#discussion_r625183001 ## File path: docs/querying/sql.md ## @@ -313,46 +313,48 @@ possible for two aggregators in the same SQL query to have different filters. Only the

[GitHub] [druid] gianm commented on a change in pull request #11188: SQL timeseries no longer skip empty buckets with all granularity

gianm commented on a change in pull request #11188: URL: https://github.com/apache/druid/pull/11188#discussion_r625170333 ## File path: docs/querying/sql.md ## @@ -313,46 +313,48 @@ possible for two aggregators in the same SQL query to have different filters. Only the

[GitHub] [druid] suneet-s commented on a change in pull request #11164: Add feature to automatically remove rules based on retention period

suneet-s commented on a change in pull request #11164: URL: https://github.com/apache/druid/pull/11164#discussion_r625156598 ## File path: docs/configuration/index.md ## @@ -750,6 +750,9 @@ These Coordinator static configurations can be defined in the `coordinator/runti

[GitHub] [druid] suneet-s commented on a change in pull request #11164: Add feature to automatically remove rules based on retention period

suneet-s commented on a change in pull request #11164: URL: https://github.com/apache/druid/pull/11164#discussion_r625156598 ## File path: docs/configuration/index.md ## @@ -750,6 +750,9 @@ These Coordinator static configurations can be defined in the `coordinator/runti

[GitHub] [druid] nishantmonu51 closed pull request #10805: Bump up frontend-maven-plugin to v1.11.0

nishantmonu51 closed pull request #10805: URL: https://github.com/apache/druid/pull/10805 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [druid] nishantmonu51 commented on pull request #10805: Bump up frontend-maven-plugin to v1.11.0

nishantmonu51 commented on pull request #10805: URL: https://github.com/apache/druid/pull/10805#issuecomment-831274116 looks like this one as merged by @clintropolis as part of https://github.com/apache/druid/pull/11057. Closing it. -- This is an automated message from the Apache

[GitHub] [druid] egor-ryashin edited a comment on pull request #10995: S3 ingestion can assume role

egor-ryashin edited a comment on pull request #10995: URL: https://github.com/apache/druid/pull/10995#issuecomment-830680346 Fixed all except coverage. The code is integration with AWS API, writing mocks for it will effectively replace about 90% of code, which is unreasonable for testing.

[GitHub] [druid] abhishekagarwal87 commented on a change in pull request #11123: Avoid memory mapping hydrants after they are persisted & after they are merged for native batch ingestion

abhishekagarwal87 commented on a change in pull request #11123: URL: https://github.com/apache/druid/pull/11123#discussion_r625030507 ## File path: server/src/main/java/org/apache/druid/segment/realtime/appenderator/AppenderatorImpl.java ## @@ -161,6 +164,13 @@ private

[GitHub] [druid] jihoonson commented on pull request #11189: Fix idempotence of segment allocation and task report apis in native batch ingestion

jihoonson commented on pull request #11189: URL: https://github.com/apache/druid/pull/11189#issuecomment-831122926 I think we need a cluster-wide configuration corresponding to the new taskContext. I will add it soon. -- This is an automated message from the Apache Git Service. To

[GitHub] [druid] jihoonson opened a new pull request #11189: Fix idempotence of segment allocation and task report apis in native batch ingestion

jihoonson opened a new pull request #11189: URL: https://github.com/apache/druid/pull/11189 ### Description Most internal APIs used in Druid's ingestion should be idempotent to handle transient errors. This PR fixes the idempotence of two APIs used in native batch ingestion.