[GitHub] [druid] paul-rogers opened a new pull request, #13780: Refinements to input-source specific table functions

2023-02-08 Thread via GitHub
paul-rogers opened a new pull request, #13780: URL: https://github.com/apache/druid/pull/13780 This is a follow-up to the earlier PR that introduced input-source specific table functions (e.g. `http`, `s3`, `localfiles`, etc.) This PR is mostly cleanup and bug fixes and is a spin-off of

[GitHub] [druid] anshu-makkar commented on pull request #13664: Add missing documentation for constant post-aggregator

2023-02-08 Thread via GitHub
anshu-makkar commented on PR #13664: URL: https://github.com/apache/druid/pull/13664#issuecomment-1423654934 Thank you @techdocsmith . Kindly merge it and Integration Test is failing on this PR, might be because of some other bug in latest code. -- This is an automated message from the

[GitHub] [druid] cheddar commented on pull request #13698: merge druid-core, extendedset, and druid-hll into druid-processing to simplify everything

2023-02-08 Thread via GitHub
cheddar commented on PR #13698: URL: https://github.com/apache/druid/pull/13698#issuecomment-1423653117 The change set looks good. I agree with Paul, need green checks from build and then we are good. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [druid] techdocsmith commented on a diff in pull request #13485: adds a Jupyter visualization tutorial

2023-02-08 Thread via GitHub
techdocsmith commented on code in PR #13485: URL: https://github.com/apache/druid/pull/13485#discussion_r1088424991 ## examples/quickstart/jupyter-notebooks/druid-visualization.ipynb: ## @@ -0,0 +1,620 @@ +{ + "cells": [ + { + "cell_type": "markdown", + "id": "ad4e60b6", +

[GitHub] [druid] clintropolis commented on a diff in pull request #13779: fix filtering nested field virtual column when used with non nested column input

2023-02-08 Thread via GitHub
clintropolis commented on code in PR #13779: URL: https://github.com/apache/druid/pull/13779#discussion_r1100962754 ## processing/src/main/java/org/apache/druid/segment/virtual/NestedFieldVirtualColumn.java: ## @@ -647,7 +650,10 @@ public ColumnCapabilities

[GitHub] [druid] techdocsmith commented on pull request #13468: docs: add a link for the Druid SQL tutorial

2023-02-08 Thread via GitHub
techdocsmith commented on PR #13468: URL: https://github.com/apache/druid/pull/13468#issuecomment-1423603238 @ektravel , do you want to remove the lines referring to Segment sizing and partitioning so we can merge this PR? Thanks! -- This is an automated message from the Apache Git

[GitHub] [druid] techdocsmith merged pull request #13465: docs: notebook only for SQL tutorial

2023-02-08 Thread via GitHub
techdocsmith merged PR #13465: URL: https://github.com/apache/druid/pull/13465 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[druid] branch master updated (714ac07b52 -> 58d9720b00)

2023-02-08 Thread techdocsmith
This is an automated email from the ASF dual-hosted git repository. techdocsmith pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git from 714ac07b52 Allow users to add additional metadata to ingestion metrics (#13760) add 58d9720b00 docs:

[GitHub] [druid] imply-cheddar commented on a diff in pull request #13779: fix filtering nested field virtual column when used with non nested column input

2023-02-08 Thread via GitHub
imply-cheddar commented on code in PR #13779: URL: https://github.com/apache/druid/pull/13779#discussion_r1100957121 ## processing/src/main/java/org/apache/druid/segment/virtual/NestedFieldVirtualColumn.java: ## @@ -647,7 +650,10 @@ public ColumnCapabilities

[GitHub] [druid] abhishekagarwal87 commented on pull request #13531: Support prometheus emitter

2023-02-08 Thread via GitHub
abhishekagarwal87 commented on PR #13531: URL: https://github.com/apache/druid/pull/13531#issuecomment-1423581151 I will merge this soon. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [druid] imply-cheddar commented on a diff in pull request #13779: fix filtering nested field virtual column when used with non nested column input

2023-02-08 Thread via GitHub
imply-cheddar commented on code in PR #13779: URL: https://github.com/apache/druid/pull/13779#discussion_r1100944253 ## processing/src/main/java/org/apache/druid/segment/virtual/NestedFieldVirtualColumn.java: ## @@ -416,7 +417,7 @@ public VectorObjectSelector

[GitHub] [druid] clintropolis opened a new pull request, #13779: fix filtering nested field virtual column when used with non nested column input

2023-02-08 Thread via GitHub
clintropolis opened a new pull request, #13779: URL: https://github.com/apache/druid/pull/13779 ### Description This PR fixes an issue when filtering on a `NestedFieldVirtualColumn` that is using an input column that is not a nested column, such as a standard string, long, float, or

[GitHub] [druid] paul-rogers opened a new pull request, #13778: Code cleanup & message improvements

2023-02-08 Thread via GitHub
paul-rogers opened a new pull request, #13778: URL: https://github.com/apache/druid/pull/13778 This PR is a collection if minor edits done as part of the Catalog project. Pulled out here to reduce the size of the catalog PR. The edits include: * Fix spacing * Add type

[GitHub] [druid] jaegwonseo commented on pull request #13531: Support prometheus emitter

2023-02-08 Thread via GitHub
jaegwonseo commented on PR #13531: URL: https://github.com/apache/druid/pull/13531#issuecomment-1423519046 @abhishekagarwal87 i just change k8s config is it related with this error? [build fail link](https://app.travis-ci.com/github/apache/druid/jobs/595434161) -- This is an

[GitHub] [druid] asdf2014 closed issue #13745: Helm chart forces zookeeper hosts to be set even if using druid-kubernetes-extensions

2023-02-08 Thread via GitHub
asdf2014 closed issue #13745: Helm chart forces zookeeper hosts to be set even if using druid-kubernetes-extensions URL: https://github.com/apache/druid/issues/13745 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[druid] branch master updated: Allow users to add additional metadata to ingestion metrics (#13760)

2023-02-08 Thread suneet
This is an automated email from the ASF dual-hosted git repository. suneet pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new 714ac07b52 Allow users to add additional

[GitHub] [druid] suneet-s merged pull request #13760: Allow users to add additional metadata to ingestion metrics

2023-02-08 Thread via GitHub
suneet-s merged PR #13760: URL: https://github.com/apache/druid/pull/13760 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [druid] paul-rogers opened a new pull request, #13777: Information schema uses numeric column types

2023-02-08 Thread via GitHub
paul-rogers opened a new pull request, #13777: URL: https://github.com/apache/druid/pull/13777 DruidDruid has an `INFORMATION_SCHEMA` to provide metadata about Druid tables and columns. Historically, columns that contain numbers (such as `ORDINAL_POSITION`) were represented as `VARCHAR`.

[GitHub] [druid] suneet-s opened a new pull request, #13776: Better logs for query errors

2023-02-08 Thread via GitHub
suneet-s opened a new pull request, #13776: URL: https://github.com/apache/druid/pull/13776 ### Description Update QueryException#toString to include more information about the exception that occurred like error code, class, etc. This PR has: - [ ] been

[GitHub] [druid] somu-imply commented on a diff in pull request #13764: Fixing a data correctness issue in unnest when first row of an MVD is null

2023-02-08 Thread via GitHub
somu-imply commented on code in PR #13764: URL: https://github.com/apache/druid/pull/13764#discussion_r1100730560 ## sql/src/test/java/org/apache/druid/sql/calcite/util/TestDataBuilder.java: ## @@ -351,6 +351,100 @@ public Optional build( public static final List ROWS1 =

[GitHub] [druid] juhoautio-rovio opened a new issue, #13775: SQL query with an empty string as group by fails: "Cannot add expression of different type to set"

2023-02-08 Thread via GitHub
juhoautio-rovio opened a new issue, #13775: URL: https://github.com/apache/druid/issues/13775 ### Affected Version 25.0.0 ### Description Having a an empty string as a value and grouping by it doesn't make much sense, but there happened to be a query like that, and it

[GitHub] [druid] paul-rogers commented on a diff in pull request #13764: Fixing a data correctness issue in unnest when first row of an MVD is null

2023-02-08 Thread via GitHub
paul-rogers commented on code in PR #13764: URL: https://github.com/apache/druid/pull/13764#discussion_r1100676736 ## sql/src/test/java/org/apache/druid/sql/calcite/util/CalciteTests.java: ## @@ -97,6 +97,7 @@ public static final String DATASOURCE3 = "numfoo"; public

[GitHub] [druid] somu-imply commented on a diff in pull request #13736: docs: sql unnest and cleanup unnest datasource

2023-02-08 Thread via GitHub
somu-imply commented on code in PR #13736: URL: https://github.com/apache/druid/pull/13736#discussion_r1100675117 ## docs/querying/sql.md: ## @@ -82,6 +83,29 @@ FROM clause, metadata tables are not considered datasources. They exist only in For more information about table,

[GitHub] [druid] paul-rogers commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
paul-rogers commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100666897 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/DruidOperatorTable.java: ## @@ -437,6 +442,12 @@ public DruidOperatorTable( for

[GitHub] [druid] techdocsmith commented on a diff in pull request #13664: Add missing documentation for constant post-aggregator

2023-02-08 Thread via GitHub
techdocsmith commented on code in PR #13664: URL: https://github.com/apache/druid/pull/13664#discussion_r1100664367 ## docs/development/extensions-core/datasketches-theta.md: ## @@ -95,6 +95,49 @@ This returns a summary of the sketch that can be used for debugging. This is the

[GitHub] [druid] jwitko commented on a diff in pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
jwitko commented on code in PR #13747: URL: https://github.com/apache/druid/pull/13747#discussion_r1100573665 ## helm/druid/templates/broker/deployment.yaml: ## @@ -41,11 +41,15 @@ spec: app: {{ include "druid.name" . }} release: {{ .Release.Name }}

[GitHub] [druid] jwitko commented on a diff in pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
jwitko commented on code in PR #13747: URL: https://github.com/apache/druid/pull/13747#discussion_r1100571768 ## helm/druid/templates/broker/role.yaml: ## @@ -0,0 +1,21 @@ +{{- if .Values.rbac.create }} +apiVersion: rbac.authorization.k8s.io/v1 +kind: Role +metadata: + name:

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100565821 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/DruidOperatorTable.java: ## @@ -437,6 +442,12 @@ public DruidOperatorTable( for (SqlOperatorConversion

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100565324 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/DruidOperatorTable.java: ## @@ -437,6 +442,12 @@ public DruidOperatorTable( for (SqlOperatorConversion

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100563840 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/PlannerOperatorConversionConfig.java: ## @@ -0,0 +1,108 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100564226 ## sql/src/test/java/org/apache/druid/sql/calcite/planner/DruidOperatorTableTest.java: ## @@ -0,0 +1,129 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100563578 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/PlannerOperatorConversionConfig.java: ## @@ -0,0 +1,108 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100563357 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/CalcitePlannerModule.java: ## @@ -40,6 +40,7 @@ public void configure(Binder binder) // We're actually

[GitHub] [druid] zachjsh commented on a diff in pull request #13766: Operator conversion deny list

2023-02-08 Thread via GitHub
zachjsh commented on code in PR #13766: URL: https://github.com/apache/druid/pull/13766#discussion_r1100563040 ## sql/src/main/java/org/apache/druid/sql/calcite/planner/PlannerOperatorConversionConfig.java: ## @@ -0,0 +1,108 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [druid] xvrl commented on a diff in pull request #13341: Bump app version in Helm Chart from 0.23.0 to 24.0.0

2023-02-08 Thread via GitHub
xvrl commented on code in PR #13341: URL: https://github.com/apache/druid/pull/13341#discussion_r1100534123 ## helm/druid/Chart.yaml: ## @@ -14,7 +14,7 @@ # limitations under the License. apiVersion: v2 -appVersion: 0.23.0 +appVersion: 24.0.0 Review Comment: shouldn't

[GitHub] [druid] dampcake commented on a diff in pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
dampcake commented on code in PR #13747: URL: https://github.com/apache/druid/pull/13747#discussion_r1100528686 ## helm/druid/templates/broker/roleBinding.yaml: ## @@ -0,0 +1,20 @@ +{{- if .Values.rbac.create }} Review Comment: Same question about checking enabled for the

[GitHub] [druid] tejaswini-imply commented on pull request #13772: Fix GHA tests cache hit miss scenario

2023-02-08 Thread via GitHub
tejaswini-imply commented on PR #13772: URL: https://github.com/apache/druid/pull/13772#issuecomment-1422992653 @paul-rogers @imply-elliott Could you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [druid] somu-imply commented on pull request #13764: Fixing a data correctness issue in unnest when first row of an MVD is null

2023-02-08 Thread via GitHub
somu-imply commented on PR #13764: URL: https://github.com/apache/druid/pull/13764#issuecomment-1422987126 @imply-cheddar it is the other way round the previous was ``` select * from mytest1, unnest(mv_to_array(c2)) as unnested(c3) __time c1 c2 c3 2022-01-01T00:00:00.000Z 1

[GitHub] [druid] anshu-makkar commented on a diff in pull request #13664: Add missing documentation for constant post-aggregator

2023-02-08 Thread via GitHub
anshu-makkar commented on code in PR #13664: URL: https://github.com/apache/druid/pull/13664#discussion_r1100432243 ## docs/development/extensions-core/datasketches-theta.md: ## @@ -95,6 +95,49 @@ This returns a summary of the sketch that can be used for debugging. This is the

[GitHub] [druid] techdocsmith commented on a diff in pull request #13664: Add missing documentation for constant post-aggregator

2023-02-08 Thread via GitHub
techdocsmith commented on code in PR #13664: URL: https://github.com/apache/druid/pull/13664#discussion_r1100427144 ## docs/development/extensions-core/datasketches-theta.md: ## @@ -95,6 +95,49 @@ This returns a summary of the sketch that can be used for debugging. This is the

[GitHub] [druid] jwitko commented on pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
jwitko commented on PR #13747: URL: https://github.com/apache/druid/pull/13747#issuecomment-1422886636 > Thank you. I see that by default, helm charts are now going to create service accounts per service. so can we keep the default off in top-level `values.yaml`

[GitHub] [druid] anshu-makkar commented on pull request #13664: Add missing documentation for constant post-aggregator

2023-02-08 Thread via GitHub
anshu-makkar commented on PR #13664: URL: https://github.com/apache/druid/pull/13664#issuecomment-1422838455 @techdocsmith Kindly let me know if any more changes are needed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [druid] abhishekagarwal87 commented on pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
abhishekagarwal87 commented on PR #13747: URL: https://github.com/apache/druid/pull/13747#issuecomment-1422713735 Thank you. I see that by default, helm charts are now going to create service accounts per service. so can we keep the default off in top-level `values.yaml` -- This is an

[GitHub] [druid] jwitko commented on pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
jwitko commented on PR #13747: URL: https://github.com/apache/druid/pull/13747#issuecomment-1422665417 > can you elaborate a bit more on "Enabling per-service serviceAccounts allows for finer grained RBAC"? Maybe take us through an example use-case that you want to implement on your own

[GitHub] [druid] jwitko commented on pull request #13747: helm: Add serviceAccounts, rbac, and small fixes

2023-02-08 Thread via GitHub
jwitko commented on PR #13747: URL: https://github.com/apache/druid/pull/13747#issuecomment-1422651898 Merged upstream master into this branch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [druid] kfaraz commented on a diff in pull request #13303: Hadoop based batch ingestion support range partition

2023-02-08 Thread via GitHub
kfaraz commented on code in PR #13303: URL: https://github.com/apache/druid/pull/13303#discussion_r105172 ## indexing-hadoop/src/main/java/org/apache/druid/indexer/DeterminePartitionsJob.java: ## @@ -603,6 +647,28 @@ protected void innerReduce(Context context, SortableBytes

[GitHub] [druid] kfaraz commented on a diff in pull request #13303: Hadoop based batch ingestion support range partition

2023-02-08 Thread via GitHub
kfaraz commented on code in PR #13303: URL: https://github.com/apache/druid/pull/13303#discussion_r102653 ## core/src/test/java/org/apache/druid/timeline/partition/DimensionRangeShardSpecTest.java: ## @@ -136,6 +136,61 @@ public void testShardSpecLookup() ); } +

[druid] branch master updated (34c04daa9f -> d7a15be9bc)

2023-02-08 Thread abhishek
This is an automated email from the ASF dual-hosted git repository. abhishek pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git from 34c04daa9f Fix infinite iteration in http sync monitoring (#13731) add d7a15be9bc Add assertions for counters

[GitHub] [druid] abhishekagarwal87 commented on pull request #13726: Add assertions for counters from reports

2023-02-08 Thread via GitHub
abhishekagarwal87 commented on PR #13726: URL: https://github.com/apache/druid/pull/13726#issuecomment-1422416183 Merged since failures are unrelated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [druid] abhishekagarwal87 merged pull request #13726: Add assertions for counters from reports

2023-02-08 Thread via GitHub
abhishekagarwal87 merged PR #13726: URL: https://github.com/apache/druid/pull/13726 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [druid] github-code-scanning[bot] commented on a diff in pull request #12852: Removes FiniteFirehoseFactory and its implementations

2023-02-08 Thread via GitHub
github-code-scanning[bot] commented on code in PR #12852: URL: https://github.com/apache/druid/pull/12852#discussion_r1099894611 ## indexing-service/src/test/java/org/apache/druid/indexing/common/task/batch/parallel/AbstractMultiPhaseParallelIndexingTest.java: ## @@ -243,22

[druid] branch master updated: Fix infinite iteration in http sync monitoring (#13731)

2023-02-08 Thread amatya
This is an automated email from the ASF dual-hosted git repository. amatya pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new 34c04daa9f Fix infinite iteration in http sync

[GitHub] [druid] AmatyaAvadhanula merged pull request #13731: Fix infinite iteration in http sync monitoring

2023-02-08 Thread via GitHub
AmatyaAvadhanula merged PR #13731: URL: https://github.com/apache/druid/pull/13731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [druid] AmatyaAvadhanula commented on pull request #13731: Fix infinite iteration in http sync monitoring

2023-02-08 Thread via GitHub
AmatyaAvadhanula commented on PR #13731: URL: https://github.com/apache/druid/pull/13731#issuecomment-1422311781 @abhishekagarwal87 I've added tests. Merging since the failures are due to code coverage -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [druid] github-code-scanning[bot] commented on a diff in pull request #13774: Query tests migration to new IT framework with TLS

2023-02-08 Thread via GitHub
github-code-scanning[bot] commented on code in PR #13774: URL: https://github.com/apache/druid/pull/13774#discussion_r1099781790 ## integration-tests-ex/cases/src/test/java/org/apache/druid/testsEx/query/ITBroadcastJoinQueryTest.java: ## @@ -0,0 +1,163 @@ +/* + * Licensed to