clintropolis opened a new pull request #6129: Add support for 'maxTotalRows' to
incremental publishing kafka indexing task and appenderator based realtime task
URL: https://github.com/apache/incubator-druid/pull/6129
Resolves #5898 by adding `getMaxTotalRows` and `getMaxRowsPerSegment` to
josephglanville commented on issue #6004: Automatically Determine Ingestion
Schema
URL:
https://github.com/apache/incubator-druid/issues/6004#issuecomment-411288680
It's already possible for an InputRowParser to automatically do this. When
writing an InputRowParser you can choose to ignor
doc987 commented on issue #6004: Automatically Determine Ingestion Schema
URL:
https://github.com/apache/incubator-druid/issues/6004#issuecomment-411281495
That gets part of the way there, though the data provided by Collectd and
Telegraf are formatted somewhat differently. That means tha
jihoonson edited a comment on issue #6124: KafkaIndexTask can delete published
segments on restart
URL:
https://github.com/apache/incubator-druid/issues/6124#issuecomment-411279909
> This doesn't seem right: there is code specifically to handle the case
where a task tries to publish a seg
jihoonson commented on issue #6124: KafkaIndexTask can delete published
segments on restart
URL:
https://github.com/apache/incubator-druid/issues/6124#issuecomment-411279909
> This doesn't seem right: there is code specifically to handle the case
where a task tries to publish a segment th
jon-wei commented on issue #6127: Unified configuration doc page
URL: https://github.com/apache/incubator-druid/pull/6127#issuecomment-411262036
Updated redirects
This is an automated message from the Apache Git Service.
To re
jon-wei opened a new pull request #6128: Unified API doc page
URL: https://github.com/apache/incubator-druid/pull/6128
This PR creates a unified API reference page that lists all of the endpoints
supported by each Druid service.
The endpoint docs have been moved from `design` to the
gianm commented on issue #6127: Unified configuration doc page
URL: https://github.com/apache/incubator-druid/pull/6127#issuecomment-411255990
I LOVE THIS IDEA.
Please add some lines to redirects.json so the old links keep working.
jon-wei opened a new pull request #6127: Unified configuration doc page
URL: https://github.com/apache/incubator-druid/pull/6127
This PR combines each of the individual service configuration pages under
`configuration` into one unified page.
TLS and auth configs have been added to th
gianm commented on issue #6124: KafkaIndexTask can delete published segments on
restart
URL:
https://github.com/apache/incubator-druid/issues/6124#issuecomment-411254406
> 5. Since the segments which are published twice are already stored in
metastore, the publish fails.
This doesn
jon-wei opened a new pull request #6126: New quickstart and tutorials
URL: https://github.com/apache/incubator-druid/pull/6126
This PR updates the quickstart and provides several new tutorials, as shown
in `toc.md`.
* [Quickstart]
* [Tutorial: Loading a file]
* [Tutor
jihoonson commented on a change in pull request #6090: Fix missing exception
handling as part of
`io.druid.java.util.http.client.netty.HttpClientPipelineFactory`
URL: https://github.com/apache/incubator-druid/pull/6090#discussion_r208428314
##
File path:
java-util/src/test/java/io
jihoonson commented on a change in pull request #6090: Fix missing exception
handling as part of
`io.druid.java.util.http.client.netty.HttpClientPipelineFactory`
URL: https://github.com/apache/incubator-druid/pull/6090#discussion_r208428096
##
File path:
java-util/src/main/java/io
jihoonson commented on a change in pull request #6090: Fix missing exception
handling as part of
`io.druid.java.util.http.client.netty.HttpClientPipelineFactory`
URL: https://github.com/apache/incubator-druid/pull/6090#discussion_r208428237
##
File path:
java-util/src/main/java/io
KenjiTakahashi opened a new pull request #6125: Fix appenderator_realtime
creating shards bigger by 1 than maxRowsPerSegment
URL: https://github.com/apache/incubator-druid/pull/6125
Not that big of a deal generally, but it messes with our ingestion
validation routines :-).
---
fjy commented on issue #6120: Separate hadoop and native batch docs more
URL: https://github.com/apache/incubator-druid/pull/6120#issuecomment-411246720
đź‘Ť
This is an automated message from the Apache Git Service.
To respond t
jihoonson commented on a change in pull request #6095: Add support
'keepSegmentGranularity' for compactionTask
URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425755
##
File path:
server/src/main/java/io/druid/server/coordinator/helper/DruidCoordinatorSegmen
jihoonson commented on a change in pull request #6095: Add support
'keepSegmentGranularity' for compactionTask
URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425665
##
File path:
indexing-service/src/main/java/io/druid/indexing/common/task/CompactionTask.ja
jihoonson commented on a change in pull request #6095: Add support
'keepSegmentGranularity' for compactionTask
URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425653
##
File path:
indexing-service/src/main/java/io/druid/indexing/common/task/CompactionTask.ja
jihoonson commented on a change in pull request #6095: Add support
'keepSegmentGranularity' for compactionTask
URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425657
##
File path:
indexing-service/src/main/java/io/druid/indexing/common/task/CompactionTask.ja
jihoonson commented on a change in pull request #6095: Add support
'keepSegmentGranularity' for compactionTask
URL: https://github.com/apache/incubator-druid/pull/6095#discussion_r208425648
##
File path:
indexing-service/src/main/java/io/druid/indexing/common/task/CompactionTask.ja
jihoonson closed pull request #6075: validate non-empty String baseDataSource
in MaterializedViewSuperviso…
URL: https://github.com/apache/incubator-druid/pull/6075
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake
This is an automated email from the ASF dual-hosted git repository.
jihoonson pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/master by this push:
new c3b7704 validate non-empty String b
jihoonson closed pull request #6121: Fix broken master
URL: https://github.com/apache/incubator-druid/pull/6121
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (fr
This is an automated email from the ASF dual-hosted git repository.
jihoonson pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/master by this push:
new 577632f Fix missing argument of Tas
jihoonson opened a new issue #6124: KafkaIndexTask can delete published
segments on restart
URL: https://github.com/apache/incubator-druid/issues/6124
This can happen in the following scenario.
1. A kafka index task starts publishing segments.
2. The task succeeds to publish segme
sasounda edited a comment on issue #5577: historical miscalculating remaining
disk capacity - segment too large exception causing segments to not load
URL:
https://github.com/apache/incubator-druid/issues/5577#issuecomment-411213124
@gianm @fjy just wanted to check if someone is looking in
sasounda commented on issue #5577: historical miscalculating remaining disk
capacity - segment too large exception causing segments to not load
URL:
https://github.com/apache/incubator-druid/issues/5577#issuecomment-411213124
@gianm just wanted to check if someone is looking into this ?
-
jihoonson opened a new issue #6123: ClassCastException in groupBy when sorting
on numeric columns containing nulls
URL: https://github.com/apache/incubator-druid/issues/6123
Here is the sample query.
```
{
"queryType": "groupBy",
"dataSource": {
"type": "table",
KenjiTakahashi commented on issue #5006: No protections for select query
URL:
https://github.com/apache/incubator-druid/issues/5006#issuecomment-411212023
I'm with @gianm on this. I have examined the select in quite a detail in the
past (before scan came to be, it is to be found somewhere
KenjiTakahashi commented on issue #6088: Scan query: time-ordering
URL:
https://github.com/apache/incubator-druid/issues/6088#issuecomment-411209773
FYI: I'd just like to see this kept as option in the query, so ones that do
no need sorting avoid the performance hit.
I'd also point
jon-wei opened a new pull request #6122: New docs intro
URL: https://github.com/apache/incubator-druid/pull/6122
Replaces the old intro concepts/architecture page and adds a new ingestion
overview page
This is an automated me
jihoonson opened a new pull request #6121: Fix broken master
URL: https://github.com/apache/incubator-druid/pull/6121
Fix missing argument of TaskToolbox.
This is an automated message from the Apache Git Service.
To respond to
gianm commented on issue #5006: No protections for select query
URL:
https://github.com/apache/incubator-druid/issues/5006#issuecomment-411176545
@RestfulBlue I'd really try to move to Scan queries if you can… ultimately I
believe we are going to be deprecating and removing Select queries.
RestfulBlue edited a comment on issue #5006: No protections for select query
URL:
https://github.com/apache/incubator-druid/issues/5006#issuecomment-411163311
@gianm yes, i have considered, but currently druid api can be used only from
some ui apps, like grafana/metabase/etc. if we let eve
jon-wei opened a new pull request #6120: Separate hadoop and native batch docs
more
URL: https://github.com/apache/incubator-druid/pull/6120
Slight adjustment to batch ingestion docs, creating a separate page for
hadoop and restructuring the existing batch ingestion page to be a directory
RestfulBlue edited a comment on issue #4826: AvaticaClientRuntimeException:
Remote driver error: IllegalStateException: DefaultQueryMetrics must not be
modified from multiple threads.
URL:
https://github.com/apache/incubator-druid/issues/4826#issuecomment-411160413
@gianm i also issue thi
RestfulBlue commented on issue #5006: No protections for select query
URL:
https://github.com/apache/incubator-druid/issues/5006#issuecomment-411163311
@gianm yes, i have considered, but currently druid api can be used only from
some ui apps, like grafana/metabase/etc. if we let every anal
jon-wei opened a new pull request #6119: Add docs for virtual columns and
transform specs
URL: https://github.com/apache/incubator-druid/pull/6119
This is an automated message from the Apache Git Service.
To respond to the m
RestfulBlue edited a comment on issue #4826: AvaticaClientRuntimeException:
Remote driver error: IllegalStateException: DefaultQueryMetrics must not be
modified from multiple threads.
URL:
https://github.com/apache/incubator-druid/issues/4826#issuecomment-411160413
@gianm i also issue thi
RestfulBlue commented on issue #4826: AvaticaClientRuntimeException: Remote
driver error: IllegalStateException: DefaultQueryMetrics must not be modified
from multiple threads.
URL:
https://github.com/apache/incubator-druid/issues/4826#issuecomment-411160413
@gianm i also issue this error
himanshug commented on issue #6088: Scan query: time-ordering
URL:
https://github.com/apache/incubator-druid/issues/6088#issuecomment-411139043
Implementing (3) makes sense to me as well with one additional change that
if limit was L then it would work like below.
try finding latest L (
gianm closed pull request #5108: Cache: Add maxEntrySize config, make groupBy
cacheable by default.
URL: https://github.com/apache/incubator-druid/pull/5108
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of prov
This is an automated email from the ASF dual-hosted git repository.
gian pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git
The following commit(s) were added to refs/heads/master by this push:
new 3525d40 Cache: Add maxEntrySize config,
jihoonson edited a comment on issue #5492: Native parallel batch indexing
without shuffle
URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-410923528
@josephglanville in perfect roll-up, all rows which have the timestamp
falling in the same interval should be in the sam
drcrallen commented on issue #5492: Native parallel batch indexing without
shuffle
URL: https://github.com/apache/incubator-druid/pull/5492#issuecomment-411124748
Tagged for special callout in release notes
This is an automat
a2l007 commented on issue #6104: Webhdfs support for orc-extension
URL:
https://github.com/apache/incubator-druid/issues/6104#issuecomment-411105781
Sure I'll investigate if it is indeed a better solution and then work
towards contributing it.
-
asdf2014 commented on issue #6118: Docs: convert all time-intervals in ISO 8601
format to uppercase
URL: https://github.com/apache/incubator-druid/pull/6118#issuecomment-410994099
@QiuMM Nice catch :+1:
This is an automated m
QiuMM commented on issue #5876: 0.12.1 Kafka Emitter Configuration Fails to
Parse
URL:
https://github.com/apache/incubator-druid/issues/5876#issuecomment-410975637
Just as the log said, your kafka topic has the same prefix of the key:
druid.emitter.kafka.alert.topic
-
QiuMM opened a new pull request #6118: Docs: convert all time-intervals in ISO
8601 format to uppercase
URL: https://github.com/apache/incubator-druid/pull/6118
Currently, time-intervals in ISO 8601 format are not all uppercase in Doc
files. For example, 1 minute may be represented by `PT1
50 matches
Mail list logo