[CANCEL] [VOTE] Release Apache Druid 0.21.1 [RC1]

cancelling to add fix for docker volume permissions, https://github.com/apache/druid/pull/11299

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Thanks for the votes, though I think since https://github.com/apache/druid/pull/11299 appears to fix the issue described in this thread that I should go ahead and cancel this vote and do an RC2. I'll try to get new artifacts prepared and a vote up soon. On Fri, May 28, 2021 at 7:49 AM Lucas

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

+1 (binding) src - Proper NOTICE and LICENSE files present - Verified .asc signatures and .sha512 checksums - git.version file is present and correct - mvn build passed with unit tests - mvn rat checks passed - ran cluster with built binaries and executed native batch ingestion followed by basic

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

> > Let's collect all the platforms that have reported having problems, create > a table for it at GitHub, and check whether they have fixed or not? > I agree we should file individual docker issues *with detailed environment and steps to reproduce*. However, I don't think this should be

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi Frank, Let's collect all the platforms that have reported having problems, create a table for it at GitHub, and check whether they have fixed or not? Kind Regards, Furkan KAMACI On Tue, May 25, 2021 at 2:07 PM frank chen wrote: > Hi Xavier, > > I have a question, does the problem reported

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi Xavier, I have a question, does the problem reported by Clint could be reproduced when executing the k8s integration test ? Thanks. Xavier Léauté 于2021年5月21日周五 下午11:41写道： > > I agree with you that the root cause is lack of some automated tests > > against released docker images. > > > >

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi all, Whether or not we release the RC1, we have to resolve the issues ASAP. I have submitted a PR https://github.com/apache/druid/pull/11299 , and I'm still testing these changes on different platforms(macOS and centos). But since the reported problems are platform-related, any help to verify

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Do we see Unable to use AWS Fargate bind mounts with Dockerfile · Issue #11278 · apache/druid (github.com) as a regression test failure for https://github.com/apache/druid/pull/11167 Furkan KAMACI 于2021年5月25日周二 下午3:31写道： > Hi, > > Here is my

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi, Here is my opinion: Druid has had problems with docker for a while now. We use Druid on a dockerized environment and manually solve this problem via setting permissions. It is not a blocker issue, and we can release the artifact. However, this is a bugfix release that aims to cover Docker

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

I agree that this probably isn't a blocker, but also agree based on the number of reports that we should consider either fixing so that the docker-compose quickstart instructions work as is, or adjust the docs so that the instructions at least include something about setting the permissions so

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Xavier, that's good to know! Glad we already have some. On Fri, May 21, 2021 at 8:41 AM Xavier Léauté wrote: > > > I agree with you that the root cause is lack of some automated tests > > against released docker images. > > > > Since https://github.com/apache/druid/pull/11187 we are now running

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

> I agree with you that the root cause is lack of some automated tests > against released docker images. > Since https://github.com/apache/druid/pull/11187 we are now running k8s integration tests against the same image we release. So this should at least catch the kind of issues people would

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi Jihoon, I agree with you that the root cause is lack of some automated tests against released docker images. For now, because of permission of docker volume behaves differently on macOS and linux, following steps are suggested to verify released docker images: 1. execute command [docker

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi Clint, Jihoon, I checked this problem, it's caused by the VOLUME problem too. /opt/data directory is mounted as a volume in docker-compose.yml , however it's not created in Dockerfile. That means the directory will be created as a user of root by docker during the starting of docker process.

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

I could reproduce the same issue on my linux as what Clint saw. I didn't look into it closely, but agree that this doesn't seem like a blocker for the 0.21.1 release since the issue is about the permission on the local deep storage. However, for the users who want to try Druid out using docker, we

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hi Clint, According to the docker instruction `COPY --chown=druid:druid --from=builder /opt /opt` in docker file, the user `druid` has permission to create directories under /opt. I don't know what happened. I will check RC1 tomorrow on a fresh linux environment to see if there's such problem.

Re: [VOTE] Release Apache Druid 0.21.1 [RC1]

Hmm, I'm actually still seeing a permissions related issue with the rc1 Docker image and Linux (Docker on Mac OS seems to work ok, which is where I initially tested). middlemanager| 2021-05-18T21:20:39,239 INFO [forking-task-runner-0] org.apache.druid.indexing.overlord.ForkingTaskRunner -

[VOTE] Release Apache Druid 0.21.1 [RC1]

Hi all, I have created a build for Apache Druid 0.21.1, release candidate 1. Thanks to everyone who has helped contribute to the release! You can read the proposed release notes here: https://github.com/apache/druid/issues/11249 The release candidate has been tagged in GitHub as