Re: Problem running Drill in a Docker container in OpenShift

2020-02-06 Thread Abhishek Girish
Hey Paul, Sorry for my delayed response. And thanks for your encouragement. So here's a brief history of my work in this area. (1) I started with simple YAML based deployments for Drill. Used standard Kubernetes APIs and Controllers. This supported bringing up Drill in distributed mode, used Map

Re: Problem running Drill in a Docker container in OpenShift

2020-02-06 Thread Abhishek Girish
Arina, There is a v1.0 of the Drill Operator for Kubernetes out, but it is currently tied to the MapR platform. Of the people here, Anton & Denys have tried it out. The open source version of it that I'm working on is based on that, minus MapR integration and plus Apache integration. My plan is t

Re: Problem running Drill in a Docker container in OpenShift

2020-02-04 Thread Arina Yelchiyeva
Abhishek, looks like Paul is planning to put on hold his efforts since he expects you open-source version to be out soon. Do you have an ETA? This work is important for the community and it would be nice if is completed in this release. Here Jira to tract the efforts: https://issues.apache.org/

Re: Problem running Drill in a Docker container in OpenShift

2020-02-03 Thread Paul Rogers
Hi Abhishek, Thanks for the update! Seems to make sense to wait for you to open source your work than to spend time on duplicating your effort. And, people who want a solution short term can perhaps work with MapR/HPE as you suggest.  Sounds like you have access to the various systems and have

Re: Problem running Drill in a Docker container in OpenShift

2020-02-03 Thread Ron Cecchini
Thanks, Paul. You're right. If I had thought about it a little more and put 2 & 2 together, I would have realized that we don't even need SqlLine up and running, as our use case is simply: Get a single Drill server running, and have a single app connect to it via JDBC calls. (This app in our

Re: Problem running Drill in a Docker container in OpenShift

2020-02-03 Thread Abhishek Girish
Hey Ron, As a part of MapR (now HPE), I've created a native operator for Apache Drill and this works on multiple variants of Kubernetes including OpenShift. With this, we introduce a new Kind called "DrillCluster" via a Custom Resource Definition (CRD) and a Custom Controller (logic to manage this

Re: Problem running Drill in a Docker container in OpenShift

2020-02-02 Thread Paul Rogers
Hi All, Our current embedded Docker container works best when run from Docker with the "-it" (interactive) flag. Since K8s pods are seldom interactive, it seems we'll need to create a container focused on the needs of server deployment. DRILL-7563 [1] has an outline of the tasks. Fortunately, t

Re: Problem running Drill in a Docker container in OpenShift

2020-01-31 Thread Paul Rogers
Hi Ron, I suspect you are right about the issue being TTY related. Sounds like you are bringing up SqlLine inside the pod. But, Sqlline is a command line app that runs Drill in embedded mode. I wonder what Sqline is using as stdin? I personally have never used Docker to bring up clients; only s

Re: Problem running Drill in a Docker container in OpenShift

2020-01-31 Thread Ron Cecchini
FWIW, I found a thread on SO that addresses this OpenShift issue with containers seemingly exiting for no apparent reason, even when running as root. It might be TTY related. openshift pod fails and restarts frequently https://stackoverflow.com/questions/35744404/openshift-pod-fails-and-restart

Re: Problem running Drill in a Docker container in OpenShift

2020-01-31 Thread Ron Cecchini
Thank you, Paul, for your in depth and informative response. Here's what we did today as a test: In OpenShift, we enabled allowing containers to run however they wanted and redeployed the Drill Docker. Note: - this is the 1.17.0 image we pulled directly from Docker Hub, not the image I made fr

Re: Problem running Drill in a Docker container in OpenShift

2020-01-30 Thread Paul Rogers
Hi Ron, Actually, helping us track down this issue is a great contribution in itself. My Docker is a bit rusty, but I just did a quick check of Drill's two Dockerfiles. Neither seem designed for a production deployment: one is a build image, the other a simple embedded image. Neither set a user

Re: Problem running Drill in a Docker container in OpenShift

2020-01-30 Thread Ron Cecchini
So, apparently I spoke too soon, as my image-from-an-image in OpenShift actually *didn't* start up successfully. I'll take Ted's and Charles' comments in the current "[DISCUSS]" thread regarding attracting users who may never contribute a line of code but nevertheless report on their use of Dri

Re: Problem running Drill in a Docker container in OpenShift

2020-01-29 Thread Ron Cecchini
Sorry for the spam, but I think I figured it out. Thank you so much for your suggestions to build an image from an image. I finally put 2 & 2 together and realized what you were saying and created the following Dockerfile. I then built and pushed the image into OpenShift - and it started up

Re: Problem running Drill in a Docker container in OpenShift

2020-01-29 Thread Ron Cecchini
Thank you, Paul and Volodymyr. I'll answer all of your questions below. (Warning: It gets a little long...) So, first of all, I am behind a proxied firewall, and I am trying to do this build on my RHEL/CentOS 7 development machine, and then replicate the steps on another ("build") machine and

Re: Problem running Drill in a Docker container in OpenShift

2020-01-29 Thread Volodymyr Vysotskyi
Hi all, We have an image that includes the 1.17 release binaries: apache/drill:1.17.0. It is a good point to try building a new image on top of the existing one with the commands you need. Kind regards, Volodymyr Vysotskyi On Wed, Jan 29, 2020 at 9:10 AM Paul Rogers wrote: > Hi Ron, > > I don

Re: Problem running Drill in a Docker container in OpenShift

2020-01-28 Thread Paul Rogers
Hi Ron, I don't think anyone on the Drill team has access to an OpenShift environment. Let's see if we can use your work to ensure that the Docker image supports OpenShift in the future. Please explain a bit more about the file permissions issue. Is the file owned by a user other than the one

Problem running Drill in a Docker container in OpenShift

2020-01-28 Thread Ron Cecchini
Hi, all. Drill and OpenShift newbie here. Has anyone successfully deployed a Drill Docker container to an OpenShift environment? While there is information about Drill Docker, there seems to be zero information about OpenShift in particular. Per the instructions at drill.apache.org/docs/ru