Re: Encrypting Airflow Communications

This might be relevant as well if you want to learn more about VPC : https://www.youtube.com/watch?v=HexrVfuIY1k On Thu, Oct 27, 2016 at 6:39 PM, siddharth anand wrote: > Hmn.. it looks like traffic within AWS's VPC is not encrypted.. so using > TLS between all services is a

Re: Encrypting Airflow Communications

I haven't looked into it but would welcome a PR if you were to propose one. We use SQL Alchemy for our ORM, so you may want to look at that for 1) above. We (Agari) run in AWS and run all our EC2-based services (e.g. Airflow servers and the DB) within a VPC. I suspect the folks running in GCP

Encrypting Airflow Communications

>From what I see, Airflow communicates with a couple sources: 1) SQL Store 2) Celery Broker Does Airflow have any configurations which make it easy to encrypt all of its communications or do we need to build custom solutions into Airflow? -- This e-mail is private and confidential and is for

Re: Next Release?

Resolving PRs (i.e. cold case or recently submitted) & releasing new versions in a timely manner are both part meeting community expectations. In this case, they are not tied to each other - the Cold Case PR clean-up activity is a call-to-action. We can all run the RC once it is cut - we are

Re: Next Release?

I thought that the 15 November deadline for PR was in preparation for the 1.8 release. Do you need help with the release? I'm dedicating each week some time on Airflow anyway (although it's more writing operators :-). On Thu, Oct 27, 2016 at 6:22 PM siddharth anand wrote: > I

Re: Next Release?

I believe the release manager is/was Max, though it might be Dan (@aoen). -s On Thu, Oct 27, 2016 at 9:20 AM, Chris Riccomini wrote: > No news AFAIK. I think > > 1) someone needs to be release mgr > 2) release mgr needs to cut RC > 3) we all need to deploy RC > > On Thu, Oct

Re: Regarding hive server2

Have you tried `PLAIN`? The nest approach is probably to fire up an iPython shell and interact with the underlying library until you find a working path. Then you can read the fairly simple HiveServer2Hook code and figure out how to pass your configuration settings through. Max On Thu, Oct 27,

retry handler not getting called

Hi, I am working with a hiveToMySql transfer operation, which is not able to connect and gives following logs: HiveServer2Error: Failed after retrying 3 times [2016-10-27 01:54:46,524] {models.py:1298} INFO - Marking task as UP_FOR_RETRY As per the code in the models.py,

Re: Regarding hive server2

Hi Maxime, Before this setting, i was getting following exception: File "/home/xxx/.pyenv/versions/2.7.12/lib/python2.7/site- packages/pyhs2/cloudera/thrift_sasl.py", line 66, in open message=("Could not start SASL: %s" % self.sasl.getError()))

Next Release?

Max, Chris, Bolke? Any news on the 1.8 release? -s

Re: Call to Committers : PR Clean up Duty : ETA Nov 15

We are down to 71 open PRs from 110 a couple of weeks ago. Chris, Bolke, Jeremiah, Dan, Max? Can we knock that number down to 30? [image: Inline image 1] On Wed, Oct 26, 2016 at 12:58 AM, siddharth anand wrote: > Pretty good activity on Cold Case PR clean-up. We've clean up