[jira] [Commented] (AIRFLOW-818) User env variables overridden when using kerberos

2018-07-04 Thread Giovanni Lanzani (JIRA)


[ 
https://issues.apache.org/jira/browse/AIRFLOW-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16532544#comment-16532544
 ] 

Giovanni Lanzani commented on AIRFLOW-818:
--

Hi [~bolke],

Could you be a bit more specific/provide pointers for this?

 

> User env variables overridden when using kerberos
> -
>
> Key: AIRFLOW-818
> URL: https://issues.apache.org/jira/browse/AIRFLOW-818
> Project: Apache Airflow
>  Issue Type: Bug
>Reporter: Bolke de Bruin
>Priority: Major
>
> If a user wants to use kerberos authentication and airflow.cfg lists kerberos 
> for security, the user's env variables will be overwritten by the cfg 
> settings resulting in not being able to use kerberos authentication.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (AIRFLOW-2698) `security.utils` fetches wrong realm from configuration

2018-06-29 Thread Giovanni Lanzani (JIRA)
Giovanni Lanzani created AIRFLOW-2698:
-

 Summary: `security.utils` fetches wrong realm from configuration
 Key: AIRFLOW-2698
 URL: https://issues.apache.org/jira/browse/AIRFLOW-2698
 Project: Apache Airflow
  Issue Type: Test
  Components: security
Reporter: Giovanni Lanzani
Assignee: Giovanni Lanzani


The `principal_from_username` function in `security` is fetching the wrong 
security real (from `security.realm` instead of `kerberos.realm`.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (AIRFLOW-2534) HiveServer2Hook is overwriting results when passing multiple sql statements

2018-05-29 Thread Giovanni Lanzani (JIRA)
Giovanni Lanzani created AIRFLOW-2534:
-

 Summary: HiveServer2Hook is overwriting results when passing 
multiple sql statements
 Key: AIRFLOW-2534
 URL: https://issues.apache.org/jira/browse/AIRFLOW-2534
 Project: Apache Airflow
  Issue Type: Test
  Components: hooks
Affects Versions: Airflow 1.9.0
Reporter: Giovanni Lanzani
Assignee: Giovanni Lanzani


`HiveServer2Hook.get_results` is overwriting records when multiple sql 
statements are passed. This might be superflous when the first statements are 
just `SET`, but in principle we want to check if that's also the case



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (AIRFLOW-2427) Write tests for NamedHivePartitionSensor

2018-05-07 Thread Giovanni Lanzani (JIRA)
Giovanni Lanzani created AIRFLOW-2427:
-

 Summary: Write tests for NamedHivePartitionSensor
 Key: AIRFLOW-2427
 URL: https://issues.apache.org/jira/browse/AIRFLOW-2427
 Project: Apache Airflow
  Issue Type: Test
  Components: core
Affects Versions: Airflow 1.9.0
Reporter: Giovanni Lanzani
Assignee: Giovanni Lanzani






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (AIRFLOW-2336) Update hive_hook dependencies so that it can work with Python 3

2018-04-18 Thread Giovanni Lanzani (JIRA)

 [ 
https://issues.apache.org/jira/browse/AIRFLOW-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Giovanni Lanzani updated AIRFLOW-2336:
--
Labels: pull-request-available  (was: )

> Update hive_hook dependencies so that it can work with Python 3
> ---
>
> Key: AIRFLOW-2336
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2336
> Project: Apache Airflow
>  Issue Type: Bug
>  Components: hooks
>Affects Versions: Airflow 1.9.0
>Reporter: Giovanni Lanzani
>Assignee: Giovanni Lanzani
>Priority: Major
>  Labels: pull-request-available
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I already have a new version of the hive metastore thrift client out. I'm 
> updating it and I will update Airflow consequently (without changing the API)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (AIRFLOW-2336) Update hive_hook dependencies so that it can work with Python 3

2018-04-18 Thread Giovanni Lanzani (JIRA)
Giovanni Lanzani created AIRFLOW-2336:
-

 Summary: Update hive_hook dependencies so that it can work with 
Python 3
 Key: AIRFLOW-2336
 URL: https://issues.apache.org/jira/browse/AIRFLOW-2336
 Project: Apache Airflow
  Issue Type: Bug
  Components: hooks
Affects Versions: Airflow 1.9.0
Reporter: Giovanni Lanzani
Assignee: Giovanni Lanzani


I already have a new version of the hive metastore thrift client out. I'm 
updating it and I will update Airflow consequently (without changing the API)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (AIRFLOW-1151) Fix scripts execution in SparkSql hook

2017-04-26 Thread Giovanni Lanzani (JIRA)
Giovanni Lanzani created AIRFLOW-1151:
-

 Summary: Fix scripts execution in SparkSql hook 
 Key: AIRFLOW-1151
 URL: https://issues.apache.org/jira/browse/AIRFLOW-1151
 Project: Apache Airflow
  Issue Type: Bug
  Components: contrib
Affects Versions: Airflow 1.8
Reporter: Giovanni Lanzani


When using the the SparkSqlOperator and submitting a file (ending with .sql or 
.hql), a whitespace need to be appended, otherwise a Jinja error will be 
raised. However the trailing whitespace confused the hook as those files will 
not end with .sql and .hql, but with .sql and .hql. This PR fixes this.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (AIRFLOW-1150) Fix scripts execution in SparkSql hook

2017-04-26 Thread Giovanni Lanzani (JIRA)
Giovanni Lanzani created AIRFLOW-1150:
-

 Summary: Fix scripts execution in SparkSql hook 
 Key: AIRFLOW-1150
 URL: https://issues.apache.org/jira/browse/AIRFLOW-1150
 Project: Apache Airflow
  Issue Type: Bug
  Components: contrib
Affects Versions: Airflow 1.8
Reporter: Giovanni Lanzani


When using the the SparkSqlOperator and submitting a file (ending with .sql or 
.hql), a whitespace need to be appended, otherwise a Jinja error will be 
raised. However the trailing whitespace confused the hook as those files will 
not end with .sql and .hql, but with .sql and .hql. This PR fixes this.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)