[PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
amoghrajesh opened a new pull request, #38651: URL: https://github.com/apache/airflow/pull/38651 Right now there is a limitation where the HiveOperator incorrectly parses and constructs the beeline command if hive "high availability" url is given for host. I was able to work

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
amoghrajesh commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1546123813 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -170,6 +178,10 @@ def _prepare_cli_cmd(self) -> list[Any]: if ";" in proxy_user:

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
amoghrajesh commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2029434704 This is how the form looks now: ![image (13)](https://github.com/apache/airflow/assets/35884252/d52ed5c3-ff83-4e57-84d7-8357567fd605) -- This is an automated message from t

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
romsharon98 commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2029518394 Looks good :) Can u just add test with `proxy_user` in `extra_json` just to verify that it add `;` correctly and to verify someone else not remove it. -- This is an automated m

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
amoghrajesh commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2029586589 > Looks good :) Can u just add test with `proxy_user` in `extra_json` just to verify that it add `;` correctly and to verify someone else not remove it. Good catch! Updated th

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
eladkal commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1546303780 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -100,6 +100,9 @@ def __init__( ) -> None: super().__init__() conn = self.get_connection(h

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-01 Thread via GitHub
amoghrajesh commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1547114486 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -100,6 +100,9 @@ def __init__( ) -> None: super().__init__() conn = self.get_connecti

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-02 Thread via GitHub
potiuk commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1547805091 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -186,7 +195,13 @@ def _prepare_cli_cmd(self) -> list[Any]: return [hive_bin, *cmd_extra, *hive_params_li

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-02 Thread via GitHub
amoghrajesh commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1548055690 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -186,7 +195,13 @@ def _prepare_cli_cmd(self) -> list[Any]: return [hive_bin, *cmd_extra, *hive_para

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-02 Thread via GitHub
amoghrajesh commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1548055690 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -186,7 +195,13 @@ def _prepare_cli_cmd(self) -> list[Any]: return [hive_bin, *cmd_extra, *hive_para

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-02 Thread via GitHub
amoghrajesh commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2033657749 @potiuk @eladkal could you review this when you have some time? Or who would be the right person for hive related PRs? -- This is an automated message from the Apache Git Service.

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-03 Thread via GitHub
hussein-awala commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1549113214 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -160,6 +162,9 @@ def _prepare_cli_cmd(self) -> list[Any]: hive_bin = "beeline" s

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-03 Thread via GitHub
hussein-awala commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1549126122 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -100,6 +100,9 @@ def __init__( ) -> None: super().__init__() conn = self.get_connec

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-03 Thread via GitHub
amoghrajesh commented on code in PR #38651: URL: https://github.com/apache/airflow/pull/38651#discussion_r1549306722 ## airflow/providers/apache/hive/hooks/hive.py: ## @@ -160,6 +162,9 @@ def _prepare_cli_cmd(self) -> list[Any]: hive_bin = "beeline" sel

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-03 Thread via GitHub
amoghrajesh commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2034004355 @hussein-awala I have addressed the nits as well, can you take a look if it looks OK now? -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-04 Thread via GitHub
amoghrajesh commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2036692513 @potiuk @eladkal @hussein-awala if all looks good shall we send this one in? -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-04 Thread via GitHub
amoghrajesh merged PR #38651: URL: https://github.com/apache/airflow/pull/38651 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airf

Re: [PR] Adding support to hive hook for high availability Hive installations [airflow]

2024-04-04 Thread via GitHub
amoghrajesh commented on PR #38651: URL: https://github.com/apache/airflow/pull/38651#issuecomment-2037396993 Merging this in favour of the reviews from Hussein and Elad. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use