roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-595422689
> CI fails with the following:
>
> ```
>
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-595347845
> Good job!
> I am working with Spark on Kubernetes as well, this will allow us to adopt
Airflow for scheduling our Spark apps,
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-595244604
thank you @kaxil I fixed all the stuff according to your last review :)
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-595108351
> Hello,
>
> your pull request seems very interesting. Currently, I am using Airflow
and Spark Operator on Kubernetes
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-592021693
@kaxil and @ashb I added test and fixed the things from your last review and
you check again?
Thanks
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-592021378
@kaxil and @ashb I added test and fixed the things from your last review and
you check again?
Thanks
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-579006913
@mik-laj can you make another review? :) I fixed the connection according to
your recommendations
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-578556340
@mik-laj can you review again, please? I added now new Kubernetes connection.
and thank you for your review and comments I learn
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-578542183
> > the spark-on-k8s-operator is being developed by GCP but it's not GCP
service(can run on all Kubernetes flavors, not just GKE)
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-577146596
ping @mik-laj
This is an automated message from the Apache Git
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-574622298
> @roitvt I am busy on the client's project, but I will try to come back
this week.
great thanks!!
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-574569602
@mik-laj can you review again? and share your thoughts
This is an
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-574569284
> Have you tested it with GKE? Should we ensure integration with IAM?
KubernetesPodOperator have support for IAM via
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s
operator/hook/sensor
URL: https://github.com/apache/airflow/pull/7163#issuecomment-574327663
> The `spark-on-k8s-operator` project is maintained by the Google Cloud
Platform and should therefore comply with the GCP
14 matches
Mail list logo
