[ https://issues.apache.org/jira/browse/AIRFLOW-4919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16882087#comment-16882087 ]
Elad commented on AIRFLOW-4919: ------------------------------- PR https://github.com/apache/airflow/pull/5250 changed the dataproc_*_properties to dataproc_properties in master So this will probably require separated PRs for master and for V1.10 branch > Add 'dataproc_properties' parameter to templated fields of > DataProcJobBaseOperator child classes > ------------------------------------------------------------------------------------------------ > > Key: AIRFLOW-4919 > URL: https://issues.apache.org/jira/browse/AIRFLOW-4919 > Project: Apache Airflow > Issue Type: Improvement > Components: contrib, gcp > Affects Versions: 1.9.0, 1.10.3 > Reporter: Adam Kramer > Assignee: Elad > Priority: Major > > Properties in Dataproc jobs have a need for templating in cases of default > values and other labeling properties, such as macro dates. > dataproc_pig_properties in DataProcPigOperator > dataproc_hive_properties in DataProcHiveOperator > dataproc_spark_properties in DataProcSparkSqlOperator > dataproc_hadoop_properties in DataProcHadoopOperator > Additionally, should add generic dataproc_properties to each as > templated_field. > Update py docs to include that it is templated. -- This message was sent by Atlassian JIRA (v7.6.3#76005)