Hossam-Samin opened a new issue, #45867: URL: https://github.com/apache/airflow/issues/45867
### Description In the past, Airflow's GCS integration included the use of wildcards in source object paths and included the delimiter parameter for object filtering. Nevertheless, GCS did not natively enable these features, which frequently led to misunderstandings or abuse. To address this, the following adjustments have been proposed: - Delimiter parameter deprecation: Because of its non-standard implementation and lack of native GCS support, this parameter is being phased out. - Match_glob Parameter Introduction: A new match_glob parameter will enable native GCS filtering based on pattern matching that is more accurate. ### Use case/motivation Making ensuring Airflow's GCS integration is in line with GCS's inherent capabilities is the main driving force for this modification, which will enhance user experience and dependability. In GCS, the match_glob option will offer a simple, supported, and intuitive method of filtering items, lowering the possibility of mistakes and misunderstandings. ### Related issues In order to enhance Airflow's GCS integration, this PR expands upon Issue #29115. For improved, native pattern-based filtering, it eliminates the perplexing delimiter parameter and substitutes it with a new match_glob option. These modifications simplify and improve the use of GCS integration. ### Are you willing to submit a PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
