Varun Patil created ARROW-8418:
----------------------------------

             Summary: [Python] partition_filename_cb in write_to_dataset should 
be passed additional keyword arguments rather than just keys
                 Key: ARROW-8418
                 URL: https://issues.apache.org/jira/browse/ARROW-8418
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
            Reporter: Varun Patil


I recently had a requirement where I would have liked to construct a filename 
based on additional context from Apache Airflow (specifically execution_date).

It would be nice to pass the additional kwargs to *partition_filename_cb* so 
that the filename can be constructed using additional information rather than 
just the keys used for partitioning.

I believe the fix should be as simple as passing kwargs to the 
*partition_filename_cb* inside *write_to_dataset.*



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to