Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2023-12-21 Thread via GitHub
elaye-canopy commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1866255633 @he-gong-sardine did you get a chance to test it? I am encountering a similar issue and was in the process of testing a fix independent of yours (I will also upload it later

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2024-01-02 Thread via GitHub
he-gong-sardine commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1874727938 @elaye-canopy -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2024-01-07 Thread via GitHub
elaye-canopy commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1880016235 @he-gong-sardine Great to see this is worked on, we independently solved it on our side and I put a comment in the code about that. Your solution does seem to work b

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2024-01-07 Thread via GitHub
elaye-canopy commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1880016337 Also, again, not directly related but logically related - perhaps similar logic should be made for the converse operator as well (GCS to SFTP) -- This is an automated messag

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2023-10-17 Thread via GitHub
he-gong-sardine commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1767049095 hi @ferruzzi yesterday in my project I wrote this code and my colleague @rynmccrmck told me I could added the code to Airflow and this PR is his draft for me. I will cr

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2023-10-17 Thread via GitHub
ferruzzi commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1767050419 I'll assign the issue to you then. let me know if you need any help -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2023-10-18 Thread via GitHub
he-gong-sardine commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1768986182 update: I wrote a PR in my own repo: https://github.com/he-gong-sardine/airflow/pull/1/files but I haven't set up airflow environment so I cannot test it. I will send

Re: [I] Enable Streaming from SFTP to GCS in `SFTPToGCSOperator` [airflow]

2023-10-22 Thread via GitHub
Player00liv commented on issue #34995: URL: https://github.com/apache/airflow/issues/34995#issuecomment-1774350113 Vhuut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To