[GitHub] [incubator-airflow] sbilinski commented on issue #3914: [AIRFLOW-3069] Log all output of the S3 file transform script

Thu, 04 Oct 2018 05:31:42 -0700 

Thanks for the suggestion @XD-DENG. Here's how it looks: 

#### Before 
<img width="1236" alt="airflow_s3_log_before" 
src="https://user-images.githubusercontent.com/1932463/46473570-ea29a680-c7e0-11e8-860c-383be3846a1b.png";>

#### After
<img width="1243" alt="airflow_s3_log_after" 
src="https://user-images.githubusercontent.com/1932463/46473613-0fb6b000-c7e1-11e8-985f-b97ca72c4971.png";>

Relevant `transform_script` code: 

```
def main(argv):
    ...

    print("Copying {0} to {1}.".format(src, dst))
    shutil.copyfile(src, dst)
    print("Done.")

    sys.stderr.write("I will fail on purpose\nExpected exit code is 42\n")
    sys.exit(42)
```


[ Full content available at: 
https://github.com/apache/incubator-airflow/pull/3914 ]
This message was relayed via gitbox.apache.org for [email protected]

Reply via email to