[GitHub] spark issue #21164: [SPARK-24098][SQL] ScriptTransformationExec should wait ...

[cxzl25]

Github user cxzl25 commented on the issue:

    https://github.com/apache/spark/pull/21164
  
    @liutang123  cc @cloud-fan @gatorsmile 
    
    I also encountered this problem.
    
    
![image](https://user-images.githubusercontent.com/3898450/40981493-9b0b0d46-690d-11e8-8607-c14756610d59.png)
    python:
    ```python
    import sys
    for line in sys.stdin:
        print 1/0
    ```
    sql:
    ```sql
    ADD FILE test.py;
    SELECT TRANSFORM(1) USING 'python test.py'
    AS (c1)
    ```
    
    I solved it this way:  *writerThread.join()*
    ```java
    if (scriptOutputReader.next(scriptOutputWritable) <= 0) {
        writerThread.join()
        checkFailureAndPropagate()
        return false
    }
    ```



---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org