Maxim Gekk created SPARK-30554:
----------------------------------

             Summary: Return Iterable from FailureSafeParser.rawParser
                 Key: SPARK-30554
                 URL: https://issues.apache.org/jira/browse/SPARK-30554
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.4.4
            Reporter: Maxim Gekk


Currently, rawParser of FailureSafeParser has the signature `IN => 
Seq[InternalRow]` which is strict requirement for underlying rawParser. It 
could return Option, for example like CSV datasource. The ticket aims to 
refactor FailureSafeParser, and change Seq to Iterable. Also. need to modify 
CSV and JSON datasources where FailureSafeParser is used, basically.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to