Re: csv reader performance with multiline option

2018-08-18 Thread Nicolas Paris
Hi yes, multiline would only use one thread in that case. The csv parser used by spark is uniVocity Le 18 août 2018 à 18:07, Nirav Patel écrivait : > does enabling 'multiLine' option impact performance? how? would it run read > entire file with just one thread? > > Thanks > > > > What's

csv reader performance with multiline option

2018-08-18 Thread Nirav Patel
does enabling 'multiLine' option impact performance? how? would it run read entire file with just one thread? Thanks --