[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-11-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18304 @danielvdende now the newlines are automatically derected. should be not an issue anymore. --- - To unsubscribe, e-mail:

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-10-07 Thread SAKSHIC
Github user SAKSHIC commented on the issue: https://github.com/apache/spark/pull/18304 custom record delimiter to read the file by setting the parameter (textinputformat.record.delimeter) is working. How to set the custom record delimiter for writing the file? ---

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18304 Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-27 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18304 Ping, @danielvdende . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-17 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18304 Thank you so much for the new decision, @HyukjinKwon and @danielvdende ! --- - To unsubscribe, e-mail:

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-17 Thread danielvdende
Github user danielvdende commented on the issue: https://github.com/apache/spark/pull/18304 Sounds good to me :+1: @HyukjinKwon --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-16 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18304 CSV's `lineSep` is not added yet. The problem here is specific to CSV - we are os-dependent on the newline separator by Univocity's which is not the case in Jackson and which can be worked

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18304 Gentle ping. If the issue is resolved, please close this PR, @cse68197 . --- - To unsubscribe, e-mail:

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-09-11 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/18304 Is this still valid, @cse68197 and @HyukjinKwon ? #18581 is superceded by #20727 . And #20727 seems to be merged. Are we waiting for the others? ---

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18304 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-05-24 Thread cse68197
Github user cse68197 commented on the issue: https://github.com/apache/spark/pull/18304 I am writing data to a file like below- allDF.rdd.map(rec => rec.mkString("|")).repartition(1).saveAsTextFile("location for file") but when I opening that file in notepad, that is

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-05-24 Thread cse68197
Github user cse68197 commented on the issue: https://github.com/apache/spark/pull/18304 Could you please validate that is this has been fixed? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2018-01-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18304 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2017-12-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18304 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2017-07-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18304 Would you mind if I ask to wait the resolution of `https://github.com/apache/spark/pull/18581` ? Strictly, they are orthogonal as that PR tries to not change the default line separator but I

[GitHub] spark issue #18304: [SPARK-21098] Set lineseparator csv multiline and csv wr...

2017-06-26 Thread danielvdende
Github user danielvdende commented on the issue: https://github.com/apache/spark/pull/18304 @HyukjinKwon any further update on this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this