be if there is a parquet concat tool around. I
couldn't see one. I understand that this tool would have to adjust the
footer.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-files-are-only-6-20MB-in-size-tp17935.html
Sent from the Apache Spark
:
http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-files-are-only-6-20MB-in-size-tp17935p17941.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
loose chronological order?
I really just want the csv -- parquet format in the same order it came in.
If I set repartition with 1 will this not be random?
cheers,
Ag
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-files-are-only-6-20MB
David, that's exactly what I was after :) Awesome, thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-files-are-only-6-20MB-in-size-tp17935p18002.html
Sent from the Apache Spark User List mailing list archive at Nabble.com
appreciated.
cheers,
Ag
PS Another solution may be if there is a parquet concat tool around. I
couldn't see one. I understand that this tool would have to adjust the
footer.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Parquet-files-are-only-6-20MB
