Sean is right. Use another action like saveAsTextfile or write on a parquet file.Happy holidays.ApostolosApostolos N. PapadopoulosAssociate ProfessorSchool of InformaticsAristotle University of Thessaloniki54124 Thessaloniki Greece -------- Αρχικό μήνυμα --------Από: Sean Owen <sro...@gmail.com> Ημερομηνία: 25/12/21 03:49 (GMT+02:00) Προς: bit...@bitfox.top Κοιν.: User <user@spark.apache.org> Θέμα: Re: df.show() to text file You can redirect the stdout of your program I guess but show is for display, not saving data. Use df.write methods for that. On Fri, Dec 24, 2021, 7:02 PM <bit...@bitfox.top> wrote:Hello list,
spark newbie here :0 How can I write the df.show() result to a text file in the system? I run with pyspark, not the python client programming. Thanks. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org