Re: [Pyspark] How to download Zip file from SFTP location and put in into Azure Data Lake and unzip it

2022-01-18 Thread Wes Peng
How large is the file? From my experience, reading the excel file from data lake and loading as dataframe, works great. Thanks On 2022-01-18 22:16, Heta Desai wrote: Hello, I have zip files on SFTP location. I want to download/copy those files and put into Azure Data Lake. Once the zip

[Pyspark] How to download Zip file from SFTP location and put in into Azure Data Lake and unzip it

2022-01-18 Thread Heta Desai
Hello, I have zip files on SFTP location. I want to download/copy those files and put into Azure Data Lake. Once the zip files get stored into Azure Data Lake, I want to unzip those files and read using Data Frames. The file format inside zip is excel. SO, once files are unzipped, I want to