ad1happy2go commented on issue #10979: URL: https://github.com/apache/hudi/issues/10979#issuecomment-2044677295
@wkhappy1 The Hudi Table data is in parquet format which is columnar and compressed, so when we read it in rdd the size may be more. In your case it has 1650 columns so that may be the reason 27 GB becoming 503 GB. Are you reading all the columns in the rdd? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
