[PR] [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs [spark]

2024-01-19 Thread via GitHub
yaooqinn opened a new pull request, #44799: URL: https://github.com/apache/spark/pull/44799 ### What changes were proposed in this pull request? According to [DeprecatedProperties](https://hadoop.apache.org/docs/r3.3.6/hadoop-project-dist/hadoop-common/DeprecatedProper

Re: [PR] [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs [spark]

2024-01-19 Thread via GitHub
dongjoon-hyun commented on code in PR #44799: URL: https://github.com/apache/spark/pull/44799#discussion_r1458816320 ## connector/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala: ## @@ -29,14 +29,14 @@ import org.apache.avro.mapreduce.AvroJob import org.apache.had

Re: [PR] [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs [spark]

2024-01-19 Thread via GitHub
yaooqinn commented on code in PR #44799: URL: https://github.com/apache/spark/pull/44799#discussion_r1458830805 ## connector/avro/src/main/scala/org/apache/spark/sql/avro/AvroUtils.scala: ## @@ -29,14 +29,14 @@ import org.apache.avro.mapreduce.AvroJob import org.apache.hadoop.c

Re: [PR] [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs [spark]

2024-01-19 Thread via GitHub
dongjoon-hyun closed pull request #44799: [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs URL: https://github.com/apache/spark/pull/44799 -- This is an automated message from the Apache Git Service. To re

Re: [PR] [SPARK-46774][SQL][AVRO] Use mapreduce.output.fileoutputformat.compress instead of deprecated mapred.output.compress in Avro write jobs [spark]

2024-01-21 Thread via GitHub
yaooqinn commented on PR #44799: URL: https://github.com/apache/spark/pull/44799#issuecomment-1902865243 Thank you @dongjoon-hyun @beliefer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp