xushiyan commented on issue #3191: URL: https://github.com/apache/hudi/issues/3191#issuecomment-950416601
@xer001 `PARTITIONING_COLUMNS_KEY` is **not** added in spark 2.4.0 see https://jar-download.com/artifacts/org.apache.spark/spark-sql_2.11/2.4.0/source-code/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala It was added in 2.4.2 and later Can you please upgrade your spark to newer versions of `2.4.x` ? @mdz-doit `PARTITIONING_COLUMNS_KEY` **is** there in 2.4.5 see https://jar-download.com/artifacts/org.apache.spark/spark-sql_2.11/2.4.5/source-code/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala Can you print your spark version from spark shell to make sure you have the right one? Or do you have other dependencies on your classpath? you can print the whole path to inspect. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
