回复:Re: Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true

2020-12-18 Thread
ot;, "false"), ("hive.metastore.server.max.threads", "10"), ("hive.metastore.authorization.storage.checks", "/apps/hive/warehouse") ("hive.stats.autogather", "true") ] spark.sparkContext._conf.setAll(settings) go

Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true

2020-12-17 Thread
`spark.sql.statistics.size.autoUpdate.enabled` is only work for table stats update.But for partition stats,I can only update it with `ANALYZE TABLE tablename PARTITION(part) COMPUTE STATISTICS`.So is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true?