What version of Hive are you using? You should look at the HS2 logs to see if there were any errors from msck command which ignored such partitions. Also, would be worth to take a look at hive.msck.path.validation configuration in case it is set to "ignore" which silently ignores invalidate partitions. If you set it to "throw" then it would probably fail the command explicitly which would help debugging.
On Sun, Dec 30, 2018 at 11:08 PM Colin Williams < colin.williams.seat...@gmail.com> wrote: > Hello, > > I have a parquet datasource that I'm writing via spark. For some > reason this particular source will not pick up added partitions with > msck repair table. However if I alter table tablename / add partition > (key=value) then it works. However this is more cumbersome than msck > repair table. > > Is there an alternative that works like msck repair table that will > pick up the additional partitions? Otherwise I will need to fetch a > list of partition values, and go through the process of sending sql > requests to add each one. >
