Aggarwal-Raghav commented on PR #6608:
URL: https://github.com/apache/hive/pull/6608#issuecomment-5002077413
> > I'm guessing the spark written partition are also contributing to this
issue.
> > Sample repro on cluster without HA service enabled:
> > ```
> > create table bug (id int) partitioned by (country string);
> > alter table bug add partition (country='ABC');
> > desc formatted bug;
-- gave location hdfs://namenode:8020/
> > desc formatted bug partition(country='ABC');
> > alter table bug partition (country='ABC') SET LOCATION
'hdfs://namenode/...../'; -- So removed :8020
> > msck repair table bug;
> > ```
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > NOTE, ensure `hdfs dfs -ls hdfs://namenode/path_to_table/` and
`hdfs://namenode:8020/path_to_table/` both are working in cluster. In localhost
(my local mac setup) it was not working for me **but on VM/cluster it was
repro-ing**
>
> How to normalize the path using `FileUtils.makeQualified` first before
comparing the existing partition?
@dengzhhu653 , that is different problem about parsing and comparing I guess.
The problem is, if I have a partition registerd in HMS already and because
of PATH URI mismatch, it again qualifies for MSCK, it shouldn't throw
exception!!, it should just ignore.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
