The problem is caused by the upgrade of cmph library from 2.0 to 2.0.2. I don't know which commit of cmph changed its format.
2019/12/8 3:46, Hieu Hoang: > That's strange, I expected that they would work all versions. Another > problem might be the encoding > > Please let me know what you find > > On Sat, Dec 7, 2019, 9:15 AM Dingyuan Wang <abcdoyle...@gmail.com > <mailto:abcdoyle...@gmail.com>> wrote: > > Dear all, > > After re-compiling moses binaries, moses can't find all Chinese words > (|UNK|UNK|UNK) in the compact phrase tables built by the older binary. > ASCII characters are not affected. If I rebuild the compact table using > the new binaries, it works with the new binary but not the old one. > > The versions are below: > > (GCC 8.2.0) > Moses code version (git tag or commit hash): > mmt-mvp-v0.12.1-11198-g3545225c0-dirty > Libraries used: > Boost version 1.62.0 > Xmlrpc-c version 1.33.14 > CMPH (version unknown) > > (GCC 9.2.1) > Moses code version (git tag or commit hash): > mmt-mvp-v0.12.1-11270-g41b31167f-dirty > Libraries used: > Boost version 1.71.0 > Xmlrpc-c version 1.33.14 > CMPH (version unknown) > > I think the difference should be because of the Boost library. I'll get > the old Boost library for a try. > > _______________________________________________ > Moses-support mailing list > Moses-support@mit.edu <mailto:Moses-support@mit.edu> > http://mailman.mit.edu/mailman/listinfo/moses-support > _______________________________________________ Moses-support mailing list Moses-support@mit.edu http://mailman.mit.edu/mailman/listinfo/moses-support