This is a great improvement plan, I have the following thoughts:
1. About the length of Topic, 128 can meet most scenarios. Even if the
storage module supports store long topic data,
I still recommend that the length of this non-system topic‘s
length should not exceed the 128 limit.
For system topics, such as the retry topic name of pop consumption
can increase the upper limit.
2. For the system properties in the message, there should be its own
namespace to distinguish it from the user's properties and protect it
from being modified by the user.
3. Is it necessary to store the server IP in every message? This
design will waste more storage space.
4. The "topic remapping" needs to consider the compatibility with the
existing design, It is recommended to discuss it as another
improvement.
5. We should consider compression and columnar storage in the new
storage format.