Re: [I] [Bug] Topic partition backlog grows after bookies restart [pulsar]

[via GitHub]

lhotari commented on issue #23908:
URL: https://github.com/apache/pulsar/issues/23908#issuecomment-2631357560

   > still something wrong, on k8s I see such error:
   > 
   > <img alt="Image" width="346" 
src="https://private-user-images.githubusercontent.com/141229367/409126656-e20fbb37-ee22-48a0-bbee-a324983b3484.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzg1OTY3NTcsIm5iZiI6MTczODU5NjQ1NywicGF0aCI6Ii8xNDEyMjkzNjcvNDA5MTI2NjU2LWUyMGZiYjM3LWVlMjItNDhhMC1iYmVlLWEzMjQ5ODNiMzQ4NC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjAzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIwM1QxNTI3MzdaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT05YTc1MjgwZDZjZjI5OWYxODc5MmRlMGY1NDIwZGQ2N2ExZWI1NTdjY2EzNmI5OGZlYWUwNzRmYTA5ZDExNzE3JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.O2oP_VTrCPwHsYw-cjHq1MKIz1KnmNZTou9tnAgNGac";>
   > on my local docker images seems to be linux/amd64
   > 
   > <img alt="Image" width="821" 
src="https://private-user-images.githubusercontent.com/141229367/409126837-f9fde6e4-3392-4a32-b58d-b525ddbcdcb1.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzg1OTY3NTcsIm5iZiI6MTczODU5NjQ1NywicGF0aCI6Ii8xNDEyMjkzNjcvNDA5MTI2ODM3LWY5ZmRlNmU0LTMzOTItNGEzMi1iNThkLWI1MjVkZGJjZGNiMS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjAzJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIwM1QxNTI3MzdaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT05ZjhmYmJiZjRiNDViYzQxMmJlMDgwNGE1ODMzMWMyZDE0OTM2MjBlOWRiOTA4OWY5Y2Y1NTFlYjYzY2Y3YTdkJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.Mvg2e3W0v1IiRfK1TIS-NApdlmc1wy7pvrcxNmB4m5c";>
   
   Did you use these commands to build a multi-platform image?
   
   ```shell
   mvn clean install -DskipTests
   DOCKER_USER=my_docker_user
   mvn install -pl docker/pulsar,docker/pulsar-all \
       -DskipTests \
       -Pmain,docker,docker-push \
       -Ddocker.platforms=linux/amd64,linux/arm64 \
       -Ddocker.organization=$DOCKER_USER \
       -Ddocker.noCache=true
   ```
   
   There are several gotchas in building and handling multi-platform images. 
I'm not exactly sure, but I think that unless you build a multi-platform image 
in one shot and push it directly to a docker repository from the build, you 
might not be able to push it separately with `docker push`. I have struggled 
with this issue in the past. You can use a custom docker repository as well, by 
prefixing the `-Ddocker.organization=` value with the docker repository.
   
   You might not need a multi-platform image in your case, but if you'd like to 
build a similar image as the Pulsar images, it's better to stick to [the same 
set of 
commands](https://pulsar.apache.org/contribute/release-process/#release-pulsar-30-and-later).
 
   
   Another detail is that tagging multi-platform images contains gotchas. In 
Pulsar, we use the `regctl image copy` to achieve tagging directly in the 
repository. 
([examples](https://pulsar.apache.org/contribute/release-process/#release-docker-images)).
 Using `docker tag` locally and then pushing with `docker push` could cause in 
unexpected results with multi-platform images. `regctl` is available at 
https://github.com/regclient/regclient .


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org