parthchandra commented on issue #721: URL: https://github.com/apache/datafusion-comet/issues/721#issuecomment-2316391612
@andygrove @viirya I'm planning to work on this. Here's what I am proposing - The process will follow the same workflow as we currently have with two additional steps - 1. Build an Uber jar with a select set of native binaries packaged in the jar 2. Add a deployment management step in maven to deploy the built jars to Apache maven. To build the uber jar 1. Create a comet-rm docker image (for comet release manager). The comet-rm image will be based on Ubuntu 20.04 (TODO: confirm this) because the Spark 3.4 release docker image also uses this image. This base image supports amd64 and arm64v8 (arm64) architectures which we will use. The comet-rm image will package all the dependencies to build comet successfully. The entrypoint for this image will get comet from git and build a linux and macOs native binary for the architecture. 2. Create a build-release-binaries script. This will - 1. Launch a docker container for both amd64 and arm64 architectures which will build the binaries for both linux and MacOs. We will end up with four native libs (in two containers). 2. Copy the built binaries in the containers to the local build directories in the appropriate subdirectories 3. Run maven package to build the jar locally. Deployment to maven This will follow the steps outlined in the official guidance from Apache Infra https://infra.apache.org/publishing-maven-artifacts.html We do not plan to use the maven release plugin, but the rest of the guidance is valid. We simply need to add the deploymentManagement section in the pom file and document the steps for the release manager to set up their credentials. wdyt? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org