parthchandra commented on issue #721:
URL:
https://github.com/apache/datafusion-comet/issues/721#issuecomment-2316391612
@andygrove @viirya I'm planning to work on this. Here's what I am proposing
-
The process will follow the same workflow as we currently have with two
additional steps -
1. Build an Uber jar with a select set of native binaries packaged in the
jar
2. Add a deployment management step in maven to deploy the built jars to
Apache maven.
To build the uber jar
1. Create a comet-rm docker image (for comet release manager). The comet-rm
image will be based on Ubuntu 20.04 (TODO: confirm this) because the Spark 3.4
release docker image also uses this image. This base image supports amd64 and
arm64v8 (arm64) architectures which we will use. The comet-rm image will
package all the dependencies to build comet successfully. The entrypoint for
this image will get comet from git and build a linux and macOs native binary
for the architecture.
2. Create a build-release-binaries script. This will -
1. Launch a docker container for both amd64 and arm64 architectures which
will build the binaries for both linux and MacOs. We will end up with four
native libs (in two containers).
2. Copy the built binaries in the containers to the local build
directories in the appropriate subdirectories
3. Run maven package to build the jar locally.
Deployment to maven
This will follow the steps outlined in the official guidance from Apache
Infra https://infra.apache.org/publishing-maven-artifacts.html
We do not plan to use the maven release plugin, but the rest of the
guidance is valid. We simply need to add the deploymentManagement section in
the pom file and document the steps for the release manager to set up their
credentials.
wdyt?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
