You could create a clean "build box"? I just created an new VM in GCP,
downloaded apache-drill-1.21.2-src.tar.gz, built it and then ran it this
way. The MapR artifacts were pulled without trouble.
Something related to checksum verification is whacky in your local Maven
config but I'm out of ideas for tracking that down and I think we can
resolve that independently of the RC...
On 2024/06/06 19:57, Charles Givre wrote:
Hey James,
How’s it going? I may have lost the email, but what are next steps for this.
In its current state, I’d have to vote -1 because I can’t build it.
However, I did try the workaround of setting the checksum to `warn` and was
able to build Drill from source. How would you like to proceed?
Best,
— C
On May 27, 2024, at 2:18 AM, James Turton <dz...@apache.org> wrote:
Yes, I didn't backport its removal because that would amount to dropping
features from the stable branch. I guess the idea would be that 1.21.x, however
long we keep it going, becomes the last series that users who need these
plugins can can still have them in official releases while continuing to
receiving bug fixes...
On 2024/05/27 04:10, Charles Givre wrote:
Hey James,
One more thing, I noticed that for 1.21.2, MapR is still being included in the
build list. (See below). I did a search and couldn't seem to find where/why
this is happening. I did confirm that this isn’t happening on the current
master.
Best,
— C
(base) ➜ apache-drill-1.21.2-src mvn clean install -DskipTests
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: osx
[INFO] os.detected.arch: aarch_64
[INFO] os.detected.version: 14.5
[INFO] os.detected.version.major: 14
[INFO] os.detected.version.minor: 5
[INFO] os.detected.classifier: osx-aarch_64
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Drill : [pom]
[INFO] Drill : Tools : [pom]
[INFO] Drill : Tools : Freemarker codegen [maven-plugin]
[INFO] Drill : Protocol [jar]
[INFO] Drill : Common [jar]
[INFO] Drill : Logical Plan [jar]
[INFO] Drill : Exec : [pom]
[INFO] Drill : Exec : Memory : [pom]
[INFO] Drill : Exec : Memory : Base [jar]
[INFO] Drill : Exec : RPC [jar]
[INFO] Drill : Exec : Vectors [jar]
[INFO] Drill : Contrib : [pom]
[INFO] Drill : Contrib : Data : [pom]
[INFO] Drill : Contrib : Data : TPCH Sample [jar]
[INFO] Drill : Metastore : [pom]
[INFO] Drill : Metastore : API [jar]
[INFO] Drill : Metastore : Iceberg [jar]
[INFO] Drill : Exec : Java Execution Engine [jar]
[INFO] Drill : Exec : JDBC Driver using dependencies [jar]
[INFO] Drill : Exec : JDBC JAR with all dependencies [jar]
[INFO] Drill : On-YARN [jar]
[INFO] Drill : Metastore : RDBMS [jar]
[INFO] Drill : Metastore : Mongo [jar]
[INFO] Drill : Contrib : Storage : Kudu [jar]
[INFO] Drill : Contrib : Format : XML [jar]
[INFO] Drill : Contrib : Storage : HTTP [jar]
[INFO] Drill : Contrib : Storage : OpenTSDB [jar]
[INFO] Drill : Contrib : Storage : MongoDB [jar]
[INFO] Drill : Contrib : Storage : HBase [jar]
[INFO] Drill : Contrib : Storage : JDBC [jar]
[INFO] Drill : Contrib : Storage : Hive : [pom]
[INFO] Drill : Contrib : Storage : Hive : Exec Shaded [jar]
[INFO] Drill : Contrib : Storage : Hive : Core [jar]
[INFO] Drill : Contrib : Storage : Kafka [jar]
[INFO] Drill : Contrib : Storage : Cassandra [jar]
[INFO] Drill : Contrib : Storage : ElasticSearch [jar]
[INFO] Drill : Contrib : Storage : Splunk [jar]
[INFO] Drill : Contrib : Storage : GoogleSheets [jar]
[INFO] Drill : Contrib : Storage : Phoenix [jar]
[INFO] Drill : Contrib : UDFs [jar]
[INFO] Drill : Contrib : Format : Syslog [jar]
[INFO] Drill : Contrib : Format : Httpd/Nginx Access Log [jar]
[INFO] Drill : Contrib : Format : PDF [jar]
[INFO] Drill : Contrib : Format : HDF5 [jar]
[INFO] Drill : Contrib : Format : SPSS [jar]
[INFO] Drill : Contrib : Format : SAS [jar]
[INFO] Drill : Contrib : Format : LTSV [jar]
[INFO] Drill : Contrib : Format : Image [jar]
[INFO] Drill : Contrib : Format : Pcap-NG [jar]
[INFO] Drill : Contrib : Format : Esri [jar]
[INFO] Drill : Contrib : Format : Excel [jar]
[INFO] Drill : Contrib : Format : MS Access [jar]
[INFO] Drill : Contrib : Format : Log Regex [jar]
[INFO] Drill : Contrib : Storage : Druid [jar]
[INFO] Drill : Contrib : Format : Iceberg [jar]
[INFO] Drill : Contrib : Format : Delta Lake [jar]
[INFO] Drill : Contrib : Storage : Drill [jar]
[INFO] Drill : Packaging and Distribution Assembly [pom]
[INFO] Drill : Contrib : Format : MaprDB [jar]
On May 24, 2024, at 11:01 AM, Charles Givre <cgi...@gmail.com> wrote:
No go unfortunately. I deleted the mapr cache in my ~/.m2 directory. Same
error. I’m using maven version 3.9.6.
Any other suggestions?
Best,
— C
On May 23, 2024, at 11:53 PM, James Turton <dz...@apache.org> wrote:
Interesting. I didn't want to drop a feature from the stable branch so the MapR
stuff is still in 1.21, while gone from master. To try to reproduce the problem
I ran rm -rf ~/.local/share/m2/repository/com/mapr locally but could still
build Drill, and the CI also didn't have any trouble[2].
I can see that the 107d... digest is returned in an HTTP ETag header for the
mapr-release artifact by repository.mapr.com, but also that the digest 6cfb...
is stored as mapr-release-6.1.0-mapr.pom.sha1 in the MapR repo[1]. I can only
guess that your local build is comparing two incompatible digests for some
reason so
* did you build in an IDE that might have some Maven configuration
of its own and
* have you tried an equivalent of rm -rf
~/.local/share/m2/repository/com/mapr; mvn install -DskipTests?
1.
https://repository.mapr.com/nexus/content/groups/mapr-public/com/mapr/mapr-release/6.1.0-mapr/
2. https://github.com/apache/drill/actions/runs/9132581568
On 2024/05/23 15:38, Charles Givre wrote:
Hi James,
Upon further research, it would seem that we already did this in DRILL-8454.
Was this included in RC1?
Best,
— C
<2825.png>
DRILL-8454: Disable unsupported MapR profile and plugin by jnturton · Pull Request
#2825 · apache/drill <https://github.com/apache/drill/pull/2825>
github.com <http://github.com/> <https://github.com/apache/drill/pull/2825>
<https://github.com/apache/drill/pull/2825>
On May 23, 2024, at 9:23 AM, Charles Givre <cgi...@gmail.com> wrote:
Hi James,
I attempted to build RC1 from source and ran into an error:
[ERROR] Failed to execute goal on project drill-format-mapr: Could not resolve
dependencies for project org.apache.drill.contrib:drill-format-mapr:jar:1.21.2:
Failed to collect dependencies at com.mapr.hadoop:maprfs:jar:6.1.0-mapr: Failed to
read artifact descriptor for com.mapr.hadoop:maprfs:jar:6.1.0-mapr: The following
artifacts could not be resolved: com.mapr:mapr-release:pom:6.1.0-mapr (absent):
Could not transfer artifact com.mapr:mapr-release:pom:6.1.0-mapr from/to
mapr-releases (https://repository.mapr.com/maven/): Checksum validation failed,
expected '107daa44a0b4a2c6dc1c28aa3546f288487def66' (REMOTE_INCLUDED) but is
actually '6cfb3d48635ec74fcdf36c35c4bb945fd32cf3a8' -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :drill-format-mapr
I don’t really know the cause of this, but I’m guessing that it can’t find some
MapR dependency. I think there’s a point where we might want to remove the
MapR code from the contrib folder. What do you think?
Best,
— C
On May 19, 2024, at 5:42 AM, James Turton <dz...@apache.org> wrote:
Tested
* web UI
* htpasswd authn
* JDBC over SSL
* JSON query
* Parquet query
* sys.version query
* PostgreSQL query.
Vote: +1.
On 2024/05/17 20:22, James Turton wrote:
Hi all
I'd like to propose the second release candidate (RC1) of Apache Drill, version
1.21.2.
The release candidate covers a total of 44 resolved Jira issues [1]. Thanks to
everyone who contributed to this release.
The tarball artefacts are hosted at [2] and the Maven artefacts are hosted at
[3].
This release candidate is based on 6b6a90fb6a03576d8d2b6a1858f72fb01b86d877
located at [4].
CI runs for the release candidate are viewable at [5].
[ ] +1
[ ] +0
[ ] -1
[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12353550
[2] https://dist.apache.org/repos/dist/dev/drill/1.21.2-rc1/
[3] https://repository.apache.org/content/repositories/orgapachedrill-1109/
[4] https://github.com/jnturton/drill/commits/drill-1.21.2
[5] https://github.com/apache/drill/actions/runs/9132581568
