Yes, I didn't backport its removal because that would amount to dropping
features from the stable branch. I guess the idea would be that 1.21.x,
however long we keep it going, becomes the last series that users who
need these plugins can can still have them in official releases while
continuing to receiving bug fixes...
On 2024/05/27 04:10, Charles Givre wrote:
Hey James,
One more thing, I noticed that for 1.21.2, MapR is still being included
in the build list. (See below). I did a search and couldn't seem to find
where/why this is happening. I did confirm that this isn’t happening on
the current master.
Best,
— C
(base) ➜ apache-drill-1.21.2-src mvn clean install -DskipTests
[INFO] Scanning for projects...
[INFO]
------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO]
------------------------------------------------------------------------
[INFO] os.detected.name: osx
[INFO] os.detected.arch: aarch_64
[INFO] os.detected.version: 14.5
[INFO] os.detected.version.major: 14
[INFO] os.detected.version.minor: 5
[INFO] os.detected.classifier: osx-aarch_64
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Drill :
[pom]
[INFO] Drill : Tools :
[pom]
[INFO] Drill : Tools : Freemarker codegen
[maven-plugin]
[INFO] Drill : Protocol
[jar]
[INFO] Drill : Common
[jar]
[INFO] Drill : Logical Plan
[jar]
[INFO] Drill : Exec :
[pom]
[INFO] Drill : Exec : Memory :
[pom]
[INFO] Drill : Exec : Memory : Base
[jar]
[INFO] Drill : Exec : RPC
[jar]
[INFO] Drill : Exec : Vectors
[jar]
[INFO] Drill : Contrib :
[pom]
[INFO] Drill : Contrib : Data :
[pom]
[INFO] Drill : Contrib : Data : TPCH Sample
[jar]
[INFO] Drill : Metastore :
[pom]
[INFO] Drill : Metastore : API
[jar]
[INFO] Drill : Metastore : Iceberg
[jar]
[INFO] Drill : Exec : Java Execution Engine
[jar]
[INFO] Drill : Exec : JDBC Driver using dependencies
[jar]
[INFO] Drill : Exec : JDBC JAR with all dependencies
[jar]
[INFO] Drill : On-YARN
[jar]
[INFO] Drill : Metastore : RDBMS
[jar]
[INFO] Drill : Metastore : Mongo
[jar]
[INFO] Drill : Contrib : Storage : Kudu
[jar]
[INFO] Drill : Contrib : Format : XML
[jar]
[INFO] Drill : Contrib : Storage : HTTP
[jar]
[INFO] Drill : Contrib : Storage : OpenTSDB
[jar]
[INFO] Drill : Contrib : Storage : MongoDB
[jar]
[INFO] Drill : Contrib : Storage : HBase
[jar]
[INFO] Drill : Contrib : Storage : JDBC
[jar]
[INFO] Drill : Contrib : Storage : Hive :
[pom]
[INFO] Drill : Contrib : Storage : Hive : Exec Shaded
[jar]
[INFO] Drill : Contrib : Storage : Hive : Core
[jar]
[INFO] Drill : Contrib : Storage : Kafka
[jar]
[INFO] Drill : Contrib : Storage : Cassandra
[jar]
[INFO] Drill : Contrib : Storage : ElasticSearch
[jar]
[INFO] Drill : Contrib : Storage : Splunk
[jar]
[INFO] Drill : Contrib : Storage : GoogleSheets
[jar]
[INFO] Drill : Contrib : Storage : Phoenix
[jar]
[INFO] Drill : Contrib : UDFs
[jar]
[INFO] Drill : Contrib : Format : Syslog
[jar]
[INFO] Drill : Contrib : Format : Httpd/Nginx Access Log
[jar]
[INFO] Drill : Contrib : Format : PDF
[jar]
[INFO] Drill : Contrib : Format : HDF5
[jar]
[INFO] Drill : Contrib : Format : SPSS
[jar]
[INFO] Drill : Contrib : Format : SAS
[jar]
[INFO] Drill : Contrib : Format : LTSV
[jar]
[INFO] Drill : Contrib : Format : Image
[jar]
[INFO] Drill : Contrib : Format : Pcap-NG
[jar]
[INFO] Drill : Contrib : Format : Esri
[jar]
[INFO] Drill : Contrib : Format : Excel
[jar]
[INFO] Drill : Contrib : Format : MS Access
[jar]
[INFO] Drill : Contrib : Format : Log Regex
[jar]
[INFO] Drill : Contrib : Storage : Druid
[jar]
[INFO] Drill : Contrib : Format : Iceberg
[jar]
[INFO] Drill : Contrib : Format : Delta Lake
[jar]
[INFO] Drill : Contrib : Storage : Drill
[jar]
[INFO] Drill : Packaging and Distribution Assembly
[pom]
[INFO] Drill : Contrib : Format : MaprDB
[jar]
On May 24, 2024, at 11:01 AM, Charles Givre <cgi...@gmail.com> wrote:
No go unfortunately. I deleted the mapr cache in my ~/.m2 directory.
Same error. I’m using maven version 3.9.6.
Any other suggestions?
Best,
— C
On May 23, 2024, at 11:53 PM, James Turton <dz...@apache.org> wrote:
Interesting. I didn't want to drop a feature from the stable branch
so the MapR stuff is still in 1.21, while gone from master. To try to
reproduce the problem I ran rm -rf
~/.local/share/m2/repository/com/mapr locally but could still build
Drill, and the CI also didn't have any trouble[2].
I can see that the 107d... digest is returned in an HTTP ETag header
for the mapr-release artifact by repository.mapr.com, but also that
the digest 6cfb... is stored as mapr-release-6.1.0-mapr.pom.sha1 in
the MapR repo[1]. I can only guess that your local build is comparing
two incompatible digests for some reason so
* did you build in an IDE that might have some Maven configuration
of its own and
* have you tried an equivalent of rm -rf
~/.local/share/m2/repository/com/mapr; mvn install -DskipTests?
1.
https://repository.mapr.com/nexus/content/groups/mapr-public/com/mapr/mapr-release/6.1.0-mapr/
2. https://github.com/apache/drill/actions/runs/9132581568
On 2024/05/23 15:38, Charles Givre wrote:
Hi James,
Upon further research, it would seem that we already did this in
DRILL-8454. Was this included in RC1?
Best,
— C
<2825.png>
DRILL-8454: Disable unsupported MapR profile and plugin by jnturton
· Pull Request #2825 · apache/drill
<https://github.com/apache/drill/pull/2825>
github.com <https://github.com/apache/drill/pull/2825>
<https://github.com/apache/drill/pull/2825>
On May 23, 2024, at 9:23 AM, Charles Givre <cgi...@gmail.com> wrote:
Hi James,
I attempted to build RC1 from source and ran into an error:
[ERROR] Failed to execute goal on project drill-format-mapr: Could
not resolve dependencies for project
org.apache.drill.contrib:drill-format-mapr:jar:1.21.2: Failed to
collect dependencies at com.mapr.hadoop:maprfs:jar:6.1.0-mapr:
Failed to read artifact descriptor for
com.mapr.hadoop:maprfs:jar:6.1.0-mapr: The following artifacts
could not be resolved: com.mapr:mapr-release:pom:6.1.0-mapr
(absent): Could not transfer artifact
com.mapr:mapr-release:pom:6.1.0-mapr from/to mapr-releases
(https://repository.mapr.com/maven/): Checksum validation failed,
expected '107daa44a0b4a2c6dc1c28aa3546f288487def66'
(REMOTE_INCLUDED) but is actually
'6cfb3d48635ec74fcdf36c35c4bb945fd32cf3a8' -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven
with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible
solutions, please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build
with the command
[ERROR] mvn <args> -rf :drill-format-mapr
I don’t really know the cause of this, but I’m guessing that it
can’t find some MapR dependency. I think there’s a point where we
might want to remove the MapR code from the contrib folder. What
do you think?
Best,
— C
On May 19, 2024, at 5:42 AM, James Turton <dz...@apache.org> wrote:
Tested
* web UI
* htpasswd authn
* JDBC over SSL
* JSON query
* Parquet query
* sys.version query
* PostgreSQL query.
Vote: +1.
On 2024/05/17 20:22, James Turton wrote:
Hi all
I'd like to propose the second release candidate (RC1) of Apache
Drill, version 1.21.2.
The release candidate covers a total of 44 resolved Jira issues
[1]. Thanks to everyone who contributed to this release.
The tarball artefacts are hosted at [2] and the Maven artefacts
are hosted at [3].
This release candidate is based on
6b6a90fb6a03576d8d2b6a1858f72fb01b86d877 located at [4].
CI runs for the release candidate are viewable at [5].
[ ] +1
[ ] +0
[ ] -1
[1]
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12313820&version=12353550
[2] https://dist.apache.org/repos/dist/dev/drill/1.21.2-rc1/
[3]
https://repository.apache.org/content/repositories/orgapachedrill-1109/
[4] https://github.com/jnturton/drill/commits/drill-1.21.2
[5] https://github.com/apache/drill/actions/runs/9132581568
