That class comes from the Hive codebase where it looks like they have
made liberal use of anonymous inner classes. The Drill build gets
exposed to it because it uses the Maven shade plugin to repackage Hive
and its dependencies. I don't think we can easily change the name of
that class.
On 2023/07/11 16:38, Mike Beckerle wrote:
Should there be a ticket created about this:
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore$drop_partition_by_name_with_environment_context_args$drop_partition_by_name_with_environment_context_argsTupleSchemeFactory.class
The largest part of that path is the file name part which has
"drop_partition_by_name_with_environment_context_args" appearing twice
in the class file name. This appears to be a generated name so we
should be able to shorten it.
On Tue, Jul 11, 2023 at 12:27 AM James Turton <dz...@apache.org> wrote:
Good news and welcome to Drill!
I haven't heard of anyone runing into this problem before, and I
build
Drill under the directory /home/james/Development/apache/drill which
isn't far off of what you tried in terms of length. I do see the
280-character path cited by Maven below though. Perhaps in your
case the
drill-hive-exec-shaded was downloaded from the Apache Snapshots repo,
rather than built locally, and this issue only presents itself if the
maven-dependency-plugin must unpack a very long file path from a
downloaded jar.
On 2023/07/10 18:23, Mike Beckerle wrote:
> Never mind. The file name was > 255 long, so I have installed
the drill
> build tree in /opt and now the path is shorter than 255.
>
>
> On Mon, Jul 10, 2023 at 12:00 PM Mike Beckerle
<mbecke...@apache.org> wrote:
>
>> I'm trying to build the current master branch as of today
2023-07-10.
>>
>> It fails due to a file-name too long issue.
>>
>> The command I issued is just "mvn clean install -DskipTests"
per the
>> instructions.
>>
>> I'm running on Linux, Ubuntu 20.04. Java 8.
>>
>> [INFO] --- maven-dependency-plugin:3.4.0:unpack (unpack) @
>> drill-hive-exec-shaded ---
>> [INFO] Configured Artifact:
>>
org.apache.drill.contrib.storage-hive:drill-hive-exec-shaded:1.22.0-SNAPSHOT:jar
>> [INFO] Unpacking
>>
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/drill-hive-exec-shaded-1.22.0-SNAPSHOT.jar
>> to
>>
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes
>> with includes "**/**" and excludes ""
>> [INFO]
>>
------------------------------------------------------------------------
>> [INFO] Reactor Summary for Drill : 1.22.0-SNAPSHOT:
>> [INFO]
>> [INFO] Drill : ............................................
SUCCESS [
>> 3.974 s]
>> [INFO] Drill : Tools : ....................................
SUCCESS [
>> 0.226 s]
>> [INFO] Drill : Tools : Freemarker codegen .................
SUCCESS [
>> 3.762 s]
>> [INFO] Drill : Protocol ...................................
SUCCESS [
>> 5.001 s]
>> [INFO] Drill : Common .....................................
SUCCESS [
>> 4.944 s]
>> [INFO] Drill : Logical Plan ...............................
SUCCESS [
>> 5.991 s]
>> [INFO] Drill : Exec : .....................................
SUCCESS [
>> 0.210 s]
>> [INFO] Drill : Exec : Memory : ............................
SUCCESS [
>> 0.179 s]
>> [INFO] Drill : Exec : Memory : Base .......................
SUCCESS [
>> 2.373 s]
>> [INFO] Drill : Exec : RPC .................................
SUCCESS [
>> 2.436 s]
>> [INFO] Drill : Exec : Vectors .............................
SUCCESS [
>> 54.917 s]
>> [INFO] Drill : Contrib : ..................................
SUCCESS [
>> 0.138 s]
>> [INFO] Drill : Contrib : Data : ...........................
SUCCESS [
>> 0.143 s]
>> [INFO] Drill : Contrib : Data : TPCH Sample ...............
SUCCESS [
>> 1.473 s]
>> [INFO] Drill : Metastore : ................................
SUCCESS [
>> 0.144 s]
>> [INFO] Drill : Metastore : API ............................
SUCCESS [
>> 4.366 s]
>> [INFO] Drill : Metastore : Iceberg ........................
SUCCESS [
>> 3.940 s]
>> [INFO] Drill : Exec : Java Execution Engine ...............
SUCCESS [01:04
>> min]
>> [INFO] Drill : Exec : JDBC Driver using dependencies ......
SUCCESS [
>> 7.332 s]
>> [INFO] Drill : Exec : JDBC JAR with all dependencies ......
SUCCESS [
>> 16.304 s]
>> [INFO] Drill : On-YARN ....................................
SUCCESS [
>> 5.477 s]
>> [INFO] Drill : Metastore : RDBMS ..........................
SUCCESS [
>> 6.704 s]
>> [INFO] Drill : Metastore : Mongo ..........................
SUCCESS [
>> 3.621 s]
>> [INFO] Drill : Contrib : Storage : Kudu ...................
SUCCESS [
>> 6.693 s]
>> [INFO] Drill : Contrib : Format : XML .....................
SUCCESS [
>> 3.511 s]
>> [INFO] Drill : Contrib : Storage : HTTP ...................
SUCCESS [
>> 5.195 s]
>> [INFO] Drill : Contrib : Storage : OpenTSDB ...............
SUCCESS [
>> 3.561 s]
>> [INFO] Drill : Contrib : Storage : MongoDB ................
SUCCESS [
>> 4.850 s]
>> [INFO] Drill : Contrib : Storage : HBase ..................
SUCCESS [
>> 10.857 s]
>> [INFO] Drill : Contrib : Storage : JDBC ...................
SUCCESS [
>> 4.413 s]
>> [INFO] Drill : Contrib : Storage : Hive : .................
SUCCESS [
>> 0.128 s]
>> [INFO] Drill : Contrib : Storage : Hive : Exec Shaded .....
FAILURE [
>> 19.135 s]
>> [INFO] Drill : Contrib : Storage : Hive : Core ............ SKIPPED
>> [INFO] Drill : Contrib : Storage : Kafka .................. SKIPPED
>> [INFO] Drill : Contrib : Storage : Cassandra .............. SKIPPED
>> [INFO] Drill : Contrib : Storage : ElasticSearch .......... SKIPPED
>> [INFO] Drill : Contrib : Storage : Splunk ................. SKIPPED
>> [INFO] Drill : Contrib : Storage : GoogleSheets ........... SKIPPED
>> [INFO] Drill : Contrib : Storage : Phoenix ................ SKIPPED
>> [INFO] Drill : Contrib : UDFs ............................. SKIPPED
>> [INFO] Drill : Contrib : Format : Syslog .................. SKIPPED
>> [INFO] Drill : Contrib : Format : Httpd/Nginx Access Log .. SKIPPED
>> [INFO] Drill : Contrib : Format : PDF ..................... SKIPPED
>> [INFO] Drill : Contrib : Format : HDF5 .................... SKIPPED
>> [INFO] Drill : Contrib : Format : SPSS .................... SKIPPED
>> [INFO] Drill : Contrib : Format : SAS ..................... SKIPPED
>> [INFO] Drill : Contrib : Format : LTSV .................... SKIPPED
>> [INFO] Drill : Contrib : Format : Image ................... SKIPPED
>> [INFO] Drill : Contrib : Format : Pcap-NG ................. SKIPPED
>> [INFO] Drill : Contrib : Format : Esri .................... SKIPPED
>> [INFO] Drill : Contrib : Format : Excel ................... SKIPPED
>> [INFO] Drill : Contrib : Format : MS Access ............... SKIPPED
>> [INFO] Drill : Contrib : Format : Log Regex ............... SKIPPED
>> [INFO] Drill : Contrib : Storage : Druid .................. SKIPPED
>> [INFO] Drill : Contrib : Format : Iceberg ................. SKIPPED
>> [INFO] Drill : Contrib : Format : Delta Lake .............. SKIPPED
>> [INFO] Drill : Contrib : Storage : Drill .................. SKIPPED
>> [INFO] Drill : Packaging and Distribution Assembly ........ SKIPPED
>> [INFO] Drill : Contrib : Format : MaprDB .................. SKIPPED
>> [INFO]
>>
------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>>
------------------------------------------------------------------------
>> [INFO] Total time: 04:17 min
>> [INFO] Finished at: 2023-07-10T11:50:33-04:00
>> [INFO]
>>
------------------------------------------------------------------------
>> [ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-dependency-plugin:3.4.0:unpack
(unpack) on
>> project drill-hive-exec-shaded: Error unpacking file:
>>
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/drill-hive-exec-shaded-1.22.0-SNAPSHOT.jar
>> to:
>>
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes:
>> Error while expanding
>>
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/drill-hive-exec-shaded-1.22.0-SNAPSHOT.jar:
>>
/home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore$drop_partition_by_name_with_environment_context_args$drop_partition_by_name_with_environment_context_argsTupleSchemeFactory.class:
>> File name too long -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven
with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug
logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible
solutions,
>> please read the following articles:
>> [ERROR] [Help 1]
>>
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>> [ERROR]
>> [ERROR] After correcting the problems, you can resume the build
with the
>> command
>> [ERROR] mvn <args> -rf :drill-hive-exec-shaded
>> mbeckerle@cat:~/dataiti/opensource/drill$
>>
>>
