Methinks the Hive plugin could probably use some attention. With that said, I don't know how much use it actually gets. Yes... a ticket would probably be in order. Best, -- C
> On Jul 11, 2023, at 10:38 AM, Mike Beckerle <mbecke...@apache.org> wrote: > > Should there be a ticket created about this: > > /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore$drop_partition_by_name_with_environment_context_args$drop_partition_by_name_with_environment_context_argsTupleSchemeFactory.class > > The largest part of that path is the file name part which has > "drop_partition_by_name_with_environment_context_args" appearing twice in > the class file name. This appears to be a generated name so we should be > able to shorten it. > > > On Tue, Jul 11, 2023 at 12:27 AM James Turton <dz...@apache.org> wrote: > >> Good news and welcome to Drill! >> >> I haven't heard of anyone runing into this problem before, and I build >> Drill under the directory /home/james/Development/apache/drill which >> isn't far off of what you tried in terms of length. I do see the >> 280-character path cited by Maven below though. Perhaps in your case the >> drill-hive-exec-shaded was downloaded from the Apache Snapshots repo, >> rather than built locally, and this issue only presents itself if the >> maven-dependency-plugin must unpack a very long file path from a >> downloaded jar. >> >> >> On 2023/07/10 18:23, Mike Beckerle wrote: >>> Never mind. The file name was > 255 long, so I have installed the drill >>> build tree in /opt and now the path is shorter than 255. >>> >>> >>> On Mon, Jul 10, 2023 at 12:00 PM Mike Beckerle <mbecke...@apache.org> >> wrote: >>> >>>> I'm trying to build the current master branch as of today 2023-07-10. >>>> >>>> It fails due to a file-name too long issue. >>>> >>>> The command I issued is just "mvn clean install -DskipTests" per the >>>> instructions. >>>> >>>> I'm running on Linux, Ubuntu 20.04. Java 8. >>>> >>>> [INFO] --- maven-dependency-plugin:3.4.0:unpack (unpack) @ >>>> drill-hive-exec-shaded --- >>>> [INFO] Configured Artifact: >>>> >> org.apache.drill.contrib.storage-hive:drill-hive-exec-shaded:1.22.0-SNAPSHOT:jar >>>> [INFO] Unpacking >>>> >> /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/drill-hive-exec-shaded-1.22.0-SNAPSHOT.jar >>>> to >>>> >> /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes >>>> with includes "**/**" and excludes "" >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Reactor Summary for Drill : 1.22.0-SNAPSHOT: >>>> [INFO] >>>> [INFO] Drill : ............................................ SUCCESS [ >>>> 3.974 s] >>>> [INFO] Drill : Tools : .................................... SUCCESS [ >>>> 0.226 s] >>>> [INFO] Drill : Tools : Freemarker codegen ................. SUCCESS [ >>>> 3.762 s] >>>> [INFO] Drill : Protocol ................................... SUCCESS [ >>>> 5.001 s] >>>> [INFO] Drill : Common ..................................... SUCCESS [ >>>> 4.944 s] >>>> [INFO] Drill : Logical Plan ............................... SUCCESS [ >>>> 5.991 s] >>>> [INFO] Drill : Exec : ..................................... SUCCESS [ >>>> 0.210 s] >>>> [INFO] Drill : Exec : Memory : ............................ SUCCESS [ >>>> 0.179 s] >>>> [INFO] Drill : Exec : Memory : Base ....................... SUCCESS [ >>>> 2.373 s] >>>> [INFO] Drill : Exec : RPC ................................. SUCCESS [ >>>> 2.436 s] >>>> [INFO] Drill : Exec : Vectors ............................. SUCCESS [ >>>> 54.917 s] >>>> [INFO] Drill : Contrib : .................................. SUCCESS [ >>>> 0.138 s] >>>> [INFO] Drill : Contrib : Data : ........................... SUCCESS [ >>>> 0.143 s] >>>> [INFO] Drill : Contrib : Data : TPCH Sample ............... SUCCESS [ >>>> 1.473 s] >>>> [INFO] Drill : Metastore : ................................ SUCCESS [ >>>> 0.144 s] >>>> [INFO] Drill : Metastore : API ............................ SUCCESS [ >>>> 4.366 s] >>>> [INFO] Drill : Metastore : Iceberg ........................ SUCCESS [ >>>> 3.940 s] >>>> [INFO] Drill : Exec : Java Execution Engine ............... SUCCESS >> [01:04 >>>> min] >>>> [INFO] Drill : Exec : JDBC Driver using dependencies ...... SUCCESS [ >>>> 7.332 s] >>>> [INFO] Drill : Exec : JDBC JAR with all dependencies ...... SUCCESS [ >>>> 16.304 s] >>>> [INFO] Drill : On-YARN .................................... SUCCESS [ >>>> 5.477 s] >>>> [INFO] Drill : Metastore : RDBMS .......................... SUCCESS [ >>>> 6.704 s] >>>> [INFO] Drill : Metastore : Mongo .......................... SUCCESS [ >>>> 3.621 s] >>>> [INFO] Drill : Contrib : Storage : Kudu ................... SUCCESS [ >>>> 6.693 s] >>>> [INFO] Drill : Contrib : Format : XML ..................... SUCCESS [ >>>> 3.511 s] >>>> [INFO] Drill : Contrib : Storage : HTTP ................... SUCCESS [ >>>> 5.195 s] >>>> [INFO] Drill : Contrib : Storage : OpenTSDB ............... SUCCESS [ >>>> 3.561 s] >>>> [INFO] Drill : Contrib : Storage : MongoDB ................ SUCCESS [ >>>> 4.850 s] >>>> [INFO] Drill : Contrib : Storage : HBase .................. SUCCESS [ >>>> 10.857 s] >>>> [INFO] Drill : Contrib : Storage : JDBC ................... SUCCESS [ >>>> 4.413 s] >>>> [INFO] Drill : Contrib : Storage : Hive : ................. SUCCESS [ >>>> 0.128 s] >>>> [INFO] Drill : Contrib : Storage : Hive : Exec Shaded ..... FAILURE [ >>>> 19.135 s] >>>> [INFO] Drill : Contrib : Storage : Hive : Core ............ SKIPPED >>>> [INFO] Drill : Contrib : Storage : Kafka .................. SKIPPED >>>> [INFO] Drill : Contrib : Storage : Cassandra .............. SKIPPED >>>> [INFO] Drill : Contrib : Storage : ElasticSearch .......... SKIPPED >>>> [INFO] Drill : Contrib : Storage : Splunk ................. SKIPPED >>>> [INFO] Drill : Contrib : Storage : GoogleSheets ........... SKIPPED >>>> [INFO] Drill : Contrib : Storage : Phoenix ................ SKIPPED >>>> [INFO] Drill : Contrib : UDFs ............................. SKIPPED >>>> [INFO] Drill : Contrib : Format : Syslog .................. SKIPPED >>>> [INFO] Drill : Contrib : Format : Httpd/Nginx Access Log .. SKIPPED >>>> [INFO] Drill : Contrib : Format : PDF ..................... SKIPPED >>>> [INFO] Drill : Contrib : Format : HDF5 .................... SKIPPED >>>> [INFO] Drill : Contrib : Format : SPSS .................... SKIPPED >>>> [INFO] Drill : Contrib : Format : SAS ..................... SKIPPED >>>> [INFO] Drill : Contrib : Format : LTSV .................... SKIPPED >>>> [INFO] Drill : Contrib : Format : Image ................... SKIPPED >>>> [INFO] Drill : Contrib : Format : Pcap-NG ................. SKIPPED >>>> [INFO] Drill : Contrib : Format : Esri .................... SKIPPED >>>> [INFO] Drill : Contrib : Format : Excel ................... SKIPPED >>>> [INFO] Drill : Contrib : Format : MS Access ............... SKIPPED >>>> [INFO] Drill : Contrib : Format : Log Regex ............... SKIPPED >>>> [INFO] Drill : Contrib : Storage : Druid .................. SKIPPED >>>> [INFO] Drill : Contrib : Format : Iceberg ................. SKIPPED >>>> [INFO] Drill : Contrib : Format : Delta Lake .............. SKIPPED >>>> [INFO] Drill : Contrib : Storage : Drill .................. SKIPPED >>>> [INFO] Drill : Packaging and Distribution Assembly ........ SKIPPED >>>> [INFO] Drill : Contrib : Format : MaprDB .................. SKIPPED >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] BUILD FAILURE >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [INFO] Total time: 04:17 min >>>> [INFO] Finished at: 2023-07-10T11:50:33-04:00 >>>> [INFO] >>>> ------------------------------------------------------------------------ >>>> [ERROR] Failed to execute goal >>>> org.apache.maven.plugins:maven-dependency-plugin:3.4.0:unpack (unpack) >> on >>>> project drill-hive-exec-shaded: Error unpacking file: >>>> >> /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/drill-hive-exec-shaded-1.22.0-SNAPSHOT.jar >>>> to: >>>> >> /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes: >>>> Error while expanding >>>> >> /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/drill-hive-exec-shaded-1.22.0-SNAPSHOT.jar: >>>> >> /home/mbeckerle/dataiti/opensource/drill/contrib/storage-hive/hive-exec-shade/target/classes/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore$drop_partition_by_name_with_environment_context_args$drop_partition_by_name_with_environment_context_argsTupleSchemeFactory.class: >>>> File name too long -> [Help 1] >>>> [ERROR] >>>> [ERROR] To see the full stack trace of the errors, re-run Maven with the >>>> -e switch. >>>> [ERROR] Re-run Maven using the -X switch to enable full debug logging. >>>> [ERROR] >>>> [ERROR] For more information about the errors and possible solutions, >>>> please read the following articles: >>>> [ERROR] [Help 1] >>>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >>>> [ERROR] >>>> [ERROR] After correcting the problems, you can resume the build with the >>>> command >>>> [ERROR] mvn <args> -rf :drill-hive-exec-shaded >>>> mbeckerle@cat:~/dataiti/opensource/drill$ >>>> >>>> >> >>
