[
https://issues.apache.org/jira/browse/SPARK-34717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean R. Owen resolved SPARK-34717.
----------------------------------
Resolution: Not A Problem
This isn't related to Spark's software. You have extraneous files in your
workspace that the license checker is trying to check and doesn't understand.
> run-tests fails on AArch64, Fedora 33
> --------------------------------------
>
> Key: SPARK-34717
> URL: https://issues.apache.org/jira/browse/SPARK-34717
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 3.1.1
> Reporter: Lutz Weischer
> Priority: Major
>
> [jw@cn06 spark]$ ./dev/run-tests
> +++ dirname /home/jw/apache/spark/R/install-dev.sh
> ++ cd /home/jw/apache/spark/R
> ++ pwd
> + FWDIR=/home/jw/apache/spark/R
> + LIB_DIR=/home/jw/apache/spark/R/lib
> + mkdir -p /home/jw/apache/spark/R/lib
> + pushd /home/jw/apache/spark/R
> + . /home/jw/apache/spark/R/find-r.sh
> ++ '[' -z '' ']'
> ++ '[' '!' -z '' ']'
> +++ command -v R
> ++ '[' '!' /usr/bin/R ']'
> ++++ which R
> +++ dirname /usr/bin/R
> ++ R_SCRIPT_PATH=/usr/bin
> ++ echo 'Using R_SCRIPT_PATH = /usr/bin'
> Using R_SCRIPT_PATH = /usr/bin
> + . /home/jw/apache/spark/R/create-rd.sh
> ++ set -o pipefail
> ++ set -e
> ++++ dirname /home/jw/apache/spark/R/create-rd.sh
> +++ cd /home/jw/apache/spark/R
> +++ pwd
> ++ FWDIR=/home/jw/apache/spark/R
> ++ pushd /home/jw/apache/spark/R
> ++ . /home/jw/apache/spark/R/find-r.sh
> +++ '[' -z /usr/bin ']'
> ++ /usr/bin/Rscript -e ' if(requireNamespace("devtools", quietly=TRUE)) {
> setwd("/home/jw/apache/spark/R"); devtools::document(pkg="./pkg",
> roclets="rd") }'
> + /usr/bin/R CMD INSTALL --library=/home/jw/apache/spark/R/lib
> /home/jw/apache/spark/R/pkg/
> * installing *source* package 'SparkR' ...
> ** using staged installation
> ** R
> ** inst
> ** byte-compile and prepare package for lazy loading
> Creating a new generic function for 'as.data.frame' in package 'SparkR'
> Creating a new generic function for 'colnames' in package 'SparkR'
> Creating a new generic function for 'colnames<-' in package 'SparkR'
> Creating a new generic function for 'cov' in package 'SparkR'
> Creating a new generic function for 'drop' in package 'SparkR'
> Creating a new generic function for 'na.omit' in package 'SparkR'
> Creating a new generic function for 'filter' in package 'SparkR'
> Creating a new generic function for 'intersect' in package 'SparkR'
> Creating a new generic function for 'sample' in package 'SparkR'
> Creating a new generic function for 'transform' in package 'SparkR'
> Creating a new generic function for 'subset' in package 'SparkR'
> Creating a new generic function for 'summary' in package 'SparkR'
> Creating a new generic function for 'union' in package 'SparkR'
> Creating a new generic function for 'endsWith' in package 'SparkR'
> Creating a new generic function for 'startsWith' in package 'SparkR'
> Creating a new generic function for 'lag' in package 'SparkR'
> Creating a new generic function for 'rank' in package 'SparkR'
> Creating a new generic function for 'sd' in package 'SparkR'
> Creating a new generic function for 'var' in package 'SparkR'
> Creating a new generic function for 'window' in package 'SparkR'
> Creating a new generic function for 'predict' in package 'SparkR'
> Creating a new generic function for 'rbind' in package 'SparkR'
> Creating a generic function for 'substr' from package 'base' in package
> 'SparkR'
> Creating a generic function for '%in%' from package 'base' in package 'SparkR'
> Creating a generic function for 'lapply' from package 'base' in package
> 'SparkR'
> Creating a generic function for 'Filter' from package 'base' in package
> 'SparkR'
> Creating a generic function for 'nrow' from package 'base' in package 'SparkR'
> Creating a generic function for 'ncol' from package 'base' in package 'SparkR'
> Creating a generic function for 'factorial' from package 'base' in package
> 'SparkR'
> Creating a generic function for 'atan2' from package 'base' in package
> 'SparkR'
> Creating a generic function for 'ifelse' from package 'base' in package
> 'SparkR'
> ** help
> No man pages found in package 'SparkR'
> *** installing help indices
> ** building package indices
> ** installing vignettes
> ** testing if installed package can be loaded from temporary location
> ** testing if installed package can be loaded from final location
> ** testing if installed package keeps a record of temporary installation path
> * DONE (SparkR)
> + cd /home/jw/apache/spark/R/lib
> + jar cfM /home/jw/apache/spark/R/lib/sparkr.zip SparkR
> + popd
> [info] Using build tool sbt with Hadoop profile hadoop3.2 and Hive profile
> hive2.3 under environment local
> [info] Found the following changed modules: root
> [info] Setup the following environment variables for tests:
> ========================================================================
> Running Apache RAT checks
> ========================================================================
> Attempting to fetch rat
> Could not find Apache license headers in the following files:
> !????? /home/jw/apache/spark/R/lib/SparkR/Meta/Rd.rds
> !????? /home/jw/apache/spark/R/lib/SparkR/Meta/features.rds
> !????? /home/jw/apache/spark/R/lib/SparkR/Meta/hsearch.rds
> !????? /home/jw/apache/spark/R/lib/SparkR/Meta/links.rds
> !????? /home/jw/apache/spark/R/lib/SparkR/Meta/nsInfo.rds
> !????? /home/jw/apache/spark/R/lib/SparkR/Meta/package.rds
> !????? /home/jw/apache/spark/R/lib/SparkR/R/SparkR.rdb
> !????? /home/jw/apache/spark/R/lib/SparkR/R/SparkR.rdx
> !????? /home/jw/apache/spark/core/src/test/resources/keystore
> !????? /home/jw/apache/spark/core/src/test/resources/untrusted-keystore
> !????? /home/jw/apache/spark/examples/src/main/resources/users.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/before_1582_date_v2_4_5.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/before_1582_date_v2_4_6.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_micros_v2_4_5.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_micros_v2_4_6.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_millis_v2_4_5.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_millis_v2_4_6.avro
> !????? /home/jw/apache/spark/external/avro/src/test/resources/episodes.avro
> !????? /home/jw/apache/spark/external/avro/src/test/resources/test.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00000.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00001.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00002.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00003.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00004.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00005.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00006.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00007.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00008.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00009.avro
> !?????
> /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00010.avro
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/dtc-2.4.7/data/.part-00000-bd7ae42f-c890-406c-894c-ca4eac67c690-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/dtr-2.4.7/data/.part-00000-39b027f0-a437-4b3d-84af-d861adcb9ca8-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtc-2.4.7/data/.part-00000-dacbde64-c861-41c7-91c0-6da8cc01fb43-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata/.part-00000-81137d9f-31e3-4a90-813c-ddc394101e21-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtr-2.4.7/data/.part-00000-3b5433ff-d346-4511-9aab-639288bfae6d-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata/.part-00000-6b9124f5-87fe-4fd8-ad9c-4be239c2215a-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/mlp-2.4.4/data/.part-00000-fa18aaf6-d8df-4b90-8231-eb5f6ac12138-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/rfc-2.4.7/data/.part-00000-e41a7b98-91f8-4485-b112-25b4b11c9009-c000.snappy.parquet.crc
> !?????
> /home/jw/apache/spark/mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata/.part-00000-21082d24-b666-4c4e-a823-70c7afdcbdc5-c000.snappy.parquet.crc
> !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/rfr-2.4.
> ?????????? ????
> ?????????? "$&(*,.024????
> ????????????o????????? Space Pilot 3000*The Series Has Landed?I,
> Roommate6Love's Labors Lost in Space(Fear of a Bot Planet(A Fishful of
> Dollars?My Three Suns,A Big Piece of Garbage(Hell Is Other Robots(A Flight to
> Remember?Mars University$When Aliens Attack.Fry & the Slurm Factory*I Second
> That Emotion*Brannigan Begin Again&A Head in the Polls?Xmas StoryDWhy Must I
> Be a Crustacean in Love8Put Your Head on My Shoulder&Lesser of Two
> Evils?Raging Bender2A Bicyclops Built for TwoPHow Hermes Requisitioned His
> Groove Back"A Clone of My Own?The Deep South Bender Gets Made2The Problem
> with Popplers?Mother's Day2Anthology of Interest (1)?The Honking"War Is the
> H-Word"The Cryonic Woman?Parasites Lost0Amazon Women in the Mood?Bendless
> Love<The Day the Earth Stood Stupid.That's Lobstertainment!2The Birdbot of
> Ice-Catraz&Luck of the Fryrish*The Cyber House Rules.Insane in the
> Mainframe&Bendin' in the Wind,Time Keeps on Slipping?I Dated a Robot,Roswell
> That Ends Well(A Tale of Two Santas2Anthology of Interest (2)?Love and
> Rocket"Leela's Homeworld,Where the Buggalo Roam*A Pharaoh to
> Remember?Godfellas?Futurestock$A Leela of Her Own?30% Iron Chef8Where No Fan
> Has Gone Before"Crimes of the Hot?Jurassic Bark*The Route of All Evil$A Taste
> of Freedom6Kif Gets Knocked Up a Notch?Less Than Hero<Teenage Mutant Leela's
> Hurdles?The Why of Fry?The Sting,The Farnsworth Parabox,Three Hundred Big
> Boys?Spanish Fry?Bend Her&Obsoletely FabulousTBender Should Not Be Allowed on
> TelevisionJThe Devil's Hands Are Idle
> Playthings?Rebirth&In-A-Gadda-Da-Leela0Attack of the Killer App(Proposition
> Infinity$The Duh-Vinci Code"Lethal Inspection,The Late Philip J. Fry?That
> Darn Katz!$A Clockwork Origin*The Prisoner of Benda<Lrrreconcilable
> Ndndifferences2The Mutants Are Revolting@The Futurama Holiday
> Spectacular?Neutopia?Benderama*Ghost in the Machines?Law and Oracle2The
> Silence of the Clamps?Yo Leela Leela2All the Presidents' Heads?Möbius
> Dick$Fry am the Egg Man.The Tip of the Zoidberg?Cold
> Warriors?Overclockwise?Reincarnation*The Bots and the Bees$A Farewell to
> Arms?Decision 3012(The Thief of Baghead?Zapp Dingbat*The Butterjunk
> Effect4The Six Million Dollar Mon?Fun on a Bun"Free Will Hunting?Near-Death
> Wish?Viva Mars Vegas 31st Century Fox?Naturama
> SEQ?+org.apache.hadoop.hive.ql.exec.ByteWritable?org.apache.hadoop.io.Text???????BpA??
> ????
> ??????238?val_238????????? 86?val_86???
> ??????311?val_311????????? 27?val_27???
> ??????165?val_165???
> ??????409?val_409???
> ??????255?val_255???
> ??????278?val_278????????? 98?val_98???
> ??????484?val_484???
> ??????265?val_265???
> ??????193?val_193???
> ??????401?val_401???
> ??????150?val_150???
> ??????273?val_273???
> ??????224?val_224???
> ??????369?val_369????????? 66?val_66???
> ??????128?val_128???
> ??????213?val_213???
> ??????146?val_146???
> ??????406?val_406???
> ??????429?val_429???
> ??????374?val_374???
> ??????152?val_152???
> ??????469?val_469???
> ??????145?val_145???
> ??????495?val_495????????? 37?val_37???
> ??????327?val_327???
> ??????281?val_281???
> ??????277?val_277???
> ??????209?val_209????????? 15?val_15????????? 82?val_82???
> ??????403?val_403???
> ??????166?val_166???
> ??????417?val_417???
> ??????430?val_430???
> ??????252?val_252???
> ??????292?val_292???
> ??????219?val_219???
> ??????287?val_287???
> ??????153?val_153???
> ??????193?val_193???
> ??????338?val_338???
> ??????446?val_446???
> ??????459?val_459???
> ??????394?val_394???
> ??????237?val_237???
> ??????482?val_482???
> ??????174?val_174???
> ??????413?val_413???
> ??????494?val_494???
> ??????207?val_207???
> SEQ?+org.apache.hadoop.hive.ql.exec.ByteWritable?org.apache.hadoop.io.Text???????BpA??
> ????
> ??????238?val_238????????? 86?val_86???
> ??????311?val_311????????? 27?val_27???
> ??????165?val_165???
> ??????409?val_
> xMR;nDA?SZf?DS?=.!?*~~+Dz.??0f-!d\0+??N(!]hַD?˃?mlB۱ 38 !`H?ut??
> !&g?9??J??/BW????β 7Kb?q?fHrstr^*53ö^}6\k~@Y
> ??
> RCF???????hive.io.rcfile.column.number?9vŕXFɍR???J?????????????????????????&)*')'%&%("?!'
> %$%"?(&?l?l??Џ???????????????????????????????,,?????????????ȏ? ?
> ?
> ???
> ? ?? ? ? ?
> ????????6?6???? ?????? ?
> ??
> ? ??
> ??
> SEQ?"org.apache.hadoop.io.BytesWritable?org.apache.hadoop.io.Text??????
> ^?[&`93(1C,???????????z121152?almond antique burnished rose
> metallic?Manufacturer#1?Brand#14?PROMO PLATED TIN?2?JUMBO BOX?1173.15?e pinto
> beans h???????????z121152?almond antique burnished rose
> metallic?Manufacturer#1?Brand#14?PROMO PLATED TIN?2?JUMBO BOX?1173.15?e pinto
> beans h???y????????t85768?almond antique chartreuse lavender
> yellow?Manufacturer#1?Brand#12?LARGE BRUSHED STEEL?34?SM
> BAG?1753.76?refull???????????110592?almond antique salmon chartreuse
> burlywood?Manufacturer#1?Brand#15?PROMO BURNISHED NICKEL?6?JUMBO PKG?1602.59?
> to the furiously???????????{86428?almond aquamarine burnished black
> steel?Manufacturer#1?Brand#12?STANDARD ANODIZED STEEL?28?WRAP
> BAG?1414.42?arefully ???????????65667?almond aquamarine pink moccasin
> thistle?Manufacturer#1?Brand#12?LARGE BURNISHED STEEL?42?JUMBO CASE?1632.66?e
> across the expr???????????105685?almond antique violet chocolate
> turquoise?Manufacturer#2?Brand#22?MEDIUM ANODIZED COPPER?14?MED
> CAN?1690.68?ly pending requ???|????????w191709?almond antique violet
> turquoise frosted?Manufacturer#2?Brand#22?ECONOMY POLISHED STEEL?40?MED
> BOX?1800.7? haggle???????????146985?almond aquamarine midnight light
> salmon?Manufacturer#2?Brand#23?MEDIUM BURNISHED COPPER?2?SM CASE?2031.98?s
> cajole caref???x????????s132666?almond aquamarine rose maroon
> antique?Manufacturer#2?Brand#24?SMALL POLISHED NICKEL?25?MED BOX?1698.66?even
> ???u????????p195606?almond aquamarine sandy cyan
> gainsboro?Manufacturer#2?Brand#25?STANDARD PLATED TIN?18?SM PKG?1701.6?ic
> de???????????90681?almond antique chartreuse khaki
> white?Manufacturer#3?Brand#31?MEDIUM BURNISHED TIN?17?SM CASE?1671.68?are
> slyly after the sl???~????????y17273?almond antique forest lavender
> goldenrod?Manufacturer#3?Brand#35?PROMO ANODIZED TIN?14?JUMBO
> CASE?1190.27?along the???z????????u112398?almond antique metallic orange
> dim?Manufacturer#3?Brand#32?MEDIUM BURNISHED BRASS?19?JUMBO JAR?1410.39?ole
> car???v????????q40982?almond antique misty red
> olive?Manufacturer#3?Brand#32?ECONOMY PLATED COPPER?1?LG PKG?1922.98?c foxes
> can s
> ^?[&`93(1C,???????????144293?almond antique olive coral
> navajo?Manufacturer#3?Brand#34?STANDARD POLISHED STEEL?45?JUMBO
> CAN?1337.29?ag furiously about ???????????}49671?almond antique gainsboro
> frosted violet?Manufacturer#4?Brand#41?SMALL BRUSHED BRASS?10?SM
> BOX?1620.67?ccounts run quick???y????????t48427?almond antique violet mint
> lemon?Manufacturer#4?Brand#42?PROMO POLISHED STEEL?39?SM CASE?1375.42?hely
> ironic i???x????????s45261?almond aquamarine floral ivory
> bisque?Manufacturer#4?Brand#42?SMALL PLATED STEEL?27?WRAP
> CASE?1206.26?careful???y????????t17927?almond aquamarine yellow dodger
> mint?Manufacturer#4?Brand#41?ECONOMY BRUSHED COPPER?7?SM PKG?1844.92?ites.
> eve???y????????t33357?almond azure aquamarine papaya
> violet?Manufacturer#4?Brand#41?STANDARD ANODIZED TIN?12?WRAP
> CASE?1290.35?reful???w????????r192697?almond antique blue firebrick
> mint?Manufacturer#5?Brand#52?MEDIUM BURNISHED TIN?31?LG DRUM?1789.69?ickly
> ir???y????????t42669?almond antique medium spring
> khaki?Manufacturer#5?Brand#51?STANDARD BURNISHED TIN?6?MED CAN?1611.66?sits
> haggl???x????????s155733?almond antique sky peru
> orange?Manufacturer#5?Brand#53?SMALL PLATED BRASS?2?WRAP
> DRUM?1788.73?furiously. bra???????????15103?almond aquamarine dodger light
> gainsboro?Manufacturer#5?Brand#53?ECONOMY BURNISHED STEEL?46?LG
> PACK?1018.1?packages hinder carefu???{????????v78486?almond azure blanched
> chiffon midnight?Manufacturer#5?Brand#52?LARGE BRUSHED BRASS?23?MED
> BAG?1464.48?hely blith
> SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2BSg?bZݴn???Z???????????????22????448410002000300040005000val_356val_169val_1000val_169val_169val_125val_125
> SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2??@bߎ??)????-???
> ???
> ???????????134510val_1val_3val_4val_5val_10
> SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2?:?w?
> ???+?????????????????20232530val_20val_23val_25val_30
> SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2??(}S?Dֳ????;???
> ???
> ??????##???41017192023val_4val_10val_17val_19val_20val_23
> [error] running /home/jw/apache/spark/dev/check-license ; received return
> code 1
> [jw@cn06 spark]$
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
