Lutz Weischer created SPARK-34717: ------------------------------------- Summary: run-tests fails on AArch64, Fedora 33 Key: SPARK-34717 URL: https://issues.apache.org/jira/browse/SPARK-34717 Project: Spark Issue Type: Bug Components: Build Affects Versions: 3.1.1 Reporter: Lutz Weischer
[jw@cn06 spark]$ ./dev/run-tests +++ dirname /home/jw/apache/spark/R/install-dev.sh ++ cd /home/jw/apache/spark/R ++ pwd + FWDIR=/home/jw/apache/spark/R + LIB_DIR=/home/jw/apache/spark/R/lib + mkdir -p /home/jw/apache/spark/R/lib + pushd /home/jw/apache/spark/R + . /home/jw/apache/spark/R/find-r.sh ++ '[' -z '' ']' ++ '[' '!' -z '' ']' +++ command -v R ++ '[' '!' /usr/bin/R ']' ++++ which R +++ dirname /usr/bin/R ++ R_SCRIPT_PATH=/usr/bin ++ echo 'Using R_SCRIPT_PATH = /usr/bin' Using R_SCRIPT_PATH = /usr/bin + . /home/jw/apache/spark/R/create-rd.sh ++ set -o pipefail ++ set -e ++++ dirname /home/jw/apache/spark/R/create-rd.sh +++ cd /home/jw/apache/spark/R +++ pwd ++ FWDIR=/home/jw/apache/spark/R ++ pushd /home/jw/apache/spark/R ++ . /home/jw/apache/spark/R/find-r.sh +++ '[' -z /usr/bin ']' ++ /usr/bin/Rscript -e ' if(requireNamespace("devtools", quietly=TRUE)) { setwd("/home/jw/apache/spark/R"); devtools::document(pkg="./pkg", roclets="rd") }' + /usr/bin/R CMD INSTALL --library=/home/jw/apache/spark/R/lib /home/jw/apache/spark/R/pkg/ * installing *source* package 'SparkR' ... ** using staged installation ** R ** inst ** byte-compile and prepare package for lazy loading Creating a new generic function for 'as.data.frame' in package 'SparkR' Creating a new generic function for 'colnames' in package 'SparkR' Creating a new generic function for 'colnames<-' in package 'SparkR' Creating a new generic function for 'cov' in package 'SparkR' Creating a new generic function for 'drop' in package 'SparkR' Creating a new generic function for 'na.omit' in package 'SparkR' Creating a new generic function for 'filter' in package 'SparkR' Creating a new generic function for 'intersect' in package 'SparkR' Creating a new generic function for 'sample' in package 'SparkR' Creating a new generic function for 'transform' in package 'SparkR' Creating a new generic function for 'subset' in package 'SparkR' Creating a new generic function for 'summary' in package 'SparkR' Creating a new generic function for 'union' in package 'SparkR' Creating a new generic function for 'endsWith' in package 'SparkR' Creating a new generic function for 'startsWith' in package 'SparkR' Creating a new generic function for 'lag' in package 'SparkR' Creating a new generic function for 'rank' in package 'SparkR' Creating a new generic function for 'sd' in package 'SparkR' Creating a new generic function for 'var' in package 'SparkR' Creating a new generic function for 'window' in package 'SparkR' Creating a new generic function for 'predict' in package 'SparkR' Creating a new generic function for 'rbind' in package 'SparkR' Creating a generic function for 'substr' from package 'base' in package 'SparkR' Creating a generic function for '%in%' from package 'base' in package 'SparkR' Creating a generic function for 'lapply' from package 'base' in package 'SparkR' Creating a generic function for 'Filter' from package 'base' in package 'SparkR' Creating a generic function for 'nrow' from package 'base' in package 'SparkR' Creating a generic function for 'ncol' from package 'base' in package 'SparkR' Creating a generic function for 'factorial' from package 'base' in package 'SparkR' Creating a generic function for 'atan2' from package 'base' in package 'SparkR' Creating a generic function for 'ifelse' from package 'base' in package 'SparkR' ** help No man pages found in package 'SparkR' *** installing help indices ** building package indices ** installing vignettes ** testing if installed package can be loaded from temporary location ** testing if installed package can be loaded from final location ** testing if installed package keeps a record of temporary installation path * DONE (SparkR) + cd /home/jw/apache/spark/R/lib + jar cfM /home/jw/apache/spark/R/lib/sparkr.zip SparkR + popd [info] Using build tool sbt with Hadoop profile hadoop3.2 and Hive profile hive2.3 under environment local [info] Found the following changed modules: root [info] Setup the following environment variables for tests: ======================================================================== Running Apache RAT checks ======================================================================== Attempting to fetch rat Could not find Apache license headers in the following files: !????? /home/jw/apache/spark/R/lib/SparkR/Meta/Rd.rds !????? /home/jw/apache/spark/R/lib/SparkR/Meta/features.rds !????? /home/jw/apache/spark/R/lib/SparkR/Meta/hsearch.rds !????? /home/jw/apache/spark/R/lib/SparkR/Meta/links.rds !????? /home/jw/apache/spark/R/lib/SparkR/Meta/nsInfo.rds !????? /home/jw/apache/spark/R/lib/SparkR/Meta/package.rds !????? /home/jw/apache/spark/R/lib/SparkR/R/SparkR.rdb !????? /home/jw/apache/spark/R/lib/SparkR/R/SparkR.rdx !????? /home/jw/apache/spark/core/src/test/resources/keystore !????? /home/jw/apache/spark/core/src/test/resources/untrusted-keystore !????? /home/jw/apache/spark/examples/src/main/resources/users.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/before_1582_date_v2_4_5.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/before_1582_date_v2_4_6.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_micros_v2_4_5.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_micros_v2_4_6.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_millis_v2_4_5.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/before_1582_timestamp_millis_v2_4_6.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/episodes.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00000.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00001.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00002.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00003.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00004.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00005.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00006.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00007.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00008.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00009.avro !????? /home/jw/apache/spark/external/avro/src/test/resources/test-random-partitioned/part-r-00010.avro !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/dtc-2.4.7/data/.part-00000-bd7ae42f-c890-406c-894c-ca4eac67c690-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/dtr-2.4.7/data/.part-00000-39b027f0-a437-4b3d-84af-d861adcb9ca8-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtc-2.4.7/data/.part-00000-dacbde64-c861-41c7-91c0-6da8cc01fb43-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtc-2.4.7/treesMetadata/.part-00000-81137d9f-31e3-4a90-813c-ddc394101e21-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtr-2.4.7/data/.part-00000-3b5433ff-d346-4511-9aab-639288bfae6d-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/gbtr-2.4.7/treesMetadata/.part-00000-6b9124f5-87fe-4fd8-ad9c-4be239c2215a-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/mlp-2.4.4/data/.part-00000-fa18aaf6-d8df-4b90-8231-eb5f6ac12138-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/rfc-2.4.7/data/.part-00000-e41a7b98-91f8-4485-b112-25b4b11c9009-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/rfc-2.4.7/treesMetadata/.part-00000-21082d24-b666-4c4e-a823-70c7afdcbdc5-c000.snappy.parquet.crc !????? /home/jw/apache/spark/mllib/src/test/resources/ml-models/rfr-2.4. ?????????? ???? ?????????? "$&(*,.024???? ????????????o????????? Space Pilot 3000*The Series Has Landed?I, Roommate6Love's Labors Lost in Space(Fear of a Bot Planet(A Fishful of Dollars?My Three Suns,A Big Piece of Garbage(Hell Is Other Robots(A Flight to Remember?Mars University$When Aliens Attack.Fry & the Slurm Factory*I Second That Emotion*Brannigan Begin Again&A Head in the Polls?Xmas StoryDWhy Must I Be a Crustacean in Love8Put Your Head on My Shoulder&Lesser of Two Evils?Raging Bender2A Bicyclops Built for TwoPHow Hermes Requisitioned His Groove Back"A Clone of My Own?The Deep South Bender Gets Made2The Problem with Popplers?Mother's Day2Anthology of Interest (1)?The Honking"War Is the H-Word"The Cryonic Woman?Parasites Lost0Amazon Women in the Mood?Bendless Love<The Day the Earth Stood Stupid.That's Lobstertainment!2The Birdbot of Ice-Catraz&Luck of the Fryrish*The Cyber House Rules.Insane in the Mainframe&Bendin' in the Wind,Time Keeps on Slipping?I Dated a Robot,Roswell That Ends Well(A Tale of Two Santas2Anthology of Interest (2)?Love and Rocket"Leela's Homeworld,Where the Buggalo Roam*A Pharaoh to Remember?Godfellas?Futurestock$A Leela of Her Own?30% Iron Chef8Where No Fan Has Gone Before"Crimes of the Hot?Jurassic Bark*The Route of All Evil$A Taste of Freedom6Kif Gets Knocked Up a Notch?Less Than Hero<Teenage Mutant Leela's Hurdles?The Why of Fry?The Sting,The Farnsworth Parabox,Three Hundred Big Boys?Spanish Fry?Bend Her&Obsoletely FabulousTBender Should Not Be Allowed on TelevisionJThe Devil's Hands Are Idle Playthings?Rebirth&In-A-Gadda-Da-Leela0Attack of the Killer App(Proposition Infinity$The Duh-Vinci Code"Lethal Inspection,The Late Philip J. Fry?That Darn Katz!$A Clockwork Origin*The Prisoner of Benda<Lrrreconcilable Ndndifferences2The Mutants Are Revolting@The Futurama Holiday Spectacular?Neutopia?Benderama*Ghost in the Machines?Law and Oracle2The Silence of the Clamps?Yo Leela Leela2All the Presidents' Heads?Möbius Dick$Fry am the Egg Man.The Tip of the Zoidberg?Cold Warriors?Overclockwise?Reincarnation*The Bots and the Bees$A Farewell to Arms?Decision 3012(The Thief of Baghead?Zapp Dingbat*The Butterjunk Effect4The Six Million Dollar Mon?Fun on a Bun"Free Will Hunting?Near-Death Wish?Viva Mars Vegas 31st Century Fox?Naturama SEQ?+org.apache.hadoop.hive.ql.exec.ByteWritable?org.apache.hadoop.io.Text???????BpA?? ???? ??????238?val_238????????? 86?val_86??? ??????311?val_311????????? 27?val_27??? ??????165?val_165??? ??????409?val_409??? ??????255?val_255??? ??????278?val_278????????? 98?val_98??? ??????484?val_484??? ??????265?val_265??? ??????193?val_193??? ??????401?val_401??? ??????150?val_150??? ??????273?val_273??? ??????224?val_224??? ??????369?val_369????????? 66?val_66??? ??????128?val_128??? ??????213?val_213??? ??????146?val_146??? ??????406?val_406??? ??????429?val_429??? ??????374?val_374??? ??????152?val_152??? ??????469?val_469??? ??????145?val_145??? ??????495?val_495????????? 37?val_37??? ??????327?val_327??? ??????281?val_281??? ??????277?val_277??? ??????209?val_209????????? 15?val_15????????? 82?val_82??? ??????403?val_403??? ??????166?val_166??? ??????417?val_417??? ??????430?val_430??? ??????252?val_252??? ??????292?val_292??? ??????219?val_219??? ??????287?val_287??? ??????153?val_153??? ??????193?val_193??? ??????338?val_338??? ??????446?val_446??? ??????459?val_459??? ??????394?val_394??? ??????237?val_237??? ??????482?val_482??? ??????174?val_174??? ??????413?val_413??? ??????494?val_494??? ??????207?val_207??? SEQ?+org.apache.hadoop.hive.ql.exec.ByteWritable?org.apache.hadoop.io.Text???????BpA?? ???? ??????238?val_238????????? 86?val_86??? ??????311?val_311????????? 27?val_27??? ??????165?val_165??? ??????409?val_ xMR;nDA?SZf?DS?=.!?*~~+Dz.??0f-!d\0+??N(!]hַD?˃?mlB۱ 38 !`H?ut?? !&g?9??J??/BW????β 7Kb?q?fHrstr^*53ö^}6\k~@Y ?? RCF???????hive.io.rcfile.column.number?9vŕXFɍR???J?????????????????????????&)*')'%&%("?!' %$%"?(&?l?l??Џ???????????????????????????????,,?????????????ȏ? ? ? ??? ? ?? ? ? ? ????????6?6???? ?????? ? ?? ? ?? ?? SEQ?"org.apache.hadoop.io.BytesWritable?org.apache.hadoop.io.Text?????? ^?[&`93(1C,???????????z121152?almond antique burnished rose metallic?Manufacturer#1?Brand#14?PROMO PLATED TIN?2?JUMBO BOX?1173.15?e pinto beans h???????????z121152?almond antique burnished rose metallic?Manufacturer#1?Brand#14?PROMO PLATED TIN?2?JUMBO BOX?1173.15?e pinto beans h???y????????t85768?almond antique chartreuse lavender yellow?Manufacturer#1?Brand#12?LARGE BRUSHED STEEL?34?SM BAG?1753.76?refull???????????110592?almond antique salmon chartreuse burlywood?Manufacturer#1?Brand#15?PROMO BURNISHED NICKEL?6?JUMBO PKG?1602.59? to the furiously???????????{86428?almond aquamarine burnished black steel?Manufacturer#1?Brand#12?STANDARD ANODIZED STEEL?28?WRAP BAG?1414.42?arefully ???????????65667?almond aquamarine pink moccasin thistle?Manufacturer#1?Brand#12?LARGE BURNISHED STEEL?42?JUMBO CASE?1632.66?e across the expr???????????105685?almond antique violet chocolate turquoise?Manufacturer#2?Brand#22?MEDIUM ANODIZED COPPER?14?MED CAN?1690.68?ly pending requ???|????????w191709?almond antique violet turquoise frosted?Manufacturer#2?Brand#22?ECONOMY POLISHED STEEL?40?MED BOX?1800.7? haggle???????????146985?almond aquamarine midnight light salmon?Manufacturer#2?Brand#23?MEDIUM BURNISHED COPPER?2?SM CASE?2031.98?s cajole caref???x????????s132666?almond aquamarine rose maroon antique?Manufacturer#2?Brand#24?SMALL POLISHED NICKEL?25?MED BOX?1698.66?even ???u????????p195606?almond aquamarine sandy cyan gainsboro?Manufacturer#2?Brand#25?STANDARD PLATED TIN?18?SM PKG?1701.6?ic de???????????90681?almond antique chartreuse khaki white?Manufacturer#3?Brand#31?MEDIUM BURNISHED TIN?17?SM CASE?1671.68?are slyly after the sl???~????????y17273?almond antique forest lavender goldenrod?Manufacturer#3?Brand#35?PROMO ANODIZED TIN?14?JUMBO CASE?1190.27?along the???z????????u112398?almond antique metallic orange dim?Manufacturer#3?Brand#32?MEDIUM BURNISHED BRASS?19?JUMBO JAR?1410.39?ole car???v????????q40982?almond antique misty red olive?Manufacturer#3?Brand#32?ECONOMY PLATED COPPER?1?LG PKG?1922.98?c foxes can s ^?[&`93(1C,???????????144293?almond antique olive coral navajo?Manufacturer#3?Brand#34?STANDARD POLISHED STEEL?45?JUMBO CAN?1337.29?ag furiously about ???????????}49671?almond antique gainsboro frosted violet?Manufacturer#4?Brand#41?SMALL BRUSHED BRASS?10?SM BOX?1620.67?ccounts run quick???y????????t48427?almond antique violet mint lemon?Manufacturer#4?Brand#42?PROMO POLISHED STEEL?39?SM CASE?1375.42?hely ironic i???x????????s45261?almond aquamarine floral ivory bisque?Manufacturer#4?Brand#42?SMALL PLATED STEEL?27?WRAP CASE?1206.26?careful???y????????t17927?almond aquamarine yellow dodger mint?Manufacturer#4?Brand#41?ECONOMY BRUSHED COPPER?7?SM PKG?1844.92?ites. eve???y????????t33357?almond azure aquamarine papaya violet?Manufacturer#4?Brand#41?STANDARD ANODIZED TIN?12?WRAP CASE?1290.35?reful???w????????r192697?almond antique blue firebrick mint?Manufacturer#5?Brand#52?MEDIUM BURNISHED TIN?31?LG DRUM?1789.69?ickly ir???y????????t42669?almond antique medium spring khaki?Manufacturer#5?Brand#51?STANDARD BURNISHED TIN?6?MED CAN?1611.66?sits haggl???x????????s155733?almond antique sky peru orange?Manufacturer#5?Brand#53?SMALL PLATED BRASS?2?WRAP DRUM?1788.73?furiously. bra???????????15103?almond aquamarine dodger light gainsboro?Manufacturer#5?Brand#53?ECONOMY BURNISHED STEEL?46?LG PACK?1018.1?packages hinder carefu???{????????v78486?almond azure blanched chiffon midnight?Manufacturer#5?Brand#52?LARGE BRUSHED BRASS?23?MED BAG?1464.48?hely blith SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2BSg?bZݴn???Z???????????????22????448410002000300040005000val_356val_169val_1000val_169val_169val_125val_125 SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2??@bߎ??)????-??? ??? ???????????134510val_1val_3val_4val_5val_10 SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2?:?w? ???+?????????????????20232530val_20val_23val_25val_30 SEQ?-org.apache.hadoop.hive.ql.io.RCFile$KeyBuffer/org.apache.hadoop.hive.ql.io.RCFile$ValueBuffer???????hive.io.rcfile.column.number?2??(}S?Dֳ????;??? ??? ??????##???41017192023val_4val_10val_17val_19val_20val_23 [error] running /home/jw/apache/spark/dev/check-license ; received return code 1 [jw@cn06 spark]$ -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org