ronnac opened a new issue #17315: mvn install scala package sigsev mxnet::TShape::Size() URL: https://github.com/apache/incubator-mxnet/issues/17315 ## Description mvn install of the scala package fails on armhf 32bit with SIGSEGV at Building MXNet Scala Package - Core INTERNAL [6/12] T E S T S test Visualize Problematic frame: # C [libmxnet.so+0x929e54] mxnet::TShape::Size() const+0x10 ### Error Messages ``` [INFO] [INFO] --------------------< org.apache.mxnet:mxnet-core >--------------------- [INFO] Building MXNet Scala Package - Core INTERNAL [6/12] [INFO] --------------------------------[ jar ]--------------------------------- [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-maven-version) @ mxnet-core --- [INFO] [INFO] --- directory-maven-plugin:0.1:directory-of (directories) @ mxnet-core --- [INFO] Directory of org.apache.mxnet:mxnet-parent set to: /root/mxnet/scala-package [INFO] [INFO] --- scala-maven-plugin:3.4.4:add-source (compile) @ mxnet-core --- [INFO] Add Source directory: /root/mxnet/scala-package/core/src/main/scala [INFO] Add Test Source directory: /root/mxnet/scala-package/core/src/test/scala [INFO] [INFO] --- exec-maven-plugin:1.6.0:exec (init-build-flavor) @ mxnet-core --- ldd: /root/mxnet/scala-package/core/../lib/libmxnet.so: No such file or directory [INFO] [INFO] --- properties-maven-plugin:1.0.0:read-project-properties (read-properties) @ mxnet-core --- [INFO] [INFO] --- exec-maven-plugin:1.6.0:exec (apidoc-generation) @ mxnet-core --- [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ mxnet-core --- [INFO] [INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ mxnet-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /root/mxnet/scala-package/core/src/main/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ mxnet-core --- [INFO] Not compiling main sources [INFO] [INFO] --- scala-maven-plugin:3.4.4:compile (compile) @ mxnet-core --- [INFO] /root/mxnet/scala-package/core/src/main/scala:-1: info: compiling [INFO] Compiling 78 source files to /root/mxnet/scala-package/core/target/classes at 1579013383658 [INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.11.8,2.1.0,null) [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Executor.scala:139: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] val argArrays = inArgs.map(new NDArray(_)).toArray [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Executor.scala:141: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] if (handle == 0) null else new NDArray(handle)).toArray [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Executor.scala:142: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] val auxArrays = auxStates.map(new NDArray(_)).toArray [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Executor.scala:163: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] val nd = new NDArray(ele, addToCollector = false) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Monitor.scala:54: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] val array = new NDArray(arr, writable = false, addToCollector = false) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/NDArray.scala:129: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] case 0 => new NDArray(ele._1) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/NDArray.scala:234: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] new NDArray(handle = NDArray.newAllocHandle(shape, context, delayAlloc = false, dtype)) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/NDArray.scala:691: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] (names.toArray, handles.map(new NDArray(_)).toArray) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/NDArray.scala:737: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] new NDArray(handleRef.value) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/NDArray.scala:1294: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] val ret = new NDArray(NDArray.newAllocHandle(shape, ctx, delayAlloc = true, dtype = dtype)) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Operator.scala:75: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] tensors(tags(i)) += new NDArray(ndarraies(i), writable = true, addToCollector = false) [WARNING] ^ [WARNING] /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/Operator.scala:77: warning: constructor NDArray in class NDArray is deprecated: Please use ResourceScope instead [WARNING] tensors(tags(i)) += new NDArray(ndarraies(i), writable = false, addToCollector = false) [WARNING] ^ [WARNING] 12 warnings found [INFO] prepare-compile in 0 s [INFO] compile in 197 s [INFO] [INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ mxnet-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.3:testCompile (default-testCompile) @ mxnet-core --- [INFO] Not compiling test sources [INFO] [INFO] --- scala-maven-plugin:3.4.4:testCompile (compile) @ mxnet-core --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.22.0:test (default-test) @ mxnet-core --- [INFO] Surefire report directory: /root/mxnet/scala-package/core/target/surefire-reports [INFO] [INFO] ------------------------------------------------------- [INFO] T E S T S [INFO] ------------------------------------------------------- [INFO] [INFO] Results: [INFO] [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] [INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ mxnet-core --- [INFO] Building jar: /root/mxnet/scala-package/core/target/mxnet-core-INTERNAL.jar [INFO] [INFO] --- maven-site-plugin:3.7:attach-descriptor (attach-descriptor) @ mxnet-core --- [INFO] Skipping because packaging 'jar' is not pom. [INFO] [INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ mxnet-core --- [INFO] Building jar: /root/mxnet/scala-package/core/target/mxnet-core-INTERNAL-sources.jar [INFO] [INFO] >>> scala-maven-plugin:3.4.4:doc-jar (compile) > generate-resources @ mxnet-core >>> [INFO] [INFO] --- maven-enforcer-plugin:1.4.1:enforce (enforce-maven-version) @ mxnet-core --- [INFO] [INFO] --- directory-maven-plugin:0.1:directory-of (directories) @ mxnet-core --- [INFO] Directory of org.apache.mxnet:mxnet-parent set to: /root/mxnet/scala-package [INFO] [INFO] --- scala-maven-plugin:3.4.4:add-source (compile) @ mxnet-core --- [INFO] [INFO] --- exec-maven-plugin:1.6.0:exec (init-build-flavor) @ mxnet-core --- ldd: /root/mxnet/scala-package/core/../lib/libmxnet.so: No such file or directory [INFO] [INFO] --- properties-maven-plugin:1.0.0:read-project-properties (read-properties) @ mxnet-core --- [INFO] [INFO] --- exec-maven-plugin:1.6.0:exec (apidoc-generation) @ mxnet-core --- [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ mxnet-core --- [INFO] [INFO] <<< scala-maven-plugin:3.4.4:doc-jar (compile) < generate-resources @ mxnet-core <<< [INFO] [INFO] [INFO] --- scala-maven-plugin:3.4.4:doc-jar (compile) @ mxnet-core --- model contains 281 documentable templates /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/module/BaseModule.scala:381: warning: Could not find any member to link for "IOException". /** ^ /root/mxnet/scala-package/core/src/main/scala/org/apache/mxnet/NDArray.scala:533: warning: Could not find any member to link for "IllegalArgumentException". /** ^ two warnings found [INFO] Building jar: /root/mxnet/scala-package/core/target/mxnet-core-INTERNAL-javadoc.jar [INFO] [INFO] --- scalatest-maven-plugin:1.0:test (test) @ mxnet-core --- Discovery starting. Discovery completed in 17 seconds, 762 milliseconds. Run starting. Expected test count is: 180 NDArraySuite: 2020-01-14 15:56:41,779 [ScalaTest-main-running-NDArraySuite] [MXNetJVM] [INFO] - Try loading mxnet-scala from native path. - to java array - to scalar - to sparse - to float 64 scalar - call toScalar on an ndarray which is not a scalar - size and shape - dtype - set scalar value - copy from java array - create NDArray based on Java Matrix - test Visualize # # A fatal error has been detected by the Java Runtime Environment: # # SIGSEGV (0xb) at pc=0xd81e2e54, pid=13067, tid=0xf0b4f460 # # JRE version: OpenJDK Runtime Environment (8.0_232-b09) (build 1.8.0_232-8u232-b09-0ubuntu1~19.04.1-b09) # Java VM: OpenJDK Client VM (25.232-b09 mixed mode linux-aarch32 ) # Problematic frame: # C [libmxnet.so+0x929e54] mxnet::TShape::Size() const+0x10 # # Core dump written. Default location: /root/mxnet/scala-package/core/core or core.13067 # # An error report file with more information is saved as: # /root/mxnet/scala-package/core/hs_err_pid13067.log # # If you would like to submit a bug report, please visit: # http://bugreport.java.com/bugreport/crash.jsp # The crash happened outside the Java Virtual Machine in native code. # See problematic frame for where to report the bug. # Aborted (core dumped) [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] MXNet Scala Package - Parent INTERNAL .............. SUCCESS [ 33.529 s] [INFO] MXNet Scala Package - Initializer INTERNAL ......... SUCCESS [ 39.652 s] [INFO] MXNet Scala Package - Initializer Native INTERNAL .. SUCCESS [ 7.803 s] [INFO] MXNet Scala Package - Macros INTERNAL .............. SUCCESS [ 37.122 s] [INFO] MXNet Scala Package - Native INTERNAL .............. SUCCESS [ 8.447 s] [INFO] MXNet Scala Package - Core INTERNAL ................ FAILURE [07:08 min] [INFO] MXNet Scala Package - Inference INTERNAL ........... SKIPPED [INFO] MXNet Scala Package - Examples INTERNAL ............ SKIPPED [INFO] MXNet Scala Package - Spark ML INTERNAL ............ SKIPPED [INFO] Assembly Scala Package INTERNAL .................... SKIPPED [INFO] MXNet Scala Package - Full linux-x86_64-only 1.6.0-SNAPSHOT SKIPPED [INFO] MXNet Scala Package - Full linux-x86_64-only 1.6.0-SNAPSHOT SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 09:18 min [INFO] Finished at: 2020-01-14T15:56:44+01:00 [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (test) on project mxnet-core: There are test failures -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.scalatest:scalatest-maven-plugin:1.0:test (test) on project mxnet-core: There are test failures at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:215) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288) at org.apache.maven.cli.MavenCli.main (MavenCli.java:192) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347) Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures at org.scalatest.tools.maven.TestMojo.execute (TestMojo.java:107) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo (DefaultBuildPluginManager.java:137) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:210) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:156) at org.apache.maven.lifecycle.internal.MojoExecutor.execute (MojoExecutor.java:148) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:117) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject (LifecycleModuleBuilder.java:81) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build (SingleThreadedBuilder.java:56) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute (LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:305) at org.apache.maven.DefaultMaven.doExecute (DefaultMaven.java:192) at org.apache.maven.DefaultMaven.execute (DefaultMaven.java:105) at org.apache.maven.cli.MavenCli.execute (MavenCli.java:956) at org.apache.maven.cli.MavenCli.doMain (MavenCli.java:288) at org.apache.maven.cli.MavenCli.main (MavenCli.java:192) at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke (Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced (Launcher.java:282) at org.codehaus.plexus.classworlds.launcher.Launcher.launch (Launcher.java:225) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode (Launcher.java:406) at org.codehaus.plexus.classworlds.launcher.Launcher.main (Launcher.java:347) [ERROR] [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :mxnet-core root@localhost ~/m/scala-package# ``` ## To Reproduce (If you developed your own code, please provide a short script that reproduces the error. For existing examples, please provide link.) ### Steps to reproduce (Paste the commands you ran that produced the error.) On an armhf 32bit device with linux disco : 1. build opencv3.4 from source build mxnet from source with cmake cd ~/mxnet/scala package mvn install -e ## What have you tried to solve it? ## Environment ``` ----------Python Info---------- ('Version :', '2.7.16') ('Compiler :', 'GCC 8.3.0') ('Build :', ('default', 'Oct 7 2019 17:36:04')) ('Arch :', ('32bit', '')) ------------Pip Info----------- No corresponding pip install for current python. ----------MXNet Info----------- No MXNet installed. ----------System Info---------- ('Platform :', 'Linux-4.4.111-16046393-armv8l-with-Ubuntu-19.04-disco') ('system :', 'Linux') ('node :', 'localhost') ('release :', '4.4.111-16046393') ('version :', '#1 SMP PREEMPT Wed Oct 9 14:44:51 KST 2019') ----------Hardware Info---------- ('machine :', 'armv8l') ('processor :', 'armv8l') lscpu: failed to determine number of CPUs: /sys/devices/system/cpu/possible: No such file or directory ----------cat /proc/cpuinfo---------- processor : 0 model name : ARMv8 Processor rev 4 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd03 CPU revision : 4 processor : 1 model name : ARMv8 Processor rev 4 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd03 CPU revision : 4 processor : 2 model name : ARMv8 Processor rev 4 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd03 CPU revision : 4 processor : 3 model name : ARMv8 Processor rev 4 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd03 CPU revision : 4 processor : 4 model name : ARMv8 Processor rev 4 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd03 CPU revision : 4 processor : 5 model name : ARMv8 Processor rev 4 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd03 CPU revision : 4 processor : 6 model name : ARMv8 Processor rev 2 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd09 CPU revision : 2 processor : 7 model name : ARMv8 Processor rev 2 (v8l) BogoMIPS : 52.00 Features : half thumb fastmult vfp edsp neon vfpv3 tls vfpv4 idiva idivt lpae evtstrm aes pmull sha1 sha2 crc32 CPU implementer : 0x41 CPU architecture: 8 CPU variant : 0x0 CPU part : 0xd09 CPU revision : 2 ----------Network Test---------- Setting timeout: 10 Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0807 sec, LOAD: 1.7457 sec. Timing for D2L: http://d2l.ai, DNS: 0.0656 sec, LOAD: 0.2946 sec. Timing for FashionMNIST: https://repo.mxnet.io/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.2743 sec, LOAD: 0.9302 sec. Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0487 sec, LOAD: 0.5180 sec. Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0375 sec, LOAD: 0.8872 sec. Timing for GluonNLP: http://gluon-nlp.mxnet.io, DNS: 0.0857 sec, LOAD: 1.1839 sec. Timing for D2L (zh-cn): http://zh.d2l.ai, DNS: 0.0722 sec, LOAD: 0.4554 sec. Timing for GluonNLP GitHub: https://github.com/dmlc/gluon-nlp, DNS: 0.0250 sec, LOAD: 0.7598 sec. ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
