apeforest opened a new issue #17490: Check failed: pbegin_ <= pend_: Invalid RecordIO Format URL: https://github.com/apache/incubator-mxnet/issues/17490 ## Description Encountered a coredump running unit test under tests/python/unittest/test_io.py ### Error Message ``` test_io.test_Cifar10Rec ... [21:43:43] src/io/iter_image_recordio_2.cc:178: ImageRecordIOParser2: data/cifar/train.rec, use 4 threads for decoding.. [21:43:43] src/io/iter_image_recordio_2.cc:663: Cannot find data/cifar/cifar10_mean.bin: create mean image, this will take some time... [21:43:43] src/io/iter_image_recordio_2.cc:686: 10000 images processed, 0.13458 sec elapsed [21:43:43] src/io/iter_image_recordio_2.cc:686: 20000 images processed, 0.218985 sec elapsed [21:43:43] src/io/iter_image_recordio_2.cc:686: 30000 images processed, 0.303331 sec elapsed terminate called after throwing an instance of 'dmlc::Error' what(): [21:43:43] src/recordio.cc:125: Check failed: pbegin_ <= pend_: Invalid RecordIO Format Stack trace: [bt] (0) /home/ubuntu/src/mxnet/python/mxnet/../../lib/libmxnet.so(dmlc::RecordIOChunkReader::NextRecord(dmlc::InputSplit::Blob*)+0xb1d) [0x7fba51c65d8d] [bt] (1) /home/ubuntu/src/mxnet/python/mxnet/../../lib/libmxnet.so(mxnet::io::ImageRecordIOParser2<float>::ParseChunk(float*, float*, unsigned long, dmlc::InputSplit::Blob*)::{lambda()#1}::operator()() const+0x205) [0x7fba504acf75] [bt] (2) /home/ubuntu/src/mxnet/python/mxnet/../../lib/libmxnet.so(+0x45ffdbe) [0x7fba5049edbe] [bt] (3) /usr/local/lib/libiomp5.so(+0x97d98) [0x7fba5ad1ed98] [bt] (4) /usr/local/lib/libiomp5.so(__kmp_invoke_microtask+0x93) [0x7fba5ad6c743] [bt] (5) /usr/local/lib/libiomp5.so(+0xab32a) [0x7fba5ad3232a] [bt] (6) /usr/local/lib/libiomp5.so(+0xaa8ab) [0x7fba5ad318ab] [bt] (7) /usr/local/lib/libiomp5.so(+0xe5bb1) [0x7fba5ad6cbb1] [bt] (8) /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7fba625476ba] Aborted (core dumped) ``` ## To Reproduce ### Steps to reproduce 1. pip install https://apache-mxnet.s3-us-west-2.amazonaws.com/dist/2020-01-30/dist/mxnet_mkl-1.6.0b20200130-py2.py3-none-manylinux1_x86_64.whl 2. nosetests -v tests/python/unittest/test_io.py ## What have you tried to solve it? 1. Build from source 2. build from nightly pip ## Environment ``` ----------Python Info---------- Version : 3.6.6 Compiler : GCC 7.2.0 Build : ('default', 'Jun 28 2018 17:14:51') Arch : ('64bit', '') ------------Pip Info----------- Version : 19.3.1 Directory : /home/ubuntu/.virtualenvs/mxnet/lib/python3.6/site-packages/pip ----------MXNet Info----------- Version : 1.6.0 Directory : /home/ubuntu/.virtualenvs/mxnet/lib/python3.6/site-packages/mxnet Num GPUs : 0 Hashtag not found. Not installed from pre-built package. ----------System Info---------- Platform : Linux-4.4.0-1100-aws-x86_64-with-debian-stretch-sid system : Linux node : ip-172-31-45-221 release : 4.4.0-1100-aws version : #111-Ubuntu SMP Wed Dec 4 12:20:15 UTC 2019 ----------Hardware Info---------- machine : x86_64 processor : x86_64 Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 36 On-line CPU(s) list: 0-35 Thread(s) per core: 2 Core(s) per socket: 18 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Platinum 8124M CPU @ 3.00GHz Stepping: 4 CPU MHz: 3000.000 BogoMIPS: 6000.00 Hypervisor vendor: KVM Virtualization type: full L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 25344K NUMA node0 CPU(s): 0-35 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology nonstop_tsc aperfmperf tsc_known_freq pni pclmulqdq monitor ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single kaiser fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f rdseed adx smap clflushopt clwb avx512cd xsaveopt xsavec xgetbv1 ida arat pku ----------Network Test---------- Setting timeout: 10 Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0013 sec, LOAD: 0.5835 sec. Timing for GluonNLP GitHub: https://github.com/dmlc/gluon-nlp, DNS: 0.0002 sec, LOAD: 0.5206 sec. Timing for GluonNLP: http://gluon-nlp.mxnet.io, DNS: 0.0325 sec, LOAD: 0.5859 sec. Timing for D2L: http://d2l.ai, DNS: 0.1733 sec, LOAD: 0.2327 sec. Timing for D2L (zh-cn): http://zh.d2l.ai, DNS: 0.1724 sec, LOAD: 0.0659 sec. Timing for FashionMNIST: https://repo.mxnet.io/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.0668 sec, LOAD: 0.3681 sec. Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0011 sec, LOAD: 0.3601 sec. Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0116 sec, LOAD: 0.0876 sec. ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
