On Tue, Oct 18, 2016 at 12:05:13PM +0100, Chris Lamb wrote: > Could you re-run the testsuite with: > > -vv -r sxX > > ... or similar? :) Many thanks.
Using '-vvv -r sxX' with pytest 2.7.3, the output of the test suite is below. Please let me know if you need any more information. ============================= test session starts ============================== platform linux -- Python 3.5.2 -- py-1.4.31 -- pytest-2.7.3 -- /gnu/store/yrb0g5nd880b21x4g98mgxlzq9218pvy-python-wrapper-3.5.2/bin/python rootdir: /tmp/guix-build-diffoscope-61.drv-0/diffoscope-61, inifile: collecting ... collected 247 items tests/test_difference.py::test_too_much_input_for_diff PASSED tests/test_difference.py::test_too_long_diff_block_lines PASSED tests/test_difference.py::test_non_str_arguments_to_source1_source2 PASSED tests/test_main.py::test_non_existing_files PASSED tests/test_main.py::test_non_existing_left_with_new_file PASSED tests/test_main.py::test_non_existing_right_with_new_file PASSED tests/test_main.py::test_non_existing_files_with_new_file PASSED tests/test_main.py::test_remove_temp_files_on_sigterm PASSED tests/test_main.py::test_ctrl_c_handling PASSED tests/test_main.py::test_text_option_with_file PASSED tests/test_main.py::test_text_option_with_stdiout PASSED tests/test_main.py::test_no_report_option PASSED tests/test_main.py::test_html_option_with_file PASSED tests/test_main.py::test_html_option_with_stdout PASSED tests/test_main.py::test_no_differences PASSED tests/test_main.py::test_list_tools PASSED tests/comparators/test_binary.py::test_same_content PASSED tests/comparators/test_binary.py::test_not_same_content PASSED tests/comparators/test_binary.py::test_guess_file_type PASSED tests/comparators/test_binary.py::test_guess_encoding_binary PASSED tests/comparators/test_binary.py::test_guess_encoding_ascii PASSED tests/comparators/test_binary.py::test_guess_encoding_unicode PASSED tests/comparators/test_binary.py::test_guess_encoding_iso8859 PASSED tests/comparators/test_binary.py::test_no_differences_with_xxd PASSED tests/comparators/test_binary.py::test_compare_with_xxd SKIPPED tests/comparators/test_binary.py::test_compare_non_existing_with_xxd PASSED tests/comparators/test_binary.py::test_no_differences_without_xxd PASSED tests/comparators/test_binary.py::test_compare_without_xxd PASSED tests/comparators/test_binary.py::test_with_compare_details PASSED tests/comparators/test_binary.py::test_with_compare_details_and_fallback SKIPPED tests/comparators/test_binary.py::test_with_compare_details_and_no_actual_differences PASSED tests/comparators/test_binary.py::test_with_compare_details_and_failed_process SKIPPED tests/comparators/test_binary.py::test_with_compare_details_and_tool_not_found SKIPPED tests/comparators/test_binary.py::test_compare_two_nonexisting_files PASSED tests/comparators/test_binary.py::test_symlink_to_dir PASSED tests/comparators/test_bzip2.py::test_identification PASSED tests/comparators/test_bzip2.py::test_no_differences PASSED tests/comparators/test_bzip2.py::test_content_source PASSED tests/comparators/test_bzip2.py::test_content_source_without_extension PASSED tests/comparators/test_bzip2.py::test_content_diff PASSED tests/comparators/test_bzip2.py::test_compare_non_existing PASSED tests/comparators/test_cbfs.py::test_identification_using_offset SKIPPED tests/comparators/test_cbfs.py::test_identification_without_offset SKIPPED tests/comparators/test_cbfs.py::test_no_differences SKIPPED tests/comparators/test_cbfs.py::test_listing SKIPPED tests/comparators/test_cbfs.py::test_content SKIPPED tests/comparators/test_cbfs.py::test_compare_non_existing SKIPPED tests/comparators/test_cpio.py::test_identification PASSED tests/comparators/test_cpio.py::test_no_differences PASSED tests/comparators/test_cpio.py::test_listing SKIPPED tests/comparators/test_cpio.py::test_symlink SKIPPED tests/comparators/test_cpio.py::test_compressed_files SKIPPED tests/comparators/test_cpio.py::test_compare_non_existing SKIPPED tests/comparators/test_deb.py::test_identification PASSED tests/comparators/test_deb.py::test_no_differences PASSED tests/comparators/test_deb.py::test_metadata PASSED tests/comparators/test_deb.py::test_compressed_files PASSED tests/comparators/test_deb.py::test_identification_of_md5sums_outside_deb PASSED tests/comparators/test_deb.py::test_identification_of_md5sums_in_deb PASSED tests/comparators/test_deb.py::test_md5sums PASSED tests/comparators/test_deb.py::test_identical_files_in_md5sums PASSED tests/comparators/test_deb.py::test_identification_of_data_tar PASSED tests/comparators/test_deb.py::test_skip_comparison_of_known_identical_files PASSED tests/comparators/test_deb.py::test_compare_non_existing PASSED tests/comparators/test_debian.py::test_dot_changes_identification PASSED tests/comparators/test_debian.py::test_dot_changes_invalid PASSED tests/comparators/test_debian.py::test_dot_changes_no_differences PASSED tests/comparators/test_debian.py::test_dot_changes_description PASSED tests/comparators/test_debian.py::test_dot_changes_internal_diff PASSED tests/comparators/test_debian.py::test_dot_changes_compare_non_existing PASSED tests/comparators/test_debian.py::test_dot_changes_no_differences_exclude_buildinfo PASSED tests/comparators/test_debian.py::test_dot_changes_identical_contents_and_different_files PASSED tests/comparators/test_debian.py::test_dot_changes_different_contents_and_identical_files PASSED tests/comparators/test_debian.py::test_dot_dsc_identification PASSED tests/comparators/test_debian.py::test_dot_dsc_invalid PASSED tests/comparators/test_debian.py::test_dot_dsc_no_differences PASSED tests/comparators/test_debian.py::test_dot_dsc_internal_diff PASSED tests/comparators/test_debian.py::test_dot_dsc_compare_non_existing PASSED tests/comparators/test_debian.py::test_dot_buildinfo_identification PASSED tests/comparators/test_debian.py::test_dot_buildinfo_invalid PASSED tests/comparators/test_debian.py::test_dot_buildinfo_no_differences PASSED tests/comparators/test_debian.py::test_dot_buildinfo_internal_diff PASSED tests/comparators/test_debian.py::test_dot_buildinfo_compare_non_existing PASSED tests/comparators/test_dex.py::test_identification PASSED tests/comparators/test_dex.py::test_no_differences PASSED tests/comparators/test_dex.py::test_differences SKIPPED tests/comparators/test_dex.py::test_compare_non_existing SKIPPED tests/comparators/test_directory.py::test_no_differences PASSED tests/comparators/test_directory.py::test_no_differences_with_extra_slash PASSED tests/comparators/test_directory.py::test_content PASSED tests/comparators/test_directory.py::test_stat PASSED tests/comparators/test_elf.py::test_obj_identification PASSED tests/comparators/test_elf.py::test_obj_no_differences PASSED tests/comparators/test_elf.py::test_obj_compare_non_existing PASSED tests/comparators/test_elf.py::test_diff PASSED tests/comparators/test_elf.py::test_lib_identification PASSED tests/comparators/test_elf.py::test_lib_no_differences PASSED tests/comparators/test_elf.py::test_lib_differences PASSED tests/comparators/test_elf.py::test_lib_compare_non_existing PASSED tests/comparators/test_elf.py::test_differences_with_dbgsym PASSED tests/comparators/test_elf.py::test_original_gnu_debuglink PASSED tests/comparators/test_epub.py::test_identification PASSED tests/comparators/test_epub.py::test_no_differences PASSED tests/comparators/test_epub.py::test_differences SKIPPED tests/comparators/test_epub.py::test_compare_non_existing SKIPPED tests/comparators/test_fonts.py::test_identification PASSED tests/comparators/test_fonts.py::test_no_differences PASSED tests/comparators/test_fonts.py::test_diff SKIPPED tests/comparators/test_fonts.py::test_compare_non_existing SKIPPED tests/comparators/test_fsimage.py::test_identification PASSED tests/comparators/test_fsimage.py::test_no_differences SKIPPED tests/comparators/test_fsimage.py::test_differences SKIPPED tests/comparators/test_fsimage.py::test_compare_non_existing SKIPPED tests/comparators/test_gettext.py::test_identification PASSED tests/comparators/test_gettext.py::test_no_differences PASSED tests/comparators/test_gettext.py::test_diff SKIPPED tests/comparators/test_gettext.py::test_charsets SKIPPED tests/comparators/test_gettext.py::test_compare_non_existing SKIPPED tests/comparators/test_git.py::test_identification PASSED tests/comparators/test_git.py::test_no_differences PASSED tests/comparators/test_git.py::test_diff PASSED tests/comparators/test_gzip.py::test_identification PASSED tests/comparators/test_gzip.py::test_no_differences PASSED tests/comparators/test_gzip.py::test_metadata PASSED tests/comparators/test_gzip.py::test_content_source PASSED tests/comparators/test_gzip.py::test_content_source_without_extension PASSED tests/comparators/test_gzip.py::test_content_diff PASSED tests/comparators/test_gzip.py::test_compare_non_existing PASSED tests/comparators/test_haskell.py::test_identification SKIPPED tests/comparators/test_haskell.py::test_no_differences PASSED tests/comparators/test_haskell.py::test_diff SKIPPED tests/comparators/test_icc.py::test_identification PASSED tests/comparators/test_icc.py::test_no_differences PASSED tests/comparators/test_icc.py::test_diff SKIPPED tests/comparators/test_icc.py::test_compare_non_existing SKIPPED tests/comparators/test_image.py::test_identification PASSED tests/comparators/test_image.py::test_no_differences PASSED tests/comparators/test_image.py::test_diff SKIPPED tests/comparators/test_image.py::test_compare_non_existing SKIPPED tests/comparators/test_ipk.py::test_identification PASSED tests/comparators/test_ipk.py::test_no_differences PASSED tests/comparators/test_ipk.py::test_metadata PASSED tests/comparators/test_ipk.py::test_compressed_files PASSED tests/comparators/test_ipk.py::test_compare_non_existing PASSED tests/comparators/test_iso9660.py::test_identification PASSED tests/comparators/test_iso9660.py::test_no_differences PASSED tests/comparators/test_iso9660.py::test_iso9660_content SKIPPED tests/comparators/test_iso9660.py::test_iso9660_rockridge SKIPPED tests/comparators/test_iso9660.py::test_symlink SKIPPED tests/comparators/test_iso9660.py::test_compressed_files SKIPPED tests/comparators/test_iso9660.py::test_compare_non_existing SKIPPED tests/comparators/test_java.py::test_identification PASSED tests/comparators/test_java.py::test_no_differences PASSED tests/comparators/test_java.py::test_diff SKIPPED tests/comparators/test_java.py::test_compare_non_existing SKIPPED tests/comparators/test_json.py::test_identification PASSED tests/comparators/test_json.py::test_no_differences PASSED tests/comparators/test_json.py::test_diff PASSED tests/comparators/test_json.py::test_compare_non_existing PASSED tests/comparators/test_macho.py::test_obj_identification PASSED tests/comparators/test_macho.py::test_obj_no_differences PASSED tests/comparators/test_macho.py::test_obj_compare_non_existing SKIPPED tests/comparators/test_macho.py::test_diff SKIPPED tests/comparators/test_mono.py::test_identification PASSED tests/comparators/test_mono.py::test_no_differences PASSED tests/comparators/test_mono.py::test_diff SKIPPED tests/comparators/test_mono.py::test_compare_non_existing SKIPPED tests/comparators/test_pdf.py::test_identification PASSED tests/comparators/test_pdf.py::test_no_differences PASSED tests/comparators/test_pdf.py::test_text_diff SKIPPED tests/comparators/test_pdf.py::test_internal_diff SKIPPED tests/comparators/test_pdf.py::test_compare_non_existing SKIPPED tests/comparators/test_png.py::test_identification PASSED tests/comparators/test_png.py::test_no_differences PASSED tests/comparators/test_png.py::test_diff SKIPPED tests/comparators/test_png.py::test_compare_non_existing SKIPPED tests/comparators/test_ppu.py::test_identification SKIPPED tests/comparators/test_ppu.py::test_no_differences PASSED tests/comparators/test_ppu.py::test_diff SKIPPED tests/comparators/test_ppu.py::test_compare_non_existing SKIPPED tests/comparators/test_ps.py::test_identification PASSED tests/comparators/test_ps.py::test_no_differences PASSED tests/comparators/test_ps.py::test_internal_diff SKIPPED tests/comparators/test_ps.py::test_text_diff SKIPPED tests/comparators/test_ps.py::test_compare_non_existing SKIPPED tests/comparators/test_rlib.py::test_identification PASSED tests/comparators/test_rlib.py::test_no_differences PASSED tests/comparators/test_rlib.py::test_num_items PASSED tests/comparators/test_rlib.py::test_item0_armap PASSED tests/comparators/test_rlib.py::test_item1_elf PASSED tests/comparators/test_rlib.py::test_item2_rust_metadata_bin PASSED tests/comparators/test_rlib.py::test_item3_deflate_llvm_bitcode SKIPPED tests/comparators/test_rlib.py::test_compare_non_existing PASSED tests/comparators/test_rpm.py::test_identification PASSED tests/comparators/test_rpm.py::test_no_differences SKIPPED tests/comparators/test_rpm.py::test_header SKIPPED tests/comparators/test_rpm.py::test_listing SKIPPED tests/comparators/test_rpm.py::test_content SKIPPED tests/comparators/test_rpm.py::test_compare_non_existing SKIPPED tests/comparators/test_sqlite.py::test_identification PASSED tests/comparators/test_sqlite.py::test_no_differences PASSED tests/comparators/test_sqlite.py::test_diff SKIPPED tests/comparators/test_sqlite.py::test_compare_non_existing SKIPPED tests/comparators/test_squashfs.py::test_identification PASSED tests/comparators/test_squashfs.py::test_no_differences PASSED tests/comparators/test_squashfs.py::test_no_warnings PASSED tests/comparators/test_squashfs.py::test_superblock FAILED tests/comparators/test_squashfs.py::test_symlink SKIPPED tests/comparators/test_squashfs.py::test_compressed_files SKIPPED tests/comparators/test_squashfs.py::test_compare_non_existing SKIPPED tests/comparators/test_tar.py::test_identification PASSED tests/comparators/test_tar.py::test_no_differences PASSED tests/comparators/test_tar.py::test_listing PASSED tests/comparators/test_tar.py::test_symlinks PASSED tests/comparators/test_tar.py::test_text_file PASSED tests/comparators/test_tar.py::test_compare_non_existing PASSED tests/comparators/test_tar.py::test_no_permissions_dir_in_tarball PASSED tests/comparators/test_text.py::test_no_differences PASSED tests/comparators/test_text.py::test_difference_in_ascii PASSED tests/comparators/test_text.py::test_difference_in_unicode PASSED tests/comparators/test_text.py::test_difference_between_iso88591_and_unicode PASSED tests/comparators/test_text.py::test_difference_between_iso88591_and_unicode_only PASSED tests/comparators/test_text.py::test_compare_non_existing PASSED tests/comparators/test_utils.py::test_tools_missing PASSED tests/comparators/test_utils.py::test_skip_unless_tools_exist_empty SKIPPED tests/comparators/test_utils.py::test_skip_unless_tools_exist_missing SKIPPED tests/comparators/test_utils.py::test_fuzzy_matching PASSED tests/comparators/test_utils.py::test_fuzzy_matching_only_once PASSED tests/comparators/test_utils.py::test_no_fuzzy_matching PASSED tests/comparators/test_utils.py::test_no_fuzzy_matching_new_file PASSED tests/comparators/test_utils.py::test_trim_stderr_in_command PASSED tests/comparators/test_xz.py::test_identification PASSED tests/comparators/test_xz.py::test_no_differences PASSED tests/comparators/test_xz.py::test_content_source PASSED tests/comparators/test_xz.py::test_content_source_without_extension PASSED tests/comparators/test_xz.py::test_content_diff PASSED tests/comparators/test_xz.py::test_compare_non_existing PASSED tests/comparators/test_zip.py::test_identification PASSED tests/comparators/test_zip.py::test_no_differences PASSED tests/comparators/test_zip.py::test_metadata SKIPPED tests/comparators/test_zip.py::test_compressed_files SKIPPED tests/comparators/test_zip.py::test_compare_non_existing SKIPPED tests/comparators/test_zip.py::test_mozzip_identification PASSED tests/comparators/test_zip.py::test_mozzip_no_differences PASSED tests/comparators/test_zip.py::test_mozzip_metadata SKIPPED tests/comparators/test_zip.py::test_mozzip_compressed_files SKIPPED tests/comparators/test_zip.py::test_mozzip_compare_non_existing SKIPPED =================================== FAILURES =================================== _______________________________ test_superblock ________________________________ differences = [] @skip_unless_tool_is_older_than('unsquashfs', unsquashfs_version, '4.3') def test_superblock(differences): expected_diff = open(data('squashfs_superblock_expected_diff')).read() > assert differences[0].unified_diff == expected_diff E IndexError: list index out of range tests/comparators/test_squashfs.py:59: IndexError =========================== short test summary info ============================ SKIP [1] tests/comparators/test_dex.py:56: requires enjarify and zipinfo and javap SKIP [1] tests/comparators/test_zip.py:87: requires zipinfo SKIP [1] tests/comparators/test_cpio.py:53: requires cpio SKIP [1] tests/comparators/test_fsimage.py:50: guestfs is missing SKIP [1] tests/comparators/test_epub.py:54: requires zipinfo SKIP [1] tests/comparators/test_pdf.py:40: requires pdftk and pdftotext SKIP [1] tests/comparators/test_icc.py:46: requires cd-iccdump SKIP [1] tests/comparators/test_haskell.py:43: requires ghc SKIP [1] tests/comparators/test_binary.py:122: requires xxd SKIP [1] tests/comparators/test_iso9660.py:41: requires isoinfo SKIP [1] tests/comparators/test_iso9660.py:64: requires isoinfo SKIP [1] tests/comparators/test_cpio.py:41: requires cpio SKIP [1] tests/comparators/test_rlib.py:69: requires llvm-dis SKIP [1] tests/comparators/test_mono.py:51: requires pedump SKIP [1] tests/comparators/test_rpm.py:61: rpm module is not installed SKIP [1] tests/comparators/test_sqlite.py:45: requires sqlite3 SKIP [1] tests/comparators/test_ppu.py:48: requires ppudump SKIP [1] tests/comparators/test_png.py:40: requires sng SKIP [1] tests/comparators/test_rpm.py:69: rpm module is not installed SKIP [1] tests/comparators/test_squashfs.py:73: requires unsquashfs SKIP [1] tests/comparators/test_zip.py:45: requires zipinfo SKIP [1] tests/comparators/test_utils.py:45: requires SKIP [1] tests/comparators/test_zip.py:52: requires zipinfo SKIP [1] tests/comparators/test_cpio.py:60: requires cpio SKIP [1] tests/comparators/test_gettext.py:42: requires msgunfmt SKIP [1] tests/comparators/test_epub.py:41: requires zipinfo SKIP [1] tests/comparators/test_iso9660.py:46: requires isoinfo SKIP [1] tests/comparators/test_cpio.py:46: requires cpio SKIP [1] tests/comparators/test_fonts.py:42: requires showttf SKIP [1] tests/comparators/test_binary.py:135: requires xxd SKIP [1] tests/comparators/test_image.py:41: requires img2txt SKIP [1] tests/comparators/test_pdf.py:45: requires pdftk and pdftotext SKIP [1] tests/comparators/test_icc.py:41: requires cd-iccdump SKIP [1] tests/comparators/test_binary.py:72: requires xxd SKIP [1] tests/comparators/test_cbfs.py:75: requires cbfstool SKIP [1] tests/comparators/test_iso9660.py:51: requires isoinfo SKIP [1] tests/comparators/test_rpm.py:37: rpm module is not installed SKIP [1] tests/comparators/test_java.py:41: requires javap SKIP [1] tests/comparators/test_fsimage.py:79: guestfs is missing SKIP [1] tests/comparators/test_sqlite.py:40: requires sqlite3 SKIP [1] tests/comparators/test_ppu.py:36: requires ppudump SKIP [1] tests/comparators/test_fonts.py:47: requires showttf SKIP [1] tests/comparators/test_utils.py:49: requires /missing SKIP [1] tests/comparators/test_binary.py:105: requires xxd SKIP [1] tests/comparators/test_ppu.py:54: requires ppudump SKIP [1] tests/comparators/test_ps.py:50: requires ps2ascii SKIP [1] tests/comparators/test_zip.py:40: requires zipinfo SKIP [1] tests/comparators/test_cbfs.py:60: requires cbfstool SKIP [1] tests/comparators/test_cbfs.py:87: requires cbfstool SKIP [1] tests/comparators/test_pdf.py:50: requires pdftk and pdftotext SKIP [1] tests/comparators/test_cbfs.py:80: requires cbfstool SKIP [1] tests/comparators/test_java.py:46: requires javap SKIP [1] tests/comparators/test_image.py:46: requires img2txt SKIP [1] tests/comparators/test_png.py:45: requires sng SKIP [1] tests/comparators/test_gettext.py:50: requires msgunfmt SKIP [1] tests/comparators/test_dex.py:42: requires enjarify and zipinfo and javap SKIP [1] tests/comparators/test_fsimage.py:61: guestfs is missing SKIP [1] tests/comparators/test_ps.py:40: requires ps2ascii SKIP [1] tests/comparators/test_cbfs.py:64: requires cbfstool SKIP [1] tests/comparators/test_squashfs.py:60: requires unsquashfs SKIP [1] tests/comparators/test_zip.py:80: requires zipinfo SKIP [1] tests/comparators/test_mono.py:46: requires pedump SKIP [1] tests/comparators/test_squashfs.py:66: requires unsquashfs SKIP [1] tests/comparators/test_cbfs.py:56: requires cbfstool SKIP [1] tests/comparators/test_macho.py:50: requires otool and lipo SKIP [1] tests/comparators/test_haskell.py:29: requires ghc SKIP [1] tests/comparators/test_macho.py:43: requires otool and lipo SKIP [1] tests/comparators/test_ps.py:45: requires ps2ascii SKIP [1] tests/comparators/test_rpm.py:46: rpm module is not installed SKIP [1] tests/comparators/test_zip.py:73: requires zipinfo SKIP [1] tests/comparators/test_iso9660.py:57: requires isoinfo SKIP [1] tests/comparators/test_rpm.py:53: rpm module is not installed SKIP [1] tests/comparators/test_gettext.py:56: requires msgunfmt ============== 1 failed, 173 passed, 73 skipped in 12.58 seconds =============== _______________________________________________ Reproducible-builds mailing list Reproducible-builds@lists.alioth.debian.org http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/reproducible-builds