[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

** Tags added: testcase -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10 REGRESSION] Randomly wrongly detects files as binary To manage notifications about this bug go to:

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

** Description changed: I have a folder with a bunch of subfolder and several hundred or thousands files, most of them PHP files (obviously text). I often use grep recursively, like this:   $ grep -R somepattern * Since the upgrade from 15.04 to 15.10, it often happens that a lot

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

** Description changed: I have a folder with a bunch of subfolder and several hundred or thousands files, most of them PHP files (obviously text). I often use grep recursively, like this: - $ grep -R somepattern * +   $ grep -R somepattern * Since the upgrade from 15.04 to 15.10,

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

I am running a Trusty system with grep/2.16-1 and the problem doesn't show up there. I manually installed grep/2.25-1~16.04.1 and grep/2.25-3 to them with the test case in Debian #799956, and they both exhibit the same issue as in the Debian bug. It does seem that it either regressed again or it

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

> Yeah, a wrong one because it has a bug. Which by the way appears to be fixed upstream. ... and apparently regressed again in 2.24 or 2.25.. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

> I see, so I should use the "C" locale, > as that commonly means "I don't care about the encoding". That is JUST A WORKAROUND that seems to work, but that shouldn't be needed. This is NOT the expected behavior. > I understand that grep works in another way now. Yeah, a wrong one because it

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

I see, so I should use the "C" locale, as that commonly means "I don't care about the encoding". Thank you for this information :-) ps/ The 'real' file was not broken, I made this test file with two encodings on purpose for testing. The real file was encoded as iso8859-1, while the default

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

grep 2.25 only stopped treating files as binary under the "C" locale, as that commonly means "I don't care about the encoding". AFAIK the behaviour did not change if you call it under a proper locale such as sv_SE.UTF-8. If you look at the file when it's encoded in a proper locale, it works: $

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

No I still have problems with a file with Swedish characters. In a live Ubuntu 16.04 LTS I installed grep version 2.25-1~16.04.1, but it did not help, as you can see from the following dialogue in a terminal window. ubuntu@ubuntu:~$ apt-cache policy grep grep: Installerad: 2.25-1~16.04.1

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

nio@xenial32 ~ $ grep -V grep (GNU grep) 2.24 Copyright © 2016 Free Software Foundation, Inc. Licens GPLv3+: GNU GPL version 3 eller senare Det här är fri programvara: du får ändra och distribuera den. Det finns INGEN GARANTI, så långt som tillåts enligt lag.

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

sudodus, what version of grep are you using? grep 2.25-1~16.04.1 was released in bug 1547466 and it may fix your issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

** Changed in: grep (Ubuntu) Status: Fix Committed => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10 REGRESSION] Randomly wrongly detects files as binary To

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

** Changed in: grep (Debian) Status: Unknown => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10 REGRESSION] Randomly wrongly detects files as binary To

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Adding to the previous post: This bug does affect Xenial alias 16.04 LTS, at least with typical text files, that contain characters, that belong to my country's standard characters, but are not part of the English standard characters. I think grep should not be sensitive to such characters, and

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

No, it *should not*, but it *does*, at least for me in an updated & dist-upgraded 32-bit version (up to date today). Using the attached file: nio@xenial32 ~ $ cat seen-binary-by-grep.txt vMgsingen l�sning - the Swedish character o-umlaut osmak ingen l�sning smak

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

But it definitely affects Wily -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10 REGRESSION] Randomly wrongly detects files as binary To manage notifications about this bug go

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

And again, I don't think this is the same as bug 1547466 at all, as per comment https://bugs.launchpad.net/ubuntu/+source/grep/+bug/1547466/comments/19 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

** Changed in: grep (Ubuntu) Status: Confirmed => Fix Committed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10 REGRESSION] Randomly wrongly detects files as binary To

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

I don't think this particular bug should affect Xenial. The Debian bug says this was fixed in grep/2.23-1 The related issue in Xenial should be fixed by bug 1547466 ** Tags added: regression-release ** Also affects: grep (Debian) via http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=799956

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Sorry, not sure what you mean exactly by "affecting a release". This issue appeared at some point on wily (with some update, NOT at dist-upgrade) and I wonder how it could be ignored for so long, when it was first reported AND after it turned out that it had wrongly be marked as duplicate. --

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

@ teo If you see that a bug is affecting a release, it is important to enter its first name into the tag list. So I will notice it and promote it. ** Changed in: grep (Ubuntu) Importance: Undecided => High ** Tags added: xenial -- You received this bug notification because you are a member

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Removed duplicate status as per https://bugs.launchpad.net/ubuntu/+source/grep/+bug/1547466/comments/24 ** This bug is no longer a duplicate of bug 1547466 grep switches into binary mode while processing a text file -- You received this bug notification because you are a member of Ubuntu

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

*** This bug is a duplicate of bug 1547466 *** https://bugs.launchpad.net/bugs/1547466 @Brian Murray, I resubscribed you because you marked this issue as duplicate of #1547466, I asked you if you could confirm because that seems doubtful and you didn't reply, and now at 1535458 they say it

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

*** This bug is a duplicate of bug 1547466 *** https://bugs.launchpad.net/bugs/1547466 (btw sorry for subscribing you to the other bug by mistake) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

*** This bug is a duplicate of bug 1547466 *** https://bugs.launchpad.net/bugs/1547466 However, $ LANG=C.UTF-8 grep somestring some_iso8859_file.txt# reproduces the issue ("binary file matches") $ LANG=C grep somestring some_iso8859_file.txt# expected (text) output $

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

*** This bug is a duplicate of bug 1547466 *** https://bugs.launchpad.net/bugs/1547466 Are you sure this is the same as 1547466 ?? 1547466 describes mode switching to binary in the middle of the file. What I observe is that some text files are treated as binary. I never get an output like

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

*** This bug is a duplicate of bug 1547466 *** https://bugs.launchpad.net/bugs/1547466 ** This bug has been marked a duplicate of bug 1547466 grep switches into binary mode while processing a text file -- You received this bug notification because you are a member of Ubuntu Bugs, which

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Actually, the following bug seems more likely the cause of the problem. https://debbugs.gnu.org/cgi/bugreport.cgi?bug=22838 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: [15.10

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Yep, looks like it's that one. So it's fixed upstream. Will it take long to land on Ubuntu? Otherwise, an update rolling back to grep version previous to the regression (which appears to be known) should be urgently released in the meanwhile. This is a pretty critical bug. It's astonishing how

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Is this perhaps related to the following debian bug? https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=799956 ** Bug watch added: Debian Bug tracker #799956 http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=799956 -- You received this bug notification because you are a member of Ubuntu Bugs,

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

For god's sake, this regression is HUGE. It makes the life of any developer a hell and it's been MONTHS. Can't you at least release an update rollinb back to a non-broken version until this is fixed?? -- You received this bug notification because you are a member of Ubuntu Bugs, which is

[Bug 1535458] Re: [15.10 REGRESSION] Randomly wrongly detects files as binary

Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: grep (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1535458 Title: