Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
пт, 11 мар. 2022 г. в 20:49, Mark Knecht : > > On Fri, Mar 11, 2022 at 10:48 AM gevisz wrote: > > > > > In addition to the old CPU, I have quite an old video card, > > namely, ATI R4770. However, I still believe that it is possible > > to compile tensorflow so that it could run on my hardware. > > At least, I did it for tensorflow-2.7.0 on 21-11-2021. > > > > Stay safe and return to us when you can. Thank you. > As for me I moved on and bought a new computer so my > hardware issues with tensorflow are behind me for now. Yes, probably, it would be the solution.
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
On Fri, Mar 11, 2022 at 10:48 AM gevisz wrote: > > In addition to the old CPU, I have quite an old video card, > namely, ATI R4770. However, I still believe that it is possible > to compile tensorflow so that it could run on my hardware. > At least, I did it for tensorflow-2.7.0 on 21-11-2021. > Stay safe and return to us when you can. As for me I moved on and bought a new computer so my hardware issues with tensorflow are behind me for now. Cheers, Mark
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
пн, 10 янв. 2022 г. в 18:16, Mark Knecht : > > > > > > Thank you for your reply, Mark. > > > > Unfortunately, you missed my previous message in this thread > > where I wrote that I do have Ubuntu 20.04 on the same computer. > > However, tensorflow fails to run on it because it is not compiled > > to be inconsistent with my videocard. So, Gentoo is my only option > > for this hardware. > > > > > My apologies. This thread has gone on for a while and I had to review > to get caught up. > > OK, so assuming I understand correctly (please correct me if I do > not) then you are talking about ONE computer that uses an AMD > Phenom II X4 processor. This computer dual boots, or is a Gentoo > machine with an Ubuntu VM. It is a dual boot. (Sorry for the late reply.) > In an earlier response to this thread you showed the flags > supported by this processor which did not include > the AVX, AVX2 or the FMA3/FMA4 flags. It is my > understanding that this processor cannot run the > current versions of tensorflow whether you compile > it yourself or not, at least in the non-GPU version. My hardware cannot run tensorflow precompiled by Ubuntu. However, some versions of tensorflow successfully compile and run in Gentoo: - all versions of tensorflow-2.5 fail to compile in Gentoo; - tensorflow-2.7.0 successfully compiled on 21-11-2021; - on 30-12-2021 recompilation of the same tensorflow-2.7.0 failed because of some changed dependencies; - I have not yet tried to compile tensorflow-2.8.0. Actually, I gave up trying to compile it and deleted it from my system. Moreover, I am not going to compile it in the near future as I am now in the war zone. > WRT to your video card, tensorflow does not require the use > of a GPU. There are two versions, tensorflow-cpu and > tensorflow-gpu. If you were to build the -cpu version then it > is my understanding it would run an a headless machine, > presuming the processor has AVX/AVX2/FMA hardware > support. > > If the processor DOES have AVX/FMA support but you were having > problems emerging TF in Gentoo then a virtual machine running > Ubuntu might have helped you as you could use a precompiled > apt or snap package. However I don't think anything gets you > past not having AVX/FMA hardware support. > > I am in the same situation. My big machine is an Intel i7 980 > Extreme. I used to be able to run TF but have not been able > to since Google raised the CPU requirements. > > If I am not understanding your hardware setup, or you think > there is a path around the AVX/FMA hardware problem > please let me know and I'll explore it more deeply with you. In addition to the old CPU, I have quite an old video card, namely, ATI R4770. However, I still believe that it is possible to compile tensorflow so that it could run on my hardware. At least, I did it for tensorflow-2.7.0 on 21-11-2021.
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
> > Thank you for your reply, Mark. > > Unfortunately, you missed my previous message in this thread > where I wrote that I do have Ubuntu 20.04 on the same computer. > However, tensorflow fails to run on it because it is not compiled > to be inconsistent with my videocard. So, Gentoo is my only option > for this hardware. > My apologies. This thread has gone on for a while and I had to review to get caught up. OK, so assuming I understand correctly (please correct me if I do not) then you are talking about ONE computer that uses an AMD Phenom II X4 processor. This computer dual boots, or is a Gentoo machine with an Ubuntu VM. In an earlier response to this thread you showed the flags supported by this processor which did not include the AVX, AVX2 or the FMA3/FMA4 flags. It is my understanding that this processor cannot run the current versions of tensorflow whether you compile it yourself or not, at least in the non-GPU version. WRT to your video card, tensorflow does not require the use of a GPU. There are two versions, tensorflow-cpu and tensorflow-gpu. If you were to build the -cpu version then it is my understanding it would run an a headless machine, presuming the processor has AVX/AVX2/FMA hardware support. If the processor DOES have AVX/FMA support but you were having problems emerging TF in Gentoo then a virtual machine running Ubuntu might have helped you as you could use a precompiled apt or snap package. However I don't think anything gets you past not having AVX/FMA hardware support. I am in the same situation. My big machine is an Intel i7 980 Extreme. I used to be able to run TF but have not been able to since Google raised the CPU requirements. If I am not understanding your hardware setup, or you think there is a path around the AVX/FMA hardware problem please let me know and I'll explore it more deeply with you. Cheers, Mark
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
On 09/01/2022 23:29, gevisz wrote: Unfortunately, you missed my previous message in this thread where I wrote that I do have Ubuntu 20.04 on the same computer. However, tensorflow fails to run on it because it is not compiled to be inconsistent with my videocard. So, Gentoo is my only option for this hardware. Can't you download the Ubuntu version and compile it for your video card there? There should be somewhere you can just download the same version they've built and tweak it for your hardware? Cheers, Wol
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
пн, 10 янв. 2022 г. в 01:29, gevisz : > > вс, 9 янв. 2022 г. в 16:52, Mark Knecht : > > > > On Sun, Jan 9, 2022 at 3:59 AM gevisz wrote: > > > > > > вс, 21 нояб. 2021 г. в 17:12, Mark Knecht : > > > > > > > > Congrats! > > > > > > Thank you. However, it was not for long. On 30-12-2021 recompilation > > > of the same tensorflow-2.7.0 because of some changed dependencies > > > failed with the same f**ng "Bazel failed" error as before. > > > > > > So, I am currently going to degrade my Gentoo system to the state it > > > was in on 12-12-2021, when its last update was successful and froze it > > > forever. > > > > > > The problem is that I do not know how to do it but I am going to post > > > this question as a separate thread. (I am using webrsync method.) > > > > > > > Sorry for the problems. I saw your other thread about downgrading > > Gentoo. I agree with the other responses you got there that Gentoo, in > > general, does not support standing still much less going backward. > > > > I will offer what will probably not be a popular comment but my > > opinion is Gentoo is exactly the wrong sort of distribution for doing > > work in tensorflow. With all of it's updates, limited testing of > > packages, extreme amounts of code building, and not being a distro > > that the official tensorflow folks even verify on, it's just too hard. > > (And a contributing factor to how I moved away in the beginning.) > > > > My thought is that you might create a 20.04 LTS Ubuntu VM (or possibly > > an LXC container) running whatever your desktop flavor of Gentoo is - > > I run Kubuntu - and just run tensorflow in the VM. You won't easily > > get GPU support unless you deal with passthrough, but the software > > will just work and you won't spend time dealing with building code > > which can be spent coding tensorflow. > > > > If you insist on running in Gentoo consider the LXD container running > > an older rev of Gentoo. (If you can find one) Get it working, if you > > can, and then never update it. > > > > lxc image list images: gentoo > > > > There are openrc and systemd versions available, but a Kubuntu stable > > container would more likely to 'just work' IMO. > > Thank you for your reply, Mark. > > Unfortunately, you missed my previous message in this thread > where I wrote that I do have Ubuntu 20.04 on the same computer. Correction: > However, tensorflow fails to run on it because it is compiled > to be inconsistent with my videocard. So, Gentoo is my only option > for this hardware.
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
вс, 9 янв. 2022 г. в 16:52, Mark Knecht : > > On Sun, Jan 9, 2022 at 3:59 AM gevisz wrote: > > > > вс, 21 нояб. 2021 г. в 17:12, Mark Knecht : > > > > > > Congrats! > > > > Thank you. However, it was not for long. On 30-12-2021 recompilation > > of the same tensorflow-2.7.0 because of some changed dependencies > > failed with the same f**ng "Bazel failed" error as before. > > > > So, I am currently going to degrade my Gentoo system to the state it > > was in on 12-12-2021, when its last update was successful and froze it > > forever. > > > > The problem is that I do not know how to do it but I am going to post > > this question as a separate thread. (I am using webrsync method.) > > > > Sorry for the problems. I saw your other thread about downgrading > Gentoo. I agree with the other responses you got there that Gentoo, in > general, does not support standing still much less going backward. > > I will offer what will probably not be a popular comment but my > opinion is Gentoo is exactly the wrong sort of distribution for doing > work in tensorflow. With all of it's updates, limited testing of > packages, extreme amounts of code building, and not being a distro > that the official tensorflow folks even verify on, it's just too hard. > (And a contributing factor to how I moved away in the beginning.) > > My thought is that you might create a 20.04 LTS Ubuntu VM (or possibly > an LXC container) running whatever your desktop flavor of Gentoo is - > I run Kubuntu - and just run tensorflow in the VM. You won't easily > get GPU support unless you deal with passthrough, but the software > will just work and you won't spend time dealing with building code > which can be spent coding tensorflow. > > If you insist on running in Gentoo consider the LXD container running > an older rev of Gentoo. (If you can find one) Get it working, if you > can, and then never update it. > > lxc image list images: gentoo > > There are openrc and systemd versions available, but a Kubuntu stable > container would more likely to 'just work' IMO. Thank you for your reply, Mark. Unfortunately, you missed my previous message in this thread where I wrote that I do have Ubuntu 20.04 on the same computer. However, tensorflow fails to run on it because it is not compiled to be inconsistent with my videocard. So, Gentoo is my only option for this hardware.
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
On Sun, Jan 9, 2022 at 3:59 AM gevisz wrote: > > вс, 21 нояб. 2021 г. в 17:12, Mark Knecht : > > > > Congrats! > > Thank you. However, it was not for long. On 30-12-2021 recompilation > of the same tensorflow-2.7.0 because of some changed dependencies > failed with the same f**ng "Bazel failed" error as before. > > So, I am currently going to degrade my Gentoo system to the state it > was in on 12-12-2021, when its last update was successful and froze it > forever. > > The problem is that I do not know how to do it but I am going to post > this question as a separate thread. (I am using webrsync method.) > Sorry for the problems. I saw your other thread about downgrading Gentoo. I agree with the other responses you got there that Gentoo, in general, does not support standing still much less going backward. I will offer what will probably not be a popular comment but my opinion is Gentoo is exactly the wrong sort of distribution for doing work in tensorflow. With all of it's updates, limited testing of packages, extreme amounts of code building, and not being a distro that the official tensorflow folks even verify on, it's just too hard. (And a contributing factor to how I moved away in the beginning.) My thought is that you might create a 20.04 LTS Ubuntu VM (or possibly an LXC container) running whatever your desktop flavor of Gentoo is - I run Kubuntu - and just run tensorflow in the VM. You won't easily get GPU support unless you deal with passthrough, but the software will just work and you won't spend time dealing with building code which can be spent coding tensorflow. If you insist on running in Gentoo consider the LXD container running an older rev of Gentoo. (If you can find one) Get it working, if you can, and then never update it. lxc image list images: gentoo There are openrc and systemd versions available, but a Kubuntu stable container would more likely to 'just work' IMO. Good luck, Mark
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
вс, 21 нояб. 2021 г. в 17:12, Mark Knecht : > > Congrats! Thank you. However, it was not for long. On 30-12-2021 recompilation of the same tensorflow-2.7.0 because of some changed dependencies failed with the same f**ng "Bazel failed" error as before. So, I am currently going to degrade my Gentoo system to the state it was in on 12-12-2021, when its last update was successful and froze it forever. The problem is that I do not know how to do it but I am going to post this question as a separate thread. (I am using webrsync method.)
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
Congrats! On Sun, Nov 21, 2021 at 2:17 AM gevisz wrote: > > Just for the history: all my attempts to compile any version of > tensorflow-2.5 failed. > However, yesterday I successfully compiled tensorflow-2.7.0. > > So, now I am afraid to update it any more in the future. :( >
[gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
Just for the history: all my attempts to compile any version of tensorflow-2.5 failed. However, yesterday I successfully compiled tensorflow-2.7.0. So, now I am afraid to update it any more in the future. :(
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
ср, 20 окт. 2021 г. в 16:45, Mark Knecht : > > On Sat, Oct 16, 2021 at 11:34 PM gevisz wrote: > > > > сб, 16 окт. 2021 г. в 21:27, Mark Knecht : > > > > > I wish you the best of luck. > > > > Thank you. But so far no luck in my fourth attempt to compile tensorflow. > > I still get the same error. :( > > > > On a possibly related/similar note my last Windows machine popped up with > some desire to update to Windows 11. After a check of the hardware It then > told me the processor isn't supported > Interesting.
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
On Sat, Oct 16, 2021 at 11:34 PM gevisz wrote: > > сб, 16 окт. 2021 г. в 21:27, Mark Knecht : > > > I wish you the best of luck. > > Thank you. But so far no luck in my fourth attempt to compile tensorflow. > I still get the same error. :( > On a possibly related/similar note my last Windows machine popped up with some desire to update to Windows 11. After a check of the hardware It then told me the processor isn't supported
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
сб, 16 окт. 2021 г. в 21:27, Mark Knecht : > I wish you the best of luck. Thank you. But so far no luck in my fourth attempt to compile tensorflow. I still get the same error. :(
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
On Sat, Oct 16, 2021 at 11:06 AM gevisz wrote: > > сб, 16 окт. 2021 г. в 20:40, Mark Knecht : > > > > On Sat, Oct 16, 2021 at 9:50 AM gevisz wrote: > > > > > > To make things worse, I've got an "Illegal instruction (core dumped)" > > > error after installing and trying to run tensorflow from Ubuntu 20.04 > > > which is installed on the same computer. > > > > > > > What processor by chance are you using. Probably a year back > > Google started requiring processors with AVX2 and FMA instructions. > > > > I can no longer run it on my Intel i7 980 Extreme unless I build from > > source which is just too painful. It's the main reason I'm starting > > to finally plan a new machine purchase. > > > > cat /proc/cpuinfo | grep flags > > I have googled and also think that the above error on Ubuntu 20.04 is > due to the old processor. > I have an AMD Phenom II X4 processor on that computer. The main > problem, however, is that > I get an error when compiling tensorflow in Gentoo. > > The CPU flags are the following: fpu vme de pse tsc msr pae mce cx8 > apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht > syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow > constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid pni monitor > cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a > misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate vmmcall npt > lbrv svm_lock nrip_save > So yes, in my experience your Ubuntu experiment using precompiled tensorflow is probably due to failure due to missing instructions in that processor. My experience compiling tensorflow was that it's fit and miss with lots of bazel problems. However, that's mostly from 2 years ago. (I bought my current house 2 years ago and the work I did was at the previous house.) There were a LOT of issues getting it compiled, and for clarity I was compiling on Ubuntu not Gentoo. That said my best results were using build instructions where you were insider of a Docker instance but you had to match things like python revisions in the Docker image with the one you were going to use in your environment outside of Docker. Generally this meant running TF in a specific python virtual environment and not just in your login. I wish you the best of luck. In the end I was able to buy a reasonably priced product that used TF but had the part I couldn't run in a library I could just remove. I lose certain features in the product but can reinsert that library when I get a new machine. Best of luck, Mark
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
сб, 16 окт. 2021 г. в 20:40, Mark Knecht : > > On Sat, Oct 16, 2021 at 9:50 AM gevisz wrote: > > > > To make things worse, I've got an "Illegal instruction (core dumped)" > > error after installing and trying to run tensorflow from Ubuntu 20.04 > > which is installed on the same computer. > > > > What processor by chance are you using. Probably a year back > Google started requiring processors with AVX2 and FMA instructions. > > I can no longer run it on my Intel i7 980 Extreme unless I build from > source which is just too painful. It's the main reason I'm starting > to finally plan a new machine purchase. > > cat /proc/cpuinfo | grep flags I have googled and also think that the above error on Ubuntu 20.04 is due to the old processor. I have an AMD Phenom II X4 processor on that computer. The main problem, however, is that I get an error when compiling tensorflow in Gentoo. The CPU flags are the following: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good nopl nonstop_tsc cpuid extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt hw_pstate vmmcall npt lbrv svm_lock nrip_save
Re: [gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
On Sat, Oct 16, 2021 at 9:50 AM gevisz wrote: > > To make things worse, I've got an "Illegal instruction (core dumped)" > error after installing and trying to run tensorflow from Ubuntu 20.04 > which is installed on the same computer. > What processor by chance are you using. Probably a year back Google started requiring processors with AVX2 and FMA instructions. I can no longer run it on my Intel i7 980 Extreme unless I build from source which is just too painful. It's the main reason I'm starting to finally plan a new machine purchase. cat /proc/cpuinfo | grep flags HTH, Mark
[gentoo-user] Re: tensorflow-2.5.0-r1 compilation failed
To make things worse, I've got an "Illegal instruction (core dumped)" error after installing and trying to run tensorflow from Ubuntu 20.04 which is installed on the same computer.