Re: [Computer-go] Deep Zen - do we have a race now?
Very interesting, but it should also mention Aya. I'm working on this as well, but I haven’t bought any hardware yet. My goal is not to get 7 dan on expensive hardware, but to get as much strength as I can on standard PC hardware. I'll be looking at much smaller nets, that don’t need a GPU to run. I'll have to buy a GPU for training. David > -Original Message- > From: Computer-go [mailto:computer-go-boun...@computer-go.org] On Behalf > Of "Ingo Althöfer" > Sent: Tuesday, March 01, 2016 8:45 AM > To: computer-go@computer-go.org > Subject: [Computer-go] Deep Zen - do we have a race now? > > Read here: > http://www.lifein19x19.com/forum/viewtopic.php?p=199532#p199532 > > Wonderfully exciting times! > Ingo. > ___ > Computer-go mailing list > Computer-go@computer-go.org > http://computer-go.org/mailman/listinfo/computer-go ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote: > Very interesting, but it should also mention Aya. > > I'm working on this as well, but I haven’t bought any hardware yet. My goal > is not to get 7 dan on expensive hardware, but to get as much strength as I > can on standard PC hardware. I'll be looking at much smaller nets, that > don’t need a GPU to run. I'll have to buy a GPU for training. But I think most people who play Go are also fans of computer games that often do use GPUs. :-) Of course, it's something totally different from NVidia Keplers, but still the step up from a CPU is tremendous. Petr Baudis ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
any news on open source deep learning type of go program? From: Petr Baudis To: computer-go@computer-go.org Sent: Wednesday, March 2, 2016 1:19 AM Subject: Re: [Computer-go] Deep Zen - do we have a race now? On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote: > Very interesting, but it should also mention Aya. > > I'm working on this as well, but I haven’t bought any hardware yet. My goal > is not to get 7 dan on expensive hardware, but to get as much strength as I > can on standard PC hardware. I'll be looking at much smaller nets, that > don’t need a GPU to run. I'll have to buy a GPU for training. But I think most people who play Go are also fans of computer games that often do use GPUs. :-) Of course, it's something totally different from NVidia Keplers, but still the step up from a CPU is tremendous. Petr Baudis ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
Would be nice to have it as an option. My desktop PC and my laptop both have CUDA-enabled graphics, and that isn't uncommon anymore. Also, if you are training on a GPU you can probably avoid a lot of hassle if you expect to run it on a GPU as well. I don't know how other NN implementations handle it, but the GPU-to-CPU conversion script that comes with the Theano-based pylearn2 kit doesn't work very reliably. Also, even quite big nets probably can be run on modest GPUs reasonably well (within memory bounds). It's the training where the size really hurts. On Tue, Mar 1, 2016 at 6:19 PM, Petr Baudis wrote: > On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote: >> Very interesting, but it should also mention Aya. >> >> I'm working on this as well, but I haven’t bought any hardware yet. My goal >> is not to get 7 dan on expensive hardware, but to get as much strength as I >> can on standard PC hardware. I'll be looking at much smaller nets, that >> don’t need a GPU to run. I'll have to buy a GPU for training. > > But I think most people who play Go are also fans of computer games that > often do use GPUs. :-) Of course, it's something totally different from > NVidia Keplers, but still the step up from a CPU is tremendous. > > Petr Baudis > ___ > Computer-go mailing list > Computer-go@computer-go.org > http://computer-go.org/mailman/listinfo/computer-go ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
I'll keep it in mind. I'm using caffe, which has a compile-time flag, so I'm not sure it will work with GPU enabled on a machine without a GPU. David > -Original Message- > From: Computer-go [mailto:computer-go-boun...@computer-go.org] On Behalf > Of Michael Markefka > Sent: Tuesday, March 01, 2016 2:21 PM > To: computer-go@computer-go.org > Subject: Re: [Computer-go] Deep Zen - do we have a race now? > > Would be nice to have it as an option. My desktop PC and my laptop both > have CUDA-enabled graphics, and that isn't uncommon anymore. > > Also, if you are training on a GPU you can probably avoid a lot of > hassle if you expect to run it on a GPU as well. I don't know how other > NN implementations handle it, but the GPU-to-CPU conversion script that > comes with the Theano-based pylearn2 kit doesn't work very reliably. > > Also, even quite big nets probably can be run on modest GPUs reasonably > well (within memory bounds). It's the training where the size really > hurts. > > On Tue, Mar 1, 2016 at 6:19 PM, Petr Baudis wrote: > > On Tue, Mar 01, 2016 at 09:14:39AM -0800, David Fotland wrote: > >> Very interesting, but it should also mention Aya. > >> > >> I'm working on this as well, but I haven t bought any hardware yet. > My goal is not to get 7 dan on expensive hardware, but to get as much > strength as I can on standard PC hardware. I'll be looking at much > smaller nets, that don t need a GPU to run. I'll have to buy a GPU for > training. > > > > But I think most people who play Go are also fans of computer games > > that often do use GPUs. :-) Of course, it's something totally > > different from NVidia Keplers, but still the step up from a CPU is > tremendous. > > > > Petr Baudis > > ___ > > Computer-go mailing list > > Computer-go@computer-go.org > > http://computer-go.org/mailman/listinfo/computer-go > ___ > Computer-go mailing list > Computer-go@computer-go.org > http://computer-go.org/mailman/listinfo/computer-go ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
On Tue, Mar 01, 2016 at 02:51:03PM -0800, David Fotland wrote: > > Also, if you are training on a GPU you can probably avoid a lot of > > hassle if you expect to run it on a GPU as well. I don't know how other > > NN implementations handle it, but the GPU-to-CPU conversion script that > > comes with the Theano-based pylearn2 kit doesn't work very reliably. > I'll keep it in mind. I'm using caffe, which has a compile-time flag, so I'm > not sure it will work with GPU enabled on a machine without a GPU. I'm not sure about Michael's specific problem, but in my experience, there is no trouble at all transferring stuff between CPU and GPU - your model is, after all, just the weight matrices. In Caffe, you should be able to switch between GPU and CPU completely freely. Petr Baudis ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
Hi Petr, to clarify a bit: pylearn2 specifically comes with a script to convert a model trained on a GPU into a version that runs on the CPU. This doesn't work very well though and the documentation points that out too. According to the dev commens that is down to how Theano, the framework pylearn2 is based on, handles its shared variables und the CUDA variables need to be converted to Theano tensor variables. Just wanted to advise caution that this process working flawlessly isn't necessarily given in every NN lib. If Caffe does this well, then David shouldn't have any problem of course and this warning doesn't apply here. -Michael On Wed, Mar 2, 2016 at 8:57 AM, Petr Baudis wrote: > On Tue, Mar 01, 2016 at 02:51:03PM -0800, David Fotland wrote: >> > Also, if you are training on a GPU you can probably avoid a lot of >> > hassle if you expect to run it on a GPU as well. I don't know how other >> > NN implementations handle it, but the GPU-to-CPU conversion script that >> > comes with the Theano-based pylearn2 kit doesn't work very reliably. >> I'll keep it in mind. I'm using caffe, which has a compile-time flag, so >> I'm not sure it will work with GPU enabled on a machine without a GPU. > > I'm not sure about Michael's specific problem, but in my experience, > there is no trouble at all transferring stuff between CPU and GPU - your > model is, after all, just the weight matrices. In Caffe, you should > be able to switch between GPU and CPU completely freely. > > Petr Baudis > ___ > Computer-go mailing list > Computer-go@computer-go.org > http://computer-go.org/mailman/listinfo/computer-go ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go
Re: [Computer-go] Deep Zen - do we have a race now?
Caffe looks like it runs the same net on CPU and GPU with no conversion. I'm going to see if I can get it working on an AWS GPU instance this weekend. David > -Original Message- > From: Computer-go [mailto:computer-go-boun...@computer-go.org] On Behalf > Of Michael Markefka > Sent: Wednesday, March 02, 2016 12:27 AM > To: computer-go@computer-go.org > Subject: Re: [Computer-go] Deep Zen - do we have a race now? > > Hi Petr, > > to clarify a bit: > > pylearn2 specifically comes with a script to convert a model trained on > a GPU into a version that runs on the CPU. This doesn't work very well > though and the documentation points that out too. According to the dev > commens that is down to how Theano, the framework pylearn2 is based on, > handles its shared variables und the CUDA variables need to be converted > to Theano tensor variables. > > Just wanted to advise caution that this process working flawlessly isn't > necessarily given in every NN lib. If Caffe does this well, then David > shouldn't have any problem of course and this warning doesn't apply > here. > > -Michael > > On Wed, Mar 2, 2016 at 8:57 AM, Petr Baudis wrote: > > On Tue, Mar 01, 2016 at 02:51:03PM -0800, David Fotland wrote: > >> > Also, if you are training on a GPU you can probably avoid a lot of > >> > hassle if you expect to run it on a GPU as well. I don't know how > >> > other NN implementations handle it, but the GPU-to-CPU conversion > >> > script that comes with the Theano-based pylearn2 kit doesn't work > very reliably. > >> I'll keep it in mind. I'm using caffe, which has a compile-time > flag, so I'm not sure it will work with GPU enabled on a machine without > a GPU. > > > > I'm not sure about Michael's specific problem, but in my experience, > > there is no trouble at all transferring stuff between CPU and GPU - > > your model is, after all, just the weight matrices. In Caffe, you > > should be able to switch between GPU and CPU completely freely. > > > > Petr Baudis > > ___ > > Computer-go mailing list > > Computer-go@computer-go.org > > http://computer-go.org/mailman/listinfo/computer-go > ___ > Computer-go mailing list > Computer-go@computer-go.org > http://computer-go.org/mailman/listinfo/computer-go ___ Computer-go mailing list Computer-go@computer-go.org http://computer-go.org/mailman/listinfo/computer-go