Re: [PD] Message from the boss of Raspberry Pi Foundation !
On Fri, Feb 8, 2013 at 5:38 AM, Marco Donnarumma wrote: > That's awesome Pierre! > > Charles (Henry) was working on GPU related computation with Pd. > Some pretty cool stuff. It would be relevant to see how his work developed > so far, and whether it might be useful in this context. > My priorities have been sliding around. The development stopped at inlets and outlets dsp perform and resampling functions, but that's the last big hurdle. Good thing is that it's relatively trivial to make a external that transfers data to the GPU, performs some processing, and transfers data back. If you've already got GPU code and just want to pack it inside an external, that's no problem to do. Chuck ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
Dear all I know 2 works on GPU and PD. André developed something with PD and GPU. http://www.ime.usp.br/~ajb/wiki/artigos/article-icmc2012-ajb-mqz.pdf Chuck (Charles Henry) also developed something and he helped Andre to develop his code. http://www.uni-weimar.de/medien/wiki/PDCON:Conference/GPU_audio_signals_processing_in_Pd,_and_PDCUDA,_an_implementation_with_the_CUDA_runtime_API AFAIK, there is a lib that allows you to copy the processing functions to GPU pipeline and the data to be processed. This lib can identify if there is a GPU available in the system and present the information about it. I think that it really would be a good thing to DSP processing on RPI. Bests F Schiavoni > @Hardoff : the patch i'm using in the video requires 16 ms of latency, > because it uses phase vocoding. You can drop to 10 ms without it, and I > guess even lower would be possible. I use the very first version of the > Pi, > with half the RAM the new model has. If we can get the GPU to compute the > audio i hope that we'll be able to get to really reasonable latencies (to > me 6 to 8 ms is really enough to play live). Also, i use the regular Pd > fro > the debian repos. I can't tell you whether Miller's or Katja's version > work > better. > > Cheers, > > Piere. ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation ! (Jon)
i read that whole discussion thread on the RPi board, and based on that it certainly sounds murky at best that GPU processing is going to become a reality on the RPi anytime soon, without Broadcom's support/permission. JamesH, one of their main hardware dev guys, seems pretty determined you can't reverse engineer video code, and everyone else seems to have stars in their eyes about it. agreed, the idea that Eben might be working on some pathways to doing this by getting Broadcom to agree to opening up certain pathways to processing via the GPU is a very tantalizing prospect. someone should press on him a bit regarding this... scott On Sat, Feb 9, 2013 at 4:57 AM, Pierre Massat wrote: > Hi Jon, > > Thank you for your insight, and welcome in the list ! > > I personnally think that for most real-time application (like the guitar > effects processor i'm using), a latency equal à below 10 to 8 ms is > definitely acceptable (especially considering the price). I could imagine > many applications for other instruments that would work just fine with such > a latency. > > Pd currently works fine with no GUI at 10 ms, with simple patches. One has > to increase the latency to 16 ms (maybe more for very heavy patches) if one > needs to do some fft or other demanding stuff (i used a phase vocoder in my > video). > > So if using the GPU for DSP doesn't reduce latency, but allows for bigger > patches, it's already great news. > > Cheers, > > Pierre. > > 2013/2/9 Jonathan Sheaffer > >> Hi All, >> >> I've been a silent observer for some time now, but since GPU processing >> is 'close to my heart', I thought I'd jump in... So there goes my first >> post in the pd-list... >> >> In general, GPUs are really beneficial for parallelisable algorithms >> involving heavy-computations, such as FFTs, fast convolution, BLAS with >> huge matrices, finite difference modelling etc... To maximise performance, >> the GPU kernel needs to unanimously operate over a large enough data set >> which needs to be copied into the device's memory, as GPUs generally can't >> access the host memory. This would mean large buffers --> increased >> latency. So doing 'real-time' DSP on a GPU would probably make more sense >> for stuff like physical modelling, complex additive synthesis etc..., >> rather than to 'generally reduce the system latency'. >> >> *However*, if the SoC platform physically shares memory between the GPU >> and the CPU, then this could, in theory, help reduce the inherent latency >> (as no memory transfers would be required), but without having detailed >> documentation, this would be difficult to assess. >> >> Cheers, >> Jon. >> >> www.jonsh.net >> >> ___ >> Pd-list@iem.at mailing list >> UNSUBSCRIBE and account-management -> >> http://lists.puredata.info/listinfo/pd-list >> >> > > ___ > Pd-list@iem.at mailing list > UNSUBSCRIBE and account-management -> > http://lists.puredata.info/listinfo/pd-list > > ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation ! (Jon)
Hi All, I've been a silent observer for some time now, but since GPU processing is 'close to my heart', I thought I'd jump in... So there goes my first post in the pd-list... In general, GPUs are really beneficial for parallelisable algorithms involving heavy-computations, such as FFTs, fast convolution, BLAS with huge matrices, finite difference modelling etc... To maximise performance, the GPU kernel needs to unanimously operate over a large enough data set which needs to be copied into the device's memory, as GPUs generally can't access the host memory. This would mean large buffers --> increased latency. So doing 'real-time' DSP on a GPU would probably make more sense for stuff like physical modelling, complex additive synthesis etc..., rather than to 'generally reduce the system latency'. *However*, if the SoC platform physically shares memory between the GPU and the CPU, then this could, in theory, help reduce the inherent latency (as no memory transfers would be required), but without having detailed documentation, this would be difficult to assess. Cheers, Jon. www.jonsh.net ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
Hi Katja, I wasn't aware of this at all. Thanks for the link ! I'll read it this afternoon. Thank you! Pierre. 2013/2/9 katja > Hi Pierre, > > There has been intensive discussion about GPU processing on RPI: > > http://www.raspberrypi.org/phpBB3/viewtopic.php?f=33&t=6188 > > Did you read it? In the light of this discussion, I wonder what Eben means > when writing "We have a bunch of GPU compute available on the device just > waiting for an application like this." > > Anyway it's great they have put your project on RPi blog. You will be > famous, Pi Massat! Congrats again. > > Katja > > > > On Fri, Feb 8, 2013 at 10:51 AM, Pierre Massat wrote: > >> Dear all, >> >> Please read below the message I received from Eben Upton, the boss of >> Raspberry Pi foundation. >> It looks like he was impressed by the video I made, and he says that >> there's a possibility of letting the GPU do some DSP computation. >> I guess you'll all agree that this is awesome news. >> >> I have no idea how we can proceed now. I think i'm absolutely incapable >> of doing anything useful in this field, so i told him that i would transfer >> this message to you, hoping that Miller, HC, Katja (and others) would know >> what needs to be done. We should probably ask him if you guys could work >> directly with their developers. >> >> Let me know what you think. >> >> Cheers! >> >> Pierre. >> >> -- Forwarded message -- >> From: Eben Upton >> Date: 2013/2/8 >> Subject: Re: RPi as multi-effects for guitar >> To: Pierre Massat >> >> >> Hi Pierre >> Awesome stuff - I think Liz is preparing a blog post about this as we >> speak. I'd be very interested in knowing a bit more about the DSP code >> that runs this stuff. We have a bunch of GPU compute available on the >> device just waiting for an application like this. >> >> Cheers >> Eben >> >> On Thu, Feb 7, 2013 at 2:29 AM, Pierre Massat wrote: >> > Hi, >> > >> > I write a blog about how to make guitar effects with computers running >> Pure >> > Data in real-time. >> > When I first heard about the Raspberry Pi I thought it would be great >> if I >> > could use it for the same purpose. It would only be much cheaper, and >> much >> > smaller than my current laptop, and could fit in my hand-made stompbox. >> > Recent improvements in Raspbian have finally made this possible, and >> this >> > makes me very happy ! >> > The Raspberry Pi is now actually capable of running rather demanding >> Pure >> > Data patches in (quasi-) real-time (at least with a latency that's low >> > enough to play live with it). >> > I quickly assembled a small patch to test it and make a video to >> demonstrate >> > that it actually works very well. >> > >> > It is obviously not the use the RPi was originally intended for, but to >> me >> > (and I'm sure to other musicians as well), this sounds like a >> revolution. >> > >> > I'm currently documenting my setup on my blog : >> > - video : >> > >> http://guitarextended.wordpress.com/2013/01/27/real-time-guitar-effects-with-raspberry-pi-pd-and-arduino/ >> > - blog post about hardware : >> > >> http://guitarextended.wordpress.com/2013/01/31/raspberry-pi-multi-effects-overview-of-the-setup/ >> > >> > There's no trick, the Pi really IS doing all the DSP work. A reader >> posted a >> > comment to ask where the computer was :) >> > >> > I take this opportunity to thank the RPi foundation for all the good >> work >> > you put in this amazing tiny thing. I see that the cam should be out in >> a >> > few months, this is all very exciting. I'm sure the Pi has already >> changed >> > the life of a lot of people ! >> > >> > Cheers, >> > >> > Pierre. >> > >> > >> > >> >> >> ___ >> Pd-list@iem.at mailing list >> UNSUBSCRIBE and account-management -> >> http://lists.puredata.info/listinfo/pd-list >> >> > ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
Hi Pierre, There has been intensive discussion about GPU processing on RPI: http://www.raspberrypi.org/phpBB3/viewtopic.php?f=33&t=6188 Did you read it? In the light of this discussion, I wonder what Eben means when writing "We have a bunch of GPU compute available on the device just waiting for an application like this." Anyway it's great they have put your project on RPi blog. You will be famous, Pi Massat! Congrats again. Katja On Fri, Feb 8, 2013 at 10:51 AM, Pierre Massat wrote: > Dear all, > > Please read below the message I received from Eben Upton, the boss of > Raspberry Pi foundation. > It looks like he was impressed by the video I made, and he says that > there's a possibility of letting the GPU do some DSP computation. > I guess you'll all agree that this is awesome news. > > I have no idea how we can proceed now. I think i'm absolutely incapable of > doing anything useful in this field, so i told him that i would transfer > this message to you, hoping that Miller, HC, Katja (and others) would know > what needs to be done. We should probably ask him if you guys could work > directly with their developers. > > Let me know what you think. > > Cheers! > > Pierre. > > -- Forwarded message -- > From: Eben Upton > Date: 2013/2/8 > Subject: Re: RPi as multi-effects for guitar > To: Pierre Massat > > > Hi Pierre > Awesome stuff - I think Liz is preparing a blog post about this as we > speak. I'd be very interested in knowing a bit more about the DSP code > that runs this stuff. We have a bunch of GPU compute available on the > device just waiting for an application like this. > > Cheers > Eben > > On Thu, Feb 7, 2013 at 2:29 AM, Pierre Massat wrote: > > Hi, > > > > I write a blog about how to make guitar effects with computers running > Pure > > Data in real-time. > > When I first heard about the Raspberry Pi I thought it would be great if > I > > could use it for the same purpose. It would only be much cheaper, and > much > > smaller than my current laptop, and could fit in my hand-made stompbox. > > Recent improvements in Raspbian have finally made this possible, and this > > makes me very happy ! > > The Raspberry Pi is now actually capable of running rather demanding Pure > > Data patches in (quasi-) real-time (at least with a latency that's low > > enough to play live with it). > > I quickly assembled a small patch to test it and make a video to > demonstrate > > that it actually works very well. > > > > It is obviously not the use the RPi was originally intended for, but to > me > > (and I'm sure to other musicians as well), this sounds like a revolution. > > > > I'm currently documenting my setup on my blog : > > - video : > > > http://guitarextended.wordpress.com/2013/01/27/real-time-guitar-effects-with-raspberry-pi-pd-and-arduino/ > > - blog post about hardware : > > > http://guitarextended.wordpress.com/2013/01/31/raspberry-pi-multi-effects-overview-of-the-setup/ > > > > There's no trick, the Pi really IS doing all the DSP work. A reader > posted a > > comment to ask where the computer was :) > > > > I take this opportunity to thank the RPi foundation for all the good work > > you put in this amazing tiny thing. I see that the cam should be out in a > > few months, this is all very exciting. I'm sure the Pi has already > changed > > the life of a lot of people ! > > > > Cheers, > > > > Pierre. > > > > > > > > > ___ > Pd-list@iem.at mailing list > UNSUBSCRIBE and account-management -> > http://lists.puredata.info/listinfo/pd-list > > ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
10ms or less would be totally acceptable. wow, i really wanna give this a go ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
Hi, Ok, so Charles Henry has been working on this, good. Anybody else would have something to propose ? I'd love to help but my technical background is far from sufficient. Bringing this to the attention of the RPi foundation is about all I could do I think. @Hardoff : the patch i'm using in the video requires 16 ms of latency, because it uses phase vocoding. You can drop to 10 ms without it, and I guess even lower would be possible. I use the very first version of the Pi, with half the RAM the new model has. If we can get the GPU to compute the audio i hope that we'll be able to get to really reasonable latencies (to me 6 to 8 ms is really enough to play live). Also, i use the regular Pd fro the debian repos. I can't tell you whether Miller's or Katja's version work better. Cheers, Piere. 2013/2/8 Simon Iten > pierre wrote in his blog that he can go as low as 10ms, later in the > settings he writes about 16ms. > > On Feb 8, 2013, at 1:57 PM, i go bananas wrote: > > > sorry, i don't think this is the thread i should be asking this in, > > > > but how low latency can you get with pd on a pi ? > > > > > > ___ > > Pd-list@iem.at mailing list > > UNSUBSCRIBE and account-management -> > http://lists.puredata.info/listinfo/pd-list > > > ___ > Pd-list@iem.at mailing list > UNSUBSCRIBE and account-management -> > http://lists.puredata.info/listinfo/pd-list > ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
pierre wrote in his blog that he can go as low as 10ms, later in the settings he writes about 16ms. On Feb 8, 2013, at 1:57 PM, i go bananas wrote: > sorry, i don't think this is the thread i should be asking this in, > > but how low latency can you get with pd on a pi ? > > > ___ > Pd-list@iem.at mailing list > UNSUBSCRIBE and account-management -> > http://lists.puredata.info/listinfo/pd-list ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
sorry, i don't think this is the thread i should be asking this in, but how low latency can you get with pd on a pi ? ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
Re: [PD] Message from the boss of Raspberry Pi Foundation !
That's awesome Pierre! Charles (Henry) was working on GPU related computation with Pd. Some pretty cool stuff. It would be relevant to see how his work developed so far, and whether it might be useful in this context. On a side note, I'm taking a studio session with CCRMA folks at the upcoming TEI conference in Barcelona. We will be working with their Satellite kit, which is based on RPI [1]. My goal is to run the Xth Sense [2] biosensor and software directly on the RPI. And after seeing your work, I'm quite confident this is feasible, as the XS is also based on real time audio input. I'll keep you updated, meanwhile thanks for opening up this perspective Pd/RPI collab! [1] http://www.tei-conf.org/13/studios See Tangible and Embedded Linux with RPI [2] http://res.marcodonnarumma.com/projects/xth-sense/ -- Marco Donnarumma New Media + Sonic Arts Practitioner, Performer, Teacher, Director. Embodied Audio-Visual Interaction Research Team. Department of Computing, Goldsmiths University of London ~ Portfolio: http://marcodonnarumma.com Research: http://res.marcodonnarumma.com Director: http://www.liveperformersmeeting.net > Dear all, > > Please read below the message I received from Eben Upton, the boss of > Raspberry Pi foundation. > It looks like he was impressed by the video I made, and he says that > there's a possibility of letting the GPU do some DSP computation. > I guess you'll all agree that this is awesome news. > > I have no idea how we can proceed now. I think i'm absolutely incapable of > doing anything useful in this field, so i told him that i would transfer > this message to you, hoping that Miller, HC, Katja (and others) would know > what needs to be done. We should probably ask him if you guys could work > directly with their developers. > > Let me know what you think. > > Cheers! > > Pierre. > > -- Forwarded message -- > From: Eben Upton > Date: 2013/2/8 > Subject: Re: RPi as multi-effects for guitar > To: Pierre Massat > > > Hi Pierre > Awesome stuff - I think Liz is preparing a blog post about this as we > speak. I'd be very interested in knowing a bit more about the DSP code > that runs this stuff. We have a bunch of GPU compute available on the > device just waiting for an application like this. > > Cheers > Eben > > ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
[PD] Message from the boss of Raspberry Pi Foundation !
Dear all, Please read below the message I received from Eben Upton, the boss of Raspberry Pi foundation. It looks like he was impressed by the video I made, and he says that there's a possibility of letting the GPU do some DSP computation. I guess you'll all agree that this is awesome news. I have no idea how we can proceed now. I think i'm absolutely incapable of doing anything useful in this field, so i told him that i would transfer this message to you, hoping that Miller, HC, Katja (and others) would know what needs to be done. We should probably ask him if you guys could work directly with their developers. Let me know what you think. Cheers! Pierre. -- Forwarded message -- From: Eben Upton Date: 2013/2/8 Subject: Re: RPi as multi-effects for guitar To: Pierre Massat Hi Pierre Awesome stuff - I think Liz is preparing a blog post about this as we speak. I'd be very interested in knowing a bit more about the DSP code that runs this stuff. We have a bunch of GPU compute available on the device just waiting for an application like this. Cheers Eben On Thu, Feb 7, 2013 at 2:29 AM, Pierre Massat wrote: > Hi, > > I write a blog about how to make guitar effects with computers running Pure > Data in real-time. > When I first heard about the Raspberry Pi I thought it would be great if I > could use it for the same purpose. It would only be much cheaper, and much > smaller than my current laptop, and could fit in my hand-made stompbox. > Recent improvements in Raspbian have finally made this possible, and this > makes me very happy ! > The Raspberry Pi is now actually capable of running rather demanding Pure > Data patches in (quasi-) real-time (at least with a latency that's low > enough to play live with it). > I quickly assembled a small patch to test it and make a video to demonstrate > that it actually works very well. > > It is obviously not the use the RPi was originally intended for, but to me > (and I'm sure to other musicians as well), this sounds like a revolution. > > I'm currently documenting my setup on my blog : > - video : > http://guitarextended.wordpress.com/2013/01/27/real-time-guitar-effects-with-raspberry-pi-pd-and-arduino/ > - blog post about hardware : > http://guitarextended.wordpress.com/2013/01/31/raspberry-pi-multi-effects-overview-of-the-setup/ > > There's no trick, the Pi really IS doing all the DSP work. A reader posted a > comment to ask where the computer was :) > > I take this opportunity to thank the RPi foundation for all the good work > you put in this amazing tiny thing. I see that the cam should be out in a > few months, this is all very exciting. I'm sure the Pi has already changed > the life of a lot of people ! > > Cheers, > > Pierre. > > > ___ Pd-list@iem.at mailing list UNSUBSCRIBE and account-management -> http://lists.puredata.info/listinfo/pd-list
