Re: [Pd] Playing a bitmap
So I'm using this now, and the problem I'm encountering is that I'd like to be able to control the frequency range of a picture without editing the picture itself. I'd like to find a way to have pix_pix2sig~, or some other object, read the image and render it to audio, but padding some number of samples with zeros, so high points in the picture aren't necessarily out of my hearing range. Would it work, perhaps, to give the cursor user-controllable height, up or down, and color it before adding the image? But if I'm not mistaken, rectangles cannot be textured to in any other way than right at the corners... Any suggestions? Thanks. -Chuckk On 1/27/07, Chuckk Hubbard [EMAIL PROTECTED] wrote: Well, here's where I have it now. I'm still working out how to scale everything correctly, so you'll have to adjust the size calculations and stuff according to the image. The metro object plays from left to right, or you can manually scroll with the y-input to the pix_crop object. I'm not sure of any of this. I wish I could get rid of the staircase effect; might just need more overlap. The scaling settings as it is are for the .jpg of the patch itself. The scaling settings exist because I have a separate rectangle for the cursor, and its crop and translate take different values to have it show the part of the image it is over depending on the width of the image, and I don't understand exactly how those values work. -Chuckk On 1/27/07, Kevin McCoy [EMAIL PROTECTED] wrote: When you get something workable, please post a patch. I've been following your conversation here with much interest. Thanks, Kevin -- Far and away the best prize that life has to offer is the chance to work hard at work worth doing. -Theodore Roosevelt #N canvas 0 0 320 263 12; #N canvas 517 158 717 714 gem 1; #X obj 229 611 outlet~; #X obj 347 612 outlet~; #X obj 36 78 tgl 15 0 empty empty empty 17 7 0 10 -262144 -1 -1 1 1 ; #X obj 25 120 gemwin; #X msg 70 71 create; #X msg 70 96 destroy; #X obj 250 78 gemhead; #X obj 250 140 pix_image; #X msg 329 69 bang; #X obj 329 92 openpanel; #X msg 329 115 open \$1; #X obj 214 222 pix_info; #X obj 214 268 pix_texture; #X floatatom 252 245 5 0 0 0 - - -; #X floatatom 311 243 5 0 0 0 - - -; #X obj 214 310 rectangle 4 3; #X floatatom 421 173 5 0 0 0 - - -; #X floatatom 506 162 5 0 0 0 - - -; #X floatatom 599 267 5 0 0 0 - - -; #X msg 599 290 \$1 0 0; #X obj 438 398 pix_invert; #X obj 411 380 tgl 15 0 empty empty empty 17 7 0 10 -262144 -1 -1 0 1; #X obj 438 428 pix_pix2sig~; #X obj 467 522 tabsend~ frame; #X obj 352 511 /~ 16386; #X obj 352 536 rifft~; #N canvas 0 0 450 300 (subpatch) 0; #X array frame 4096 float 3; #A 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00392157 0 0 0.00392157 0.00784314 0.027451 0.00392157 0 0 0.0156863 0.0235294 0 0 0.0235294 0.00784314 0 0 0.0392157 0.027451 0 0 0 0.0196078 0 0.027451 0 0 0 0.00784314 0.0392157 0.0352941 0 0 0.0431373 0.00784314 0.00392157 0 0 0 0.0392157 0.0235294 0 0 0 0 0.027451 0 0.0196078 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0; #A 1000 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Re: [Pd] Playing a bitmap
When you get something workable, please post a patch. I've been following your conversation here with much interest. Thanks, Kevin On 1/27/07, Chuckk Hubbard [EMAIL PROTECTED] wrote: This is awesome. I still don't have it working right, but I'm close. What I was doing was cropping the image to 1 pixel wide, but I think that was a mistake. I need a large block size for resolution, and through some testing, as Paris suggested, I realized I was getting discrete blocks of pitch that changed every few seconds. I suspect I just need more window overlap... -Chuckk On 1/26/07, Stephen Sinclair [EMAIL PROTECTED] wrote: May I suggest this paper: http://www.dafx.ca/proceedings/papers/p_309.pdf and: http://ccrma.stanford.edu/~woony/works/raster/ The examples are quite fun. :) Steve ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- Far and away the best prize that life has to offer is the chance to work hard at work worth doing. -Theodore Roosevelt ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- http://pocketkm.blogspot.com ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
RE: [Pd] Playing a bitmap
all politics aside, i was just wondering if you used an image like color bars (or maybe even reduce to three bars R, G, B) if it would be easier to figure out what's happening? good luck, p Original Message Subject: Re: [Pd] Playing a bitmap From: Chuckk Hubbard [EMAIL PROTECTED] Date: Fri, January 26, 2007 3:06 pm To: [EMAIL PROTECTED] [EMAIL PROTECTED] Cc: PD-list@iem.at On 1/25/07, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: hey chuckk, given the picture, no wonder it sounds bad ;-) Yeah, it's one of my more violent pieces. i have actually not used this object myself (i use it's inverse) so not much help - maybe IOhannes or someone will know more, or there's the source code... good luck, p Thanks. I'd like to include something like this in my senior recital in March, so if I figure it out now I'll have 2 months to try different bitmaps. -Chuckk ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
Re: [Pd] Playing a bitmap
On 1/25/07, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: hey chuckk, given the picture, no wonder it sounds bad ;-) Yeah, it's one of my more violent pieces. i have actually not used this object myself (i use it's inverse) so not much help - maybe IOhannes or someone will know more, or there's the source code... good luck, p Thanks. I'd like to include something like this in my senior recital in March, so if I figure it out now I'll have 2 months to try different bitmaps. -Chuckk ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
Re: [Pd] Playing a bitmap
So, it seems to me the input would have to be a couple of pixels at a time, with a small block size, in order to scroll. Like enter a column of pixels and do, as someone mentioned, reverse FFT to get a block. Maybe map the image to a rectangle with width 1, then slide it across? I don't necessarily have to see the scrolling or even the image, but it would be nice. I don't want to be obnoxious, but I know next to nothing about Gem, so any suggestions are welcome. -Chuckk On 1/23/07, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: you might also want to check out the Gem object: pix_pix2sig~ best, p Original Message Subject: Re: [Pd] Playing a bitmap From: Kevin McCoy [EMAIL PROTECTED] Date: Tue, January 23, 2007 12:59 am To: Claude Heiland-Allen [EMAIL PROTECTED], PD-list@iem.at That looks rad. I'll have to try it out. Kevin On 1/22/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote:Chuckk Hubbard wrote: On 1/23/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote: Chuckk Hubbard wrote: Has anyone done this with Pd? I thought I remembered something in GEM, but I can't find it anywhere. Just to have a cursor scroll left to right and assign the different values of pixels to different musical properties... -Chuckk Like this? http://gridflow.ca/gallery/photo_pianoroll.pd.gif Yeah, I think so. How's it work? Thanks for sharing. -Chuckk Not sure exactly, it's not my patch, but from the screenshot it looks like it copies a scanline of greyscale pixels into an array, then rescales the array exponentially into annother array (frequency-pitch conversion), then does an inverse fft and sends the resulting audio to dac~; the partials of the output sound being determined by the particular scanline of the image that was just copied to the array. I think this technique is a form of scanned synthesis, but I'm not an expert on terminology. At least searching pd-list for that term shows up some interesting results... Claude ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- http://pocketkm.blogspot.com - ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- Far and away the best prize that life has to offer is the chance to work hard at work worth doing. -Theodore Roosevelt ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
RE: [Pd] Playing a bitmap
hey chuckk, given the picture, no wonder it sounds bad ;-) i have actually not used this object myself (i use it's inverse) so not much help - maybe IOhannes or someone will know more, or there's the source code... good luck, p Original Message Subject: Re: [Pd] Playing a bitmap From: Chuckk Hubbard [EMAIL PROTECTED] Date: Thu, January 25, 2007 4:58 am To: [EMAIL PROTECTED] [EMAIL PROTECTED] Cc: PD-list@iem.at Here's what I have so far, using: http://upload.wikimedia.org/wikipedia/en/d/df/US_%241_obverse.jpg Since it's not copyrighted. I don't understand exactly what's happening. It doesn't sound to me like it's what I want; the frequencies just don't seem to line up. -Chuckk On 1/25/07, Chuckk Hubbard [EMAIL PROTECTED] wrote: So, it seems to me the input would have to be a couple of pixels at a time, with a small block size, in order to scroll. Like enter a column of pixels and do, as someone mentioned, reverse FFT to get a block. Maybe map the image to a rectangle with width 1, then slide it across? I don't necessarily have to see the scrolling or even the image, but it would be nice. I don't want to be obnoxious, but I know next to nothing about Gem, so any suggestions are welcome. -Chuckk On 1/23/07, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: you might also want to check out the Gem object: pix_pix2sig~ best, p Original Message Subject: Re: [Pd] Playing a bitmap From: Kevin McCoy [EMAIL PROTECTED] Date: Tue, January 23, 2007 12:59 am To: Claude Heiland-Allen [EMAIL PROTECTED], PD-list@iem.at That looks rad. I'll have to try it out. Kevin On 1/22/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote:Chuckk Hubbard wrote: On 1/23/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote: Chuckk Hubbard wrote: Has anyone done this with Pd? I thought I remembered something in GEM, but I can't find it anywhere. Just to have a cursor scroll left to right and assign the different values of pixels to different musical properties... -Chuckk Like this? http://gridflow.ca/gallery/photo_pianoroll.pd.gif Yeah, I think so. How's it work? Thanks for sharing. -Chuckk Not sure exactly, it's not my patch, but from the screenshot it looks like it copies a scanline of greyscale pixels into an array, then rescales the array exponentially into annother array (frequency-pitch conversion), then does an inverse fft and sends the resulting audio to dac~; the partials of the output sound being determined by the particular scanline of the image that was just copied to the array. I think this technique is a form of scanned synthesis, but I'm not an expert on terminology. At least searching pd-list for that term shows up some interesting results... Claude ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- http://pocketkm.blogspot.com - ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- Far and away the best prize that life has to offer is the chance to work hard at work worth doing. -Theodore Roosevelt -- Far and away the best prize that life has to offer is the chance to work hard at work worth doing. -Theodore Roosevelt - #N canvas 0 0 193 195 12; #N canvas 452 52 743 729 gem 1; #N canvas 0 0 450 300 gemwin 0; #X obj 132 136 gemwin; #X obj 67 89 outlet; #X obj 67 10 inlet; #X obj 67 41 route create; #X msg 67 70 set destroy; #X msg 142 68 set create; #X msg 132 112 create \, 1; #X msg 198 112 destroy; #X connect 2 0 3 0; #X connect 3 0 4 0; #X connect 3 0 6 0; #X connect 3 1 5 0; #X connect 3 1 7 0; #X connect 4 0 1 0; #X connect 5 0 1 0; #X connect 6 0 0 0; #X connect 7 0 0 0; #X restore 618 523 pd gemwin; #X msg 618 504 destroy; #X obj 264 40 gemhead; #X obj 344 16 bng 15 250 50 0 empty empty pix_load 20 8 0 8 -262144 -1 -1; #N canvas 0 0 599 378 image 0; #X obj 77 48 inlet; #X obj 77 344 outlet; #X obj 77 205 pix_image ../../doc/gem/examples/data/fractal.JPG; #X obj 223 55 inlet; #X msg 223 123 open \$1; #X obj 223 100 openpanel; #X connect 0 0 2 0; #X connect 2 0 1 0; #X connect 3 0 5 0; #X connect 4 0 2 0; #X connect 5 0 4 0; #X restore 264 69 pd
Re: [Pd] Playing a bitmap
On 1/23/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote: Chuckk Hubbard wrote: Has anyone done this with Pd? I thought I remembered something in GEM, but I can't find it anywhere. Just to have a cursor scroll left to right and assign the different values of pixels to different musical properties... -Chuckk Like this? http://gridflow.ca/gallery/photo_pianoroll.pd.gif Yeah, I think so. How's it work? Thanks for sharing. -Chuckk ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
Re: [Pd] Playing a bitmap
Chuckk Hubbard wrote: On 1/23/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote: Chuckk Hubbard wrote: Has anyone done this with Pd? I thought I remembered something in GEM, but I can't find it anywhere. Just to have a cursor scroll left to right and assign the different values of pixels to different musical properties... -Chuckk Like this? http://gridflow.ca/gallery/photo_pianoroll.pd.gif Yeah, I think so. How's it work? Thanks for sharing. -Chuckk Not sure exactly, it's not my patch, but from the screenshot it looks like it copies a scanline of greyscale pixels into an array, then rescales the array exponentially into annother array (frequency-pitch conversion), then does an inverse fft and sends the resulting audio to dac~; the partials of the output sound being determined by the particular scanline of the image that was just copied to the array. I think this technique is a form of scanned synthesis, but I'm not an expert on terminology. At least searching pd-list for that term shows up some interesting results... Claude ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
Re: [Pd] Playing a bitmap
That looks rad. I'll have to try it out. Kevin On 1/22/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote: Chuckk Hubbard wrote: On 1/23/07, Claude Heiland-Allen [EMAIL PROTECTED] wrote: Chuckk Hubbard wrote: Has anyone done this with Pd? I thought I remembered something in GEM, but I can't find it anywhere. Just to have a cursor scroll left to right and assign the different values of pixels to different musical properties... -Chuckk Like this? http://gridflow.ca/gallery/photo_pianoroll.pd.gif Yeah, I think so. How's it work? Thanks for sharing. -Chuckk Not sure exactly, it's not my patch, but from the screenshot it looks like it copies a scanline of greyscale pixels into an array, then rescales the array exponentially into annother array (frequency-pitch conversion), then does an inverse fft and sends the resulting audio to dac~; the partials of the output sound being determined by the particular scanline of the image that was just copied to the array. I think this technique is a form of scanned synthesis, but I'm not an expert on terminology. At least searching pd-list for that term shows up some interesting results... Claude ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list -- http://pocketkm.blogspot.com ___ PD-list@iem.at mailing list UNSUBSCRIBE and account-management - http://lists.puredata.info/listinfo/pd-list
