> > > the cmos is said to operate at 8 fps … this would make my argument > > > with the ai wrong unless (e.g. amortized with many parallel things or > > > something maybe), because normally one matrix op relies on output of > > > last. Maybe that is what it was trying to get at. In the microscopy > > > papers they imply cmos is faster than this — but in the fpm papers I > > > was excited about recently they usually do low resolution. > > > > > > It sounds like it may be possible but if so I haven’t sorted out how > > > quite yet, to do fast tokens. Maybe by engaging the internals of the > > > cmos somehow? > > > > > > I sure didn’t connect that! I was expecting faster cmos > > > > yeah the Sony IMX500 used in the raspberry pi camera can do 12MP/60fps > > or 1080p at 240fps [1] > > 1: https://developer.sony.com/imx500/imx500-key-specifications > > Oh bit the numbers from perplexity were for a 3,000mp chip 0.o sounds > expensive
Oh! But these chips generally offer higher frame rates at lower resolutions, so they _already_ can exchange between space and time. It should be fine to reorder matrices to be more serial.
