Rob Clark wrote:
On Mon, 12 Oct 2009, Rob Clark wrote:

It would be great to use the GPU for ZFS or to offload some of ...
Let us know when you have a demo ready. :-)

[b]Other[/b] demos showing a few 'lousy speed-ups of only 2 times' with some speed-ups reaching over 1000 times faster. The general consensus seems to be that a 8-12 times speed-up is a reasonable expectation (with some effort) for the so-called "average Problem". See: http://www.nvidia.com/object/cuda_apps_flash_new.html
It all depends on the code so I wouldn't say there's any reasonable expectation. To assume otherwise is flawed..
If SunStudio had some GPU support and there were a few functions added for the hotpoints ...
GPUs are great for some things but it is difficult to imagine a GPU being of assistance in the zfs implementation due to way too much latency, optimization for floating point rather than integer, and due to creating a "hotpoint". For zfs it is much better to spread the load across multiple CPU cores using many threads as is done now.

Bob
--

If you wait long enough someone will 'build a Bridge to it' ...


Accelerating Distributed Storage Systems with CUDA - Paper & Code
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=e223fbfc-f017-498c-8174-699747dbd88b
I believe I commented on this thread before and that paper mostly focuses on hashed and md5 checksums. The other problem is that while as long as the GPU is on the other side of the memory controller it's unlikely to be "cost" (performance/latency) effective to do the expensive round-trip for small chunks of data. Depending on the storage topology and stack of course... *If* you had some master node doing checksums or doing it at the application layer it could possible make sense, but it would need to be some seriously huge workload to justify it.

Real-time Parallel Hashing on the GPU
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=d91c3c63-a2d6-4a15-a70a-87bcafdd70d8


CUDA Multiforcer - Password Recovery or Testing if Password is 'Secure Enough'
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=9e515da5-c97e-4c37-8305-f27982a02d5f


Parallelizing Hash-based Data Carving
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=f93b62b6-b6af-497e-83a8-865af31c8d7a
 and Paper: http://arxiv.org/abs/0901.1307


Support for OpenCL in OpenSolaris would be a good thing,
OpenCL wouldn't help solve this and from the research papers I've seen it's lower performance and higher execution times than CUDA.

/* Disclaimer : I work for a vendor doing a GPGPU solution based on HMPP which will be ported to Solaris. Our driver some parts of the stack are open source as well.. */



./C
_______________________________________________
zfs-code mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/zfs-code

Reply via email to