Rob Clark wrote:
On Mon, 12 Oct 2009, Rob Clark wrote:
It would be great to use the GPU for ZFS or to offload some of ...
Let us know when you have a demo ready. :-)
[b]Other[/b] demos showing a few 'lousy speed-ups of only 2 times' with some speed-ups reaching over 1000 times faster.
The general consensus seems to be that a 8-12 times speed-up is a reasonable expectation (with some effort) for
the so-called "average Problem". See: http://www.nvidia.com/object/cuda_apps_flash_new.html
It all depends on the code so I wouldn't say there's any reasonable
expectation. To assume otherwise is flawed..
If SunStudio had some GPU support and there were a few functions
added for the hotpoints ...
GPUs are great for some things but it is difficult to imagine a GPU
being of assistance in the zfs implementation due to way too much
latency, optimization for floating point rather than integer, and due
to creating a "hotpoint". For zfs it is much better to spread the
load across multiple CPU cores using many threads as is done now.
Bob
--
If you wait long enough someone will 'build a Bridge to it' ...
Accelerating Distributed Storage Systems with CUDA - Paper & Code
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=e223fbfc-f017-498c-8174-699747dbd88b
I believe I commented on this thread before and that paper mostly
focuses on hashed and md5 checksums. The other problem is that while as
long as the GPU is on the other side of the memory controller it's
unlikely to be "cost" (performance/latency) effective to do the
expensive round-trip for small chunks of data. Depending on the storage
topology and stack of course... *If* you had some master node doing
checksums or doing it at the application layer it could possible make
sense, but it would need to be some seriously huge workload to justify it.
Real-time Parallel Hashing on the GPU
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=d91c3c63-a2d6-4a15-a70a-87bcafdd70d8
CUDA Multiforcer - Password Recovery or Testing if Password is 'Secure Enough'
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=9e515da5-c97e-4c37-8305-f27982a02d5f
Parallelizing Hash-based Data Carving
http://www.nvidia.com/object/cuda_apps_flash_new.html#state=detailsOpen;aid=f93b62b6-b6af-497e-83a8-865af31c8d7a
and Paper: http://arxiv.org/abs/0901.1307
Support for OpenCL in OpenSolaris would be a good thing,
OpenCL wouldn't help solve this and from the research papers I've seen
it's lower performance and higher execution times than CUDA.
/* Disclaimer : I work for a vendor doing a GPGPU solution based on HMPP
which will be ported to Solaris. Our driver some parts of the stack are
open source as well.. */
./C
_______________________________________________
zfs-code mailing list
[email protected]
http://mail.opensolaris.org/mailman/listinfo/zfs-code