Hadoop and Cuda , JCuda (CPU+GPU architecture)

Hi I am going to process video analytics using hadoop I am very interested about CPU+GPU architercute espessially using CUDA ( http://www.nvidia.com/object/cuda_home_new.html) and JCUDA ( http://jcuda.org/) Does using HADOOP and CPU+GPU architecture bring significant performance improvement and do

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Oleg, I, on the other hand, have a project that might benefit, but not the implementation as yet. http://frd.org/ is very CPU intensive. So please share your notes. Mark On Mon, Sep 24, 2012 at 10:30 AM, Oleg Ruchovets wrote: > Hi > > I am going to process video analytics using hadoop > I a

Re: hadoop and video processing

I am not an expert in distributed video processing / analytics. However, the answer you are seeking will depend on the size of your videos and the algorithms you want to use. Ideally, you would want to process part of the videos in parallel using map tasks and then merge the results using the reduc

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop On Mon, Sep 24, 2012 at 10:30 AM, Oleg Ruchovets wrote: > Hi > > I am going to process video analytics using hadoop > I am very interested about CPU+GPU architercute espessially using CUDA ( > http://www.nvidia.com/object/cuda_home_new.html) and JC

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Thank you very much. I saw this link !!! . Do you have any code , example shared in the network (github for example). On Mon, Sep 24, 2012 at 5:33 PM, Chen He wrote: > http://wiki.apache.org/hadoop/CUDA%20On%20Hadoop > > On Mon, Sep 24, 2012 at 10:30 AM, Oleg Ruchovets >wrote: > > > Hi > > >

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Please see the Jcuda example. I do refer from there. BTW, you can also compile your cuda code in advance and let your hadoop code call those compiled code through Jcuda. That is what I did in my program. On Mon, Sep 24, 2012 at 10:45 AM, Oleg Ruchovets wrote: > Thank you very much. I saw this li

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Great , Can you give some tips or best practices like: 1) file size 2) Is it good Idea to process data as locally as possble (I mean process a data like one file per one map) 3) During your project did you face with limitations , problems? Can you point me on which hartware is better to use

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Hi Oleg I will answer your questions one by one. 1) file size There is no exactly number of file size that will definitely works well for GPGPU+Hadoop. You need to do your project POC to get the number. I think the GPU+Hadoop is very suitable for computation-intensive and data-intensive applica

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Make sure to checkout the rootbeer compiler that makes life easy: https://github.com/pcpratts/rootbeer1 On Mon, Sep 24, 2012 at 10:26 PM, Chen He wrote: > Hi Oleg > > I will answer your questions one by one. > > 1) file size > > There is no exactly number of file size that will definitely works w

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

On Mon, Sep 24, 2012 at 10:38 AM, Harsh J wrote: > Make sure to checkout the rootbeer compiler that makes life easy: > https://github.com/pcpratts/rootbeer1 Indeed. Interesting to think about how one might plumb Mapper and Reducer to Rootbeer's ParallelRuntime. Best regards, - Andy Problems

Re: Passing Command-line Parameters to the Job Submit Command

Thanks Hemanth, But in general, if we want to pass arguments to any job (not only PiEstimator from examples-jar) and submit the Job to the Job queue scheduler, by the looks of it, we might always need to use the java environment variables only. Is my above assumption correct? Thanks, Varad On M

libhdfs install dep

Anybody know why libhdfs.so is not found by package managers on CentOS 64 and OpenSuse64? I hava an rpm which declares Hadoop as a dependacy, but the package managers (KPackageKit, zypper, etc) report libhdfs.so as a missing dependency eventhough Hadoop has been installed via rpm package, and

Re: Hadoop and Cuda , JCuda (CPU+GPU architecture)

Sir We tried to integrate hadoop and JCUDA. We tried a code from http://code.google.com/p/mrcl/source/browse/trunk/hama-mrcl/src/mrcl/mrcl/?r=76 We re able to compile. We are not able to execute. It does not recognise JCUBLAS.jar. We tried setting the classpath We are herewith attaching the pr

RE: libhdfs install dep

Rodrigo, Assuming you are asking for hadoop 1.x You are missing the hadoop-<*>libhdfs* rpm. Build it or get it from the vendor you got your hadoop from. -Original Message- From: Pastrana, Rodrigo (RIS-BCT) [mailto:rodrigo.pastr...@lexisnexis.com] Sent: Monday, September 24, 2012