Hive vs. DryadLINQ

2009-10-15 Thread Qing Yan
Hi, Has anyone looked into the Microsoft Dryad project? Their basic idea is using DAG(connect computational vertices with communication edges) to model distributed computing flows. And they have something called DryadLINQ which seems to be the Hive equivilent. Since the DAG model

Re: Hive vs. DryadLINQ

2009-10-15 Thread Jeff Hammerbacher
Hey Qing, You can download Dryad and see for yourself: http://connect.microsoft.com/site/sitehome.aspx?SiteID=891. There's no accompanying distributed file system, unfortunately, and I've never seen a benchmark of Dryad scaling to more than 300 nodes, so it's not clear that it's the right model