PIG vs HIVE
Hi All, I want to understand about the exceptional cases where Hive takes over Pig and Pig takes over Hive. leaving the Fact Pig is best as an ETL Tool and Hive is best Data Warehouse. Please suggest me me the real use cases for both. Thanks Regards Yogesh Kumar
Re: PIG vs HIVE
you may want to read the following pages one is from pig architect http://developer.yahoo.com/blogs/hadoop/posts/2010/01/comparing_pig_latin_and_sql_fo/ http://www.larsgeorge.com/2009/10/hive-vs-pig.html also remember that these technologies are evolving On Thu, Oct 18, 2012 at 12:32 AM, yogesh dhari yogeshdh...@live.com wrote: Hi All, I want to understand about the exceptional cases where Hive takes over Pig and Pig takes over Hive. leaving the Fact Pig is best as an ETL Tool and Hive is best Data Warehouse. Please suggest me me the real use cases for both. Thanks Regards Yogesh Kumar -- Nitin Pawar
Re: Latest Pig vs Hive comparisons
Thanks all for the links. But i must say none of the links covered my question. The link, Aniket provided has some information which i already looked at - Author probably need to update the content. I was looking for new features up-to-date comparison. -Bharath On Wed, Sep 19, 2012 at 1:35 PM, Bertrand Dechoux decho...@gmail.comwrote: Although the two first links are interesting reads, I would recommend you the last one provided by Russel. The key thing is not to think I will choose the most efficient wrt to performance but I will choose the most in tune with my use cases. Secondly, HCatalog is really something worth mentioning. Basically, the difference in format handling as explained in the other articles is less hard-lined now. Regards Bertrand On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney russell.jur...@gmail.comwrote: A presentation on Hive vs Pig by a committer on both projects is here: http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 18, 2012, at 3:01 PM, Aniket Mokashi aniket...@gmail.com wrote: (Probably not what you are looking for) Check - http://www.larsgeorge.com/2009/10/hive-vs-pig.html ~Aniket On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney russell.jur...@gmail.com wrote: A detailed post comparing Pig/Hive performance from last week: http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 14, 2012, at 10:55 AM, Anurag Tangri tangri.anu...@gmail.com wrote: Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath -- ...:::Aniket:::... Quetzalco@tl -- Bertrand Dechoux
Re: Latest Pig vs Hive comparisons
While pig and hive are mostly the same (as they abstract you from the internals of map reduce) they are totally different (as one is a flow language and one is an interpreted sql like language). So the differences are too numerous to mention. On Thu, Sep 20, 2012 at 3:48 PM, Bharath Mundlapudi mundlap...@gmail.com wrote: Thanks all for the links. But i must say none of the links covered my question. The link, Aniket provided has some information which i already looked at - Author probably need to update the content. I was looking for new features up-to-date comparison. -Bharath On Wed, Sep 19, 2012 at 1:35 PM, Bertrand Dechoux decho...@gmail.com wrote: Although the two first links are interesting reads, I would recommend you the last one provided by Russel. The key thing is not to think I will choose the most efficient wrt to performance but I will choose the most in tune with my use cases. Secondly, HCatalog is really something worth mentioning. Basically, the difference in format handling as explained in the other articles is less hard-lined now. Regards Bertrand On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney russell.jur...@gmail.com wrote: A presentation on Hive vs Pig by a committer on both projects is here: http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 18, 2012, at 3:01 PM, Aniket Mokashi aniket...@gmail.com wrote: (Probably not what you are looking for) Check -http://www.larsgeorge.com/2009/10/hive-vs-pig.html ~Aniket On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney russell.jur...@gmail.com wrote: A detailed post comparing Pig/Hive performance from last week: http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 14, 2012, at 10:55 AM, Anurag Tangri tangri.anu...@gmail.com wrote: Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath -- ...:::Aniket:::... Quetzalco@tl -- Bertrand Dechoux
Re: Latest Pig vs Hive comparisons
So the differences are too numerous to mention. From a feature point of view (at a macro level) not many difference. IMHO, Lars did a fantastic job of listing those differences. Unfortunately, both the projects are moving targets and that article needs an update. If time permits, I will write a blog on this. -Bharath On Thu, Sep 20, 2012 at 1:21 PM, Edward Capriolo edlinuxg...@gmail.comwrote: While pig and hive are mostly the same (as they abstract you from the internals of map reduce) they are totally different (as one is a flow language and one is an interpreted sql like language). So the differences are too numerous to mention. On Thu, Sep 20, 2012 at 3:48 PM, Bharath Mundlapudi mundlap...@gmail.com wrote: Thanks all for the links. But i must say none of the links covered my question. The link, Aniket provided has some information which i already looked at - Author probably need to update the content. I was looking for new features up-to-date comparison. -Bharath On Wed, Sep 19, 2012 at 1:35 PM, Bertrand Dechoux decho...@gmail.com wrote: Although the two first links are interesting reads, I would recommend you the last one provided by Russel. The key thing is not to think I will choose the most efficient wrt to performance but I will choose the most in tune with my use cases. Secondly, HCatalog is really something worth mentioning. Basically, the difference in format handling as explained in the other articles is less hard-lined now. Regards Bertrand On Wed, Sep 19, 2012 at 2:42 AM, Russell Jurney russell.jur...@gmail.com wrote: A presentation on Hive vs Pig by a committer on both projects is here: http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 18, 2012, at 3:01 PM, Aniket Mokashi aniket...@gmail.com wrote: (Probably not what you are looking for) Check -http://www.larsgeorge.com/2009/10/hive-vs-pig.html ~Aniket On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney russell.jur...@gmail.com wrote: A detailed post comparing Pig/Hive performance from last week: http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 14, 2012, at 10:55 AM, Anurag Tangri tangri.anu...@gmail.com wrote: Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath -- ...:::Aniket:::... Quetzalco@tl -- Bertrand Dechoux
Re: Latest Pig vs Hive comparisons
(Probably not what you are looking for) Check - http://www.larsgeorge.com/2009/10/hive-vs-pig.html ~Aniket On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney russell.jur...@gmail.comwrote: A detailed post comparing Pig/Hive performance from last week: http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 14, 2012, at 10:55 AM, Anurag Tangri tangri.anu...@gmail.com wrote: Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath -- ...:::Aniket:::... Quetzalco@tl
Re: Latest Pig vs Hive comparisons
A presentation on Hive vs Pig by a committer on both projects is here: http://hortonworks.com/blog/hadoop-features-large-at-stanford-xldb/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 18, 2012, at 3:01 PM, Aniket Mokashi aniket...@gmail.com wrote: (Probably not what you are looking for) Check - http://www.larsgeorge.com/2009/10/hive-vs-pig.html ~Aniket On Fri, Sep 14, 2012 at 2:28 PM, Russell Jurney russell.jur...@gmail.comwrote: A detailed post comparing Pig/Hive performance from last week: http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 14, 2012, at 10:55 AM, Anurag Tangri tangri.anu...@gmail.com wrote: Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath -- ...:::Aniket:::... Quetzalco@tl
Latest Pig vs Hive comparisons
Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath
Re: Latest Pig vs Hive comparisons
Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath
Re: Latest Pig vs Hive comparisons
A detailed post comparing Pig/Hive performance from last week: http://hortonworks.com/blog/pig-performance-and-optimization-analysis/ Russell Jurney twitter.com/rjurney russell.jur...@gmail.com datasyndrome.com On Sep 14, 2012, at 10:55 AM, Anurag Tangri tangri.anu...@gmail.com wrote: Knowing performance statistics would be good too. Sent from my iPhone On Sep 14, 2012, at 10:34 AM, Bharath Mundlapudi mundlap...@gmail.com wrote: Hello Community, Is there any document/blog comparing different features offered by Pig 0.8 (0.9, 0.10) or greater and Hive 0.8 (0.9)? -Bharath
