Re: Dev meetup Nov 2015
Thanks for archiving the slides, Thejas! Yes, the meetup is very successful. Thanks to all for presenting or attending to Hortonworks for hosting. I think there were several topics that were brought up in the meetup deserving further discussion, such as data correctness issue, qtest destiny, quality collaboration, etc. Before we totally forget, I think we should resume the discussion so that we have certain actionable items. Thus, I'm going to trigger a couple of [DISCUSSION] threads as a start. Others please feel free to start discussions that you think important. Your feedback is greatly appreciated. Thanks, Xuefu On Wed, Nov 18, 2015 at 2:00 PM, Thejas Nair wrote: > Thanks to all who attended the meetup. There were great talks and > discussions! > > Here are the slides - > > https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup > > > On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang wrote: > > HI folks, > > > > Here is the talks that are scheduled for Monday's meetup. As you can see > > that we have a full schedule, speakers please constrain your talk within > > the given slot. > > > > 1. Lessons learned from enterprise users (Xuefu, 5m) > > 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m) > > 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m) > > 4. Correctness issue reporting and tracking guideline (Carl, 5m) > > 5. Dynamic dependency resolution and classloader issues (Anthony, 10m) > > 6. A query syntax validation tool for Hive. (Szehon, 15m) > > 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m) > > 8. Uber's plan for Hive and our expected feature from the overall dev > > community (Mohammad Islam, 15m) > > 9. Update on LLAP (Gopal V Vijayaraghavan, 10m) > > > > See you all there! > > > > --Xuefu > > > > On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang wrote: > > > >> Hi all, > >> > >> As an update, here is the link to the meetup: > >> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please > >> RSVP as soon as possible because the organizers do need a headcount > before > >> the event. > >> > >> Also, we are finalizing a list of talks. If you plan to give a talk, > >> please let the organizer know. > >> > >> Thanks, > >> Xuefu > >> > >> > >> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang > wrote: > >> > >>> Hi all, > >>> > >>> Apache Hive community is considering a developer meetup in the middle > of > >>> this month. While we are finalizing the venue, I'd like to invite you > to > >>> plan to join, and even better, to give talk in the event. > >>> > >>> We consider the center of the meetup would be around the quality aspect > >>> of the Project, and like to establish a collaborative effort in > improving > >>> Hive's quality. In the meantime, any topic will be considered. > >>> > >>> Please let me or Thejas know if you'd like to give a talk. > >>> > >>> Detailed venue and agenda will be given soon. Look forward to meeting > you > >>> in two weeks! > >>> > >>> Regards, > >>> > >>> Xuefu > >>> > >> > >> >
Re: Dev meetup Nov 2015
Thejas, thank you for sharing the slides! On Thu, Nov 19, 2015 at 1:00 AM, Thejas Nair wrote: > Thanks to all who attended the meetup. There were great talks and > discussions! > > Here are the slides - > > https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup > > > On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang wrote: > > HI folks, > > > > Here is the talks that are scheduled for Monday's meetup. As you can see > > that we have a full schedule, speakers please constrain your talk within > > the given slot. > > > > 1. Lessons learned from enterprise users (Xuefu, 5m) > > 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m) > > 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m) > > 4. Correctness issue reporting and tracking guideline (Carl, 5m) > > 5. Dynamic dependency resolution and classloader issues (Anthony, 10m) > > 6. A query syntax validation tool for Hive. (Szehon, 15m) > > 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m) > > 8. Uber's plan for Hive and our expected feature from the overall dev > > community (Mohammad Islam, 15m) > > 9. Update on LLAP (Gopal V Vijayaraghavan, 10m) > > > > See you all there! > > > > --Xuefu > > > > On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang wrote: > > > >> Hi all, > >> > >> As an update, here is the link to the meetup: > >> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please > >> RSVP as soon as possible because the organizers do need a headcount > before > >> the event. > >> > >> Also, we are finalizing a list of talks. If you plan to give a talk, > >> please let the organizer know. > >> > >> Thanks, > >> Xuefu > >> > >> > >> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang > wrote: > >> > >>> Hi all, > >>> > >>> Apache Hive community is considering a developer meetup in the middle > of > >>> this month. While we are finalizing the venue, I'd like to invite you > to > >>> plan to join, and even better, to give talk in the event. > >>> > >>> We consider the center of the meetup would be around the quality aspect > >>> of the Project, and like to establish a collaborative effort in > improving > >>> Hive's quality. In the meantime, any topic will be considered. > >>> > >>> Please let me or Thejas know if you'd like to give a talk. > >>> > >>> Detailed venue and agenda will be given soon. Look forward to meeting > you > >>> in two weeks! > >>> > >>> Regards, > >>> > >>> Xuefu > >>> > >> > >> >
Re: Dev meetup Nov 2015
Hi, I've attached the LLAP Slides from the meetup to that. For those who missed the meeting, I've recreated the demo as a video. http://people.apache.org/~gopalv/LLAP.gif TL;DR - The data-set is the TPC-DS 1000Gb scale data-set & I'm running 2x160Gb LLAP instances (16 physical cores each), with 16Gb caches (so net-cache size of 32Gb). LLAP - 890 milliseconds Tez - 9.47 seconds MR2 - 183 seconds Cheers, Gopal On 11/18/15, 2:00 PM, "Thejas Nair" wrote: >Thanks to all who attended the meetup. There were great talks and >discussions! > >Here are the slides - >https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentatio >ns-November2015HiveContributorMeetup > > >On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang wrote: >> HI folks, >> >> Here is the talks that are scheduled for Monday's meetup. As you can see >> that we have a full schedule, speakers please constrain your talk within >> the given slot. >> >> 1. Lessons learned from enterprise users (Xuefu, 5m) >> 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m) >> 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m) >> 4. Correctness issue reporting and tracking guideline (Carl, 5m) >> 5. Dynamic dependency resolution and classloader issues (Anthony, 10m) >> 6. A query syntax validation tool for Hive. (Szehon, 15m) >> 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m) >> 8. Uber's plan for Hive and our expected feature from the overall dev >> community (Mohammad Islam, 15m) >> 9. Update on LLAP (Gopal V Vijayaraghavan, 10m) >> >> See you all there! >> >> --Xuefu >> >> On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang wrote: >> >>> Hi all, >>> >>> As an update, here is the link to the meetup: >>> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please >>> RSVP as soon as possible because the organizers do need a headcount >>>before >>> the event. >>> >>> Also, we are finalizing a list of talks. If you plan to give a talk, >>> please let the organizer know. >>> >>> Thanks, >>> Xuefu >>> >>> >>> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang >>>wrote: >>> Hi all, Apache Hive community is considering a developer meetup in the middle of this month. While we are finalizing the venue, I'd like to invite you to plan to join, and even better, to give talk in the event. We consider the center of the meetup would be around the quality aspect of the Project, and like to establish a collaborative effort in improving Hive's quality. In the meantime, any topic will be considered. Please let me or Thejas know if you'd like to give a talk. Detailed venue and agenda will be given soon. Look forward to meeting you in two weeks! Regards, Xuefu >>> >>> >
Re: Dev meetup Nov 2015
Thanks to all who attended the meetup. There were great talks and discussions! Here are the slides - https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang wrote: > HI folks, > > Here is the talks that are scheduled for Monday's meetup. As you can see > that we have a full schedule, speakers please constrain your talk within > the given slot. > > 1. Lessons learned from enterprise users (Xuefu, 5m) > 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m) > 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m) > 4. Correctness issue reporting and tracking guideline (Carl, 5m) > 5. Dynamic dependency resolution and classloader issues (Anthony, 10m) > 6. A query syntax validation tool for Hive. (Szehon, 15m) > 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m) > 8. Uber's plan for Hive and our expected feature from the overall dev > community (Mohammad Islam, 15m) > 9. Update on LLAP (Gopal V Vijayaraghavan, 10m) > > See you all there! > > --Xuefu > > On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang wrote: > >> Hi all, >> >> As an update, here is the link to the meetup: >> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please >> RSVP as soon as possible because the organizers do need a headcount before >> the event. >> >> Also, we are finalizing a list of talks. If you plan to give a talk, >> please let the organizer know. >> >> Thanks, >> Xuefu >> >> >> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang wrote: >> >>> Hi all, >>> >>> Apache Hive community is considering a developer meetup in the middle of >>> this month. While we are finalizing the venue, I'd like to invite you to >>> plan to join, and even better, to give talk in the event. >>> >>> We consider the center of the meetup would be around the quality aspect >>> of the Project, and like to establish a collaborative effort in improving >>> Hive's quality. In the meantime, any topic will be considered. >>> >>> Please let me or Thejas know if you'd like to give a talk. >>> >>> Detailed venue and agenda will be given soon. Look forward to meeting you >>> in two weeks! >>> >>> Regards, >>> >>> Xuefu >>> >> >>
Re: Dev meetup Nov 2015
HI folks, Here is the talks that are scheduled for Monday's meetup. As you can see that we have a full schedule, speakers please constrain your talk within the given slot. 1. Lessons learned from enterprise users (Xuefu, 5m) 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m) 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m) 4. Correctness issue reporting and tracking guideline (Carl, 5m) 5. Dynamic dependency resolution and classloader issues (Anthony, 10m) 6. A query syntax validation tool for Hive. (Szehon, 15m) 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m) 8. Uber's plan for Hive and our expected feature from the overall dev community (Mohammad Islam, 15m) 9. Update on LLAP (Gopal V Vijayaraghavan, 10m) See you all there! --Xuefu On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang wrote: > Hi all, > > As an update, here is the link to the meetup: > http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please > RSVP as soon as possible because the organizers do need a headcount before > the event. > > Also, we are finalizing a list of talks. If you plan to give a talk, > please let the organizer know. > > Thanks, > Xuefu > > > On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang wrote: > >> Hi all, >> >> Apache Hive community is considering a developer meetup in the middle of >> this month. While we are finalizing the venue, I'd like to invite you to >> plan to join, and even better, to give talk in the event. >> >> We consider the center of the meetup would be around the quality aspect >> of the Project, and like to establish a collaborative effort in improving >> Hive's quality. In the meantime, any topic will be considered. >> >> Please let me or Thejas know if you'd like to give a talk. >> >> Detailed venue and agenda will be given soon. Look forward to meeting you >> in two weeks! >> >> Regards, >> >> Xuefu >> > >
Re: Dev meetup Nov 2015
Hi all, As an update, here is the link to the meetup: http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please RSVP as soon as possible because the organizers do need a headcount before the event. Also, we are finalizing a list of talks. If you plan to give a talk, please let the organizer know. Thanks, Xuefu On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang wrote: > Hi all, > > Apache Hive community is considering a developer meetup in the middle of > this month. While we are finalizing the venue, I'd like to invite you to > plan to join, and even better, to give talk in the event. > > We consider the center of the meetup would be around the quality aspect of > the Project, and like to establish a collaborative effort in improving > Hive's quality. In the meantime, any topic will be considered. > > Please let me or Thejas know if you'd like to give a talk. > > Detailed venue and agenda will be given soon. Look forward to meeting you > in two weeks! > > Regards, > > Xuefu >
