Ok, HDFS is now enabled.  You'll see a stream of updates shortly on the ~30 
Patch Available HDFS issues.

Nige

On Dec 20, 2010, at 12:42 PM, Jakob Homan wrote:

> I committed HDFS-1511 this morning.  We should be good to go.  I can
> haz snooty robot butler?
> 
> On Fri, Dec 17, 2010 at 8:31 PM, Konstantin Boudnik <c...@apache.org> wrote:
>> Thanks Jacob. I am wasted already but I can do it on Sun, I think,
>> unless it is done earlier.
>> --
>>   Take care,
>> Konstantin (Cos) Boudnik
>> 
>> 
>> 
>> On Fri, Dec 17, 2010 at 19:41, Jakob Homan <jgho...@gmail.com> wrote:
>>> Ok.  I'll get a patch out for 1511 tomorrow, unless someone wants to
>>> whip one up tonight.
>>> 
>>> 
>>> On Fri, Dec 17, 2010 at 7:22 PM, Nigel Daley <nda...@mac.com> wrote:
>>>> I agree with Cos on fixing HDFS-1511 first. Once that is done I'll enable 
>>>> hdfs patch testing.
>>>> 
>>>> Cheers,
>>>> Nige
>>>> 
>>>> Sent from my iPhone4
>>>> 
>>>> On Dec 17, 2010, at 7:01 PM, Konstantin Boudnik <c...@apache.org> wrote:
>>>> 
>>>>> One more issue needs to be addressed before test-patch is turned on HDFS 
>>>>> is
>>>>>  https://issues.apache.org/jira/browse/HDFS-1511
>>>>> --
>>>>>   Take care,
>>>>> Konstantin (Cos) Boudnik
>>>>> 
>>>>> 
>>>>> 
>>>>> On Fri, Dec 17, 2010 at 16:17, Konstantin Boudnik <c...@apache.org> wrote:
>>>>>> Considering that because of these 4 faulty cases every patch will be
>>>>>> -1'ed a patch author will still have to look at it and make a comment
>>>>>> why this particular -1 isn't valid. Lesser work, perhaps, but messier
>>>>>> IMO. I'm not blocking it - I just feel like there's a better way.
>>>>>> 
>>>>>> --
>>>>>>   Take care,
>>>>>> Konstantin (Cos) Boudnik
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> On Fri, Dec 17, 2010 at 15:55, Jakob Homan <jgho...@gmail.com> wrote:
>>>>>>>> If HDFS is added to the test-patch queue right now we get
>>>>>>>> nothing but dozens of -1'ed patches.
>>>>>>> There aren't dozens of patches being submitted currently.  The -1
>>>>>>> isn't the important thing, it's the grunt work of actually running
>>>>>>> (and waiting) for the tests, test-patch, etc. that Hudson does so that
>>>>>>> the developer doesn't have to.
>>>>>>> 
>>>>>>> On Fri, Dec 17, 2010 at 3:48 PM, Dhruba Borthakur <dhr...@gmail.com> 
>>>>>>> wrote:
>>>>>>>> +1, thanks for doing this.
>>>>>>>> 
>>>>>>>> On Fri, Dec 17, 2010 at 3:19 PM, Jakob Homan <jgho...@gmail.com> wrote:
>>>>>>>> 
>>>>>>>>> So, with test-patch updated to show the failing tests, saving the
>>>>>>>>> developers the need to go and verify that the failed tests are all
>>>>>>>>> known, how do people feel about turning on test-patch again for HDFS
>>>>>>>>> and mapred?  I think it'll help prevent any more tests from entering
>>>>>>>>> the "yeah, we know" category.
>>>>>>>>> 
>>>>>>>>> Thanks,
>>>>>>>>> jg
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> On Wed, Nov 17, 2010 at 5:08 PM, Jakob Homan <jho...@yahoo-inc.com> 
>>>>>>>>> wrote:
>>>>>>>>>> True, each patch would get a -1 and the failing tests would need to 
>>>>>>>>>> be
>>>>>>>>>> verified as those known bad (BTW, it would be great if Hudson could 
>>>>>>>>>> list
>>>>>>>>>> which tests failed in the message it posts to JIRA).  But that's 
>>>>>>>>>> still
>>>>>>>>> quite
>>>>>>>>>> a bit less error-prone work than if the developer runs the tests and
>>>>>>>>>> test-patch themselves.  Also, with 22 being cut, there are a lot of
>>>>>>>>> patches
>>>>>>>>>> up in the air and several developers are juggling multiple patches.  
>>>>>>>>>> The
>>>>>>>>>> more automation we can have, even if it's not perfect, will decrease
>>>>>>>>> errors
>>>>>>>>>> we may make.
>>>>>>>>>> -jg
>>>>>>>>>> 
>>>>>>>>>> Nigel Daley wrote:
>>>>>>>>>>> 
>>>>>>>>>>> On Nov 17, 2010, at 3:11 PM, Jakob Homan wrote:
>>>>>>>>>>> 
>>>>>>>>>>>>> It's also ready to run on MapReduce and HDFS but we won't turn it 
>>>>>>>>>>>>> on
>>>>>>>>>>>>> until these projects build and test cleanly.  Looks like both 
>>>>>>>>>>>>> these
>>>>>>>>> projects
>>>>>>>>>>>>> currently have test failures.
>>>>>>>>>>>> 
>>>>>>>>>>>> Assuming the projects are compiling and building, is there a 
>>>>>>>>>>>> reason to
>>>>>>>>>>>> not turn it on despite the test failures? Hudson is invaluable to
>>>>>>>>> developers
>>>>>>>>>>>> who then don't have to run the tests and test-patch themselves.  We
>>>>>>>>> didn't
>>>>>>>>>>>> turn Hudson off when it was working previously and there were known
>>>>>>>>>>>> failures.  I think one of the reasons we have more failing tests 
>>>>>>>>>>>> now is
>>>>>>>>> the
>>>>>>>>>>>> higher cost of doing Hudson's work (not a great excuse I know).  
>>>>>>>>>>>> This
>>>>>>>>> is
>>>>>>>>>>>> particularly true now because several of the failing tests involve
>>>>>>>>> tests
>>>>>>>>>>>> timing out, making the whole testing regime even longer.
>>>>>>>>>>> 
>>>>>>>>>>> Every single patch would get a -1 and need investigation.  
>>>>>>>>>>> Currently,
>>>>>>>>> that
>>>>>>>>>>> would be about 83 investigations between MR and HDFS issues that 
>>>>>>>>>>> are in
>>>>>>>>>>> patch available state.  Shouldn't we focus on getting these tests 
>>>>>>>>>>> fixed
>>>>>>>>> or
>>>>>>>>>>> removed/?  Also, I need to get MAPREDUCE-2172 fixed (applies to 
>>>>>>>>>>> HDFS as
>>>>>>>>>>> well) before I turn this on.
>>>>>>>>>>> 
>>>>>>>>>>> Cheers,
>>>>>>>>>>> Nige
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> --
>>>>>>>> Connect to me at http://www.facebook.com/dhruba
>>>>>>>> 
>>>>>>> 
>>>>>> 
>>>> 
>>> 
>> 

Reply via email to