[cross-project-issues-dev] Disk usage report for Hudson/Build

[genie]

Compiled 2017-02-08T16:07

 build.eclipse.org 
-> Usage exceeding 1GB for: Hudson master jobs and workspace (2017-02-08T10:00)
   2.8G papyrus-trunk-nightly
   1.7G papyrus-trunk-extra-nightly
-> Usage exceeding 1GB for: /shared (1000G capacity) (2017-02-08T10:00)
1492.8G hipp
 216.8G rt
 176.1G eclipse
  42.1G webtools
  33.6G technology
  23.4G common
  11.4G tools
   8.1G jobs
   7.6G orbit
   6.7G cbi-ng.deleteme
   5.4G modeling
   2.7G simrel
   1.6G mylyn
   1.5G cbi
   1.4G soa
-> Usage exceeding 1GB for: /shared/modeling
   3.1G build
-> Usage exceeding 1GB for: /shared/tools
   4.6G tm
   2.1G objectteams
   1.4G mtj
   1.1G aspectj
-> Usage exceeding 1GB for: /shared/technology
  18.6G epp
   4.8G stem
   3.3G babel
   2.4G cosmos
   1.6G m2e
 END: build.eclipse.org 


 hudson-slave1.eclipse.org 
/dev/xvda1158G   23G  135G  15% /
-> Usage exceeding 1GB for: Hudson workspace on hudson-slave1 (50G capacity) 
(2016-08-18T21:00)
 END: hudson-slave1.eclipse.org 


 hudson-slave2.eclipse.org 
-> Usage exceeding 1GB for: 
 END: hudson-slave2.eclipse.org 


 hudson-slave3.eclipse.org 
/dev/xvda1 55G   23G   33G  41% /
-> Usage exceeding 1GB for: Hudson workspace on hudson-slave3 (50G capacity) 
(2017-02-07T18:00)
 END: hudson-slave3.eclipse.org 

___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Marketplace down?

[Greg Watson]

Apparently is was a cache issue [1]. It's working for me again now.

Thanks,
Greg

[1] https://bugs.eclipse.org/bugs/show_bug.cgi?id=511934 


> On Feb 8, 2017, at 1:51 PM, Denis Roy  wrote:
> 
> All good here.
> 
> On 08/02/17 01:41 PM, Greg Watson wrote:
>> I'm getting the message "Error" when I try to access 
>> https://marketplace.eclipse.org. Is anyone else seeing this?
>> 
>> Thanks
>> Greg
>> ___
>> cross-project-issues-dev mailing list
>> cross-project-issues-dev@eclipse.org
>> To change your delivery options, retrieve your password, or unsubscribe from 
>> this list, visit
>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
> 
> 
> ___
> cross-project-issues-dev mailing list
> cross-project-issues-dev@eclipse.org
> To change your delivery options, retrieve your password, or unsubscribe from 
> this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Marketplace down?

[Denis Roy]

All good here.

On 08/02/17 01:41 PM, Greg Watson wrote:
> I'm getting the message "Error" when I try to access 
> https://marketplace.eclipse.org. Is anyone else seeing this?
>
> Thanks
> Greg
> ___
> cross-project-issues-dev mailing list
> cross-project-issues-dev@eclipse.org
> To change your delivery options, retrieve your password, or unsubscribe from 
> this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev


___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Marketplace down?

[Antoine THOMAS]

Works for me. No error message.

Le 8 févr. 2017 7:41 PM, "Greg Watson"  a écrit :

> I'm getting the message "Error" when I try to access
> https://marketplace.eclipse.org. Is anyone else seeing this?
>
> Thanks
> Greg
> ___
> cross-project-issues-dev mailing list
> cross-project-issues-dev@eclipse.org
> To change your delivery options, retrieve your password, or unsubscribe
> from this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
>
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

[cross-project-issues-dev] Marketplace down?

[Greg Watson]

I'm getting the message "Error" when I try to access 
https://marketplace.eclipse.org. Is anyone else seeing this?

Thanks
Greg
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Excessive disk usage of HIPPs

[Frederic Gurr]

Hi Laurent,

Here is a more detailed list for emfcompare:

hipp8:/jobs/genie.emfcompare # du -shc *
50M clean-nightly
1.3Gcli-master-gerrit
7.4Gcli-master-nightly
16K collaborative.modeling-master-nightly
4.0Gcollaborative.modeling.luna-master-nightly
3.8Gcollaborative.modeling.mars-master-nightly
4.0Gcollaborative.modeling.neon-master-nightly
2.4Gegit.logical-master-nightly
604Kegit.test.tmpdir
0   emfcompare-master-multi
651Mjgit.hooks-master-nighly
568Kmaintenance-1.1
568Kmaintenance-1.2
568Kmaintenance-1.3
429Mmaintenance-2.1
2.3Gmaintenance-3.1
3.5Gmaintenance-gerrit
9.9Gmaintenance-nightly
13G master-build-on-egit-logical-nighlty
5.2Gmaster-gerrit
9.7Gmaster-nightly
2.2Gmaster-performance
2.0Gmaster-performance-git
1.9Gmaster-performance-large
2.6Gmaster-performance-large-git
32K master-q7-nightly
7.4Gmaster-quality
5.7Gmaster-rcptt-nightly
445Mpublish-integration
74M publish-nightly
21M sandbox
168Kshell_tests
3.1Gsirius.compare-master-nightly
52M test-releng
92G total

Disk usage in master-nightly:

hipp8:/jobs/genie.emfcompare/master-nightly # du -shc *
376Kbuilds
2.6Mconfig-history
16K config.xml
4.6Gconfigurations
0   lastStable
0   lastSuccessful
4.0KnextBuildNumber
4.0Kscm-polling.log
5.1Gworkspace
9.7Gtotal

So it's mostly the workspace and the build artifacts (not big by itself,
but there are quite a few builds kept with artifacts) in each configuration.

During the move, only EMFcompare's jobs dir was copied from one physical
machine to another and it used the same amount of disk space before the
move and after.

Regards,

Fred


On 08.02.2017 11:06, Laurent Goubet wrote:
> Hi Frederic,
> 
> I just went through all of our builds and three of them indeed didn't
> have the "discard old" option, for reasons unknown. Then again, what we
> have shouldn't take so much space at all. Is there any way to have more
> detailed information about what's taking so much space on emfcompare? Is
> it due to the move from hipp9 to hipp8?
> 
> Regards,
> 
> Laurent
> 
> 
> On 06/02/2017 19:26, Frederic Gurr wrote:
>> Hi,
>>
>> The following HIPP instances use a lot of disk space:
>>
>> * emfcompare 102 GB
>> * ice403 GB
>> * packaging  485 GB
>> * kitalpha   191 GB
>> * papyrus472 GB
>> * platform   206 GB
>>
>> Unfortunately I have to urge the corresponding projects to clean up
>> their HIPP instances and configure their jobs to use the "Discard Old
>> Builds" option.
>> There are two parameters that should be set to reasonable values:
>>
>> * Max # of builds to keep
>> * Max # of builds to keep with artifacts
>>
>> HIPP instances are not supposed to act as build artifact archive, so
>> keeping more than 5 or 10 builds with artifacts of a few hundred MBs or
>> even GBs is a bad practice.
>> If your console log is verbose, keeping a lot builds (even without
>> artifact) can also require a lot of disk space.
>>
>> A recommended default is to keep 10 builds, and (depending on the size
>> of artifacts) 5 builds with artifacts.
>>
>> Please note: when you change those settings, old builds will only be
>> deleted once the next build is running.
>>
>> Thanks for your cooperation.
>>
>> Regards,
>>
>> Fred
>> ___
>> cross-project-issues-dev mailing list
>> cross-project-issues-dev@eclipse.org
>> To change your delivery options, retrieve your password, or unsubscribe from 
>> this list, visit
>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
> 
> -- 
> 
> *Laurent Goubet*
> Consultant
> +33 2 51 13 51 42
> 
> 
> 
> 7 Boulevard Ampère - Carquefou - France
> *obeo.fr*  | *twitter*
>  | *linkedin*
> 
> 
> 
> 
> ___
> cross-project-issues-dev mailing list
> cross-project-issues-dev@eclipse.org
> To change your delivery options, retrieve your password, or unsubscribe from 
> this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
> 
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Bugzilla down? (Internal Server Error)

[Andreas Sewe]

Denis Roy wrote:
> Actually, it's 4:32 am:)

Still, thank you!

> A SELECT query against the downloads database created a deadlock tying
> up all our db connections.
> 
> I'm looking into why that happened.

There's nothing like a good puzzle to boot your brain early in the morning.

Anyhow, I'm off to report a few IDE crashes now. :-)

Andreas

-- 
Codetrails GmbH
The knowledge transfer company

Robert-Bosch-Str. 7, 64293 Darmstadt
Phone: +49-6151-276-7092
Mobile: +49-170-811-3791
http://www.codetrails.com/

Managing Director: Dr. Marcel Bruch
Handelsregister: Darmstadt HRB 91940



signature.asc
Description: OpenPGP digital signature
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Excessive disk usage of HIPPs

[Laurent Goubet]

Hi Frederic,

I just went through all of our builds and three of them indeed didn't 
have the "discard old" option, for reasons unknown. Then again, what we 
have shouldn't take so much space at all. Is there any way to have more 
detailed information about what's taking so much space on emfcompare? Is 
it due to the move from hipp9 to hipp8?


Regards,

Laurent


On 06/02/2017 19:26, Frederic Gurr wrote:

Hi,

The following HIPP instances use a lot of disk space:

* emfcompare102 GB
* ice   403 GB
* packaging 485 GB
* kitalpha  191 GB
* papyrus   472 GB
* platform  206 GB

Unfortunately I have to urge the corresponding projects to clean up
their HIPP instances and configure their jobs to use the "Discard Old
Builds" option.
There are two parameters that should be set to reasonable values:

* Max # of builds to keep
* Max # of builds to keep with artifacts

HIPP instances are not supposed to act as build artifact archive, so
keeping more than 5 or 10 builds with artifacts of a few hundred MBs or
even GBs is a bad practice.
If your console log is verbose, keeping a lot builds (even without
artifact) can also require a lot of disk space.

A recommended default is to keep 10 builds, and (depending on the size
of artifacts) 5 builds with artifacts.

Please note: when you change those settings, old builds will only be
deleted once the next build is running.

Thanks for your cooperation.

Regards,

Fred
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev


--

*Laurent Goubet*
Consultant
+33 2 51 13 51 42



7 Boulevard Ampère - Carquefou - France
*obeo.fr*  | *twitter* 
 | *linkedin* 



<>___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Bugzilla down? (Internal Server Error)

[Denis Roy]

Actually, it's 4:32 am:)


A SELECT query against the downloads database created a deadlock tying
up all our db connections.

I'm looking into why that happened.

Denis



On 08/02/17 04:25 AM, Mike Milinkovich wrote:
>
> Yup. 
>
> Thank you Denis for getting up at 2:00am to kick the server. 
>
> Mike Milinkovich
> mike.milinkov...@eclipse.org 
> +1.613.220.3223
>
> On Feb 8, 2017, at 10:21 AM, Remy Suen  > wrote:
>
>> It was down for me too but seems back up. Connecting fine from Japan.
>>
>> Regards,
>> Remy
>>
>> On Wed, Feb 8, 2017 at 6:09 PM, Andrey Loskutov > > wrote:
>>> Yes, I get error 500 too.
>>>
>>> Am 08.02.2017 um 10:04 schrieb Andreas Sewe:

 Hi,

 Bugzilla seems to be down for me; I get an Internal Server Error. Is
 anyone else seeing this problem?

 Best wishes,

 Andreas



 ___
 cross-project-issues-dev mailing list
 cross-project-issues-dev@eclipse.org
 
 To change your delivery options, retrieve your password, or unsubscribe
 from this list, visit
 https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

>>>
>>> --
>>> Kind regards,
>>> Andrey Loskutov
>>>
>>> http://google.com/+AndreyLoskutov
>>>
>>> ___
>>> cross-project-issues-dev mailing list
>>> cross-project-issues-dev@eclipse.org
>>> 
>>> To change your delivery options, retrieve your password, or
>>> unsubscribe from
>>> this list, visit
>>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Bugzilla down? (Internal Server Error)

[Mike Milinkovich]

Yup. 

Thank you Denis for getting up at 2:00am to kick the server. 

Mike Milinkovich
mike.milinkov...@eclipse.org
+1.613.220.3223

> On Feb 8, 2017, at 10:21 AM, Remy Suen  wrote:
> 
> It was down for me too but seems back up. Connecting fine from Japan.
> 
> Regards,
> Remy
> 
>> On Wed, Feb 8, 2017 at 6:09 PM, Andrey Loskutov  wrote:
>> Yes, I get error 500 too.
>> 
>>> Am 08.02.2017 um 10:04 schrieb Andreas Sewe:
>>> 
>>> Hi,
>>> 
>>> Bugzilla seems to be down for me; I get an Internal Server Error. Is
>>> anyone else seeing this problem?
>>> 
>>> Best wishes,
>>> 
>>> Andreas
>>> 
>>> 
>>> 
>>> ___
>>> cross-project-issues-dev mailing list
>>> cross-project-issues-dev@eclipse.org
>>> To change your delivery options, retrieve your password, or unsubscribe
>>> from this list, visit
>>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
>>> 
>> 
>> --
>> Kind regards,
>> Andrey Loskutov
>> 
>> http://google.com/+AndreyLoskutov
>> 
>> ___
>> cross-project-issues-dev mailing list
>> cross-project-issues-dev@eclipse.org
>> To change your delivery options, retrieve your password, or unsubscribe from
>> this list, visit
>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
> ___
> cross-project-issues-dev mailing list
> cross-project-issues-dev@eclipse.org
> To change your delivery options, retrieve your password, or unsubscribe from 
> this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Bugzilla down? (Internal Server Error)

[Remy Suen]

It was down for me too but seems back up. Connecting fine from Japan.

Regards,
Remy

On Wed, Feb 8, 2017 at 6:09 PM, Andrey Loskutov  wrote:
> Yes, I get error 500 too.
>
> Am 08.02.2017 um 10:04 schrieb Andreas Sewe:
>>
>> Hi,
>>
>> Bugzilla seems to be down for me; I get an Internal Server Error. Is
>> anyone else seeing this problem?
>>
>> Best wishes,
>>
>> Andreas
>>
>>
>>
>> ___
>> cross-project-issues-dev mailing list
>> cross-project-issues-dev@eclipse.org
>> To change your delivery options, retrieve your password, or unsubscribe
>> from this list, visit
>> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
>>
>
> --
> Kind regards,
> Andrey Loskutov
>
> http://google.com/+AndreyLoskutov
>
> ___
> cross-project-issues-dev mailing list
> cross-project-issues-dev@eclipse.org
> To change your delivery options, retrieve your password, or unsubscribe from
> this list, visit
> https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

Re: [cross-project-issues-dev] Bugzilla down? (Internal Server Error)

[Andrey Loskutov]

Yes, I get error 500 too.

Am 08.02.2017 um 10:04 schrieb Andreas Sewe:

Hi,

Bugzilla seems to be down for me; I get an Internal Server Error. Is
anyone else seeing this problem?

Best wishes,

Andreas



___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev



--
Kind regards,
Andrey Loskutov

http://google.com/+AndreyLoskutov
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev

[cross-project-issues-dev] Bugzilla down? (Internal Server Error)

[Andreas Sewe]

Hi,

Bugzilla seems to be down for me; I get an Internal Server Error. Is
anyone else seeing this problem?

Best wishes,

Andreas

-- 
Codetrails GmbH
The knowledge transfer company

Robert-Bosch-Str. 7, 64293 Darmstadt
Phone: +49-6151-276-7092
Mobile: +49-170-811-3791
http://www.codetrails.com/

Managing Director: Dr. Marcel Bruch
Handelsregister: Darmstadt HRB 91940



signature.asc
Description: OpenPGP digital signature
___
cross-project-issues-dev mailing list
cross-project-issues-dev@eclipse.org
To change your delivery options, retrieve your password, or unsubscribe from 
this list, visit
https://dev.eclipse.org/mailman/listinfo/cross-project-issues-dev