Re: [gridengine users] OT: IBM to acquire Platform Computing!
On Mon, 17 Oct 2011 at 14:45 -, William Bryce wrote: > > And finally, Platform Analytics does reporting properly! I > > attended a business analyst workshop a few years ago, and after > > knowing how companies are handling their data for analysis, I > > immediately realized that the ARCo way was not efficient. While > > both ARCo & Platform Analytics store job & cluster information to > > a database, the way data is archived & processed makes a huge > > difference in load of the database, and the type of queries that > > can be easily issued by the cluster administrator. > > Yup, exactly right. That is why we created UniSight. It is an ETL > engine and complete BI server based on Pentaho. So when you run your > report query on 5 million jobs it doesn't take the whole day. It only takes 7 seconds elapsed time for qacct to report on 2.7M records. A little bit of perl converts the data to a .csv file and I can let others play with the data for hours in excel. I don't understand the BI problem...and don't want to either. I think these are toys for those in the corner offices (but then I'm not in the corner office or making the big bucks). Stuart -- I've never been lost; I was once bewildered for three days, but never lost! -- Daniel Boone ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
Re: [gridengine users] OT: IBM to acquire Platform Computing!
Hi Rayson, Just to point out: > And finally, Platform Analytics does reporting properly! I attended a > business analyst workshop a few years ago, and after knowing how > companies are handling their data for analysis, I immediately realized > that the ARCo way was not efficient. While both ARCo & Platform > Analytics store job & cluster information to a database, the way data > is archived & processed makes a huge difference in load of the > database, and the type of queries that can be easily issued by the > cluster administrator. Yup, exactly right. That is why we created UniSight. It is an ETL engine and complete BI server based on Pentaho. So when you run your report query on 5 million jobs it doesn't take the whole day. Bill. On 2011-10-17, at 2:36 PM, Rayson Ho wrote: > 2011/10/11 Chi Chan : >> However, if you look at the growth rate of Platform before 2000, Platform >> grew at least 50% per year. Of course >> as companies are larger it is harder to grow, but another factor is that >> there are more Platform LSF competitors, >> like SGE, Torque/Maui, Condor, SLURM, etc, and they have similar >> functionalities but are much cheaper. > > > It has been like that for a few years - nowadays people just switch > from SGE to PBS, LSF to SGE, or to SLURM or Condor, etc... without > worrying much about the features (or lack thereof) in any batch > systems. > > A lot of the distinguishing features in LSF are not used by over 80% > of the users. But people who need those features are willing to pay > the expensive licensing cost! > > For example, Platform has integration for parallel environment for > (almost) each supercomputer platform. So for instance, if you don't > have SGI machines (which over 95% of the sites don't), then you won't > need the SGI MPT integration. > > Another example, GPU integration. A lot of sites don't have CUDA or > OpenCL applications. While Platform's GPU integration is still the > best among all of the solutions provided by major batch systems > (including the new one in Open Grid Scheduler), over 90% of the sites > don't need it. > > And finally, Platform Analytics does reporting properly! I attended a > business analyst workshop a few years ago, and after knowing how > companies are handling their data for analysis, I immediately realized > that the ARCo way was not efficient. While both ARCo & Platform > Analytics store job & cluster information to a database, the way data > is archived & processed makes a huge difference in load of the > database, and the type of queries that can be easily issued by the > cluster administrator. And I used to avoid mentioning this but as > Platform will be owned by IBM it does not matter now - luckily, the > work needed to fix ARCo is not extremely huge, in the end, Platform > Analytics uses a 3rd party front-end, so ARCo can be re-architected to > do very similar things relatively easily. > > Rayson > ___ > users mailing list > users@gridengine.org > https://gridengine.org/mailman/listinfo/users William Bryce | VP of Products Univa Corporation - 1001 Warrenville Road, Suite 100 Lisle, Il, 65032 USA Email bbr...@univa.com | Mobile: 512.751.8014 | Office: 416.519.2934 ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
Re: [gridengine users] OT: IBM to acquire Platform Computing!
2011/10/11 Chi Chan : > However, if you look at the growth rate of Platform before 2000, Platform > grew at least 50% per year. Of course > as companies are larger it is harder to grow, but another factor is that > there are more Platform LSF competitors, > like SGE, Torque/Maui, Condor, SLURM, etc, and they have similar > functionalities but are much cheaper. It has been like that for a few years - nowadays people just switch from SGE to PBS, LSF to SGE, or to SLURM or Condor, etc... without worrying much about the features (or lack thereof) in any batch systems. A lot of the distinguishing features in LSF are not used by over 80% of the users. But people who need those features are willing to pay the expensive licensing cost! For example, Platform has integration for parallel environment for (almost) each supercomputer platform. So for instance, if you don't have SGI machines (which over 95% of the sites don't), then you won't need the SGI MPT integration. Another example, GPU integration. A lot of sites don't have CUDA or OpenCL applications. While Platform's GPU integration is still the best among all of the solutions provided by major batch systems (including the new one in Open Grid Scheduler), over 90% of the sites don't need it. And finally, Platform Analytics does reporting properly! I attended a business analyst workshop a few years ago, and after knowing how companies are handling their data for analysis, I immediately realized that the ARCo way was not efficient. While both ARCo & Platform Analytics store job & cluster information to a database, the way data is archived & processed makes a huge difference in load of the database, and the type of queries that can be easily issued by the cluster administrator. And I used to avoid mentioning this but as Platform will be owned by IBM it does not matter now - luckily, the work needed to fix ARCo is not extremely huge, in the end, Platform Analytics uses a 3rd party front-end, so ARCo can be re-architected to do very similar things relatively easily. Rayson ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
Re: [gridengine users] OT: IBM to acquire Platform Computing!
On Thu, Oct 13, 2011 at 11:35 AM, Chris Smith wrote: > While I would love to see LSF open sourced, I don't have quite the > faith you have, Rayson. Hi Chris, Haven't worked with you for a long time... (10+ years?) > IBM also has a lot of software that they don't > open source (LL being one!). I agree. Tivoli, which I have experience with, is not open source. (And the list goes on: Websphere, DB2, AIX, JIT/compilers, z/OS, IBM i, etc) By open, I hope "IBM LSF" would at least release the documentation for download. More importantly, IBM sales have better integrity, and they don't commonly use sneaky FUD-based sales tactics. > I'm the one who mentioned openlava to > Chris, by the way. For the folks I deal with, it's got enough > functionality and horsepower to get the job done. And I'm motivated to > create some momentum around it so that it continues to improve. Yup, given your experience with LSF, I guess you and other LSF experts would find OpenLava easier to migrate to. Rayson > > -- Chris > ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
Re: [gridengine users] OT: IBM to acquire Platform Computing!
On Tue, Oct 11, 2011 at 11:19, Rayson Ho wrote:
> On Tue, Oct 11, 2011 at 2:08 PM, Chris Dagdigian wrote:
>> On a related note I was talking to a former Platform person who I'm sure
>> many of us know on this list and he mentioned that the stripped down older
>> variant of Platform LSF that platform produced back in the day ("lava") has
>> a new open source home and developer group:
>>
>> http://openlava.net/
>
> Hmm, OpenLava is not backed by Platform Computing... and according to
> the domain record, seems like the project is started by a Bright
> Computing employee.
>
> BTW, given IBM's open source track record, I believe Platform LSF will
> be a bit more open when IBM finally takes control.
>
While I would love to see LSF open sourced, I don't have quite the
faith you have, Rayson. IBM also has a lot of software that they don't
open source (LL being one!). I'm the one who mentioned openlava to
Chris, by the way. For the folks I deal with, it's got enough
functionality and horsepower to get the job done. And I'm motivated to
create some momentum around it so that it continues to improve.
-- Chris
___
users mailing list
users@gridengine.org
https://gridengine.org/mailman/listinfo/users
Re: [gridengine users] OT: IBM to acquire Platform Computing!
On Tue, Oct 11, 2011 at 2:08 PM, Chris Dagdigian wrote:
> On a related note I was talking to a former Platform person who I'm sure
> many of us know on this list and he mentioned that the stripped down older
> variant of Platform LSF that platform produced back in the day ("lava") has
> a new open source home and developer group:
>
> http://openlava.net/
Hmm, OpenLava is not backed by Platform Computing... and according to
the domain record, seems like the project is started by a Bright
Computing employee.
BTW, given IBM's open source track record, I believe Platform LSF will
be a bit more open when IBM finally takes control.
Rayson
>
> -Chris
>
>
>
> Rayson Ho wrote:
>>
>>
>> http://www.platform.com/press-releases/2011/IBMtoAcquireSystemSoftwareCompanyPlatformComputingtoExtendReachofTechnicalComputing
>>
>> Not sure what's going to happen to Loadleveler...
>
___
users mailing list
users@gridengine.org
https://gridengine.org/mailman/listinfo/users
Re: [gridengine users] OT: IBM to acquire Platform Computing!
On a related note I was talking to a former Platform person who I'm sure
many of us know on this list and he mentioned that the stripped down
older variant of Platform LSF that platform produced back in the day
("lava") has a new open source home and developer group:
http://openlava.net/
-Chris
Rayson Ho wrote:
http://www.platform.com/press-releases/2011/IBMtoAcquireSystemSoftwareCompanyPlatformComputingtoExtendReachofTechnicalComputing
Not sure what's going to happen to Loadleveler...
___
users mailing list
users@gridengine.org
https://gridengine.org/mailman/listinfo/users
[gridengine users] OT: IBM to acquire Platform Computing!
http://www.platform.com/press-releases/2011/IBMtoAcquireSystemSoftwareCompanyPlatformComputingtoExtendReachofTechnicalComputing Not sure what's going to happen to Loadleveler... Rayson ___ users mailing list users@gridengine.org https://gridengine.org/mailman/listinfo/users
