Re: Jenkins with a DB?
I have some solutions to this depending on what you are trying to do and would be happy to help. Feel free to send me an email with "Jenkins Question" in the subject and I we can chat. barbine.mich...@gmail.com On Friday, June 28, 2013 at 4:14:46 PM UTC-4, Michael Barbine wrote: > > Hello! > > I'm looking for some input on a proven way to put all of the data > contained in the Jenkins XML or API into a RDBMS. Doesn't matter which > one... I can move it around later. > > I found some plugins on the Jenkins site - any input on which is the best? > > I have some ideas on developing my own way by using the MSSXML schema and > dropping the config.xml, build.xml and job.xml into a repo for consumption. > Early tests have been successful, but it's not as clean or secure as I'd > like. > > > THANK YOU IN ADVANCE for your input > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/5c707d79-8cf6-45bb-b28c-d8bf91216325%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Jenkins - database backend or separate database for reporting (Sonar?)
It works really well for our ops. I'm hoping someone will take this and make it work on something else and repost though. I needed some of the built in functionality in sql though. Sent from my Samsung Galaxy S®4 Original message From: "Indra Gunawan (ingunawa)" Date:12/17/2013 1:37 AM (GMT-05:00) To: jenkinsci-users@googlegroups.com Subject: Re: Jenkins - database backend or separate database for reporting (Sonar?) SQLServer, a database for Window only, is something you want to use with Jenkins? Yikes!!! From: Michael Barbine Reply-To: "jenkinsci-users@googlegroups.com" Date: Monday, December 16, 2013 8:37 AM To: "jenkinsci-users@googlegroups.com" Subject: Re: Jenkins - database backend or separate database for reporting (Sonar?) https://github.com/mbarbine/JenkinsDB On Monday, November 14, 2011 4:56:50 PM UTC-5, gboissinot wrote: Which metrics tools do you use? Sonar provides some plugins to support Java, C/C++, C# and so on. These plugins run the metric tool (run step) and record metrics results in Sonar database (collect step). These informaion can then be displayed in the Sonar Web dashboard. However, I strongly suggest running the metrics tools from Jenkins (run step). The Jenkins role is to set up an environment and to instanciate the integration process. Therefore, metrics tools are executed from Jenkins (or from a process such as your build tool, managed by Jenkins). Then these metrics results can be processed and convert them in a generic format. These output can then be sent to a datastore or to Sonar if you want to use Sonar as a generic metrics platform. In the last case, Sonar is only aimed at collecting metrics results and at displaying them. In my opinion, that's the right approach. Please look at the DTKit ecosystem https://wiki.jenkins-ci.org/display/JENKINS/DTKit https://wiki.jenkins-ci.org/display/JENKINS/DTKit+Plugin On Mon, Nov 14, 2011 at 5:52 PM, Keith B. Perry wrote: Hi all, I am currently manually generating some reports for management, and I would like to automate these. The reports themselves just show the exact numbers of each project at the end of each month. It would be great if each time a build was fired off, it would write a record to the database and update it with statistics (cyclomatic complexity, static analysis, compiler warnings, code coverage, etc...). Sonar looks promising, but we have a very diverse environment (Java, C++, C, C#, python) that I am not sure it would be able to handle. Does anyone have any experience out there with Sonar and C++ tools? Any good ideas how to have Jenkins automatically throw records in a database? -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to a topic in the Google Groups "Jenkins Users" group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-users/AXUdweW8jRQ/unsubscribe. To unsubscribe from this group and all its topics, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out. -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Jenkins - database backend or separate database for reporting (Sonar?)
https://github.com/mbarbine/JenkinsDB On Monday, November 14, 2011 4:56:50 PM UTC-5, gboissinot wrote: > > Which metrics tools do you use? > > Sonar provides some plugins to support Java, C/C++, C# and so on. These > plugins run the metric tool (run step) and record metrics results in Sonar > database (collect step). These informaion can then be displayed in the > Sonar Web dashboard. > > However, I strongly suggest running the metrics tools from Jenkins (run > step). The Jenkins role is to set up an environment and to instanciate the > integration process. > Therefore, metrics tools are executed from Jenkins (or from a process such > as your build tool, managed by Jenkins). > Then these metrics results can be processed and convert them in a generic > format. > > These output can then be sent to a datastore or to Sonar if you want to > use Sonar as a generic metrics platform. In the last case, Sonar is only > aimed at collecting metrics results and at displaying them. In my opinion, > that's the right approach. > > Please look at the DTKit ecosystem > https://wiki.jenkins-ci.org/display/JENKINS/DTKit > https://wiki.jenkins-ci.org/display/JENKINS/DTKit+Plugin > > On Mon, Nov 14, 2011 at 5:52 PM, Keith B. Perry > > > wrote: > >> Hi all, >> I am currently manually generating some reports for management, and I >> would like to automate these. The reports themselves just show the exact >> numbers of each project at the end of each month. It would be great if >> each time a build was fired off, it would write a record to the database >> and update it with statistics (cyclomatic complexity, static analysis, >> compiler warnings, code coverage, etc...). Sonar looks promising, but we >> have a very diverse environment (Java, C++, C, C#, python) that I am not >> sure it would be able to handle. >> >> Does anyone have any experience out there with Sonar and C++ tools? >> >> Any good ideas how to have Jenkins automatically throw records in a >> database? >> > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Jenkins Database Envy - is it just me?
https://github.com/mbarbine/JenkinsDB On Friday, October 12, 2012 11:39:41 AM UTC-4, Mandeville, Rob wrote: > > I’ve been using Jenkins for a couple of years (starting back before the > Hudson/Jenkins fork) and it has saved my career on several occasions. > However, I’m getting some database envy. I want to be able to read from > and write to the database of builds and build results without HTTPing > through the server. I’d also like to not have everything in core all the > time (the lazy-loading feature in 1.485 was, IMHO, a case of DB envy). > What I’d love to see is to have the file-based persistence layer connecting > to a JDBC data source, probably shipping with embedded HSQLDB or something > by default. > > > > But my question is: is it just me? > > > > I’m using Jenkins in a fairly heavy-duty way (and investigating if we > should upgrade to CloudBees Enterprise Edition), and effectively have a > separate database, build parser, and build results web site so that we can > see results going back several years and query it in multiple ways. I > don’t think that I’m your typical Jenkins user. In fact, I can see reasons > not to use a DB persistence layer: the files that the Jenkins server keeps > for its configuration and logs are pretty human-readable, and having a DB > persistence layer would require a DB connection to look at. I also realize > that, even if we did want to go to a DB layer, this would be an expensive > process that would take resources away from adding more features to Jenkins. > > > > So how many people would like to see a DB layer, how many wouldn’t, and > how many don’t care how it keeps its data under the hood? > > > > --Rob Mandeville > > Litle & Co. > > > The information in this message is for the intended recipient(s) only > and may be the proprietary and/or confidential property of Litle & Co., > LLC, and thus protected from disclosure. If you are not the intended > recipient(s), or an employee or agent responsible for delivering this > message to the intended recipient, you are hereby notified that any use, > dissemination, distribution or copying of this communication is prohibited. > If you have received this communication in error, please notify Litle & Co. > immediately by replying to this message and then promptly deleting it and > your reply permanently from your computer. > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Store build meta data in a db
SOLUTION: https://github.com/mbarbine/JenkinsDB On Tuesday, April 9, 2013 6:32:03 PM UTC-4, Ipoo Doh wrote: > > Problem: > I want to store build metadata in a db, things like Job and its build > history details like The build number, time it started, time it ended, > whether it succeeded, where the artiifacts are stored, wheather it has been > promoted, its svn tag details, etc... Other tools like our automated > testing framework will feed off these data in the DB and run their tests > and update their corresponding table (which will be linked to the build > history table by foreign key) with the results. Please let me know how i > can achieve this in Jenkins. > > Thanks > Ipoo Doh > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Real-time log parsing?
https://github.com/mbarbine/JenkinsDB On Friday, October 12, 2012 11:25:18 AM UTC-4, Mandeville, Rob wrote: > > I’m running multi-hour test cycles and my users have a demand for > real-time results. If test #50 failed 45 minutes in, they want to be able > to see it without waiting five hours for the rest of the tests to run. > We’ve had this problem for longer than we’ve had Jenkins, so our solution > is to have a log parser separate from Jenkins “tail” the build log, reading > it as it’s being written and writing test results to a database powering a > non-Jenkins web site. Said process is also reading other auxiliary files > (far too many to turn into Jenkins artifacts), so it has to run on the host > the slave node and the build are running on, not the machine hosting the > Jenkins server. > > > > The problem with this is that we have to make sure that everything gets > appended to a log file on disk (so the parser can “tail” it) and to > standard output (so that we can see it). Accidentally opening the log file > for “write” rather than “append” truncates the log and the parser gets lost. > > Is there a way for a process on the slave node machine to “tail” the build > log that Jenkins is getting? Can Jenkins’ output log be replicated in real > time in the workspace? Can a groovy JAR be run asynchronously inside the > slave as it’s building, and watch the bytes go by? Any other ideas? > > > > --Rob > > > The information in this message is for the intended recipient(s) only > and may be the proprietary and/or confidential property of Litle & Co., > LLC, and thus protected from disclosure. If you are not the intended > recipient(s), or an employee or agent responsible for delivering this > message to the intended recipient, you are hereby notified that any use, > dissemination, distribution or copying of this communication is prohibited. > If you have received this communication in error, please notify Litle & Co. > immediately by replying to this message and then promptly deleting it and > your reply permanently from your computer. > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Suggestions for CI with Jenkins & Database
https://github.com/mbarbine/JenkinsDB On Sunday, November 20, 2011 3:46:13 AM UTC-5, julio wrote: > > Hi all, > > we are starting our development project for the first time with > Jenkins, and we planned to manage the Database-CI in this way: > > 1) every single developer has own database schema+data local as it is > in the dev-database > 2) if a developer change locally DDL/DML (in .sql files) and commit > (we are using GIT), automatically these changes are applied to the Dev- > Database > > Is there a way saying Jenkins applying these changes to the db when > one or more .sql files are changed? or it should be done via GIT (for > example in the post-receive hook)? > > or there is a better strategy to handle the DB changes? > > Thanks > > Julio > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Jenkins Database
Hello, I wrote a series of scripts and database stored procedures that crawl the XML API and dynamically toss the data into various tables. It is not dependent on the configuration of Jenkins and works very well. Anyone have a use for this? The implementation is very straight forward and I'd be willing to post the scripts and a guide to my Github account. We are using this heavily for automation in our DevOps environment. I have also built a nice UI and custom API that uses this database as a proper CM repository with an API that we use for automatic deployment of historical builds. I won't be able to share all of that development though. Thanks! -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Unique Identifier for Jenkins Projects
Hello, Does any one know of a place or a field in Jenkins that is static and unique for each project in the projects list in Jenkins? Is there a plugin out there that would give me a unique identifier for the project? The project name itself is not unique due to the fact that if you rename the job all of the data about the job is renamed without and effictively leaves no trace of the old project name (that I know of). When that happens my database plugin (that I am almost finished developing) starts over as if it is a new job. I'd like to continue trending the info with the new name. For example - I have a table full of the API/XML for ProjectX When I rename ProjectX to ProjectY Jenkins see's that ProjectX no longer exists and renames the entire job. If I am keeping a history of all of the API/XML and a job is renamed then I lost track of the history. What I would need is something like - Project# 1234 ProjectName *ProjectX* Build# 45 Then when it is renamecd Project# 1234 ProjectName* ProjectY* Build# 45 I'm currently scraping the data off of of this URL to grab project information http:///view/All/cc.xml -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Jenkins with a DB?
On Friday, June 28, 2013 4:14:46 PM UTC-4, Michael Barbine wrote: > > Hello! > > I'm looking for some input on a proven way to put all of the data > contained in the Jenkins XML or API into a RDBMS. Doesn't matter which > one... I can move it around later. > > I found some plugins on the Jenkins site - any input on which is the best? > > I have some ideas on developing my own way by using the MSSXML schema and > dropping the config.xml, build.xml and job.xml into a repo for consumption. > Early tests have been successful, but it's not as clean or secure as I'd > like. > > > THANK YOU IN ADVANCE for your input > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Jenkins with a DB?
Hello! I'm looking for some input on a proven way to put all of the data contained in the Jenkins XML or API into a RDBMS. Doesn't matter which one... I can move it around later. I found some plugins on the Jenkins site - any input on which is the best? I have some ideas on developing my own way by using the MSSXML schema and dropping the config.xml, build.xml and job.xml into a repo for consumption. Early tests have been successful, but it's not as clean or secure as I'd like. THANK YOU IN ADVANCE for your input -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
