Add entry for Jenkins and testing

Approved by:	hrs (mentor, blanket)
This commit is contained in:
Benjamin Kaduk 2015-01-08 19:16:28 +00:00
parent 33309ad8b1
commit 94fc9c798b
Notes: svn2git 2020-12-08 03:00:23 +00:00
svn path=/head/; revision=46169

View file

@ -790,4 +790,143 @@
</help>
</project>
<project cat='proj'>
<title>Jenkins Continuous Integration for &os;</title>
<contact>
<person>
<name>
<given>Craig</given>
<common>Rodrigues</common>
</name>
<email>rodrigc@FreeBSD.org</email>
</person>
<person>
<name>Jenkins Administrators</name>
<email>jenkins-admin@FreeBSD.org</email>
</person>
<person>
<name>&os; Testing</name>
<email>freebsd-testing@FreeBSD.org</email>
</person>
</contact>
<links>
<url href="https://jenkins.freebsd.org">Jenkins CI server in &os; cluster</url>
<url href="http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing">FreeBSD and Jenkins OS Testing</url>
<url href="https://wiki.freebsd.org/201411DevAndVendorSummit?action=AttachFile&amp;do=view&amp;target=kyua_jenkins.pdf">Kyua and Jenkins Testing Framework for BSD </url>
<url href="https://issues.jenkins-ci.org/browse/JENKINS-21507">PAM authentication problems in FreeBSD</url>
<url href="https://issues.jenkins-ci.org/browse/JENKINS-24521">Issue to update Jenkins to JNA 4.1.0 for FreeBSD</url>
<url href="https://github.com/rodrigc/kyua/wiki/Quickstart-Guide">Kyua Quickstart Guide</url>
<url href="http://www.freshports.org/textproc/igor/">Igor tool for proofreading documentation</url>
<url href="https://jenkins.freebsd.org/job/FreeBSD_Doc-igor">FreeBSD_Doc-igor Jenkins build</url>
<url href="https://jenkins.freebsd.org/job/FreeBSD_HEAD_sparc64/">FreeBSD_HEAD_sparc64 Jenkins build</url>
<url href="https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000609.html">Susan Stanziano from Xinuous ran kyua tests</url>
<url href="https://lists.freebsd.org/pipermail/freebsd-testing/2014-December/000697.html">Andy Zhang from Microsoft ran kyua tests</url>
<url href="https://lists.freebsd.org/pipermail/svn-src-all/2014-October/092212.html">&a.ngie; imported NetBSD tests</url>
<url href="http://lists.freebsd.org/pipermail/freebsd-testing/2015-January/000713.html">Steve Wills ran tests in Google Compute Engine</url>
<url href="https://github.com/Homebrew/homebrew/pull/32346">Kyua submitted to Homebrew project</url>
<url href="https://github.com/freebsd/freebsd-ci/pull/3">Brian Gardner submits jtreg tests</url>
<url href="https://lists.freebsd.org/pipermail/freebsd-testing/2015-January/000723.html">Ahmed Kamal offers to help with Saltstack</url>
<url href="https://lists.freebsd.org/pipermail/freebsd-testing/2015-January/000722.html">MIPS builds</url>
</links>
<body>
<p>Since the last status report, many people have contributed
help in various areas to help with with Continuous Integration
and Testing in FreeBSD. Some of the highlights include:</p>
<ul>
<li>The Jenkins project mentioned on their blog how FreeBSD is using
Jenkins and kyua to run OS-level tests.</li>
<li>&a.rodrigc; submitted patches to upgrade Jenkins to use JNA 4.1.0.
The Jenkins project accepted these patches [JENKINS-24521] in
the Jenkins 1.586 release. This fixed problems with PAM
authentication support in Jenkins on FreeBSD [JENKINS-21507].</li>
<li>&a.rodrigc; gave a presentation Kyua and Jenkins Testing
Framework for BSD at the Developer and Vendor summit on
November 3, 2014 in San Jose, California. In the presentation,
&a.rodrigc;'s described how for every commit to the FreeBSD source
tree, nearly 3000 tests are run using kyua inside a bhyve virtual
machine. The kyua test results are exported to JUnit XML format,
which is then used by Jenkins to generate web-based test reports with
graphs.</li>
<li>&a.lwhsu; set up a Jenkins build named FreeBSD_Doc-igor
to run the Igor tool written by &a.wblock;. Igor proofreads
FreeBSD documentation and reports various errors.</li>
<li>&a.rodrigc; set up a Jenkins build named
FreeBSD_HEAD_sparc64 to build the FreeBSD HEAD branch for
the sparc64 architecture</li>
<li>&a.ngie; imported more tests from NetBSD. After this import,
there are now over 3000 tests in the /usr/tests
directory.</li>
<li>Susan Stanziano from Xinuous ran kyua tests and provided
feedback about test errors, running the tests in a bhyve
VM.</li>
<li>Andy Zhang from Microsoft ran kyua tests and provided
feedback about test errors running in a Hyper-V 2012R2
VM.</li>
<li>&a.swills; ran the &os; tests in Google Compute Engine and provided
the test results.</li>
<li>&a.rodrigc; submitted a formula to create a package for
kyua in the Homebrew packaging system on OS X. The Homebrew project
accepted this. Now, kyua can easily be installed on OS X via a
Homebrew package. Hopefully &os; this will make it easier to share
more test infrastructure and scripts with OS X.</li>
<li>&a.rodrigc; submitted to the Debian project a kyua
package. Approval for this is still pending. A package
will make it much easier to install kyua on Linux distributions which
use Debian packages such as Debian, Ubuntu and Linux Mint. Hopefully
&os; this will make it easier to share more test infrastructure and
scripts with Linux.</li>
<li>Brian Gardner submitted scripts to run the Regression Test
Harness for OpenJDK (jtreg). The test results are in JUnit XML
format, which can be natively imported into Jenkins.</li>
<li>Ahmed Kamal, an experienced devops expert, and past
contributor to the Ubuntu project, offered to help
&a.rodrigc; with improving the automation and deployment of
Jenkins nodes in the &os; cluster using the Saltstack automation
framework. Ahmed is interested in helping the &os; project.</li>
<li>&a.rodrigc; worked with &a.adrian; to set up Jenkins
builds of MIPS targets. The next step will be to get kyua
tests running inside a QEMU MIPS VM.</li>
</ul>
</body>
<help>
<task>
<p>Set up more builds based on different architectures.</p>
</task>
<task>
<p>Improve the maintenance of nodes in the Jenkins cluster
using devops frameworks such as Saltstack.</p>
</task>
<task>
<p>Get feedback for improving the Kyua Quickstart Guide.</p>
</task>
<task>
<p>People interested in helping out should join the
freebsd-testing@FreeBSD.org list.</p>
</task>
</help>
</project>
</report>