From af1814b505a65df0aba120d3adbb7cc808b66b62 Mon Sep 17 00:00:00 2001 From: Daniel Gerzo Date: Fri, 22 Oct 2010 10:03:42 +0000 Subject: [PATCH] - add the status report for 3Q/2010 to easily allow people to review it - I was promised to receive one more report from re@, and rwatson@ might send some as well. However this report is quite, we should start with the review already. --- en/news/status/report-2010-07-2010-09.xml | 2245 +++++++++++++++++++++ 1 file changed, 2245 insertions(+) create mode 100644 en/news/status/report-2010-07-2010-09.xml diff --git a/en/news/status/report-2010-07-2010-09.xml b/en/news/status/report-2010-07-2010-09.xml new file mode 100644 index 0000000000..6f5bb626cb --- /dev/null +++ b/en/news/status/report-2010-07-2010-09.xml @@ -0,0 +1,2245 @@ + + + + + + + July-September + + 2010 + + +
+ Introduction + +

SUMMARY GOES HERE

+ +

Thanks to all the reporters for the excellent work! We hope you + enjoy reading.

+
+ + + soc + + Google Summer of Code + + + + proj + + Projects + + + + team + + &os; Team Reports + + + + net + + Network Infrastructure + + + + kern + + Kernel + + + + docs + + Documentation + + + + bin + + Userland Programs + + + + arch + + Architectures + + + + ports + + Ports + + + + misc + + Miscellaneous + + + + Atheros AR913x SoC support + + + + + Adrian + Chadd + + adrian@FreeBSD.org + + + + + (The + Atheros hackery will eventually live here) + + + Atheros wireless device work + + + +

&os;-CURRENT runs on the AR9132 SoC. Minor platform-specific + tweaks are needed to use it on a given piece of hardware (eg + where in flash the ethernet MAC address is stored.) The AR910x + wireless MAC/PHY is supported. The only available test platform + uses a 2.4ghz radio; 5ghz 11a mode has not been tested. As with + other atheros chipset support in &os;, 11n support is not yet + finished. The current development platform is the TP-Link + TP-WN1043ND 802.11n wireless bridge/router. It is currently being + successfully used as a 11bg access point.

+ + + + USB support is currently not functional. + + There is currently no support for the realtek gigabit + switch/PHY chip. This is being worked on. + + + + + pkg_patch + + + + + Ivan + Voras + + ivoras@FreeBSD.org + + + + + + + + +

pkg_patch is an tool meant to be used with the rest of the + pkg_* utilities whose job is to create and apply binary patches + to &os; package archives. The SoC project was successfully + completed but there are some open issues about the integration of + the tool in the &os; system. Some changes are necessary to the + port/patch infrastructure to support the "update" mode instead of + "remove+add".

+ + + + Solve pending issues about the ports install/upgrade + workflow, probably within the pkg_install2 + effort. + + + + + Extfs Status Report + + + + + Zheng + Liu + + gnehzuil@gmail.com + + + + + project + wiki + + + pre-allocation + + + ext4 read-only mode + + + +

This project has two goals: pre-allocation algorithm for + ext2fs and ext4 read-only mode. The aim of pre-allocation + algorithm is to implement a reservation window mechanism. Now + this mechanism has been implemented and I have submitted a patch + file to mailing list (fs@FreeBSD.org). The aim of ext4 read-only + mode is to make it possible to read ext4 file system in read-only + mode when disk is formatted with default features. Until now it + can read data from ext4 filesystem with default features in + read-only mode. I have submitted a patch to mailing list + (fs@FreeBSD.org). I am building a new kernel module for it, which + calls ext4fs.

+ + + + More testing of pre-allocation algorithm. + + + + + BSD# Project + + + + + Romain + Tartière + + romain@FreeBSD.org + + + + + The BSD# project + on Google-code + + Mono (Open source .Net + Development Framework) + + + +

The BSD# Project is devoted to porting the Mono .NET framework + and applications to the &os; operating system.

+ +

Mono 2.8 has been released a few days ago and is already + available in the BSD# repository. The updates breaks a few ports + so the lang/mono updated in the &os; ports tree will be delayed + until those programs are fixed for a smoother update + experience.

+ +

Work is in progress to include some long-awaited ports such as + deskuils/gnome-do but they require a lot of testing and hacking + because they have clearly been designed to run on GNU/Linux and + portability has never been a priority (which is quite amusing if + you consider portability is the main reason to be for mono).

+ + + + If you have some time, test mono ports and send + feedback. + + If you have more time, join the BSD# Team! There are many + ways to help out! + + Currently low priority, some mono hackers who do not use + &os; would be interested in a debug live-image of &os; to help us + diagnose and fix bugs more efficiency. + + + + + Clang Replacing GCC in the Base System + + + + + Ed + Schouten + + ed@FreeBSD.org + + + + + Roman + Divacky + + rdivacky@FreeBSD.org + + + + + Brooks + Davis + + brooks@FreeBSD.org + + + + + Pawel + Worach + + pawel.worach@gmail.com + + + + + Dimitry + Andric + + dim@FreeBSD.org + + + + + + + + +

We recently imported the 2.8 release of Clang into head. This + release contains many new features and improvements. The + integrated assembler is in this version too, but it is not ready + for general use yet.

+ +

Since r212979, all necessary changes have been committed to be + able to build world with Clang, at least on amd64 and i386. It + can also be installed and run, and we are now starting the + process of shaking out the inevitable bugs.

+ +

Because LLVM and Clang are still being improved continuously, + we want to import new versions regularly, approximately every two + months, to gain access to new features, bug fixes and performance + improvements.

+ +

There is also an effort on behalf of the ports people, to make + as many ports as possible compile and run properly with Clang. + Most of the time, this means fixing the incorrect assumption that + gcc is the only existing compiler, but sometimes more complicated + issues pop up. Help in this area is greatly appreciated.

+ + + + Importing new Clang snapshots fairly regularly + (approximately bi-monthly). + + Seeing if Clang can be used to build world for ARM + (volunteers and ARM experts wanted). + + Fixing as many ports as possible to build with Clang. + + Running periodical ports exp builds with Clang (on amd64 + and i386), for example once a month. + + + + + Updating base tools to accommodate ports + requirements + + + + + Gordon + Tetlow + + gordon@FreeBSD.org + + + + +

The goal of the project is to allow easier extension of base + system tools by the ports system. Ideally, no files in /etc + should need to be modified by a port installation.

+ +

The man toolset was recently reimplemented as a BSDL version + instead of the old GPL version. It is also a single shell script + instead of multiple C programs. Ports can extend the man + functionality by dropping files into + /usr/local/etc/man.d/portname.conf.

+ +

Next up on the list is to finish the implementation for + newsyslog thereby allowing ports that need logs rotated to take + advantage of that tool

+ + + + + &os;/mips on Octeon + + + + + Juli + Mallett + + jmallett@FreeBSD.org + + + + + + + + +

All Octeon development is now ongoing in 9.0-CURRENT and most + Octeon-specific and general MIPS changes from the old Octeon + branch have been checked in. The Simple Executive from the Cavium + Octeon SDK has been checked into Subversion and most of the + Octeon port has been updated to use it where appropriate, + including moving to a port of the Linux Ethernet driver, octe. + SMP support is stable on 2-core systems and has seen some testing + on systems with up to 16 cores.

+ + + + Some PCI devices still do not seem to work + completely. + + Host-mode USB support is incomplete and needs further + testing and debugging. + + Work on an ATA-based Compact Flash driver for boards that + support DMA has begun. + + A GPIO driver should be trivial using the Simple + Executive. + + Performance in the Linux-derived octe Ethernet driver could + be improved. Support for some switch chipsets that are commonly + present in Octeon-based equipment is in progress. + + + + + Kernel event timers infrastructure + + + + + Alexander + Motin + + mav@FreeBSD.org + + + + + + Slides from DevSummit in Karlsruhe. + + + Proof of concept (dirty) patch, removing some timer events. + + + +

Work on new event timers infrastructure continues. In HEAD + amd64, arm (Marvell), i386, mips, pc98, powerpc, sparc64, sun4v + architectures were refactored to use new timers API.

+ +

New machine-independent timers management code written. It + can utilize both legacy periodic and new one-shot timer + operation modes.

+ +

Using one-shot mode allows significantly reduce number of + timer interrupts and respectively increase CPU sleep time + during idle periods. Timer interrupts on idle CPUs now + generated only when they are needed to handle registered + time-based events. Busy CPUs unluckily still receiving full + interrupt rate for purposes of resource accounting, scheduling + and timekeeping.

+ +

With some additional tuning it is now possible to have + 8-core system, receiving only about 100 interrupt per second + and respectively have CPUs idle periods up to 100ms. This + allows to effectively use any supported CPU idle states + (C-states), that reduces power consumption and increases effect + of the Intel TurboBoost technology.

+ +

New manual pages written to document this functionality: + eventtimers(7), attimer(4), atrtc(4), hpet(4).

+ + + + Troubleshoot possible hardware issues. + + Refactor remaining architectures (arm, ia64, XEN + PV). + + Do some optimizations in different subsystems to reduce + number of time-based events. Extend callout API with terms of + precision, allowing to group close events. + + Make schedulers tickless, or at least less depending on + time events to make possible skip timer interrupts when CPUs are + busy. + + Merge code into 8-STABLE when it will be considered + ready. + + + + + Ports distfile and WWW checker + + + + + Emanuel + Haupt + + ehaupt@FreeBSD.org + + + + + + + + +

Given the current status of fenner@'s Distfiles Survey, a new + distfile checker was written in order to have an overview for the + state of each distfile in the ports tree. The distfile checker is + also able to verify WWW entries in pkg-descr files. This is an + attempt to weed out broken MASTER_SITES and outdated WWW + entries.

+ +

The current version uses a MySQL database backend and is able + to verify 432512 distfiles (30 concurrent threads) within 24 + hours.

+ + + + provide JavaScript to sort/filter/search tables. + + + + + Userland DTrace + + + + + Rui + Paulo + + rpaulo@FreeBSD.org + + + + + + + + +

Userland DTrace support was a &os; Foundation sponsored + project that was developed during this summer. The project aimed + to bring the userland DTracing functionality to &os; as it is + available on OpenSolaris. &os; now supports the pid provider and + the usdt probes. plockstat is available with a separate patch. + Dtruss, a DTrace script that works similarly to ktrace, but with + other advantages was imported into &os;. The mysql-server and + postgresql-server ports also have DTrace support.

+ + + + + &os; on the Playstation 3 + + + + + Nathan + Whitehorn + + nwhitehorn@FreeBSD.org + + + + + Peter + Grehan + + grehan@FreeBSD.org + + + + + PS3 + SVN Repository + + Pre-built + PS3 kernel + + + +

&os;/powerpc64 now boots multi-user SMP and is self-hosting on + the Playstation 3. Booting requires a PS3 console with the + OtherOS capability (fat model console with firmware < 3.21). + The only supported hardware at present is the ethernet + controller.

+ + + + USB and SATA support. + + Boot loader enhancements to allow user input at the loader + prompt. + + Support for the Cell SPU units. + + + + + Bringing up ARM to &os; Tree + + + + + Warner + Losh + + imp@bsdimp.com + + + + + Mohammed + Farrag + + mfarrag@FreeBSD.org + + + + +

We are still in the beginning of the project since we started + it after the summer of code.

+ + + + Reading ARM structure. + Reading MicroC OS. + Using Qemu to emulate the work. + + + + + Ports Collection + + + + + Thomas + Abthorpe + + portmgr-secretary@FreeBSD.org + + + + + Port + Management Team + + portmgr@FreeBSD.org + + + + + + + + + + + + + + + + + + + + + + +

The ports tree count now exceeds 22,000. With the assistance + of many people, especially Philip Gollucci, the open PR count is + below 1000 for the first time in quite a while. This is very + encouraging progress.

+ +

Since the last report, we added five new committers, and took + in two commit bits for safe keeping.

+ +

With onsite assistance from jhb@, gnn@, skreuzer@, and + pgollucci@, we now have 11 new servers at NYI. The machines still + need testing for stability and will soon be assigned for package + building.

+ +

The Ports Management team have been running -exp runs on an + ongoing basis, verifying how base system updates may affect the + ports tree, as well as providing QA runs for major ports updates. + Of note, -exp runs were done for:

+ +
    +
  • des: test libfetch
    • +
  • gabor: tests for BSD iconv and grep
    • +
  • mezz: switch www/neon28 to www/neon29
    • +
  • beat: update www/libxul
    • +
  • johans: update devel/bison and devel/m4
    • +
  • dinoex: update graphics/tiff
    • +
  • jpaetzel: update devel/popt
    • +
  • ade: multiple runs autotools upgrade
    • +
  • gerald: setting USE_GCC=4.5 as default
    • +
  • ashish: changes to Mk/bsd.license.mk
    • +
  • kwm: test of clang in head
    • +
+ + + + Looking for help fixing ports + broken on CURRENT. + + Looking for help with + Tier-2 architectures. + + Most ports PRs are assigned, we now need to focus on + testing, committing and closing. + + + + + &os; Developer Summit, Karlsruhe + + + + + Gábor + Páli + + pgj@FreeBSD.org + + + + + + + + +

We were happy to have more than 40 &os; developers and guests + attending the &os; Developer Summit prior to EuroBSDCon 2010 + in Karlsruhe, Germany. This workshop-style event was hosted at + Karlsruhe Institute of Technology, and included prepared + presentations in the morning, as well as group hacking and + discussion sections in the afternoon. We had various talks on + several topics, covering the USB subsystem, state of the + toolchain, the &os; documentation, NanoBSD improvements, &os; + port of PF, jails, Virtual Private Systems, cooperation with the + PC-BSD Project, FreeNAS, the new event timers subsystems, + bugbusting discussions and Ports Tinderbox presentations, and + many of this year's and last year's Google Summer of Code + projects. Photos, videos, and slides for most of the talks are + available on the wiki page.

+ + + + + USB stack + + + + + Hans Petter + Selasky + + hselasky@FreeBSD.org + + + + + + XHCI driver + + + +

During the last two months the USB stack in &os;-current has + been enhanced to support USB 3.0 and the XHCI USB 3.0 chipset + from Intel. The XHCI chip will eventually replace the EHCI, OHCI + and UHCI chips.

+ + + + &os; testers which have access to USB 3.0 hardware are + wanted. + + + + + &os;/mips Ralink RT3052F/Broadcom BCM5354 + + + + + Aleksandr + Rybalko + + ray@dlink.ua + + + + + + Description + + Mercurial + repository + + + +

&os;/mips has been ported to D-Link DAP-1350, wireless + AP/router based on Ralink RT3052F SoC.

+ +

Drivers status:

+ +
    +
  • rt2860: Ralink RT2860 802.11n - Worked, but RT3022 2.4G + 2T2R radio tuning required.
    • + +
  • rt: Ralink RT3052F onChip Ethernet MAC - DONE
    • + +
  • rtsw: OnChip Ethernet switch - not done (initialized by + UBoot)
    • + +
  • usb-otg: DWC like USB OTG controller - Worked
    • + +
  • gpio: RT3052F onChip GPIO - Worked (LEDs, Buttons)
    • + +
  • cfi: CFI NOR Flash - Worked
    • +
+ +

&os;/mips D-Link DIR-320 project(BCM5354 SoC).

+ +

New profile openvpn-router available for testing.

+ + + + Debug/Fix USB OTG driver (RT3052F). + + Debug/Fix 802.11n driver (RT3052F). + + Write rtswitch driver (RT3052F). + + Implement Timer unit driver (RT3052F). + + Implement Hardware NAT/PPPoE/VLAN offload (RT3052F). + + Implement I2C/I2S/PCM/SPI drivers (RT3052F). + + switch configuration utility (BCM5354). + + + + + Web feeds for UPDATING files + + + + + Alexander + Kojevnikov + + alexander@kojevnikov.com + + + + + + + + +

updating.versia.com + features web feeds for UPDATING files from ports, head, stable/7 + and stable/8. These feeds provide an easy way to track important + changes in the ports tree and the base system.

+ + + + + &os;/sparc64 + + + + + Marius + Strobl + + marius@FreeBSD.org + + + + +

Apart from the constant bug fixing and adaptions to + machine-independent changes that pretty much always take place, + not much has happened in the area of sparc64 since the last + status report. The only noteworthy exception are some performance + optimizations which take advantage of features of Fujitsu SPARC64 + CPUs. These were a bit too risky for putting them in shortly + before &os; 8.1-RELEASE but will be part of 7.4-RELEASE and + 8.2-RELEASE now that they have received the necessary testing.

+ +

Part of reasons why not much has happened in this spot was some + lack of time on my side but also due to nobody showing up with an + not yet supported sun4u machine lately and me delving in the + network land instead, which yielded some things to report about + in the next status report. On the other hand I recently got a + hold of a Sun Fire 3800, so these and other models from the same + family likely will be supported by &os; at some point in the + future.

+ + + + + The &os; German Documentation Project Status Report + + + + + Johann + Kois + + jkois@FreeBSD.org + + + + + Benedict + Reuschling + + bcr@FreeBSD.org + + + + + Website of the &os; German + Documentation Project. + + + +

The committers to the German Documentation Project were mostly + trying to keep the documents and the website translations in sync + with the ones on &os;.org. Fabian Ruch was helpful in catching up + with the changes to the Porters Handbook. Benedict translated the + Solid State article into german because this is becoming a good + addition to traditional hard drive storage.

+ +

We tried to re-activate committers who did not contribute for + some time but most of them are currently unable to free up enough + time. We hope to gain fresh contributor blood as we are getting + occasional reports about bugs and grammar in the german + translation.

+ + + + Submit grammar, spelling or other errors you find in the + german documents and the website. + + Translate more articles and other open handbook + sections. + + + + + pkg_upgrade (sysutils/bsdadminscripts) + + + + + Dominic + Fandrey + + kamikaze@bsdforen.de + + + + + + bsdadminscripts SF project + + + EuroBSDCon2010 slides and paper + + + +

pkg_upgrade was (to my knowledge) the first binary packages + only update tool for the &os; ports. Using it does not require a + copy of the ports tree.

+ +

Currently the tool is in the final stages of a recode, that + will greatly improve support for sharing packages over NFS or + nullfs mounts (e.g. for distributing packages into jails) and + also offers improved dependency tracking and performance, more in + line with how pointyhat and Tinderbox build packages.

+ +

I recently had the opportunity to present my work at the + EuroBSDCon2010.

+ + + + Complete session code. + + Add INDEX generator script that harvests information + directly from packages and hence is always accurate. + + Testing. + + + + + Registration of optional kernel subsystems via + sysctl + + + + + Ilya + Bakulin + + kibab@FreeBSD.org + + + + + + Project description on GSoC website + + + Slides (from &os; DevSummit in Karlsruhe) + + + +

All work is now in Perforce. Rich set of features is added to + the kernel, userland tools and libc modifications are ready, + documentation is ready.

+ + + + Documentation review. + + Presentation of feature set on the various mailing + lists. + + Committing to -HEAD, possibly merging to stable branches + (changes do not break ABI/KBI). + + + + + PEFS + + + + + Gleb + Kurtsou + + gk@FreeBSD.org + + + + + + + + + + +

PEFS is a kernel level stacked cryptographic filesystem, i.e. + it stacks on top of existing mounted filesystems. AES and + Camellia algorithms in XTS mode are supported. The project has + matured since Summer of Code'2009, most important improvements + for last few months include: switch to use XTS encryption mode, + implementation of sparse file support, fixing rename bugs + including race and livelock conditions, addition of ext2 support. + PEFS suite contains pam module facilitating user authentication + with filesystem key and adding keys to mounted filesystem on + login. PEFS passes fsx, pjdfstest, blogbench and dbench tests + running on top of UFS and ZFS.

+ + + + + ringmap + + + + + Alexander + Fiveg + + afiveg@FreeBSD.org + + + + + Project-Page on + Google Code + + + Slides + + Wiki + + + +

Ringmap is a complete &os; packet capturing stack specialized for + very high-speed networks. The goal of this project is to develop the + software for efficient packet capturing and integrate it with the + generic network drivers and libpcap.

+ +

Current Status:

+ +
    +
  • integrated with lem driver. Intel network controllers: + 8254X are supported.
    • + +
  • packet filtering using BPF in both kernel and user-space
    • + +
  • partly integrated with ixgbe driver for 10Gb capturing
    • +
+ + + + Support for hardware timestamping. + + Writing packets to the disc from within the kernel. + + Multiqueue support. + + Extending the "ringmap" for packet transmission. + + + + + The &os; Foundation Status Report + + + + + Deb + Goodkin + + deb@FreeBSDFoundation.org + + + + + + + + +

We were proud to be a sponsor for MeetBSD 2010 Poland and + KvivBSD 2010 in Kiev, Ukraine. We also committed to sponsoring + BSDDay Argentina 2010, MeetBSD California 2010, and NYBSDCon 2010 + all in November. The Foundation was also represented at MeetBSD + Poland and Ohio LinuxFest.

+ +

Completed the Foundation funded projects: &os; Jail Based + Virtualization by Bjoern Zeeb and DTrace Userland by Rui + Paulo.

+ +

We kicked off a new project by Swinburne University called + Five New TCP Congestion Control Algorithms for &os;.

+ +

We continued our work on infrastructure projects to beef up + hardware for package-building, network-testing, etc. This + includes purchasing equipment as well as managing equipment + donations.

+ +

We are three quarters of the way through the year and we have + raised around $160,000 towards our goal of $350,000. Find out how + to make a donation at + + http://www.FreeBSDFoundation.org/donate/ +

+ +

Stop by and visit with us at MeetBSD California (Nov 5-6), + LISA (Nov 10-11), and NYCBSDCon (Nov 12-14).

+ + + + + Chromium web browser + + + + + Ruben + + chromium@hybridsource.org + + + + + Main chromium + site + + Porting + summary + + + +

Chromium is a Webkit-based web browser that is largely BSD + licensed and was recently committed to ports. It has been working + well on &os; and supports new features like HTML 5 video. Newer + builds use the Clang compiler, Clang first compiled a non-debug + build of Chromium, a very large C++ project, on &os;. This + porting effort employs a new hybrid-source model: portions of the + latest &os; patches are kept closed for a limited time and new + builds are made available only to paying subscribers, while older + builds are eventually spun off to ports. Further work remains to + port all of Chromium to &os;, I am now porting the task manager + to use &os;'s libkvm and the ALSA audio backend needs to be + ported to OSS. There are other issues listed at the porting + summary, contact me if you would like to pitch in.

+ + + + + BSD-Day@2010 + + + + + Gábor + Páli + + pgj@FreeBSD.org + + + + + + + + +

The purpose of this one-day event is to gather Central + European developers of today's open-source BSD systems to + popularize their work and their organizations, and to meet each + other in the real life. We would also like to motivate potential + future developers and users, especially undergraduate university + students to work with BSD systems. This year's BSD-Day will be + held in Budapest, Hungary at Eötvös Loránd + University, Faculty of Informatics on November 20, 2010. + Everybody is welcome!

+ + + + + Five New TCP Congestion Control Algorithms for &os; + + + + + David + Hayes + + dahayes@swin.edu.au + + + + + Lawrence + Stewart + + lstewart@FreeBSD.org + + + + + Grenville + Armitage + + garmitage@swin.edu.au + + + + + Rui + Paulo + + rpaulo@FreeBSD.org + + + + + + + + + + + + + + +

Work has commenced on a newly funded &os; Foundation project + to bring six modular TCP congestion control (CC) algorithm + implementations (the existing NewReno and five new algorithms: + HTCP, CUBIC, Vegas, HD and CHD) to the &os; kernel. See the + CAIA 5cc and NewTCP websites for more details on the + algorithms.

+ +

To support the project's primary deliverable, we will also + be incorporating the CAIA modular CC and Khelp frameworks into + the &os; kernel, along with the Enhanced Round Trip Time Khelp + module.

+ +

The project will make a sizable, state-of-the-art + contribution to &os; and in certain areas, add completely novel + work unavailable in any other operating system known to us.

+ +

We anticipate a number of benefits, including vastly + improved researcher friendliness, reduced work for TCP oriented + vendors of &os;-based appliances, and greater choice for system + administrators who operate &os; systems in atypical network + scenarios.

+ +

Keep and eye on the freebsd-net@FreeBSD.org mailing list for + project related announcements.

+ + + + + Enhancing the &os; TCP Implementation + + + + + Lawrence + Stewart + + lstewart@FreeBSD.org + + + + + + + + + + + + + + +

All outstanding patches have been committed to the svn "head" + branch after a lengthy review process. I anticipate merging all + of the project's SIFTR and reassembly queue related patches from + head to the stable branches in time for the upcoming 7.4 and 8.2 + releases.

+ + + + + Resource Containers + + + + + Edward Tomasz + Napierala + + trasz@FreeBSD.org + + + + +

The goal of this project is to implement resource containers + and a simple per-jail resource limits mechanism. Resource + containers are also a prerequisite for other resource management + mechanisms, such as Hierarchical Resource Limits, for "Collective + Limits on Set of Processes (aka. Jobs)" Google Summer of Code + 2010 project, for implementing mechanism similar to Linux + cgroups, and might be also used to e.g. provide precise resource + usage accounting for administrative or billing purposes. So far, + a generic resource usage framework has been developed, along with + limit enforcement for most resources. Work is ongoing on adding + limits for remaining resources, debugging and generally improving + the implementation. This project is being sponsored by The &os; + Foundation.

+ + + + + BSNMP enhancements + + + + + Shteryana + Shopova + + syrinx@FreeBSD.org + + + + + Philip + Paeps + + philip@FreeBSD.org + + + + + bsnmpd(1) + related pages on &os; wiki + + + snmp_wlan(3) P4 code tree + + + SNMPv3 for bnmspd(1) P4 code tree + + + +

During the previous few months several additions were + developed to &os;'s built-in SNMP daemon - bsnmpd(1). First a + snmp_wlan(3) module was developed that allows monitoring and + configuration of wlan(4) interfaces operating in various modes, + including statistics, attached/neighboring station infomation, + MAC access control entries and mesh routing information. The + module's code was submitted in SVN and is now a part of the &os; + base system. Next, SNMPv3 authentication and encryption support + were added to bsnmplib(3), bsnmpd(1) and bsnmptools (which are + available via the ports system currently). The message digest and + cipher calculation calls use the implementation of the relevant + cryptographic algorithm implementation in OpenSSL's crypto(3) + library. bsnmpd(1) may still optionally be compiled wihtout the + crypto(3) library, in which case only unauthenticated plain-text + SNMPv3 PDUs may be processed. In addition, a snmp_usm(3) module + was developed that is used to configure SNMPv3 users parameters + (name, authentication & encryption algorithms used and relevant + keys, etc) into bsnmpd(1) as per RFC 3414. Finally, a + snmp_vacm(3) module was developed that allows configuration of + view-based access control as per RFC 3415, and relevant checks + are made by bsnmpd(1) that allow or restrict access to specific + SNMPv1/SNMPv2 communities or SNMPv3 users to certain MIB subtrees + as per the configuration in the snmp_vacm(3) module. If none of + the SNMPv3-related modules is loaded, bsnmpd(1) preserves its + current behavior with SNMPv1/SNMPv2c PDUs. This work is being + funded by the &os; Foundation.

+ + + + Update Wiki Page to reflect latest work and document proper + use. + + Finish cleanup and have it reviewed. + + More extensive user testing. + + + + + &os; Services Control (fsc) + + + + + Tom + Rhodes + + trhodes@FreeBSD.org + + + + + + + + +

&os; Services Control is a mix of binaries which integrate + into the rc.d system and provide for service (daemon) + monitoring. It knows about signals, pidfiles, and uses very + little resources.

+ +

The fsc daemon (fscd) runs in the background once the system + has started. Services are then added to this daemon via the + fscadm control utility and from there they will be monitored. + When they die, depending on the reason, they will be restarted. + Certain signals, may be ignored (list not decided) and fscd + will remove that service from monitoring. Every action is + logged to the system logging daemon. Additionally, the fscadm + utility may be used to inquire about what services are + monitored, their pidfile location, and current process id.

+ +

FSC provides several some advantages over the third party + daemontools package. For example, fscd uses push notifications + instead of polling; fscd is an internal, &os; maintained + software package accessible to all developers where daemontools + would have to be a port and require us to maintain patches; + fscd could be easily integrated with the current rc.d + infrastructure.

+ +

Partially based on the ideas of daemontools and Solaris + Service Mangement Facility (SMF), this could be an extremely + useful tool for &os; systems.

+ +

Since the last status report, two bugs have been fixed and + the documentation has been updated. In the coming weeks we hope + to get more developer attention and review, perhaps even push + to commit the code into &os;.

+ + + + Testing and feedback would be really helpful. + + + + + Netdump support + + + + + Attilio + Rao + + attilio@FreeBSD.org + + + + + Ed + Maste + + emaste@FreeBSD.org + + + + + + + + + + +

Netdump provides kernel core dumping over the network, instead + of to a local disk. It implements a very minimal TCP/IPv4 stack + and uses a custom UDP protocol to transmit the dump to the + netdump server running on another host. Network interfaces + selected for dumping, perform I/O in polling mode.

+ +

Netdump should find use in diskless workstation clusters, + PXE-booted test machines, and perhaps when doing disk driver + development.

+ + + + General &os; dumping mechanism refinements. + + Implement checksum on UDP packets. + + Investigate the possibility to replace the custom protocol + with tftp. + + Investigate the possibility to replace the custom TCP/IPv4 + stack with Contiki. + + Implement network console and gdb backend using a shared + debug context stack. + + Add IPv6 support. + + + + + PC-BSD + + + + + Kris + Moore + + kmoore@FreeBSD.org + + + + + PC-BSD Website + + PC-BSD + Current Repo + + + +

Work is progressing quickly on a major re-factoring of PC-BSD + tools and the PBI format for 9.0. Our GUI tools have been + converted to compile / run within native QT without KDE now, + allowing us to begin offering support for other desktop + environments for 9.0, such as Gnome, XFCE, LXDE, KDE, etc. The + PBI format has undergone a complete evolution, and is now + entirely command-line based for all aspects of it, with only a + few dependencies upon curl & xdg-utils. This will allow us to + begin offering PBIs for traditional &os; users starting with 9.0, + who will be able to install the pbi-manager from ports in the + near future.

+ + + + We are still busy converting / fixing all our tools to play + nicely with various DE's, but making quick progress. + + The new PBI format is still undergoing extensive testing, + and bugs are being isolated and fixed. + + + + + xz compression for packages and logfiles + + + + + Martin + Matuska + + mm@FreeBSD.org + + + + +

Support for xz compression has been enabled in bsdtar (HEAD, + 8-STABLE) and added to pkg_create(1) and pkg_add(1) (HEAD). + Packages with the .txz suffix can be created and installed. + Logfile compression using xz in newsyslog(8) will be integrated + soon. Benchmarks show 15-30% better compression ratios and up to + halved decompression times when compared to bzip2. A switch from + the default package format from .tbz to .txz is to be + considered.

+ + + + Test building all &os; packages with xz compression. + + + + + meetBSD California 2010 DevSummit + + + + + Warner + Losh + + imp@ixsystems.com + + + + + Information + page + + + +

We will be having a developers summit meeting at meetBSD + California 2010 on November 4th, the day before the conference. + Based on who is in attendance, we will be taking about the status + of pressing issues; working on pressing problems and using the + opportunity for face to face meetings to work out issues that are + difficult in email. This is an invitation only event, but any + developer can invite people they think would help drive this + meeting forward. An agenda will be published closer to the date. + For more information, please contact Warner Losh.

+ + + + + External toolchain support + + + + + Warner + Losh + + imp@FreeBSD.org + + + + +

One problem that the project has with its push towards + embedded platforms is with the toolchain. The compilers and + linkers and such in the current &os; support the architectures + generically, but often times silicon vendors produce specialized + toolchains to wring the most performance out of their silicon. + Right now, it is difficult to compile &os; with these tools, as + many manual steps are required to make things 'just so'. The + external toolchain project will leverage some of the work done by + the clang team to support clang in the base system (breaking the + strict dependency on CC=cc (except for the broken intel CC + support)). In addition, the orchestration of the build (make + buildworld) will change to avoid bootstrapping certain tools, or + compiling the compilers at all. In addition, support for using + alternate assemblers, linkers, etc will be added. The work will + be done in subversion in projects/xtc (for eXternal Tool + Chain).

+ + + + + Target Big Endian Must Die + + + + + Warner + Losh + + imp@FreeBSD.org + + + + +

The "tbemd" or Target Big Endian Must Die effort is nearing + completion. Most of the big sweeping changes to the tree have + been committed. The last change, actually pulling the switch, is + stalled waiting for make universe improvements. This work will + change the TARGET_ARCH from a plain 'mips' to 'mipsel' or + 'mipseb' based on which endian the platform has. It introduces + the concept of multiple architectures being implemented with one + set of files, and regularizes that design pattern into the &os; + build process. In the past, you had to set TARGET_BIG_ENDIAN=t to + compile for big endian, but that had a number of problems: ca not + share /usr/obj between little and big endian targets, sometimes + the produced compilers will not work right unless TARGET_BIG_ENDIAN + is defined in the environment, etc.

+ + + + Update make universe to cope with the new architectures + when building kernels. + + + + + &os; KDE Team + + + + + &os; KDE + Team + + kde@FreeBSD.org + + + + + Thomas + Abthorpe + + tabthorpe@FreeBSD.org + + + + + Max + Brazhnikov + + makc@FreeBSD.org + + + + + Kris + Moore + + kmoore@FreeBSD.org + + + + + Dima + Panov + + fluffy@FreeBSD.org + + + + + Alberto + Villa + + avilla@FreeBSD.org + + + + + + + + +

The &os; KDE team has been actively keeping pace with development cycle + as it is released by the KDE developers. Often having KDE in the + ports tree within the same week it has been released.

+ +

An integral part of maintaining KDE exists in supporting the + Qt toolchain. As Nokia releases Qt, + our team is keeping pace making it available in our development repository.

+ +

We are fortunate to have a strong contributor base that help + keep the process moving along. Our heartfelt thanks go out to all + that have helped with patches, maintaining ports, and responding + with help on the mailing lists.

+ + + + KDE 4.5.4 is due out at the end of November, with 4.6.0 to + be released early in 2011. + + The &os; KDE team is always looking for helpers, if you are + interested in assisting, please feel free to contact any of our + team members. + + + + + pc-sysinstall + + + + + Kris + Moore + + kmoore@FreeBSD.org + + + + + John + Hixson + + john@ixsystems.com + + + + + Josh + Paetzel + + jpaetzel@FreeBSD.org + + + + + + + + +

pc-sysinstall was imported into HEAD recently. For the moment + it is feature complete, although progress on the text front end + for it may exposes additional functionality it needs

+ + + + the automated/scripted install features of pc-sysinstall + need wider testing and use to expose potential weaknesses, bugs, + and additional features it may require. + + Related tasks include getting a text front end to + pc-sysinstall working and hooking up pc-sysinstall to the build + so install media is generated that runs pc-sysinstall. + + + + + DAHDI/&os; Project + + + + + Max + Khon + + fjoe@samodelkin.net + + + + + + + + + + Project Status + + + +

The purpose of DAHDI/&os; project is to make it possible to + use &os; as a base system for software PBX solutions.

+ +

DAHDI (Digium/Asterisk Hardware Device Interface) is an + open-source device driver framework and a set of hardware drivers + for E1/T1, ISDN digital, and FXO/FXS analog cards [1] + Asterisk is one of the most popular open-source software PBX + solutions [2].

+ +

The project includes porting DAHDI framework and hardware + drivers for E1/T1, FXO/FXS analog, and ISDN digital cards to + &os;. This also includes TDMoE support, software and HW echo + cancellation (Octasic, VPMADT032), and hardware transcoding + support (TC400B). The work is ongoing in the official DAHDI SVN + repository with the close collaboration with DAHDI folks at + Digium.

+ +

DAHDI/&os; project is completed. ports/misc/dahdi now contains + the most recent DAHDI/&os; version and additional stuff that is + not available in DAHDI/&os; SVN repository due to licensing and + copyright restrictions (OSLEC echo canceler, experimental zaphfc + driver). Experimental sparc64 support is also implemented and is + currently being tested.

+ +

There is a pile of minor changes in queue that will be handled + soon:

+ +
    +
  • add ability to run asterisk+dahdi under non-root user + account
    • + +
  • add support for bri_net_ptmp ISDN signalling to asterisk + port and drop old and outdated zaptel+asterisk-bristuff + ports
    • +
+ +

I will continue periodic merges from DAHDI/Linux SVN on a + regular basis and roll out new DAHDI/&os; releases (most likely + synchronized with DAHDI/Linux releases).

+ + + + + V4L Support in Linux Emulator + + + + + J.R. + Oldroyd + + fbsd@opal.com + + + + + + + + +

The V4L support in the Linux emulator has been MFC'd to + 8-STABLE allowing use of video in skype calls using a camera + supported by the pwcbsd or video4bsd drivers. A known issue for + skype is that your camera must support YUV420 mode which is what + skype uses. Note that V4L2 support is not included in the current + work, and remains as a project for anyone interested.

+ + + + + Syncing pf(4) with OpenBSD 4.5 + + + + + Ermal + Luçi + + eri@FreeBSD.org + + + + + + Viewing the changes. + + The + actual repo to build from. + + + Public announcement. + + + +

This work is based on OpenBSD 4.5 state of pf(4). It includes + many improvements over the code currently present in &os;. The + actual new feature present in pf45 repository is support for + divert(4), which should allow tools like snort_inline to work + with pf(4) too. This work also enables pfsync(4) to be loaded as + a module as well.

+ +

Currently, this work is considered stable and a patch agains + -CURRENT has been released on freebsd-pf@ mailing list.

+ +

The reason why this work is based off of OpenBSD 4.5 is that + after this release they have changed the syntax which is not + backwards compatible.

+ +

After importing this one the work will go on the newest + version and decisions on it will than be done.

+ + + + Make a decision whether we need pflow(4) in base. + + More regression testing is needed. + + + + + OpenAFS port + + + + + Benjamin + Kaduk + + kaduk@mit.edu + + + + + Derrick + Brashear + + shadow@gmail.com + + + + + OpenAFS home page + + + FreeBSD port for the OpenAFS 1.5.77 release + + + +

AFS is a distributed network filesystem that originated from + the Andrew Project at Carnegie-Mellon University; the OpenAFS + client implementation has not been particularly useful on FreeBSD + since the FreeBSD 4.X releases. The previous status report + brought the OpenAFS client to a useful form on 9.0-CURRENT, + though with many rough edges. Only a couple of those edges have + been smoothed out during the past few months, as developer time + was scarce. A mismatch between file size and vmobject size + tracking was resolved (allowing executables to be run from AFS), + and our system call entry has been updated on HEAD and RELENG_8 + to match reality. Thanks to kib@ for both of those! The code is + useful enough that we plan to submit an openafs-devel port to the + Ports Collection in the coming cycle.

+ +

There are several known outstanding issues that are being + worked on, but detailed bug reports are welcome at + port-freebsd@openafs.org.

+ + + + Rework vnode locking for lookup operations to avoid an + easily-triggered deadlock between two threads when one is looking + up the parent directory. + + Update VFS locking to allow the use of disk-based client + caches as well as memory-based caches. + + Track down races and deadlocks that appear under + load. + + Integrate with the bsd.kmod.mk kernel-module build + infrastructure. + + + + + gptboot improvements + + + + + Pawel Jakub + Dawidek + + pjd@FreeBSD.org + + + + + + + + +

The gptboot now fully follows GPT specification (verifies + checksums and falls back to backup header and table if primary is + corrupted).

+ +

One can now use new attributes to configure partition that + gptboot will try to boot only once from and in case of a failure + it will fall back to the previous one.

+ +

For more information check out the commit message.

+ + + + + HAST (Highly Available Storage) improvements + + + + + Pawel Jakub + Dawidek + + pjd@FreeBSD.org + + + + +

HAST is now better than ever!:) Some recent improvements + include:

+ +
    +
  • Hooks supports - HAST will execute the given command on + various events (connect, disconnect, synchronization start, + synchronization completed, synchronization interrupted, + split-brain condition, role change).
    • + +
  • Configuration reload on SIGHUP, a very missing + functionality.
    • + +
  • Internal keepalive mechanism.
    • + +
  • Many bug fixes, majority of them reported by Mikolaj + Golub.
    • +
+ + + + + ZFSv28 is ready for wider testing + + + + + Pawel Jakub + Dawidek + + pjd@FreeBSD.org + + + + + + + + +

ZFS v28 which includes data deduplication and plenty of other + shiny new features is ready for testing. For more information + check out the announcement.

+ + + + + GELI additions + + + + + Pawel Jakub + Dawidek + + pjd@FreeBSD.org + + + + +

There are three new GELI (a disk encryption GEOM class) + features available in FreeBSD HEAD:

+ +
    +
  • AES-XTS encryption. XTS mode is a standard that is + recommended these days for storage encryption. This is the + default now. AES-XTS support was also added to opencrypto + framework and aesni(4) driver.
    • + +
  • Multiple encryption keys. GELI will use one encryption key + for at most 2^20 blocks (sectors), as it is not recommended to + use the same encryption key for too much data. It generates keys + array from the master key on attach and uses it accordingly. This + is the default now.
    • + +
  • Passphrase can now also be loaded from a file (-J and -j + options).
    • +
+ + + + + Valgrind port + + + + + Stanislav + Sedov + + stas@FreeBSD.org + + + + + Ed + Maste + + emaste@FreeBSD.org + + + + +

Valgrind is a tool for detecting memory management and + threading bugs, and profiling. Version 3.6.0 has recently been + released, while we we have a working port of 3.5.0 now. Work is + now underway to update the &os; port to 3.6.0, with the eventual + goal of having our changes integrated upstream.

+ +

A bugzilla entry has been submitted to track the &os; Valgrind + port. You can see the status and vote for the bug to express your + interest at + https://bugs.kde.org/show_bug.cgi?id=208531.

+ + + + Port exp-ptrcheck valgrind tool and fix outstanding issues + that show up in memcheck/helgrind/DRD in the Valgrind regression + tests suite. + + More testing (please, help). + + Integrate our patches upstream. + + +