Difference between revisions of "OpenZFS Developer Summit 2016"

From OpenZFS
Jump to navigation Jump to search
Line 163: Line 163:
|SPA import and pool recovery||Pavel Zakharov||
|SPA import and pool recovery||Pavel Zakharov||
|}
|}
== Hackathon Ideas ==
''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''
==== Medium-size hackathon projects ====
* store total # blocks on disk (of each type, in each ds, etc) (George W)
* use refcount_t for v_count (fileystem-ey but not ZFS)
* on-disk map from dataset GUID -> set of object IDs
* scrub specific dataset
* channel programs enhancements
** open-context channel program
** setting properties
** new sync tasks
* add LZ4HC compression
* allow receive of -L / -e / -c streams on systems with the required feature flags disabled
* allow spacemap to represent larger range with one entry (increase entry size)
==== Simpler hackathon projects ====
* break zfs/zpool manpages into one page per subcommand
* zfs send —current-format
* “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr))
* more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
* metaslab size can exceed offset addressable by spacemap
==== Backlog ideas ====
* error counts in per-vdev object
* scrub on readonly pool
* “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
* preferred allocation alignment (george)
* promote prefetch reads to sync reads
* runtime lock analyzer (like freebsd WITNESS)
* test suite for system attributes
* feature flags support for disabling inactive features
* ZFS should prefer gethrtime() to ddi_get_lbolt()
* create vdev in syncing context (with sync task)
* Add interface for creating file with specific recordsize
* does ::abuf_find still work?
* JSON command output
* zfs help command
* zfs set print usage message specific to property you're trying to set
* make zfs recv less trusting
* convert some AVL trees to b-trees or hash tables
* cross platform xattr


<!--
<!--

Revision as of 20:03, 23 September 2016

OpenZFS Dev Summit 2016

The fourth annual OpenZFS Developer Summit is being held in San Francisco, California.

The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.

All OpenZFS developers are invited to participate!

Livestream

You can watch the livestream below.

We will be live streaming all the presentations on Day 1 starting at 9 am. If you aren't able to make it to the event in person, we encourage you to watch our stream.

Recordings of the talks will be posted after the Summit.

Thank You 2016 Sponsors!

Platinum Sponsors

  • Delphix
  • Intel
  • OSNexus
  • Nexenta
  • datto

Gold Sponsors

  • Syneto
  • iXSystems

Silver Sponsors

  • FreeBSD Foundation
  • High Availability
  • Canonical


Event

When

September 26 and 27, 2016

Detailed Schedule is below.

Where

The conference will take place in San Francisco, with each day held at a different location within the city:

Registration

Developer Summit 2016 registration is now open!

  • There will be no registration deadline - the registration will remain open until capacity is reached. There will be a waitlist in case tickets become available.
  • Registration is $50 per attendee. If your company is a sponsor (as listed below), you may be eligible for a free registration. Please contact admin at open-zfs dot org once if that is the case. Speakers will also receive free registration.

All attendees are expected to contribute/participate. Your ideas and questions are what make the event exciting!

Schedule

Day 0: September 25th

Optional meetup for dinner/drinks (at your expense) at Rosamunde Saussage Grill on Mission St in SF, starting at 6pm.

Note that Rosamunde has multiple locations, be sure to set your GPS for the location on Mission St, near 24th St. Location is less than a block from the 24th St. Mission BART stop.

Day 1: September 26th

Children's Creativity Museum, 221 4th St, San Francisco, CA 94103.

Presentations this day will be live streamed; check this page the day of the event for details.

Click on the title of the presentation for more details.

Start End Title Speaker Company
8:30 am 9:00 am Registration & Breakfast
9:00 am 9:25 am State of the Union Matt Ahrens Delphix
9:25 am 10:05 am Keynote Dustin Kirkland Canonical
10:05 am 10:35 am Break
10:35 am 11:15 am Lustre, Supercomputers, and ZFS Brian Behlendorf LLNL
11:15 am 11:40 am ZFS and Containers Michael Crogan
11:40 am 11:55 am Channel Programs Sara Hartse & Chris Williamson Delphix
11:55 am 12:45 pm Lunch
12:45 pm 1:10 pm ZFS First Mount Mark Shellenbaum Oracle
1:10 pm 1:50pm Scrub/Resilver Performance Saso Kiselkov Nexenta
1:50 pm 2:20 pm Break
2:20 pm 3:00 pm ZFS-Native Encryption Tom Caputi Datto
3:00 pm 3:40 pm Fault Management Don Brady & Justin Gibbs Intel & FreeBSD Foundation
3:40 pm 4:10 pm Break
4:10 pm 4:50 pm ZFS Validation & QA Sydney Vanda & John Salinas Intel
4:50 pm 5:00 pm Closing Matt Ahrens Delphix
5:00 pm 5:30 pm Break
5:30 pm 8:00 pm Dinner

Day 2: September 26th

Delphix SF Office, 343 Sansome St, Suite 900, San Francisco, CA 94104

Start End Event
9:00 am 9:45 am Lightning Talks
9:45 am 10:00 am Break
10:00 am 12:00 pm Hackathon
12:00 pm 1:00 pm Lunch
1:00 pm 4:00 pm Hackathon
4:00 pm 5:00 pm Hackathon Presentations

We will have lightning (5 minute) updates on the following projects which have been discussed at previous conferences:

Title Speaker Previous Talk
ABD solves large/fragmented memory Dan Kimmel & David Chen Slides Video (2015)
Eager Zero George Wilson Slides Video (2015)
Compressend Send and Receive Dan Kimmel Slides Video (2015)
Device Removal Matt Ahrens Slides Video (2014)
Parity Declustered RAID for ZFS (DRAID) Isaac Huang Slides Video (2015)
SPA Metadata Allocation Classes Don Brady Slides Video (2015)
Redacted send/receive Paul Dagnelie Slides Video (2015)
Persistent L2ARC and TRIM Saso Kiselkov Slides Video (2015)
SPA import and pool recovery Pavel Zakharov

Hackathon Ideas

Add your idea and your name below. Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.

Medium-size hackathon projects

  • store total # blocks on disk (of each type, in each ds, etc) (George W)
  • use refcount_t for v_count (fileystem-ey but not ZFS)
  • on-disk map from dataset GUID -> set of object IDs
  • scrub specific dataset
  • channel programs enhancements
    • open-context channel program
    • setting properties
    • new sync tasks
  • add LZ4HC compression
  • allow receive of -L / -e / -c streams on systems with the required feature flags disabled
  • allow spacemap to represent larger range with one entry (increase entry size)

Simpler hackathon projects

  • break zfs/zpool manpages into one page per subcommand
  • zfs send —current-format
  • “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr))
  • more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
  • metaslab size can exceed offset addressable by spacemap

Backlog ideas

  • error counts in per-vdev object
  • scrub on readonly pool
  • “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
  • preferred allocation alignment (george)
  • promote prefetch reads to sync reads
  • runtime lock analyzer (like freebsd WITNESS)
  • test suite for system attributes
  • feature flags support for disabling inactive features
  • ZFS should prefer gethrtime() to ddi_get_lbolt()
  • create vdev in syncing context (with sync task)
  • Add interface for creating file with specific recordsize
  • does ::abuf_find still work?
  • JSON command output
  • zfs help command
  • zfs set print usage message specific to property you're trying to set
  • make zfs recv less trusting
  • convert some AVL trees to b-trees or hash tables
  • cross platform xattr


Harrasment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2015 page.