Difference between revisions of "OpenZFS Developer Summit 2016"

From OpenZFS
Jump to navigation Jump to search
(After event editing)
Line 100: Line 100:
|}
|}


=== Hackathon Ideas ===
=== Hackathon Projects===
 
''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''


==== Simpler hackathon projects ====
==== Simpler hackathon projects ====

Revision as of 19:54, 28 September 2016

OpenZFS Dev Summit 2016

The fourth annual OpenZFS Developer Summit was held in San Francisco, California.

The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.


Livestream

You can watch the recorded livestream below.


Individual recordings of the talks will be posted on Youtube after the Summit.

Thank You 2016 Sponsors!

Platinum Sponsors

  • Delphix
  • Intel
  • OSNexus
  • Nexenta
  • datto

Gold Sponsors

  • Syneto
  • iXSystems

Silver Sponsors

  • FreeBSD Foundation
  • High Availability
  • Canonical


Presentations

Click on the title of the presentation for more details.

Title Speaker Company Video Slides
State of the Union Matt Ahrens Delphix TBA TBA
Keynote Dustin Kirkland Canonical TBA TBA
Lustre, Supercomputers, and ZFS Brian Behlendorf LLNL TBA TBA
ZFS and Containers Michael Crogan TBA TBA
Channel Programs Sara Hartse & Chris Williamson Delphix TBA TBA
ZFS First Mount Mark Shellenbaum Oracle TBA TBA
Scrub/Resilver Performance Saso Kiselkov Nexenta TBA TBA
ZFS-Native Encryption Tom Caputi Datto TBA TBA
Fault Management Don Brady & Justin Gibbs Intel & FreeBSD Foundation TBA TBA
ZFS Validation & QA Sydney Vanda & John Salinas Intel TBA TBA
Closing Matt Ahrens Delphix TBA TBA

Hackathon

We had lightning (5 minute) updates on the following projects which have been discussed at previous conferences:

Title Speaker Previous Talk
ABD solves large/fragmented memory Dan Kimmel & David Chen Slides Video (2015)
Eager Zero George Wilson Slides Video (2015)
Compressend Send and Receive Dan Kimmel Slides Video (2015)
Device Removal Matt Ahrens Slides Video (2014)
Parity Declustered RAID for ZFS (DRAID) Isaac Huang Slides Video (2015)
SPA Metadata Allocation Classes Don Brady Slides Video (2015)
Redacted send/receive Paul Dagnelie Slides Video (2015)
Persistent L2ARC and TRIM Saso Kiselkov Slides Video (2015)
SPA import and pool recovery Pavel Zakharov

Hackathon Projects

Simpler hackathon projects

  • cppcheck errors (reported on mailing list, DLPX-47345)
  • ::metaslab_trace and ::metaslab_weight dcmds should be documented (DLPX-45762
  • break zfs/zpool manpages into one page per subcommand
  • zfs send —current-format
  • “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr))
  • more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
  • metaslab size can exceed offset addressable by spacemap (DLPX-39390)

Medium-size hackathon projects

  • zstd compression algo (saso)
  • storage pool checkpoint (DLPX-46652)
  • port "zpool iostat" enhancements from Linux to illumos/FreeBSD ZoL PR
  • add subcommand to wait for background zfs activity to complete (DLPX-44432)
  • compress last block of each object, even if compression is disabled (DLPX-42061)
  • store total # blocks on disk (of each type, in each ds, etc) (George W)
  • port "Backfill metadnode more intelligently" from Linux to illumos/FreeBSD ZoL PR
  • port large dnode support from Linux to illumos/FreeBSD ZoL PR
  • port SIMD-vectorized fletcher4 and RAIDZ code from Linux to illumos/FreeBSD
  • cross-platform compatibility layer (Paul D)
  • use refcount_t for v_count (fileystem-ey but not ZFS)
  • on-disk map from dataset GUID -> set of object IDs
  • scrub specific dataset
  • channel programs enhancements
    • open-context channel program
    • setting properties
    • new sync tasks
  • finish reviewing / push LZ4HC compression ZoL PR
  • allow receive of -L / -e / -c streams on systems with the required feature flags disabled
  • allow spacemap to represent larger range with one entry (increase entry size)

Backlog ideas

  • error counts in per-vdev object
  • scrub on readonly pool
  • “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
  • preferred allocation alignment (george)
  • promote prefetch reads to sync reads
  • runtime lock analyzer (like freebsd WITNESS)
  • test suite for system attributes
  • feature flags support for disabling inactive features
  • ZFS should prefer gethrtime() to ddi_get_lbolt()
  • create vdev in syncing context (with sync task)
  • Add interface for creating file with specific recordsize
  • does ::abuf_find still work?
  • JSON command output
  • zfs help command
  • zfs set print usage message specific to property you're trying to set
  • make zfs recv less trusting
  • convert some AVL trees to b-trees or hash tables
  • cross platform xattr

Sponsorship

A huge thank you for all the companies sponsoring the OpenZFS Developers Summit!

As an OpenZFS Dev Summit sponsor, you are providing critical support to our annual event, without which it would not be able to continue. Your generous contributions pay for the venue, food and beverage expenses, live streaming service, and other miscellaneous goods and services.

Harrasment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2015 page.