Difference between revisions of "OpenZFS Developer Summit 2016"

From OpenZFS
Jump to navigation Jump to search
(After event editing)
Line 1: Line 1:
[[File:OpenZFS_2016_338px_White.png| right | 370px | OpenZFS Dev Summit 2016]] The fourth annual OpenZFS Developer Summit is being held in San Francisco, California.
[[File:OpenZFS_2016_338px_White.png| right | 370px | OpenZFS Dev Summit 2016]] The fourth annual OpenZFS Developer Summit was held in San Francisco, California.
The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.
The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.


All OpenZFS developers are invited to participate!


==Livestream==
==Livestream==
You can watch the livestream below.
You can watch the recorded livestream below.


<html>
<html>
Line 11: Line 10:
</html>
</html>


We will be live streaming all the presentations on Day 1 starting at 9 am. If you aren't able to make it to the event in person, we encourage you to watch our stream.


Recordings of the talks will be posted after the Summit.
Individual recordings of the talks will be posted on Youtube after the Summit.


==Thank You 2016 Sponsors!==
==Thank You 2016 Sponsors!==
Line 43: Line 41:




==Event==
==Presentations==
 
===When===
September 26 and 27, 2016
 
Detailed Schedule is below.
 
===Where===
The conference will take place in San Francisco, with each day held at a different location within the city:
* Monday, September 26th (presentations) - [https://www.google.com/maps/place/Children's+Creativity+Museum/@37.7833214,-122.4043141,17z/data=!3m1!4b1!4m5!3m4!1s0x80858087438c54b7:0x9229072a5964c7fb!8m2!3d37.7833172!4d-122.4021201 Children's Creativity Museum, 221 4th St, San Francisco, CA 94103.]
* Tuesday, September 27th (hackathon) - [https://www.google.com/maps/place/343+Sansome+St,+San+Francisco,+CA+94104/@37.7939169,-122.4052801,16.54z/data=!4m5!3m4!1s0x8085808a7989b1d9:0x878bc14303216c5e!8m2!3d37.7936971!4d-122.4017307 Delphix SF Office, 343 Sansome St, Suite 900, San Francisco, CA 94104]
 
===Registration===
[https://www.eventbrite.com/e/openzfs-developer-summit-2016-tickets-24968191533|OpenZFS Developer Summit 2016 registration] is now open!
* There will be no registration deadline - the registration will remain open until capacity is reached. There will be a waitlist in case tickets become available.
* Registration is $50 per attendee. If your company is a sponsor (as listed below), you may be eligible for a free registration. Please contact admin at open-zfs dot org once if that is the case. Speakers will also receive free registration.
All attendees are expected to contribute/participate. Your ideas and questions are what make the event exciting!
 
===Schedule===
 
====Day 0: September 25th====
 
Optional meetup for dinner/drinks (at your expense) at [http://www.rosamundesausagegrill.com/ Rosamunde Saussage Grill] on [https://www.google.com/maps/place/Rosamunde+Sausage+Grill/@37.7516627,-122.4207522,17z/data=!3m1!4b1!4m5!3m4!1s0x808580a6c02ad54d:0xa8dacc04df3a68c8!8m2!3d37.7516585!4d-122.4185635 Mission St] in SF, starting at 6pm.
 
Note that Rosamunde has multiple locations, be sure to set your GPS for the location on Mission St, near 24th St.  Location is less than a block from the 24th St. Mission BART stop.
 
====Day 1: September 26th====
 
[https://www.google.com/maps/place/Children's+Creativity+Museum/@37.7833214,-122.4043141,17z/data=!3m1!4b1!4m5!3m4!1s0x80858087438c54b7:0x9229072a5964c7fb!8m2!3d37.7833172!4d-122.4021201 Children's Creativity Museum, 221 4th St, San Francisco, CA 94103.]
 
Presentations this day will be live streamed; check this page the day of the event for details.


Click on the title of the presentation for more details.
Click on the title of the presentation for more details.
Line 79: Line 47:
{| class="wikitable"
{| class="wikitable"
|-
|-
!Start!!End!!Title!!Speaker!!Company
!Title!!Speaker!!Company!!Video!!Slides
|-
|8:30 am||9:00 am||colspan=3|'''Registration & Breakfast'''
|-
|9:00 am||9:25 am||State of the Union||Matt Ahrens||[http://www.delphix.com/ Delphix]
|-
|9:25 am|| 10:05 am||Keynote||Dustin Kirkland||[http://canonical.com/ Canonical]
|-
|10:05 am||10:35 am||colspan=3|'''Break'''
|-
|10:35 am|| 11:15 am||Lustre, Supercomputers, and ZFS||Brian Behlendorf||[http://llnl.gov LLNL]
|-
|-
|11:15 am|| 11:40 am||[[ZFS and Containers]]||Michael Crogan||
|State of the Union||Matt Ahrens||[http://www.delphix.com/ Delphix]||TBA||TBA
|-
|-
|11:40 am||11:55 am||Channel Programs||Sara Hartse & Chris Williamson||[http://delphix.com Delphix]
|Keynote||Dustin Kirkland||[http://canonical.com/ Canonical]||TBA||TBA
|-
|-
|11:55 am||12:45 pm||colspan=3|'''Lunch'''
|Lustre, Supercomputers, and ZFS||Brian Behlendorf||[http://llnl.gov LLNL]||TBA||TBA
|-
|-
|12:45 pm||1:10 pm||ZFS First Mount||Mark Shellenbaum||[http://www.oracle.com Oracle]
|[[ZFS and Containers]]||Michael Crogan|| ||TBA||TBA
|-
|-
|1:10 pm||1:50pm||[[Scrub/Resilver Performance]]||Saso Kiselkov||[http://www.nexenta.com/ Nexenta]
|Channel Programs||Sara Hartse & Chris Williamson||[http://delphix.com Delphix]||TBA||TBA
|-
|-
|1:50 pm||2:20 pm||colspan=3|'''Break'''
|ZFS First Mount||Mark Shellenbaum||[http://www.oracle.com Oracle]||TBA||TBA
|-
|-
|2:20 pm||3:00 pm||[[ZFS-Native Encryption]]||Tom Caputi||[http://www.datto.com Datto]
|[[Scrub/Resilver Performance]]||Saso Kiselkov||[http://www.nexenta.com/ Nexenta]||TBA||TBA
|-
|-
|3:00 pm||3:40 pm||[[Fault Management]]||Don Brady & Justin Gibbs||[http://www.intel.com/ Intel] & [https://www.freebsdfoundation.org/ FreeBSD Foundation]
|[[ZFS-Native Encryption]]||Tom Caputi||[http://www.datto.com Datto]||TBA||TBA
|-
|-
|3:40 pm||4:10 pm||colspan=3|'''Break'''
|[[Fault Management]]||Don Brady & Justin Gibbs||[http://www.intel.com/ Intel] & [https://www.freebsdfoundation.org/ FreeBSD Foundation]||TBA||TBA
|-
|-
|4:10 pm|| 4:50 pm||[[ZFS Validation & QA]]||Sydney Vanda & John Salinas||[http://www.intel.com/ Intel]
|[[ZFS Validation & QA]]||Sydney Vanda & John Salinas||[http://www.intel.com/ Intel]||TBA||TBA
|-
|-
|4:50 pm||5:00 pm||Closing||Matt Ahrens||[http://www.delphix.com/ Delphix]
|Closing||Matt Ahrens||[http://www.delphix.com/ Delphix]||TBA||TBA
|-
|5:00 pm||5:30 pm||colspan=3|'''Break'''
|-
|5:30 pm||8:00 pm||colspan=3|'''Dinner'''
|}
|}


====Day 2: September 26th====
==Hackathon==


[https://www.google.com/maps/place/343+Sansome+St,+San+Francisco,+CA+94104/@37.7939169,-122.4052801,16.54z/data=!4m5!3m4!1s0x8085808a7989b1d9:0x878bc14303216c5e!8m2!3d37.7936971!4d-122.4017307 Delphix SF Office, 343 Sansome St, Suite 900, San Francisco, CA 94104]
{| class="wikitable"
|-
!Start!!End!!Event
|-
|9:00 am||11:00 am||Lightning Talks
|-
|11:00 am||12:00 pm||Hackathon
|-
|12:00 pm||1:00 pm||'''Lunch'''
|-
|1:00 pm||4:00 pm||Hackathon
|-
|4:00 pm||5:00 pm||Hackathon Presentations
|}


We will have lightning (5 minute) updates on the following projects which have been discussed at previous conferences:
We had lightning (5 minute) updates on the following projects which have been discussed at previous conferences:


{| class="wikitable"
{| class="wikitable"
Line 162: Line 100:
|}
|}


== Hackathon Ideas ==
=== Hackathon Ideas ===


''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''
''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''
Line 217: Line 155:
* cross platform xattr
* cross platform xattr


<!--
==Sponsorship==
==Sponsorship==
Thank you for considering sponsoring the OpenZFS Developers Summit!
A huge thank you for all the companies sponsoring the OpenZFS Developers Summit!
 
As an OpenZFS Dev Summit sponsor, you are providing critical support to our annual event, without which it would not be able to continue. Your generous contributions pay for the venue, food and beverage expenses, live streaming service, and other miscellaneous goods and services. There are multiple sponsorship opportunities for each package.


Please note that we are happy to customize a sponsorship package if you are willing to provide more or less support than specified by our packages.
As an OpenZFS Dev Summit sponsor, you are providing critical support to our annual event, without which it would not be able to continue. Your generous contributions pay for the venue, food and beverage expenses, live streaming service, and other miscellaneous goods and services.  
 
We are also happy to accept non-monetary support, such as by webcasting and video recording the event, creating the badges, providing hackathon prizes, or designing the t-shirts. For this type of support, we match the sponsorship benefits to the level of effort/support you provide.
 
For more information or questions, please contact admin@open-zfs.org.
 
===Sponsor Deadlines===
{| class="wikitable" style="vertical-align:top;"
|-
| style="width: 15% | August 29, 2016 || Attendee registration deadline for reserved sponsor tickets. <br/> '''Attendees registered after this deadline may need to be placed on a waitlist.'''
|-
| September 1, 2016 || Sponsorship confirmed, logo provided, and documentation returned in order to have logo included on OpenZFS Dev Summit 2016 conference t-shirt and conference signage
|-
| September 1, 2016 || Sizes and quantities provided for extra t-shirts
|}
 
===Sponsorship Packages===
{| class="wikitable" style="text-align:center;"
! || Platinum<br />Beer Bash<br />Hackathon || Gold || Silver || Bronze
|-
| Amount || $4,000 || $2,000 || $1,000 || $500
|-
| Logo on the back of OpenZFS Dev Summit t-shirts || X || || ||
|-
| A dedicated table at venue for promotional purposes to<br />display sponsor branded swag and any provided tablecloths || X || || ||
|-
| Space to put up the sponsoring company’s<br />pop-up banner for display at venue || X || || ||
|-
| Home page acknowledgement with<br />corporate name, logo, and link on open-zfs.org || X || || ||
|-
| Top of event page acknowledgement with<br />corporate name, logo, and link on open-zfs.org || X || X || ||
|-
| Ability to provide a number of sponsor branded<br />swag types for promotional purposes || Unlimited || 2 || 1 ||
|-
| Reserved Free Conference Tickets || 4 || 3 || 2 || 1
|-
| Extra t-shirts in chosen sizes sent to the sponsor || 5 || 3 || 2 || 1
|-
| An opportunity to be known as an OpenZFS supporter<br />in a very talented and influential community || X || X || X || X
|-
|Inclusion of company logo on a<br />sponsor “thank you” banner for display at venue || X || X || X || X
|-
|Event page acknowledgement with<br />corporate name, logo, and link on open-zfs.org || X || X || X || X
|-
|Permission to use OpenZFS Dev Summit logo<br />on sponsor website || X || X || X || X
|-
|Mentioned as a “thank you” during<br />the opening and closing of the event || X || X || X || X
|}
-->


==Harrasment Policy==
==Harrasment Policy==

Revision as of 19:52, 28 September 2016

OpenZFS Dev Summit 2016

The fourth annual OpenZFS Developer Summit was held in San Francisco, California.

The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.


Livestream

You can watch the recorded livestream below.


Individual recordings of the talks will be posted on Youtube after the Summit.

Thank You 2016 Sponsors!

Platinum Sponsors

  • Delphix
  • Intel
  • OSNexus
  • Nexenta
  • datto

Gold Sponsors

  • Syneto
  • iXSystems

Silver Sponsors

  • FreeBSD Foundation
  • High Availability
  • Canonical


Presentations

Click on the title of the presentation for more details.

Title Speaker Company Video Slides
State of the Union Matt Ahrens Delphix TBA TBA
Keynote Dustin Kirkland Canonical TBA TBA
Lustre, Supercomputers, and ZFS Brian Behlendorf LLNL TBA TBA
ZFS and Containers Michael Crogan TBA TBA
Channel Programs Sara Hartse & Chris Williamson Delphix TBA TBA
ZFS First Mount Mark Shellenbaum Oracle TBA TBA
Scrub/Resilver Performance Saso Kiselkov Nexenta TBA TBA
ZFS-Native Encryption Tom Caputi Datto TBA TBA
Fault Management Don Brady & Justin Gibbs Intel & FreeBSD Foundation TBA TBA
ZFS Validation & QA Sydney Vanda & John Salinas Intel TBA TBA
Closing Matt Ahrens Delphix TBA TBA

Hackathon

We had lightning (5 minute) updates on the following projects which have been discussed at previous conferences:

Title Speaker Previous Talk
ABD solves large/fragmented memory Dan Kimmel & David Chen Slides Video (2015)
Eager Zero George Wilson Slides Video (2015)
Compressend Send and Receive Dan Kimmel Slides Video (2015)
Device Removal Matt Ahrens Slides Video (2014)
Parity Declustered RAID for ZFS (DRAID) Isaac Huang Slides Video (2015)
SPA Metadata Allocation Classes Don Brady Slides Video (2015)
Redacted send/receive Paul Dagnelie Slides Video (2015)
Persistent L2ARC and TRIM Saso Kiselkov Slides Video (2015)
SPA import and pool recovery Pavel Zakharov

Hackathon Ideas

Add your idea and your name below. Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.

Simpler hackathon projects

  • cppcheck errors (reported on mailing list, DLPX-47345)
  • ::metaslab_trace and ::metaslab_weight dcmds should be documented (DLPX-45762
  • break zfs/zpool manpages into one page per subcommand
  • zfs send —current-format
  • “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr))
  • more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
  • metaslab size can exceed offset addressable by spacemap (DLPX-39390)

Medium-size hackathon projects

  • zstd compression algo (saso)
  • storage pool checkpoint (DLPX-46652)
  • port "zpool iostat" enhancements from Linux to illumos/FreeBSD ZoL PR
  • add subcommand to wait for background zfs activity to complete (DLPX-44432)
  • compress last block of each object, even if compression is disabled (DLPX-42061)
  • store total # blocks on disk (of each type, in each ds, etc) (George W)
  • port "Backfill metadnode more intelligently" from Linux to illumos/FreeBSD ZoL PR
  • port large dnode support from Linux to illumos/FreeBSD ZoL PR
  • port SIMD-vectorized fletcher4 and RAIDZ code from Linux to illumos/FreeBSD
  • cross-platform compatibility layer (Paul D)
  • use refcount_t for v_count (fileystem-ey but not ZFS)
  • on-disk map from dataset GUID -> set of object IDs
  • scrub specific dataset
  • channel programs enhancements
    • open-context channel program
    • setting properties
    • new sync tasks
  • finish reviewing / push LZ4HC compression ZoL PR
  • allow receive of -L / -e / -c streams on systems with the required feature flags disabled
  • allow spacemap to represent larger range with one entry (increase entry size)

Backlog ideas

  • error counts in per-vdev object
  • scrub on readonly pool
  • “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
  • preferred allocation alignment (george)
  • promote prefetch reads to sync reads
  • runtime lock analyzer (like freebsd WITNESS)
  • test suite for system attributes
  • feature flags support for disabling inactive features
  • ZFS should prefer gethrtime() to ddi_get_lbolt()
  • create vdev in syncing context (with sync task)
  • Add interface for creating file with specific recordsize
  • does ::abuf_find still work?
  • JSON command output
  • zfs help command
  • zfs set print usage message specific to property you're trying to set
  • make zfs recv less trusting
  • convert some AVL trees to b-trees or hash tables
  • cross platform xattr

Sponsorship

A huge thank you for all the companies sponsoring the OpenZFS Developers Summit!

As an OpenZFS Dev Summit sponsor, you are providing critical support to our annual event, without which it would not be able to continue. Your generous contributions pay for the venue, food and beverage expenses, live streaming service, and other miscellaneous goods and services.

Harrasment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2015 page.