Difference between revisions of "OpenZFS Developer Summit 2016"

From OpenZFS
Jump to navigation Jump to search
(typo)
 
(7 intermediate revisions by 3 users not shown)
Line 2: Line 2:
The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.
The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.


Check out the following blog posts about the event:
<ul>
<li>[https://www.delphix.com/blog/delphix-engineering/thank-you-openzfs-2016-developers-summit-sponsors Delphix Blog: Thank you OpenZFS 2016 Developers Summit Sponsors!]</li>
<li>[https://www.ixsystems.com/blog/openzfs-devsummit-2016/ iXsystems Blog: OpenZFS: Stronger Than Ever]</li>
</ul>


==Livestream==
You can watch the recorded livestream below.
<html>
<iframe id="ls_embed_1474574561" src="//livestream.com/accounts/15501788/events/6340478/player?width=640&height=360&enableInfoAndActivity=true&autoPlay=false&mute=false" width="640" height="360" frameborder="0" scrolling="no" allowfullscreen> </iframe><script type="text/javascript" data-embed_id="ls_embed_1474574561" src="//livestream.com/assets/plugins/referrer_tracking.js"></script>
</html>
Individual recordings of the talks will be posted on Youtube after the Summit.


==Thank You 2016 Sponsors!==
==Thank You 2016 Sponsors!==
Line 19: Line 15:
<div><ul>  
<div><ul>  
<li style="display: inline-block; padding-bottom: 70px;"> [[File: Delphix logo.png|170x150px|link=http://delphix.com | right | Delphix]] </li>
<li style="display: inline-block; padding-bottom: 70px;"> [[File: Delphix logo.png|170x150px|link=http://delphix.com | right | Delphix]] </li>
<li style="display: inline-block; padding: 20px;"> [[File: Intel.png|120x120px|link=http://www.high-availability.com/ | right | Intel ]]</li>
<li style="display: inline-block; padding: 20px;"> [[File: Intel.png|120x120px|link=http://www.intel.com/ | right | Intel ]]</li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: OsNexus.png|150x150px|link=http://www.osnexus.com/ | right | OSNexus ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: OsNexus.png|150x150px|link=http://www.osnexus.com/ | right | OSNexus ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: Nexenta.png|150x150px|link=http://www.nexenta.com/ | right | Nexenta ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: Nexenta.png|150x150px|link=http://www.nexenta.com/ | right | Nexenta ]] </li>
Line 39: Line 35:
<li style="display: inline-block; padding: 20px;"> [[File: canonical-ubuntu.png |150x150px|link=http://www.canonical.com/ | Canonical]] </li>
<li style="display: inline-block; padding: 20px;"> [[File: canonical-ubuntu.png |150x150px|link=http://www.canonical.com/ | Canonical]] </li>
</ul></div>
</ul></div>


==Presentations==
==Presentations==
Line 49: Line 44:
!Title!!Speaker!!Company!!Video!!Slides
!Title!!Speaker!!Company!!Video!!Slides
|-
|-
|State of the Union||Matt Ahrens||[http://www.delphix.com/ Delphix]||TBA||TBA
|State of the Union||Matt Ahrens||[http://www.delphix.com/ Delphix]||[https://youtu.be/CIJGUNDZ9yE Video]|| [https://drive.google.com/file/d/0B5hUzsxe4cdmcVpoR0N6cEJLeFU/view?usp=sharing Slides]
|-
|-
|Keynote||Dustin Kirkland||[http://canonical.com/ Canonical]||TBA||TBA
|Keynote||Dustin Kirkland||[http://canonical.com/ Canonical]||[https://youtu.be/nDmvwevnJNc Video]||N/A
|-
|-
|Lustre, Supercomputers, and ZFS||Brian Behlendorf||[http://llnl.gov LLNL]||TBA||TBA
|Lustre, Supercomputers, and ZFS||Brian Behlendorf||[http://llnl.gov LLNL]||[https://youtu.be/RoyrIocAByU Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmLVRwZy1WY19LYkE/view?usp=sharing Slides]
|-
|-
|[[ZFS and Containers]]||Michael Crogan|| ||TBA||TBA
|[[ZFS and Containers]]||Michael Crogan|| ||[https://youtu.be/HOCihVmsbwQ Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmbTRBXzZPN3BrbDQ/view?usp=sharing Slides]
|-
|-
|Channel Programs||Sara Hartse & Chris Williamson||[http://delphix.com Delphix]||TBA||TBA
|Channel Programs||Sara Hartse & Chris Williamson||[http://delphix.com Delphix]||[https://youtu.be/ogOwo4mZxMA Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmTVFUb2ItekRaU2s/view?usp=sharing Slides]
|-
|-
|ZFS First Mount||Mark Shellenbaum||[http://www.oracle.com Oracle]||TBA||TBA
|ZFS First Mount||Mark Shellenbaum||[http://www.oracle.com Oracle]||[https://youtu.be/xMH5rCL8S2k Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmT1lDS3JaUlhwc1E/view?usp=sharing Slides]
|-
|-
|[[Scrub/Resilver Performance]]||Saso Kiselkov||[http://www.nexenta.com/ Nexenta]||TBA||TBA
|[[Scrub/Resilver Performance]]||Saso Kiselkov||[http://www.nexenta.com/ Nexenta]||[https://youtu.be/SZFwv8BdBj4 Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmVU91cml1N0pKYTQ/view?usp=sharing Slides]
|-
|-
|[[ZFS-Native Encryption]]||Tom Caputi||[http://www.datto.com Datto]||TBA||TBA
|[[ZFS-Native Encryption]]||Tom Caputi||[http://www.datto.com Datto]||[https://youtu.be/frnLiXclAMo Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmU3ZTRXNxa2JIaDQ/view?usp=sharing Slides]
|-
|-
|[[Fault Management]]||Don Brady & Justin Gibbs||[http://www.intel.com/ Intel] & [https://www.freebsdfoundation.org/ FreeBSD Foundation]||TBA||TBA
|[[Fault Management]]||Don Brady & Justin Gibbs||[http://www.intel.com/ Intel] & [https://www.freebsdfoundation.org/ FreeBSD Foundation]||[https://youtu.be/zJbQiqdcpDg Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmeGFNRzZKV2J0blE/view?usp=sharing Slides]
|-
|-
|[[ZFS Validation & QA]]||Sydney Vanda & John Salinas||[http://www.intel.com/ Intel]||TBA||TBA
|[[ZFS Validation & QA]]||Sydney Vanda & John Salinas||[http://www.intel.com/ Intel]||[https://youtu.be/N0OZN8Z2IX0 Video]||[https://drive.google.com/file/d/0B5hUzsxe4cdmalBiay1EdHdMbWs/view?usp=sharing Slides]
|-
|-
|Closing||Matt Ahrens||[http://www.delphix.com/ Delphix]||TBA||TBA
|Closing||Matt Ahrens||[http://www.delphix.com/ Delphix]||[https://youtu.be/kn5xnqKehfY Video]||N/A
|}
|}


Line 85: Line 80:
|Eager Zero||George Wilson||[https://drive.google.com/file/d/0B4BF1vnv6p0-T21WN0N2N0pCY0E/view?usp=sharing Slides] [https://youtu.be/oVh6l4BTntw Video] (2015)
|Eager Zero||George Wilson||[https://drive.google.com/file/d/0B4BF1vnv6p0-T21WN0N2N0pCY0E/view?usp=sharing Slides] [https://youtu.be/oVh6l4BTntw Video] (2015)
|-
|-
|Compressend Send and Receive || Dan Kimmel||[https://drive.google.com/file/d/0B4BF1vnv6p0-cHZEeEJaZmNpZVE/view?usp=sharing Slides] [https://youtu.be/LaNgoAZeTww Video] (2015)
|Compressed Send and Receive || Dan Kimmel||[https://drive.google.com/file/d/0B4BF1vnv6p0-cHZEeEJaZmNpZVE/view?usp=sharing Slides] [https://youtu.be/LaNgoAZeTww Video] (2015)
|-
|-
|Device Removal || Matt Ahrens || [http://open-zfs.org/w/images/b/b4/Device_Removal-Alex_Reece_%26_Matt_Ahrens.pdf Slides] [http://www.youtube.com/watch?v=Xs6MsJ9kKKE&list=PLaUVvul17xSdOhJ-wDugoCAIPJZHloVoq&index=12 Video] (2014)
|Device Removal || Matt Ahrens || [http://open-zfs.org/w/images/b/b4/Device_Removal-Alex_Reece_%26_Matt_Ahrens.pdf Slides] [http://www.youtube.com/watch?v=Xs6MsJ9kKKE&list=PLaUVvul17xSdOhJ-wDugoCAIPJZHloVoq&index=12 Video] (2014)
Line 102: Line 97:
=== Hackathon Projects===
=== Hackathon Projects===


Congratulations to our 4 "best in show" winners, who received [http://www.intel.com/content/www/us/en/compute-stick/intel-compute-stick.html Intel Compute Sticks], donated by Intel.
* zpool checkpoint (Dan Kimmel, Serapheim Dimitropoulos).  Allows reverting the entire pool to a previous state.
* preferred ashift (George Wilson).  Allows dynamically switching to 4K sector aligned allocations
* zstd compression algo (Saso Kiselkov).  Better compression ratio & faster than zlib/gzip.
* testing encryption with Illumos debug kernel (Tom Caputi & Dan McDonald).  Using ::findleaks and kmem_flags=0xf to find bugs in encryption implementation
Thanks to everyone who participated at the hackathon!
* John Kennedy - zpool wait
* Pavel, Don, Steve, George - special metadata vdev classes
* Richard Elling - timing zil_replay
* Prakash - automated pull request testing for openzfs
* Alek P - async delete, port dnode backfill patch from Linux to OpenZFS
* Steven Burgess & Intel QA folks- platform-independent test suite changes
* Richard Laager - Linux pull requests, Ubuntu Root-on-ZFS HOWTO LUKS updates
* David Chen - ABD Linux code testing
* Alexander Motin - slog performance investigations
* Prashanth - large dnode from Linux to Illumos
* SMART data in pool stats
* ZoL buildbot check style
* Chris W - upstreaming channel programs
* Paul D - compatibility layer
* Matt - upstreaming device removal
* Jim Salter - Updating OpenZFS [[Roadmap]]
<!--
==== Simpler hackathon projects ====
==== Simpler hackathon projects ====
* cppcheck errors (reported on mailing list, DLPX-47345)
* cppcheck errors (reported on mailing list, DLPX-47345)
Line 152: Line 174:
* convert some AVL trees to b-trees or hash tables
* convert some AVL trees to b-trees or hash tables
* cross platform xattr
* cross platform xattr
-->


==Sponsorship==
==Sponsorship==

Latest revision as of 19:45, 27 June 2017

OpenZFS Dev Summit 2016

The fourth annual OpenZFS Developer Summit was held in San Francisco, California.

The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consists of a day of presentation and a 1-day hackathon.

Check out the following blog posts about the event:


Thank You 2016 Sponsors!

Platinum Sponsors

  • Delphix
  • Intel
  • OSNexus
  • Nexenta
  • datto

Gold Sponsors

  • Syneto
  • iXSystems

Silver Sponsors

  • FreeBSD Foundation
  • High Availability
  • Canonical

Presentations

Click on the title of the presentation for more details.

Title Speaker Company Video Slides
State of the Union Matt Ahrens Delphix Video Slides
Keynote Dustin Kirkland Canonical Video N/A
Lustre, Supercomputers, and ZFS Brian Behlendorf LLNL Video Slides
ZFS and Containers Michael Crogan Video Slides
Channel Programs Sara Hartse & Chris Williamson Delphix Video Slides
ZFS First Mount Mark Shellenbaum Oracle Video Slides
Scrub/Resilver Performance Saso Kiselkov Nexenta Video Slides
ZFS-Native Encryption Tom Caputi Datto Video Slides
Fault Management Don Brady & Justin Gibbs Intel & FreeBSD Foundation Video Slides
ZFS Validation & QA Sydney Vanda & John Salinas Intel Video Slides
Closing Matt Ahrens Delphix Video N/A

Hackathon

We had lightning (5 minute) updates on the following projects which have been discussed at previous conferences:

Title Speaker Previous Talk
ABD solves large/fragmented memory Dan Kimmel & David Chen Slides Video (2015)
Eager Zero George Wilson Slides Video (2015)
Compressed Send and Receive Dan Kimmel Slides Video (2015)
Device Removal Matt Ahrens Slides Video (2014)
Parity Declustered RAID for ZFS (DRAID) Isaac Huang Slides Video (2015)
SPA Metadata Allocation Classes Don Brady Slides Video (2015)
Redacted send/receive Paul Dagnelie Slides Video (2015)
Persistent L2ARC and TRIM Saso Kiselkov Slides Video (2015)
SPA import and pool recovery Pavel Zakharov

Hackathon Projects

Congratulations to our 4 "best in show" winners, who received Intel Compute Sticks, donated by Intel.

  • zpool checkpoint (Dan Kimmel, Serapheim Dimitropoulos). Allows reverting the entire pool to a previous state.
  • preferred ashift (George Wilson). Allows dynamically switching to 4K sector aligned allocations
  • zstd compression algo (Saso Kiselkov). Better compression ratio & faster than zlib/gzip.
  • testing encryption with Illumos debug kernel (Tom Caputi & Dan McDonald). Using ::findleaks and kmem_flags=0xf to find bugs in encryption implementation

Thanks to everyone who participated at the hackathon!

  • John Kennedy - zpool wait
  • Pavel, Don, Steve, George - special metadata vdev classes
  • Richard Elling - timing zil_replay
  • Prakash - automated pull request testing for openzfs
  • Alek P - async delete, port dnode backfill patch from Linux to OpenZFS
  • Steven Burgess & Intel QA folks- platform-independent test suite changes
  • Richard Laager - Linux pull requests, Ubuntu Root-on-ZFS HOWTO LUKS updates
  • David Chen - ABD Linux code testing
  • Alexander Motin - slog performance investigations
  • Prashanth - large dnode from Linux to Illumos
  • SMART data in pool stats
  • ZoL buildbot check style
  • Chris W - upstreaming channel programs
  • Paul D - compatibility layer
  • Matt - upstreaming device removal
  • Jim Salter - Updating OpenZFS Roadmap


Sponsorship

A huge thank you for all the companies sponsoring the OpenZFS Developers Summit!

As an OpenZFS Dev Summit sponsor, you are providing critical support to our annual event, without which it would not be able to continue. Your generous contributions pay for the venue, food and beverage expenses, live streaming service, and other miscellaneous goods and services.

Harrasment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2015 page.

Retrieved from "https://openzfs.org/w/index.php?title=OpenZFS_Developer_Summit_2016&oldid=2315"