Difference between revisions of "Main Page"

From OpenZFS
Jump to navigation Jump to search
(38 intermediate revisions by 3 users not shown)
Line 2: Line 2:
__NOTOC__
__NOTOC__


OpenZFS brings together developers and users from various open-source forks of the original ZFS on different platforms and we're always looking to grow our community. There are a multitude of ways to contribute to the project and contributors are happy to help newcomers. As we add diverse perspectives, our community becomes richer, and we're committed to creating an environment where all people feel welcome.  [[Newcomers | Information for new contributors is available here.]]
== [[OpenZFS Developer Summit 2020]] ==


 
The 2020 [[OpenZFS_Developer_Summit_2020 | OpenZFS Developer Conference]] was held October 6-7, as an online conference.
OpenZFS is an associated project of SPI ([https://www.spi-inc.org/projects/openzfs/ Software in the Public Interest]).  SPI is a 501(c)3 nonprofit organization which handles our donations, finances, and legal holdings.  You can donate to OpenZFS using the link below:
 
<html>
<form action="https://www.paypal.com/cgi-bin/webscr" method="post">
<fieldset>
<input type="hidden" name="cmd" value="_s-xclick" />
<input type="hidden" name="hosted_button_id" value="X6KB4BFPRFAG6" />
<input type="image" src="https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif" name="submit" alt="Donate to OpenZFS via PayPal" />
<img alt="" src="https://www.paypalobjects.com/en_US/i/scr/pixel.gif" width="1" height="1" />
</fieldset>
</form>
</html>
 
 
== Summary ==
 
OpenZFS was [[announcement | announced in September 2013]] as the truly '''open source''' successor to the [[History | ZFS project]]. Our community '''brings together developers''' from the illumos, FreeBSD, Linux, OS X and Windows [[distributions | platforms]], and a wide range of [[companies]] that build products on top of OpenZFS.
 
OpenZFS is an '''outstanding storage platform''' that encompasses the functionality of traditional filesystems, volume managers, and more, with consistent reliability, functionality and performance across all [[distributions]]:
 
{| class="wikitable"
| '''illumos'''
|[https://illumos.org/docs/about/features/ Webpage]
|[https://github.com/illumos/illumos-gate/ GitHub]
|-
| '''ZoF – ZFS on FreeBSD'''
|[https://zfsonfreebsd.github.io/ZoF/ Webpage]
|[https://github.com/zfsonfreebsd/ZoF GitHub]
|-
| '''ZoL – ZFS on Linux'''
|[http://zfsonlinux.org/ Webpage]
|[https://github.com/zfsonlinux/zfs/ GitHub]
|-
| '''OpenZFS on OS X'''
|[https://openzfsonosx.org/ Webpage]
|[https://github.com/openzfsonosx/ GitHub]
|-
| '''OpenZFS on Windows'''
|[https://openzfsonwindows.org/ Webpage]
|[https://github.com/openzfsonwindows/ GitHub]
|}
 
== [[OpenZFS Developer Summit 2019]] <-- click for more info ==
 
The seventh annual conference will be held on '''Nov 4-5, 2019''' in San Francisco, CA.
 
'''Register on [https://www.eventbrite.com/e/openzfs-developer-summit-2019-tickets-62373559997 eventbrite]'''
 
===Presentations===


{| class="wikitable"
{| class="wikitable"
|-
|-
!Title!!Speaker!!Company
!Title!!Speaker!!Company!!Presentation/Video
|-
|State of OpenZFS||Matt Ahrens||Delphix
|-
|Metaslab Allocation Performance||Paul Dagnelie||Delphix
|-
|Storage Configurator||Steven Umbehocker||OSNexus
|-
|Capacity Usage Calculator||Kody Kantor||Joyent
|-
|-
|OpenZFS Everywhere||Michael Dexter & Jorgen Lundman||
|State of OpenZFS||Matt Ahrens||Delphix||[https://docs.google.com/presentation/d/1BiQLUL7gPabTPvLciLMIOTXiPvWgWKCen57LmJT5tgc/edit?usp=sharing Slides] [https://youtu.be/na3wwRPUamk Video]
|-
|-
|Debugging ZFS: State of the Art on Linux|| Tom Caputi || Datto
|[[OpenZFS_Developer_Summit_2020_talks#ZFS_Caching:_How_Big_Is_the_ARC.3F_.28George_Wilson.29 | ZFS Caching: How Big Is the ARC?]]||George Wilson || Delphix || [https://drive.google.com/file/d/19th2JHeITp1Iefc-JffIDqn_4oy_JfVx/view?ts=5f7b7499 Slides] [https://youtu.be/3xKeUAmxvM8 Video]
|-
|-
|Debugging ZFS: From Illumos to Linux||Serapheim Dimitropoulos ||Delphix
|[[OpenZFS_Developer_Summit_2020_talks#Persistent_L2ARC_.28George_Amanakis.29 | Persistent L2ARC]]||George Amanakis||Independent||[https://drive.google.com/file/d/1N4drzhggcbgVZ36y5HyNdDuOXTsye1N_/view?usp=sharing Slides] [https://youtu.be/e_vVy_3HgVw Video]
|-
|-
|ZFS TRIM Explained||Brian Behlendorf||LLNL
|[[OpenZFS_Developer_Summit_2020_talks#ZIL_Design_Challenges_for_Fast_Media_.28Saji_Nair.29 | ZIL Performance Improvements for Fast Media]]||Saji Nair||Nutanix||[https://drive.google.com/file/d/1RqIteEdm_1O4xgT0FsMLK97AWMw2bpE-/view?usp=sharing Slides] [https://youtu.be/TnXwrigwF7I Video]
|-
|-
|Healing With ZFS Receive||Alek Pinchuk||Axcient
|[[OpenZFS_Developer_Summit_2020_talks#Sequential_Reconstruction_.28Mark_Maybee.29 | Sequential Reconstruction]]||Mark Maybee||Cray||[https://docs.google.com/presentation/d/1vLsgQ1MaHlifw40C9R2sPsSiHiQpxglxMbK2SMthu0Q/edit?usp=sharing Slides] [https://youtu.be/Efl0Kv_hXwY Video]
|-
|-
|libshare on Linux is Broken || George Wilson & Don Brady ||Delphix
|[[OpenZFS_Developer_Summit_2020_talks#dRAID.2C_Finally_.28With_a_New_Tile_Layout.29_.28Mark_Maybee.29 | dRAID, Finally!]]||Mark Maybee||Cray||[https://docs.google.com/presentation/d/1uo0nBfY84HIhEqGWEx-Tbm8fPbJKtIP3ICo4toOPcJo/edit?usp=sharing Slides] [https://youtu.be/jdXOtEF6Fh0 Video]
|-
|-
|VDEV Properties||Allan Jude||Klara Systems
|[[OpenZFS_Developer_Summit_2020_talks#Send.2FReceive_Performance_Enhancements_.28Matt_Ahrens.29 | Send/Receive Performance Enhancements]]||Matt Ahrens ||Delphix||[https://docs.google.com/presentation/d/1HuKHawQbuetqpbwp4wmfm6Ozj-WYJpPa6QAxgDxLsgk/edit?usp=sharing Slides] [https://youtu.be/p9VHwuCRPes Video]
|-
|-
|A Device by Any Other Name: <br>Common Pitfalls in Device Naming for ZFS on Linux||Sara Hartse & Don Brady||Delphix
|[[OpenZFS_Developer_Summit_2020_talks#Improved_.E2.80.9Czfs_diff.E2.80.9D_performance_with_reverse-name_lookup_.28Sanjeev_Bagewadi_.26_David_Chen.29 | Improving “zfs diff” performance with reverse-name lookup]]|| Sanjeev Bagewadi & David Chen || Nutanix||[https://drive.google.com/file/d/1t9O_KXa5aXxUwfXG6DvIMIetCOHzdH0Q/view?usp=sharing Slides] [https://youtu.be/FjMdn4IXKXE Video]
|-
|-
|Illumos Brings the SAS||Kody Kantor||Joyent
|[[OpenZFS_Developer_Summit_2020_talks#Performance_Troubleshooting_.28Gaurav_Kumar.29 | Performance Troubleshooting Tools]]||Gaurav Kumar|| Nutanix||[https://drive.google.com/file/d/1YzulcT7p7TvHF50aI-Rxg6CMZMIGnxL_/view?usp=sharing Slides] [https://youtu.be/1fnhpRGuY0s Video]
|-
|-
|Optimizing Filesystems for Multi-Actuator HDDs ||Muhammad Ahmad||Seagate
|[[OpenZFS_Developer_Summit_2020_talks#File_Cloning_with_Block_Reference_Table_.28Pawel_Dawidek.29 | File Cloning with Block Reference Table]]||Pawel Dawidek||Fudo Security||[https://drive.google.com/file/d/1csE8OuPotfhaFi9KvTGKMGy86KxrBu2W/view?usp=sharing Slides] [https://youtu.be/hYBgoaQC-vo Video]
|-
|-
|Hacking presentations, voting & awards||everyone||||[https://youtu.be/SjlQAqwLAOg Video]
|}
|}


===Diamond Sponsors===
* [[OpenZFS_Developer_Summit_2020_talks | Detailed description of each presentation]]
<div><ul>
* [https://docs.google.com/spreadsheets/d/1qH-qST3uSYVh7fzWHWIB1eM1y5rAYCQs6tRDjOhVYx0/edit#gid=0 OpenZFS 2020 Hackathon Ideas] spreadsheet
<li style="display: inline-block; padding: 20px;"> [[File: Datto_logo_2015.jpg|100px|link=http://www.datto.com/ | datto ]] </li>
<li style="display: inline-block; padding: 20px;"> [[File: Delphix logo.png|150px|link=http://www.delphix.com | Delphix]] </li>
<li style="display: inline-block; padding: 20px;"> [[File: Intel.png|80px|link=http://www.intel.com/ | Intel ]] </li>
<li style="display: inline-block; padding: 20px;">[[File: OsNexus.png|180x180px|link=http://www.osnexus.com/ | OSNEXUS ]] </li>
</ul></div>
 
== News ==
A [[Code of Conduct]] has been implemented for the OpenZFS community.


Matt Ahrens and George Wilson gave a talk on [https://www.socallinuxexpo.org/scale/16x/presentations/openzfs-basics OpenZFS Basics] at SCALE16x, March 2018.  [https://docs.google.com/presentation/d/1P2Q_eAgJH_6YorgTHDVgTZQfrBgtGs6VwLBvX7W23FA/edit?usp=sharing Slides] and [https://www.youtube.com/watch?v=MsY-BafQgj4 Video]
== Introduction to OpenZFS ==


The [http://zfs.datto.com/ ZFS User Conference] was held April 2018.  Videos now posted.
'''OpenZFS''' is an open-source storage platform. It includes the functionality of both traditional file systems and volume manager. It has many advanced [[Features | features]] including:
* Protection against data corruption. Integrity checking for both data and metadata.
* Continuous integrity verification and automatic “self-healing” repair
** Data redundancy with mirroring, RAID-Z1/2/3 [and DRAID]
* Support for high storage capacities — up to 256 trillion yobibytes (2^128 bytes)
* Space-saving with transparent compression using LZ4, GZIP or ZSTD
* Hardware-accelerated native encryption
* Efficient storage with snapshots and copy-on-write clones
* Efficient local or remote replication — send only changed blocks with ZFS send and receive


Matt Ahrens gave a talk at BSDCAN: [https://www.bsdcan.org/2018/schedule/events/960.en.html Flexible Disk Use in OpenZFS?], June 2018
== Contributing to OpenZFS ==
The OpenZFS project brings together developers from the Linux, FreeBSD, illumos, MacOS, and Windows platforms.  OpenZFS is supported by a wide range of companies.  


Sara Hartse gave a talk at BSDCAN: [https://www.bsdcan.org/2018/schedule/events/937.en.html 100x Faster Clone Deletion for ZFS], June 2018
There are many ways to contribute to OpenZFS including:
* OpenZFS uses [https://github.com/openzfs/zfs GitHub] to track [https://github.com/openzfs/zfs/issues bug reports] and [https://github.com/openzfs/zfs/pulls feature development]
* A monthly [https://docs.google.com/document/d/1w2jv2XVYFmBVvG1EGf-9A5HBVsjAYoLIFZAnWHhV-BM/edit OpenZFS Leadership Meeting] Zoom call to discussion active development
* The annual [[OpenZFS_Developer_Summit | OpenZFS Developer Summit]]


[[OpenZFS_Developer_Summit_2018 | OpenZFS Developer Summit]] was held September 10-11, 2018.
== Get Started with OpenZFS ==
[https://openzfs.github.io/openzfs-docs/Project%20and%20Community/FAQ.html Frequently Asked Questions]


The first [https://docs.google.com/document/d/1w2jv2XVYFmBVvG1EGf-9A5HBVsjAYoLIFZAnWHhV-BM/edit?ts=5bb3b66c# OpenZFS Leadership Meeting] will be held October 9, 2018
[[Newcomers | OpenZFS concepts]]


Matt Ahrens gave a talk at BSDCAN: [https://www.youtube.com/watch?v=NXg86uBDSqI How ZFS Snapshots Really Work] at BSDCAN, May 2019
A non-exhaustive list of [[Features | OpenZFS features]]


== Goals ==
== OpenZFS Technical Resources ==
[https://openzfs.github.io/openzfs-docs/Getting%20Started/index.html How to install OpenZFS]


The high-level goals of OpenZFS are:
[https://openzfs.github.io/openzfs-docs/man/index.html OpenZFS manual pages]
* to '''raise awareness''' of the quality, utility, and availability of open source implementations of ZFS
* to encourage '''open communication''' about ongoing efforts to improve open source ZFS
* to ensure '''consistent reliability''', functionality, and performance of all distributions of ZFS.


The main technical goal of OpenZFS is '''easier sharing of code''' between platforms. Strategies include:
Feature Details. Detailed subsystem/feature blogs, on-disk format specifications: [[Developer_resources | Developer Resources]]
* creating a platform-independent [[mailing list]] for developers to review ZFS code and architecture changes from all platforms
* smoothing the [[illumos integration process]]
* making it easy to run both ztest and the ZFS test suite (TestRunner or STF based) on each platform
* [[Reduce code differences | reducing code differences]] between the platforms.


== Donate ==
== Donate ==
Line 131: Line 74:
We accept donations to cover our ongoing costs.
We accept donations to cover our ongoing costs.


OpenZFS is an associated project of SPI ([https://www.spi-inc.org/projects/openzfs/ Software in the Public Interest]).  SPI is a 501(c)3 nonprofit organization which handles our donations, finances, and legal holdings.  You can donate through paypal using the link below:
OpenZFS is an associated project of SPI ([https://www.spi-inc.org/projects/openzfs/ Software in the Public Interest]).  SPI is a 501(c)(3) nonprofit organization which handles our donations, finances, and legal holdings.  You can donate through paypal using the link below:


<html>
<html>
<br>
<form action="https://www.paypal.com/cgi-bin/webscr" method="post">
<form action="https://www.paypal.com/cgi-bin/webscr" method="post">
<fieldset>
<input type="hidden" name="cmd" value="_s-xclick" />
<input type="hidden" name="cmd" value="_s-xclick" />
<input type="hidden" name="hosted_button_id" value="X6KB4BFPRFAG6" />
<input type="hidden" name="hosted_button_id" value="X6KB4BFPRFAG6" />
<input type="image" src="https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif" name="submit" alt="Donate to OpenZFS via PayPal" />
<input type="image" src="https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif" name="submit" alt="Donate to OpenZFS via PayPal" />
<img alt="" src="https://www.paypalobjects.com/en_US/i/scr/pixel.gif" width="1" height="1" />
<img alt="" src="https://www.paypalobjects.com/en_US/i/scr/pixel.gif" width="1" height="1" />
</fieldset>
</form>
</form>
<br>
</html>
</html>
== Site orientation ==
* [[FAQ]]
* How to [[participate]]
* [[Companies]] with products that are based on OpenZFS
* Download [[distributions]] that include OpenZFS
* [[Events]] – the forthcoming [[OpenZFS Developer Summit]] and more
* [[Developer resources]]
** [[mailing list]]
** [[illumos integration process]]
** [[contributors]]
** [[platform code differences]]
** [[OpenZFS Office Hours]]
** implementation
*** [[Documentation/ZfsSend | ZFS send]]
*** [[Documentation/Administrative Commands | administrative commands]]
* [[System Administration|Documentation]] for users/sysadmins
** [[features]]
** [[Feature Flags| feature flags]]
** [[Publications| publications and conference talks]]
** [[history]] – from ZFS to OpenZFS
*** OpenZFS launch [[announcement]] – September 2013
** [[performance tuning]]
* [[Projects]]
** [[reduce code differences]]
** the [[Projects/ZFS Channel Programs | ZFS Channel Programs]] (ZCP) proposal
* [[About OpenZFS]]
[http://open-zfs.org/w/index.php?title=Special%3AAllPages&from=&to=&namespace=0&hideredirects=1 All main pages] (alphabetical order) …


== Twitter ==
== Twitter ==


<html>
<html>
<a class="twitter-timeline" width="720" height="437" href="https://twitter.com/OpenZFS" data-widget-id="378639669799288832">Tweets by @OpenZFS</a>
<a class="twitter-timeline" width="720" height="437" href="https://twitter.com/OpenZFS" data-widget-id="378639669799288832"> @OpenZFS</a>
<script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+"://platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs");</script>
<script>!function(d,s,id){var js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+"://platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs");</script>



Revision as of 20:15, 15 October 2020

Welcome to OpenZFS

OpenZFS Developer Summit 2020

The 2020 OpenZFS Developer Conference was held October 6-7, as an online conference.

Title Speaker Company Presentation/Video
State of OpenZFS Matt Ahrens Delphix Slides Video
ZFS Caching: How Big Is the ARC? George Wilson Delphix Slides Video
Persistent L2ARC George Amanakis Independent Slides Video
ZIL Performance Improvements for Fast Media Saji Nair Nutanix Slides Video
Sequential Reconstruction Mark Maybee Cray Slides Video
dRAID, Finally! Mark Maybee Cray Slides Video
Send/Receive Performance Enhancements Matt Ahrens Delphix Slides Video
Improving “zfs diff” performance with reverse-name lookup Sanjeev Bagewadi & David Chen Nutanix Slides Video
Performance Troubleshooting Tools Gaurav Kumar Nutanix Slides Video
File Cloning with Block Reference Table Pawel Dawidek Fudo Security Slides Video
Hacking presentations, voting & awards everyone Video

Introduction to OpenZFS

OpenZFS is an open-source storage platform. It includes the functionality of both traditional file systems and volume manager. It has many advanced features including:

  • Protection against data corruption. Integrity checking for both data and metadata.
  • Continuous integrity verification and automatic “self-healing” repair
    • Data redundancy with mirroring, RAID-Z1/2/3 [and DRAID]
  • Support for high storage capacities — up to 256 trillion yobibytes (2^128 bytes)
  • Space-saving with transparent compression using LZ4, GZIP or ZSTD
  • Hardware-accelerated native encryption
  • Efficient storage with snapshots and copy-on-write clones
  • Efficient local or remote replication — send only changed blocks with ZFS send and receive

Contributing to OpenZFS

The OpenZFS project brings together developers from the Linux, FreeBSD, illumos, MacOS, and Windows platforms. OpenZFS is supported by a wide range of companies.

There are many ways to contribute to OpenZFS including:

Get Started with OpenZFS

Frequently Asked Questions

OpenZFS concepts

A non-exhaustive list of OpenZFS features

OpenZFS Technical Resources

How to install OpenZFS

OpenZFS manual pages

Feature Details. Detailed subsystem/feature blogs, on-disk format specifications: Developer Resources

We accept donations to cover our ongoing costs.

OpenZFS is an associated project of SPI (Software in the Public Interest). SPI is a 501(c)(3) nonprofit organization which handles our donations, finances, and legal holdings. You can donate through paypal using the link below:



Twitter