blob: 1444ecd40911ad3bc51c0ce66ee1a9e2d8733cd5 [file] [log] [blame]
Mike Rapoport3406bb52018-03-21 21:22:46 +02001.. _zswap:
2
3=====
4zswap
5=====
6
7Overview
8========
Seth Jennings61b0d762013-07-10 16:05:05 -07009
10Zswap is a lightweight compressed cache for swap pages. It takes pages that are
11in the process of being swapped out and attempts to compress them into a
12dynamically allocated RAM-based memory pool. zswap basically trades CPU cycles
13for potentially reduced swap I/O This trade-off can also result in a
14significant performance improvement if reads from the compressed cache are
15faster than reads from a swap device.
16
Mike Rapoport3406bb52018-03-21 21:22:46 +020017.. note::
18 Zswap is a new feature as of v3.11 and interacts heavily with memory
19 reclaim. This interaction has not been fully explored on the large set of
20 potential configurations and workloads that exist. For this reason, zswap
21 is a work in progress and should be considered experimental.
Seth Jennings61b0d762013-07-10 16:05:05 -070022
Mike Rapoport3406bb52018-03-21 21:22:46 +020023 Some potential benefits:
24
Seth Jennings61b0d762013-07-10 16:05:05 -070025* Desktop/laptop users with limited RAM capacities can mitigate the
Mike Rapoport3406bb52018-03-21 21:22:46 +020026 performance impact of swapping.
Seth Jennings61b0d762013-07-10 16:05:05 -070027* Overcommitted guests that share a common I/O resource can
Mike Rapoport3406bb52018-03-21 21:22:46 +020028 dramatically reduce their swap I/O pressure, avoiding heavy handed I/O
29 throttling by the hypervisorThis allows more work to get done with less
30 impact to the guest workload and guests sharing the I/O subsystem
Seth Jennings61b0d762013-07-10 16:05:05 -070031* Users with SSDs as swap devices can extend the life of the device by
Mike Rapoport3406bb52018-03-21 21:22:46 +020032 drastically reducing life-shortening writes.
Seth Jennings61b0d762013-07-10 16:05:05 -070033
34Zswap evicts pages from compressed cache on an LRU basis to the backing swap
Christian Hesse0151e3d2013-11-12 15:07:34 -080035device when the compressed pool reaches its size limit. This requirement had
Seth Jennings61b0d762013-07-10 16:05:05 -070036been identified in prior community discussions.
37
Dan Streetmanc00ed162015-06-25 15:00:35 -070038Zswap is disabled by default but can be enabled at boot time by setting
Mike Rapoport3406bb52018-03-21 21:22:46 +020039the ``enabled`` attribute to 1 at boot time. ie: ``zswap.enabled=1``. Zswap
Dan Streetmanc00ed162015-06-25 15:00:35 -070040can also be enabled and disabled at runtime using the sysfs interface.
41An example command to enable zswap at runtime, assuming sysfs is mounted
Mike Rapoport3406bb52018-03-21 21:22:46 +020042at ``/sys``, is::
Dan Streetmanc00ed162015-06-25 15:00:35 -070043
Mike Rapoport3406bb52018-03-21 21:22:46 +020044 echo 1 > /sys/module/zswap/parameters/enabled
Dan Streetmanc00ed162015-06-25 15:00:35 -070045
46When zswap is disabled at runtime it will stop storing pages that are
47being swapped out. However, it will _not_ immediately write out or fault
48back into memory all of the pages stored in the compressed pool. The
49pages stored in zswap will remain in the compressed pool until they are
50either invalidated or faulted back into memory. In order to force all
51pages out of the compressed pool, a swapoff on the swap device(s) will
52fault back into memory all swapped out pages, including those in the
53compressed pool.
Seth Jennings61b0d762013-07-10 16:05:05 -070054
Mike Rapoport3406bb52018-03-21 21:22:46 +020055Design
56======
Seth Jennings61b0d762013-07-10 16:05:05 -070057
58Zswap receives pages for compression through the Frontswap API and is able to
59evict pages from its own compressed pool on an LRU basis and write them back to
60the backing swap device in the case that the compressed pool is full.
61
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070062Zswap makes use of zpool for the managing the compressed memory pool. Each
63allocation in zpool is not directly accessible by address. Rather, a handle is
Christian Hesse0151e3d2013-11-12 15:07:34 -080064returned by the allocation routine and that handle must be mapped before being
Seth Jennings61b0d762013-07-10 16:05:05 -070065accessed. The compressed memory pool grows on demand and shrinks as compressed
Mike Rapoport3406bb52018-03-21 21:22:46 +020066pages are freed. The pool is not preallocated. By default, a zpool
67of type zbud is created, but it can be selected at boot time by
68setting the ``zpool`` attribute, e.g. ``zswap.zpool=zbud``. It can
69also be changed at runtime using the sysfs ``zpool`` attribute, e.g.::
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070070
Mike Rapoport3406bb52018-03-21 21:22:46 +020071 echo zbud > /sys/module/zswap/parameters/zpool
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070072
73The zbud type zpool allocates exactly 1 page to store 2 compressed pages, which
74means the compression ratio will always be 2:1 or worse (because of half-full
75zbud pages). The zsmalloc type zpool has a more complex compressed page
76storage method, and it can achieve greater storage densities. However,
77zsmalloc does not implement compressed page eviction, so once zswap fills it
78cannot evict the oldest page, it can only reject new pages.
Seth Jennings61b0d762013-07-10 16:05:05 -070079
80When a swap page is passed from frontswap to zswap, zswap maintains a mapping
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070081of the swap entry, a combination of the swap type and swap offset, to the zpool
Seth Jennings61b0d762013-07-10 16:05:05 -070082handle that references that compressed swap page. This mapping is achieved
83with a red-black tree per swap type. The swap offset is the search key for the
84tree nodes.
85
86During a page fault on a PTE that is a swap entry, frontswap calls the zswap
87load function to decompress the page into the page allocated by the page fault
88handler.
89
90Once there are no PTEs referencing a swap page stored in zswap (i.e. the count
91in the swap_map goes to 0) the swap code calls the zswap invalidate function,
92via frontswap, to free the compressed entry.
93
94Zswap seeks to be simple in its policies. Sysfs attributes allow for one user
Christian Hesse0151e3d2013-11-12 15:07:34 -080095controlled policy:
Mike Rapoport3406bb52018-03-21 21:22:46 +020096
Seth Jennings61b0d762013-07-10 16:05:05 -070097* max_pool_percent - The maximum percentage of memory that the compressed
Mike Rapoport3406bb52018-03-21 21:22:46 +020098 pool can occupy.
Seth Jennings61b0d762013-07-10 16:05:05 -070099
Mike Rapoport3406bb52018-03-21 21:22:46 +0200100The default compressor is lzo, but it can be selected at boot time by
101setting the ``compressor`` attribute, e.g. ``zswap.compressor=lzo``.
102It can also be changed at runtime using the sysfs "compressor"
103attribute, e.g.::
Dan Streetman9c4c5ef2015-09-09 15:35:25 -0700104
Mike Rapoport3406bb52018-03-21 21:22:46 +0200105 echo lzo > /sys/module/zswap/parameters/compressor
Dan Streetman9c4c5ef2015-09-09 15:35:25 -0700106
107When the zpool and/or compressor parameter is changed at runtime, any existing
108compressed pages are not modified; they are left in their own zpool. When a
109request is made for a page in an old zpool, it is uncompressed using its
110original compressor. Once all pages are removed from an old zpool, the zpool
111and its compressor are freed.
Seth Jennings61b0d762013-07-10 16:05:05 -0700112
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800113Some of the pages in zswap are same-value filled pages (i.e. contents of the
114page have same value or repetitive pattern). These pages include zero-filled
115pages and they are handled differently. During store operation, a page is
116checked if it is a same-value filled page before compressing it. If true, the
117compressed length of the page is set to zero and the pattern or same-filled
118value is stored.
119
120Same-value filled pages identification feature is enabled by default and can be
Mike Rapoport3406bb52018-03-21 21:22:46 +0200121disabled at boot time by setting the ``same_filled_pages_enabled`` attribute
122to 0, e.g. ``zswap.same_filled_pages_enabled=0``. It can also be enabled and
123disabled at runtime using the sysfs ``same_filled_pages_enabled``
124attribute, e.g.::
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800125
Mike Rapoport3406bb52018-03-21 21:22:46 +0200126 echo 1 > /sys/module/zswap/parameters/same_filled_pages_enabled
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800127
128When zswap same-filled page identification is disabled at runtime, it will stop
129checking for the same-value filled pages during store operation. However, the
130existing pages which are marked as same-value filled pages remain stored
131unchanged in zswap until they are either loaded or invalidated.
132
Seth Jennings61b0d762013-07-10 16:05:05 -0700133A debugfs interface is provided for various statistic about pool size, number
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800134of pages stored, same-value filled pages and various counters for the reasons
135pages are rejected.