blob: f8c6a79d7c701e043cb4f2798db9c94aaccf9ec5 [file] [log] [blame]
Mike Rapoport3406bb52018-03-21 21:22:46 +02001.. _zswap:
2
3=====
4zswap
5=====
6
7Overview
8========
Seth Jennings61b0d762013-07-10 16:05:05 -07009
10Zswap is a lightweight compressed cache for swap pages. It takes pages that are
11in the process of being swapped out and attempts to compress them into a
12dynamically allocated RAM-based memory pool. zswap basically trades CPU cycles
13for potentially reduced swap I/O This trade-off can also result in a
14significant performance improvement if reads from the compressed cache are
15faster than reads from a swap device.
16
Mike Rapoport3406bb52018-03-21 21:22:46 +020017.. note::
18 Zswap is a new feature as of v3.11 and interacts heavily with memory
19 reclaim. This interaction has not been fully explored on the large set of
20 potential configurations and workloads that exist. For this reason, zswap
21 is a work in progress and should be considered experimental.
Seth Jennings61b0d762013-07-10 16:05:05 -070022
Mike Rapoport3406bb52018-03-21 21:22:46 +020023 Some potential benefits:
24
Seth Jennings61b0d762013-07-10 16:05:05 -070025* Desktop/laptop users with limited RAM capacities can mitigate the
Mike Rapoport3406bb52018-03-21 21:22:46 +020026 performance impact of swapping.
Seth Jennings61b0d762013-07-10 16:05:05 -070027* Overcommitted guests that share a common I/O resource can
Mike Rapoport3406bb52018-03-21 21:22:46 +020028 dramatically reduce their swap I/O pressure, avoiding heavy handed I/O
29 throttling by the hypervisorThis allows more work to get done with less
30 impact to the guest workload and guests sharing the I/O subsystem
Seth Jennings61b0d762013-07-10 16:05:05 -070031* Users with SSDs as swap devices can extend the life of the device by
Mike Rapoport3406bb52018-03-21 21:22:46 +020032 drastically reducing life-shortening writes.
Seth Jennings61b0d762013-07-10 16:05:05 -070033
34Zswap evicts pages from compressed cache on an LRU basis to the backing swap
Christian Hesse0151e3d2013-11-12 15:07:34 -080035device when the compressed pool reaches its size limit. This requirement had
Seth Jennings61b0d762013-07-10 16:05:05 -070036been identified in prior community discussions.
37
Maciej S. Szmigierobb8b93b2020-04-06 20:08:03 -070038Whether Zswap is enabled at the boot time depends on whether
39the ``CONFIG_ZSWAP_DEFAULT_ON`` Kconfig option is enabled or not.
40This setting can then be overridden by providing the kernel command line
41``zswap.enabled=`` option, for example ``zswap.enabled=0``.
42Zswap can also be enabled and disabled at runtime using the sysfs interface.
Dan Streetmanc00ed162015-06-25 15:00:35 -070043An example command to enable zswap at runtime, assuming sysfs is mounted
Mike Rapoport3406bb52018-03-21 21:22:46 +020044at ``/sys``, is::
Dan Streetmanc00ed162015-06-25 15:00:35 -070045
Mike Rapoport3406bb52018-03-21 21:22:46 +020046 echo 1 > /sys/module/zswap/parameters/enabled
Dan Streetmanc00ed162015-06-25 15:00:35 -070047
48When zswap is disabled at runtime it will stop storing pages that are
49being swapped out. However, it will _not_ immediately write out or fault
50back into memory all of the pages stored in the compressed pool. The
51pages stored in zswap will remain in the compressed pool until they are
52either invalidated or faulted back into memory. In order to force all
53pages out of the compressed pool, a swapoff on the swap device(s) will
54fault back into memory all swapped out pages, including those in the
55compressed pool.
Seth Jennings61b0d762013-07-10 16:05:05 -070056
Mike Rapoport3406bb52018-03-21 21:22:46 +020057Design
58======
Seth Jennings61b0d762013-07-10 16:05:05 -070059
60Zswap receives pages for compression through the Frontswap API and is able to
61evict pages from its own compressed pool on an LRU basis and write them back to
62the backing swap device in the case that the compressed pool is full.
63
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070064Zswap makes use of zpool for the managing the compressed memory pool. Each
65allocation in zpool is not directly accessible by address. Rather, a handle is
Christian Hesse0151e3d2013-11-12 15:07:34 -080066returned by the allocation routine and that handle must be mapped before being
Seth Jennings61b0d762013-07-10 16:05:05 -070067accessed. The compressed memory pool grows on demand and shrinks as compressed
Mike Rapoport3406bb52018-03-21 21:22:46 +020068pages are freed. The pool is not preallocated. By default, a zpool
Maciej S. Szmigierobb8b93b2020-04-06 20:08:03 -070069of type selected in ``CONFIG_ZSWAP_ZPOOL_DEFAULT`` Kconfig option is created,
70but it can be overridden at boot time by setting the ``zpool`` attribute,
71e.g. ``zswap.zpool=zbud``. It can also be changed at runtime using the sysfs
72``zpool`` attribute, e.g.::
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070073
Mike Rapoport3406bb52018-03-21 21:22:46 +020074 echo zbud > /sys/module/zswap/parameters/zpool
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070075
76The zbud type zpool allocates exactly 1 page to store 2 compressed pages, which
77means the compression ratio will always be 2:1 or worse (because of half-full
78zbud pages). The zsmalloc type zpool has a more complex compressed page
79storage method, and it can achieve greater storage densities. However,
80zsmalloc does not implement compressed page eviction, so once zswap fills it
81cannot evict the oldest page, it can only reject new pages.
Seth Jennings61b0d762013-07-10 16:05:05 -070082
83When a swap page is passed from frontswap to zswap, zswap maintains a mapping
Dan Streetman9c4c5ef2015-09-09 15:35:25 -070084of the swap entry, a combination of the swap type and swap offset, to the zpool
Seth Jennings61b0d762013-07-10 16:05:05 -070085handle that references that compressed swap page. This mapping is achieved
86with a red-black tree per swap type. The swap offset is the search key for the
87tree nodes.
88
89During a page fault on a PTE that is a swap entry, frontswap calls the zswap
90load function to decompress the page into the page allocated by the page fault
91handler.
92
93Once there are no PTEs referencing a swap page stored in zswap (i.e. the count
94in the swap_map goes to 0) the swap code calls the zswap invalidate function,
95via frontswap, to free the compressed entry.
96
97Zswap seeks to be simple in its policies. Sysfs attributes allow for one user
Christian Hesse0151e3d2013-11-12 15:07:34 -080098controlled policy:
Mike Rapoport3406bb52018-03-21 21:22:46 +020099
Seth Jennings61b0d762013-07-10 16:05:05 -0700100* max_pool_percent - The maximum percentage of memory that the compressed
Mike Rapoport3406bb52018-03-21 21:22:46 +0200101 pool can occupy.
Seth Jennings61b0d762013-07-10 16:05:05 -0700102
Maciej S. Szmigierobb8b93b2020-04-06 20:08:03 -0700103The default compressor is selected in ``CONFIG_ZSWAP_COMPRESSOR_DEFAULT``
104Kconfig option, but it can be overridden at boot time by setting the
105``compressor`` attribute, e.g. ``zswap.compressor=lzo``.
Mike Rapoport3406bb52018-03-21 21:22:46 +0200106It can also be changed at runtime using the sysfs "compressor"
107attribute, e.g.::
Dan Streetman9c4c5ef2015-09-09 15:35:25 -0700108
Mike Rapoport3406bb52018-03-21 21:22:46 +0200109 echo lzo > /sys/module/zswap/parameters/compressor
Dan Streetman9c4c5ef2015-09-09 15:35:25 -0700110
111When the zpool and/or compressor parameter is changed at runtime, any existing
112compressed pages are not modified; they are left in their own zpool. When a
113request is made for a page in an old zpool, it is uncompressed using its
114original compressor. Once all pages are removed from an old zpool, the zpool
115and its compressor are freed.
Seth Jennings61b0d762013-07-10 16:05:05 -0700116
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800117Some of the pages in zswap are same-value filled pages (i.e. contents of the
118page have same value or repetitive pattern). These pages include zero-filled
119pages and they are handled differently. During store operation, a page is
120checked if it is a same-value filled page before compressing it. If true, the
121compressed length of the page is set to zero and the pattern or same-filled
122value is stored.
123
124Same-value filled pages identification feature is enabled by default and can be
Mike Rapoport3406bb52018-03-21 21:22:46 +0200125disabled at boot time by setting the ``same_filled_pages_enabled`` attribute
126to 0, e.g. ``zswap.same_filled_pages_enabled=0``. It can also be enabled and
127disabled at runtime using the sysfs ``same_filled_pages_enabled``
128attribute, e.g.::
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800129
Mike Rapoport3406bb52018-03-21 21:22:46 +0200130 echo 1 > /sys/module/zswap/parameters/same_filled_pages_enabled
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800131
132When zswap same-filled page identification is disabled at runtime, it will stop
133checking for the same-value filled pages during store operation. However, the
134existing pages which are marked as same-value filled pages remain stored
135unchanged in zswap until they are either loaded or invalidated.
136
Vitaly Wool45190f02020-01-30 22:15:04 -0800137To prevent zswap from shrinking pool when zswap is full and there's a high
138pressure on swap (this will result in flipping pages in and out zswap pool
139without any real benefit but with a performance drop for the system), a
140special parameter has been introduced to implement a sort of hysteresis to
141refuse taking pages into zswap pool until it has sufficient space if the limit
142has been hit. To set the threshold at which zswap would start accepting pages
143again after it became full, use the sysfs ``accept_threhsold_percent``
144attribute, e. g.::
145
146 echo 80 > /sys/module/zswap/parameters/accept_threhsold_percent
147
148Setting this parameter to 100 will disable the hysteresis.
149
Seth Jennings61b0d762013-07-10 16:05:05 -0700150A debugfs interface is provided for various statistic about pool size, number
Srividya Desireddy51f73ff2017-12-14 15:32:45 -0800151of pages stored, same-value filled pages and various counters for the reasons
152pages are rejected.