mirror of
https://github.com/torvalds/linux.git
synced 2024-11-24 21:21:41 +00:00
c074e1467f
These knobs offer more fine-grained control to userspace than needed and
directly expose/influence kernel implementation; remove them.
For disabling same_filled handling, there is no logical reason to refuse
storing same-filled pages more efficiently and opt for compression.
Scanning pages for patterns may be an argument, but the page contents will
be read into the CPU cache anyway during compression. Also, removing the
same_filled handling code does not move the needle significantly in terms
of performance anyway [1].
For disabling non_same_filled handling, it was added when the compressed
pages in zswap were not being properly charged to memcgs, as workloads
could escape the accounting with compression [2]. This is no longer the
case after commit f4840ccfca
("zswap: memcg accounting"), and using
zswap without compression does not make much sense.
[1]https://lore.kernel.org/lkml/CAJD7tkaySFP2hBQw4pnZHJJwe3bMdjJ1t9VC2VJd=khn1_TXvA@mail.gmail.com/
[2]https://lore.kernel.org/lkml/19d5cdee-2868-41bd-83d5-6da75d72e940@maciej.szmigiero.name/
[yosryahmed@google.com: remove same_filled_pages from docs]
Link: https://lkml.kernel.org/r/ZhxFVggdyvCo79jc@google.com
Link: https://lkml.kernel.org/r/20240413022407.785696-5-yosryahmed@google.com
Signed-off-by: Yosry Ahmed <yosryahmed@google.com>
Acked-by: Johannes Weiner <hannes@cmpxchg.org>
Reviewed-by: Nhat Pham <nphamcs@gmail.com>
Reviewed-by: Chengming Zhou <chengming.zhou@linux.dev>
Cc: "Maciej S. Szmigiero" <mail@maciej.szmigiero.name>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
150 lines
6.9 KiB
ReStructuredText
150 lines
6.9 KiB
ReStructuredText
=====
|
|
zswap
|
|
=====
|
|
|
|
Overview
|
|
========
|
|
|
|
Zswap is a lightweight compressed cache for swap pages. It takes pages that are
|
|
in the process of being swapped out and attempts to compress them into a
|
|
dynamically allocated RAM-based memory pool. zswap basically trades CPU cycles
|
|
for potentially reduced swap I/O. This trade-off can also result in a
|
|
significant performance improvement if reads from the compressed cache are
|
|
faster than reads from a swap device.
|
|
|
|
Some potential benefits:
|
|
|
|
* Desktop/laptop users with limited RAM capacities can mitigate the
|
|
performance impact of swapping.
|
|
* Overcommitted guests that share a common I/O resource can
|
|
dramatically reduce their swap I/O pressure, avoiding heavy handed I/O
|
|
throttling by the hypervisor. This allows more work to get done with less
|
|
impact to the guest workload and guests sharing the I/O subsystem
|
|
* Users with SSDs as swap devices can extend the life of the device by
|
|
drastically reducing life-shortening writes.
|
|
|
|
Zswap evicts pages from compressed cache on an LRU basis to the backing swap
|
|
device when the compressed pool reaches its size limit. This requirement had
|
|
been identified in prior community discussions.
|
|
|
|
Whether Zswap is enabled at the boot time depends on whether
|
|
the ``CONFIG_ZSWAP_DEFAULT_ON`` Kconfig option is enabled or not.
|
|
This setting can then be overridden by providing the kernel command line
|
|
``zswap.enabled=`` option, for example ``zswap.enabled=0``.
|
|
Zswap can also be enabled and disabled at runtime using the sysfs interface.
|
|
An example command to enable zswap at runtime, assuming sysfs is mounted
|
|
at ``/sys``, is::
|
|
|
|
echo 1 > /sys/module/zswap/parameters/enabled
|
|
|
|
When zswap is disabled at runtime it will stop storing pages that are
|
|
being swapped out. However, it will _not_ immediately write out or fault
|
|
back into memory all of the pages stored in the compressed pool. The
|
|
pages stored in zswap will remain in the compressed pool until they are
|
|
either invalidated or faulted back into memory. In order to force all
|
|
pages out of the compressed pool, a swapoff on the swap device(s) will
|
|
fault back into memory all swapped out pages, including those in the
|
|
compressed pool.
|
|
|
|
Design
|
|
======
|
|
|
|
Zswap receives pages for compression from the swap subsystem and is able to
|
|
evict pages from its own compressed pool on an LRU basis and write them back to
|
|
the backing swap device in the case that the compressed pool is full.
|
|
|
|
Zswap makes use of zpool for the managing the compressed memory pool. Each
|
|
allocation in zpool is not directly accessible by address. Rather, a handle is
|
|
returned by the allocation routine and that handle must be mapped before being
|
|
accessed. The compressed memory pool grows on demand and shrinks as compressed
|
|
pages are freed. The pool is not preallocated. By default, a zpool
|
|
of type selected in ``CONFIG_ZSWAP_ZPOOL_DEFAULT`` Kconfig option is created,
|
|
but it can be overridden at boot time by setting the ``zpool`` attribute,
|
|
e.g. ``zswap.zpool=zbud``. It can also be changed at runtime using the sysfs
|
|
``zpool`` attribute, e.g.::
|
|
|
|
echo zbud > /sys/module/zswap/parameters/zpool
|
|
|
|
The zbud type zpool allocates exactly 1 page to store 2 compressed pages, which
|
|
means the compression ratio will always be 2:1 or worse (because of half-full
|
|
zbud pages). The zsmalloc type zpool has a more complex compressed page
|
|
storage method, and it can achieve greater storage densities.
|
|
|
|
When a swap page is passed from swapout to zswap, zswap maintains a mapping
|
|
of the swap entry, a combination of the swap type and swap offset, to the zpool
|
|
handle that references that compressed swap page. This mapping is achieved
|
|
with a red-black tree per swap type. The swap offset is the search key for the
|
|
tree nodes.
|
|
|
|
During a page fault on a PTE that is a swap entry, the swapin code calls the
|
|
zswap load function to decompress the page into the page allocated by the page
|
|
fault handler.
|
|
|
|
Once there are no PTEs referencing a swap page stored in zswap (i.e. the count
|
|
in the swap_map goes to 0) the swap code calls the zswap invalidate function
|
|
to free the compressed entry.
|
|
|
|
Zswap seeks to be simple in its policies. Sysfs attributes allow for one user
|
|
controlled policy:
|
|
|
|
* max_pool_percent - The maximum percentage of memory that the compressed
|
|
pool can occupy.
|
|
|
|
The default compressor is selected in ``CONFIG_ZSWAP_COMPRESSOR_DEFAULT``
|
|
Kconfig option, but it can be overridden at boot time by setting the
|
|
``compressor`` attribute, e.g. ``zswap.compressor=lzo``.
|
|
It can also be changed at runtime using the sysfs "compressor"
|
|
attribute, e.g.::
|
|
|
|
echo lzo > /sys/module/zswap/parameters/compressor
|
|
|
|
When the zpool and/or compressor parameter is changed at runtime, any existing
|
|
compressed pages are not modified; they are left in their own zpool. When a
|
|
request is made for a page in an old zpool, it is uncompressed using its
|
|
original compressor. Once all pages are removed from an old zpool, the zpool
|
|
and its compressor are freed.
|
|
|
|
Some of the pages in zswap are same-value filled pages (i.e. contents of the
|
|
page have same value or repetitive pattern). These pages include zero-filled
|
|
pages and they are handled differently. During store operation, a page is
|
|
checked if it is a same-value filled page before compressing it. If true, the
|
|
compressed length of the page is set to zero and the pattern or same-filled
|
|
value is stored.
|
|
|
|
To prevent zswap from shrinking pool when zswap is full and there's a high
|
|
pressure on swap (this will result in flipping pages in and out zswap pool
|
|
without any real benefit but with a performance drop for the system), a
|
|
special parameter has been introduced to implement a sort of hysteresis to
|
|
refuse taking pages into zswap pool until it has sufficient space if the limit
|
|
has been hit. To set the threshold at which zswap would start accepting pages
|
|
again after it became full, use the sysfs ``accept_threshold_percent``
|
|
attribute, e. g.::
|
|
|
|
echo 80 > /sys/module/zswap/parameters/accept_threshold_percent
|
|
|
|
Setting this parameter to 100 will disable the hysteresis.
|
|
|
|
Some users cannot tolerate the swapping that comes with zswap store failures
|
|
and zswap writebacks. Swapping can be disabled entirely (without disabling
|
|
zswap itself) on a cgroup-basis as follows::
|
|
|
|
echo 0 > /sys/fs/cgroup/<cgroup-name>/memory.zswap.writeback
|
|
|
|
Note that if the store failures are recurring (for e.g if the pages are
|
|
incompressible), users can observe reclaim inefficiency after disabling
|
|
writeback (because the same pages might be rejected again and again).
|
|
|
|
When there is a sizable amount of cold memory residing in the zswap pool, it
|
|
can be advantageous to proactively write these cold pages to swap and reclaim
|
|
the memory for other use cases. By default, the zswap shrinker is disabled.
|
|
User can enable it as follows::
|
|
|
|
echo Y > /sys/module/zswap/parameters/shrinker_enabled
|
|
|
|
This can be enabled at the boot time if ``CONFIG_ZSWAP_SHRINKER_DEFAULT_ON`` is
|
|
selected.
|
|
|
|
A debugfs interface is provided for various statistic about pool size, number
|
|
of pages stored, same-value filled pages and various counters for the reasons
|
|
pages are rejected.
|