Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 1 | .. SPDX-License-Identifier: GPL-2.0 |
| 2 | |
| 3 | ========================================== |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 4 | WHAT IS Flash-Friendly File System (F2FS)? |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 5 | ========================================== |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 6 | |
| 7 | NAND flash memory-based storage devices, such as SSD, eMMC, and SD cards, have |
| 8 | been equipped on a variety systems ranging from mobile to server systems. Since |
| 9 | they are known to have different characteristics from the conventional rotating |
| 10 | disks, a file system, an upper layer to the storage device, should adapt to the |
| 11 | changes from the sketch in the design level. |
| 12 | |
| 13 | F2FS is a file system exploiting NAND flash memory-based storage devices, which |
| 14 | is based on Log-structured File System (LFS). The design has been focused on |
| 15 | addressing the fundamental issues in LFS, which are snowball effect of wandering |
| 16 | tree and high cleaning overhead. |
| 17 | |
| 18 | Since a NAND flash memory-based storage device shows different characteristic |
| 19 | according to its internal geometry or flash memory management scheme, namely FTL, |
| 20 | F2FS and its tools support various parameters not only for configuring on-disk |
| 21 | layout, but also for selecting allocation and cleaning algorithms. |
| 22 | |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 23 | The following git tree provides the file system formatting tool (mkfs.f2fs), |
| 24 | a consistency checking tool (fsck.f2fs), and a debugging tool (dump.f2fs). |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 25 | |
| 26 | - git://git.kernel.org/pub/scm/linux/kernel/git/jaegeuk/f2fs-tools.git |
Jaegeuk Kim | 5bb446a | 2012-11-27 14:36:14 +0900 | [diff] [blame] | 27 | |
| 28 | For reporting bugs and sending patches, please use the following mailing list: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 29 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 30 | - linux-f2fs-devel@lists.sourceforge.net |
| 31 | |
| 32 | Background and Design issues |
| 33 | ============================ |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 34 | |
| 35 | Log-structured File System (LFS) |
| 36 | -------------------------------- |
| 37 | "A log-structured file system writes all modifications to disk sequentially in |
| 38 | a log-like structure, thereby speeding up both file writing and crash recovery. |
| 39 | The log is the only structure on disk; it contains indexing information so that |
| 40 | files can be read back from the log efficiently. In order to maintain large free |
| 41 | areas on disk for fast writing, we divide the log into segments and use a |
| 42 | segment cleaner to compress the live information from heavily fragmented |
| 43 | segments." from Rosenblum, M. and Ousterhout, J. K., 1992, "The design and |
| 44 | implementation of a log-structured file system", ACM Trans. Computer Systems |
| 45 | 10, 1, 26–52. |
| 46 | |
| 47 | Wandering Tree Problem |
| 48 | ---------------------- |
| 49 | In LFS, when a file data is updated and written to the end of log, its direct |
| 50 | pointer block is updated due to the changed location. Then the indirect pointer |
| 51 | block is also updated due to the direct pointer block update. In this manner, |
| 52 | the upper index structures such as inode, inode map, and checkpoint block are |
| 53 | also updated recursively. This problem is called as wandering tree problem [1], |
| 54 | and in order to enhance the performance, it should eliminate or relax the update |
| 55 | propagation as much as possible. |
| 56 | |
| 57 | [1] Bityutskiy, A. 2005. JFFS3 design issues. http://www.linux-mtd.infradead.org/ |
| 58 | |
| 59 | Cleaning Overhead |
| 60 | ----------------- |
| 61 | Since LFS is based on out-of-place writes, it produces so many obsolete blocks |
| 62 | scattered across the whole storage. In order to serve new empty log space, it |
| 63 | needs to reclaim these obsolete blocks seamlessly to users. This job is called |
| 64 | as a cleaning process. |
| 65 | |
| 66 | The process consists of three operations as follows. |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 67 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 68 | 1. A victim segment is selected through referencing segment usage table. |
| 69 | 2. It loads parent index structures of all the data in the victim identified by |
| 70 | segment summary blocks. |
| 71 | 3. It checks the cross-reference between the data and its parent index structure. |
| 72 | 4. It moves valid data selectively. |
| 73 | |
| 74 | This cleaning job may cause unexpected long delays, so the most important goal |
| 75 | is to hide the latencies to users. And also definitely, it should reduce the |
| 76 | amount of valid data to be moved, and move them quickly as well. |
| 77 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 78 | Key Features |
| 79 | ============ |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 80 | |
| 81 | Flash Awareness |
| 82 | --------------- |
| 83 | - Enlarge the random write area for better performance, but provide the high |
| 84 | spatial locality |
| 85 | - Align FS data structures to the operational units in FTL as best efforts |
| 86 | |
| 87 | Wandering Tree Problem |
| 88 | ---------------------- |
| 89 | - Use a term, “node”, that represents inodes as well as various pointer blocks |
| 90 | - Introduce Node Address Table (NAT) containing the locations of all the “node” |
| 91 | blocks; this will cut off the update propagation. |
| 92 | |
| 93 | Cleaning Overhead |
| 94 | ----------------- |
| 95 | - Support a background cleaning process |
| 96 | - Support greedy and cost-benefit algorithms for victim selection policies |
| 97 | - Support multi-head logs for static/dynamic hot and cold data separation |
| 98 | - Introduce adaptive logging for efficient block allocation |
| 99 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 100 | Mount Options |
| 101 | ============= |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 102 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 103 | |
| 104 | ====================== ============================================================ |
Namjae Jeon | 696c018 | 2013-06-16 09:48:48 +0900 | [diff] [blame] | 105 | background_gc=%s Turn on/off cleaning operations, namely garbage |
| 106 | collection, triggered in background when I/O subsystem is |
| 107 | idle. If background_gc=on, it will turn on the garbage |
| 108 | collection and if background_gc=off, garbage collection |
Masanari Iida | 4bb9998 | 2015-11-16 20:46:28 +0900 | [diff] [blame] | 109 | will be turned off. If background_gc=sync, it will turn |
Jaegeuk Kim | 6aefd93 | 2015-10-05 11:02:54 -0700 | [diff] [blame] | 110 | on synchronous garbage collection running in background. |
Namjae Jeon | 696c018 | 2013-06-16 09:48:48 +0900 | [diff] [blame] | 111 | Default value for this option is on. So garbage |
| 112 | collection is on by default. |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 113 | disable_roll_forward Disable the roll-forward recovery routine |
Jaegeuk Kim | 2d834bf | 2015-01-23 18:33:46 -0800 | [diff] [blame] | 114 | norecovery Disable the roll-forward recovery routine, mounted read- |
| 115 | only (i.e., -o ro,disable_roll_forward) |
Chao Yu | 64058be | 2016-07-03 22:05:14 +0800 | [diff] [blame] | 116 | discard/nodiscard Enable/disable real-time discard in f2fs, if discard is |
| 117 | enabled, f2fs will issue discard/TRIM commands when a |
| 118 | segment is cleaned. |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 119 | no_heap Disable heap-style segment allocation which finds free |
| 120 | segments for data from the beginning of main area, while |
| 121 | for node from the end of main area. |
| 122 | nouser_xattr Disable Extended User Attributes. Note: xattr is enabled |
| 123 | by default if CONFIG_F2FS_FS_XATTR is selected. |
| 124 | noacl Disable POSIX Access Control List. Note: acl is enabled |
| 125 | by default if CONFIG_F2FS_FS_POSIX_ACL is selected. |
| 126 | active_logs=%u Support configuring the number of active logs. In the |
| 127 | current design, f2fs supports only 2, 4, and 6 logs. |
| 128 | Default number is 6. |
| 129 | disable_ext_identify Disable the extension list configured by mkfs, so f2fs |
| 130 | does not aware of cold files such as media files. |
Jaegeuk Kim | 66e960c | 2013-11-01 11:20:05 +0900 | [diff] [blame] | 131 | inline_xattr Enable the inline xattrs feature. |
Chao Yu | 23cf721 | 2017-02-15 10:34:45 +0800 | [diff] [blame] | 132 | noinline_xattr Disable the inline xattrs feature. |
Chao Yu | 7321dd9 | 2019-01-24 17:18:07 +0800 | [diff] [blame] | 133 | inline_xattr_size=%u Support configuring inline xattr size, it depends on |
| 134 | flexible inline xattr feature. |
Huajun Li | e4024e8 | 2013-11-10 23:13:21 +0800 | [diff] [blame] | 135 | inline_data Enable the inline data feature: New created small(<~3.4k) |
| 136 | files can be written into inode block. |
Chao Yu | d37a868 | 2014-09-24 18:20:23 +0800 | [diff] [blame] | 137 | inline_dentry Enable the inline dir feature: data in new created |
| 138 | directory entries can be written into inode block. The |
| 139 | space of inode block which is used to store inline |
| 140 | dentries is limited to ~3.4k. |
Masanari Iida | 04b9a5f | 2017-01-24 12:47:55 +0900 | [diff] [blame] | 141 | noinline_dentry Disable the inline dentry feature. |
Jaegeuk Kim | 6b4afdd | 2014-04-02 15:34:36 +0900 | [diff] [blame] | 142 | flush_merge Merge concurrent cache_flush commands as much as possible |
| 143 | to eliminate redundant command issues. If the underlying |
| 144 | device handles the cache_flush command relatively slowly, |
| 145 | recommend to enable this option. |
Jaegeuk Kim | 0f7b2ab | 2014-07-23 09:57:31 -0700 | [diff] [blame] | 146 | nobarrier This option can be used if underlying storage guarantees |
| 147 | its cached data should be written to the novolatile area. |
| 148 | If this option is set, no cache_flush commands are issued |
| 149 | but f2fs still guarantees the write ordering of all the |
| 150 | data writes. |
Jaegeuk Kim | d5053a34 | 2014-10-30 22:47:03 -0700 | [diff] [blame] | 151 | fastboot This option is used when a system wants to reduce mount |
| 152 | time as much as possible, even though normal performance |
| 153 | can be sacrificed. |
Chao Yu | 8967215 | 2015-02-05 17:55:51 +0800 | [diff] [blame] | 154 | extent_cache Enable an extent cache based on rb-tree, it can cache |
| 155 | as many as extent which map between contiguous logical |
| 156 | address and physical address per inode, resulting in |
Jaegeuk Kim | 7daaea2 | 2015-06-25 17:43:04 -0700 | [diff] [blame] | 157 | increasing the cache hit ratio. Set by default. |
Masanari Iida | 4bb9998 | 2015-11-16 20:46:28 +0900 | [diff] [blame] | 158 | noextent_cache Disable an extent cache based on rb-tree explicitly, see |
Jaegeuk Kim | 7daaea2 | 2015-06-25 17:43:04 -0700 | [diff] [blame] | 159 | the above extent_cache mount option. |
Wanpeng Li | 7534279 | 2015-03-24 10:20:27 +0800 | [diff] [blame] | 160 | noinline_data Disable the inline data feature, inline data feature is |
| 161 | enabled by default. |
Chao Yu | 343f40f | 2015-12-16 13:12:16 +0800 | [diff] [blame] | 162 | data_flush Enable data flushing before checkpoint in order to |
| 163 | persist data of regular and symlink. |
Chao Yu | d0995b5 | 2019-08-27 18:17:55 +0800 | [diff] [blame] | 164 | reserve_root=%d Support configuring reserved space which is used for |
| 165 | allocation from a privileged user with specified uid or |
| 166 | gid, unit: 4KB, the default limit is 0.2% of user blocks. |
| 167 | resuid=%d The user ID which may use the reserved blocks. |
| 168 | resgid=%d The group ID which may use the reserved blocks. |
Chao Yu | 5641289 | 2017-06-12 22:30:44 +0800 | [diff] [blame] | 169 | fault_injection=%d Enable fault injection in all supported types with |
| 170 | specified injection rate. |
Chao Yu | d494500 | 2018-08-08 17:36:41 +0800 | [diff] [blame] | 171 | fault_type=%d Support configuring fault injection type, should be |
| 172 | enabled with fault_injection option, fault type value |
| 173 | is shown below, it supports single or combined type. |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 174 | |
| 175 | =================== =========== |
Chao Yu | d494500 | 2018-08-08 17:36:41 +0800 | [diff] [blame] | 176 | Type_Name Type_Value |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 177 | =================== =========== |
Chao Yu | d494500 | 2018-08-08 17:36:41 +0800 | [diff] [blame] | 178 | FAULT_KMALLOC 0x000000001 |
| 179 | FAULT_KVMALLOC 0x000000002 |
| 180 | FAULT_PAGE_ALLOC 0x000000004 |
| 181 | FAULT_PAGE_GET 0x000000008 |
| 182 | FAULT_ALLOC_BIO 0x000000010 |
| 183 | FAULT_ALLOC_NID 0x000000020 |
| 184 | FAULT_ORPHAN 0x000000040 |
| 185 | FAULT_BLOCK 0x000000080 |
| 186 | FAULT_DIR_DEPTH 0x000000100 |
| 187 | FAULT_EVICT_INODE 0x000000200 |
| 188 | FAULT_TRUNCATE 0x000000400 |
Chao Yu | 6f5c2ed | 2018-09-12 09:22:29 +0800 | [diff] [blame] | 189 | FAULT_READ_IO 0x000000800 |
Chao Yu | d494500 | 2018-08-08 17:36:41 +0800 | [diff] [blame] | 190 | FAULT_CHECKPOINT 0x000001000 |
| 191 | FAULT_DISCARD 0x000002000 |
Chao Yu | 6f5c2ed | 2018-09-12 09:22:29 +0800 | [diff] [blame] | 192 | FAULT_WRITE_IO 0x000004000 |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 193 | =================== =========== |
Jaegeuk Kim | 36abef4 | 2016-06-03 19:29:38 -0700 | [diff] [blame] | 194 | mode=%s Control block allocation mode which supports "adaptive" |
| 195 | and "lfs". In "lfs" mode, there should be no random |
| 196 | writes towards main area. |
Jaegeuk Kim | ec91538 | 2016-12-21 17:09:19 -0800 | [diff] [blame] | 197 | io_bits=%u Set the bit size of write IO requests. It should be set |
| 198 | with "mode=lfs". |
Chao Yu | 0abd675 | 2017-07-09 00:13:07 +0800 | [diff] [blame] | 199 | usrquota Enable plain user disk quota accounting. |
| 200 | grpquota Enable plain group disk quota accounting. |
Chao Yu | 5c57132 | 2017-07-26 00:01:41 +0800 | [diff] [blame] | 201 | prjquota Enable plain project quota accounting. |
Chao Yu | 4b2414d | 2017-08-08 10:54:31 +0800 | [diff] [blame] | 202 | usrjquota=<file> Appoint specified file and type during mount, so that quota |
| 203 | grpjquota=<file> information can be properly updated during recovery flow, |
| 204 | prjjquota=<file> <quota file>: must be in root directory; |
| 205 | jqfmt=<quota type> <quota type>: [vfsold,vfsv0,vfsv1]. |
| 206 | offusrjquota Turn off user journelled quota. |
| 207 | offgrpjquota Turn off group journelled quota. |
| 208 | offprjjquota Turn off project journelled quota. |
| 209 | quota Enable plain user disk quota accounting. |
| 210 | noquota Disable all plain disk quota option. |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 211 | whint_mode=%s Control which write hints are passed down to block |
| 212 | layer. This supports "off", "user-based", and |
| 213 | "fs-based". In "off" mode (default), f2fs does not pass |
| 214 | down hints. In "user-based" mode, f2fs tries to pass |
| 215 | down hints given by users. And in "fs-based" mode, f2fs |
| 216 | passes down hints with its policy. |
Jaegeuk Kim | 0793962 | 2018-02-18 08:50:49 -0800 | [diff] [blame] | 217 | alloc_mode=%s Adjust block allocation policy, which supports "reuse" |
| 218 | and "default". |
Jaegeuk Kim | d629081 | 2018-05-25 18:02:58 -0700 | [diff] [blame] | 219 | fsync_mode=%s Control the policy of fsync. Currently supports "posix", |
| 220 | "strict", and "nobarrier". In "posix" mode, which is |
| 221 | default, fsync will follow POSIX semantics and does a |
| 222 | light operation to improve the filesystem performance. |
| 223 | In "strict" mode, fsync will be heavy and behaves in line |
| 224 | with xfs, ext4 and btrfs, where xfstest generic/342 will |
| 225 | pass, but the performance will regress. "nobarrier" is |
| 226 | based on "posix", but doesn't issue flush command for |
| 227 | non-atomic files likewise "nobarrier" mount option. |
Sheng Yong | ff62af2 | 2018-03-15 18:51:42 +0800 | [diff] [blame] | 228 | test_dummy_encryption Enable dummy encryption, which provides a fake fscrypt |
| 229 | context. The fake fscrypt context is used by xfstests. |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 230 | checkpoint=%s[:%u[%]] Set to "disable" to turn off checkpointing. Set to "enable" |
Daniel Rosenberg | 4354994 | 2018-08-20 19:21:43 -0700 | [diff] [blame] | 231 | to reenable checkpointing. Is enabled by default. While |
| 232 | disabled, any unmounting or unexpected shutdowns will cause |
| 233 | the filesystem contents to appear as they did when the |
| 234 | filesystem was mounted with that option. |
Daniel Rosenberg | 4d3aed7 | 2019-05-29 17:49:06 -0700 | [diff] [blame] | 235 | While mounting with checkpoint=disabled, the filesystem must |
| 236 | run garbage collection to ensure that all available space can |
| 237 | be used. If this takes too much time, the mount may return |
| 238 | EAGAIN. You may optionally add a value to indicate how much |
| 239 | of the disk you would be willing to temporarily give up to |
| 240 | avoid additional garbage collection. This can be given as a |
| 241 | number of blocks, or as a percent. For instance, mounting |
| 242 | with checkpoint=disable:100% would always succeed, but it may |
| 243 | hide up to all remaining free space. The actual space that |
| 244 | would be unusable can be viewed at /sys/fs/f2fs/<disk>/unusable |
| 245 | This space is reclaimed once checkpoint=enable. |
Linus Torvalds | f40f31c | 2020-04-07 13:48:26 -0700 | [diff] [blame] | 246 | compress_algorithm=%s Control compress algorithm, currently f2fs supports "lzo", |
| 247 | "lz4" and "zstd" algorithm. |
Chao Yu | 4c8ff70 | 2019-11-01 18:07:14 +0800 | [diff] [blame] | 248 | compress_log_size=%u Support configuring compress cluster size, the size will |
| 249 | be 4KB * (1 << %u), 16KB is minimum size, also it's |
| 250 | default size. |
| 251 | compress_extension=%s Support adding specified extension, so that f2fs can enable |
| 252 | compression on those corresponding files, e.g. if all files |
| 253 | with '.ext' has high compression rate, we can set the '.ext' |
| 254 | on compression extension list and enable compression on |
| 255 | these file by default rather than to enable it via ioctl. |
| 256 | For other files, we can still enable compression via ioctl. |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 257 | ====================== ============================================================ |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 258 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 259 | Debugfs Entries |
| 260 | =============== |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 261 | |
| 262 | /sys/kernel/debug/f2fs/ contains information about all the partitions mounted as |
| 263 | f2fs. Each file shows the whole f2fs information. |
| 264 | |
| 265 | /sys/kernel/debug/f2fs/status includes: |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 266 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 267 | - major file system information managed by f2fs currently |
| 268 | - average SIT information about whole segments |
| 269 | - current memory footprint consumed by f2fs. |
| 270 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 271 | Sysfs Entries |
| 272 | ============= |
Namjae Jeon | b59d0ba | 2013-08-04 23:09:40 +0900 | [diff] [blame] | 273 | |
Tiezhu Yang | 6de3f12 | 2017-02-08 05:08:01 +0800 | [diff] [blame] | 274 | Information about mounted f2fs file systems can be found in |
Namjae Jeon | b59d0ba | 2013-08-04 23:09:40 +0900 | [diff] [blame] | 275 | /sys/fs/f2fs. Each mounted filesystem will have a directory in |
| 276 | /sys/fs/f2fs based on its device name (i.e., /sys/fs/f2fs/sda). |
| 277 | The files in each per-device directory are shown in table below. |
| 278 | |
| 279 | Files in /sys/fs/f2fs/<devname> |
| 280 | (see also Documentation/ABI/testing/sysfs-fs-f2fs) |
Daniel Rosenberg | 5aba543 | 2019-07-23 16:05:28 -0700 | [diff] [blame] | 281 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 282 | Usage |
| 283 | ===== |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 284 | |
| 285 | 1. Download userland tools and compile them. |
| 286 | |
| 287 | 2. Skip, if f2fs was compiled statically inside kernel. |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 288 | Otherwise, insert the f2fs.ko module:: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 289 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 290 | # insmod f2fs.ko |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 291 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 292 | 3. Create a directory trying to mount:: |
| 293 | |
| 294 | # mkdir /mnt/f2fs |
| 295 | |
| 296 | 4. Format the block device, and then mount as f2fs:: |
| 297 | |
| 298 | # mkfs.f2fs -l label /dev/block_device |
| 299 | # mount -t f2fs /dev/block_device /mnt/f2fs |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 300 | |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 301 | mkfs.f2fs |
| 302 | --------- |
| 303 | The mkfs.f2fs is for the use of formatting a partition as the f2fs filesystem, |
| 304 | which builds a basic on-disk layout. |
| 305 | |
| 306 | The options consist of: |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 307 | |
| 308 | =============== =========================================================== |
| 309 | ``-l [label]`` Give a volume label, up to 512 unicode name. |
| 310 | ``-a [0 or 1]`` Split start location of each area for heap-based allocation. |
| 311 | |
| 312 | 1 is set by default, which performs this. |
| 313 | ``-o [int]`` Set overprovision ratio in percent over volume size. |
| 314 | |
| 315 | 5 is set by default. |
| 316 | ``-s [int]`` Set the number of segments per section. |
| 317 | |
| 318 | 1 is set by default. |
| 319 | ``-z [int]`` Set the number of sections per zone. |
| 320 | |
| 321 | 1 is set by default. |
| 322 | ``-e [str]`` Set basic extension list. e.g. "mp3,gif,mov" |
| 323 | ``-t [0 or 1]`` Disable discard command or not. |
| 324 | |
| 325 | 1 is set by default, which conducts discard. |
| 326 | =============== =========================================================== |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 327 | |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 328 | fsck.f2fs |
| 329 | --------- |
| 330 | The fsck.f2fs is a tool to check the consistency of an f2fs-formatted |
| 331 | partition, which examines whether the filesystem metadata and user-made data |
| 332 | are cross-referenced correctly or not. |
| 333 | Note that, initial version of the tool does not fix any inconsistency. |
| 334 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 335 | The options consist of:: |
| 336 | |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 337 | -d debug level [default:0] |
| 338 | |
| 339 | dump.f2fs |
| 340 | --------- |
| 341 | The dump.f2fs shows the information of specific inode and dumps SSA and SIT to |
| 342 | file. Each file is dump_ssa and dump_sit. |
| 343 | |
| 344 | The dump.f2fs is used to debug on-disk data structures of the f2fs filesystem. |
Masanari Iida | 4bb9998 | 2015-11-16 20:46:28 +0900 | [diff] [blame] | 345 | It shows on-disk inode information recognized by a given inode number, and is |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 346 | able to dump all the SSA and SIT entries into predefined files, ./dump_ssa and |
| 347 | ./dump_sit respectively. |
| 348 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 349 | The options consist of:: |
| 350 | |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 351 | -d debug level [default:0] |
| 352 | -i inode no (hex) |
| 353 | -s [SIT dump segno from #1~#2 (decimal), for all 0~-1] |
| 354 | -a [SSA dump segno from #1~#2 (decimal), for all 0~-1] |
| 355 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 356 | Examples:: |
Changman Lee | d51a7fb | 2013-07-04 17:12:47 +0900 | [diff] [blame] | 357 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 358 | # dump.f2fs -i [ino] /dev/sdx |
| 359 | # dump.f2fs -s 0~-1 /dev/sdx (SIT dump) |
| 360 | # dump.f2fs -a 0~-1 /dev/sdx (SSA dump) |
| 361 | |
| 362 | Design |
| 363 | ====== |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 364 | |
| 365 | On-disk Layout |
| 366 | -------------- |
| 367 | |
| 368 | F2FS divides the whole volume into a number of segments, each of which is fixed |
| 369 | to 2MB in size. A section is composed of consecutive segments, and a zone |
| 370 | consists of a set of sections. By default, section and zone sizes are set to one |
| 371 | segment size identically, but users can easily modify the sizes by mkfs. |
| 372 | |
| 373 | F2FS splits the entire volume into six areas, and all the areas except superblock |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 374 | consists of multiple segments as described below:: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 375 | |
| 376 | align with the zone size <-| |
| 377 | |-> align with the segment size |
| 378 | _________________________________________________________________________ |
Huajun Li | 9268cc3 | 2012-12-31 13:59:04 +0800 | [diff] [blame] | 379 | | | | Segment | Node | Segment | | |
| 380 | | Superblock | Checkpoint | Info. | Address | Summary | Main | |
| 381 | | (SB) | (CP) | Table (SIT) | Table (NAT) | Area (SSA) | | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 382 | |____________|_____2______|______N______|______N______|______N_____|__N___| |
| 383 | . . |
| 384 | . . |
| 385 | . . |
| 386 | ._________________________________________. |
| 387 | |_Segment_|_..._|_Segment_|_..._|_Segment_| |
| 388 | . . |
| 389 | ._________._________ |
| 390 | |_section_|__...__|_ |
| 391 | . . |
| 392 | .________. |
| 393 | |__zone__| |
| 394 | |
| 395 | - Superblock (SB) |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 396 | It is located at the beginning of the partition, and there exist two copies |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 397 | to avoid file system crash. It contains basic partition information and some |
| 398 | default parameters of f2fs. |
| 399 | |
| 400 | - Checkpoint (CP) |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 401 | It contains file system information, bitmaps for valid NAT/SIT sets, orphan |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 402 | inode lists, and summary entries of current active segments. |
| 403 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 404 | - Segment Information Table (SIT) |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 405 | It contains segment information such as valid block count and bitmap for the |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 406 | validity of all the blocks. |
| 407 | |
Huajun Li | 9268cc3 | 2012-12-31 13:59:04 +0800 | [diff] [blame] | 408 | - Node Address Table (NAT) |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 409 | It is composed of a block address table for all the node blocks stored in |
Huajun Li | 9268cc3 | 2012-12-31 13:59:04 +0800 | [diff] [blame] | 410 | Main area. |
| 411 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 412 | - Segment Summary Area (SSA) |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 413 | It contains summary entries which contains the owner information of all the |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 414 | data and node blocks stored in Main area. |
| 415 | |
| 416 | - Main Area |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 417 | It contains file and directory data including their indices. |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 418 | |
| 419 | In order to avoid misalignment between file system and flash-based storage, F2FS |
| 420 | aligns the start block address of CP with the segment size. Also, it aligns the |
| 421 | start block address of Main area with the zone size by reserving some segments |
| 422 | in SSA area. |
| 423 | |
| 424 | Reference the following survey for additional technical details. |
| 425 | https://wiki.linaro.org/WorkingGroups/Kernel/Projects/FlashCardSurvey |
| 426 | |
| 427 | File System Metadata Structure |
| 428 | ------------------------------ |
| 429 | |
| 430 | F2FS adopts the checkpointing scheme to maintain file system consistency. At |
| 431 | mount time, F2FS first tries to find the last valid checkpoint data by scanning |
| 432 | CP area. In order to reduce the scanning time, F2FS uses only two copies of CP. |
| 433 | One of them always indicates the last valid data, which is called as shadow copy |
| 434 | mechanism. In addition to CP, NAT and SIT also adopt the shadow copy mechanism. |
| 435 | |
| 436 | For file system consistency, each CP points to which NAT and SIT copies are |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 437 | valid, as shown as below:: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 438 | |
| 439 | +--------+----------+---------+ |
Huajun Li | 9268cc3 | 2012-12-31 13:59:04 +0800 | [diff] [blame] | 440 | | CP | SIT | NAT | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 441 | +--------+----------+---------+ |
| 442 | . . . . |
| 443 | . . . . |
| 444 | . . . . |
| 445 | +-------+-------+--------+--------+--------+--------+ |
Huajun Li | 9268cc3 | 2012-12-31 13:59:04 +0800 | [diff] [blame] | 446 | | CP #0 | CP #1 | SIT #0 | SIT #1 | NAT #0 | NAT #1 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 447 | +-------+-------+--------+--------+--------+--------+ |
| 448 | | ^ ^ |
| 449 | | | | |
| 450 | `----------------------------------------' |
| 451 | |
| 452 | Index Structure |
| 453 | --------------- |
| 454 | |
| 455 | The key data structure to manage the data locations is a "node". Similar to |
| 456 | traditional file structures, F2FS has three types of node: inode, direct node, |
Huajun Li | d08ab08 | 2012-12-05 16:45:32 +0800 | [diff] [blame] | 457 | indirect node. F2FS assigns 4KB to an inode block which contains 923 data block |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 458 | indices, two direct node pointers, two indirect node pointers, and one double |
| 459 | indirect node pointer as described below. One direct node block contains 1018 |
| 460 | data blocks, and one indirect node block contains also 1018 node blocks. Thus, |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 461 | one inode block (i.e., a file) covers:: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 462 | |
| 463 | 4KB * (923 + 2 * 1018 + 2 * 1018 * 1018 + 1018 * 1018 * 1018) := 3.94TB. |
| 464 | |
| 465 | Inode block (4KB) |
| 466 | |- data (923) |
| 467 | |- direct node (2) |
| 468 | | `- data (1018) |
| 469 | |- indirect node (2) |
| 470 | | `- direct node (1018) |
| 471 | | `- data (1018) |
| 472 | `- double indirect node (1) |
| 473 | `- indirect node (1018) |
| 474 | `- direct node (1018) |
| 475 | `- data (1018) |
| 476 | |
| 477 | Note that, all the node blocks are mapped by NAT which means the location of |
| 478 | each node is translated by the NAT table. In the consideration of the wandering |
| 479 | tree problem, F2FS is able to cut off the propagation of node updates caused by |
| 480 | leaf data writes. |
| 481 | |
| 482 | Directory Structure |
| 483 | ------------------- |
| 484 | |
| 485 | A directory entry occupies 11 bytes, which consists of the following attributes. |
| 486 | |
| 487 | - hash hash value of the file name |
| 488 | - ino inode number |
| 489 | - len the length of file name |
| 490 | - type file type such as directory, symlink, etc |
| 491 | |
| 492 | A dentry block consists of 214 dentry slots and file names. Therein a bitmap is |
| 493 | used to represent whether each dentry is valid or not. A dentry block occupies |
| 494 | 4KB with the following composition. |
| 495 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 496 | :: |
| 497 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 498 | Dentry Block(4 K) = bitmap (27 bytes) + reserved (3 bytes) + |
| 499 | dentries(11 * 214 bytes) + file name (8 * 214 bytes) |
| 500 | |
| 501 | [Bucket] |
| 502 | +--------------------------------+ |
| 503 | |dentry block 1 | dentry block 2 | |
| 504 | +--------------------------------+ |
| 505 | . . |
| 506 | . . |
| 507 | . [Dentry Block Structure: 4KB] . |
| 508 | +--------+----------+----------+------------+ |
| 509 | | bitmap | reserved | dentries | file names | |
| 510 | +--------+----------+----------+------------+ |
| 511 | [Dentry Block: 4KB] . . |
| 512 | . . |
| 513 | . . |
| 514 | +------+------+-----+------+ |
| 515 | | hash | ino | len | type | |
| 516 | +------+------+-----+------+ |
| 517 | [Dentry Structure: 11 bytes] |
| 518 | |
| 519 | F2FS implements multi-level hash tables for directory structure. Each level has |
| 520 | a hash table with dedicated number of hash buckets as shown below. Note that |
| 521 | "A(2B)" means a bucket includes 2 data blocks. |
| 522 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 523 | :: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 524 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 525 | ---------------------- |
| 526 | A : bucket |
| 527 | B : block |
| 528 | N : MAX_DIR_HASH_DEPTH |
| 529 | ---------------------- |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 530 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 531 | level #0 | A(2B) |
| 532 | | |
| 533 | level #1 | A(2B) - A(2B) |
| 534 | | |
| 535 | level #2 | A(2B) - A(2B) - A(2B) - A(2B) |
| 536 | . | . . . . |
| 537 | level #N/2 | A(2B) - A(2B) - A(2B) - A(2B) - A(2B) - ... - A(2B) |
| 538 | . | . . . . |
| 539 | level #N | A(4B) - A(4B) - A(4B) - A(4B) - A(4B) - ... - A(4B) |
| 540 | |
| 541 | The number of blocks and buckets are determined by:: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 542 | |
| 543 | ,- 2, if n < MAX_DIR_HASH_DEPTH / 2, |
| 544 | # of blocks in level #n = | |
| 545 | `- 4, Otherwise |
| 546 | |
Chao Yu | bfec07d | 2014-05-28 08:56:09 +0800 | [diff] [blame] | 547 | ,- 2^(n + dir_level), |
| 548 | | if n + dir_level < MAX_DIR_HASH_DEPTH / 2, |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 549 | # of buckets in level #n = | |
Chao Yu | bfec07d | 2014-05-28 08:56:09 +0800 | [diff] [blame] | 550 | `- 2^((MAX_DIR_HASH_DEPTH / 2) - 1), |
| 551 | Otherwise |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 552 | |
| 553 | When F2FS finds a file name in a directory, at first a hash value of the file |
| 554 | name is calculated. Then, F2FS scans the hash table in level #0 to find the |
| 555 | dentry consisting of the file name and its inode number. If not found, F2FS |
| 556 | scans the next hash table in level #1. In this way, F2FS scans hash tables in |
| 557 | each levels incrementally from 1 to N. In each levels F2FS needs to scan only |
| 558 | one bucket determined by the following equation, which shows O(log(# of files)) |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 559 | complexity:: |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 560 | |
| 561 | bucket number to scan in level #n = (hash value) % (# of buckets in level #n) |
| 562 | |
| 563 | In the case of file creation, F2FS finds empty consecutive slots that cover the |
| 564 | file name. F2FS searches the empty slots in the hash tables of whole levels from |
| 565 | 1 to N in the same way as the lookup operation. |
| 566 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 567 | The following figure shows an example of two cases holding children:: |
| 568 | |
Jaegeuk Kim | 98e4da8 | 2012-11-02 17:05:42 +0900 | [diff] [blame] | 569 | --------------> Dir <-------------- |
| 570 | | | |
| 571 | child child |
| 572 | |
| 573 | child - child [hole] - child |
| 574 | |
| 575 | child - child - child [hole] - [hole] - child |
| 576 | |
| 577 | Case 1: Case 2: |
| 578 | Number of children = 6, Number of children = 3, |
| 579 | File size = 7 File size = 7 |
| 580 | |
| 581 | Default Block Allocation |
| 582 | ------------------------ |
| 583 | |
| 584 | At runtime, F2FS manages six active logs inside "Main" area: Hot/Warm/Cold node |
| 585 | and Hot/Warm/Cold data. |
| 586 | |
| 587 | - Hot node contains direct node blocks of directories. |
| 588 | - Warm node contains direct node blocks except hot node blocks. |
| 589 | - Cold node contains indirect node blocks |
| 590 | - Hot data contains dentry blocks |
| 591 | - Warm data contains data blocks except hot and cold data blocks |
| 592 | - Cold data contains multimedia data or migrated data blocks |
| 593 | |
| 594 | LFS has two schemes for free space management: threaded log and copy-and-compac- |
| 595 | tion. The copy-and-compaction scheme which is known as cleaning, is well-suited |
| 596 | for devices showing very good sequential write performance, since free segments |
| 597 | are served all the time for writing new data. However, it suffers from cleaning |
| 598 | overhead under high utilization. Contrarily, the threaded log scheme suffers |
| 599 | from random writes, but no cleaning process is needed. F2FS adopts a hybrid |
| 600 | scheme where the copy-and-compaction scheme is adopted by default, but the |
| 601 | policy is dynamically changed to the threaded log scheme according to the file |
| 602 | system status. |
| 603 | |
| 604 | In order to align F2FS with underlying flash-based storage, F2FS allocates a |
| 605 | segment in a unit of section. F2FS expects that the section size would be the |
| 606 | same as the unit size of garbage collection in FTL. Furthermore, with respect |
| 607 | to the mapping granularity in FTL, F2FS allocates each section of the active |
| 608 | logs from different zones as much as possible, since FTL can write the data in |
| 609 | the active logs into one allocation unit according to its mapping granularity. |
| 610 | |
| 611 | Cleaning process |
| 612 | ---------------- |
| 613 | |
| 614 | F2FS does cleaning both on demand and in the background. On-demand cleaning is |
| 615 | triggered when there are not enough free segments to serve VFS calls. Background |
| 616 | cleaner is operated by a kernel thread, and triggers the cleaning job when the |
| 617 | system is idle. |
| 618 | |
| 619 | F2FS supports two victim selection policies: greedy and cost-benefit algorithms. |
| 620 | In the greedy algorithm, F2FS selects a victim segment having the smallest number |
| 621 | of valid blocks. In the cost-benefit algorithm, F2FS selects a victim segment |
| 622 | according to the segment age and the number of valid blocks in order to address |
| 623 | log block thrashing problem in the greedy algorithm. F2FS adopts the greedy |
| 624 | algorithm for on-demand cleaner, while background cleaner adopts cost-benefit |
| 625 | algorithm. |
| 626 | |
| 627 | In order to identify whether the data in the victim segment are valid or not, |
| 628 | F2FS manages a bitmap. Each bit represents the validity of a block, and the |
| 629 | bitmap is composed of a bit stream covering whole blocks in main area. |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 630 | |
| 631 | Write-hint Policy |
| 632 | ----------------- |
| 633 | |
| 634 | 1) whint_mode=off. F2FS only passes down WRITE_LIFE_NOT_SET. |
| 635 | |
| 636 | 2) whint_mode=user-based. F2FS tries to pass down hints given by |
| 637 | users. |
| 638 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 639 | ===================== ======================== =================== |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 640 | User F2FS Block |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 641 | ===================== ======================== =================== |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 642 | META WRITE_LIFE_NOT_SET |
| 643 | HOT_NODE " |
| 644 | WARM_NODE " |
| 645 | COLD_NODE " |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 646 | ioctl(COLD) COLD_DATA WRITE_LIFE_EXTREME |
| 647 | extension list " " |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 648 | |
| 649 | -- buffered io |
| 650 | WRITE_LIFE_EXTREME COLD_DATA WRITE_LIFE_EXTREME |
| 651 | WRITE_LIFE_SHORT HOT_DATA WRITE_LIFE_SHORT |
| 652 | WRITE_LIFE_NOT_SET WARM_DATA WRITE_LIFE_NOT_SET |
| 653 | WRITE_LIFE_NONE " " |
| 654 | WRITE_LIFE_MEDIUM " " |
| 655 | WRITE_LIFE_LONG " " |
| 656 | |
| 657 | -- direct io |
| 658 | WRITE_LIFE_EXTREME COLD_DATA WRITE_LIFE_EXTREME |
| 659 | WRITE_LIFE_SHORT HOT_DATA WRITE_LIFE_SHORT |
| 660 | WRITE_LIFE_NOT_SET WARM_DATA WRITE_LIFE_NOT_SET |
| 661 | WRITE_LIFE_NONE " WRITE_LIFE_NONE |
| 662 | WRITE_LIFE_MEDIUM " WRITE_LIFE_MEDIUM |
| 663 | WRITE_LIFE_LONG " WRITE_LIFE_LONG |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 664 | ===================== ======================== =================== |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 665 | |
| 666 | 3) whint_mode=fs-based. F2FS passes down hints with its policy. |
| 667 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 668 | ===================== ======================== =================== |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 669 | User F2FS Block |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 670 | ===================== ======================== =================== |
Hyunchul Lee | 8b3a0ca | 2018-01-31 11:36:59 +0900 | [diff] [blame] | 671 | META WRITE_LIFE_MEDIUM; |
| 672 | HOT_NODE WRITE_LIFE_NOT_SET |
| 673 | WARM_NODE " |
| 674 | COLD_NODE WRITE_LIFE_NONE |
| 675 | ioctl(COLD) COLD_DATA WRITE_LIFE_EXTREME |
| 676 | extension list " " |
| 677 | |
| 678 | -- buffered io |
| 679 | WRITE_LIFE_EXTREME COLD_DATA WRITE_LIFE_EXTREME |
| 680 | WRITE_LIFE_SHORT HOT_DATA WRITE_LIFE_SHORT |
| 681 | WRITE_LIFE_NOT_SET WARM_DATA WRITE_LIFE_LONG |
| 682 | WRITE_LIFE_NONE " " |
| 683 | WRITE_LIFE_MEDIUM " " |
| 684 | WRITE_LIFE_LONG " " |
| 685 | |
| 686 | -- direct io |
| 687 | WRITE_LIFE_EXTREME COLD_DATA WRITE_LIFE_EXTREME |
| 688 | WRITE_LIFE_SHORT HOT_DATA WRITE_LIFE_SHORT |
| 689 | WRITE_LIFE_NOT_SET WARM_DATA WRITE_LIFE_NOT_SET |
| 690 | WRITE_LIFE_NONE " WRITE_LIFE_NONE |
| 691 | WRITE_LIFE_MEDIUM " WRITE_LIFE_MEDIUM |
| 692 | WRITE_LIFE_LONG " WRITE_LIFE_LONG |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 693 | ===================== ======================== =================== |
Jaegeuk Kim | cad3836 | 2019-06-26 18:23:05 -0700 | [diff] [blame] | 694 | |
| 695 | Fallocate(2) Policy |
| 696 | ------------------- |
| 697 | |
| 698 | The default policy follows the below posix rule. |
| 699 | |
| 700 | Allocating disk space |
| 701 | The default operation (i.e., mode is zero) of fallocate() allocates |
| 702 | the disk space within the range specified by offset and len. The |
| 703 | file size (as reported by stat(2)) will be changed if offset+len is |
| 704 | greater than the file size. Any subregion within the range specified |
| 705 | by offset and len that did not contain data before the call will be |
| 706 | initialized to zero. This default behavior closely resembles the |
| 707 | behavior of the posix_fallocate(3) library function, and is intended |
| 708 | as a method of optimally implementing that function. |
| 709 | |
| 710 | However, once F2FS receives ioctl(fd, F2FS_IOC_SET_PIN_FILE) in prior to |
| 711 | fallocate(fd, DEFAULT_MODE), it allocates on-disk blocks addressess having |
| 712 | zero or random data, which is useful to the below scenario where: |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 713 | |
Jaegeuk Kim | cad3836 | 2019-06-26 18:23:05 -0700 | [diff] [blame] | 714 | 1. create(fd) |
| 715 | 2. ioctl(fd, F2FS_IOC_SET_PIN_FILE) |
| 716 | 3. fallocate(fd, 0, 0, size) |
| 717 | 4. address = fibmap(fd, offset) |
| 718 | 5. open(blkdev) |
| 719 | 6. write(blkdev, address) |
Chao Yu | 4c8ff70 | 2019-11-01 18:07:14 +0800 | [diff] [blame] | 720 | |
| 721 | Compression implementation |
| 722 | -------------------------- |
| 723 | |
| 724 | - New term named cluster is defined as basic unit of compression, file can |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 725 | be divided into multiple clusters logically. One cluster includes 4 << n |
| 726 | (n >= 0) logical pages, compression size is also cluster size, each of |
| 727 | cluster can be compressed or not. |
Chao Yu | 4c8ff70 | 2019-11-01 18:07:14 +0800 | [diff] [blame] | 728 | |
| 729 | - In cluster metadata layout, one special block address is used to indicate |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 730 | cluster is compressed one or normal one, for compressed cluster, following |
| 731 | metadata maps cluster to [1, 4 << n - 1] physical blocks, in where f2fs |
| 732 | stores data including compress header and compressed data. |
Chao Yu | 4c8ff70 | 2019-11-01 18:07:14 +0800 | [diff] [blame] | 733 | |
| 734 | - In order to eliminate write amplification during overwrite, F2FS only |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 735 | support compression on write-once file, data can be compressed only when |
| 736 | all logical blocks in file are valid and cluster compress ratio is lower |
| 737 | than specified threshold. |
Chao Yu | 4c8ff70 | 2019-11-01 18:07:14 +0800 | [diff] [blame] | 738 | |
| 739 | - To enable compression on regular inode, there are three ways: |
Chao Yu | 4c8ff70 | 2019-11-01 18:07:14 +0800 | [diff] [blame] | 740 | |
Mauro Carvalho Chehab | 89272ca | 2020-02-17 17:12:04 +0100 | [diff] [blame] | 741 | * chattr +c file |
| 742 | * chattr +c dir; touch dir/file |
| 743 | * mount w/ -o compress_extension=ext; touch file.ext |
| 744 | |
| 745 | Compress metadata layout:: |
| 746 | |
| 747 | [Dnode Structure] |
| 748 | +-----------------------------------------------+ |
| 749 | | cluster 1 | cluster 2 | ......... | cluster N | |
| 750 | +-----------------------------------------------+ |
| 751 | . . . . |
| 752 | . . . . |
| 753 | . Compressed Cluster . . Normal Cluster . |
| 754 | +----------+---------+---------+---------+ +---------+---------+---------+---------+ |
| 755 | |compr flag| block 1 | block 2 | block 3 | | block 1 | block 2 | block 3 | block 4 | |
| 756 | +----------+---------+---------+---------+ +---------+---------+---------+---------+ |
| 757 | . . |
| 758 | . . |
| 759 | . . |
| 760 | +-------------+-------------+----------+----------------------------+ |
| 761 | | data length | data chksum | reserved | compressed data | |
| 762 | +-------------+-------------+----------+----------------------------+ |