blob: bf5c48066fac5a3175ae7704152c5beca185cd4a [file] [log] [blame]
Tobin C. Harding099c5c72019-05-15 10:29:10 +10001.. SPDX-License-Identifier: GPL-2.0
2
Tobin C. Harding90ac11a2019-05-15 10:29:09 +10003=========================================
4Overview of the Linux Virtual File System
5=========================================
Linus Torvalds1da177e2005-04-16 15:20:36 -07006
Tobin C. Hardinge66b0452019-05-15 10:29:11 +10007Original author: Richard Gooch <rgooch@atnf.csiro.au>
Linus Torvalds1da177e2005-04-16 15:20:36 -07008
Tobin C. Hardinge66b0452019-05-15 10:29:11 +10009- Copyright (C) 1999 Richard Gooch
10- Copyright (C) 2005 Pekka Enberg
Pekka J Enberg5ea626a2005-09-09 13:10:19 -070011
Linus Torvalds1da177e2005-04-16 15:20:36 -070012
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080013Introduction
14============
Linus Torvalds1da177e2005-04-16 15:20:36 -070015
Tobin C. Harding90caa782019-05-15 10:29:07 +100016The Virtual File System (also known as the Virtual Filesystem Switch) is
17the software layer in the kernel that provides the filesystem interface
18to userspace programs. It also provides an abstraction within the
19kernel which allows different filesystem implementations to coexist.
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080020
Tobin C. Harding90caa782019-05-15 10:29:07 +100021VFS system calls open(2), stat(2), read(2), write(2), chmod(2) and so on
22are called from a process context. Filesystem locking is described in
Mauro Carvalho Chehabec23eb52019-07-26 09:51:27 -030023the document Documentation/filesystems/locking.rst.
Linus Torvalds1da177e2005-04-16 15:20:36 -070024
25
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080026Directory Entry Cache (dcache)
27------------------------------
Linus Torvalds1da177e2005-04-16 15:20:36 -070028
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080029The VFS implements the open(2), stat(2), chmod(2), and similar system
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100030calls. The pathname argument that is passed to them is used by the VFS
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080031to search through the directory entry cache (also known as the dentry
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100032cache or dcache). This provides a very fast look-up mechanism to
33translate a pathname (filename) into a specific dentry. Dentries live
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080034in RAM and are never saved to disc: they exist only for performance.
35
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100036The dentry cache is meant to be a view into your entire filespace. As
Tobin C. Harding90caa782019-05-15 10:29:07 +100037most computers cannot fit all dentries in the RAM at the same time, some
38bits of the cache are missing. In order to resolve your pathname into a
39dentry, the VFS may have to resort to creating dentries along the way,
40and then loading the inode. This is done by looking up the inode.
Linus Torvalds1da177e2005-04-16 15:20:36 -070041
Pekka J Enberg5ea626a2005-09-09 13:10:19 -070042
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080043The Inode Object
44----------------
Linus Torvalds1da177e2005-04-16 15:20:36 -070045
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100046An individual dentry usually has a pointer to an inode. Inodes are
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080047filesystem objects such as regular files, directories, FIFOs and other
Tobin C. Harding90caa782019-05-15 10:29:07 +100048beasts. They live either on the disc (for block device filesystems) or
49in the memory (for pseudo filesystems). Inodes that live on the disc
50are copied into the memory when required and changes to the inode are
51written back to disc. A single inode can be pointed to by multiple
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080052dentries (hard links, for example, do this).
Linus Torvalds1da177e2005-04-16 15:20:36 -070053
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080054To look up an inode requires that the VFS calls the lookup() method of
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100055the parent directory inode. This method is installed by the specific
Tobin C. Harding90caa782019-05-15 10:29:07 +100056filesystem implementation that the inode lives in. Once the VFS has the
57required dentry (and hence the inode), we can do all those boring things
58like open(2) the file, or stat(2) it to peek at the inode data. The
59stat(2) operation is fairly simple: once the VFS has the dentry, it
60peeks at the inode data and passes some of it back to userspace.
Linus Torvalds1da177e2005-04-16 15:20:36 -070061
Linus Torvalds1da177e2005-04-16 15:20:36 -070062
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080063The File Object
64---------------
Linus Torvalds1da177e2005-04-16 15:20:36 -070065
66Opening a file requires another operation: allocation of a file
Tobin C. Harding90caa782019-05-15 10:29:07 +100067structure (this is the kernel-side implementation of file descriptors).
68The freshly allocated file structure is initialized with a pointer to
69the dentry and a set of file operation member functions. These are
70taken from the inode data. The open() file method is then called so the
71specific filesystem implementation can do its work. You can see that
72this is another switch performed by the VFS. The file structure is
73placed into the file descriptor table for the process.
Linus Torvalds1da177e2005-04-16 15:20:36 -070074
75Reading, writing and closing files (and other assorted VFS operations)
76is done by using the userspace file descriptor to grab the appropriate
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080077file structure, and then calling the required file structure method to
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100078do whatever is required. For as long as the file is open, it keeps the
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080079dentry in use, which in turn means that the VFS inode is still in use.
Linus Torvalds1da177e2005-04-16 15:20:36 -070080
Pekka J Enberg5ea626a2005-09-09 13:10:19 -070081
82Registering and Mounting a Filesystem
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080083=====================================
Linus Torvalds1da177e2005-04-16 15:20:36 -070084
Pekka Enbergcc7d1f82005-11-07 01:01:08 -080085To register and unregister a filesystem, use the following API
86functions:
Linus Torvalds1da177e2005-04-16 15:20:36 -070087
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +100088.. code-block:: c
Linus Torvalds1da177e2005-04-16 15:20:36 -070089
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +100090 #include <linux/fs.h>
91
92 extern int register_filesystem(struct file_system_type *);
93 extern int unregister_filesystem(struct file_system_type *);
Linus Torvalds1da177e2005-04-16 15:20:36 -070094
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +100095The passed struct file_system_type describes your filesystem. When a
Tobin C. Harding90caa782019-05-15 10:29:07 +100096request is made to mount a filesystem onto a directory in your
97namespace, the VFS will call the appropriate mount() method for the
98specific filesystem. New vfsmount referring to the tree returned by
99->mount() will be attached to the mountpoint, so that when pathname
100resolution reaches the mountpoint it will jump into the root of that
101vfsmount.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700102
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800103You can see all filesystems that are registered to the kernel in the
104file /proc/filesystems.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700105
106
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700107struct file_system_type
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800108-----------------------
Linus Torvalds1da177e2005-04-16 15:20:36 -0700109
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000110This describes the filesystem. As of kernel 2.6.39, the following
Linus Torvalds1da177e2005-04-16 15:20:36 -0700111members are defined:
112
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000113.. code-block:: c
Linus Torvalds1da177e2005-04-16 15:20:36 -0700114
Liao Pingfang6a2195a2021-01-10 15:59:59 +0800115 struct file_system_type {
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000116 const char *name;
117 int fs_flags;
118 struct dentry *(*mount) (struct file_system_type *, int,
119 const char *, void *);
120 void (*kill_sb) (struct super_block *);
121 struct module *owner;
122 struct file_system_type * next;
123 struct list_head fs_supers;
124 struct lock_class_key s_lock_key;
125 struct lock_class_key s_umount_key;
126 };
127
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000128``name``
129 the name of the filesystem type, such as "ext2", "iso9660",
Linus Torvalds1da177e2005-04-16 15:20:36 -0700130 "msdos" and so on
131
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000132``fs_flags``
133 various flags (i.e. FS_REQUIRES_DEV, FS_NO_DCACHE, etc.)
Linus Torvalds1da177e2005-04-16 15:20:36 -0700134
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000135``mount``
136 the method to call when a new instance of this filesystem should
137 be mounted
Linus Torvalds1da177e2005-04-16 15:20:36 -0700138
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000139``kill_sb``
140 the method to call when an instance of this filesystem should be
141 shut down
Linus Torvalds1da177e2005-04-16 15:20:36 -0700142
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700143
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000144``owner``
145 for internal VFS use: you should initialize this to THIS_MODULE
146 in most cases.
147
148``next``
149 for internal VFS use: you should initialize this to NULL
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700150
Borislav Petkov0746aec2007-07-15 23:41:19 -0700151 s_lock_key, s_umount_key: lockdep-specific
152
Al Viro1a102ff2011-03-16 09:07:58 -0400153The mount() method has the following arguments:
Linus Torvalds1da177e2005-04-16 15:20:36 -0700154
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000155``struct file_system_type *fs_type``
156 describes the filesystem, partly initialized by the specific
157 filesystem code
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700158
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000159``int flags``
160 mount flags
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700161
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000162``const char *dev_name``
163 the device name we are mounting.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700164
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000165``void *data``
166 arbitrary mount options, usually comes as an ASCII string (see
167 "Mount Options" section)
Linus Torvalds1da177e2005-04-16 15:20:36 -0700168
Al Viro1a102ff2011-03-16 09:07:58 -0400169The mount() method must return the root dentry of the tree requested by
170caller. An active reference to its superblock must be grabbed and the
171superblock must be locked. On failure it should return ERR_PTR(error).
Linus Torvalds1da177e2005-04-16 15:20:36 -0700172
Tobin C. Harding90caa782019-05-15 10:29:07 +1000173The arguments match those of mount(2) and their interpretation depends
174on filesystem type. E.g. for block filesystems, dev_name is interpreted
175as block device name, that device is opened and if it contains a
176suitable filesystem image the method creates and initializes struct
177super_block accordingly, returning its root dentry to caller.
Al Viro1a102ff2011-03-16 09:07:58 -0400178
179->mount() may choose to return a subtree of existing filesystem - it
180doesn't have to create a new one. The main result from the caller's
Tobin C. Harding90caa782019-05-15 10:29:07 +1000181point of view is a reference to dentry at the root of (sub)tree to be
182attached; creation of new superblock is a common side effect.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700183
Tobin C. Harding90caa782019-05-15 10:29:07 +1000184The most interesting member of the superblock structure that the mount()
185method fills in is the "s_op" field. This is a pointer to a "struct
186super_operations" which describes the next level of the filesystem
187implementation.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700188
Al Viro1a102ff2011-03-16 09:07:58 -0400189Usually, a filesystem uses one of the generic mount() implementations
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000190and provides a fill_super() callback instead. The generic variants are:
Linus Torvalds1da177e2005-04-16 15:20:36 -0700191
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000192``mount_bdev``
193 mount a filesystem residing on a block device
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700194
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000195``mount_nodev``
196 mount a filesystem that is not backed by a device
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700197
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000198``mount_single``
199 mount a filesystem which shares the instance between all mounts
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700200
Al Viro1a102ff2011-03-16 09:07:58 -0400201A fill_super() callback implementation has the following arguments:
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700202
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000203``struct super_block *sb``
204 the superblock structure. The callback must initialize this
205 properly.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700206
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000207``void *data``
208 arbitrary mount options, usually comes as an ASCII string (see
209 "Mount Options" section)
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700210
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000211``int silent``
212 whether or not to be silent on error
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700213
214
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800215The Superblock Object
216=====================
217
218A superblock object represents a mounted filesystem.
219
220
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700221struct super_operations
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800222-----------------------
Linus Torvalds1da177e2005-04-16 15:20:36 -0700223
224This describes how the VFS can manipulate the superblock of your
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000225filesystem. As of kernel 2.6.22, the following members are defined:
Linus Torvalds1da177e2005-04-16 15:20:36 -0700226
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000227.. code-block:: c
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700228
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000229 struct super_operations {
230 struct inode *(*alloc_inode)(struct super_block *sb);
231 void (*destroy_inode)(struct inode *);
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700232
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000233 void (*dirty_inode) (struct inode *, int flags);
234 int (*write_inode) (struct inode *, int);
235 void (*drop_inode) (struct inode *);
236 void (*delete_inode) (struct inode *);
237 void (*put_super) (struct super_block *);
238 int (*sync_fs)(struct super_block *sb, int wait);
239 int (*freeze_fs) (struct super_block *);
240 int (*unfreeze_fs) (struct super_block *);
241 int (*statfs) (struct dentry *, struct kstatfs *);
242 int (*remount_fs) (struct super_block *, int *, char *);
243 void (*clear_inode) (struct inode *);
244 void (*umount_begin) (struct super_block *);
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700245
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000246 int (*show_options)(struct seq_file *, struct dentry *);
247
248 ssize_t (*quota_read)(struct super_block *, int, char *, size_t, loff_t);
249 ssize_t (*quota_write)(struct super_block *, int, const char *, size_t, loff_t);
250 int (*nr_cached_objects)(struct super_block *);
251 void (*free_cached_objects)(struct super_block *, int);
252 };
Linus Torvalds1da177e2005-04-16 15:20:36 -0700253
254All methods are called without any locks being held, unless otherwise
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000255noted. This means that most methods can block safely. All methods are
Linus Torvalds1da177e2005-04-16 15:20:36 -0700256only called from a process context (i.e. not from an interrupt handler
257or bottom half).
258
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000259``alloc_inode``
260 this method is called by alloc_inode() to allocate memory for
261 struct inode and initialize it. If this function is not
Tobin C. Harding50c1f432019-05-15 10:29:05 +1000262 defined, a simple 'struct inode' is allocated. Normally
263 alloc_inode will be used to allocate a larger structure which
264 contains a 'struct inode' embedded within it.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700265
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000266``destroy_inode``
267 this method is called by destroy_inode() to release resources
268 allocated for struct inode. It is only required if
Tobin C. Harding50c1f432019-05-15 10:29:05 +1000269 ->alloc_inode was defined and simply undoes anything done by
NeilBrown341546f2006-03-25 03:07:56 -0800270 ->alloc_inode.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700271
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000272``dirty_inode``
Eric Biggersa38ed482021-01-12 11:02:48 -0800273 this method is called by the VFS when an inode is marked dirty.
274 This is specifically for the inode itself being marked dirty,
275 not its data. If the update needs to be persisted by fdatasync(),
276 then I_DIRTY_DATASYNC will be set in the flags argument.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700277
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000278``write_inode``
279 this method is called when the VFS needs to write an inode to
280 disc. The second parameter indicates whether the write should
281 be synchronous or not, not all filesystems check this flag.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700282
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000283``drop_inode``
284 called when the last access to the inode is dropped, with the
285 inode->i_lock spinlock held.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700286
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700287 This method should be either NULL (normal UNIX filesystem
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000288 semantics) or "generic_delete_inode" (for filesystems that do
289 not want to cache inodes - causing "delete_inode" to always be
Linus Torvalds1da177e2005-04-16 15:20:36 -0700290 called regardless of the value of i_nlink)
291
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000292 The "generic_delete_inode()" behavior is equivalent to the old
293 practice of using "force_delete" in the put_inode() case, but
294 does not have the races that the "force_delete()" approach had.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700295
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000296``delete_inode``
297 called when the VFS wants to delete an inode
Linus Torvalds1da177e2005-04-16 15:20:36 -0700298
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000299``put_super``
300 called when the VFS wishes to free the superblock
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000301 (i.e. unmount). This is called with the superblock lock held
Linus Torvalds1da177e2005-04-16 15:20:36 -0700302
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000303``sync_fs``
304 called when VFS is writing out all dirty data associated with a
305 superblock. The second parameter indicates whether the method
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000306 should wait until the write out has been completed. Optional.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700307
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000308``freeze_fs``
309 called when VFS is locking a filesystem and forcing it into a
310 consistent state. This method is currently used by the Logical
311 Volume Manager (LVM).
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700312
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000313``unfreeze_fs``
314 called when VFS is unlocking a filesystem and making it writable
Tobin C. Harding50c1f432019-05-15 10:29:05 +1000315 again.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700316
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000317``statfs``
318 called when the VFS needs to get filesystem statistics.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700319
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000320``remount_fs``
321 called when the filesystem is remounted. This is called with
322 the kernel lock held
Linus Torvalds1da177e2005-04-16 15:20:36 -0700323
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000324``clear_inode``
325 called then the VFS clears the inode. Optional
Linus Torvalds1da177e2005-04-16 15:20:36 -0700326
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000327``umount_begin``
328 called when the VFS is unmounting a filesystem.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700329
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000330``show_options``
331 called by the VFS to show mount options for /proc/<pid>/mounts.
332 (see "Mount Options" section)
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700333
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000334``quota_read``
335 called by the VFS to read from filesystem quota file.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700336
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000337``quota_write``
338 called by the VFS to write to filesystem quota file.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700339
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000340``nr_cached_objects``
341 called by the sb cache shrinking function for the filesystem to
342 return the number of freeable cached objects it contains.
Dave Chinner0e1fdaf2011-07-08 14:14:44 +1000343 Optional.
344
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000345``free_cache_objects``
346 called by the sb cache shrinking function for the filesystem to
347 scan the number of objects indicated to try to free them.
348 Optional, but any filesystem implementing this method needs to
349 also implement ->nr_cached_objects for it to be called
350 correctly.
Dave Chinner0e1fdaf2011-07-08 14:14:44 +1000351
352 We can't do anything with any errors that the filesystem might
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000353 encountered, hence the void return type. This will never be
354 called if the VM is trying to reclaim under GFP_NOFS conditions,
355 hence this method does not need to handle that situation itself.
Dave Chinner0e1fdaf2011-07-08 14:14:44 +1000356
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000357 Implementations must include conditional reschedule calls inside
358 any scanning loop that is done. This allows the VFS to
359 determine appropriate scan batch sizes without having to worry
360 about whether implementations will cause holdoff problems due to
361 large scan batch sizes.
Dave Chinner8ab47662011-07-08 14:14:45 +1000362
Tobin C. Harding90caa782019-05-15 10:29:07 +1000363Whoever sets up the inode is responsible for filling in the "i_op"
364field. This is a pointer to a "struct inode_operations" which describes
365the methods that can be performed on individual inodes.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700366
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +1000367
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200368struct xattr_handlers
369---------------------
370
371On filesystems that support extended attributes (xattrs), the s_xattr
Tobin C. Harding90caa782019-05-15 10:29:07 +1000372superblock field points to a NULL-terminated array of xattr handlers.
373Extended attributes are name:value pairs.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200374
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000375``name``
376 Indicates that the handler matches attributes with the specified
377 name (such as "system.posix_acl_access"); the prefix field must
378 be NULL.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200379
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000380``prefix``
381 Indicates that the handler matches all attributes with the
382 specified name prefix (such as "user."); the name field must be
383 NULL.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200384
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000385``list``
386 Determine if attributes matching this xattr handler should be
387 listed for a particular dentry. Used by some listxattr
388 implementations like generic_listxattr.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200389
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000390``get``
391 Called by the VFS to get the value of a particular extended
392 attribute. This method is called by the getxattr(2) system
393 call.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200394
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000395``set``
396 Called by the VFS to set the value of a particular extended
397 attribute. When the new value is NULL, called to remove a
Randy Dunlap8286de72020-07-03 14:43:25 -0700398 particular extended attribute. This method is called by the
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000399 setxattr(2) and removexattr(2) system calls.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200400
Tobin C. Harding90caa782019-05-15 10:29:07 +1000401When none of the xattr handlers of a filesystem match the specified
402attribute name or when a filesystem doesn't support extended attributes,
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000403the various ``*xattr(2)`` system calls return -EOPNOTSUPP.
Andreas Gruenbacher6c6ef9f2016-09-29 17:48:44 +0200404
Linus Torvalds1da177e2005-04-16 15:20:36 -0700405
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800406The Inode Object
407================
408
409An inode object represents an object within the filesystem.
410
411
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700412struct inode_operations
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800413-----------------------
Linus Torvalds1da177e2005-04-16 15:20:36 -0700414
Tobin C. Harding90caa782019-05-15 10:29:07 +1000415This describes how the VFS can manipulate an inode in your filesystem.
416As of kernel 2.6.22, the following members are defined:
Linus Torvalds1da177e2005-04-16 15:20:36 -0700417
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000418.. code-block:: c
419
420 struct inode_operations {
Christian Brauner549c7292021-01-21 14:19:43 +0100421 int (*create) (struct user_namespace *, struct inode *,struct dentry *, umode_t, bool);
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000422 struct dentry * (*lookup) (struct inode *,struct dentry *, unsigned int);
423 int (*link) (struct dentry *,struct inode *,struct dentry *);
424 int (*unlink) (struct inode *,struct dentry *);
Christian Brauner549c7292021-01-21 14:19:43 +0100425 int (*symlink) (struct user_namespace *, struct inode *,struct dentry *,const char *);
426 int (*mkdir) (struct user_namespace *, struct inode *,struct dentry *,umode_t);
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000427 int (*rmdir) (struct inode *,struct dentry *);
Christian Brauner549c7292021-01-21 14:19:43 +0100428 int (*mknod) (struct user_namespace *, struct inode *,struct dentry *,umode_t,dev_t);
429 int (*rename) (struct user_namespace *, struct inode *, struct dentry *,
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000430 struct inode *, struct dentry *, unsigned int);
431 int (*readlink) (struct dentry *, char __user *,int);
432 const char *(*get_link) (struct dentry *, struct inode *,
433 struct delayed_call *);
Christian Brauner549c7292021-01-21 14:19:43 +0100434 int (*permission) (struct user_namespace *, struct inode *, int);
Miklos Szeredi0cad6242021-08-18 22:08:24 +0200435 struct posix_acl * (*get_acl)(struct inode *, int, bool);
Christian Brauner549c7292021-01-21 14:19:43 +0100436 int (*setattr) (struct user_namespace *, struct dentry *, struct iattr *);
437 int (*getattr) (struct user_namespace *, const struct path *, struct kstat *, u32, unsigned int);
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000438 ssize_t (*listxattr) (struct dentry *, char *, size_t);
439 void (*update_time)(struct inode *, struct timespec *, int);
440 int (*atomic_open)(struct inode *, struct dentry *, struct file *,
441 unsigned open_flag, umode_t create_mode);
Christian Brauner549c7292021-01-21 14:19:43 +0100442 int (*tmpfile) (struct user_namespace *, struct inode *, struct dentry *, umode_t);
443 int (*set_acl)(struct user_namespace *, struct inode *, struct posix_acl *, int);
Miklos Szeredi4c5b4792021-04-07 14:36:42 +0200444 int (*fileattr_set)(struct user_namespace *mnt_userns,
445 struct dentry *dentry, struct fileattr *fa);
446 int (*fileattr_get)(struct dentry *dentry, struct fileattr *fa);
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000447 };
Linus Torvalds1da177e2005-04-16 15:20:36 -0700448
449Again, all methods are called without any locks being held, unless
450otherwise noted.
451
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000452``create``
453 called by the open(2) and creat(2) system calls. Only required
454 if you want to support regular files. The dentry you get should
455 not have an inode (i.e. it should be a negative dentry). Here
456 you will probably call d_instantiate() with the dentry and the
457 newly created inode
Linus Torvalds1da177e2005-04-16 15:20:36 -0700458
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000459``lookup``
460 called when the VFS needs to look up an inode in a parent
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000461 directory. The name to look for is found in the dentry. This
Linus Torvalds1da177e2005-04-16 15:20:36 -0700462 method must call d_add() to insert the found inode into the
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000463 dentry. The "i_count" field in the inode structure should be
464 incremented. If the named inode does not exist a NULL inode
Linus Torvalds1da177e2005-04-16 15:20:36 -0700465 should be inserted into the dentry (this is called a negative
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000466 dentry). Returning an error code from this routine must only be
467 done on a real error, otherwise creating inodes with system
Linus Torvalds1da177e2005-04-16 15:20:36 -0700468 calls like create(2), mknod(2), mkdir(2) and so on will fail.
469 If you wish to overload the dentry methods then you should
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000470 initialise the "d_dop" field in the dentry; this is a pointer to
471 a struct "dentry_operations". This method is called with the
472 directory inode semaphore held
Linus Torvalds1da177e2005-04-16 15:20:36 -0700473
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000474``link``
475 called by the link(2) system call. Only required if you want to
476 support hard links. You will probably need to call
Linus Torvalds1da177e2005-04-16 15:20:36 -0700477 d_instantiate() just as you would in the create() method
478
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000479``unlink``
480 called by the unlink(2) system call. Only required if you want
481 to support deleting inodes
Linus Torvalds1da177e2005-04-16 15:20:36 -0700482
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000483``symlink``
484 called by the symlink(2) system call. Only required if you want
485 to support symlinks. You will probably need to call
Linus Torvalds1da177e2005-04-16 15:20:36 -0700486 d_instantiate() just as you would in the create() method
487
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000488``mkdir``
489 called by the mkdir(2) system call. Only required if you want
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000490 to support creating subdirectories. You will probably need to
Linus Torvalds1da177e2005-04-16 15:20:36 -0700491 call d_instantiate() just as you would in the create() method
492
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000493``rmdir``
494 called by the rmdir(2) system call. Only required if you want
Linus Torvalds1da177e2005-04-16 15:20:36 -0700495 to support deleting subdirectories
496
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000497``mknod``
498 called by the mknod(2) system call to create a device (char,
499 block) inode or a named pipe (FIFO) or socket. Only required if
500 you want to support creating these types of inodes. You will
501 probably need to call d_instantiate() just as you would in the
502 create() method
Linus Torvalds1da177e2005-04-16 15:20:36 -0700503
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000504``rename``
505 called by the rename(2) system call to rename the object to have
506 the parent and name given by the second inode and dentry.
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800507
Miklos Szeredi18fc84d2016-09-27 11:03:58 +0200508 The filesystem must return -EINVAL for any unsupported or
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000509 unknown flags. Currently the following flags are implemented:
510 (1) RENAME_NOREPLACE: this flag indicates that if the target of
511 the rename exists the rename should fail with -EEXIST instead of
512 replacing the target. The VFS already checks for existence, so
513 for local filesystems the RENAME_NOREPLACE implementation is
514 equivalent to plain rename.
Miklos Szeredi520c8b12014-04-01 17:08:42 +0200515 (2) RENAME_EXCHANGE: exchange source and target. Both must
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000516 exist; this is checked by the VFS. Unlike plain rename, source
517 and target may be of different type.
Miklos Szeredi520c8b12014-04-01 17:08:42 +0200518
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000519``get_link``
520 called by the VFS to follow a symbolic link to the inode it
521 points to. Only required if you want to support symbolic links.
522 This method returns the symlink body to traverse (and possibly
523 resets the current position with nd_jump_link()). If the body
524 won't go away until the inode is gone, nothing else is needed;
525 if it needs to be otherwise pinned, arrange for its release by
526 having get_link(..., ..., done) do set_delayed_call(done,
527 destructor, argument). In that case destructor(argument) will
528 be called once VFS is done with the body you've returned. May
529 be called in RCU mode; that is indicated by NULL dentry
Al Virofceef392015-12-29 15:58:39 -0500530 argument. If request can't be handled without leaving RCU mode,
531 have it return ERR_PTR(-ECHILD).
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700532
Eric Biggersdcb2cb12019-04-11 16:16:28 -0700533 If the filesystem stores the symlink target in ->i_link, the
534 VFS may use it directly without calling ->get_link(); however,
535 ->get_link() must still be provided. ->i_link must not be
536 freed until after an RCU grace period. Writing to ->i_link
537 post-iget() time requires a 'release' memory barrier.
538
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000539``readlink``
540 this is now just an override for use by readlink(2) for the
Miklos Szeredi76fca902016-12-09 16:45:04 +0100541 cases when ->get_link uses nd_jump_link() or object is not in
542 fact a symlink. Normally filesystems should only implement
543 ->get_link for symlinks and readlink(2) will automatically use
544 that.
545
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000546``permission``
547 called by the VFS to check for access rights on a POSIX-like
Tobin C. Harding50c1f432019-05-15 10:29:05 +1000548 filesystem.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700549
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000550 May be called in rcu-walk mode (mask & MAY_NOT_BLOCK). If in
551 rcu-walk mode, the filesystem must check the permission without
552 blocking or storing to the inode.
Nick Pigginb74c79e2011-01-07 17:49:58 +1100553
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000554 If a situation is encountered that rcu-walk cannot handle,
555 return
Nick Pigginb74c79e2011-01-07 17:49:58 +1100556 -ECHILD and it will be called again in ref-walk mode.
557
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000558``setattr``
559 called by the VFS to set attributes for a file. This method is
560 called by chmod(2) and related system calls.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700561
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000562``getattr``
563 called by the VFS to get attributes of a file. This method is
564 called by stat(2) and related system calls.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700565
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000566``listxattr``
567 called by the VFS to list all extended attributes for a given
568 file. This method is called by the listxattr(2) system call.
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800569
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000570``update_time``
571 called by the VFS to update a specific time or the i_version of
572 an inode. If this is not defined the VFS will update the inode
573 itself and call mark_inode_dirty_sync.
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800574
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000575``atomic_open``
576 called on the last component of an open. Using this optional
577 method the filesystem can look up, possibly create and open the
578 file in one atomic operation. If it wants to leave actual
579 opening to the caller (e.g. if the file turned out to be a
580 symlink, device, or just something filesystem won't do atomic
581 open for), it may signal this by returning finish_no_open(file,
582 dentry). This method is only called if the last component is
583 negative or needs lookup. Cached positive dentries are still
584 handled by f_op->open(). If the file was created, FMODE_CREATED
585 flag should be set in file->f_mode. In case of O_EXCL the
586 method must only succeed if the file didn't exist and hence
587 FMODE_CREATED shall always be set on success.
Miklos Szeredid18e9002012-06-05 15:10:17 +0200588
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000589``tmpfile``
590 called in the end of O_TMPFILE open(). Optional, equivalent to
591 atomically creating, opening and unlinking a file in given
592 directory.
Al Viro48bde8d2013-07-03 16:19:23 +0400593
Miklos Szeredi4c5b4792021-04-07 14:36:42 +0200594``fileattr_get``
595 called on ioctl(FS_IOC_GETFLAGS) and ioctl(FS_IOC_FSGETXATTR) to
596 retrieve miscellaneous file flags and attributes. Also called
597 before the relevant SET operation to check what is being changed
598 (in this case with i_rwsem locked exclusive). If unset, then
599 fall back to f_op->ioctl().
600
601``fileattr_set``
602 called on ioctl(FS_IOC_SETFLAGS) and ioctl(FS_IOC_FSSETXATTR) to
603 change miscellaneous file flags and attributes. Callers hold
604 i_rwsem exclusive. If unset, then fall back to f_op->ioctl().
605
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +1000606
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800607The Address Space Object
608========================
609
NeilBrown341546f2006-03-25 03:07:56 -0800610The address space object is used to group and manage pages in the page
Tobin C. Harding90caa782019-05-15 10:29:07 +1000611cache. It can be used to keep track of the pages in a file (or anything
612else) and also track the mapping of sections of the file into process
613address spaces.
Linus Torvalds1da177e2005-04-16 15:20:36 -0700614
NeilBrown341546f2006-03-25 03:07:56 -0800615There are a number of distinct yet related services that an
Tobin C. Harding90caa782019-05-15 10:29:07 +1000616address-space can provide. These include communicating memory pressure,
617page lookup by address, and keeping track of pages tagged as Dirty or
618Writeback.
NeilBrown341546f2006-03-25 03:07:56 -0800619
NeilBrowna9e102b2006-03-25 03:08:29 -0800620The first can be used independently to the others. The VM can try to
Tobin C. Harding90caa782019-05-15 10:29:07 +1000621either write dirty pages in order to clean them, or release clean pages
622in order to reuse them. To do this it can call the ->writepage method
623on dirty pages, and ->releasepage on clean pages with PagePrivate set.
624Clean pages without PagePrivate and with no external references will be
625released without notice being given to the address_space.
NeilBrown341546f2006-03-25 03:07:56 -0800626
NeilBrowna9e102b2006-03-25 03:08:29 -0800627To achieve this functionality, pages need to be placed on an LRU with
Tobin C. Harding90caa782019-05-15 10:29:07 +1000628lru_cache_add and mark_page_active needs to be called whenever the page
629is used.
NeilBrown341546f2006-03-25 03:07:56 -0800630
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000631Pages are normally kept in a radix tree index by ->index. This tree
Tobin C. Harding90caa782019-05-15 10:29:07 +1000632maintains information about the PG_Dirty and PG_Writeback status of each
633page, so that pages with either of these flags can be found quickly.
NeilBrown341546f2006-03-25 03:07:56 -0800634
635The Dirty tag is primarily used by mpage_writepages - the default
636->writepages method. It uses the tag to find dirty pages to call
637->writepage on. If mpage_writepages is not used (i.e. the address
Tobin C. Harding90caa782019-05-15 10:29:07 +1000638provides its own ->writepages) , the PAGECACHE_TAG_DIRTY tag is almost
639unused. write_inode_now and sync_inode do use it (through
NeilBrown341546f2006-03-25 03:07:56 -0800640__sync_single_inode) to check if ->writepages has been successful in
641writing out the whole address_space.
642
Tobin C. Harding90caa782019-05-15 10:29:07 +1000643The Writeback tag is used by filemap*wait* and sync_page* functions, via
644filemap_fdatawait_range, to wait for all writeback to complete.
NeilBrown341546f2006-03-25 03:07:56 -0800645
646An address_space handler may attach extra information to a page,
647typically using the 'private' field in the 'struct page'. If such
648information is attached, the PG_Private flag should be set. This will
NeilBrowna9e102b2006-03-25 03:08:29 -0800649cause various VM routines to make extra calls into the address_space
NeilBrown341546f2006-03-25 03:07:56 -0800650handler to deal with that data.
651
652An address space acts as an intermediate between storage and
653application. Data is read into the address space a whole page at a
Tobin C. Harding90caa782019-05-15 10:29:07 +1000654time, and provided to the application either by copying of the page, or
655by memory-mapping the page. Data is written into the address space by
656the application, and then written-back to storage typically in whole
657pages, however the address_space has finer control of write sizes.
NeilBrown341546f2006-03-25 03:07:56 -0800658
659The read process essentially only requires 'readpage'. The write
Nick Piggin4e02ed42008-10-29 14:00:55 -0700660process is more complicated and uses write_begin/write_end or
Tobin C. Harding90caa782019-05-15 10:29:07 +1000661set_page_dirty to write data into the address_space, and writepage and
662writepages to writeback data to storage.
NeilBrown341546f2006-03-25 03:07:56 -0800663
664Adding and removing pages to/from an address_space is protected by the
665inode's i_mutex.
666
667When data is written to a page, the PG_Dirty flag should be set. It
668typically remains set until writepage asks for it to be written. This
Tobin C. Harding90caa782019-05-15 10:29:07 +1000669should clear PG_Dirty and set PG_Writeback. It can be actually written
670at any point after PG_Dirty is clear. Once it is known to be safe,
671PG_Writeback is cleared.
NeilBrown341546f2006-03-25 03:07:56 -0800672
Jeff Laytonacbf3c32017-07-06 07:02:27 -0400673Writeback makes use of a writeback_control structure to direct the
Randy Dunlap8286de72020-07-03 14:43:25 -0700674operations. This gives the writepage and writepages operations some
Jeff Laytonacbf3c32017-07-06 07:02:27 -0400675information about the nature of and reason for the writeback request,
676and the constraints under which it is being done. It is also used to
677return information back to the caller about the result of a writepage or
678writepages request.
679
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +1000680
Jeff Laytonacbf3c32017-07-06 07:02:27 -0400681Handling errors during writeback
682--------------------------------
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +1000683
Jeff Laytonacbf3c32017-07-06 07:02:27 -0400684Most applications that do buffered I/O will periodically call a file
685synchronization call (fsync, fdatasync, msync or sync_file_range) to
686ensure that data written has made it to the backing store. When there
687is an error during writeback, they expect that error to be reported when
688a file sync request is made. After an error has been reported on one
689request, subsequent requests on the same file descriptor should return
6900, unless further writeback errors have occurred since the previous file
691syncronization.
692
693Ideally, the kernel would report errors only on file descriptions on
694which writes were done that subsequently failed to be written back. The
695generic pagecache infrastructure does not track the file descriptions
696that have dirtied each individual page however, so determining which
697file descriptors should get back an error is not possible.
698
699Instead, the generic writeback error tracking infrastructure in the
700kernel settles for reporting errors to fsync on all file descriptions
701that were open at the time that the error occurred. In a situation with
Tobin C. Harding90caa782019-05-15 10:29:07 +1000702multiple writers, all of them will get back an error on a subsequent
703fsync, even if all of the writes done through that particular file
704descriptor succeeded (or even if there were no writes on that file
705descriptor at all).
Jeff Laytonacbf3c32017-07-06 07:02:27 -0400706
707Filesystems that wish to use this infrastructure should call
708mapping_set_error to record the error in the address_space when it
709occurs. Then, after writing back data from the pagecache in their
710file->fsync operation, they should call file_check_and_advance_wb_err to
711ensure that the struct file's error cursor has advanced to the correct
712point in the stream of errors emitted by the backing device(s).
Linus Torvalds1da177e2005-04-16 15:20:36 -0700713
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +1000714
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700715struct address_space_operations
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800716-------------------------------
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700717
Tobin C. Harding90caa782019-05-15 10:29:07 +1000718This describes how the VFS can manipulate mapping of a file to page
719cache in your filesystem. The following members are defined:
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700720
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000721.. code-block:: c
722
723 struct address_space_operations {
724 int (*writepage)(struct page *page, struct writeback_control *wbc);
725 int (*readpage)(struct file *, struct page *);
726 int (*writepages)(struct address_space *, struct writeback_control *);
727 int (*set_page_dirty)(struct page *page);
Matthew Wilcox (Oracle)8151b4c2020-06-01 21:46:44 -0700728 void (*readahead)(struct readahead_control *);
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000729 int (*readpages)(struct file *filp, struct address_space *mapping,
730 struct list_head *pages, unsigned nr_pages);
731 int (*write_begin)(struct file *, struct address_space *mapping,
732 loff_t pos, unsigned len, unsigned flags,
Nick Pigginafddba42007-10-16 01:25:01 -0700733 struct page **pagep, void **fsdata);
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000734 int (*write_end)(struct file *, struct address_space *mapping,
735 loff_t pos, unsigned len, unsigned copied,
736 struct page *page, void *fsdata);
737 sector_t (*bmap)(struct address_space *, sector_t);
738 void (*invalidatepage) (struct page *, unsigned int, unsigned int);
739 int (*releasepage) (struct page *, int);
740 void (*freepage)(struct page *);
741 ssize_t (*direct_IO)(struct kiocb *, struct iov_iter *iter);
742 /* isolate a page for migration */
743 bool (*isolate_page) (struct page *, isolate_mode_t);
744 /* migrate the contents of a page to the specified target */
745 int (*migratepage) (struct page *, struct page *);
746 /* put migration-failed page back to right list */
747 void (*putback_page) (struct page *);
748 int (*launder_page) (struct page *);
Minchan Kimbda807d2016-07-26 15:23:05 -0700749
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000750 int (*is_partially_uptodate) (struct page *, unsigned long,
751 unsigned long);
752 void (*is_dirty_writeback) (struct page *, bool *, bool *);
753 int (*error_remove_page) (struct mapping *mapping, struct page *page);
754 int (*swap_activate)(struct file *);
755 int (*swap_deactivate)(struct file *);
756 };
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700757
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000758``writepage``
759 called by the VM to write a dirty page to backing store. This
760 may happen for data integrity reasons (i.e. 'sync'), or to free
761 up memory (flush). The difference can be seen in
762 wbc->sync_mode. The PG_Dirty flag has been cleared and
763 PageLocked is true. writepage should start writeout, should set
764 PG_Writeback, and should make sure the page is unlocked, either
765 synchronously or asynchronously when the write operation
766 completes.
NeilBrown341546f2006-03-25 03:07:56 -0800767
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000768 If wbc->sync_mode is WB_SYNC_NONE, ->writepage doesn't have to
769 try too hard if there are problems, and may choose to write out
770 other pages from the mapping if that is easier (e.g. due to
771 internal dependencies). If it chooses not to start writeout, it
772 should return AOP_WRITEPAGE_ACTIVATE so that the VM will not
773 keep calling ->writepage on that page.
NeilBrown341546f2006-03-25 03:07:56 -0800774
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000775 See the file "Locking" for more details.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700776
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000777``readpage``
778 called by the VM to read a page from backing store. The page
779 will be Locked when readpage is called, and should be unlocked
780 and marked uptodate once the read completes. If ->readpage
781 discovers that it needs to unlock the page for some reason, it
782 can do so, and then return AOP_TRUNCATED_PAGE. In this case,
783 the page will be relocated, relocked and if that all succeeds,
784 ->readpage will be called again.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700785
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000786``writepages``
787 called by the VM to write out pages associated with the
Julia Lawalle9b2f152020-07-26 21:22:21 +0200788 address_space object. If wbc->sync_mode is WB_SYNC_ALL, then
Tobin C. Harding50c1f432019-05-15 10:29:05 +1000789 the writeback_control will specify a range of pages that must be
Julia Lawalle9b2f152020-07-26 21:22:21 +0200790 written out. If it is WB_SYNC_NONE, then a nr_to_write is
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000791 given and that many pages should be written if possible. If no
792 ->writepages is given, then mpage_writepages is used instead.
793 This will choose pages from the address space that are tagged as
794 DIRTY and will pass them to ->writepage.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700795
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000796``set_page_dirty``
797 called by the VM to set a page dirty. This is particularly
798 needed if an address space attaches private data to a page, and
799 that data needs to be updated when a page is dirtied. This is
800 called, for example, when a memory mapped page gets modified.
NeilBrown341546f2006-03-25 03:07:56 -0800801 If defined, it should set the PageDirty flag, and the
Tobin C. Harding1b44ae62019-05-15 10:29:12 +1000802 PAGECACHE_TAG_DIRTY tag in the radix tree.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700803
Matthew Wilcox (Oracle)8151b4c2020-06-01 21:46:44 -0700804``readahead``
805 Called by the VM to read pages associated with the address_space
806 object. The pages are consecutive in the page cache and are
807 locked. The implementation should decrement the page refcount
808 after starting I/O on each page. Usually the page will be
809 unlocked by the I/O completion handler. If the filesystem decides
810 to stop attempting I/O before reaching the end of the readahead
811 window, it can simply return. The caller will decrement the page
812 refcount and unlock the remaining pages for you. Set PageUptodate
813 if the I/O completes successfully. Setting PageError on any page
814 will be ignored; simply unlock the page if an I/O error occurs.
815
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000816``readpages``
817 called by the VM to read pages associated with the address_space
818 object. This is essentially just a vector version of readpage.
819 Instead of just one page, several pages are requested.
NeilBrowna9e102b2006-03-25 03:08:29 -0800820 readpages is only used for read-ahead, so read errors are
Tobin C. Harding50c1f432019-05-15 10:29:05 +1000821 ignored. If anything goes wrong, feel free to give up.
Matthew Wilcox (Oracle)8151b4c2020-06-01 21:46:44 -0700822 This interface is deprecated and will be removed by the end of
823 2020; implement readahead instead.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700824
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000825``write_begin``
826 Called by the generic buffered write code to ask the filesystem
827 to prepare to write len bytes at the given offset in the file.
828 The address_space should check that the write will be able to
829 complete, by allocating space if necessary and doing any other
830 internal housekeeping. If the write will update parts of any
831 basic-blocks on storage, then those blocks should be pre-read
832 (if they haven't been read already) so that the updated blocks
833 can be written out properly.
Nick Pigginafddba42007-10-16 01:25:01 -0700834
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000835 The filesystem must return the locked pagecache page for the
836 specified offset, in ``*pagep``, for the caller to write into.
Nick Pigginafddba42007-10-16 01:25:01 -0700837
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000838 It must be able to cope with short writes (where the length
839 passed to write_begin is greater than the number of bytes copied
840 into the page).
Nick Piggin4e02ed42008-10-29 14:00:55 -0700841
Nick Pigginafddba42007-10-16 01:25:01 -0700842 flags is a field for AOP_FLAG_xxx flags, described in
843 include/linux/fs.h.
844
Tobin C. Harding1b44ae62019-05-15 10:29:12 +1000845 A void * may be returned in fsdata, which then gets passed into
846 write_end.
Nick Pigginafddba42007-10-16 01:25:01 -0700847
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000848 Returns 0 on success; < 0 on failure (which is the error code),
849 in which case write_end is not called.
Nick Pigginafddba42007-10-16 01:25:01 -0700850
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000851``write_end``
852 After a successful write_begin, and data copy, write_end must be
853 called. len is the original len passed to write_begin, and
854 copied is the amount that was able to be copied.
Nick Pigginafddba42007-10-16 01:25:01 -0700855
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000856 The filesystem must take care of unlocking the page and
857 releasing it refcount, and updating i_size.
Nick Pigginafddba42007-10-16 01:25:01 -0700858
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000859 Returns < 0 on failure, otherwise the number of bytes (<=
860 'copied') that were able to be copied into pagecache.
Nick Pigginafddba42007-10-16 01:25:01 -0700861
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000862``bmap``
863 called by the VFS to map a logical block offset within object to
864 physical block number. This method is used by the FIBMAP ioctl
865 and for working with swap-files. To be able to swap to a file,
866 the file must have a stable mapping to a block device. The swap
867 system does not go through the filesystem but instead uses bmap
868 to find out where the blocks in the file are and uses those
869 addresses directly.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700870
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000871``invalidatepage``
872 If a page has PagePrivate set, then invalidatepage will be
873 called when part or all of the page is to be removed from the
874 address space. This generally corresponds to either a
875 truncation, punch hole or a complete invalidation of the address
Lukas Czernerd47992f2013-05-21 23:17:23 -0400876 space (in the latter case 'offset' will always be 0 and 'length'
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000877 will be PAGE_SIZE). Any private data associated with the page
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000878 should be updated to reflect this truncation. If offset is 0
879 and length is PAGE_SIZE, then the private data should be
880 released, because the page must be able to be completely
881 discarded. This may be done by calling the ->releasepage
882 function, but in this case the release MUST succeed.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700883
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000884``releasepage``
885 releasepage is called on PagePrivate pages to indicate that the
886 page should be freed if possible. ->releasepage should remove
887 any private data from the page and clear the PagePrivate flag.
888 If releasepage() fails for some reason, it must indicate failure
889 with a 0 return value. releasepage() is used in two distinct
890 though related cases. The first is when the VM finds a clean
891 page with no active users and wants to make it a free page. If
892 ->releasepage succeeds, the page will be removed from the
893 address_space and become free.
NeilBrown341546f2006-03-25 03:07:56 -0800894
Shaun Zinckbc5b1d52007-10-20 02:35:36 +0200895 The second case is when a request has been made to invalidate
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000896 some or all pages in an address_space. This can happen through
897 the fadvise(POSIX_FADV_DONTNEED) system call or by the
898 filesystem explicitly requesting it as nfs and 9fs do (when they
899 believe the cache may be out of date with storage) by calling
900 invalidate_inode_pages2(). If the filesystem makes such a call,
901 and needs to be certain that all pages are invalidated, then its
902 releasepage will need to ensure this. Possibly it can clear the
903 PageUptodate bit if it cannot free private data yet.
NeilBrown341546f2006-03-25 03:07:56 -0800904
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000905``freepage``
906 freepage is called once the page is no longer visible in the
907 page cache in order to allow the cleanup of any private data.
908 Since it may be called by the memory reclaimer, it should not
909 assume that the original address_space mapping still exists, and
910 it should not block.
Linus Torvalds6072d132010-12-01 13:35:19 -0500911
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000912``direct_IO``
913 called by the generic read/write routines to perform direct_IO -
914 that is IO requests which bypass the page cache and transfer
915 data directly between the storage and the application's address
916 space.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700917
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000918``isolate_page``
919 Called by the VM when isolating a movable non-lru page. If page
920 is successfully isolated, VM marks the page as PG_isolated via
921 __SetPageIsolated.
Minchan Kimbda807d2016-07-26 15:23:05 -0700922
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000923``migrate_page``
924 This is used to compact the physical memory usage. If the VM
925 wants to relocate a page (maybe off a memory card that is
926 signalling imminent failure) it will pass a new page and an old
927 page to this function. migrate_page should transfer any private
928 data across and update any references that it has to the page.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700929
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000930``putback_page``
931 Called by the VM when isolated page's migration fails.
Minchan Kimbda807d2016-07-26 15:23:05 -0700932
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000933``launder_page``
934 Called before freeing a page - it writes back the dirty page.
935 To prevent redirtying the page, it is kept locked during the
936 whole operation.
Borislav Petkov422b14c2007-07-15 23:41:43 -0700937
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000938``is_partially_uptodate``
939 Called by the VM when reading a file through the pagecache when
940 the underlying blocksize != pagesize. If the required block is
941 up to date then the read can complete without needing the IO to
942 bring the whole page up to date.
Mel Gorman26c0c5b2013-07-03 15:04:45 -0700943
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000944``is_dirty_writeback``
945 Called by the VM when attempting to reclaim a page. The VM uses
946 dirty and writeback information to determine if it needs to
947 stall to allow flushers a chance to complete some IO.
948 Ordinarily it can use PageDirty and PageWriteback but some
949 filesystems have more complex state (unstable pages in NFS
950 prevent reclaim) or do not set those flags due to locking
951 problems. This callback allows a filesystem to indicate to the
952 VM if a page should be treated as dirty or writeback for the
953 purposes of stalling.
Mel Gorman543cc112013-07-03 15:04:46 -0700954
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000955``error_remove_page``
956 normally set to generic_error_remove_page if truncation is ok
957 for this address space. Used for memory failure handling.
Andi Kleen25718732009-09-16 11:50:13 +0200958 Setting this implies you deal with pages going away under you,
959 unless you have them locked or reference counts increased.
960
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000961``swap_activate``
962 Called when swapon is used on a file to allocate space if
963 necessary and pin the block lookup information in memory. A
964 return value of zero indicates success, in which case this file
965 can be used to back swapspace.
Mel Gorman62c230b2012-07-31 16:44:55 -0700966
Tobin C. Hardingee5dc042019-06-04 10:26:56 +1000967``swap_deactivate``
968 Called during swapoff on files where swap_activate was
969 successful.
Mel Gorman62c230b2012-07-31 16:44:55 -0700970
Andi Kleen25718732009-09-16 11:50:13 +0200971
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800972The File Object
973===============
974
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000975A file object represents a file opened by a process. This is also known
Jeff Laytonacbf3c32017-07-06 07:02:27 -0400976as an "open file description" in POSIX parlance.
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800977
978
Pekka J Enberg5ea626a2005-09-09 13:10:19 -0700979struct file_operations
Pekka Enbergcc7d1f82005-11-07 01:01:08 -0800980----------------------
Linus Torvalds1da177e2005-04-16 15:20:36 -0700981
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +1000982This describes how the VFS can manipulate an open file. As of kernel
Amir Goldstein17ef4452018-08-27 15:56:01 +03009834.18, the following members are defined:
Linus Torvalds1da177e2005-04-16 15:20:36 -0700984
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +1000985.. code-block:: c
986
987 struct file_operations {
988 struct module *owner;
989 loff_t (*llseek) (struct file *, loff_t, int);
990 ssize_t (*read) (struct file *, char __user *, size_t, loff_t *);
991 ssize_t (*write) (struct file *, const char __user *, size_t, loff_t *);
992 ssize_t (*read_iter) (struct kiocb *, struct iov_iter *);
993 ssize_t (*write_iter) (struct kiocb *, struct iov_iter *);
994 int (*iopoll)(struct kiocb *kiocb, bool spin);
995 int (*iterate) (struct file *, struct dir_context *);
996 int (*iterate_shared) (struct file *, struct dir_context *);
997 __poll_t (*poll) (struct file *, struct poll_table_struct *);
998 long (*unlocked_ioctl) (struct file *, unsigned int, unsigned long);
999 long (*compat_ioctl) (struct file *, unsigned int, unsigned long);
1000 int (*mmap) (struct file *, struct vm_area_struct *);
1001 int (*open) (struct inode *, struct file *);
1002 int (*flush) (struct file *, fl_owner_t id);
1003 int (*release) (struct inode *, struct file *);
1004 int (*fsync) (struct file *, loff_t, loff_t, int datasync);
1005 int (*fasync) (int, struct file *, int);
1006 int (*lock) (struct file *, int, struct file_lock *);
1007 ssize_t (*sendpage) (struct file *, struct page *, int, size_t, loff_t *, int);
1008 unsigned long (*get_unmapped_area)(struct file *, unsigned long, unsigned long, unsigned long, unsigned long);
1009 int (*check_flags)(int);
1010 int (*flock) (struct file *, int, struct file_lock *);
1011 ssize_t (*splice_write)(struct pipe_inode_info *, struct file *, loff_t *, size_t, unsigned int);
1012 ssize_t (*splice_read)(struct file *, loff_t *, struct pipe_inode_info *, size_t, unsigned int);
1013 int (*setlease)(struct file *, long, struct file_lock **, void **);
1014 long (*fallocate)(struct file *file, int mode, loff_t offset,
1015 loff_t len);
1016 void (*show_fdinfo)(struct seq_file *m, struct file *f);
1017 #ifndef CONFIG_MMU
1018 unsigned (*mmap_capabilities)(struct file *);
1019 #endif
1020 ssize_t (*copy_file_range)(struct file *, loff_t, struct file *, loff_t, size_t, unsigned int);
1021 loff_t (*remap_file_range)(struct file *file_in, loff_t pos_in,
1022 struct file *file_out, loff_t pos_out,
1023 loff_t len, unsigned int remap_flags);
1024 int (*fadvise)(struct file *, loff_t, loff_t, int);
1025 };
Linus Torvalds1da177e2005-04-16 15:20:36 -07001026
1027Again, all methods are called without any locks being held, unless
1028otherwise noted.
1029
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001030``llseek``
1031 called when the VFS needs to move the file position index
Linus Torvalds1da177e2005-04-16 15:20:36 -07001032
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001033``read``
1034 called by read(2) and related system calls
Linus Torvalds1da177e2005-04-16 15:20:36 -07001035
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001036``read_iter``
1037 possibly asynchronous read with iov_iter as destination
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001038
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001039``write``
1040 called by write(2) and related system calls
Linus Torvalds1da177e2005-04-16 15:20:36 -07001041
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001042``write_iter``
1043 possibly asynchronous write with iov_iter as source
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001044
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001045``iopoll``
1046 called when aio wants to poll for completions on HIPRI iocbs
Christoph Hellwigfb7e1602018-11-22 16:37:38 +01001047
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001048``iterate``
1049 called when the VFS needs to read the directory contents
Linus Torvalds1da177e2005-04-16 15:20:36 -07001050
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001051``iterate_shared``
1052 called when the VFS needs to read the directory contents when
1053 filesystem supports concurrent dir iterators
Amir Goldstein17ef4452018-08-27 15:56:01 +03001054
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001055``poll``
1056 called by the VFS when a process wants to check if there is
Linus Torvalds1da177e2005-04-16 15:20:36 -07001057 activity on this file and (optionally) go to sleep until there
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001058 is activity. Called by the select(2) and poll(2) system calls
Linus Torvalds1da177e2005-04-16 15:20:36 -07001059
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001060``unlocked_ioctl``
1061 called by the ioctl(2) system call.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001062
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001063``compat_ioctl``
1064 called by the ioctl(2) system call when 32 bit system calls are
1065 used on 64 bit kernels.
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001066
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001067``mmap``
1068 called by the mmap(2) system call
Linus Torvalds1da177e2005-04-16 15:20:36 -07001069
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001070``open``
1071 called by the VFS when an inode should be opened. When the VFS
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001072 opens a file, it creates a new "struct file". It then calls the
1073 open method for the newly allocated file structure. You might
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001074 think that the open method really belongs in "struct
1075 inode_operations", and you may be right. I think it's done the
1076 way it is because it makes filesystems simpler to implement.
1077 The open() method is a good place to initialize the
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001078 "private_data" member in the file structure if you want to point
1079 to a device structure
1080
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001081``flush``
1082 called by the close(2) system call to flush a file
Linus Torvalds1da177e2005-04-16 15:20:36 -07001083
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001084``release``
1085 called when the last reference to an open file is closed
Linus Torvalds1da177e2005-04-16 15:20:36 -07001086
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001087``fsync``
1088 called by the fsync(2) system call. Also see the section above
1089 entitled "Handling errors during writeback".
Linus Torvalds1da177e2005-04-16 15:20:36 -07001090
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001091``fasync``
1092 called by the fcntl(2) system call when asynchronous
Linus Torvalds1da177e2005-04-16 15:20:36 -07001093 (non-blocking) mode is enabled for a file
1094
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001095``lock``
1096 called by the fcntl(2) system call for F_GETLK, F_SETLK, and
1097 F_SETLKW commands
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001098
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001099``get_unmapped_area``
1100 called by the mmap(2) system call
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001101
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001102``check_flags``
1103 called by the fcntl(2) system call for F_SETFL command
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001104
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001105``flock``
1106 called by the flock(2) system call
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001107
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001108``splice_write``
1109 called by the VFS to splice data from a pipe to a file. This
1110 method is used by the splice(2) system call
Pekka J Enbergd1195c52006-04-11 14:21:59 +02001111
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001112``splice_read``
1113 called by the VFS to splice data from file to a pipe. This
1114 method is used by the splice(2) system call
Pekka J Enbergd1195c52006-04-11 14:21:59 +02001115
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001116``setlease``
1117 called by the VFS to set or release a file lock lease. setlease
1118 implementations should call generic_setlease to record or remove
1119 the lease in the inode after setting it.
Hugh Dickins17cf28a2012-05-29 15:06:41 -07001120
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001121``fallocate``
1122 called by the VFS to preallocate blocks or punch a hole.
Hugh Dickins17cf28a2012-05-29 15:06:41 -07001123
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001124``copy_file_range``
1125 called by the copy_file_range(2) system call.
Amir Goldstein17ef4452018-08-27 15:56:01 +03001126
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001127``remap_file_range``
1128 called by the ioctl(2) system call for FICLONERANGE and FICLONE
1129 and FIDEDUPERANGE commands to remap file ranges. An
1130 implementation should remap len bytes at pos_in of the source
1131 file into the dest file at pos_out. Implementations must handle
1132 callers passing in len == 0; this means "remap to the end of the
1133 source file". The return value should the number of bytes
1134 remapped, or the usual negative error code if errors occurred
1135 before any bytes were remapped. The remap_flags parameter
1136 accepts REMAP_FILE_* flags. If REMAP_FILE_DEDUP is set then the
1137 implementation must only remap if the requested file ranges have
Julia Lawallcb56eca2020-07-26 20:43:40 +02001138 identical contents. If REMAP_FILE_CAN_SHORTEN is set, the caller is
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001139 ok with the implementation shortening the request length to
1140 satisfy alignment or EOF requirements (or any other reason).
Amir Goldstein17ef4452018-08-27 15:56:01 +03001141
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001142``fadvise``
1143 possibly called by the fadvise64() system call.
Amir Goldstein45cd0fa2018-08-27 15:56:02 +03001144
Linus Torvalds1da177e2005-04-16 15:20:36 -07001145Note that the file operations are implemented by the specific
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001146filesystem in which the inode resides. When opening a device node
Linus Torvalds1da177e2005-04-16 15:20:36 -07001147(character or block special) most filesystems will call special
1148support routines in the VFS which will locate the required device
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001149driver information. These support routines replace the filesystem file
Linus Torvalds1da177e2005-04-16 15:20:36 -07001150operations with those for the device driver, and then proceed to call
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001151the new open() method for the file. This is how opening a device file
Linus Torvalds1da177e2005-04-16 15:20:36 -07001152in the filesystem eventually ends up calling the device driver open()
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001153method.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001154
1155
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001156Directory Entry Cache (dcache)
1157==============================
1158
Linus Torvalds1da177e2005-04-16 15:20:36 -07001159
1160struct dentry_operations
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001161------------------------
Linus Torvalds1da177e2005-04-16 15:20:36 -07001162
1163This describes how a filesystem can overload the standard dentry
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001164operations. Dentries and the dcache are the domain of the VFS and the
1165individual filesystem implementations. Device drivers have no business
1166here. These methods may be set to NULL, as they are either optional or
1167the VFS uses a default. As of kernel 2.6.22, the following members are
Linus Torvalds1da177e2005-04-16 15:20:36 -07001168defined:
1169
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +10001170.. code-block:: c
Linus Torvalds1da177e2005-04-16 15:20:36 -07001171
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +10001172 struct dentry_operations {
1173 int (*d_revalidate)(struct dentry *, unsigned int);
1174 int (*d_weak_revalidate)(struct dentry *, unsigned int);
1175 int (*d_hash)(const struct dentry *, struct qstr *);
1176 int (*d_compare)(const struct dentry *,
1177 unsigned int, const char *, const struct qstr *);
1178 int (*d_delete)(const struct dentry *);
1179 int (*d_init)(struct dentry *);
1180 void (*d_release)(struct dentry *);
1181 void (*d_iput)(struct dentry *, struct inode *);
1182 char *(*d_dname)(struct dentry *, char *, int);
1183 struct vfsmount *(*d_automount)(struct path *);
1184 int (*d_manage)(const struct path *, bool);
1185 struct dentry *(*d_real)(struct dentry *, const struct inode *);
1186 };
1187
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001188``d_revalidate``
1189 called when the VFS needs to revalidate a dentry. This is
1190 called whenever a name look-up finds a dentry in the dcache.
1191 Most local filesystems leave this as NULL, because all their
1192 dentries in the dcache are valid. Network filesystems are
1193 different since things can change on the server without the
1194 client necessarily being aware of it.
Jeff Laytonecf3d1f2013-02-20 11:19:05 -05001195
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001196 This function should return a positive value if the dentry is
1197 still valid, and zero or a negative error code if it isn't.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001198
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001199 d_revalidate may be called in rcu-walk mode (flags &
1200 LOOKUP_RCU). If in rcu-walk mode, the filesystem must
1201 revalidate the dentry without blocking or storing to the dentry,
1202 d_parent and d_inode should not be used without care (because
1203 they can change and, in d_inode case, even become NULL under
1204 us).
Nick Piggin34286d62011-01-07 17:49:57 +11001205
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001206 If a situation is encountered that rcu-walk cannot handle,
1207 return
Nick Piggin34286d62011-01-07 17:49:57 +11001208 -ECHILD and it will be called again in ref-walk mode.
1209
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001210``_weak_revalidate``
1211 called when the VFS needs to revalidate a "jumped" dentry. This
1212 is called when a path-walk ends at dentry that was not acquired
1213 by doing a lookup in the parent directory. This includes "/",
1214 "." and "..", as well as procfs-style symlinks and mountpoint
1215 traversal.
Jeff Laytonecf3d1f2013-02-20 11:19:05 -05001216
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001217 In this case, we are less concerned with whether the dentry is
1218 still fully correct, but rather that the inode is still valid.
1219 As with d_revalidate, most local filesystems will set this to
1220 NULL since their dcache entries are always valid.
Jeff Laytonecf3d1f2013-02-20 11:19:05 -05001221
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001222 This function has the same return code semantics as
1223 d_revalidate.
Jeff Laytonecf3d1f2013-02-20 11:19:05 -05001224
1225 d_weak_revalidate is only called after leaving rcu-walk mode.
1226
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001227``d_hash``
1228 called when the VFS adds a dentry to the hash table. The first
Nick Piggin621e1552011-01-07 17:49:27 +11001229 dentry passed to d_hash is the parent directory that the name is
Linus Torvaldsda53be12013-05-21 15:22:44 -07001230 to be hashed into.
Nick Pigginb1e6a012011-01-07 17:49:28 +11001231
1232 Same locking and synchronisation rules as d_compare regarding
1233 what is safe to dereference etc.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001234
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001235``d_compare``
1236 called to compare a dentry name with a given name. The first
Nick Piggin621e1552011-01-07 17:49:27 +11001237 dentry is the parent of the dentry to be compared, the second is
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001238 the child dentry. len and name string are properties of the
1239 dentry to be compared. qstr is the name to compare it with.
Nick Piggin621e1552011-01-07 17:49:27 +11001240
1241 Must be constant and idempotent, and should not take locks if
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001242 possible, and should not or store into the dentry. Should not
1243 dereference pointers outside the dentry without lots of care
1244 (eg. d_parent, d_inode, d_name should not be used).
Nick Piggin621e1552011-01-07 17:49:27 +11001245
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001246 However, our vfsmount is pinned, and RCU held, so the dentries
1247 and inodes won't disappear, neither will our sb or filesystem
1248 module. ->d_sb may be used.
Nick Piggin621e1552011-01-07 17:49:27 +11001249
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001250 It is a tricky calling convention because it needs to be called
1251 under "rcu-walk", ie. without any locks or references on things.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001252
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001253``d_delete``
1254 called when the last reference to a dentry is dropped and the
1255 dcache is deciding whether or not to cache it. Return 1 to
1256 delete immediately, or 0 to cache the dentry. Default is NULL
1257 which means to always cache a reachable dentry. d_delete must
1258 be constant and idempotent.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001259
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001260``d_init``
1261 called when a dentry is allocated
Miklos Szeredi285b1022016-06-28 11:47:32 +02001262
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001263``d_release``
1264 called when a dentry is really deallocated
Linus Torvalds1da177e2005-04-16 15:20:36 -07001265
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001266``d_iput``
1267 called when a dentry loses its inode (just prior to its being
1268 deallocated). The default when this is NULL is that the VFS
1269 calls iput(). If you define this method, you must call iput()
1270 yourself
Linus Torvalds1da177e2005-04-16 15:20:36 -07001271
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001272``d_dname``
1273 called when the pathname of a dentry should be generated.
1274 Useful for some pseudo filesystems (sockfs, pipefs, ...) to
1275 delay pathname generation. (Instead of doing it when dentry is
1276 created, it's done only when the path is needed.). Real
1277 filesystems probably dont want to use it, because their dentries
1278 are present in global dcache hash, so their hash should be an
1279 invariant. As no lock is held, d_dname() should not try to
1280 modify the dentry itself, unless appropriate SMP safety is used.
1281 CAUTION : d_path() logic is quite tricky. The correct way to
1282 return for example "Hello" is to put it at the end of the
1283 buffer, and returns a pointer to the first char.
1284 dynamic_dname() helper function is provided to take care of
1285 this.
Eric Dumazetc23fbb62007-05-08 00:26:18 -07001286
Miklos Szeredi0cac6432016-06-30 08:53:28 +02001287 Example :
1288
Tobin C. Hardingaf96c1e32019-05-15 10:29:13 +10001289.. code-block:: c
1290
Miklos Szeredi0cac6432016-06-30 08:53:28 +02001291 static char *pipefs_dname(struct dentry *dent, char *buffer, int buflen)
1292 {
1293 return dynamic_dname(dentry, buffer, buflen, "pipe:[%lu]",
1294 dentry->d_inode->i_ino);
1295 }
1296
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001297``d_automount``
1298 called when an automount dentry is to be traversed (optional).
1299 This should create a new VFS mount record and return the record
1300 to the caller. The caller is supplied with a path parameter
1301 giving the automount directory to describe the automount target
1302 and the parent VFS mount record to provide inheritable mount
1303 parameters. NULL should be returned if someone else managed to
1304 make the automount first. If the vfsmount creation failed, then
1305 an error code should be returned. If -EISDIR is returned, then
1306 the directory will be treated as an ordinary directory and
1307 returned to pathwalk to continue walking.
David Howellsea5b7782011-01-14 19:10:03 +00001308
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001309 If a vfsmount is returned, the caller will attempt to mount it
1310 on the mountpoint and will remove the vfsmount from its
1311 expiration list in the case of failure. The vfsmount should be
1312 returned with 2 refs on it to prevent automatic expiration - the
1313 caller will clean up the additional ref.
David Howells9875cf82011-01-14 18:45:21 +00001314
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001315 This function is only used if DCACHE_NEED_AUTOMOUNT is set on
1316 the dentry. This is set by __d_instantiate() if S_AUTOMOUNT is
1317 set on the inode being added.
David Howells9875cf82011-01-14 18:45:21 +00001318
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001319``d_manage``
1320 called to allow the filesystem to manage the transition from a
1321 dentry (optional). This allows autofs, for example, to hold up
1322 clients waiting to explore behind a 'mountpoint' while letting
1323 the daemon go past and construct the subtree there. 0 should be
1324 returned to let the calling process continue. -EISDIR can be
1325 returned to tell pathwalk to use this directory as an ordinary
1326 directory and to ignore anything mounted on it and not to check
1327 the automount flag. Any other error code will abort pathwalk
1328 completely.
David Howellscc53ce52011-01-14 18:45:26 +00001329
David Howellsab909112011-01-14 18:46:51 +00001330 If the 'rcu_walk' parameter is true, then the caller is doing a
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001331 pathwalk in RCU-walk mode. Sleeping is not permitted in this
1332 mode, and the caller can be asked to leave it and call again by
1333 returning -ECHILD. -EISDIR may also be returned to tell
1334 pathwalk to ignore d_automount or any mounts.
David Howellsab909112011-01-14 18:46:51 +00001335
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001336 This function is only used if DCACHE_MANAGE_TRANSIT is set on
1337 the dentry being transited from.
David Howellscc53ce52011-01-14 18:45:26 +00001338
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001339``d_real``
1340 overlay/union type filesystems implement this method to return
1341 one of the underlying dentries hidden by the overlay. It is
1342 used in two different modes:
Eric Dumazetc23fbb62007-05-08 00:26:18 -07001343
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001344 Called from file_dentry() it returns the real dentry matching
1345 the inode argument. The real dentry may be from a lower layer
1346 already copied up, but still referenced from the file. This
1347 mode is selected with a non-NULL inode argument.
Miklos Szeredie698b8a2016-06-30 08:53:27 +02001348
Miklos Szeredifb160432018-07-18 15:44:44 +02001349 With NULL inode the topmost real underlying dentry is returned.
Eric Dumazetc23fbb62007-05-08 00:26:18 -07001350
Linus Torvalds1da177e2005-04-16 15:20:36 -07001351Each dentry has a pointer to its parent dentry, as well as a hash list
Tobin C. Harding4ee33ea2019-05-15 10:29:06 +10001352of child dentries. Child dentries are basically like files in a
Linus Torvalds1da177e2005-04-16 15:20:36 -07001353directory.
1354
Pekka J Enberg5ea626a2005-09-09 13:10:19 -07001355
Pekka Enbergcc7d1f82005-11-07 01:01:08 -08001356Directory Entry Cache API
Linus Torvalds1da177e2005-04-16 15:20:36 -07001357--------------------------
1358
1359There are a number of functions defined which permit a filesystem to
1360manipulate dentries:
1361
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001362``dget``
1363 open a new handle for an existing dentry (this just increments
Linus Torvalds1da177e2005-04-16 15:20:36 -07001364 the usage count)
1365
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001366``dput``
1367 close a handle for a dentry (decrements the usage count). If
Nick Pigginfe15ce42011-01-07 17:49:23 +11001368 the usage count drops to 0, and the dentry is still in its
1369 parent's hash, the "d_delete" method is called to check whether
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001370 it should be cached. If it should not be cached, or if the
1371 dentry is not hashed, it is deleted. Otherwise cached dentries
1372 are put into an LRU list to be reclaimed on memory shortage.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001373
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001374``d_drop``
1375 this unhashes a dentry from its parents hash list. A subsequent
1376 call to dput() will deallocate the dentry if its usage count
1377 drops to 0
Linus Torvalds1da177e2005-04-16 15:20:36 -07001378
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001379``d_delete``
1380 delete a dentry. If there are no other open references to the
1381 dentry then the dentry is turned into a negative dentry (the
1382 d_iput() method is called). If there are other references, then
1383 d_drop() is called instead
Linus Torvalds1da177e2005-04-16 15:20:36 -07001384
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001385``d_add``
1386 add a dentry to its parents hash list and then calls
Linus Torvalds1da177e2005-04-16 15:20:36 -07001387 d_instantiate()
1388
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001389``d_instantiate``
1390 add a dentry to the alias hash list for the inode and updates
1391 the "d_inode" member. The "i_count" member in the inode
1392 structure should be set/incremented. If the inode pointer is
1393 NULL, the dentry is called a "negative dentry". This function
1394 is commonly called when an inode is created for an existing
1395 negative dentry
Linus Torvalds1da177e2005-04-16 15:20:36 -07001396
Tobin C. Hardingee5dc042019-06-04 10:26:56 +10001397``d_lookup``
1398 look up a dentry given its parent and path name component It
1399 looks up the child of that given name from the dcache hash
1400 table. If it is found, the reference count is incremented and
1401 the dentry is returned. The caller must use dput() to free the
1402 dentry when it finishes using it.
Linus Torvalds1da177e2005-04-16 15:20:36 -07001403
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +10001404
Miklos Szeredif84e3f52008-02-08 04:21:34 -08001405Mount Options
1406=============
1407
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +10001408
Miklos Szeredif84e3f52008-02-08 04:21:34 -08001409Parsing options
1410---------------
1411
1412On mount and remount the filesystem is passed a string containing a
1413comma separated list of mount options. The options can have either of
1414these forms:
1415
1416 option
1417 option=value
1418
1419The <linux/parser.h> header defines an API that helps parse these
1420options. There are plenty of examples on how to use it in existing
1421filesystems.
1422
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +10001423
Miklos Szeredif84e3f52008-02-08 04:21:34 -08001424Showing options
1425---------------
1426
Tobin C. Harding90caa782019-05-15 10:29:07 +10001427If a filesystem accepts mount options, it must define show_options() to
1428show all the currently active options. The rules are:
Miklos Szeredif84e3f52008-02-08 04:21:34 -08001429
1430 - options MUST be shown which are not default or their values differ
1431 from the default
1432
1433 - options MAY be shown which are enabled by default or have their
1434 default value
1435
Tobin C. Harding90caa782019-05-15 10:29:07 +10001436Options used only internally between a mount helper and the kernel (such
1437as file descriptors), or which only have an effect during the mounting
1438(such as ones controlling the creation of a journal) are exempt from the
1439above rules.
Miklos Szeredif84e3f52008-02-08 04:21:34 -08001440
Tobin C. Harding90caa782019-05-15 10:29:07 +10001441The underlying reason for the above rules is to make sure, that a mount
1442can be accurately replicated (e.g. umounting and mounting again) based
1443on the information found in /proc/mounts.
Miklos Szeredif84e3f52008-02-08 04:21:34 -08001444
Tobin C. Hardinge04c83c2019-05-15 10:29:08 +10001445
Pekka Enbergcc7d1f82005-11-07 01:01:08 -08001446Resources
1447=========
1448
1449(Note some of these resources are not up-to-date with the latest kernel
1450 version.)
1451
1452Creating Linux virtual filesystems. 2002
Alexander A. Klimovc69f22f2020-06-21 15:35:52 +02001453 <https://lwn.net/Articles/13325/>
Pekka Enbergcc7d1f82005-11-07 01:01:08 -08001454
1455The Linux Virtual File-system Layer by Neil Brown. 1999
1456 <http://www.cse.unsw.edu.au/~neilb/oss/linux-commentary/vfs.html>
1457
1458A tour of the Linux VFS by Michael K. Johnson. 1996
Alexander A. Klimovc69f22f2020-06-21 15:35:52 +02001459 <https://www.tldp.org/LDP/khg/HyperNews/get/fs/vfstour.html>
Pekka Enbergcc7d1f82005-11-07 01:01:08 -08001460
1461A small trail through the Linux kernel by Andries Brouwer. 2001
Alexander A. Klimovc69f22f2020-06-21 15:35:52 +02001462 <https://www.win.tue.nl/~aeb/linux/vfs/trail.html>