Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 1 | ======= |
| 2 | Locking |
| 3 | ======= |
| 4 | |
| 5 | The text below describes the locking rules for VFS-related methods. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 6 | It is (believed to be) up-to-date. *Please*, if you change anything in |
| 7 | prototypes or locking protocols - update this file. And update the relevant |
| 8 | instances in the tree, don't leave that to maintainers of filesystems/devices/ |
| 9 | etc. At the very least, put the list of dubious cases in the end of this file. |
| 10 | Don't turn it into log - maintainers of out-of-the-tree code are supposed to |
| 11 | be able to use diff(1). |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 12 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 13 | Thing currently missing here: socket operations. Alexey? |
| 14 | |
| 15 | dentry_operations |
| 16 | ================= |
| 17 | |
| 18 | prototypes:: |
| 19 | |
Al Viro | 0b728e1 | 2012-06-10 16:03:43 -0400 | [diff] [blame] | 20 | int (*d_revalidate)(struct dentry *, unsigned int); |
Jeff Layton | ecf3d1f | 2013-02-20 11:19:05 -0500 | [diff] [blame] | 21 | int (*d_weak_revalidate)(struct dentry *, unsigned int); |
Linus Torvalds | da53be1 | 2013-05-21 15:22:44 -0700 | [diff] [blame] | 22 | int (*d_hash)(const struct dentry *, struct qstr *); |
Al Viro | 6fa67e7 | 2016-07-31 16:37:25 -0400 | [diff] [blame] | 23 | int (*d_compare)(const struct dentry *, |
Nick Piggin | 621e155 | 2011-01-07 17:49:27 +1100 | [diff] [blame] | 24 | unsigned int, const char *, const struct qstr *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 25 | int (*d_delete)(struct dentry *); |
Miklos Szeredi | 285b102 | 2016-06-28 11:47:32 +0200 | [diff] [blame] | 26 | int (*d_init)(struct dentry *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 27 | void (*d_release)(struct dentry *); |
| 28 | void (*d_iput)(struct dentry *, struct inode *); |
Eric Dumazet | c23fbb6 | 2007-05-08 00:26:18 -0700 | [diff] [blame] | 29 | char *(*d_dname)((struct dentry *dentry, char *buffer, int buflen); |
David Howells | 9875cf8 | 2011-01-14 18:45:21 +0000 | [diff] [blame] | 30 | struct vfsmount *(*d_automount)(struct path *path); |
Ian Kent | fb5f51c | 2016-11-24 08:03:41 +1100 | [diff] [blame] | 31 | int (*d_manage)(const struct path *, bool); |
Miklos Szeredi | fb16043 | 2018-07-18 15:44:44 +0200 | [diff] [blame] | 32 | struct dentry *(*d_real)(struct dentry *, const struct inode *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 33 | |
| 34 | locking rules: |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 35 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 36 | ================== =========== ======== ============== ======== |
| 37 | ops rename_lock ->d_lock may block rcu-walk |
| 38 | ================== =========== ======== ============== ======== |
| 39 | d_revalidate: no no yes (ref-walk) maybe |
| 40 | d_weak_revalidate: no no yes no |
| 41 | d_hash no no no maybe |
| 42 | d_compare: yes no no maybe |
| 43 | d_delete: no yes no no |
| 44 | d_init: no no yes no |
| 45 | d_release: no no yes no |
| 46 | d_prune: no yes no no |
| 47 | d_iput: no no yes no |
| 48 | d_dname: no no no no |
| 49 | d_automount: no no yes no |
| 50 | d_manage: no no yes (ref-walk) maybe |
| 51 | d_real no no yes no |
| 52 | ================== =========== ======== ============== ======== |
| 53 | |
| 54 | inode_operations |
| 55 | ================ |
| 56 | |
| 57 | prototypes:: |
| 58 | |
Al Viro | ebfc3b4 | 2012-06-10 18:05:36 -0400 | [diff] [blame] | 59 | int (*create) (struct inode *,struct dentry *,umode_t, bool); |
Al Viro | 00cd8dd | 2012-06-10 17:13:09 -0400 | [diff] [blame] | 60 | struct dentry * (*lookup) (struct inode *,struct dentry *, unsigned int); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 61 | int (*link) (struct dentry *,struct inode *,struct dentry *); |
| 62 | int (*unlink) (struct inode *,struct dentry *); |
| 63 | int (*symlink) (struct inode *,struct dentry *,const char *); |
Al Viro | 18bb1db | 2011-07-26 01:41:39 -0400 | [diff] [blame] | 64 | int (*mkdir) (struct inode *,struct dentry *,umode_t); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 65 | int (*rmdir) (struct inode *,struct dentry *); |
Al Viro | 1a67aaf | 2011-07-26 01:52:52 -0400 | [diff] [blame] | 66 | int (*mknod) (struct inode *,struct dentry *,umode_t,dev_t); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 67 | int (*rename) (struct inode *, struct dentry *, |
Miklos Szeredi | 520c8b1 | 2014-04-01 17:08:42 +0200 | [diff] [blame] | 68 | struct inode *, struct dentry *, unsigned int); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 69 | int (*readlink) (struct dentry *, char __user *,int); |
Eric Biggers | 1a6a316 | 2019-04-11 16:16:29 -0700 | [diff] [blame] | 70 | const char *(*get_link) (struct dentry *, struct inode *, struct delayed_call *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 71 | void (*truncate) (struct inode *); |
Nick Piggin | b74c79e | 2011-01-07 17:49:58 +1100 | [diff] [blame] | 72 | int (*permission) (struct inode *, int, unsigned int); |
Miklos Szeredi | 0cad624 | 2021-08-18 22:08:24 +0200 | [diff] [blame] | 73 | struct posix_acl * (*get_acl)(struct inode *, int, bool); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 74 | int (*setattr) (struct dentry *, struct iattr *); |
Eric Biggers | 75dd7e4 | 2017-03-31 18:31:25 +0100 | [diff] [blame] | 75 | int (*getattr) (const struct path *, struct kstat *, u32, unsigned int); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 76 | ssize_t (*listxattr) (struct dentry *, char *, size_t); |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 77 | int (*fiemap)(struct inode *, struct fiemap_extent_info *, u64 start, u64 len); |
Josef Bacik | c3b2da3 | 2012-03-26 09:59:21 -0400 | [diff] [blame] | 78 | void (*update_time)(struct inode *, struct timespec *, int); |
Al Viro | d958527 | 2012-06-22 12:39:14 +0400 | [diff] [blame] | 79 | int (*atomic_open)(struct inode *, struct dentry *, |
Al Viro | 30d9049 | 2012-06-22 12:40:19 +0400 | [diff] [blame] | 80 | struct file *, unsigned open_flag, |
Al Viro | 6c9b1de | 2018-07-09 19:20:08 -0400 | [diff] [blame] | 81 | umode_t create_mode); |
Al Viro | 48bde8d | 2013-07-03 16:19:23 +0400 | [diff] [blame] | 82 | int (*tmpfile) (struct inode *, struct dentry *, umode_t); |
Miklos Szeredi | 4c5b479 | 2021-04-07 14:36:42 +0200 | [diff] [blame] | 83 | int (*fileattr_set)(struct user_namespace *mnt_userns, |
| 84 | struct dentry *dentry, struct fileattr *fa); |
| 85 | int (*fileattr_get)(struct dentry *dentry, struct fileattr *fa); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 86 | |
| 87 | locking rules: |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 88 | all may block |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 89 | |
Miklos Szeredi | 4c5b479 | 2021-04-07 14:36:42 +0200 | [diff] [blame] | 90 | ============= ============================================= |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 91 | ops i_rwsem(inode) |
Miklos Szeredi | 4c5b479 | 2021-04-07 14:36:42 +0200 | [diff] [blame] | 92 | ============= ============================================= |
Sean Anderson | 965de0e | 2018-05-23 22:29:10 -0400 | [diff] [blame] | 93 | lookup: shared |
| 94 | create: exclusive |
| 95 | link: exclusive (both) |
| 96 | mknod: exclusive |
| 97 | symlink: exclusive |
| 98 | mkdir: exclusive |
| 99 | unlink: exclusive (both) |
| 100 | rmdir: exclusive (both)(see below) |
| 101 | rename: exclusive (all) (see below) |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 102 | readlink: no |
Al Viro | 6b25539 | 2015-11-17 10:20:54 -0500 | [diff] [blame] | 103 | get_link: no |
Sean Anderson | 965de0e | 2018-05-23 22:29:10 -0400 | [diff] [blame] | 104 | setattr: exclusive |
Nick Piggin | b74c79e | 2011-01-07 17:49:58 +1100 | [diff] [blame] | 105 | permission: no (may not block if called in rcu-walk mode) |
Christoph Hellwig | 4e34e71 | 2011-07-23 17:37:31 +0200 | [diff] [blame] | 106 | get_acl: no |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 107 | getattr: no |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 108 | listxattr: no |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 109 | fiemap: no |
Josef Bacik | c3b2da3 | 2012-03-26 09:59:21 -0400 | [diff] [blame] | 110 | update_time: no |
Jeff Layton | ff46734 | 2019-10-30 06:46:54 -0400 | [diff] [blame] | 111 | atomic_open: shared (exclusive if O_CREAT is set in open flags) |
Al Viro | 48bde8d | 2013-07-03 16:19:23 +0400 | [diff] [blame] | 112 | tmpfile: no |
Miklos Szeredi | 4c5b479 | 2021-04-07 14:36:42 +0200 | [diff] [blame] | 113 | fileattr_get: no or exclusive |
| 114 | fileattr_set: exclusive |
| 115 | ============= ============================================= |
Josef Bacik | c3b2da3 | 2012-03-26 09:59:21 -0400 | [diff] [blame] | 116 | |
Andreas Gruenbacher | 6c6ef9f | 2016-09-29 17:48:44 +0200 | [diff] [blame] | 117 | |
Sean Anderson | 965de0e | 2018-05-23 22:29:10 -0400 | [diff] [blame] | 118 | Additionally, ->rmdir(), ->unlink() and ->rename() have ->i_rwsem |
| 119 | exclusive on victim. |
Miklos Szeredi | 2773bf0 | 2016-09-27 11:03:58 +0200 | [diff] [blame] | 120 | cross-directory ->rename() has (per-superblock) ->s_vfs_rename_sem. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 121 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 122 | See Documentation/filesystems/directory-locking.rst for more detailed discussion |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 123 | of the locking scheme for directory operations. |
| 124 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 125 | xattr_handler operations |
| 126 | ======================== |
| 127 | |
| 128 | prototypes:: |
| 129 | |
Andreas Gruenbacher | 6c6ef9f | 2016-09-29 17:48:44 +0200 | [diff] [blame] | 130 | bool (*list)(struct dentry *dentry); |
| 131 | int (*get)(const struct xattr_handler *handler, struct dentry *dentry, |
| 132 | struct inode *inode, const char *name, void *buffer, |
| 133 | size_t size); |
Christian Brauner | e65ce2a | 2021-01-21 14:19:27 +0100 | [diff] [blame] | 134 | int (*set)(const struct xattr_handler *handler, |
| 135 | struct user_namespace *mnt_userns, |
| 136 | struct dentry *dentry, struct inode *inode, const char *name, |
| 137 | const void *buffer, size_t size, int flags); |
Andreas Gruenbacher | 6c6ef9f | 2016-09-29 17:48:44 +0200 | [diff] [blame] | 138 | |
| 139 | locking rules: |
| 140 | all may block |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 141 | |
| 142 | ===== ============== |
| 143 | ops i_rwsem(inode) |
| 144 | ===== ============== |
Andreas Gruenbacher | 6c6ef9f | 2016-09-29 17:48:44 +0200 | [diff] [blame] | 145 | list: no |
| 146 | get: no |
Sean Anderson | 965de0e | 2018-05-23 22:29:10 -0400 | [diff] [blame] | 147 | set: exclusive |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 148 | ===== ============== |
Andreas Gruenbacher | 6c6ef9f | 2016-09-29 17:48:44 +0200 | [diff] [blame] | 149 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 150 | super_operations |
| 151 | ================ |
| 152 | |
| 153 | prototypes:: |
| 154 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 155 | struct inode *(*alloc_inode)(struct super_block *sb); |
Al Viro | fdb0da8 | 2019-04-10 14:43:44 -0400 | [diff] [blame] | 156 | void (*free_inode)(struct inode *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 157 | void (*destroy_inode)(struct inode *); |
Christoph Hellwig | aa38572 | 2011-05-27 06:53:02 -0400 | [diff] [blame] | 158 | void (*dirty_inode) (struct inode *, int flags); |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 159 | int (*write_inode) (struct inode *, struct writeback_control *wbc); |
Al Viro | 336fb3b | 2010-06-08 00:37:12 -0400 | [diff] [blame] | 160 | int (*drop_inode) (struct inode *); |
| 161 | void (*evict_inode) (struct inode *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 162 | void (*put_super) (struct super_block *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 163 | int (*sync_fs)(struct super_block *sb, int wait); |
Takashi Sato | c4be0c1 | 2009-01-09 16:40:58 -0800 | [diff] [blame] | 164 | int (*freeze_fs) (struct super_block *); |
| 165 | int (*unfreeze_fs) (struct super_block *); |
David Howells | 726c334 | 2006-06-23 02:02:58 -0700 | [diff] [blame] | 166 | int (*statfs) (struct dentry *, struct kstatfs *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 167 | int (*remount_fs) (struct super_block *, int *, char *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 168 | void (*umount_begin) (struct super_block *); |
Al Viro | 34c80b1 | 2011-12-08 21:32:45 -0500 | [diff] [blame] | 169 | int (*show_options)(struct seq_file *, struct dentry *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 170 | ssize_t (*quota_read)(struct super_block *, int, char *, size_t, loff_t); |
| 171 | ssize_t (*quota_write)(struct super_block *, int, const char *, size_t, loff_t); |
| 172 | |
| 173 | locking rules: |
Al Viro | 336fb3b | 2010-06-08 00:37:12 -0400 | [diff] [blame] | 174 | All may block [not true, see below] |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 175 | |
| 176 | ====================== ============ ======================== |
| 177 | ops s_umount note |
| 178 | ====================== ============ ======================== |
Christoph Hellwig | 7e325d3 | 2009-06-19 20:22:37 +0200 | [diff] [blame] | 179 | alloc_inode: |
Al Viro | fdb0da8 | 2019-04-10 14:43:44 -0400 | [diff] [blame] | 180 | free_inode: called from RCU callback |
Christoph Hellwig | 7e325d3 | 2009-06-19 20:22:37 +0200 | [diff] [blame] | 181 | destroy_inode: |
Christoph Hellwig | aa38572 | 2011-05-27 06:53:02 -0400 | [diff] [blame] | 182 | dirty_inode: |
Christoph Hellwig | 7e325d3 | 2009-06-19 20:22:37 +0200 | [diff] [blame] | 183 | write_inode: |
Dave Chinner | f283c86 | 2011-03-22 22:23:39 +1100 | [diff] [blame] | 184 | drop_inode: !!!inode->i_lock!!! |
Al Viro | 336fb3b | 2010-06-08 00:37:12 -0400 | [diff] [blame] | 185 | evict_inode: |
Christoph Hellwig | 7e325d3 | 2009-06-19 20:22:37 +0200 | [diff] [blame] | 186 | put_super: write |
Christoph Hellwig | 7e325d3 | 2009-06-19 20:22:37 +0200 | [diff] [blame] | 187 | sync_fs: read |
Valerie Aurora | 06fd516 | 2012-06-12 16:20:48 +0200 | [diff] [blame] | 188 | freeze_fs: write |
| 189 | unfreeze_fs: write |
Al Viro | 336fb3b | 2010-06-08 00:37:12 -0400 | [diff] [blame] | 190 | statfs: maybe(read) (see below) |
| 191 | remount_fs: write |
Christoph Hellwig | 7e325d3 | 2009-06-19 20:22:37 +0200 | [diff] [blame] | 192 | umount_begin: no |
| 193 | show_options: no (namespace_sem) |
| 194 | quota_read: no (see below) |
| 195 | quota_write: no (see below) |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 196 | ====================== ============ ======================== |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 197 | |
Al Viro | 336fb3b | 2010-06-08 00:37:12 -0400 | [diff] [blame] | 198 | ->statfs() has s_umount (shared) when called by ustat(2) (native or |
| 199 | compat), but that's an accident of bad API; s_umount is used to pin |
| 200 | the superblock down when we only have dev_t given us by userland to |
| 201 | identify the superblock. Everything else (statfs(), fstatfs(), etc.) |
| 202 | doesn't hold it when calling ->statfs() - superblock is pinned down |
| 203 | by resolving the pathname passed to syscall. |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 204 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 205 | ->quota_read() and ->quota_write() functions are both guaranteed to |
| 206 | be the only ones operating on the quota file by the quota code (via |
| 207 | dqio_sem) (unless an admin really wants to screw up something and |
| 208 | writes to quota files with quotas on). For other details about locking |
| 209 | see also dquot_operations section. |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 210 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 211 | file_system_type |
| 212 | ================ |
| 213 | |
| 214 | prototypes:: |
| 215 | |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 216 | struct dentry *(*mount) (struct file_system_type *, int, |
| 217 | const char *, void *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 218 | void (*kill_sb) (struct super_block *); |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 219 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 220 | locking rules: |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 221 | |
| 222 | ======= ========= |
| 223 | ops may block |
| 224 | ======= ========= |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 225 | mount yes |
| 226 | kill_sb yes |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 227 | ======= ========= |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 228 | |
Al Viro | 1a102ff | 2011-03-16 09:07:58 -0400 | [diff] [blame] | 229 | ->mount() returns ERR_PTR or the root dentry; its superblock should be locked |
| 230 | on return. |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 231 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 232 | ->kill_sb() takes a write-locked superblock, does all shutdown work on it, |
| 233 | unlocks and drops the reference. |
| 234 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 235 | address_space_operations |
| 236 | ======================== |
| 237 | prototypes:: |
| 238 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 239 | int (*writepage)(struct page *page, struct writeback_control *wbc); |
| 240 | int (*readpage)(struct file *, struct page *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 241 | int (*writepages)(struct address_space *, struct writeback_control *); |
| 242 | int (*set_page_dirty)(struct page *page); |
Matthew Wilcox (Oracle) | 8151b4c | 2020-06-01 21:46:44 -0700 | [diff] [blame] | 243 | void (*readahead)(struct readahead_control *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 244 | int (*readpages)(struct file *filp, struct address_space *mapping, |
| 245 | struct list_head *pages, unsigned nr_pages); |
Nick Piggin | 4e02ed4 | 2008-10-29 14:00:55 -0700 | [diff] [blame] | 246 | int (*write_begin)(struct file *, struct address_space *mapping, |
| 247 | loff_t pos, unsigned len, unsigned flags, |
| 248 | struct page **pagep, void **fsdata); |
| 249 | int (*write_end)(struct file *, struct address_space *mapping, |
| 250 | loff_t pos, unsigned len, unsigned copied, |
| 251 | struct page *page, void *fsdata); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 252 | sector_t (*bmap)(struct address_space *, sector_t); |
Lukas Czerner | d47992f | 2013-05-21 23:17:23 -0400 | [diff] [blame] | 253 | void (*invalidatepage) (struct page *, unsigned int, unsigned int); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 254 | int (*releasepage) (struct page *, int); |
Linus Torvalds | 6072d13 | 2010-12-01 13:35:19 -0500 | [diff] [blame] | 255 | void (*freepage)(struct page *); |
Christoph Hellwig | c8b8e32 | 2016-04-07 08:51:58 -0700 | [diff] [blame] | 256 | int (*direct_IO)(struct kiocb *, struct iov_iter *iter); |
Minchan Kim | bda807d | 2016-07-26 15:23:05 -0700 | [diff] [blame] | 257 | bool (*isolate_page) (struct page *, isolate_mode_t); |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 258 | int (*migratepage)(struct address_space *, struct page *, struct page *); |
Minchan Kim | bda807d | 2016-07-26 15:23:05 -0700 | [diff] [blame] | 259 | void (*putback_page) (struct page *); |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 260 | int (*launder_page)(struct page *); |
Al Viro | c186afb4 | 2014-02-02 21:16:54 -0500 | [diff] [blame] | 261 | int (*is_partially_uptodate)(struct page *, unsigned long, unsigned long); |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 262 | int (*error_remove_page)(struct address_space *, struct page *); |
Mel Gorman | 62c230b | 2012-07-31 16:44:55 -0700 | [diff] [blame] | 263 | int (*swap_activate)(struct file *); |
| 264 | int (*swap_deactivate)(struct file *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 265 | |
| 266 | locking rules: |
Linus Torvalds | 6072d13 | 2010-12-01 13:35:19 -0500 | [diff] [blame] | 267 | All except set_page_dirty and freepage may block |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 268 | |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 269 | ====================== ======================== ========= =============== |
| 270 | ops PageLocked(page) i_rwsem invalidate_lock |
| 271 | ====================== ======================== ========= =============== |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 272 | writepage: yes, unlocks (see below) |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 273 | readpage: yes, unlocks shared |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 274 | writepages: |
| 275 | set_page_dirty no |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 276 | readahead: yes, unlocks shared |
| 277 | readpages: no shared |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 278 | write_begin: locks the page exclusive |
| 279 | write_end: yes, unlocks exclusive |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 280 | bmap: |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 281 | invalidatepage: yes exclusive |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 282 | releasepage: yes |
| 283 | freepage: yes |
| 284 | direct_IO: |
Minchan Kim | bda807d | 2016-07-26 15:23:05 -0700 | [diff] [blame] | 285 | isolate_page: yes |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 286 | migratepage: yes (both) |
Minchan Kim | bda807d | 2016-07-26 15:23:05 -0700 | [diff] [blame] | 287 | putback_page: yes |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 288 | launder_page: yes |
| 289 | is_partially_uptodate: yes |
| 290 | error_remove_page: yes |
Mel Gorman | 62c230b | 2012-07-31 16:44:55 -0700 | [diff] [blame] | 291 | swap_activate: no |
| 292 | swap_deactivate: no |
Randy Dunlap | 7882c55 | 2021-07-27 16:22:12 -0700 | [diff] [blame] | 293 | ====================== ======================== ========= =============== |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 294 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 295 | ->write_begin(), ->write_end() and ->readpage() may be called from |
Matthew Wilcox | f4e6d84 | 2016-03-06 23:27:26 -0500 | [diff] [blame] | 296 | the request handler (/dev/loop). |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 297 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 298 | ->readpage() unlocks the page, either synchronously or via I/O |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 299 | completion. |
| 300 | |
Matthew Wilcox (Oracle) | 8151b4c | 2020-06-01 21:46:44 -0700 | [diff] [blame] | 301 | ->readahead() unlocks the pages that I/O is attempted on like ->readpage(). |
| 302 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 303 | ->readpages() populates the pagecache with the passed pages and starts |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 304 | I/O against them. They come unlocked upon I/O completion. |
| 305 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 306 | ->writepage() is used for two purposes: for "memory cleansing" and for |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 307 | "sync". These are quite different operations and the behaviour may differ |
| 308 | depending upon the mode. |
| 309 | |
| 310 | If writepage is called for sync (wbc->sync_mode != WBC_SYNC_NONE) then |
| 311 | it *must* start I/O against the page, even if that would involve |
| 312 | blocking on in-progress I/O. |
| 313 | |
| 314 | If writepage is called for memory cleansing (sync_mode == |
| 315 | WBC_SYNC_NONE) then its role is to get as much writeout underway as |
| 316 | possible. So writepage should try to avoid blocking against |
| 317 | currently-in-progress I/O. |
| 318 | |
| 319 | If the filesystem is not called for "sync" and it determines that it |
| 320 | would need to block against in-progress I/O to be able to start new I/O |
| 321 | against the page the filesystem should redirty the page with |
| 322 | redirty_page_for_writepage(), then unlock the page and return zero. |
| 323 | This may also be done to avoid internal deadlocks, but rarely. |
| 324 | |
Robert P. J. Day | 3a4fa0a | 2007-10-19 23:10:43 +0200 | [diff] [blame] | 325 | If the filesystem is called for sync then it must wait on any |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 326 | in-progress I/O and then start new I/O. |
| 327 | |
Nikita Danilov | 2054606 | 2005-05-01 08:58:37 -0700 | [diff] [blame] | 328 | The filesystem should unlock the page synchronously, before returning to the |
| 329 | caller, unless ->writepage() returns special WRITEPAGE_ACTIVATE |
| 330 | value. WRITEPAGE_ACTIVATE means that page cannot really be written out |
| 331 | currently, and VM should stop calling ->writepage() on this page for some |
| 332 | time. VM does this by moving page to the head of the active list, hence the |
| 333 | name. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 334 | |
| 335 | Unless the filesystem is going to redirty_page_for_writepage(), unlock the page |
| 336 | and return zero, writepage *must* run set_page_writeback() against the page, |
| 337 | followed by unlocking it. Once set_page_writeback() has been run against the |
| 338 | page, write I/O can be submitted and the write I/O completion handler must run |
| 339 | end_page_writeback() once the I/O is complete. If no I/O is submitted, the |
| 340 | filesystem must run end_page_writeback() against the page before returning from |
| 341 | writepage. |
| 342 | |
| 343 | That is: after 2.5.12, pages which are under writeout are *not* locked. Note, |
| 344 | if the filesystem needs the page to be locked during writeout, that is ok, too, |
| 345 | the page is allowed to be unlocked at any point in time between the calls to |
| 346 | set_page_writeback() and end_page_writeback(). |
| 347 | |
| 348 | Note, failure to run either redirty_page_for_writepage() or the combination of |
| 349 | set_page_writeback()/end_page_writeback() on a page submitted to writepage |
| 350 | will leave the page itself marked clean but it will be tagged as dirty in the |
| 351 | radix tree. This incoherency can lead to all sorts of hard-to-debug problems |
| 352 | in the filesystem like having dirty inodes at umount and losing written data. |
| 353 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 354 | ->writepages() is used for periodic writeback and for syscall-initiated |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 355 | sync operations. The address_space should start I/O against at least |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 356 | ``*nr_to_write`` pages. ``*nr_to_write`` must be decremented for each page |
| 357 | which is written. The address_space implementation may write more (or less) |
| 358 | pages than ``*nr_to_write`` asks for, but it should try to be reasonably close. |
| 359 | If nr_to_write is NULL, all dirty pages must be written. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 360 | |
| 361 | writepages should _only_ write pages which are present on |
| 362 | mapping->io_pages. |
| 363 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 364 | ->set_page_dirty() is called from various places in the kernel |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 365 | when the target page is marked as needing writeback. It may be called |
| 366 | under spinlock (it cannot block) and is sometimes called with the page |
| 367 | not locked. |
| 368 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 369 | ->bmap() is currently used by legacy ioctl() (FIBMAP) provided by some |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 370 | filesystems and by the swapper. The latter will eventually go away. Please, |
| 371 | keep it that way and don't breed new callers. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 372 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 373 | ->invalidatepage() is called when the filesystem must attempt to drop |
Lukas Czerner | d47992f | 2013-05-21 23:17:23 -0400 | [diff] [blame] | 374 | some or all of the buffers from the page when it is being truncated. It |
| 375 | returns zero on success. If ->invalidatepage is zero, the kernel uses |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 376 | block_invalidatepage() instead. The filesystem must exclusively acquire |
| 377 | invalidate_lock before invalidating page cache in truncate / hole punch path |
| 378 | (and thus calling into ->invalidatepage) to block races between page cache |
| 379 | invalidation and page cache filling functions (fault, read, ...). |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 380 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 381 | ->releasepage() is called when the kernel is about to try to drop the |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 382 | buffers from the page in preparation for freeing it. It returns zero to |
| 383 | indicate that the buffers are (or may be) freeable. If ->releasepage is zero, |
| 384 | the kernel assumes that the fs has no private interest in the buffers. |
| 385 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 386 | ->freepage() is called when the kernel is done dropping the page |
Linus Torvalds | 6072d13 | 2010-12-01 13:35:19 -0500 | [diff] [blame] | 387 | from the page cache. |
| 388 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 389 | ->launder_page() may be called prior to releasing a page if |
Trond Myklebust | e3db769 | 2007-01-10 23:15:39 -0800 | [diff] [blame] | 390 | it is still found to be dirty. It returns zero if the page was successfully |
| 391 | cleaned, or an error value if not. Note that in order to prevent the page |
| 392 | getting mapped back in and redirtied, it needs to be kept locked |
| 393 | across the entire operation. |
| 394 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 395 | ->swap_activate will be called with a non-zero argument on |
Mel Gorman | 62c230b | 2012-07-31 16:44:55 -0700 | [diff] [blame] | 396 | files backing (non block device backed) swapfiles. A return value |
| 397 | of zero indicates success, in which case this file can be used for |
| 398 | backing swapspace. The swapspace operations will be proxied to the |
| 399 | address space operations. |
| 400 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 401 | ->swap_deactivate() will be called in the sys_swapoff() |
Mel Gorman | 62c230b | 2012-07-31 16:44:55 -0700 | [diff] [blame] | 402 | path after ->swap_activate() returned success. |
| 403 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 404 | file_lock_operations |
| 405 | ==================== |
| 406 | |
| 407 | prototypes:: |
| 408 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 409 | void (*fl_copy_lock)(struct file_lock *, struct file_lock *); |
| 410 | void (*fl_release_private)(struct file_lock *); |
| 411 | |
| 412 | |
| 413 | locking rules: |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 414 | |
| 415 | =================== ============= ========= |
| 416 | ops inode->i_lock may block |
| 417 | =================== ============= ========= |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 418 | fl_copy_lock: yes no |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 419 | fl_release_private: maybe maybe[1]_ |
| 420 | =================== ============= ========= |
Jeff Layton | 2ece173 | 2014-08-12 10:38:07 -0400 | [diff] [blame] | 421 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 422 | .. [1]: |
| 423 | ->fl_release_private for flock or POSIX locks is currently allowed |
| 424 | to block. Leases however can still be freed while the i_lock is held and |
| 425 | so fl_release_private called on a lease should not block. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 426 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 427 | lock_manager_operations |
| 428 | ======================= |
| 429 | |
| 430 | prototypes:: |
| 431 | |
J. Bruce Fields | 8fb47a4 | 2011-07-20 20:21:59 -0400 | [diff] [blame] | 432 | void (*lm_notify)(struct file_lock *); /* unblock callback */ |
| 433 | int (*lm_grant)(struct file_lock *, struct file_lock *, int); |
J. Bruce Fields | 8fb47a4 | 2011-07-20 20:21:59 -0400 | [diff] [blame] | 434 | void (*lm_break)(struct file_lock *); /* break_lease callback */ |
| 435 | int (*lm_change)(struct file_lock **, int); |
J. Bruce Fields | 28df3d1 | 2017-07-28 16:35:15 -0400 | [diff] [blame] | 436 | bool (*lm_breaker_owns_lease)(struct file_lock *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 437 | |
| 438 | locking rules: |
Jeff Layton | 1c8c601 | 2013-06-21 08:58:15 -0400 | [diff] [blame] | 439 | |
Randy Dunlap | 6cbef2a | 2020-06-14 20:22:19 -0700 | [diff] [blame] | 440 | ====================== ============= ================= ========= |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 441 | ops inode->i_lock blocked_lock_lock may block |
Randy Dunlap | 6cbef2a | 2020-06-14 20:22:19 -0700 | [diff] [blame] | 442 | ====================== ============= ================= ========= |
Jeff Layton | 7b2296a | 2013-06-21 08:58:20 -0400 | [diff] [blame] | 443 | lm_notify: yes yes no |
| 444 | lm_grant: no no no |
| 445 | lm_break: yes no no |
| 446 | lm_change yes no no |
J. Bruce Fields | 28df3d1 | 2017-07-28 16:35:15 -0400 | [diff] [blame] | 447 | lm_breaker_owns_lease: no no no |
Randy Dunlap | 6cbef2a | 2020-06-14 20:22:19 -0700 | [diff] [blame] | 448 | ====================== ============= ================= ========= |
Jeff Layton | 1c8c601 | 2013-06-21 08:58:15 -0400 | [diff] [blame] | 449 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 450 | buffer_head |
| 451 | =========== |
| 452 | |
| 453 | prototypes:: |
| 454 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 455 | void (*b_end_io)(struct buffer_head *bh, int uptodate); |
| 456 | |
| 457 | locking rules: |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 458 | |
| 459 | called from interrupts. In other words, extreme care is needed here. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 460 | bh is locked, but that's all warranties we have here. Currently only RAID1, |
| 461 | highmem, fs/buffer.c, and fs/ntfs/aops.c are providing these. Block devices |
| 462 | call this method upon the IO completion. |
| 463 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 464 | block_device_operations |
| 465 | ======================= |
| 466 | prototypes:: |
| 467 | |
Christoph Hellwig | e1455d1 | 2010-10-06 10:46:53 +0200 | [diff] [blame] | 468 | int (*open) (struct block_device *, fmode_t); |
| 469 | int (*release) (struct gendisk *, fmode_t); |
| 470 | int (*ioctl) (struct block_device *, fmode_t, unsigned, unsigned long); |
| 471 | int (*compat_ioctl) (struct block_device *, fmode_t, unsigned, unsigned long); |
Dan Williams | 7a9eb20 | 2016-06-03 18:06:47 -0700 | [diff] [blame] | 472 | int (*direct_access) (struct block_device *, sector_t, void **, |
Ross Zwisler | e2e0539 | 2015-08-18 13:55:41 -0600 | [diff] [blame] | 473 | unsigned long *); |
Christoph Hellwig | e1455d1 | 2010-10-06 10:46:53 +0200 | [diff] [blame] | 474 | void (*unlock_native_capacity) (struct gendisk *); |
Christoph Hellwig | e1455d1 | 2010-10-06 10:46:53 +0200 | [diff] [blame] | 475 | int (*getgeo)(struct block_device *, struct hd_geometry *); |
| 476 | void (*swap_slot_free_notify) (struct block_device *, unsigned long); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 477 | |
| 478 | locking rules: |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 479 | |
| 480 | ======================= =================== |
Christoph Hellwig | a869870 | 2021-05-25 08:12:56 +0200 | [diff] [blame] | 481 | ops open_mutex |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 482 | ======================= =================== |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 483 | open: yes |
| 484 | release: yes |
| 485 | ioctl: no |
| 486 | compat_ioctl: no |
| 487 | direct_access: no |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 488 | unlock_native_capacity: no |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 489 | getgeo: no |
| 490 | swap_slot_free_notify: no (see below) |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 491 | ======================= =================== |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 492 | |
Christoph Hellwig | e1455d1 | 2010-10-06 10:46:53 +0200 | [diff] [blame] | 493 | swap_slot_free_notify is called with swap_lock and sometimes the page lock |
| 494 | held. |
| 495 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 496 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 497 | file_operations |
| 498 | =============== |
| 499 | |
| 500 | prototypes:: |
| 501 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 502 | loff_t (*llseek) (struct file *, loff_t, int); |
| 503 | ssize_t (*read) (struct file *, char __user *, size_t, loff_t *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 504 | ssize_t (*write) (struct file *, const char __user *, size_t, loff_t *); |
Al Viro | 293bc98 | 2014-02-11 18:37:41 -0500 | [diff] [blame] | 505 | ssize_t (*read_iter) (struct kiocb *, struct iov_iter *); |
| 506 | ssize_t (*write_iter) (struct kiocb *, struct iov_iter *); |
Jan Kara | c625b4c | 2021-05-10 19:13:53 +0200 | [diff] [blame] | 507 | int (*iopoll) (struct kiocb *kiocb, bool spin); |
Al Viro | 2233f31 | 2013-05-22 21:44:23 -0400 | [diff] [blame] | 508 | int (*iterate) (struct file *, struct dir_context *); |
Sean Anderson | 965de0e | 2018-05-23 22:29:10 -0400 | [diff] [blame] | 509 | int (*iterate_shared) (struct file *, struct dir_context *); |
Christoph Hellwig | 6e8b704 | 2018-01-02 22:50:45 +0100 | [diff] [blame] | 510 | __poll_t (*poll) (struct file *, struct poll_table_struct *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 511 | long (*unlocked_ioctl) (struct file *, unsigned int, unsigned long); |
| 512 | long (*compat_ioctl) (struct file *, unsigned int, unsigned long); |
| 513 | int (*mmap) (struct file *, struct vm_area_struct *); |
| 514 | int (*open) (struct inode *, struct file *); |
| 515 | int (*flush) (struct file *); |
| 516 | int (*release) (struct inode *, struct file *); |
Josef Bacik | 02c24a8 | 2011-07-16 20:44:56 -0400 | [diff] [blame] | 517 | int (*fsync) (struct file *, loff_t start, loff_t end, int datasync); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 518 | int (*fasync) (int, struct file *, int); |
| 519 | int (*lock) (struct file *, int, struct file_lock *); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 520 | ssize_t (*sendpage) (struct file *, struct page *, int, size_t, |
| 521 | loff_t *, int); |
| 522 | unsigned long (*get_unmapped_area)(struct file *, unsigned long, |
| 523 | unsigned long, unsigned long, unsigned long); |
| 524 | int (*check_flags)(int); |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 525 | int (*flock) (struct file *, int, struct file_lock *); |
| 526 | ssize_t (*splice_write)(struct pipe_inode_info *, struct file *, loff_t *, |
| 527 | size_t, unsigned int); |
| 528 | ssize_t (*splice_read)(struct file *, loff_t *, struct pipe_inode_info *, |
| 529 | size_t, unsigned int); |
Jeff Layton | e6f5c78 | 2014-08-22 10:40:25 -0400 | [diff] [blame] | 530 | int (*setlease)(struct file *, long, struct file_lock **, void **); |
Christoph Hellwig | 2fe17c1 | 2011-01-14 13:07:43 +0100 | [diff] [blame] | 531 | long (*fallocate)(struct file *, int, loff_t, loff_t); |
Jan Kara | c625b4c | 2021-05-10 19:13:53 +0200 | [diff] [blame] | 532 | void (*show_fdinfo)(struct seq_file *m, struct file *f); |
| 533 | unsigned (*mmap_capabilities)(struct file *); |
| 534 | ssize_t (*copy_file_range)(struct file *, loff_t, struct file *, |
| 535 | loff_t, size_t, unsigned int); |
| 536 | loff_t (*remap_file_range)(struct file *file_in, loff_t pos_in, |
| 537 | struct file *file_out, loff_t pos_out, |
| 538 | loff_t len, unsigned int remap_flags); |
| 539 | int (*fadvise)(struct file *, loff_t, loff_t, int); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 540 | |
| 541 | locking rules: |
Linus Torvalds | a11e1d4 | 2018-06-28 09:43:44 -0700 | [diff] [blame] | 542 | All may block. |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 543 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 544 | ->llseek() locking has moved from llseek to the individual llseek |
| 545 | implementations. If your fs is not using generic_file_llseek, you |
| 546 | need to acquire and release the appropriate locks in your ->llseek(). |
| 547 | For many filesystems, it is probably safe to acquire the inode |
Jan Blunck | 866707f | 2010-05-26 14:44:54 -0700 | [diff] [blame] | 548 | mutex or just to use i_size_read() instead. |
| 549 | Note: this does not protect the file->f_pos against concurrent modifications |
| 550 | since this is something the userspace has to take care about. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 551 | |
Sean Anderson | 965de0e | 2018-05-23 22:29:10 -0400 | [diff] [blame] | 552 | ->iterate() is called with i_rwsem exclusive. |
| 553 | |
| 554 | ->iterate_shared() is called with i_rwsem at least shared. |
| 555 | |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 556 | ->fasync() is responsible for maintaining the FASYNC bit in filp->f_flags. |
| 557 | Most instances call fasync_helper(), which does that maintenance, so it's |
| 558 | not normally something one needs to worry about. Return values > 0 will be |
| 559 | mapped to zero in the VFS layer. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 560 | |
| 561 | ->readdir() and ->ioctl() on directories must be changed. Ideally we would |
| 562 | move ->readdir() to inode_operations and use a separate method for directory |
| 563 | ->ioctl() or kill the latter completely. One of the problems is that for |
| 564 | anything that resembles union-mount we won't have a struct file for all |
| 565 | components. And there are other reasons why the current interface is a mess... |
| 566 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 567 | ->read on directories probably must go away - we should just enforce -EISDIR |
| 568 | in sys_read() and friends. |
| 569 | |
Jeff Layton | f82b4b6 | 2014-08-22 18:50:48 -0400 | [diff] [blame] | 570 | ->setlease operations should call generic_setlease() before or after setting |
| 571 | the lease within the individual filesystem to record the result of the |
| 572 | operation |
| 573 | |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 574 | ->fallocate implementation must be really careful to maintain page cache |
| 575 | consistency when punching holes or performing other operations that invalidate |
| 576 | page cache contents. Usually the filesystem needs to call |
| 577 | truncate_inode_pages_range() to invalidate relevant range of the page cache. |
| 578 | However the filesystem usually also needs to update its internal (and on disk) |
| 579 | view of file offset -> disk block mapping. Until this update is finished, the |
| 580 | filesystem needs to block page faults and reads from reloading now-stale page |
| 581 | cache contents from the disk. Since VFS acquires mapping->invalidate_lock in |
| 582 | shared mode when loading pages from disk (filemap_fault(), filemap_read(), |
| 583 | readahead paths), the fallocate implementation must take the invalidate_lock to |
| 584 | prevent reloading. |
| 585 | |
| 586 | ->copy_file_range and ->remap_file_range implementations need to serialize |
| 587 | against modifications of file data while the operation is running. For |
| 588 | blocking changes through write(2) and similar operations inode->i_rwsem can be |
| 589 | used. To block changes to file contents via a memory mapping during the |
| 590 | operation, the filesystem must take mapping->invalidate_lock to coordinate |
| 591 | with ->page_mkwrite. |
| 592 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 593 | dquot_operations |
| 594 | ================ |
| 595 | |
| 596 | prototypes:: |
| 597 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 598 | int (*write_dquot) (struct dquot *); |
| 599 | int (*acquire_dquot) (struct dquot *); |
| 600 | int (*release_dquot) (struct dquot *); |
| 601 | int (*mark_dirty) (struct dquot *); |
| 602 | int (*write_info) (struct super_block *, int); |
| 603 | |
| 604 | These operations are intended to be more or less wrapping functions that ensure |
| 605 | a proper locking wrt the filesystem and call the generic quota operations. |
| 606 | |
| 607 | What filesystem should expect from the generic quota functions: |
| 608 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 609 | ============== ============ ========================= |
| 610 | ops FS recursion Held locks when called |
| 611 | ============== ============ ========================= |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 612 | write_dquot: yes dqonoff_sem or dqptr_sem |
| 613 | acquire_dquot: yes dqonoff_sem or dqptr_sem |
| 614 | release_dquot: yes dqonoff_sem or dqptr_sem |
| 615 | mark_dirty: no - |
| 616 | write_info: yes dqonoff_sem |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 617 | ============== ============ ========================= |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 618 | |
| 619 | FS recursion means calling ->quota_read() and ->quota_write() from superblock |
| 620 | operations. |
| 621 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 622 | More details about quota locking can be found in fs/dquot.c. |
| 623 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 624 | vm_operations_struct |
| 625 | ==================== |
| 626 | |
| 627 | prototypes:: |
| 628 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 629 | void (*open)(struct vm_area_struct*); |
| 630 | void (*close)(struct vm_area_struct*); |
Souptick Joarder | fe3136f | 2018-07-22 18:31:34 +0530 | [diff] [blame] | 631 | vm_fault_t (*fault)(struct vm_area_struct*, struct vm_fault *); |
| 632 | vm_fault_t (*page_mkwrite)(struct vm_area_struct *, struct vm_fault *); |
| 633 | vm_fault_t (*pfn_mkwrite)(struct vm_area_struct *, struct vm_fault *); |
Rik van Riel | 28b2ee2 | 2008-07-23 21:27:05 -0700 | [diff] [blame] | 634 | int (*access)(struct vm_area_struct *, unsigned long, void*, int, int); |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 635 | |
| 636 | locking rules: |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 637 | |
Randy Dunlap | 6cbef2a | 2020-06-14 20:22:19 -0700 | [diff] [blame] | 638 | ============= ========= =========================== |
Michel Lespinasse | c1e8d7c | 2020-06-08 21:33:54 -0700 | [diff] [blame] | 639 | ops mmap_lock PageLocked(page) |
Randy Dunlap | 6cbef2a | 2020-06-14 20:22:19 -0700 | [diff] [blame] | 640 | ============= ========= =========================== |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 641 | open: yes |
| 642 | close: yes |
| 643 | fault: yes can return with page locked |
Kirill A. Shutemov | 8c6e50b | 2014-04-07 15:37:18 -0700 | [diff] [blame] | 644 | map_pages: yes |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 645 | page_mkwrite: yes can return with page locked |
Boaz Harrosh | dd90618 | 2015-04-15 16:15:11 -0700 | [diff] [blame] | 646 | pfn_mkwrite: yes |
Christoph Hellwig | b83be6f | 2010-12-16 12:04:54 +0100 | [diff] [blame] | 647 | access: yes |
Randy Dunlap | 6cbef2a | 2020-06-14 20:22:19 -0700 | [diff] [blame] | 648 | ============= ========= =========================== |
Mark Fasheh | ed2f2f9 | 2007-07-19 01:47:01 -0700 | [diff] [blame] | 649 | |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 650 | ->fault() is called when a previously not present pte is about to be faulted |
| 651 | in. The filesystem must find and return the page associated with the passed in |
| 652 | "pgoff" in the vm_fault structure. If it is possible that the page may be |
| 653 | truncated and/or invalidated, then the filesystem must lock invalidate_lock, |
| 654 | then ensure the page is not already truncated (invalidate_lock will block |
Nick Piggin | b827e49 | 2009-04-30 15:08:16 -0700 | [diff] [blame] | 655 | subsequent truncate), and then return with VM_FAULT_LOCKED, and the page |
| 656 | locked. The VM will unlock the page. |
| 657 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 658 | ->map_pages() is called when VM asks to map easy accessible pages. |
Kirill A. Shutemov | bae473a | 2016-07-26 15:25:20 -0700 | [diff] [blame] | 659 | Filesystem should find and map pages associated with offsets from "start_pgoff" |
| 660 | till "end_pgoff". ->map_pages() is called with page table locked and must |
Kirill A. Shutemov | 8c6e50b | 2014-04-07 15:37:18 -0700 | [diff] [blame] | 661 | not block. If it's not possible to reach a page without blocking, |
| 662 | filesystem should skip it. Filesystem should use do_set_pte() to setup |
Kirill A. Shutemov | bae473a | 2016-07-26 15:25:20 -0700 | [diff] [blame] | 663 | page table entry. Pointer to entry associated with the page is passed in |
Jan Kara | 82b0f8c | 2016-12-14 15:06:58 -0800 | [diff] [blame] | 664 | "pte" field in vm_fault structure. Pointers to entries for other offsets |
Kirill A. Shutemov | bae473a | 2016-07-26 15:25:20 -0700 | [diff] [blame] | 665 | should be calculated relative to "pte". |
Kirill A. Shutemov | 8c6e50b | 2014-04-07 15:37:18 -0700 | [diff] [blame] | 666 | |
Jan Kara | 730633f | 2021-01-28 19:19:45 +0100 | [diff] [blame] | 667 | ->page_mkwrite() is called when a previously read-only pte is about to become |
| 668 | writeable. The filesystem again must ensure that there are no |
| 669 | truncate/invalidate races or races with operations such as ->remap_file_range |
| 670 | or ->copy_file_range, and then return with the page locked. Usually |
| 671 | mapping->invalidate_lock is suitable for proper serialization. If the page has |
| 672 | been truncated, the filesystem should not look up a new page like the ->fault() |
| 673 | handler, but simply return with VM_FAULT_NOPAGE, which will cause the VM to |
| 674 | retry the fault. |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 675 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 676 | ->pfn_mkwrite() is the same as page_mkwrite but when the pte is |
Boaz Harrosh | dd90618 | 2015-04-15 16:15:11 -0700 | [diff] [blame] | 677 | VM_PFNMAP or VM_MIXEDMAP with a page-less entry. Expected return is |
| 678 | VM_FAULT_NOPAGE. Or one of the VM_FAULT_ERROR types. The default behavior |
| 679 | after this call is to make the pte read-write, unless pfn_mkwrite returns |
| 680 | an error. |
| 681 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 682 | ->access() is called when get_user_pages() fails in |
Stefan Weil | 507da6a | 2013-12-05 20:34:05 +0100 | [diff] [blame] | 683 | access_process_vm(), typically used to debug a process through |
Rik van Riel | 28b2ee2 | 2008-07-23 21:27:05 -0700 | [diff] [blame] | 684 | /proc/pid/mem or ptrace. This function is needed only for |
| 685 | VM_IO | VM_PFNMAP VMAs. |
| 686 | |
Mauro Carvalho Chehab | ec23eb5 | 2019-07-26 09:51:27 -0300 | [diff] [blame] | 687 | -------------------------------------------------------------------------------- |
| 688 | |
Linus Torvalds | 1da177e | 2005-04-16 15:20:36 -0700 | [diff] [blame] | 689 | Dubious stuff |
| 690 | |
| 691 | (if you break something or notice that it is broken and do not fix it yourself |
| 692 | - at least put it here) |