From: mchristi@redhat.com Subject: [PATCH 00/42] v6: separate operations from flags in the bio/request structs Date: Fri, 15 Apr 2016 05:39:20 -0500 Message-ID: <1460716802-2294-1-git-send-email-mchristi@redhat.com> To: linux-f2fs-devel@lists.sourceforge.net, linux-ext4@vger.kernel.org, konrad.wilk@oracle.com, drbd-dev@lists.linbit.com, philipp.reisner@linbit.com, lars.ellenberg@linbit.com, linux-raid@vger.kernel.org, dm-devel@redhat.com, linux-fsdevel@vger.kernel.org, linux-bcache@vger.kernel.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, linux-scsi@vger.kernel.org, linux-mtd@lists.infradead.org, target-devel@vger.kernel.org, linux-btrfs@vger.kernel.org, osd-dev@open-osd.org, xfs@oss.sgi.com, ocfs2-devel@oss.oracle.com Return-path: Sender: linux-bcache-owner@vger.kernel.org List-Id: linux-ext4.vger.kernel.org The following patches begin to cleanup the request->cmd_flags and bio->bi_rw mess. We currently use cmd_flags to specify the operation, attributes and state of the request. For bi_rw we use it for similar info and also the priority but then also have another bi_flags field for state. At some point, we abused them so much we just made cmd_flags 64 bits, so we could add more. The following patches seperate the operation (read, write discard, flush, etc) from cmd_flags/bi_rw. This patchset was made against linux-next from today April 15 (git tag next-20160415). I put a git tree here: https://github.com/mikechristie/linux-kernel.git The patches are in the op branch. v6 and maybe hopfully the last version: 1. Adapt patch 41 to Jens's QUEUE_FLAG_WC/FUA patchset. v5: 1. Missed crypto fs submit_bio_wait call. 2. Change nfs bi_rw check to bi_op. 3. btrfs. Convert finish_parity_scrub. 4. Reworked against Jens's QUEUE_FLAG patches so I could drop my similar code. 5. Separated the core block layer change into multiple patches for merging, elevator, stats, mq and non mq request allocation to try and make it easier to read. v4: 1. Rebased to current linux-next tree. v3: 1. Used "=" instead of "|=" to setup bio bi_rw. 2. Removed __get_request cmd_flags compat code. 3. Merged initial dm related changes requested by Mike Snitzer. 4. Fixed ubd kbuild errors in flush related patches. 5. Fix 80 char col issues in several patches. 6. Fix issue with one of the btrfs patches where it looks like I reverted a patch when trying to fix a merge error. v2 1. Dropped arguments from submit_bio, and had callers setup bio. 2. Add REQ_OP_FLUSH for request_fn users and renamed REQ_FLUSH to REQ_PREFLUSH for make_request_fn users. 3. Dropped bio/rq_data_dir functions, and added a op_is_write function instead. Diffstat for the set: Documentation/block/writeback_cache_control.txt | 28 ++++---- Documentation/device-mapper/log-writes.txt | 10 +-- arch/um/drivers/ubd_kern.c | 2 +- block/bio.c | 21 +++--- block/blk-core.c | 92 +++++++++++++------------ block/blk-flush.c | 23 ++++--- block/blk-lib.c | 12 ++-- block/blk-map.c | 2 +- block/blk-merge.c | 24 ++++--- block/blk-mq.c | 41 ++++++----- block/cfq-iosched.c | 53 ++++++++------ block/elevator.c | 7 +- drivers/ata/libata-scsi.c | 2 +- drivers/block/brd.c | 2 +- drivers/block/drbd/drbd_actlog.c | 33 +++++---- drivers/block/drbd/drbd_bitmap.c | 8 +-- drivers/block/drbd/drbd_int.h | 4 +- drivers/block/drbd/drbd_main.c | 20 +++--- drivers/block/drbd/drbd_protocol.h | 2 +- drivers/block/drbd/drbd_receiver.c | 37 ++++++---- drivers/block/drbd/drbd_req.c | 2 +- drivers/block/drbd/drbd_worker.c | 7 +- drivers/block/floppy.c | 3 +- drivers/block/loop.c | 14 ++-- drivers/block/mtip32xx/mtip32xx.c | 2 +- drivers/block/nbd.c | 4 +- drivers/block/osdblk.c | 2 +- drivers/block/pktcdvd.c | 4 +- drivers/block/ps3disk.c | 4 +- drivers/block/rbd.c | 4 +- drivers/block/rsxx/dma.c | 2 +- drivers/block/skd_main.c | 11 ++- drivers/block/umem.c | 2 +- drivers/block/virtio_blk.c | 2 +- drivers/block/xen-blkback/blkback.c | 29 +++++--- drivers/block/xen-blkfront.c | 65 ++++++++--------- drivers/block/zram/zram_drv.c | 2 +- drivers/ide/ide-cd_ioctl.c | 3 - drivers/ide/ide-disk.c | 2 +- drivers/ide/ide-floppy.c | 2 +- drivers/lightnvm/rrpc.c | 6 +- drivers/md/bcache/btree.c | 2 + drivers/md/bcache/debug.c | 8 ++- drivers/md/bcache/io.c | 2 +- drivers/md/bcache/journal.c | 9 +-- drivers/md/bcache/movinggc.c | 2 +- drivers/md/bcache/request.c | 27 ++++---- drivers/md/bcache/super.c | 26 ++++--- drivers/md/bcache/writeback.c | 4 +- drivers/md/bitmap.c | 6 +- drivers/md/dm-bufio.c | 9 ++- drivers/md/dm-cache-target.c | 18 ++--- drivers/md/dm-crypt.c | 8 ++- drivers/md/dm-era-target.c | 4 +- drivers/md/dm-flakey.c | 2 +- drivers/md/dm-io.c | 58 +++++++++------- drivers/md/dm-kcopyd.c | 25 ++++--- drivers/md/dm-log-writes.c | 13 ++-- drivers/md/dm-log.c | 5 +- drivers/md/dm-raid.c | 5 +- drivers/md/dm-raid1.c | 22 +++--- drivers/md/dm-region-hash.c | 6 +- drivers/md/dm-snap-persistent.c | 24 ++++--- drivers/md/dm-snap.c | 6 +- drivers/md/dm-stats.c | 9 ++- drivers/md/dm-stripe.c | 6 +- drivers/md/dm-thin.c | 25 ++++--- drivers/md/dm.c | 44 ++++++------ drivers/md/linear.c | 4 +- drivers/md/md.c | 21 ++++-- drivers/md/md.h | 5 +- drivers/md/multipath.c | 2 +- drivers/md/raid0.c | 4 +- drivers/md/raid1.c | 40 ++++++----- drivers/md/raid10.c | 54 ++++++++------- drivers/md/raid5-cache.c | 34 +++++---- drivers/md/raid5.c | 63 +++++++++-------- drivers/mmc/card/block.c | 10 ++- drivers/mmc/card/queue.c | 6 +- drivers/mmc/card/queue.h | 5 +- drivers/mtd/mtd_blkdevs.c | 4 +- drivers/nvme/host/core.c | 4 +- drivers/nvme/host/nvme.h | 2 +- drivers/nvme/host/pci.c | 2 +- drivers/scsi/osd/osd_initiator.c | 12 ++-- drivers/scsi/sd.c | 20 ++++-- drivers/staging/lustre/lustre/llite/lloop.c | 6 +- drivers/target/target_core_iblock.c | 42 +++++------ drivers/target/target_core_pscsi.c | 2 +- fs/btrfs/check-integrity.c | 61 ++++++++-------- fs/btrfs/check-integrity.h | 6 +- fs/btrfs/compression.c | 17 +++-- fs/btrfs/ctree.h | 2 +- fs/btrfs/disk-io.c | 44 ++++++------ fs/btrfs/disk-io.h | 2 +- fs/btrfs/extent-tree.c | 2 +- fs/btrfs/extent_io.c | 91 ++++++++++++------------ fs/btrfs/extent_io.h | 8 +-- fs/btrfs/inode.c | 71 ++++++++++--------- fs/btrfs/raid56.c | 17 +++-- fs/btrfs/scrub.c | 16 +++-- fs/btrfs/volumes.c | 91 ++++++++++++------------ fs/btrfs/volumes.h | 6 +- fs/buffer.c | 70 ++++++++++--------- fs/crypto/crypto.c | 3 +- fs/direct-io.c | 36 ++++++---- fs/exofs/ore.c | 2 +- fs/ext4/balloc.c | 2 +- fs/ext4/crypto.c | 3 +- fs/ext4/ialloc.c | 2 +- fs/ext4/inode.c | 8 +-- fs/ext4/mmp.c | 4 +- fs/ext4/namei.c | 3 +- fs/ext4/page-io.c | 9 ++- fs/ext4/readpage.c | 9 +-- fs/ext4/super.c | 2 +- fs/f2fs/checkpoint.c | 10 +-- fs/f2fs/data.c | 40 +++++++---- fs/f2fs/f2fs.h | 5 +- fs/f2fs/gc.c | 9 ++- fs/f2fs/inline.c | 3 +- fs/f2fs/node.c | 8 ++- fs/f2fs/segment.c | 16 +++-- fs/f2fs/trace.c | 7 +- fs/fat/misc.c | 2 +- fs/gfs2/bmap.c | 4 +- fs/gfs2/dir.c | 2 +- fs/gfs2/log.c | 8 +-- fs/gfs2/lops.c | 13 ++-- fs/gfs2/lops.h | 2 +- fs/gfs2/meta_io.c | 19 ++--- fs/gfs2/ops_fstype.c | 4 +- fs/gfs2/quota.c | 2 +- fs/hfsplus/hfsplus_fs.h | 2 +- fs/hfsplus/part_tbl.c | 5 +- fs/hfsplus/super.c | 6 +- fs/hfsplus/wrapper.c | 16 +++-- fs/isofs/compress.c | 2 +- fs/jbd2/commit.c | 6 +- fs/jbd2/journal.c | 10 +-- fs/jbd2/recovery.c | 4 +- fs/jfs/jfs_logmgr.c | 8 ++- fs/jfs/jfs_metapage.c | 10 +-- fs/logfs/dev_bdev.c | 17 +++-- fs/mpage.c | 42 +++++------ fs/nfs/blocklayout/blocklayout.c | 22 +++--- fs/nilfs2/btnode.c | 6 +- fs/nilfs2/btnode.h | 2 +- fs/nilfs2/btree.c | 6 +- fs/nilfs2/gcinode.c | 5 +- fs/nilfs2/mdt.c | 11 +-- fs/nilfs2/segbuf.c | 19 ++--- fs/ntfs/aops.c | 6 +- fs/ntfs/compress.c | 2 +- fs/ntfs/file.c | 2 +- fs/ntfs/logfile.c | 2 +- fs/ntfs/mft.c | 4 +- fs/ocfs2/aops.c | 2 +- fs/ocfs2/buffer_head_io.c | 8 +-- fs/ocfs2/cluster/heartbeat.c | 15 ++-- fs/ocfs2/super.c | 2 +- fs/reiserfs/inode.c | 4 +- fs/reiserfs/journal.c | 14 ++-- fs/reiserfs/stree.c | 4 +- fs/reiserfs/super.c | 2 +- fs/squashfs/block.c | 4 +- fs/udf/dir.c | 2 +- fs/udf/directory.c | 2 +- fs/udf/inode.c | 2 +- fs/ufs/balloc.c | 2 +- fs/ufs/util.c | 2 +- fs/xfs/xfs_aops.c | 14 ++-- fs/xfs/xfs_buf.c | 29 ++++---- include/linux/bio.h | 30 ++++---- include/linux/blk-cgroup.h | 13 ++-- include/linux/blk_types.h | 36 +++++----- include/linux/blkdev.h | 32 +++++---- include/linux/blktrace_api.h | 2 +- include/linux/buffer_head.h | 11 +-- include/linux/dm-io.h | 3 +- include/linux/elevator.h | 4 +- include/linux/fs.h | 57 ++++++++++----- include/trace/events/bcache.h | 12 ++-- include/trace/events/block.h | 31 ++++++--- include/trace/events/f2fs.h | 37 ++++++---- kernel/power/swap.c | 34 +++++---- kernel/trace/blktrace.c | 58 +++++++++------- mm/page_io.c | 10 +-- 188 files changed, 1529 insertions(+), 1217 deletions(-)