Minki/linux
1
0
Fork 1
mirror of https://github.com/torvalds/linux.git synced 2024-11-22 20:22:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,294,618 Commits 7 Branches 862 Tags 6.4 GiB
af05633d40
Commit Graph

4041 Commits

Author SHA1 Message Date
Kent Overstreet
5df4be3f62 bcachefs: Btree iter improvements 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
03e183cb5d bcachefs: Verify fs hasn't been modified before going rw 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
134915f3d3 bcachefs: Go rw lazily 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
65e7ab8f2a bcachefs: Fix a deadlock 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
11e6f19a30 bcachefs: Rework error handling in btree update path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
8b2b9d11b9 bcachefs: Fix error handling in gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
6122ab639c bcachefs: More debug params for testing of recovery paths 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
05235e9928 bcachefs: Run gc if failed to read alloc btree 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
082f0801e0 bcachefs: Fix error handling in bch2_fs_recovery() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
dc3b63dc33 bcachefs: Add time stats for btree updates 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
1a470560c9 bcachefs: BTREE_INSERT_ATOMIC must be used for extents now 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
49a67206e4 bcachefs: Add more time stats for being blocked on allocator 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
7c648fe899 bcachefs: Fix a deadlock 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
4d8100daa9 bcachefs: Allocate fs_usage in do_btree_insert_at() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
9623ab27ab bcachefs: Btree update path cleanup 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
0dc17247f1 bcachefs: kill struct btree_insert 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
0564b16782 bcachefs: convert bch2_btree_insert_at() usage to bch2_trans_commit() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:18 -04:00
Kent Overstreet
94d290e40c bcachefs: drop btree_insert->did_work 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
9a12b1b097 bcachefs: Refactor extent insert path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
c93cead058 bcachefs: Always use bch2_extent_trim_atomic() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
db8a5f0a6a bcachefs: fix bch2_mark_bkey_replicas() call 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
18c9883e1c bcachefs: fix bch2_invalidate_one_bucket2() during journal replay 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
61f321fc8b bcachefs: Make deferred inode updates a mount option 
Journal reclaim may still need performance tuning

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
3aea434272 bcachefs: Fix for shutting down before fs started marking it clean 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
844045581e bcachefs: Fix for when compressed extent is split during journal replay 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
a8e00bd48a bcachefs: increase BTREE_ITER_MAX 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
db6447b383 bcachefs: fix a faulty assertion 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
812af308de bcachefs: assertion to catch outstanding bug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
b5d056358d bcachefs: minor journal reclaim fixes 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
59928c1220 bcachefs: Don't BUG_ON() on bucket sector count overflow 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
446c562c2c bcachefs: Remove direct use of bch2_btree_iter_link() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
5154704b29 bcachefs: Use deferred btree updates for inode updates 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
3e5d6c59be bcachefs: Use journal preres for deferred btree updates 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
68ef94a63c bcachefs: Add a pre-reserve mechanism for the journal 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
9ace606e93 bcachefs: Don't block on reclaim_lock from journal_res_get 
When we're doing btree updates from journal flush, this becomes a
locking inversion

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
03d5eaed86 bcachefs: bch2_journal_space_available improvements 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
2384db8f32 bcachefs: Separate discards from rest of journal reclaim 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
0ce2dbbe99 bcachefs: ja->discard_idx, ja->dirty_idx 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:17 -04:00
Kent Overstreet
fcbf3e5096 bcachefs: Allocator startup fixes/refactoring 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
dc9aa17841 bcachefs: Drop a faulty assertion 
the assertion was meant to check that bch2_journal_reclaim_fast() was
always being called, but since the atomic dec can happen outside of
j->lock the assertion itself can race

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
1633e492ce bcachefs: improved flush_held_btree_writes() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
6409c6a0ae bcachefs: use correct wq for journal reclaim 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
e5a66496a0 bcachefs: Journal reclaim refactoring 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
2d3b581039 bcachefs: Better journal debug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
c8cc5b3e3f bcachefs: Don't get journal reservation until after we know insert will succeed 
Checking if we can do the insert after getting the journal reservation
means potentially wasting space in the journal, which will break the new
pre reservation mechanism

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8db2acde2f bcachefs: fix integer underflow in journal code 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
28062d320b bcachefs: Fix gc handling of bucket gens 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
86a225c42d bcachefs: fix a deadlock on startup 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
3c5fa33a55 bcachefs: force str_hash code to be inlined 
the btree trans iterator stuff relies on a dirty horrible hack that uses
a short backtrace to generate tokens, and gcc uninlining these functions
breaks that hack. ugh.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
d16b4a77a5 bcachefs: Assorted journal refactoring 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
ecf37a4a80 bcachefs: fs_usage_u64s() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
768ac63924 bcachefs: Add a mechanism for blocking the journal 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8fe826f90a bcachefs: Convert bucket invalidation to key marking path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
73c27c6095 bcachefs: fixes for cached data accounting 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8c96cfccf0 bcachefs: fix more locking bugs 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
8777210b92 bcachefs: refactor key marking code a bit 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
2ecc6171a3 bcachefs: Fix double counting when gc is running 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
39fbc5a49f bcachefs: gc lock no longer needed for disk reservations 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:16 -04:00
Kent Overstreet
76f4c7b0c3 bcachefs: Fix oldest_gen handling 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
053dbb377d bcachefs: Fix a locking bug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
6639339253 bcachefs: Fix a lockdep splat 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
f7e76361c4 bcachefs: no need to run gc when initializing new fs 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
6d033aa404 bcachefs: Don't need to walk inodes on clean shutdown 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
1df42b5715 bcachefs: don't do initial gc if have alloc info feature 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
3577df5f7f bcachefs: serialize persistent_reserved 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
3e0745e283 bcachefs: initialize fs usage summary in recovery 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
42b72e0ba2 bcachefs: journal_replay_early() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
3ccc5c50f2 bcachefs: Write out fs usage 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
2c5af169f7 bcachefs: reserve space in journal for fs usage entries 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
24547d097a bcachefs: fix bch2_sb_field_resize() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
94cd106f8d bcachefs: delete a debug printk 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
736affa8bb bcachefs: fix for unmount hang 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
b935a8a67a bcachefs: Fix a bug when shutting down before allocator started 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
4c97e04aa8 bcachefs: percpu utility code 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
fe112812ae bcachefs: sysfs trigger for bch2_alloc_write 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
eac3ca0f49 bcachefs: New journal_entry_res mechanism 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
6e1b07183a bcachefs: improve alloc_debug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
bdba6c29ff bcachefs: fix inode counting 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
61c8d7c8eb bcachefs: Persist stripe blocks_used 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:15 -04:00
Kent Overstreet
ed1646ca74 bcachefs: Improve c version of __bkey_cmp_bits 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
430735cd1a bcachefs: Persist alloc info on clean shutdown 
- Does not persist alloc info for stripes yet
 - Also does not yet include filesystem block/sector counts yet, from
struct fs_usage
 - Not made use of just yet

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
5e5d9bdbb8 bcachefs: Fix fifo overflow in allocator startup 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
7ef2a73a58 bcachefs: Fix check for if extent update is allocating 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
dbaee46846 bcachefs: fix error message in device remove path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
919dbbd18b bcachefs: dio arithmetic improvements 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
b030f691da bcachefs: Fix some reserve calculations 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
0519b72dd2 bcachefs: Add a workqueue for journal reclaim 
journal reclaim writes btree nodes, which can end up waiting for in
flight btree writes to complete, and btree write completions run out of
workqueues - so we can't run out of the same workqueue or we risk
deadlock

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
b0cbf659a5 bcachefs: Fix an allocator error path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
000de45996 bcachefs: fixes for getting stuck flushing journal pins 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
ed4840308c bcachefs: Fix a dio bug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
d0cc3defba bcachefs: More allocator startup improvements 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
b8adb83365 bcachefs: correctly initialize bch_extent_ptr 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
04c2c34f00 bcachefs: use crc64 from lib/ 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
23f80d2b3b bcachefs: Factor out acc_u64s() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
e47c017144 bcachefs: Minor replicas.c refactoring 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
e19e57f8a1 bcachefs: fix new reinherit_attrs ioctl 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
0b847a19d9 bcachefs: Lots of option handling improvements 
Add helptext to option definitions - so  we can unify the option
handling with the format command

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
2fab25cdd7 bcachefs: more project quota fixes 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
69d46f9031 bcachefs: fix an rcu usage bug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
a36d3685bb bcachefs: fix ja->cur_idx use while reading journal 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:14 -04:00
Kent Overstreet
d3bb629d04 bcachefs: fix device remove error path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
19b505a934 bcachefs: Fix duplicate ioctl nr 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
8095708fce bcachefs: bch2_ioc_reinherit_attrs() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
96012e143e bcachefs: rename keeps inheritable inode opts consistent 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
4d269918ed bcachefs: add bcachefs_effective xattrs 
Allows seeing xattrs that were inherited, not explicitly set

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
721d4ad8eb bcachefs: Add flags to indicate if inode opts were inherited or explicitly set 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
0f5254aa98 bcachefs: bch2_fs_quota_transfer 
improve quota transfer locking & make ei_qid usage more consistent

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
d42dd4ad6d bcachefs: merge BCH_INODE_FIELDS_INHERIT/BCH_INODE_OPTS 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
a3e70fb287 bcachefs: use x-macros more consistently 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
7121643e4f bcachefs: Fix for building in userspace 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Tim Schlueter
f9ccc30824 bcachefs: Fix bkey_method compilation on gcc 7.3.0 
Signed-off-by: Tim Schlueter <schlueter.tim@linux.com>
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
06b7345cc2 bcachefs: Include summarized counts in fs_usage 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
5663a41521 bcachefs: refactor bch_fs_usage 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
73e6ab9564 bcachefs: Switch replicas to mark_lock 
Prep work for upcoming disk accounting changes

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
56e0e7c79f bcachefs: fix an incorrect bkey_debugcheck() call 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
45dbb73e40 bcachefs: improve extent debugcheck fn 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
641ab73643 bcachefs: improve/clarify ptr_disk_sectors() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
57cb2142ed bcachefs: Fix for running in degraded mode 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
db636adb2e bcachefs: Compression fixes 
regressions from switching disk space accounting to be in compressed
sectors

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
56338d3dc3 bcachefs: propagate BCH_WRITE_CACHED 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
9166b41db1 bcachefs: s/usage_lock/mark_lock 
better describes what it's for, and we're going to call a new lock
usage_lock

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
76640280ac bcachefs: New blockcount field for bch_stripe 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:13 -04:00
Kent Overstreet
8eb7f3ee46 bcachefs: move dirty into bucket_mark 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
90541a741d bcachefs: Add new alloc fields 
prep work for persistent alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
3636ed489a bcachefs: Deferred btree updates 
Will be used in the future for inode updates, which will be very helpful
for multithreaded workloads that have to update the inode with every
extent update (appends, or updates that change i_sectors)

Also will be used eventually for fully persistent alloc info

However - we still need a mechanism for reserving space in the journal
prior to getting a journal reservation, so it's not technically safe to
make use of this just yet, we could deadlock with the journal full
(although not likely to be an issue in practice)

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
eb8632657f bcachefs: drop bogus percpu_ref_tryget 
caller should already be guarding against rw, and checking here breaks
when caller needs to finish updates for going RO

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
f0cfb963ec bcachefs: Track nr_inodes with the key marking machinery 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
26609b619f bcachefs: Make bkey types globally unique 
this lets us get rid of a lot of extra switch statements - in a lot of
places we dispatch on the btree node type, and then the key type, so
this is a nice cleanup across a lot of code.

Also improve the on disk format versioning stuff.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
01a0108f01 bcachefs: Fix a btree iter usage error 
previously, if the code traversed to the next btree node, that could
return an error (due to lock restarts) - which was not being checked
for.

fix is to rework it so it never iterates past the current leaf node, and
pops an assertion if it ever sees an error.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
5b8a9227f8 bcachefs: Split out bkey_sort.c 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
9d11058a78 bcachefs: fix waiting on an open journal entry 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
d034c09b26 bcachefs: return errors correctly from gc 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
eeb83e25bb bcachefs: Hold usage_lock over mark_key and fs_usage_apply 
Fixes an inconsistency at the end of gc

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
dfe9bfb32e bcachefs: Stripes now properly subject to gc 
gc now verifies the contents of the stripes radix tree, important for
persistent alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
ad7ae8d63f bcachefs: Btree locking fix, refactoring 
Hit an assertion, probably spurious, indicating an iterator was unlocked
when it shouldn't have been (spurious because it wasn't locked at all
when the caller called btree_insert_at()).

Add a flag, BTREE_ITER_NOUNLOCK, and tighten up the assertions

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
de5bb710f9 bcachefs: shim for userspace raid library 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
4e65431c85 Revert "bcachefs: start erasure coding after journal replay" 
This reverts commit 36f389604294dfc953e6f5624ceb683818d32f28.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
e88973373a bcachefs: Allow for new alloc fields 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
9ca53b55f7 bcachefs: gc now operates on second set of bucket marks 
This means we can now use gc to verify the allocation information -
important for testing persistant alloc info

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
e647369168 bcachefs: fix mempool double initialization 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
8812600c29 bcachefs: fix btree iterator bug when using depth > 0 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
61274e9d45 bcachefs: Allocator startup improvements 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
a9ec345401 bcachefs: Journal refactoring 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:12 -04:00
Kent Overstreet
f1a79365a7 bcachefs: Don't block on journal reservation with btree locks held 
Fixes a deadlock between the allocator thread, when it first starts up,
and journal replay

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
129550c4d0 bcachefs: start erasure coding after journal replay 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
f81b648d1f bcachefs: Clean up, possixly fix page disk reservation accounting 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
b1ba2359fb bcachefs: Fix an error path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
283cca30a8 bcachefs: fix typo when picking read method 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
cd575ddf57 bcachefs: Erasure coding 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
91f8b5677b bcachefs: More btree gc refactorings 
more prep work for erasure coding

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
1d25849c2c bcachefs: Centralize marking of replicas in btree update path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
b35b192583 bcachefs: Move key marking out of extents.c 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
af9d3bc203 bcachefs: stripe support for replicas tracking 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
c258f28eba bcachefs: Check for unsupported features 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
319f9ac38e bcachefs: revamp to_text methods 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
75369d4ec3 bcachefs: delete some dead code 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
82ebd49cd6 bcachefs: fix a replicas bug 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Tim Schlueter
a420eea689 bcachefs: Set the last mount time using the realtime clock 
This way the last mount time is actually meaningful instead of just being
various times from 1970 (which happens with the monotonic clock).

Also, roundup_pow_of_two() is undefined when passed in 0, so check before
calling it.

Signed-off-by: Tim Schlueter <schlueter.tim@linux.com>
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
4628529f15 bcachefs: Disk usage in compressed sectors, not uncompressed 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
8b335baef2 bcachefs: Assorted fixes for running on very small devices 
It's now possible to create and use a filesystem on a 512k device with
4k buckets (though at that size we still waste almost half to internal
reserves)

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
b092dadd55 bcachefs: Scale down number of writepoints when low on space 
this means we don't have to reserve space for them when calculating
filesystem capacity

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
72644db153 bcachefs: Fix an assertion when rebuilding replicas 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
02f1a96c13 bcachefs: Rename nofsck opt to fsck 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
6bdbfa87a8 bcachefs: Fix journal replay when replicas sb section missing 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:11 -04:00
Kent Overstreet
636ad1d391 bcachefs: fix bounds checks in bch2_bio_map() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
ac10a9611d bcachefs: Some fixes for building in userspace 
userspace allocators don't align allocations as nicely as kernel
allocators, which meant that in some cases we weren't allocating big
enough bvec arrays - just make the calculations more rigorous and
explicit to fix it.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
b564513cf9 bcachefs: fix bch2_bkey_print_bfloat 
was popping an assertion in the eytzinger code

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
5bd95a3718 bcachefs: new avoid mechanism for io retries 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
47799326bc bcachefs: more key marking refactoring 
prep work for erasure coding

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
103e212785 bcachefs: replicas: prep work for stripes 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
7a920560d7 bcachefs: kill struct bch_replicas_cpu_entry 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
198d67006b bcachefs: add functionality for heaps to update backpointers 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
2252aa271c bcachefs: btree gc refactoring 
prep work for erasure coding

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
abce30b79b bcachefs: BCH_EXTENT_ENTRY_TYPES() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
71c9e0ba42 bcachefs: bch2_extent_ptr_decoded_append() 
This new helper for the move path avoids creating a new CRC entry when
we already have one that matches the pointer being added.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
a2753581f6 bcachefs: bch2_extent_drop_ptrs() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
1742237ba1 bcachefs: extent_for_each_ptr_decode() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
642d66d1bb bcachefs: kill bch_extent_crc_type 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
4cb1315666 bcachefs: extent_ptr_decoded 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
deb3318b0e bcachefs: fix missing include 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
6278a46da3 bcachefs: fix a spurious gcc warning 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
ef337c54c6 bcachefs: Allocation code refactoring 
bch2_alloc_sectors_start() was a nightmare to work with - it's got some
tricky stuff to do, since it wants to use the buckets the writepoint
already has, unless they're not in the target it wants to write to,
unless it can't allocate from any other devices in which case it will
use those buckets if it has to - et cetera.

This restructures the code to start with a new empty list of open
buckets we're going to use for the new allocation, pulling buckets from
the write point's list as we decide that we really are going to use
them - making the code somewhat more functional and drastically easier
to understand.

Also fixes a bug where we could end up waiting on c->freelist_wait
(because allocating from one device failed) but return success from
bch2_bucket_alloc(), because allocating from a different device
succeeded.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
7b3f84ea7d bcachefs: Split out alloc_background.c 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
f43cc5be6e bcachefs: Fix failure to suspend 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
c2fcff5973 bcachefs: Fix suspend when moving data faster than ratelimit 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:10 -04:00
Kent Overstreet
d06182cadb bcachefs: fix bch2_acl_chmod() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
34b8e55276 bcachefs: Fix a deadlock 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
cf0517af15 bcachefs: fix a divide 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
bc230209d3 bcachefs: make fsck spew less 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
741daa5be5 bcachefs: Dirent repair code 
There was a bug for awhile in previous kernels where we weren't
computing dirent name lengths correctly and we weren't zeroing out
padding at the end of dirents (due to struct bch_dirent changing size by
adding __attribute__((aligned)), and not updating other code to use
offsetof).

This patch fixes dirents with junk at the end, by going off of the
dirent's hash.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
cbdf24cef1 bcachefs: Fix a btree iter bug when iter pos == POS_MAX 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
a00fd8c535 bcachefs: Comparison function cleanups 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
f84306a570 bcachefs: Prioritize fragmentation in bucket allocator 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
216c9facfd bcachefs: Pass around bset_tree less 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
fc3268c13c bcachefs: kill extent_insert_hook 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
190fa7af39 bcachefs: kill i_sectors_hook 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
8ef231bd51 bcachefs: convert fcollapse to bch2_extent_update() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
5f461e01b8 bcachefs: convert fpunch to bch2_extent_update() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
54e2264e17 bcachefs: convert truncate to bch2_extent_update() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
08af47dfc2 bcachefs: convert bchfs_write_index_update() to bch2_extent_update() 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
e2d9912c6f bcachefs: bch2_extent_trim_atomic() 
Prep work for extents insert hook removal

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
581edb6341 bcachefs: mempoolify btree_trans 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
cc1add4a80 bcachefs: BTREE_INSERT_JOURNAL_RES_FULL is no longer possible 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
df8a42393e bcachefs: extent_squash() can no longer fail 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
e4ccb25131 bcachefs: make struct btree_iter a bit smaller 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
271a3d3a4b bcachefs: lift ordering restriction on 0 size extents 
This lifts the restriction that 0 size extents must not overlap with
other extents, which means we can now sort extents and non extents the
same way, and will let us simplify a bunch of other stuff as well.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:09 -04:00
Kent Overstreet
0fdf18047f bcachefs: extent unit tests 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
1fe08f31b2 bcachefs: bkey_written() 
also cleanups of btree node offsets

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
617391baa5 bcachefs: improved rw_aux_tree_bsearch() 
shouldn't be any reason for an actual binary search here

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
b0004d8dfa bcachefs: Factor out btree_key_can_insert() 
working on getting rid of all the reasons bch2_insert_fixup_extent() can
fail/stop partway, which is needed for other refactorings.

One of the reasons we could have to bail out is if we're splitting a
compressed extent we might need to add to our disk reservation - but we
can check that before actually starting the insert.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
a50ed7c8e8 bcachefs: BCH_SB_RESERVE_BYTES 
Add an option, gc_reserve_bytes, to set the copygc reserve as a size
instead of a percent

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
a9bec5208b bcachefs: Better calculation of copygc threshold 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
6eac2c2e24 bcachefs: Change how replicated data is accounted 
Due to compression, the different replicas of a replicated extent don't
necessarily have to take up the same amount of space - so replicated
data sector counts shouldn't be stored divided by the number of
replicas.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
5b650fd11a bcachefs: Account for internal fragmentation better 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
09f3297ac9 bcachefs: kill s_alloc, use bch_data_type 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
a7c7a3092e bcachefs: bch2_mark_key() now takes bch_data_type 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
647d7b60b1 bcachefs: Fix an assertion in the btree node merge path 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
94c1f4adec bcachefs: Fix locking in allocator thread 
gc lock must be held while invalidating buckets - fixes
"1f7a95698e bcachefs: Invalidate buckets when writing to alloc btree"

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
277c981c63 bcachefs: fix bch2_val_to_text() 
was returning wrong value

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
bb1b3658aa bcachefs: minor fsync fix 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
9c859dc91b bcachefs: Assorted journal refactoring 
Also improve error reporting - only return an error from
bch2_journal_flush_seq() if we had an error writing that entry (i.e. not
if there was an error with a newer entry).

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
60476b14b4 bcachefs: fix last_seq_ondisk 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
658971f276 bcachefs: fix mtime/ctime update on truncate 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
73ab6f356d bcachefs: fix fsync after create 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
3142e7ef4b bcachefs: fix nbuckets usage on device resize 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
b29e197aaf bcachefs: Invalidate buckets when writing to alloc btree 
Prep work for persistent alloc information. Refactoring also lets us
make free_inc much smaller, which means a lot fewer buckets stranded on
freelists.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
b2be7c8b73 bcachefs: kill bucket mark sector count saturation 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
c692399529 bcachefs: don't call bch2_bucket_seq_cleanup from journal_buf_switch 
journal_buf_switch is called from the foreground when getting a journal
reservation and thus is somewhat latency sensitive;
bch2_bucket_seq_cleanup has to run infrequently but is a bit expensive
when it does run.

Call it from the journal write path instead, and punt the journal write
to worqueue context.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:08 -04:00
Kent Overstreet
8bb4dff72d bcachefs: Fix an assertion 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
d96b3ffe38 bcachefs: fix rename + fsync 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
19ee5f2ac4 bcachefs: Use ei_update_lock consistently 
This is prep work for using deferred btree updates for inode updates -
the way inodes are done now we're relying on btree locking for ei_inode
and ei_update_lock could probably be removed, but it'll actually be
needed when we switch to deferred updates.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
fc88796d1c bcachefs: bch2_trans_update() now takes struct btree_insert_entry 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
2ea9004864 bcachefs: Fix mtime/ctime updates 
Also make inode flags consistent with how the rest of the inode is
updated

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
4e1ec2cc0d bcachefs: Simplify bch2_write_inode_trans, fix lockdep splat 
ei_update_lock isn't currently needed for write inode (but it will be
needed again when deferred btree updates are used for inode updates)

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
af1c687181 bcachefs: add bch_verbose() statements for shutdown 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
4077991c85 bcachefs: Fix a use after free in the journal code 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
97446a242a bcachefs: Fix device add 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
1c7a0adf31 bcachefs: trace transaction restarts 
exceptionally crappy "tracing", but it's a start at documenting the
places restarts can be triggered

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
d69f41d6bb bcachefs: Convert raw uses of bch2_btree_iter_link() to new transactions 
Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
88c07f7397 bcachefs: Only check inode i_nlink during full fsck 
Now that all filesystem operatinos that manipulate the filesystem
heirachy and i_nlink are fully atomic, we can add a feature bit to
indicate i_nlink doesn't need to be checked.

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00
Kent Overstreet
1c6fdbd8f2 bcachefs: Initial commit 
Initially forked from drivers/md/bcache, bcachefs is a new copy-on-write
filesystem with every feature you could possibly want.

Website: https://bcachefs.org

Signed-off-by: Kent Overstreet <kent.overstreet@linux.dev>
 2023-10-22 17:08:07 -04:00