linux/fs/xfs/linux-2.6
Hugh Dickins 4c21e2f244 [PATCH] mm: split page table lock
Christoph Lameter demonstrated very poor scalability on the SGI 512-way, with
a many-threaded application which concurrently initializes different parts of
a large anonymous area.

This patch corrects that, by using a separate spinlock per page table page, to
guard the page table entries in that page, instead of using the mm's single
page_table_lock.  (But even then, page_table_lock is still used to guard page
table allocation, and anon_vma allocation.)

In this implementation, the spinlock is tucked inside the struct page of the
page table page: with a BUILD_BUG_ON in case it overflows - which it would in
the case of 32-bit PA-RISC with spinlock debugging enabled.

Splitting the lock is not quite for free: another cacheline access.  Ideally,
I suppose we would use split ptlock only for multi-threaded processes on
multi-cpu machines; but deciding that dynamically would have its own costs.
So for now enable it by config, at some number of cpus - since the Kconfig
language doesn't support inequalities, let preprocessor compare that with
NR_CPUS.  But I don't think it's worth being user-configurable: for good
testing of both split and unsplit configs, split now at 4 cpus, and perhaps
change that to 8 later.

There is a benefit even for singly threaded processes: kswapd can be attacking
one part of the mm while another part is busy faulting.

Signed-off-by: Hugh Dickins <hugh@veritas.com>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-10-29 21:40:42 -07:00
..
kmem.c [PATCH] gfp_t: fs/* 2005-10-28 08:16:47 -07:00
kmem.h [PATCH] gfp_t: fs/* 2005-10-28 08:16:47 -07:00
mrlock.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
mutex.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
sema.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
spin.h [XFS] Manage spinlock differences between kernel versions a bit. 2005-09-05 08:27:50 +10:00
sv.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
time.h [PATCH] fs: fix-up schedule_timeout() usage 2005-09-10 10:06:36 -07:00
xfs_aops.c [PATCH] gfp_t: fs/* 2005-10-28 08:16:47 -07:00
xfs_aops.h [XFS] Delay I/O completion for unwritten extents after conversion 2005-09-05 08:23:35 +10:00
xfs_buf.c [PATCH] mm: split page table lock 2005-10-29 21:40:42 -07:00
xfs_buf.h [XFS] replace "extern inline" with "static inline" Patch from Adrian Bunk 2005-09-05 08:40:49 +10:00
xfs_cred.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_export.c Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_export.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_file.c [XFS] send dmapi events from nopage for mmapped files 2005-09-02 15:43:05 +10:00
xfs_fs_subr.c Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_fs_subr.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_globals.c Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_globals.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_ioctl32.c [XFS] add handlers to fix xfs_flock_t alignment issues in compat ioctls 2005-09-05 08:25:06 +10:00
xfs_ioctl32.h [XFS] Fix directory inodes ioctl compat code, minor code consistency cleanups 2005-05-06 06:44:46 -07:00
xfs_ioctl.c [XFS] remove struct vnode::v_type 2005-09-02 16:46:51 +10:00
xfs_iops.c [XFS] Sort out some cosmetic differences between XFS trees. 2005-09-05 11:47:01 +10:00
xfs_iops.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_linux.h [XFS] Sort out some cosmetic differences between XFS trees. 2005-09-05 11:47:01 +10:00
xfs_lrw.c [XFS] Delay direct I/O completion to a workqueue This is nessecary 2005-09-05 08:22:52 +10:00
xfs_lrw.h [XFS] Add a chunk of tracing code to diagnose truncate related issues. 2005-09-02 16:40:17 +10:00
xfs_stats.c Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_stats.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_super.c [PATCH] fs: fix-up schedule_timeout() usage 2005-09-10 10:06:36 -07:00
xfs_super.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_sysctl.c Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_sysctl.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_version.h Linux-2.6.12-rc2 2005-04-16 15:20:36 -07:00
xfs_vfs.c [XFS] Switch kernel thread handling to the kthread_ API 2005-09-05 08:34:18 +10:00
xfs_vfs.h [XFS] Switch kernel thread handling to the kthread_ API 2005-09-05 08:34:18 +10:00
xfs_vnode.c [XFS] streamline the clear_inode path 2005-09-05 08:23:54 +10:00
xfs_vnode.h [XFS] streamline the clear_inode path 2005-09-05 08:23:54 +10:00