Lai Jiangshan 9ab1544eb4
rcu: introduce kfree_rcu() ...
Many rcu callbacks functions just call kfree() on the base structure.
These functions are trivial, but their size adds up, and furthermore
when they are used in a kernel module, that module must invoke the
high-latency rcu_barrier() function at module-unload time.
The kfree_rcu() function introduced by this commit addresses this issue.
Rather than encoding a function address in the embedded rcu_head
structure, kfree_rcu() instead encodes the offset of the rcu_head
structure within the base structure. Because the functions are not
allowed in the low-order 4096 bytes of kernel virtual memory, offsets
up to 4095 bytes can be accommodated. If the offset is larger than
4095 bytes, a compile-time error will be generated in __kfree_rcu().
If this error is triggered, you can either fall back to use of call_rcu()
or rearrange the structure to position the rcu_head structure into the
first 4096 bytes.
Note that the allowable offset might decrease in the future, for example,
to allow something like kmem_cache_free_rcu().
The new kfree_rcu() function can replace code as follows:
call_rcu(&p->rcu, simple_kfree_callback);
where "simple_kfree_callback()" might be defined as follows:
void simple_kfree_callback(struct rcu_head *p)
{
struct foo *q = container_of(p, struct foo, rcu);
kfree(q);
}
with the following:
kfree_rcu(&p->rcu, rcu);
Note that the "rcu" is the name of a field in the structure being
freed. The reason for using this rather than passing in a pointer
to the base structure is that the above approach allows better type
checking.
This commit is based on earlier work by Lai Jiangshan and Manfred Spraul:
Lai's V1 patch: http://lkml.org/lkml/2008/9/18/1
Manfred's patch: http://lkml.org/lkml/2009/1/2/115
Signed-off-by: Lai Jiangshan <laijs@cn.fujitsu.com >
Signed-off-by: Manfred Spraul <manfred@colorfullife.com >
Signed-off-by: Paul E. McKenney <paulmck@linux.vnet.ibm.com >
Reviewed-by: David Howells <dhowells@redhat.com >
Reviewed-by: Josh Triplett <josh@joshtriplett.org >
2011-05-05 23:16:59 -07:00
2011-03-31 11:26:23 -03:00
2011-01-30 01:14:14 -08:00
2011-04-11 07:27:24 -07:00
2011-03-29 12:11:16 -07:00
2010-10-20 15:37:28 -07:00
2011-03-31 11:26:23 -03:00
2011-03-23 10:42:00 +01:00
2011-04-18 10:15:43 -07:00
2011-03-31 11:26:23 -03:00
2010-12-16 12:37:26 -05:00
2011-05-02 20:26:32 -07:00
2011-03-23 12:24:23 -07:00
2011-04-27 19:16:12 -04:00
2011-03-31 11:26:23 -03:00
2011-04-11 07:27:24 -07:00
2010-10-13 18:00:51 +02:00
2011-03-31 11:26:23 -03:00
2011-01-20 17:50:17 +01:00
2011-01-20 17:50:17 +01:00
2011-01-13 08:03:19 -08:00
2011-03-31 11:26:23 -03:00
2011-03-16 15:11:04 -07:00
2011-03-01 22:24:19 +03:00
2011-03-31 11:26:23 -03:00
2011-03-26 14:15:06 +00:00
2011-03-31 11:26:23 -03:00
2011-02-18 16:54:54 -05:00
2011-04-24 14:28:45 -04:00
2011-01-13 08:03:08 -08:00
2011-04-28 12:56:09 -07:00
2011-03-31 11:26:23 -03:00
2011-02-24 19:58:42 +01:00
2010-10-15 21:18:59 +02:00
2011-01-20 18:30:17 -08:00
2011-03-21 22:59:08 -04:00
2010-11-23 20:14:46 +00:00
2010-10-22 10:20:08 -07:00
2011-03-15 02:42:32 -04:00
2011-01-31 14:03:00 -08:00
2011-03-30 16:53:38 -07:00
2010-11-12 07:55:30 -08:00
2011-01-19 23:51:37 +01:00
2011-01-15 20:07:45 -05:00
2010-12-06 15:58:43 -05:00
2011-03-10 08:52:07 +01:00
2011-03-22 17:43:59 -07:00
2010-10-27 18:03:06 -07:00
2011-03-11 14:25:50 +00:00
2011-01-10 13:31:14 -08:00
2011-01-13 08:03:12 -08:00
2011-03-08 08:28:01 +01:00
2011-04-25 18:10:58 -07:00
2010-11-15 13:27:04 -05:00
2011-03-10 08:52:27 +01:00
2011-04-19 13:32:46 +02:00
2011-03-03 10:53:20 -05:00
2011-03-23 19:47:19 -07:00
2011-03-10 08:52:07 +01:00
2011-03-23 19:47:06 -07:00
2011-01-13 08:03:17 -08:00
2011-03-31 11:26:23 -03:00
2010-12-16 17:53:38 +01:00
2011-03-31 11:26:23 -03:00
2011-02-16 13:30:48 +01:00
2011-03-31 11:26:23 -03:00
2010-11-26 10:51:04 +00:00
2011-03-31 11:26:23 -03:00
2010-12-20 09:07:35 -08:00
2010-10-25 08:02:40 -07:00
2011-03-22 17:44:00 -07:00
2011-03-22 17:44:10 -07:00
2011-03-22 17:44:10 -07:00
2011-03-22 17:44:10 -07:00
2011-01-05 14:15:50 +01:00
2011-03-31 11:26:23 -03:00
2011-03-30 17:14:33 -07:00
2011-01-26 10:50:06 +10:00
2010-10-14 14:32:06 -07:00
2011-03-31 11:26:23 -03:00
2011-01-24 14:51:56 -08:00
2010-11-10 16:57:11 -08:00
2011-03-16 17:54:33 -04:00
2011-01-12 12:47:34 -05:00
2011-01-13 08:03:22 -08:00
2010-11-30 13:39:55 +00:00
2011-03-22 17:44:15 -07:00
2011-03-23 19:47:02 -07:00
2011-01-13 08:03:13 -08:00
2011-03-22 19:25:05 -07:00
2011-04-24 07:58:46 -07:00
2011-03-14 17:02:43 -07:00
2011-01-20 17:01:09 -08:00
2011-01-10 08:51:44 -08:00
2011-03-08 16:10:38 +01:00
2011-04-18 18:25:41 +10:00
2011-03-23 22:16:41 +01:00
2011-03-24 13:54:30 +00:00
2011-01-13 19:59:52 +00:00
2011-03-31 11:26:23 -03:00
2010-11-26 09:57:36 +01:00
2011-02-25 12:00:34 -08:00
2011-03-31 11:26:23 -03:00
2011-03-10 11:35:17 +01:00
2011-03-10 11:35:15 +01:00
2011-03-31 11:26:23 -03:00
2011-03-07 01:12:28 +05:30
2011-02-03 15:39:16 -08:00
2010-10-21 14:47:59 +02:00
2011-03-14 08:40:51 -07:00
2011-04-05 23:51:37 +02:00
2011-03-22 17:44:11 -07:00
2011-01-13 21:49:56 -08:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-03-23 19:46:17 -07:00
2011-01-12 20:16:43 -05:00
2010-12-15 13:56:33 -05:00
2011-03-31 11:26:23 -03:00
2011-03-14 19:12:20 -04:00
2010-10-18 11:03:14 +02:00
2011-01-09 15:42:55 -08:00
2011-03-15 02:21:45 -04:00
2010-12-08 10:30:34 -08:00
2011-03-31 11:26:23 -03:00
2011-03-21 10:05:22 -07:00
2011-01-10 08:51:44 -08:00
2011-02-03 15:39:17 -08:00
2010-11-30 17:28:57 -05:00
2011-02-16 17:48:59 +01:00
2011-01-07 17:50:27 +11:00
2011-04-12 15:21:04 -07:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2010-10-22 10:22:17 -07:00
2010-11-15 13:49:51 +09:00
2011-01-07 17:50:23 +11:00
2011-01-07 17:50:23 +11:00
2011-03-10 10:31:48 -05:00
2011-02-11 16:23:33 -05:00
2010-12-07 20:16:56 +01:00
2011-01-07 17:50:29 +11:00
2011-03-22 08:35:35 +01:00
2011-03-22 17:44:05 -07:00
2010-12-06 17:15:15 -08:00
2010-10-25 14:11:37 -07:00
2011-01-10 22:11:23 +01:00
2011-01-14 08:06:39 -08:00
2011-03-05 10:56:00 +01:00
2011-02-03 16:37:28 +01:00
2011-03-31 11:26:23 -03:00
2011-02-11 15:05:49 +01:00
2010-12-17 15:18:04 +01:00
2011-03-31 11:26:23 -03:00
2011-03-10 19:15:58 +01:00
2010-10-12 16:53:37 +02:00
2011-04-28 11:28:20 -07:00
2010-11-12 14:51:55 +01:00
2011-02-17 09:52:03 -08:00
2010-11-09 09:31:10 -08:00
2011-02-23 00:53:26 +00:00
2011-03-20 14:50:53 +01:00
2011-03-31 11:26:23 -03:00
2011-03-12 15:08:54 -08:00
2010-10-26 17:40:56 -07:00
2011-03-09 16:10:56 -05:00
2010-11-19 17:47:57 +08:00
2011-01-11 23:55:51 +01:00
2011-01-06 11:10:05 -08:00
2010-10-18 11:03:14 +02:00
2011-01-19 23:31:09 -08:00
2010-11-16 10:58:30 -08:00
2011-03-18 15:14:45 -07:00
2010-11-12 12:30:57 -08:00
2011-02-27 16:11:51 -08:00
2011-03-10 16:37:26 -08:00
2011-02-10 07:51:44 -05:00
2010-10-21 16:08:28 +02:00
2011-02-18 12:42:28 -08:00
2011-01-06 10:23:33 -08:00
2010-10-22 10:21:26 -07:00
2011-01-31 21:17:41 -08:00
2011-04-18 13:29:03 -07:00
2011-05-05 23:16:54 -07:00
2010-10-26 16:52:08 -07:00
2010-11-11 13:40:11 +01:00
2010-12-17 10:01:09 -08:00
2010-11-25 10:42:59 +09:00
2011-03-23 19:47:08 -07:00
2010-12-14 00:21:51 -05:00
2011-03-31 11:26:23 -03:00
2010-11-24 11:16:42 -08:00
2010-10-18 19:58:50 +02:00
2011-03-30 00:37:41 +02:00
2011-03-29 14:48:19 +02:00
2010-10-28 11:58:39 +02:00
2011-03-31 11:26:23 -03:00
2011-03-20 21:13:43 -04:00
2010-12-09 20:17:07 -08:00
2011-03-31 11:26:23 -03:00
2011-03-20 20:08:48 -04:00
2010-10-18 19:58:57 +02:00
2010-10-29 14:45:29 -04:00
2011-03-24 08:36:10 +01:00
2011-03-22 16:17:32 -07:00
2011-03-22 04:53:54 -03:00
2011-02-17 11:12:40 -08:00
2010-10-22 15:34:12 -05:00
2011-01-13 17:32:31 -08:00
2011-03-22 17:44:14 -07:00
2011-04-01 16:14:30 +11:00
2011-03-08 11:17:18 +11:00
2011-03-08 11:17:18 +11:00
2011-03-08 11:17:22 +11:00
2010-10-27 18:03:18 -07:00
2011-03-18 16:54:31 +00:00
2011-01-13 17:32:47 -08:00
2011-02-13 16:54:24 -08:00
2011-01-24 14:45:11 +10:30
2011-01-13 08:03:07 -08:00
2011-02-18 08:02:10 -08:00
2011-01-07 17:02:58 -08:00
2011-01-07 08:43:37 +01:00
2011-03-22 17:44:01 -07:00
2011-03-31 11:26:23 -03:00
2011-03-17 13:08:30 -03:00
2010-10-24 10:50:49 +02:00
2011-01-12 11:23:08 +02:00
2011-01-12 11:23:12 +02:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:06 -08:00
2011-01-13 08:03:05 -08:00
2011-03-25 21:00:29 -07:00
2011-04-24 11:32:16 -04:00
2010-10-25 14:11:39 -07:00
2011-04-25 18:14:10 -07:00
2011-02-18 11:32:28 -08:00
2011-01-21 13:38:57 -08:00
2011-03-31 11:26:23 -03:00
2011-03-18 22:33:38 -07:00
2010-11-22 08:34:23 -08:00
2010-10-26 16:52:19 -07:00
2011-01-10 19:04:08 +01:00
2010-12-06 11:03:46 -08:00
2011-03-22 04:53:56 -03:00
2010-10-12 15:37:51 -07:00
2011-04-14 16:06:54 -07:00
2011-01-15 13:28:17 +02:00
2011-02-03 16:08:57 -08:00
2011-02-14 17:38:30 -08:00
2011-01-13 17:32:34 -08:00
2011-01-13 17:32:46 -08:00
2011-03-22 17:44:03 -07:00
2011-04-28 11:28:20 -07:00
2011-01-13 17:32:46 -08:00
2011-02-15 10:24:31 +01:00
2011-02-21 15:21:53 -08:00
2011-01-24 14:32:52 +10:30
2011-01-16 13:47:07 -05:00
2011-03-31 11:26:23 -03:00
2011-01-30 01:14:38 -08:00
2010-10-12 16:53:34 +02:00
2011-03-02 13:43:15 -08:00
2010-11-26 15:05:34 +01:00
2010-10-18 11:03:14 +02:00
2011-03-18 09:04:20 -04:00
2011-01-12 20:03:43 -05:00
2011-01-12 20:03:43 -05:00
2011-02-22 10:19:31 -08:00
2011-04-01 20:23:25 -07:00
2011-04-04 17:00:54 +02:00
2011-03-03 13:32:07 -08:00
2010-10-18 08:32:07 -07:00
2010-12-16 12:37:23 -05:00
2011-03-31 11:26:23 -03:00
2011-04-24 14:28:18 -04:00
2011-03-23 15:29:04 -04:00
2011-03-11 15:39:26 -05:00
2011-03-11 15:38:44 -05:00
2011-03-27 17:48:07 +02:00
2011-04-27 15:57:16 -04:00
2011-01-25 15:24:47 -05:00
2011-03-10 17:29:40 +09:00
2011-03-31 11:26:23 -03:00
2010-12-22 22:15:32 +01:00
2011-02-03 16:08:57 -08:00
2011-03-31 11:26:23 -03:00
2010-12-23 15:57:48 -07:00
2011-02-28 01:36:38 -07:00
2011-01-15 22:01:58 -07:00
2010-10-21 11:34:55 -06:00
2010-11-01 01:08:14 -04:00
2011-02-04 11:46:50 -07:00
2010-10-12 21:58:08 -06:00
2011-03-23 14:55:56 -06:00
2011-03-16 17:28:10 -07:00
2011-03-31 11:26:23 -03:00
2010-10-17 01:57:50 +02:00
2011-02-15 11:10:20 +01:00
2011-03-31 11:26:23 -03:00
2011-03-22 17:44:03 -07:00
2010-10-26 16:52:05 -07:00
2011-03-24 10:16:26 -07:00
2011-03-14 02:58:03 -04:00
2011-01-16 13:47:07 -05:00
2011-05-01 18:18:49 +02:00
2011-03-31 11:26:23 -03:00
2011-01-16 11:56:26 -08:00
2011-03-21 09:40:43 -07:00
2011-03-21 09:38:02 -07:00
2010-10-27 21:30:13 -04:00
2010-10-27 17:53:25 +02:00
2011-02-28 11:20:03 +01:00
2011-04-07 11:14:49 -07:00
2011-03-09 11:59:33 -08:00
2010-10-24 15:07:11 -07:00
2011-04-18 10:35:30 -07:00
2011-01-10 07:38:54 -08:00
2011-03-31 11:26:23 -03:00
2011-04-12 11:13:00 +02:00
2011-03-11 15:13:26 -05:00
2011-03-15 00:43:14 +01:00
2011-03-15 00:43:14 +01:00
2011-03-23 22:16:41 +01:00
2011-03-31 11:26:23 -03:00
2011-01-25 15:24:47 -05:00
2011-04-18 10:39:38 +02:00
2011-02-02 15:28:20 +01:00
2011-03-01 22:27:26 +03:00
2011-01-13 08:03:21 -08:00
2011-01-13 08:03:21 -08:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:10 -08:00
2011-03-23 19:46:37 -07:00
2010-12-28 14:25:21 -08:00
2011-03-04 09:23:30 -08:00
2011-03-22 17:44:00 -07:00
2011-03-31 11:26:23 -03:00
2011-01-12 19:14:55 +01:00
2011-03-24 21:16:31 -04:00
2011-01-13 17:32:48 -08:00
2010-10-29 04:16:31 -04:00
2010-10-27 18:03:18 -07:00
2010-11-29 11:17:22 -08:00
2010-10-26 16:52:16 -07:00
2011-01-14 02:36:43 +00:00
2010-12-17 12:34:59 -08:00
2011-05-05 23:16:59 -07:00
2010-11-29 22:01:58 -08:00
2011-05-05 23:16:56 -07:00
2011-03-31 11:26:23 -03:00
2011-02-01 11:12:29 -05:00
2011-03-23 19:46:23 -07:00
2010-11-12 07:55:30 -08:00
2010-10-17 01:57:50 +02:00
2010-11-15 13:24:06 -05:00
2011-03-09 13:52:27 -05:00
2011-03-23 19:46:41 -07:00
2011-04-14 16:06:56 -07:00
2011-02-25 15:07:37 -08:00
2011-04-14 16:06:56 -07:00
2011-03-22 17:44:03 -07:00
2011-01-13 08:03:23 -08:00
2011-03-29 18:44:05 -07:00
2010-11-15 11:29:30 -08:00
2011-01-27 12:30:38 +01:00
2011-01-27 12:30:39 +01:00
2011-01-27 12:30:40 +01:00
2010-12-22 02:39:57 +03:00
2011-04-14 16:06:55 -07:00
2011-04-22 16:17:29 -07:00
2010-10-22 10:20:06 -07:00
2010-10-21 10:12:48 +11:00
2010-10-30 12:12:50 +02:00
2011-01-07 17:50:27 +11:00
2010-10-22 10:20:10 -07:00
2011-01-13 08:03:19 -08:00
2010-11-30 14:11:49 -08:00
2011-01-19 15:37:31 +09:00
2010-10-18 09:33:31 -07:00
2010-11-09 14:45:52 +01:00
2010-11-15 18:48:25 +09:00
2010-11-09 16:38:20 +09:00
2010-10-31 10:40:39 -04:00
2011-03-22 17:44:15 -07:00
2011-04-07 11:14:49 -07:00
2010-11-28 21:16:28 +02:00
2011-01-23 21:00:05 +02:00
2011-03-22 20:48:04 +02:00
2011-03-22 17:16:34 +09:00
2011-03-31 11:26:23 -03:00
2011-03-23 07:48:42 -07:00
2010-12-08 12:16:33 -08:00
2011-03-31 11:26:23 -03:00
2011-03-09 14:08:09 -08:00
2011-03-28 06:05:24 -04:00
2011-03-31 11:26:23 -03:00
2011-01-27 12:30:38 +01:00
2011-03-31 11:26:23 -03:00
2010-11-18 14:37:34 +01:00
2011-03-31 11:26:23 -03:00
2011-03-31 11:26:23 -03:00
2011-04-11 22:54:42 +02:00
2011-03-22 15:47:22 +09:00
2011-03-24 10:16:26 -07:00
2010-10-27 18:03:14 -07:00
2011-03-21 00:40:29 -04:00
2011-03-15 00:43:46 +01:00
2011-03-09 16:43:24 -08:00
2011-03-31 11:26:23 -03:00
2010-10-17 01:57:44 +02:00
2011-01-24 09:33:36 -08:00
2010-12-22 19:43:34 -08:00
2011-02-28 18:00:31 -08:00
2011-02-02 15:28:13 +01:00
2011-02-04 12:41:21 -08:00
2011-02-21 12:53:08 -08:00
2010-10-22 14:46:25 +02:00
2011-03-31 11:26:23 -03:00
2011-02-02 15:28:18 +01:00
2011-03-13 16:35:18 -04:00
2011-02-23 18:05:11 -05:00
2011-01-13 08:03:08 -08:00
2010-11-29 08:55:25 +11:00
2010-11-29 08:55:22 +11:00
2011-03-31 11:26:23 -03:00
2011-02-03 09:28:46 -05:00
2011-02-17 11:59:56 -08:00
2011-01-13 08:03:20 -08:00
2011-03-22 16:17:32 -07:00
2011-03-22 17:44:09 -07:00
2010-11-28 23:08:04 +01:00
2011-03-31 11:26:23 -03:00
2010-12-20 09:37:33 +01:00
2010-11-10 16:57:11 -08:00
2010-10-22 10:22:05 -07:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:18 -08:00
2011-03-23 19:47:03 -07:00
2011-03-31 11:26:23 -03:00
2011-04-19 11:23:31 -03:00
2011-03-22 04:53:33 -03:00
2011-01-06 13:05:04 +10:00
2011-03-31 11:26:23 -03:00
2010-11-10 12:04:41 +09:00
2010-12-11 02:01:35 -05:00
2011-04-19 11:20:56 -03:00
2010-10-27 18:03:18 -07:00
2011-01-24 14:45:11 +10:30
2011-02-09 08:19:55 +10:30
2011-03-28 12:53:29 +01:00
2011-04-14 16:06:55 -07:00
2011-02-17 11:13:19 -08:00
2011-03-31 11:26:23 -03:00
2010-10-13 15:45:21 -04:00
2010-11-15 13:25:02 -05:00
2011-02-21 10:07:23 +01:00
2011-03-24 21:17:51 -04:00
2011-01-17 08:05:27 -08:00
2011-03-13 20:22:28 -07:00
2011-03-31 11:26:23 -03:00
2011-01-13 08:03:24 -08:00
2011-03-22 17:44:17 -07:00
9ab1544eb4