Minki/linux
1
0
Fork 1
mirror of https://github.com/torvalds/linux.git synced 2024-12-16 08:02:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

powerpc/booke64: wrap tlb lock and search in htw miss with FTR_SMT

Browse Source 
Virtualized environments may expose a e6500 dual-threaded core
as two single-threaded e6500 cores. Take advantage of this
and get rid of the tlb lock and the trap-causing tlbsx in
the htw miss handler by guarding with CPU_FTR_SMT, as it's
already being done in the bolted tlb1 miss handler.

As seen in the results below, measurements done with lmbench
random memory access latency test running under Freescale's
Embedded Hypervisor, there is a ~34% improvement.

Memory latencies in nanoseconds - smaller is better
    (WARNING - may not be correct, check graphs)
----------------------------------------------------
Host       Mhz   L1 $   L2 $    Main mem    Rand mem
---------  ---   ----   ----    --------    --------
smt       1665 1.8020   13.2    83.0         1149.7
nosmt     1665 1.8020   13.2    83.0          758.1

Signed-off-by: Laurentiu Tudor <Laurentiu.Tudor@freescale.com>
Cc: Scott Wood <scottwood@freescale.com>
[scottwood@freescale.com: commit message tweak]
Signed-off-by: Scott Wood <scottwood@freescale.com>
This commit is contained in:
Laurentiu Tudor 2014-05-30 17:59:15 +03:00 committed by Scott Wood
parent f24bc2701a
commit 7c48005036
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
arch/powerpc/mm/tlb_low_64e.S
View File

@ -299,6 +299,7 @@ itlb_miss_fault_bolted:
* r10 = crap (free to use) * r10 = crap (free to use)
*/ */
tlb_miss_common_e6500: tlb_miss_common_e6500:
BEGIN_FTR_SECTION
/* /*
* Search if we already have an indirect entry for that virtual * Search if we already have an indirect entry for that virtual
* address, and if we do, bail out. * address, and if we do, bail out.
@ -333,6 +334,7 @@ tlb_miss_common_e6500:
andis. r10,r10,MAS1_VALID@h andis. r10,r10,MAS1_VALID@h
bne tlb_miss_done_e6500 bne tlb_miss_done_e6500
END_FTR_SECTION_IFSET(CPU_FTR_SMT)
/* Now, we need to walk the page tables. First check if we are in /* Now, we need to walk the page tables. First check if we are in
* range. * range.
@ -393,11 +395,13 @@ tlb_miss_common_e6500:
tlb_miss_done_e6500: tlb_miss_done_e6500:
.macro tlb_unlock_e6500 .macro tlb_unlock_e6500
BEGIN_FTR_SECTION
beq cr1,1f /* no unlock if lock was recursively grabbed */ beq cr1,1f /* no unlock if lock was recursively grabbed */
li r15,0 li r15,0
isync isync
stb r15,0(r11) stb r15,0(r11)
1: 1:
END_FTR_SECTION_IFSET(CPU_FTR_SMT)
.endm .endm
tlb_unlock_e6500 tlb_unlock_e6500