LLVM SPEC 2006

From Dmz-portal

Jump to: navigation, search

Contents

Running SPEC 2006 As an External LLVM Test Suite

LLVM Test suite runs SPEC 2006 benchmarks using its own Makefile's and reduced ("test") SPEC data sets. The results are the benchmarks execution time in seconds.

Fix SPEC 2006 configuration

Before running the suite you need to fix 400.perlbench test case configuration. Open CPU2006/400.perlbench/src/spec_config.h file, define HASATTRIBUTE macro and remove all #undef HASATTRIBUTE pragmas.

Configure SPEC 2006 to run as part of LLVM test suite

# $LLVM_SRC points to the root of LLVM source code tree.
# $SPEC_SRC points to the root of SPEC 2006 source code tree.
$ mkdir $LLVM_SRC/projects/test-suite-externals
$ ln -s $SPEC_SRC $LLVM_SRC/projects/test-suite-externals/speccpu2006

Run SPEC 2006 only

# $LLVM_BLD points to the root of LLVM build tree.
$ cd $LLVM_BLD/projects/test-suite/External/SPEC
$ make report.html TEST=nightly CC=gcc CXX=g++

Run SPEC 2006 with beta options

# $LLVM_BLD points to the root of LLVM build tree.
$ cd $LLVM_BLD/projects/test-suite/External/SPEC
$ make report.html TEST=nightly ENABLE_LLCBETA=1 LLCBETAOPTION=-enable-misched CC=gcc CXX=g++

Benchmarks (test case execution time in seconds)

Benchmark GCC LLC LLC-BETA GCC/LLC GCC/LLC-BETA LLC/LLC-BETA
CFP2006/433.milc 401.9583 381.8125 371.0000 1.05 1.08 1.03
CFP2006/444.namd 300.3542 238.1875 225.3333 1.26 1.33 1.06
CFP2006/447.dealII 369.1875 284.5208 255.5000 1.30 1.44 1.11
CFP2006/450.soplex 0.1875 0.2083 0.2083 0.90 0.90 1.00
CFP2006/470.lbm 96.1250 85.4375 91.7500 1.13 1.05 0.93
 
CINT2006/400.perlbench 63.4375 66.7292 62.8333 0.95 1.01 1.06
CINT2006/401.bzip2 32.5208 33.2500 33.1875 0.98 0.98 1.00
CINT2006/403.gcc 18.2500 n/a n/a n/a n/a n/a
CINT2006/429.mcf 86.2500 88.4167 86.2500 0.98 1.00 1.03
CINT2006/445.gobmk 5.3958 5.2708 5.3333 1.02 1.01 0.99
CINT2006/456.hmmer 39.8958 32.7500 32.4375 1.22 1.23 1.01
CINT2006/458.sjeng 54.9375 53.8750 53.8542 1.02 1.02 1.00
CINT2006/462.libquantum 127.4375 147.9583 130.8542 0.86 0.97 1.13
CINT2006/464.h264ref 207.1875 185.6667 193.9167 1.12 1.07 0.96
CINT2006/471.omnetpp 7.4167 6.6250 5.8750 1.12 1.26 1.13
CINT2006/473.astar 77.4167 81.4583 79.8542 0.95 0.97 1.02
CINT2006/483.xalancbmk 2.0000 1.5000 1.5833 1.33 1.26 0.95

Running original SPEC 2006

SPEC 2006 Clang MIPS Configuration

Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox