Skip to Content
Contact Us

Cloud Benchmark

Cloud Benchmark

SAP Standard Application Benchmarks in Cloud Environments

In 2012 the SAP Benchmark Council Meeting finalized the rules for running SAP Standard Application Benchmarks in Cloud Environments. The rules specify how SAP Standard Application Benchmarks can be performed in Cloud Environments and what customers have to be aware of, when interpreting the benchmark results.


Sales and Distribution (SD) Two-tier Internet configuration, SAP enhancement package 5 for SAP ERP 6.0 

Date of Certification
(mm/dd/yyyy)
  Technology Partner

  Number of Benchmark Users

  SAPS

  Operating System - Release

  RDBMS Release

  Central Server

  Certification Number
10/24/2016   IBM   2.000

  10.980

  Red Hat Enterprise Linux 6.7

  DB2 10.5
  IBM SAP-NW-E31270v3-32GB, 1 processors / 4 cores / 8 threads, Intel Xeon Processor E3-1270 v3, 3.50 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 8 MB L3 cache per processor, 32 GB main memory

  2016048
07/21/2016   Microsoft Corporation   5.550   30.430   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS15v2, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2673 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2016038
05/17/2016   Amazon Web Services   24.060   131.500   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Amazon EC2 x1.32xlarge, 4 processors / 72 cores / 144 threads, Intel Xeon Processor E7-8880 v3, 2.30 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 45 MB L3 cache per processor, 2048 GB main memory   2016021
05/09/2016   Microsoft Corporation   4.410   24.180   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS14v2, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2673 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2016018
05/09/2016   Microsoft Corporation   2.240   12.300   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS13v2, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2673 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2016017
05/09/2016   Microsoft Corporation   1.220   6.680   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS12v2, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2673 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2016016
05/09/2016   Microsoft Corporation   640   3.530   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS11v2, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2673 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2016015
05/09/2016   Amazon Web Services   8.600   47.320   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Amazon EC2 m4.10xlarge, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2676 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2016014
10/05/2015   Microsoft Corporation   4,140   22,680   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS4, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   2015049
10/05/2015   Microsoft Corporation   2,170   11,870   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS3, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   2015048
10/05/2015   Microsoft Corporation   1,250   6,900   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS2, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   2015047
10/05/2015   Microsoft Corporation   650   3,580   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS1, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   2015046
09/02/2015   Microsoft Corporation   7,600   41,670   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS5, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   2015038
07/21/2015   Amazon Web Services   7,980   44,280   Windows Server 2012 Standard Edition   SQL Server 2012   Amazon EC2 m4.10xlarge, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2676 v3, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 192 GB main memory   2015032
07/21/2015   IBM   9,360   53,730   Windows Server 2012 Standard Edition   SQL Server 2012   IBM AMM CCN-GHW5, 2 processors / 24 cores / 48 threads, Intel Xeon Processor E5-2690 v3, 2.60 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 30 MB L3 cache per processor, 256 GB main memory   2015030
07/21/2015   IBM   7,400   41,720   Windows Server 2012 R2 Standard Edition   SQL Server 2012   IBM AMM CCN-GIB5, 2 processors / 20 cores / 40 threads, Intel Xeon Processor E5-2690 v2, 3.0 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 256 GB main memory   2015029
03/10/2015   Amazon Web Services   6,750   37.950   Windows Server 2012 Standard Edition   SQL Server 2012   Amazon EC2 c4.8xlarge, 2 processors / 20 cores / 40 threads, Intel Xeon Processor E5-2666 v3, 2.90 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 64 GB main memory   2015006
03/10/2015   Amazon Web Services   3,385   19.030   Windows Server 2012 Standard Edition   SQL Server 2012   Amazon EC2 c4.4xlarge,2 processors / 20 cores / 40 threads, Intel Xeon Processor E5-2666 v3, 2.90 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 64 GB main memory   2015005
10/27/2014   Amazon Web Services   5.680   31.830   Windows Server 2012 Standard Edition   SQL Server 2012   Amazon EC2 c3.8xlarge, 2 processors / 20 cores / 40 threads, Intel Xeon Processor E5-2680 v2, 2.80 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 64 GB main memory   2014041
10/27/2014   Microsoft Corporation   3.400   18.770   Windows Server 2012 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services D14, 2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory   2014040
10/27/2014   Microsoft Corporation   4.040   22.570   Windows Server 2012 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services A9, 2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2670, 2.60 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory   2014039
10/06/2014   Amazon Web Services   5,824   31,920   Windows Server 2012 Standard Edition   SQL Server 2012   Amazon EC2 r3.8xlarge, Intel Xeon Processor E5-2670 v2, 2.50 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 244GB main memory   2014035
03/28/2013   Amazon Web Services   5,550   30,430   Windows Server 2008 R2 Datacenter   SQL Server 2012   Amazon EC2 cr1.8xlarge, Intel Xeon Processor E5-2670, 2.60 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 244GB main memory   2014010

Sales and Distribution (SD) Three-tier Internet configuration, SAP enhancement package 5 for SAP ERP 6.0

Date of Certification
(mm/dd/yyyy)
  Technology Partner
  Number of Benchmark Users
  SAPS   Operating System - Release 
  RDBMS Release
  Database Server 

  Number & Type of Application Servers 
  Certification Number
11/02/2015   Microsoft Corporation   16.640   91.050   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS13,2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 32 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory   1 x Azure Virtual Machine Services DS12, 2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 32 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory 6 x Azure Virtual Machine Services DS14, 2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 32 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory   2015052
11/02/2015   Microsoft Corporation   8.800   48.750   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services DS13,2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 32 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory   1 x Azure Virtual Machine Services DS12, 2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 32 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory 3 x Azure Virtual Machine Services DS14, 2 processors / 16 cores / 32 threads, Intel Xeon Processor E5-2660, 2.20 GHz, 32 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 128 GB main memory   2015051
10/05/2015   Microsoft Corporation   45,100   247,880   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS4, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   1 x Azure Virtual Machine Services GS2, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5- 2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory 7 x Azure Virtual Machine Services GS5, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory.   2015045
10/05/2015   Microsoft Corporation   24,500   137,520   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS3, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   1 x Azure Virtual Machine Services GS2, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5- 2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory 4 x Azure Virtual Machine Services GS5, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory.   2015044
10/05/2015   Microsoft Corporation   14,060   78,620   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS2, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   1 x Azure Virtual Machine Services GS2, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5- 2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory 2 x Azure Virtual Machine Services GS5, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory .   2015043
10/05/2015   Microsoft Corporation   7,000   38,415   Windows Server 2012 R2 Datacenter Edition   SQL Server 2012   Azure Virtual Machine Services GS1, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory   1 x Azure Virtual Machine Services GS2, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5- 2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory 1 x Azure Virtual Machine Services GS5, 2 processors / 32 cores / 64 threads, Intel Xeon Processor E5-2698B v3, 2.00 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 40 MB L3 cache per processor, 512 GB main memory.   2015042
11/27/2013   Amazon WebServices   11,464   62,750   Windows Server 2008 R2 Datacenter   SQL Server 2012   Amazon EC2 m2.4xlarge, Intel Xeon Processor E5-2665, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 68.4GB main memory   9 x Amazon EC2 m2.4xlarge, Intel Xeon Processor E5-2665, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 68.4GB main memory   2013035
11/27/2013   Amazon WebServices   11,464   62,750   Windows Server 2008 R2 Datacenter   SQL Server 2012   Amazon EC2 m2.4xlarge, Intel Xeon Processor E5-2665, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 68.4GB main memory   9 x Amazon EC2 m2.4xlarge, Intel Xeon Processor E5-2665, 2.40 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 68.4GB main memory   2013035

SAP BW Enhanced Mixed Load (BW EML) Standard Application Benchmark Results (500,000,000 records)

Date of Certification
(mm/dd/yyyy)
  Technology Partner
  Number of records 
  Ad-Hoc Navigation Steps/ Hour 
  Operating System - Release Database Server
  RDBMS Release 
  SAP NetWeaver Release 
  Number & Type of Database/Application Servers
  Certification Number
01/17/2014   Amazon Web Services   500,000,000   113,390   SuSE Linux Enterprise Server 11   SAP HANA 1.0   SAP NetWeaver 7.31   1 database server:  Amazon EC2 cr1.8xlarge, Intel Xeon Processor E5-2670, 2.60 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 20 MB L3 cache per processor, 244 GB main memory; 2 application servers: Amazon EC2 c3.8xlarge, Intel Xeon Processor E5-2680 v2, 2.80 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 60 GB main memory   2014001
04/10/2014   Amazon Web Services   500,000,000   137,510   SuSE Linux Enterprise Server 11   SAP HANA 1.0   SAP NetWeaver 7.31   1 database server:  Amazon EC2 r3.8xlarge, Intel Xeon Processor E5-2670 v2, 2.50 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 244 GB main memory; 2 application servers: Amazon EC2 c3.8xlarge, Intel Xeon Processor E5-2680 v2, 2.80 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 60 GB main memory   2014013

SAP BW Enhanced Mixed Load (BW EML) Standard Application Benchmark Results (2,000,000,000 records)

Date of Certification
(mm/dd/yyyy)
  Technology Partner   Number of records   Ad-Hoc Navigation Steps/ Hour   Operating System - Release Database Server   RDBMS Release   SAP NetWeaver Release
  Number & Type of Database/Application Servers   Certification Number
04/11/2014   Amazon Web Services   2,000,000,000   177,590   SuSE Linux Enterprise Server 11   SAP HANA 1.0   SAP NetWeaver 7.31   5 database servers:  Amazon EC2 r3.8xlarge, Intel Xeon Processor E5-2670 v2, 2.50 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 244 GB main memory ; 3 application servers: Amazon EC2 c3.8xlarge, Intel Xeon Processor E5-2680 v2, 2.80 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 60 GB main memory   2014014

SAP BW Enhanced Mixed Load (BW EML) Standard Application Benchmark Results (5,000,000,000 records)

Date of Certification
(mm/dd/yyyy)
  Technology Partner   Number of records   Ad-Hoc Navigation Steps/ Hour   Operating System - Release Database Server   RDBMS Release   SAP NetWeaver Release
 
Number & Type of Database/Application Servers
  Certification Number
05/05/2015   Amazon Web Services   5,000,000,000   303.270   SuSE Linux Enterprise Server 11   SAP HANA 1.0   SAP NetWeaver 7.40   17 database servers:  Amazon EC2 r3.8xlarge, Intel Xeon Processor E5-2670 v2, 2.50 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 244 GB main memory; 3 application servers: Amazon EC2 c4.8xlarge, Intel Xeon Processor E5-2666 v3, 2.90 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 60 GB main memory   2015019
05/05/2015   Amazon Web Services   5,000,000,000   258,020   SuSE Linux Enterprise Server 11   SAP HANA 1.0   SAP NetWeaver 7.40   14 database servers:  Amazon EC2 r3.8xlarge, Intel Xeon Processor E5-2670 v2, 2.50 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 244 GB main memory; 3 application servers: Amazon EC2 c4.8xlarge, Intel Xeon Processor E5-2666 v3, 2.90 GHz, 64 KB L1 cache and 256 KB L2 cache per core, 25 MB L3 cache per processor, 60 GB main memory   2015017

 

SAP Benchmarks in cloud environments

Things you should be aware of when interpreting SAP Standard Application Benchmarks in cloud environments results:

Shared Resources:
Network and Storage are shared resources in typical cloud offerings. There might be a impact from other cloud subscribers on the network and storage performance. Network and Storage SLAs should be defined to minimize the risk of performance impacts.

WAN Connectivity:
In a typically Cloud Offering the Customers are connected via a WAN connection (Internet or VPN) to the cloud provider computing center. The performance of the WAN is not part of the cloud provider nor SAP responsibility. Please be aware of this. The Cloud Provider should offer a tool to measure the actual WAN performance from customer location to the Cloud.

Hardware Changes:
Underlying hardware of a cloud container might change over time.

Single Computing Unit (SCU) Performance:
Some SAP applications for example SAP CRM, SAP SRM and SAP EWM benefit from a very good SCU performance in order to ensure fast response times. With changing hardware in a cloud environment there might also be changes in SCU Performance. SLAs should be defined to guarantee a constant Single Computing Unit Performance for constant application performance.

Flexibility (elasticity) of the cloud infrastructure:
How fast can infrastructure be adapted to customer needs. How big can be the largest container in the Cloud environment, needed for scaling in multitier environments. These are two questions that should be taken into account when you are planning to subscribe to a cloud offering.

Back to top