HOW WE BENCHMARK TEST
Modern workloads demand high-performance infrastructure to process and analyse data at scale.
When analysing data in the cloud, the choice of platform can have a significant impact on speed, efficiency and overall cost.
To provide a clear comparison, we conducted performance benchmarking using the industry-standard TPROC-C HammerDB tool. We tested Microsoft SQL Server workloads on an AWS c5.xlarge EC2 instance and compared the results against a similarly configured BlackBox Hosting Standard Single Server.
TEST PARAMETERS AND RESULTS
To ensure a fair comparison, we provisioned two virtual machines configured exclusively with SQL Server 2025 Standard and the HammerDB benchmarking tool. Each environment was tested using a workload of 4 warehouses and 16 virtual users.
The results showed a clear performance advantage for BlackBox Hosting. Our standard VM delivered significantly higher transactional throughput, achieving 127,271 NOPM (new orders per minute) and 295,698 TPM (transactions per minute), compared to AWS at 93,465 NOPM and 217,169 TPM.
In addition to improved performance, BlackBox Hosting also offers substantial cost savings. By switching from AWS, organisations can reduce infrastructure spend by more than 34% while gaining the performance needed to support demanding data workloads.
NEW ORDERS PER MINUTE
TRANSACTIONS PER MINUTE
COST ANALYSIS
