IOPS

From Wikipedia, the free encyclopedia - View original article

 
Jump to: navigation, search

IOPS (Input/Output Operations Per Second, pronounced eye-ops) is a common performance measurement used to benchmark computer storage devices like hard disk drives (HDD), solid state drives (SSD), and storage area networks (SAN). As with any benchmark, IOPS numbers published by storage device manufacturers do not guarantee real-world application performance.[1][2]

IOPS can be measured with applications, such as Iometer (originally developed by Intel), as well as IOzone and FIO[3] and is primarily used with servers to find the best storage configuration.

The specific number of IOPS possible in any system configuration will vary greatly, depending upon the variables the tester enters into the program, including the balance of read and write operations, the mix of sequential and random access patterns, the number of worker threads and queue depth, as well as the data block sizes.[1] There are other factors which can also affect the IOPS results including the system setup, storage drivers, OS background operations, etc. Also, when testing SSDs in particular, there are preconditioning considerations that must be taken into account.[4]

Performance characteristics[edit]

Random access compared to sequential access.

The most common performance characteristics measured are sequential and random operations. Sequential operations access locations on the storage device in a contiguous manner and are generally associated with large data transfer sizes, e.g., 128 KB. Random operations access locations on the storage device in a non-contiguous manner and are generally associated with small data transfer sizes, e.g., 4 KB.

The most common performance characteristics are as follows:

MeasurementDescription
Total IOPSTotal number of I/O operations per second (when performing a mix of read and write tests)
Random Read IOPSAverage number of random read I/O operations per second
Random Write IOPSAverage number of random write I/O operations per second
Sequential Read IOPSAverage number of sequential read I/O operations per second
Sequential Write IOPSAverage number of sequential write I/O operations per second

For HDDs and similar electromechanical storage devices, the random IOPS numbers are primarily dependent upon the storage device's random seek time, whereas for SSDs and similar solid state storage devices, the random IOPS numbers are primarily dependent upon the storage device's internal controller and memory interface speeds. On both types of storage devices the sequential IOPS numbers (especially when using a large block size) typically indicate the maximum sustained bandwidth that the storage device can handle.[1] Often sequential IOPS are reported as a simple MB/s number as follows:

\text{IOPS} * \text{TransferSizeInBytes} = \text{BytesPerSec} (with the answer typically converted to MegabytesPerSec)

Some HDDs will improve in performance as the number of outstanding IO's (i.e. queue depth) increases. This is usually the result of more advanced controller logic on the drive performing command queuing and reordering commonly called either Tagged Command Queuing (TCQ) or Native Command Queuing (NCQ). Most commodity SATA drives either cannot do this, or their implementation is so poor that no performance benefit can be seen.[citation needed] Enterprise class SATA drives, such as the Western Digital Raptor and Seagate Barracuda NL will improve by nearly 100% with deep queues.[5] High-end SCSI drives more commonly found in servers, generally show much greater improvement, with the Seagate Savvio exceeding 400 IOPS—more than doubling its performance.[citation needed]

While traditional HDDs have about the same IOPS for read and write operations, most NAND flash-based SSDs are much slower writing than reading due to the inability to rewrite directly into a previously written location forcing a procedure called garbage collection.[6][7][8] This has caused hardware test sites to start to provide independently measured results when testing IOPS performance.

Newer flash SSD drives such as the Intel X25-E have much higher IOPS than traditional hard disk drives. In a test done by Xssist, using IOmeter, 4 KB random transfers, 70/30 read/write ratio, queue depth 4, the IOPS delivered by the Intel X25-E 64 GB G1 started around 10000 IOPs, and dropped sharply after 8 minutes to 4000 IOPS, and continued to decrease gradually for the next 42 minutes. IOPS vary between 3000 to 4000 from around the 50th minutes onwards for the rest of the 8+ hours test run.[9] Even with the drop in random IOPS after the 50th minute, the X25-E still has much higher IOPS compared to traditional hard disk drives. Some SSDs, including the OCZ RevoDrive 3 x2 PCIe using the SandForce controller, have shown much higher sustained write performance that more closely matches the read speed.[10]

Examples[edit]

Some com­monly accepted aver­ages for random IO operations, calculated as 1/(seek + latency) = IOPS:

DeviceTypeIOPSInterfaceNotes
7,200 rpm SATA drivesHDD~75-100 IOPS[2]SATA 3 Gbit/s
10,000 rpm SATA drivesHDD~125-150 IOPS[2]SATA 3 Gbit/s
10,000 rpm SAS drivesHDD~140 IOPS[2]SAS
15,000 rpm SAS drivesHDD~175-210 IOPS[2]SAS

Solid State Devices

DeviceTypeIOPSInterfaceNotes
Intel X25-M G2 (MLC)SSD~8,600 IOPS[11]SATA 3 Gbit/sIntel's data sheet[12] claims 6,600/8,600 IOPS (80 GB/160 GB version) and 35,000 IOPS for random 4 KB writes and reads, respectively.
Intel X25-E (SLC)SSD~5,000 IOPS[13]SATA 3 Gbit/sIntel's data sheet[14] claims 3,300 IOPS and 35,000 IOPS for writes and reads, respectively. 5,000 IOPS are measured for a mix. Intel X25-E G1 has around 3 times higher IOPS compared to the Intel X25-M G2.[15]
G.Skill Phoenix ProSSD~20,000 IOPS[16]SATA 3 Gbit/sSandForce-1200 based SSD drives with enhanced firmware, states up to 50,000 IOPS, but benchmarking shows for this particular drive ~25,000 IOPS for random read and ~15,000 IOPS for random write.[16]
OCZ Vertex 3SSDUp to 60,000 IOPS[17]SATA 6 Gbit/sRandom Write 4 KB (Aligned)
Corsair Force Series GTSSDUp to 85,000 IOPS[18]SATA 6 Gbit/s240 GB Drive, 555 MB/s sequential read & 525 MB/s sequential write, Random Write 4 KB Test (Aligned)
OCZ Vertex 4SSDUp to 120,000 IOPS[19]SATA 6 Gbit/s256 GB Drive, 560 MB/s sequential read & 510 MB/s sequential write, Random Read 4 KB Test 90K IOPS, Random Write 4 KB Test 85K IOPS
(IBM) Texas Memory Systems RamSan-20SSD120,000+ Random Read/Write IOPS[20]PCIeIncludes RAM cache
Fusion-io ioDriveSSD140,000 Read IOPS, 135,000 Write IOPS[21]PCIe
Virident Systems tachIOnSSD320,000 sustained READ IOPS using 4KB blocks and 200,000 sustained WRITE IOPS using 4KB blocks[22]PCIe
OCZ RevoDrive 3 X2SSD200,000 Random Write 4K IOPS[23]PCIe
Fusion-io ioDrive DuoSSD250,000+ IOPS[24]PCIe
Violin Memory Violin 3200SSD250,000+ Random Read/Write IOPS[25]PCIe /FC/Infiniband/iSCSIFlash Memory Array
WHIPTAIL, ACCELASSD250,000/200,000+ Write/Read IOPS[26]Fibre Channel, iSCSI, Infiniband/SRP, NFS, CIFSFlash Based Storage Array
DDRdrive X1,SSD300,000+ (512B Random Read IOPS) and 200,000+ (512B Random Write IOPS)[27][28][29][30]PCIe
SolidFire SF3010/SF6010SSD250,000 4KB Read/Write IOPS[31]iSCSIFlash Based Storage Array (5RU)
(IBM) Texas Memory Systems RamSan-720 ApplianceFLASH/DRAM500,000 Optimal Read, 250,000 Optimal Write 4KB IOPS[32]FC / InfiniBand
OCZ Single SuperScale Z-Drive R4 PCI-Express SSDSSDUp to 500,000 IOPS[33]PCIe
WHIPTAIL, INVICTASSD650,000/550,000+ Read/Write IOPS[34]Fibre Channel, iSCSI, Infiniband/SRP, NFSFlash Based Storage Array
Violin Memory Violin 60003RU Flash Memory Array1,000,000+ Random Read/Write IOPS[35]/FC/Infiniband/10Gb(iSCSI)/ PCIe
(IBM) Texas Memory Systems RamSan-630 ApplianceFlash/DRAM1,000,000+ 4KB Random Read/Write IOPS[36]FC / InfiniBand
IBM FlashSystem 840Flash/DRAM1,100,000+ 4KB Random Read/600,000 4KB Write IOPS[37]8G FC / 16G FC / 10G FCoE / InfiniBandModular 2U Storage Shelf - 4TB-48TB
Fusion-io ioDrive Octal (single PCI Express card)SSD1,180,000+ Random Read/Write IOPS[38]PCIe
OCZ 2x SuperScale Z-Drive R4 PCI-Express SSDSSDUp to 1,200,000 IOPS[33]PCIe
(IBM)Texas Memory Systems RamSan-70Flash/DRAM1,200,000 Random Read/Write IOPS[39]PCIeIncludes RAM cache
Kaminario K2Flash/DRAM/Hybrid SSDUp to 1,200,000 IOPS SPC-1 IOPS with the K2-D (DRAM)[40][41]FC
NetApp FAS6240 clusterFlash/Disk1,261,145 SPECsfs2008 nfsv3 IOPs using 1,440 15K disks, across 60 shelves, with virtual storage tiering.[42]NFS, CIFS, FC, FCoE, iSCSISPECsfs2008 is the latest version of the Standard Performance Evaluation Corporation benchmark suite measuring file server throughput and response time, providing a standardized method for comparing performance across different vendor platforms. http://www.spec.org/sfs2008.
Fusion-io ioDrive2SSDUp to 9,608,000 IOPS[43]PCIeOnly via demonstration so far.

See also[edit]

References[edit]

  1. ^ a b c Lowe, Scott (2010-02-12). "Calculate IOPS in a storage array". techrepublic.com. Retrieved 2011-07-03. 
  2. ^ a b c d e "Getting The Hang Of IOPS v1.3". 2012-08-03. Retrieved 2013-08-15. 
  3. ^ Axboe, Jens. "Flexible IO Tester". Retrieved 2010-06-04. (source available at http://git.kernel.dk/)
  4. ^ Smith, Kent (2009-08-11). "Benchmarking SSDs: The Devil is in the Preconditioning Details". SandForce.com. Retrieved 2012-08-28. 
  5. ^ "SATA in the Enterprise - A 500 GB Drive Roundup | StorageReview.com - Storage Reviews". StorageReview.com. 2006-07-13. Retrieved 2013-05-13. 
  6. ^ Hu, X.-Y. and E. Eleftheriou, R. Haas, I. Iliadis, R. Pletka (2009). "Write Amplification Analysis in Flash-Based Solid State Drives". IBM. CiteSeerX: 10.1.1.154.8668. 
  7. ^ "SSDs - Write Amplification, TRIM and GC". OCZ Technology. Retrieved 2010-05-31. 
  8. ^ "Intel Solid State Drives". Intel. Retrieved 2010-05-31. 
  9. ^ "Intel X25-E 64GB G1, 4KB Random IOPS, iometer benchmark". 2010-03-27. Retrieved 2010-04-01. 
  10. ^ "OCZ RevoDrive 3 x2 PCIe SSD Review – 1.5GB Read/1.25GB Write/200,000 IOPS As Little As $699". 2011-06-28. Retrieved 2011-06-30. 
  11. ^ Schmid, Patrick; Roos, Achim (2008-09-08). "Intel's X25-M Solid State Drive Reviewed". Retrieved 2011-08-02. 
  12. ^ http://download.intel.com/design/flash/nand/mainstream/322296.pdf
  13. ^ 1. "Intel’s X25-E SSD Walks All Over The Competition : They Did It Again: X25-E For Servers Takes Off". Tomshardware.com. Retrieved 2013-05-13. 
  14. ^ http://download.intel.com/design/flash/nand/extreme/extreme-sata-ssd-datasheet.pdf
  15. ^ "Intel X25-E G1 vs Intel X25-M G2 Random 4 KB IOPS, iometer". May 2010. Retrieved 2010-05-19. 
  16. ^ a b "G.Skill Phoenix Pro 120 GB Test - SandForce SF-1200 SSD mit 50K IOPS - HD Tune Access Time IOPS (Diagramme) (5/12)". Tweakpc.de. Retrieved 2013-05-13. 
  17. ^ http://www.ocztechnology.com/res/manuals/OCZ_Vertex3_Product_Sheet.pdf
  18. ^ Force Series™ GT 240GB SATA 3 6Gb/s Solid-State Hard Drive. "Force Series™ GT 240GB SATA 3 6Gb/s Solid-State Hard Drive - Force Series GT - SSD". Corsair.com. Retrieved 2013-05-13. 
  19. ^ "OCZ Vertex 4 SSD 2.5" SATA 3 6Gb/s". Ocztechnology.com. Retrieved 2013-05-13. 
  20. ^ "IBM System Storage - Flash: Overview". Ramsan.com. Retrieved 2013-05-13. 
  21. ^ "Home - Fusion-io Community Forum". Community.fusionio.com. Retrieved 2013-05-13. 
  22. ^ http://www.theregister.co.uk/2010/06/16/virident_tachion/
  23. ^ "OCZ RevoDrive 3 X2 480GB Review | StorageReview.com - Storage Reviews". StorageReview.com. 2011-06-28. Retrieved 2013-05-13. 
  24. ^ "Home - Fusion-io Community Forum". Community.fusionio.com. Retrieved 2013-05-13. 
  25. ^ [1][dead link]
  26. ^ "Products". Whiptail. Retrieved 2013-05-13. 
  27. ^ http://www.ddrdrive.com/ddrdrive_press.pdf
  28. ^ http://www.ddrdrive.com/ddrdrive_brief.pdf
  29. ^ http://www.ddrdrive.com/ddrdrive_bench.pdf
  30. ^ Author: Allyn Malventano (2009-05-04). "DDRdrive hits the ground running - PCI-E RAM-based SSD | PC Perspective". Pcper.com. Retrieved 2013-05-13. 
  31. ^ "SSD Cloud Storage System - Examples & Specifications". SolidFire. Retrieved 2013-05-13. 
  32. ^ 8. https://www.ramsan.com/files/download/798
  33. ^ a b "OCZ Technology Launches Next Generation Z-Drive R4 PCI Express Solid State Storage Systems". OCZ. 2011-08-02. Retrieved 2011-08-02. 
  34. ^ "Products". Whiptail. Retrieved 2013-05-13. 
  35. ^ 6000 Series Flash Memory Arrays. "Flash Memory Arrays, Enterprise Flash Storage Violin Memory". Violin-memory.com. Retrieved 2013-11-14. 
  36. ^ "IBM flash storage and solutions: Overview". Ramsan.com. Retrieved 2013-11-14. 
  37. ^ "IBM flash storage and solutions: Overview". ibm.com. Retrieved 2014-05-21. 
  38. ^ "ioDrive Octal". Fusion-io. Retrieved 2013-11-14. 
  39. ^ "IBM flash storage and solutions: Overview". Ramsan.com. Retrieved 2013-11-14. 
  40. ^ Mellor, Chris (2012-07-30). "Chris Mellor, The Register, July 30, 2012: "Million-plus IOPS: Kaminario smashes IBM in DRAM decimation"". Theregister.co.uk. Retrieved 2013-11-14. 
  41. ^ http://www.storageperformance.org/results/benchmark_results_spc1/#kaminario_spc1
  42. ^ "SpecSFS2008". Retrieved 2014-02-07. 
  43. ^ "Achieves More Than Nine Million IOPS From a Single ioDrive2". Fusion-io. Retrieved 2013-11-14.