Versions Compared

Old Version 13

changes.mady.by.user Former user

Saved on

compared with

New Version 14

changes.mady.by.user Former user

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Use Flash as a disk replacement for durability, servicing requests from DRAM (Flash-backup)
  2. Use Flash to replace DRAM as the main storage technology (Flash-cloud)

Flash-backup (1) can help reduce some of the problem of the log-based persistence protocol discussed earlier in the quarter due to the better bandwidth characteristics Flash, in particular for the recovery case. Nevertheless, due to the increased cost of Flash compared to disks, if we can make the protocol work with disks using Flash is a bad idea. 

Flash-cloud (2) is interesting for two reasons. First, it will reduce significantly the cost/bit for overall system. Second, it will reduce significantly the power consumption for the system, especially for the idle case. A large part of our memory devices (DRAM or Flash) will be storing bits that are not accessed frequently. Minimizing the static power of these devices would be very useful for cost and scaling reasons.

The disadvantages for Flash-cloud are the following: 1) Unacceptale RPC latency in the tens of usec (more on this later). 2) While Flash chips are commodity, Flash systems are still not. The cost of systems may be high for a while due to volume. 3) While the movement towards Flash in the enterprise is strong and will address some of the endurance and bandwidth issues for Flash, it may not be exactly what we want as they will focus competing with disk as opposed to DRAM.

Architecting Flash-cloud

Within the node, we'd need a highly parallel storage system with multiple Flash  channels for bandwidth and latency purposes. PCIe is 1GB/s per lane, ONMI is 200MB/s per channel. We would have to make the FTL match our data model and access patterns.

  •  
  • Why not use flash instead of RAM as the main storage mechanism
    • What is flash latency?
      • SSDs:
        • Current claims for x25-E: 75 µs read, 85 µs write
      • Typical ONFI:
        • Micron MT29H8G08ACAH1, 8, 16, 32 Gb
          • Read 30 µs, Write 160 µs, Erase 3 ms
    • Can it be made a low enough so it doesn't impact RPC latency?
    • What is the latency of typical flash packaging today? 100 µs?
  • Does flash offer advantages over disk as the backup mechanism?