Page Comparison

This page documents the goals and results for a series of milestones for the first implementation of RAMCloud. Each milestone last 2 weeks, ending on a Monday.

Milestone 17: ends October 4, 2010

• Ryan goals:
  • Finish edits in response to code review.
  • File bugs on remaining important issues in FastTransport.
• Ryan actual:
  •  
• Steve goals:
  • Finish Infiniband Transport and Driver
  • Simple benchmarks of the above
  • Restart work on new Log and Segment code
• Steve actual:
  •  
• Diego goals:
  • Finish updates to Transport API.
  • Update Driver API.
  • Finish Ethernet packet driver.
• Diego actual:
  •  

Milestone 16: ends September 21, 2010

• Ryan goals:
  • Code review FastTransport, commit with review changes
  • Analyze performance of FastTransport.
• Ryan actual:
  • Working through code review:
    • Done with everything except FastTransport*
    • Worked through easy comments in FastTransport.h
• Steve goals:
  • Infiniband transport & driver
  • Continue working on performance discrepancy with Mellanox
• Steve actual:
  • Driver mostly done (blocked on ServiceLocator), does copying right now to avoid memory registration issues
  • Transport 80% coded
  • Mellanox: our hardware is slower, but we're not sure why (they get latency up to 40% better than us)
• Diego goals:
  • Finish ServiceLocator.
  • Finish Ethernet packet driver.
  • Resolve monitor issue.
• Diego actual:
  • Class/code review done, but integration still in progress.
  • No packet driver work.
  • Monitor #5 works
• John goals:
  • TCPTransport performance improvements.
  • Class prep.
• John actual:
  • No TCPTransport work yet.

Milestone 15: ends September 7, 2010

• Ryan goals:
  • Tuning/code review for FastTransport
• Ryan actual:
  • Code review imminent
• Steve goals:
  • Gone one week
  • Infiniband transport working
• Steve actual:
  • Gone one week
  • Partial Infiniband transport (waiting for ServiceLocators)
  • Talking with Mellanox about performance
• Diego goals:
  • Working monitor
  • Driver to send raw Ethernet packets through the kernel
• Diego actual:
  • Monitor still broken
  • Ethernet packet driver exists but not in proper form
  • Implemented ServiceLocator class; undergoing code review, not integrating cleanly
• John goals:
  • Really really check in Client/Server changes.
  • Start on smaller issues.
• John actual:
  • Committed Client/Server changes
  • Fixed several smaller issues (cpplint, etc.)

Milestone 14: ends August 23, 2010

• Ryan goals:
  • Finish documentation and tests for FastTransport (1 week)
  • Possible next steps:
    • Redo sessions
    • Add UDP layer
• Ryan actual:
  • A few more unit tests to write for FastTransport
  • More work needed on docs
  • FastTransport currently ~1300 lines
• Steve goals:
  • Learn about Infiniband software layers
  • Start on Infiniband Transport class
• Steve actual:
  • Still learning Infiniband, writing simple stand-alone app
  • Setup code for Infiniband complex
  • Mellanox person coming tomorrow for training
• Diego goals:
  • On vacation
• Diego actual:
  • Vacation
• John goals:
  • Finish Client/Server changes and check in (1 week)
  • Odds and ends
• John actual:
  • Client/Server changes code-reviewed, working on followups
  • Switched to using exceptions instead of Status returns.

Milestone 13: ends August 9, 2010

• Ryan:
  • New transport working without timers
  • Take basic performance measurements of new transport
  • Timers working with new transport
• Ryan results:
  • C++ FastTransport implementation compiles and is showing signs of life, but has almost no tests or documentation yet.
  • It looks like the Session mechanism is going to need a redesign.
• Steve goals:
  • Intel driver completely working in user space
  • Basic user-space 10G performance measurements (without fast transport)
  • Ideal: measure performance with user-space driver and new transport
• Steve results:
  • Mellanox NICs and switch arrived
  • Got Infiniband and 10GE pings working using "out-of-the-box" software.
  • Starting to learn about Infiniband verbs
  • Intel work is on hold for now
• Diego:
  • Finish translating ClientSession into C++.
  • On vacation
• John goals:
  • Client converted to C++, upgraded for full use of Buffers, integrated with RAMCloud
• John results:
  • Client converted to C++ and tested, along with Server.
  • Several new header files, such as Rpc.h and Table.h
  • All existing C++ code (including ClientMain and Bench) now uses the new Client.
  • Still need to convert the Python bindings and Python code.

Milestone 12: ends July 26, 2010

...