Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Facebook wants a tryGet() - try to get and if it takes too long, abort. Might be useful when a 2s hiccup is not ok.

How many apps are there nowadays that don't tolerate 2s hiccups?

...

Facebook: Crucial piece of metadata on some server, every web machine waits for 2s, systemic fallout from that.
tryGet() with exponential backupbackoff, application-level replication.

...

Graph algos have phases: local computation, then batch updates to other machine.

No Not clear on optimizing the "local computation" phase, that's going to cause a lot of bandwidth.

...

Google: Could say: Let's assume someone gives us a distributed file system to store all the log files. How can we get the latency down?

John: Is there such a filesystem in existence?
Google: Conceptually, I don't see what the difference is between your writes and those of hadoopfs or gfs.
They scatter things across.
It could be that you don't really want to deal with their implementations.

...