Tips from Charlie & Co
Tips for Expediting the Purchase Request
If the item is sole sourced (i.e. can only get from one vendor), you're set.
If not, try to help purchasing by doing the work for them. I.e., find 3 competing quotes and submit the best one. If you don't, they'll apparently try to find 3 themselves, but it can take a while.
Other potential sources for SuperMicro hardware
Silicon Mechanics (siliconmechanics.com) - Seattle area, used extensively by CSL/Gates
Mazda Technologies (packs X58 chipset-based, core i7s in 1U machines)
Penguin Computing (Fremont, CA. Usually more expensive?)
Power
We will have three 250v plugs (20A each - L6-20R is the socket)
Should probably get 4 PDUs for 20kW total. Can likely scrounge a fourth socket if we need it.
PDUs commonly come with 24 plugs, so we'll likely want two, one for each 220v source.
Twin servers share a power supply, so we cut down on the number of plugs that way.
Quad servers apparently share 2 power supplies, but need only one to run (i.e. redundant power by default).
PDUs run ~$750 for 24 plugs
Was some concern that the Infiniband and 10GigE switches could be very power hungry
Our Mellanox 36-port switches are IS5024 (XXX verify): ?? watts
Arista 24-port switch (7124S): 210W "typical power draw"
Switches
48-port gigabit linking all nodes.
Recommended staying away from cheapo switches (NetGear, DLink, etc).
Good experiences with HP switches (used throughout Gates). Lifetime warranty. ~$1,500.
Switch for IPMI needs only be 10/100. Not as critical.
Get something cheap, or get an old decommissioned one for free from Charlie.
Racks
Be sure whatever we get has standard dimensions (i.e. can fit through a doorway).
Should be no problem taking a full rack in the elevator.
Misc
Be sure whoever delivers has a lift on their truck, as we do not have a loading dock!