ProcPile is a pure Ruby distributed computing
cluster environment. Its goal is to allow fast
prototyping on smaller datasets, especially those
where serialization and deserialization are minor
expenses relative to the core processing task.
Once the algorithms are settled, you should be
able to scale out to full production usage. At
that point, you can replace the core processes
with Ruby modules written in C (or Inline::C), or
move the design to a more "grown-up" clustering
environment.
