Skynet Open source Ruby implementation of Google's MapReduce framework
Download

Skynet Ranking & Summary

Skynet Tags

framework ruby framework distribute mapreduce framework distribute task mapreduce

Skynet Description

Open source Ruby implementation of Google's MapReduce framework Skynet is an open source Ruby implementation of Google's MapReduce framework.With Skynet, one can easily convert a time-consuming serial task, such as a computationally expensive Rails migration, into a distributed program running on many computers. If you'd like to learn more about MapReduce, see my intro at the bottom of this document.Skynet is an adaptive, self-upgrading, fault-tolerant, and fully distributed system with no single point of failure. It uses a "peer recovery" system where workers watch out for each other. If a worker dies or fails for any reason, another worker will notice and pick up that task. Also, Skynet has no special 'master' servers, only workers that can act as a master for any task at any time. Even these master tasks can fail and will automatically be picked up by other workers.NOTE: Skynet is licensed and distributed under the terms of the MIT/X Consortium License.

Skynet Related Software