Skip to content

Brainlog/Fault-Tolerant-Master-Worker-Word-Counter

Repository files navigation

Cloud Computing : Streaming Computation

  1. In this assignment, workers are fault tolerant. There is one more version where the master is "also" fault tolerant. Check
  2. Used Lua script to make operations atomic.
  3. Used Redis as Master To run the source code :
  4. Change the path in constants.py to directory in which all the files are stored.
  5. Set the number of workers.
  6. To try crashing or slowing down the workers, set N_CRASHING and N_SLEEPING workers.
  7. Acknowledgement : Starter code (structure of APIs) is provided by our Course Coordinator.
  8. Install redis from pip.
  9. Configure the redis-server on the port and run redis-client to start the master.
  10. Finally run
python3 client.py

About

This is a streaming computation master worker fault tolerant design.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published