Building a Task Queue with Celery and Redis
The more microservices you have the more you need asynchronous messaging between the microservices or scheduled jobs or background tasks. Background tasks are good for many reasons; lifting off the heavy load from specific microservices, run stateless jobs and scheduled tasks, asynchronous messaging etc… But failed background tasks -true to its name- can go unnoticed if you do not set up a proper monitoring or a highly available system. So you need those tasks (in short) to be fast, highly available and easy to manage....