Using Celery with Flask

In this post, I will talk about using Celery with Flask. I’m going to assume that you have completed¬†this tutorial¬†on Celery. Basic Flask app structure Assume that we have written a nicely working Flask app which now needs to do some backend processing. Here’s our basic Flask app structure: +–myapp_dir/ +–app/ +–static/ +–templates/ +–utils/ +–views/ … Continue reading Using Celery with Flask

Storing Results in Celery is a Bad Idea

For months I had sleepless nights over Celery backend system crashes. I was using RabbitMQ initially and then switched to Redis and it didn’t change anything. The Problem My app would generate hundreds of data every hour after processing and RabbitMQ would run out of file descriptors to handle it and crash. With Redis, the … Continue reading Storing Results in Celery is a Bad Idea