Skip to Main Content
Talk Intermediate

Boosting Your Python Web App's Performance with Task Queues and Concurrency in Celery

Approved
Session Description

So this session is going to be about how to use CELERY in your Python Based Web apps (I will use Django as an example), to divide the tasks and make the whole user experience a lot better. So a web apps main work is to handle clients, users, interact with databases and work with different requests etc. It is not meant to handle processes like running some time bound scripts, calling third party apis, handling scheduled tasks or even running ML models (tho it can, but not recommended). For this to isolate this whole process comes "CELERY" as a game changer. So for example If there is task to send 10,000 emails, this can be run by your web app, but it needs to wait until whole process is done. So instead you can just make a task file and write the logic to send mails, and in background this whole process is taking place and mails are being send and at the same time we can use our website without waiting for that certain process to end with the help of CELERY.


The second part of the session will be all about discussions over Concurrency, Multithreading and Multiprocessing in python! and how Celery uses it to do the job.


Session also involves some live demons on CPU usage with threads and more.

References

Session Categories

FOSS

Speakers

yashraj
Core Member | Django India

I am currently a college student, Pythonista and a DjangoNaut!

I am python and Backend developer. I also love doing webscraping.

I have been working with python for around 5 years and Django for 2 years and maximum of my work uses python in it.

I am DjangoNaut, which is a Fellowship program run by Django Software Foundation to find the next maintainers of Django. Only 14 people worldwide were selected for this program, in which i am the only one from India in this session.

I contribute to Open Source in Django.

I am also a Core member at DjangoIndia and FOSSCU-k community.

My tech stack lies in : Python, Django, Flask, Beautiful Soup, Celery, Docker and other python based libraries.

yashraj

Reviews

Not the highest quality CFP, although we can consider it if there's a lack of talks, in my opinion
Reviewer #1 Not Sure

topic isn't anything new, but it is indeed a well written CFP so I will approve
Reviewer #2 Approved

Reviewer #3 Approved