About

I run a rank-tracking web app built with Django and Python, using Celery for background tasks. We have a performance problem: One user tracks about 3,000 keywords, refreshed daily via an external API. That single job takes around 4 hours to finish. Because of this, we hit Celery’s concurrency/hard-limit and other users’ keyword refresh jobs are delayed or skipped. I’m looking for a developer who can: Review our Celery setup, queues, and worker configuration. Suggest and implement improvements (parallelization, task splitting, scheduling, etc.). Help ensure that large jobs don’t block other users. Requirements: Strong Django + Python skills. Solid experience with Celery (task queues, scaling, monitoring). Ability to optimize API-driven batch jobs.