SHORTLIST20
Français
Englishالعربية中文日本語한국어EspañolFrançaisहिन्दी
Programmation

Top 20 Python task queues, schedulers and workflow tools

Celery, RQ, Airflow, Prefect, Dagster and message-broker clients for running work in the background

Mis à jour · GitHub stars (stars)

Pourquoi ces 20

Ranked by GitHub stars: how many developers bookmarked the project. Stars measure attention, not quality, so each row also shows forks, licence, the last push and the section of the community list it sits in. Three kinds share the list: task queues (Celery, RQ, Dramatiq) run jobs from your app, schedulers and orchestrators (APScheduler, Airflow, Prefect) run them on a timetable or as pipelines, and messaging clients (Kafka, RabbitMQ, MQTT) move the messages. Orchestrators are whole platforms with web UIs, so they collect more stars than a small library that does one job well.

  1. 1

    apache-airflow

    Airflow is a platform to programmatically author, schedule and monitor workflows.

    47,263 stars 18,121 forkslast push 2026-10-22PythonApache-2.0

  2. 2

    celery

    An asynchronous task queue/job queue based on distributed message passing.

    29,032 stars 5,236 forkslast push 2026-10-22PythonNOASSERTION

  3. 3

    prefect

    A modern workflow orchestration framework that makes it easy to build, schedule and monitor robust data pipelines.

    24,061 stars 2,609 forkslast push 2026-10-22PythonApache-2.0

  4. 4

    dagster

    An orchestration platform for the development, production, and observation of data assets.

    16,313 stars 2,366 forkslast push 2026-10-21PythonApache-2.0

  5. 5

    schedule

    Python job scheduling for humans.

    12,269 stars 1,014 forkslast push 2024-05-25PythonMIT

  6. 6

    rq

    Simple job queues for Python.

    10,695 stars 1,514 forkslast push 2026-10-21PythonNOASSERTION

  7. 7

    apscheduler

    A light but powerful in-process task scheduler that lets you schedule functions.

    7,666 stars 807 forkslast push 2026-10-12PythonMIT

  8. 8

    huey

    A little task queue with multi-process, multi-thread, or greenlet workers.

    6,055 stars 405 forkslast push 2026-10-21PythonMIT

  9. 9

    faststream

    A framework for building async services over Kafka, RabbitMQ, NATS, MQTT, and Redis.

    5,379 stars 411 forkslast push 2026-10-21PythonApache-2.0

  10. 10

    dramatiq

    A fast and reliable background task processing library for Python 3.

    5,330 stars 386 forkslast push 2026-10-15PythonLGPL-3.0

  11. 11

    pika

    Pure-Python RabbitMQ/AMQP 0-9-1 client library.

    3,888 stars 854 forkslast push 2026-10-22PythonBSD-3-Clause

  12. 12

    paho-mqtt

    The Eclipse Paho MQTT client for Python.

    2,430 stars 752 forkslast push 2026-10-12PythonNOASSERTION

  13. 13

    taskiq

    Distributed task queue with native asyncio support and pluggable brokers.

    2,361 stars 156 forkslast push 2026-10-12PythonMIT

  14. 14

    temporalio

    Temporal SDK for durable, fault-tolerant workflows that survive crashes and retries.

    1,228 stars 271 forkslast push 2026-10-22PythonMIT

  15. 15

    confluent-kafka

    Confluent's Python client for Apache Kafka, built on librdkafka.

    523 stars 970 forkslast push 2026-10-21PythonNOASSERTION

Comment c'est mesuré

Every project in the Task Queues, Job Schedulers and Messaging sections of the community list vinta/awesome-python on GitHub that has a public repository, ranked by GitHub stars from the GitHub API; archived repositories are left out. Refreshed every 6 hours.

Références

  1. vinta/awesome-python: Task Queues, Job Schedulers and Messaging, GitHub community list (list text CC BY 4.0; star counts from the GitHub API). Checked 2026-10-22 08:48 UTC.
  2. vinta/awesome-python (Task Queues, Job Schedulers, Messaging), GitHub community list, 15 tools with a public repository.