Jobs (25)

• AWS Batch- Managed cloud-scale job scheduling service from AWS for batch computing workloads. Automatically provisions and scales compute resources, supports priority-based scheduling, retries, dependencies, and works with EC2 and Fargate.AWS
• Agenda- Lightweight job scheduling library for Node.js using MongoDB for persistence. Provides cron scheduling, one-time jobs, and job prioritization with MongoDB's reliability.
• Amazon SQS- AWS managed message queue service for decoupling application components. Supports FIFO and standard queues, automatic scaling, and integration with Lambda and other AWS services.AWS
• Apache Kafka- Distributed event streaming platform for high-throughput, fault-tolerant job and event processing. Supports partitioning, replication, and can be used as a backbone for job queue systems with persistence.
• Bee-Queue- Simple, fast, and robust job queue library for Node.js backed by Redis. Lightweight alternative to other job queues with minimal memory overhead and straightforward API.
• Bull- Fastest and most reliable Redis-based job queue for Node.js. Provides robust job processing with minimal CPU usage, rate limiting, priority queues, and delayed jobs built on Redis transactions.
• Bull (Legacy)- Original Bull Redis queue library for Node.js (now maintained as legacy while BullMQ is the modern version). Supports job queues, delayed jobs, and retries with callbacks-based API.
• BullMQ- Fast and robust Redis-backed job queue library for Node.js. Supports delayed jobs, retries, rate limiting, and concurrent job processing with TypeScript support and low latency.
• Cadence Workflow- Open-source workflow orchestration engine for distributed systems with fault-tolerant, stateful workflow execution. Scales to millions of concurrent workflows with automatic state recovery and built-in reliability.
• Celery- Distributed task queue for Python with support for real-time and scheduled tasks. Flexible message brokers (RabbitMQ, Redis), automatic retries, and horizontal scalability across multiple machines.
• Faktory- Language-agnostic persistent background job server with support for multiple languages through a unified API. Features job queues, scheduling, retries, and enterprise options with web UI monitoring.
• GCP Cloud Tasks- Managed task queue service from Google Cloud Platform for asynchronous job execution. Handles HTTP and App Engine task routing with automatic retries, rate limiting, and scheduled execution.GCP
• Good Job- PostgreSQL-backed job queue for Rails using ActiveJob. Provides database-native background job processing without external dependencies, with built-in retries and scheduled job support.
• Graphile Worker- High-performance Node.js job queue built on PostgreSQL with no Redis dependency. Offers sub-2ms latency, automatic retries, cron scheduling, and up to 10k jobs/second with native TypeScript support.
• Inngest- Serverless event-driven task queue with built-in durability, retries, and step functions for orchestrating background jobs and workflows. Supports scheduled functions, delayed jobs, and fan-out processing without infrastructure setup.
• Quirrel- Task queueing solution designed for serverless environments. Now part of Netlify, it provides delayed jobs, fanout job distribution, recurring jobs, and CRON scheduling for serverless functions.
• RabbitMQ- Open-source message broker and task queue with support for multiple protocols (AMQP, MQTT, STOMP). Provides routing, acknowledgments, dead-lettering, and clustering for reliable distributed job processing.
• Resque- Redis-backed job queue library for Ruby with a simple, robust design. Provides a web UI for job monitoring, supports retries, and is widely used in the Ruby ecosystem.
• River- High-performance job queue for Go and PostgreSQL with transactional job enqueueing. Built on PostgreSQL's SKIP LOCKED feature for reliable, zero-loss background job processing without external dependencies.
• Sidekiq- Simple and efficient background job processing for Ruby and Rails. Open-source library backed by Redis with support for priority queues, scheduled jobs, retries, and a web UI for monitoring.
• Temporal.io- Open-source workflow orchestration platform for managing long-running, stateful workflows with built-in reliability, retries, and fault tolerance. Supports multiple languages and scales to millions of concurrent workflows.
• Trigger.dev- Developer-friendly workflow orchestration platform for serverless applications. Provides a modern SDK for defining background jobs, API integrations, and workflows with a web dashboard for monitoring.
• Upstash QStash- Serverless message queue and task scheduler for HTTP-based job dispatch and scheduling. Push-based model designed for serverless functions with automatic retries, delayed delivery, and FIFO queues without requiring backend infrastructure.
• Zeplo- Serverless message queue powered by HTTPS with zero setup required. Queue and schedule HTTP requests with automatic retries, delays, and cron scheduling without managing infrastructure.
• pg-boss- Node.js job queue built on PostgreSQL with SKIP LOCKED for reliable job processing. Provides cron scheduling, exactly-once delivery, and backpressure-compatible workers without external dependencies.