Background Processing
Task queues, workers, Redis, Celery, and asynchronous processing.
Terms in Background Processing
Background Task
A background task performs work outside the main request-response cycle.
Backpressure
Backpressure slows or limits producers when consumers cannot keep up with incoming work.
Celery
Celery is a distributed task queue commonly used with Python applications.
Celery Beat
Celery Beat schedules periodic Celery tasks.
Consumer
A consumer receives and processes messages from a queue.
Dead Letter Queue
A dead letter queue stores messages that cannot be successfully processed.
Distributed Task
A distributed task can be processed by workers running across multiple machines or processes.
Message Broker
A message broker receives and distributes messages between producers and consumers.
Producer
A producer creates messages or tasks and sends them to a queue or broker.
Redis
Redis is an in-memory data store commonly used for caching and task queues.
Scheduled Task
A scheduled task executes automatically at a specified time or interval.
Task Chaining
Task chaining executes multiple background tasks in a defined sequence.
Task Idempotency
An idempotent task can safely be executed more than once without producing unintended repeated effects.
Task Monitoring
Task monitoring tracks queued, running, completed, and failed background jobs.
Task Priority
Task priority determines which queued tasks should be processed before others.
Task Queue
A task queue stores work items that workers process asynchronously.
Task Result Backend
A result backend stores the status or result of asynchronous tasks.
Task Retry
Task retrying allows failed background work to be attempted again.
Task Timeout
A task timeout stops or marks a task as failed after a specified period.
Worker
A worker is a process that consumes and executes queued tasks.
Worker Pool
A worker pool maintains multiple worker processes or threads for concurrent task execution.