TaskGroup — Developer Reference

This page contains developer-facing examples and API usage for TaskGroup.

Example: Basic Task Grouping


from etl_lib.tasks.TaskGroup import TaskGroup
from etl_lib.tasks.processing import (
    ReservationMetricsTask,
    RoomMetricsTask,
    GuestMatchingTask,
)
 
task1 = ReservationMetricsTask(job_context=job_context)
task2 = RoomMetricsTask(job_context=job_context)
task3 = GuestMatchingTask(job_context=job_context)
 
metrics_group = TaskGroup(
    name="metrics-processing",
    tasks=[task1, task2, task3]
)
 
metrics_group.run()

Nested Task Groups


raw_group = TaskGroup(
    name="raw-processing",
    tasks=[
        AthenaeumRawTask(job_context=job_context),
        MewsRawTask(job_context=job_context),
    ]
)
 
clean_group = TaskGroup(
    name="cleaning",
    tasks=[
        CleanAthenaeumTask(job_context=job_context),
        CleanMewsTask(job_context=job_context),
    ]
)
 
master_group = TaskGroup(
    name="complete-pipeline",
    tasks=[raw_group, clean_group]
)
 
master_group.run()

TaskGroup vs Task with Subtasks

Examples and comparison details: you can check in development references.

Back to process documentation: /processes/tasks/task-group