GuestlineIngesterTask — Developer Reference

Developer reference for GuestlineIngesterTask with constructor parameters and usage examples.

File: etl_lib/tasks/chains/guestline/GuestlineIngesterTask.py

Constructor Parameters

Parameter	Type	Description
`name`	`Optional[str]`	Custom task name
`job_context`	`JobContext`	Job context with Spark and config
`sync_dates`	`Optional[List[str]]`	Opt-in list of specific dates
`**kwargs`	`dict`	Extra Task kwargs

Example Usage


from etl_lib.tasks.chains.guestline.GuestlineIngesterTask import GuestlineIngesterTask
 
task = GuestlineIngesterTask(job_context=job_context, sync_dates=["2025-09-15"])
task.run()

Implementation Details

Uses HttpClient to fetch gateway URIs and event log payloads
Normalizes JSON keys to lowercase via lowercase_keys() helper
Converts returned JSON payloads to Spark DataFrames using provided schemas
Writes DataFrames to the ingest catalog via job_context.catalog.write_to_ingest(...)
Handles missing/empty payloads gracefully

Back to tasks: /processes/tasks/chains/guestline/guestline-ingester-task