nv_ingest.modules.sources package

Submodules

nv_ingest.modules.sources.message_broker_task_source module

nv_ingest.modules.sources.message_broker_task_source.fetch_and_process_messages(

client,

validated_config: MessageBrokerTaskSourceSchema,

)

Fetch messages from the message broker and process them.

Parameters:

• client (MessageBrokerClientBase) – The client used to interact with the message broker.

• validated_config (MessageBrokerTaskSourceSchema) – The validated configuration for the message broker.

Yields:

IngestControlMessage – The processed control message for each fetched job.

Raises:

Exception – If an irrecoverable error occurs during message processing.

nv_ingest.modules.sources.message_broker_task_source.process_message(

job: Dict,

ts_fetched: datetime,

) → IngestControlMessage

Process a job and return an IngestControlMessage.

Module contents