nv_ingest_api.util.message_brokers package

Subpackages

• nv_ingest_api.util.message_brokers.simple_message_broker package
  • Submodules
  • nv_ingest_api.util.message_brokers.simple_message_broker.broker module
    • SimpleMessageBroker
      • allow_reuse_address
    • SimpleMessageBrokerHandler
      • handle()
  • nv_ingest_api.util.message_brokers.simple_message_broker.ordered_message_queue module
    • OrderedMessageQueue
      • acknowledge()
      • can_push()
      • empty()
      • full()
      • pop()
      • push()
      • qsize()
      • return_message()
  • nv_ingest_api.util.message_brokers.simple_message_broker.simple_client module
    • SimpleClient
      • fetch_message()
      • get_client()
      • ping()
      • size()
      • submit_message()
  • Module contents
    • ResponseSchema
      • response
      • response_code
      • response_reason
      • trace_id
      • transaction_id
    • SimpleClient
      • fetch_message()
      • get_client()
      • ping()
      • size()
      • submit_message()
    • SimpleMessageBroker
      • allow_reuse_address

Submodules

nv_ingest_api.util.message_brokers.qos_scheduler module

class nv_ingest_api.util.message_brokers.qos_scheduler.QosScheduler(

base_queue: str,

total_buffer_capacity: int = 1,

num_prefetch_threads: int = 0,

prefetch_poll_interval: float = 0.0,

prefetch_non_immediate: bool = False,

strategy: str = 'lottery',

prioritize_immediate: bool = True,

)

Bases: object

Simplified scheduler that fetches jobs from the default queue only. Uses the provided timeout value when polling the broker.

close() → None

Cleanly close the scheduler. No-op for the current implementation since we do not spin background threads.

fetch_next(client, timeout: float = 0.0) → dict | None

Immediate-first, then strategy-based scheduling among non-immediate queues.

Behavior: - Always check ‘immediate’ first (non-blocking). If present, return immediately. - If not, select using the configured strategy (lottery, round_robin, weighted_round_robin). - If no job is found in a full pass:

• If timeout <= 0: return None.

• Else: sleep in 0.5s increments and retry until accumulated elapsed time >= timeout.

Module contents