nv_ingest.pipeline.config package#
Submodules#
nv_ingest.pipeline.config.loaders module#
nv_ingest.pipeline.config.replica_resolver module#
Runtime replica resolution for static scaling mode.
This module provides functionality to resolve replica counts for stages using non-static strategies when dynamic scaling is disabled, ensuring total memory consumption stays within the static_memory_threshold.
- nv_ingest.pipeline.config.replica_resolver.get_memory_intensive_stages(
- pipeline_config: PipelineConfigSchema,
Identify stages that are memory-intensive and may need special handling.
- Parameters:
pipeline_config (PipelineConfigSchema) – The pipeline configuration.
- Returns:
List of stage names that are memory-intensive.
- Return type:
List[str]
- nv_ingest.pipeline.config.replica_resolver.resolve_static_replicas(
- pipeline_config: PipelineConfigSchema,
Resolve static replica counts for all stages when dynamic scaling is disabled.
This function calculates the static replica counts for stages using non-static strategies, ensuring the total memory consumption stays within the configured static_memory_threshold. If the total exceeds the threshold, all non-static stages are scaled down proportionally (minimum 1 replica each).
- Parameters:
pipeline_config (PipelineConfigSchema) – The pipeline configuration with potentially unresolved replica strategies.
- Returns:
A new pipeline configuration with all static replica counts resolved.
- Return type: