Get Job Logs#

Stream logs from a data generation job to monitor progress and troubleshoot issues.

Prerequisites#

Before you can get logs from a data generation job, make sure that you have:

  • Obtained the base URL of your NeMo Data Designer service

  • Set the NEMO_MICROSERVICES_BASE_URL environment variable to your NeMo Data Designer service endpoint

export NEMO_MICROSERVICES_BASE_URL="https://your-data-designer-service-url"

To Get Logs from a Data Generation Job#

Use the NeMoDataDesignerClient to get logs from a data generation job:

import os
from nemo_microservices.data_designer.essentials import NeMoDataDesignerClient


# Initialize client
data_designer_client = NeMoDataDesignerClient(
    base_url=os.environ["NEMO_MICROSERVICES_BASE_URL"]
)

# Connect to a job
job_results = data_designer_client.get_job_results("job_abc123xyz")

# Get the job logs
logs = job_results.get_logs()
Example Response
[
    {
        "asctime": "2025-10-22 22:50:34,460",
        "levelname": "INFO",
        "name": "nemo_data_designer.engine.dataset_builders.utils.dag",
        "message": "⛓️ Sorting column configs into a Directed Acyclic Graph",
    },
    {
        "asctime": "2025-10-22 22:50:34,490",
        "levelname": "INFO",
        "name": "nemo_data_designer.engine.models.registry",
        "message": "🩺 Running health checks for models..."
    },
    # ...
]

Log Levels#

  • info: General information about job progress

  • warning: Warning messages that don’t stop execution

  • error: Error messages indicating problems