aiq.eval.utils.output_uploader#
Attributes#
Classes#
Run custom scripts and upload evaluation outputs using the configured s3 |
Module Contents#
- logger#
- class OutputUploader(
- output_config: aiq.data_models.evaluate.EvalOutputConfig,
- job_id: str | None = None,
Run custom scripts and upload evaluation outputs using the configured s3 credentials.
- output_config#
- _s3_client = None#
- job_id = None#
- property s3_config#
- async _upload_file(s3_client, bucket, s3_key, local_path, pbar)#
- async upload_directory()#
Upload the contents of the local output directory to the remote S3 bucket in parallel.
- run_custom_scripts()#
Run custom Python scripts defined in the EvalOutputConfig. Each script is run with its kwargs passed as command-line arguments. The output directory is passed as the first argument.