nemo_curator.stages.text.experimental.translation.backends.google

View as Markdown

Google Cloud Translation API backend for NeMo Curator.

Supports both Google Cloud Translation API v2 (Basic) and v3 (Advanced).

Module Contents

Classes

NameDescription
GoogleTranslationBackendGoogle Cloud Translation backend (v2 and v3 APIs).

API

class nemo_curator.stages.text.experimental.translation.backends.google.GoogleTranslationBackend(
project_id: str | None = None,
location: str = 'global',
api_version: str = 'v2',
max_concurrent_requests: int = 32
)

Bases: ExecutorTranslationBackend

Google Cloud Translation backend (v2 and v3 APIs).

Parameters:

project_id
str | NoneDefaults to None

Google Cloud project ID. Required for v3. Falls back to the GOOGLE_CLOUD_PROJECT environment variable.

location
strDefaults to 'global'

Google Cloud location for v3 (default "global").

api_version
strDefaults to 'v2'

"v2" (default) or "v3".

max_concurrent_requests
intDefaults to 32

Semaphore size for async concurrency.

_api_version
= api_version.lower()
_parent
str | None = None
_project_id
backend_name
= 'Google Cloud Translation'
nemo_curator.stages.text.experimental.translation.backends.google.GoogleTranslationBackend._non_retryable_exceptions() -> tuple[type[BaseException], ...]

Return 400-class Google API errors that should not be retried.

nemo_curator.stages.text.experimental.translation.backends.google.GoogleTranslationBackend._translate_single_sync(
text: str,
source_lang: str,
target_lang: str
) -> str

Synchronous single-text translation (called via executor).

nemo_curator.stages.text.experimental.translation.backends.google.GoogleTranslationBackend.close() -> None

Release client resources.

nemo_curator.stages.text.experimental.translation.backends.google.GoogleTranslationBackend.setup() -> None

Initialize the Google Cloud Translation client.

Raises:

  • ImportError: If google-cloud-translate is not installed.
  • ValueError: If v3 is selected but no project_id is available.