Skip to main content
Ctrl+K
Morpheus (25.06) - Home Morpheus (25.06) - Home

Morpheus (25.06)

Morpheus (25.06) - Home Morpheus (25.06) - Home

Morpheus (25.06)

Table of Contents

Using Morpheus

  • Getting Started with Morpheus
  • Morpheus Conda Packages
  • Morpheus CLI Overview
  • Building a Pipeline
  • Morpheus CPU-Only Mode
  • Morpheus Models
  • Examples
    • Anomalous Behavior Profiling with Forest Inference Library (FIL) Example
    • ABP Detection Example Using Morpheus
    • DOCA GPU Real-Time traffic analysis
    • GNN Fraud Detection Pipeline
    • LLM
      • Completion Pipeline
      • Vector DataBase Upload (VDB Upload) Pipeline
      • Retrieval Augmented Generation (RAG) Pipeline
      • Morpheus LLM Agents Pipeline
      • LLM
    • Example cyBERT Morpheus Pipeline for Apache Log Parsing
    • Sensitive Information Detection with Natural Language Processing (NLP) Example
    • Example Ransomware Detection Morpheus Pipeline for App Shield Data
    • Root Cause Analysis Acceleration & Predictive Maintenance Example
    • SID Visualization Example
    • Examples
  • Developer Guides
    • Simple Python Stage
    • Real-World Application: Phishing Detection
    • Simple C++ Stage
    • Creating a C++ Source Stage
    • Digital Fingerprinting (DFP)
    • Digital Fingerprinting (DFP) Reference
    • Python Morpheus Modules
    • C++ Morpheus Modules
    • Morpheus Control Messages
    • Introduction to Modular Digital Fingerprinting Pipeline (Integrated Training)
    • Developer Guides

Modifying Morpheus

  • Morpheus Architecture
  • Contributing to Morpheus

API

  • Python API
    • morpheus
      • morpheus.cli
        • morpheus.cli.click_completion_tools
        • morpheus.cli.default_command_hooks
          • morpheus.cli.default_command_hooks.DefaultCommandHooks
        • morpheus.cli.hookspecs
        • morpheus.cli.plugin_manager
          • morpheus.cli.plugin_manager.PluginManager
        • morpheus.cli.register_stage
        • morpheus.cli.run
        • morpheus.cli.stage_registry
          • morpheus.cli.stage_registry.GlobalStageRegistry
          • morpheus.cli.stage_registry.LazyStageInfo
          • morpheus.cli.stage_registry.StageInfo
          • morpheus.cli.stage_registry.StageRegistry
        • morpheus.cli.utils
          • morpheus.cli.utils.MorpheusRelativePath
      • morpheus.common
      • morpheus.config
        • morpheus.config.AEFeatureScalar
        • morpheus.config.Config
        • morpheus.config.ConfigAutoEncoder
        • morpheus.config.ConfigBase
        • morpheus.config.ConfigFIL
        • morpheus.config.ConfigOnnxToTRT
        • morpheus.config.CppConfig
        • morpheus.config.ExecutionMode
        • morpheus.config.PipelineModes
      • morpheus.controllers
        • morpheus.controllers.elasticsearch_controller
          • morpheus.controllers.elasticsearch_controller.ElasticsearchController
        • morpheus.controllers.file_to_df_controller
          • morpheus.controllers.file_to_df_controller.FileToDFController
        • morpheus.controllers.filter_detections_controller
          • morpheus.controllers.filter_detections_controller.FilterDetectionsController
        • morpheus.controllers.monitor_controller
          • morpheus.controllers.monitor_controller.MonitorController
        • morpheus.controllers.rss_controller
          • morpheus.controllers.rss_controller.FeedStats
          • morpheus.controllers.rss_controller.RSSController
        • morpheus.controllers.serialize_controller
          • morpheus.controllers.serialize_controller.SerializeController
        • morpheus.controllers.write_to_file_controller
          • morpheus.controllers.write_to_file_controller.WriteToFileController
      • morpheus.io
        • morpheus.io.data_manager
          • morpheus.io.data_manager.DataManager
        • morpheus.io.data_manager_loader
          • morpheus.io.data_manager_loader.DataManagerDataset
          • morpheus.io.data_manager_loader.DataManagerLoader
        • morpheus.io.data_record
          • morpheus.io.data_record.DataRecord
        • morpheus.io.data_storage
          • morpheus.io.data_storage.file_system
            • morpheus.io.data_storage.file_system.FileSystemStorage
          • morpheus.io.data_storage.in_memory
            • morpheus.io.data_storage.in_memory.InMemoryStorage
        • morpheus.io.data_storage_interface
          • morpheus.io.data_storage_interface.RecordStorageInterface
        • morpheus.io.deserializers
        • morpheus.io.serializers
        • morpheus.io.utils
      • morpheus.loaders
        • morpheus.loaders.file_to_df_loader
        • morpheus.loaders.fsspec_loader
        • morpheus.loaders.sql_loader
      • morpheus.messages
        • morpheus.messages.control_message
          • morpheus.messages.control_message.ControlMessage
        • morpheus.messages.data_class_prop
          • morpheus.messages.data_class_prop.DataClassProp
        • morpheus.messages.memory
          • morpheus.messages.memory.inference_memory
            • morpheus.messages.memory.inference_memory.InferenceMemory
            • morpheus.messages.memory.inference_memory.InferenceMemoryAE
            • morpheus.messages.memory.inference_memory.InferenceMemoryFIL
            • morpheus.messages.memory.inference_memory.InferenceMemoryNLP
          • morpheus.messages.memory.response_memory
            • morpheus.messages.memory.response_memory.ResponseMemory
            • morpheus.messages.memory.response_memory.ResponseMemoryAE
            • morpheus.messages.memory.response_memory.ResponseMemoryProbs
          • morpheus.messages.memory.tensor_memory
            • morpheus.messages.memory.tensor_memory.TensorMemory
        • morpheus.messages.message_base
          • morpheus.messages.message_base.MessageBase
          • morpheus.messages.message_base.MessageData
          • morpheus.messages.message_base.MessageImpl
        • morpheus.messages.message_meta
          • morpheus.messages.message_meta.AppShieldMessageMeta
          • morpheus.messages.message_meta.MessageMeta
          • morpheus.messages.message_meta.MutableTableCtxMgr
          • morpheus.messages.message_meta.UserMessageMeta
      • morpheus.models
      • morpheus.parsers
        • morpheus.parsers.event_parser
          • morpheus.parsers.event_parser.EventParser
        • morpheus.parsers.ip
        • morpheus.parsers.splunk_notable_parser
          • morpheus.parsers.splunk_notable_parser.SplunkNotableParser
        • morpheus.parsers.url_parser
        • morpheus.parsers.windows_event_parser
          • morpheus.parsers.windows_event_parser.WindowsEventParser
        • morpheus.parsers.zeek
      • morpheus.pipeline
        • morpheus.pipeline.boundary_stage_mixin
          • morpheus.pipeline.boundary_stage_mixin.BoundaryStageMixin
        • morpheus.pipeline.configurable_output_source
          • morpheus.pipeline.configurable_output_source.ConfigurableOutputSource
          • morpheus.pipeline.configurable_output_source.SupportedMessageTypes
        • morpheus.pipeline.control_message_stage
          • morpheus.pipeline.control_message_stage.ControlMessageStage
        • morpheus.pipeline.execution_mode_mixins
          • morpheus.pipeline.execution_mode_mixins.CpuOnlyMixin
          • morpheus.pipeline.execution_mode_mixins.GpuAndCpuMixin
        • morpheus.pipeline.linear_pipeline
          • morpheus.pipeline.linear_pipeline.LinearPipeline
        • morpheus.pipeline.pass_thru_type_mixin
          • morpheus.pipeline.pass_thru_type_mixin.PassThruTypeMixin
        • morpheus.pipeline.pipeline
          • morpheus.pipeline.pipeline.Pipeline
          • morpheus.pipeline.pipeline.PipelineState
        • morpheus.pipeline.preallocator_mixin
          • morpheus.pipeline.preallocator_mixin.PreallocatorMixin
        • morpheus.pipeline.receiver
          • morpheus.pipeline.receiver.Receiver
        • morpheus.pipeline.sender
          • morpheus.pipeline.sender.Sender
        • morpheus.pipeline.single_output_source
          • morpheus.pipeline.single_output_source.SingleOutputSource
        • morpheus.pipeline.single_port_stage
          • morpheus.pipeline.single_port_stage.SinglePortStage
        • morpheus.pipeline.source_stage
          • morpheus.pipeline.source_stage.SourceStage
        • morpheus.pipeline.stage
          • morpheus.pipeline.stage.Stage
        • morpheus.pipeline.stage_base
          • morpheus.pipeline.stage_base.StageBase
        • morpheus.pipeline.stage_decorator
          • morpheus.pipeline.stage_decorator.PreAllocatedWrappedFunctionStage
          • morpheus.pipeline.stage_decorator.WrappedFunctionSourceStage
          • morpheus.pipeline.stage_decorator.WrappedFunctionStage
        • morpheus.pipeline.stage_schema
          • morpheus.pipeline.stage_schema.PortSchema
          • morpheus.pipeline.stage_schema.StageSchema
      • morpheus.service
      • morpheus.stages
        • morpheus.stages.boundary
          • morpheus.stages.boundary.linear_boundary_stage
            • morpheus.stages.boundary.linear_boundary_stage.LinearBoundaryEgressStage
            • morpheus.stages.boundary.linear_boundary_stage.LinearBoundaryIngressStage
        • morpheus.stages.doca
          • morpheus.stages.doca.doca_convert_stage
            • morpheus.stages.doca.doca_convert_stage.DocaConvertStage
          • morpheus.stages.doca.doca_source_stage
            • morpheus.stages.doca.doca_source_stage.DocaSourceStage
        • morpheus.stages.general
          • morpheus.stages.general.buffer_stage
            • morpheus.stages.general.buffer_stage.BufferStage
          • morpheus.stages.general.delay_stage
            • morpheus.stages.general.delay_stage.DelayStage
          • morpheus.stages.general.linear_modules_source
            • morpheus.stages.general.linear_modules_source.LinearModuleSourceStage
          • morpheus.stages.general.linear_modules_stage
            • morpheus.stages.general.linear_modules_stage.LinearModulesStage
          • morpheus.stages.general.monitor_stage
            • morpheus.stages.general.monitor_stage.MonitorStage
          • morpheus.stages.general.multi_port_modules_stage
            • morpheus.stages.general.multi_port_modules_stage.MultiPortModulesStage
          • morpheus.stages.general.multi_processing_stage
            • morpheus.stages.general.multi_processing_stage.MultiProcessingBaseStage
            • morpheus.stages.general.multi_processing_stage.MultiProcessingStage
          • morpheus.stages.general.router_stage
            • morpheus.stages.general.router_stage.RouterStage
          • morpheus.stages.general.trigger_stage
            • morpheus.stages.general.trigger_stage.TriggerStage
        • morpheus.stages.inference
          • morpheus.stages.inference.identity_inference_stage
            • morpheus.stages.inference.identity_inference_stage.IdentityInferenceStage
          • morpheus.stages.inference.inference_stage
            • morpheus.stages.inference.inference_stage.InferenceStage
            • morpheus.stages.inference.inference_stage.InferenceWorker
          • morpheus.stages.inference.pytorch_inference_stage
            • morpheus.stages.inference.pytorch_inference_stage.PyTorchInferenceStage
          • morpheus.stages.inference.triton_inference_stage
            • morpheus.stages.inference.triton_inference_stage.InputWrapper
            • morpheus.stages.inference.triton_inference_stage.ResourcePool
            • morpheus.stages.inference.triton_inference_stage.ShmInputWrapper
            • morpheus.stages.inference.triton_inference_stage.TritonInOut
            • morpheus.stages.inference.triton_inference_stage.TritonInferenceStage
            • morpheus.stages.inference.triton_inference_stage.TritonInferenceWorker
        • morpheus.stages.input
          • morpheus.stages.input.appshield_source_stage
            • morpheus.stages.input.appshield_source_stage.AppShieldSourceStage
          • morpheus.stages.input.arxiv_source
            • morpheus.stages.input.arxiv_source.ArxivSource
          • morpheus.stages.input.autoencoder_source_stage
            • morpheus.stages.input.autoencoder_source_stage.AutoencoderSourceStage
          • morpheus.stages.input.azure_source_stage
            • morpheus.stages.input.azure_source_stage.AzureSourceStage
          • morpheus.stages.input.cloud_trail_source_stage
            • morpheus.stages.input.cloud_trail_source_stage.CloudTrailSourceStage
          • morpheus.stages.input.control_message_file_source_stage
            • morpheus.stages.input.control_message_file_source_stage.ControlMessageFileSourceStage
          • morpheus.stages.input.control_message_kafka_source_stage
            • morpheus.stages.input.control_message_kafka_source_stage.ControlMessageKafkaSourceStage
          • morpheus.stages.input.databricks_deltalake_source_stage
            • morpheus.stages.input.databricks_deltalake_source_stage.DataBricksDeltaLakeSourceStage
          • morpheus.stages.input.duo_source_stage
            • morpheus.stages.input.duo_source_stage.DuoSourceStage
          • morpheus.stages.input.file_source_stage
            • morpheus.stages.input.file_source_stage.FileSourceStage
          • morpheus.stages.input.http_client_source_stage
            • morpheus.stages.input.http_client_source_stage.HttpClientSourceStage
          • morpheus.stages.input.http_server_source_stage
            • morpheus.stages.input.http_server_source_stage.HttpServerSourceStage
          • morpheus.stages.input.in_memory_data_generation_stage
            • morpheus.stages.input.in_memory_data_generation_stage.InMemoryDataGenStage
          • morpheus.stages.input.in_memory_source_stage
            • morpheus.stages.input.in_memory_source_stage.InMemorySourceStage
          • morpheus.stages.input.kafka_source_stage
            • morpheus.stages.input.kafka_source_stage.AutoOffsetReset
            • morpheus.stages.input.kafka_source_stage.KafkaSourceStage
          • morpheus.stages.input.rss_source_stage
            • morpheus.stages.input.rss_source_stage.RSSSourceStage
        • morpheus.stages.output
          • morpheus.stages.output.compare_dataframe_stage
            • morpheus.stages.output.compare_dataframe_stage.CompareDataFrameStage
          • morpheus.stages.output.http_client_sink_stage
            • morpheus.stages.output.http_client_sink_stage.HttpClientSinkStage
          • morpheus.stages.output.http_server_sink_stage
            • morpheus.stages.output.http_server_sink_stage.HttpServerSinkStage
          • morpheus.stages.output.in_memory_sink_stage
            • morpheus.stages.output.in_memory_sink_stage.InMemorySinkStage
          • morpheus.stages.output.write_to_databricks_deltalake_stage
            • morpheus.stages.output.write_to_databricks_deltalake_stage.DataBricksDeltaLakeSinkStage
          • morpheus.stages.output.write_to_elasticsearch_stage
            • morpheus.stages.output.write_to_elasticsearch_stage.WriteToElasticsearchStage
          • morpheus.stages.output.write_to_file_stage
            • morpheus.stages.output.write_to_file_stage.WriteToFileStage
          • morpheus.stages.output.write_to_kafka_stage
            • morpheus.stages.output.write_to_kafka_stage.WriteToKafkaStage
        • morpheus.stages.postprocess
          • morpheus.stages.postprocess.add_classifications_stage
            • morpheus.stages.postprocess.add_classifications_stage.AddClassificationsStage
          • morpheus.stages.postprocess.add_scores_stage
            • morpheus.stages.postprocess.add_scores_stage.AddScoresStage
          • morpheus.stages.postprocess.add_scores_stage_base
            • morpheus.stages.postprocess.add_scores_stage_base.AddScoresStageBase
          • morpheus.stages.postprocess.filter_detections_stage
            • morpheus.stages.postprocess.filter_detections_stage.FilterDetectionsStage
          • morpheus.stages.postprocess.generate_viz_frames_stage
            • morpheus.stages.postprocess.generate_viz_frames_stage.GenerateVizFramesStage
          • morpheus.stages.postprocess.serialize_stage
            • morpheus.stages.postprocess.serialize_stage.SerializeStage
          • morpheus.stages.postprocess.timeseries_stage
            • morpheus.stages.postprocess.timeseries_stage.TimeSeriesStage
          • morpheus.stages.postprocess.validation_stage
            • morpheus.stages.postprocess.validation_stage.ValidationStage
        • morpheus.stages.preprocess
          • morpheus.stages.preprocess.drop_null_stage
            • morpheus.stages.preprocess.drop_null_stage.DropNullStage
          • morpheus.stages.preprocess.group_by_column_stage
            • morpheus.stages.preprocess.group_by_column_stage.GroupByColumnStage
          • morpheus.stages.preprocess.preprocess_base_stage
            • morpheus.stages.preprocess.preprocess_base_stage.PreprocessBaseStage
          • morpheus.stages.preprocess.preprocess_fil_stage
            • morpheus.stages.preprocess.preprocess_fil_stage.PreprocessFILStage
          • morpheus.stages.preprocess.preprocess_nlp_stage
            • morpheus.stages.preprocess.preprocess_nlp_stage.PreprocessNLPStage
      • morpheus.utils
        • morpheus.utils.atomic_integer
          • morpheus.utils.atomic_integer.AtomicInteger
        • morpheus.utils.column_info
          • morpheus.utils.column_info.BoolColumn
          • morpheus.utils.column_info.ColumnInfo
          • morpheus.utils.column_info.CustomColumn
          • morpheus.utils.column_info.DataFrameInputSchema
          • morpheus.utils.column_info.DateTimeColumn
          • morpheus.utils.column_info.DistinctIncrementColumn
          • morpheus.utils.column_info.IncrementColumn
          • morpheus.utils.column_info.PreparedDFInfo
          • morpheus.utils.column_info.RenameColumn
          • morpheus.utils.column_info.StringCatColumn
          • morpheus.utils.column_info.StringJoinColumn
        • morpheus.utils.compare_df
        • morpheus.utils.concat_df
        • morpheus.utils.control_message_utils
          • morpheus.utils.control_message_utils.CMDefaultFailureContextManager
        • morpheus.utils.cudf_subword_helper
          • morpheus.utils.cudf_subword_helper.Feature
        • morpheus.utils.directory_watcher
          • morpheus.utils.directory_watcher.DirectoryWatcher
        • morpheus.utils.downloader
          • morpheus.utils.downloader.DownloadMethods
          • morpheus.utils.downloader.Downloader
        • morpheus.utils.env_config_value
          • morpheus.utils.env_config_value.EnvConfigValue
          • morpheus.utils.env_config_value.EnvConfigValueSource
        • morpheus.utils.execution_chain
          • morpheus.utils.execution_chain.ExecutionChain
        • morpheus.utils.file_utils
        • morpheus.utils.http_utils
          • morpheus.utils.http_utils.HTTPMethod
          • morpheus.utils.http_utils.HttpParseResponse
          • morpheus.utils.http_utils.MimeTypes
        • morpheus.utils.loader_ids
        • morpheus.utils.loader_utils
        • morpheus.utils.logger
          • morpheus.utils.logger.LogLevels
          • morpheus.utils.logger.TqdmLoggingHandler
        • morpheus.utils.logging_timer
          • morpheus.utils.logging_timer.LogTimeInfo
        • morpheus.utils.module_ids
        • morpheus.utils.module_utils
          • morpheus.utils.module_utils.ModuleLoader
          • morpheus.utils.module_utils.ModuleLoaderFactory
        • morpheus.utils.monitor_utils
          • morpheus.utils.monitor_utils.MorpheusTqdm
          • morpheus.utils.monitor_utils.MorpheusTqdmMonitor
          • morpheus.utils.monitor_utils.SilentMorpheusTqdm
        • morpheus.utils.onnx_to_trt
        • morpheus.utils.producer_consumer_queue
          • morpheus.utils.producer_consumer_queue.AsyncIOProducerConsumerQueue
          • morpheus.utils.producer_consumer_queue.ProducerConsumerQueue
        • morpheus.utils.schema_transforms
        • morpheus.utils.seed
        • morpheus.utils.shared_process_pool
          • morpheus.utils.shared_process_pool.CancellationToken
          • morpheus.utils.shared_process_pool.PoolStatus
          • morpheus.utils.shared_process_pool.SharedProcessPool
          • morpheus.utils.shared_process_pool.SimpleFuture
          • morpheus.utils.shared_process_pool.Task
        • morpheus.utils.sql_utils
          • morpheus.utils.sql_utils.SQLUtils
        • morpheus.utils.type_aliases
        • morpheus.utils.type_utils
    • morpheus_dfp
      • morpheus_dfp.stages
        • morpheus_dfp.stages.dfp_file_batcher_stage
          • morpheus_dfp.stages.dfp_file_batcher_stage.DFPFileBatcherStage
          • morpheus_dfp.stages.dfp_file_batcher_stage.TimestampFileObj
        • morpheus_dfp.stages.dfp_file_to_df
          • morpheus_dfp.stages.dfp_file_to_df.DFPFileToDataFrameStage
        • morpheus_dfp.stages.dfp_postprocessing_stage
          • morpheus_dfp.stages.dfp_postprocessing_stage.DFPPostprocessingStage
        • morpheus_dfp.stages.dfp_preprocessing_stage
          • morpheus_dfp.stages.dfp_preprocessing_stage.DFPPreprocessingStage
        • morpheus_dfp.stages.dfp_rolling_window_stage
          • morpheus_dfp.stages.dfp_rolling_window_stage.DFPRollingWindowStage
        • morpheus_dfp.stages.dfp_split_users_stage
          • morpheus_dfp.stages.dfp_split_users_stage.DFPSplitUsersStage
        • morpheus_dfp.stages.dfp_viz_postproc
          • morpheus_dfp.stages.dfp_viz_postproc.DFPVizPostprocStage
        • morpheus_dfp.stages.multi_file_source
          • morpheus_dfp.stages.multi_file_source.MultiFileSource
        • morpheus_dfp.stages.write_to_s3_stage
          • morpheus_dfp.stages.write_to_s3_stage.WriteToS3Stage
      • morpheus_dfp.utils
        • morpheus_dfp.utils.cached_user_window
          • morpheus_dfp.utils.cached_user_window.CachedUserWindow
        • morpheus_dfp.utils.logging_timer
          • morpheus_dfp.utils.logging_timer.LogTimeInfo
        • morpheus_dfp.utils.module_ids
        • morpheus_dfp.utils.regex_utils
        • morpheus_dfp.utils.schema_utils
          • morpheus_dfp.utils.schema_utils.Schema
          • morpheus_dfp.utils.schema_utils.SchemaBuilder
    • morpheus_llm
      • morpheus_llm.error
      • morpheus_llm.llm
        • morpheus_llm.llm.nodes
          • morpheus_llm.llm.nodes.extracter_node
            • morpheus_llm.llm.nodes.extracter_node.ExtracterNode
            • morpheus_llm.llm.nodes.extracter_node.ManualExtracterNode
          • morpheus_llm.llm.nodes.langchain_agent_node
            • morpheus_llm.llm.nodes.langchain_agent_node.LangChainAgentNode
          • morpheus_llm.llm.nodes.llm_generate_node
            • morpheus_llm.llm.nodes.llm_generate_node.LLMGenerateNode
          • morpheus_llm.llm.nodes.prompt_template_node
            • morpheus_llm.llm.nodes.prompt_template_node.PromptTemplateNode
          • morpheus_llm.llm.nodes.rag_node
            • morpheus_llm.llm.nodes.rag_node.RAGNode
          • morpheus_llm.llm.nodes.retriever_node
            • morpheus_llm.llm.nodes.retriever_node.RetrieverNode
        • morpheus_llm.llm.services
          • morpheus_llm.llm.services.llm_service
            • morpheus_llm.llm.services.llm_service.LLMClient
            • morpheus_llm.llm.services.llm_service.LLMService
          • morpheus_llm.llm.services.nemo_llm_service
            • morpheus_llm.llm.services.nemo_llm_service.NeMoLLMClient
            • morpheus_llm.llm.services.nemo_llm_service.NeMoLLMService
          • morpheus_llm.llm.services.nvfoundation_llm_service
            • morpheus_llm.llm.services.nvfoundation_llm_service.NVFoundationLLMClient
            • morpheus_llm.llm.services.nvfoundation_llm_service.NVFoundationLLMService
          • morpheus_llm.llm.services.openai_chat_service
            • morpheus_llm.llm.services.openai_chat_service.OpenAIChatClient
            • morpheus_llm.llm.services.openai_chat_service.OpenAIChatService
          • morpheus_llm.llm.services.utils
            • morpheus_llm.llm.services.utils.langchain_llm_client_wrapper
        • morpheus_llm.llm.task_handlers
          • morpheus_llm.llm.task_handlers.simple_task_handler
            • morpheus_llm.llm.task_handlers.simple_task_handler.SimpleTaskHandler
      • morpheus_llm.modules
        • morpheus_llm.modules.output
          • morpheus_llm.modules.output.write_to_vector_db
            • morpheus_llm.modules.output.write_to_vector_db.AccumulationStats
        • morpheus_llm.modules.schemas
          • morpheus_llm.modules.schemas.write_to_vector_db_schema
            • morpheus_llm.modules.schemas.write_to_vector_db_schema.WriteToVDBSchema
      • morpheus_llm.service
        • morpheus_llm.service.vdb
          • morpheus_llm.service.vdb.faiss_vdb_service
            • morpheus_llm.service.vdb.faiss_vdb_service.FaissVectorDBResourceService
            • morpheus_llm.service.vdb.faiss_vdb_service.FaissVectorDBService
          • morpheus_llm.service.vdb.kinetica_vector_db_service
            • morpheus_llm.service.vdb.kinetica_vector_db_service.Dimension
            • morpheus_llm.service.vdb.kinetica_vector_db_service.DistanceStrategy
            • morpheus_llm.service.vdb.kinetica_vector_db_service.KineticaVectorDBResourceService
            • morpheus_llm.service.vdb.kinetica_vector_db_service.KineticaVectorDBService
          • morpheus_llm.service.vdb.milvus_client
            • morpheus_llm.service.vdb.milvus_client.MilvusClient
          • morpheus_llm.service.vdb.milvus_vector_db_service
            • morpheus_llm.service.vdb.milvus_vector_db_service.FieldSchemaEncoder
            • morpheus_llm.service.vdb.milvus_vector_db_service.MilvusVectorDBResourceService
            • morpheus_llm.service.vdb.milvus_vector_db_service.MilvusVectorDBService
          • morpheus_llm.service.vdb.utils
            • morpheus_llm.service.vdb.utils.VectorDBServiceFactory
          • morpheus_llm.service.vdb.vector_db_service
            • morpheus_llm.service.vdb.vector_db_service.VectorDBResourceService
            • morpheus_llm.service.vdb.vector_db_service.VectorDBService
      • morpheus_llm.stages
        • morpheus_llm.stages.llm
          • morpheus_llm.stages.llm.llm_engine_stage
            • morpheus_llm.stages.llm.llm_engine_stage.LLMEngineStage
        • morpheus_llm.stages.output
          • morpheus_llm.stages.output.write_to_vector_db_stage
            • morpheus_llm.stages.output.write_to_vector_db_stage.WriteToVectorDBStage
  • C++ API
    • Namespace boost
    • Namespace boost::iostreams
    • Namespace morpheus
    • Namespace morpheus::detail
    • Namespace morpheus::llm
    • Namespace morpheus::utilities
    • Namespace nlohmann
    • Struct AddClassificationStageInterfaceProxy
    • Struct AddScoresStageInterfaceProxy
    • Struct ControlMessageProxy
    • Struct CudaError
    • Struct CudfHelper
    • Struct CuDFTableUtil
    • Struct CupyUtil
    • Struct DeserializeStageInterfaceProxy
    • Struct ExponentialBackoff
    • Struct FiberQueueInterfaceProxy
    • Struct FileSourceStageInterfaceProxy
    • Struct FilterDetectionStageInterfaceProxy
    • Struct HttpEndpoint
    • Struct HttpEndpointInterfaceProxy
    • Struct HttpServerInterfaceProxy
    • Struct HttpServerSourceStageInterfaceProxy
    • Struct IDataTable
    • Struct InferenceClientStageInterfaceProxy
    • Struct InferenceMemoryFILInterfaceProxy
    • Struct InferenceMemoryInterfaceProxy
    • Struct InferenceMemoryNLPInterfaceProxy
    • Struct ITensor
    • Struct ITensorOperations
    • Struct ITensorStorage
    • Struct KafkaSourceStageInterfaceProxy
    • Struct LineInsertingFilter
    • Struct InputMap
    • Struct LLMContextState
    • Struct LLMTask
    • Struct UserInputMapping
    • Struct LoaderRegistryProxy
    • Struct LogicError
    • Struct MatxUtil
    • Struct MemoryDescriptor
    • Struct MessageMetaInterfaceProxy
    • Template Struct MonitorStageInterfaceProxy
    • Struct MutableTableInfo
    • Template Struct PreallocateStageInterfaceProxy
    • Struct PreprocessFILStageInterfaceProxy
    • Struct PreprocessNLPStageInterfaceProxy
    • Struct PyDataTable
    • Struct RawPacketMessageProxy
    • Struct ResponseMemoryInterfaceProxy
    • Struct ResponseMemoryProbsInterfaceProxy
    • Struct SerializersProxy
    • Struct SerializeStageInterfaceProxy
    • Struct StringUtil
    • Struct TableInfo
    • Struct TableInfoBase
    • Struct TableInfoData
    • Struct TensorMemoryInterfaceProxy
    • Struct TensorModelMapping
    • Struct TensorObject
    • Struct TensorObjectInterfaceProxy
    • Struct TensorUtils
    • Struct TritonInferInput
    • Struct TritonInferRequestedOutput
    • Struct TritonInOut
    • Template Struct extract_value_type
    • Template Struct extract_value_type< ClassT< T, ArgsT… > >
    • Template Struct is_specialization
    • Template Struct is_specialization< TemplateT< ArgsT… >, TemplateT >
    • Struct WriteToFileStageInterfaceProxy
    • Class AddClassificationsStage
    • Class AddScoresStage
    • Class AddScoresStageBase
    • Class ControlMessage
    • Class DataLoader
    • Class DataLoaderModule
    • Class DeserializeStage
    • Class DevMemInfo
    • Class DType
    • Template Class FactoryRegistry
    • Class FiberQueue
    • Class FileDataLoader
    • Class FileSourceStage
    • Class FilterDetectionsStage
    • Class GRPCDataLoader
    • Class HttpServer
    • Template Class HttpServerSourceStage
    • Class HttpTritonClient
    • Class IInferenceClient
    • Class IInferenceClientSession
    • Class InferenceClientStage
    • Class InferenceMemory
    • Class InferenceMemoryFIL
    • Class InferenceMemoryNLP
    • Class ITritonClient
    • Class KafkaOAuthCallback
    • Class KafkaRebalancer
    • Class KafkaSourceStage
    • Class KafkaSourceStage__Rebalancer
    • Class KafkaSourceStageStopAfter
    • Class KafkaSourceStageUnsubscribedException
    • Class LambdaLoader
    • Class Listener
    • Class LLMContext
    • Class LLMEngine
    • Template Class LLMLambdaNode
    • Class LLMNode
    • Class LLMNodeBase
    • Class LLMNodeRunner
    • Class LLMTaskHandler
    • Class LLMTaskHandlerRunner
    • Class PyLLMEngine
    • Class PyLLMEngineStage
    • Class PyLLMLambdaNode
    • Template Class PyLLMNode
    • Template Class PyLLMNodeBase
    • Class PyLLMTaskHandler
    • Class Loader
    • Class MessageMeta
    • Template Class MonitorController
    • Template Class MonitorStage
    • Class MutableTableCtxMgr
    • Class OStreamSink
    • Class PayloadDataLoader
    • Template Class PreallocateStage
    • Class PreprocessFILStage
    • Class PreprocessNLPStage
    • Class ProgressBarContextManager
    • Class RawPacketMessage
    • Class ResponseMemory
    • Class ResponseMemoryProbs
    • Class RESTDataLoader
    • Class RMMTensor
    • Class SerializeStage
    • Class SlicedMessageMeta
    • Class SourceStageStopAfter
    • Class Tensor
    • Class TensorMemory
    • Class TritonInferenceClient
    • Class TritonInferenceClientSession
    • Class json_dict_t
    • Class json_list_t
    • Class PythonByteContainer
    • Class WriteToFileStage
    • Class json_dict
    • Class json_list
    • Enum ControlMessageType
    • Enum FileTypes
    • Enum FilterSource
    • Enum TensorStorageType
    • Enum TypeId
    • Template Function morpheus::concat_message_batch
    • Template Function morpheus::detail::set_contiguous_stride
    • Function morpheus::detail::throw_cuda_error
    • Template Function morpheus::detail::validate_stride
    • Function morpheus::determine_file_type(const std::string&)
    • Function morpheus::determine_file_type(const std::filesystem::path&)
    • Function morpheus::df_to_csv(const TableInfo&, std::ostream&, bool, bool, bool)
    • Function morpheus::df_to_csv(const TableInfo&, bool, bool)
    • Function morpheus::df_to_json(const TableInfo&, std::ostream&, bool, bool)
    • Function morpheus::df_to_json(const TableInfo&, bool)
    • Function morpheus::df_to_parquet(const TableInfo&, std::ostream&, bool, bool, bool)
    • Function morpheus::df_to_parquet(const TableInfo&, bool, bool)
    • Template Function morpheus::do_register_tuple_index
    • Function morpheus::filetypes_to_str
    • Template Function morpheus::foreach_map
    • Function morpheus::get_column_names_from_table
    • Function morpheus::get_index_col_count
    • Function morpheus::get_indexers
    • Function morpheus::get_table_info_data_slice
    • Template Function morpheus::get_with_default
    • Function morpheus::llm::find_matching_input_for_placeholder
    • Function morpheus::llm::is_valid_node_name
    • Template Function morpheus::llm::make_lambda_node(std::function<ReturnT(ArgsT…)>&&)
    • Template Function morpheus::llm::make_lambda_node(FuncT&&)
    • Function morpheus::llm::process_input_names
    • Function morpheus::llm::PYBIND11_MODULE
    • Function morpheus::load_table_from_file
    • Function morpheus::make_output_message(std::shared_ptr<MessageMeta>&, control_message_task_t *, morpheus::utilities::json_t&&, std::shared_ptr<MessageMeta>&)
    • Function morpheus::make_output_message(std::shared_ptr<MessageMeta>&, control_message_task_t *, morpheus::utilities::json_t&&, std::shared_ptr<ControlMessage>&)
    • Function morpheus::make_response
    • Function morpheus::operator<<
    • Function morpheus::prepare_df_index
    • Function morpheus::proxy_table_from_table_with_metadata
    • Function morpheus::proxy_table_info_data_from_table
    • Function morpheus::PYBIND11_MODULE(common, _module)
    • Function morpheus::PYBIND11_MODULE(messages, _module)
    • Function morpheus::PYBIND11_MODULE(modules, _module)
    • Function morpheus::PYBIND11_MODULE(stages, _module)
    • Function morpheus::read_file_to_df
    • Template Function morpheus::reg_converter
    • Template Function morpheus::reg_py_type_helper
    • Template Function morpheus::register_permutations
    • Template Function morpheus::register_tuple_index
    • Function morpheus::request_headers_to_json
    • Function morpheus::set_contiguous_stride
    • Template Function morpheus::size_in_bits
    • Function morpheus::table_to_csv
    • Function morpheus::table_to_json
    • Function morpheus::table_to_parquet
    • Function morpheus::utilities::cast_from_json
    • Function morpheus::utilities::cast_from_pyobject(const pybind11::object&)
    • Function morpheus::utilities::cast_from_pyobject(const py::object&)
    • Function morpheus::utilities::cast_from_pyobject_impl
    • Function morpheus::utilities::show_warning_message
    • Template Function morpheus::write_df_to_file(const TableInfo&, const std::string&, FileTypes, ArgsT&&…)
    • Template Function morpheus::write_df_to_file(const MutableTableInfo&, const std::string&, FileTypes, ArgsT&&…)
    • Variable morpheus::DefaultMaxPayloadSize
    • Variable morpheus::RegexOptions
    • Define CHECK_CUDA
    • Define CHECK_TRITON
    • Define CUDA_TRY
    • Define MORPHEUS_CONCAT_STR
    • Define MORPHEUS_EXPECTS
    • Define MORPHEUS_FAIL
    • Define MORPHEUS_STRINGIFY
    • Define STRINGIFY_DETAIL
    • Typedef morpheus::control_message_task_t
    • Typedef morpheus::DeviceContainer
    • Typedef morpheus::llm::input_mappings_t
    • Typedef morpheus::llm::user_input_mappings_t
    • Typedef morpheus::LoaderRegistry
    • Typedef morpheus::on_complete_cb_fn_t
    • Typedef morpheus::parse_status_t
    • Typedef morpheus::payload_parse_fn_t
    • Typedef morpheus::RangeType
    • Typedef morpheus::RankType
    • Typedef morpheus::request_handler_fn_t
    • Typedef morpheus::request_queue_t
    • Typedef morpheus::request_t
    • Typedef morpheus::ShapeType
    • Typedef morpheus::table_t
    • Typedef morpheus::table_with_http_fields_t
    • Typedef morpheus::Task
    • Typedef morpheus::tcp_endpoint_t
    • Typedef morpheus::TensorIndex
    • Typedef morpheus::TensorMap
    • Typedef morpheus::TensorSize
    • Typedef morpheus::time_point_t
    • Typedef morpheus::utilities::extract_value_type_t
    • Typedef morpheus::utilities::is_specialization_v
    • Typedef morpheus::utilities::json_t
    • Typedef PyObject

Morpheus Stages

  • Stages Documentation

Morpheus Modules

  • Modules
    • Data Loader Module
    • File Batcher Module
    • File to DataFrame Module
    • Filter Control Message Module
    • Filter Detections Module
    • FromControlMessage Module
    • MLflow Model Writer Module
    • Batch Data Payload Module
    • Serialize Module
    • ToControlMessage Module
    • Write to Elasticsearch Module
    • WriteToFile Module
    • DFP Data Prep Module
    • DFP Deployment Module
    • dfp_inference_pipe
    • DFP Inference Module
    • DFP Monitor Module
    • DFP Post-processing Module
    • dfp_preproc
    • DFP Rolling Window Module
    • DFP Split Users Module
    • DFP Training Pipe Module
    • DFP Training Module
    • Pre-inference Module
    • Pre-inference Module
    • Spear Phishing Email Enrichment Module
    • Spear Phishing Inference Module
    • Inference Intent
    • Spear Phishing Email Scoring Module
    • Spear Phishing Inference Pipeline Preprocessing Module
    • Spear Phishing Sender Sketch Aggregator Module
    • SQL Sender Sketch Query Constructor Module
    • Sender Sketch Update Module

Morpheus Loaders

  • Loaders
    • File to DataFrame Loader
    • Filesystem Spec Loader
    • SQL Loader
    • REST to DataFrame Loader

Extra Information

  • Glossary of Common Morpheus Terms
  • Performance
  • Troubleshooting
  • Known Issues
  • Code of Conduct
  • License
  • Python API
  • morpheus_llm
  • morpheus_llm.llm
  • morpheus_llm.llm.services

morpheus_llm.llm.services#

Modules

llm_service

nemo_llm_service

nvfoundation_llm_service

openai_chat_service

utils

previous

morpheus_llm.llm.nodes.retriever_node.RetrieverNode

next

morpheus_llm.llm.services.llm_service
NVIDIA NVIDIA
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA.