Struct FileSourceStageInterfaceProxy#

Struct Documentation#

struct FileSourceStageInterfaceProxy#

Interface proxy, used to insulate python bindings.

Public Static Functions

static std::shared_ptr<mrc::segment::Object<FileSourceStage>> init(
mrc::segment::Builder &builder,
const std::string &name,
std::string filename,
int repeat = 1,
bool filter_null = true,
std::vector<std::string> filter_null_columns = {},
pybind11::dict parser_kwargs = pybind11::dict()
)#

Create and initialize a FileSourceStage, and return the result.

Parameters:

  • builder – : Pipeline context object reference

  • name – : Name of a stage reference

  • filename – : Name of the file from which the messages will be read.

  • repeat – : Repeats the input dataset multiple times. Useful to extend small datasets for debugging.

  • parser_kwargs – : Optional arguments to pass to the file parser.

Returns:

std::shared_ptr<mrc::segment::Object<FileSourceStage>>

static std::shared_ptr<mrc::segment::Object<FileSourceStage>> init(
mrc::segment::Builder &builder,
const std::string &name,
std::filesystem::path filename,
int repeat = 1,
bool filter_null = true,
std::vector<std::string> filter_null_columns = {},
pybind11::dict parser_kwargs = pybind11::dict()
)#