Scalar

Source header: cuvs/preprocessing/quantize/scalar.hpp

Scalar quantizer utilities

preprocessing::quantize::scalar::params

quantizer parameters.

1
struct params { ... };

Fields

preprocessing::quantize::scalar::quantizer

Defines and stores scalar for quantisation upon training

The quantization is performed by a linear mapping of an interval in the float data type to the full range of the quantized int type.

1
template <typename T>
2
struct quantizer { ... };

Fields

preprocessing::quantize::scalar::train

Initializes a scalar quantizer to be used later for quantizing the dataset.

1
quantizer<double> train(raft::resources const& res,
2
const params params,
3
raft::device_matrix_view<const double, int64_t> dataset);

Usage example:

Parameters

Returns

quantizer<double>

Additional overload: preprocessing::quantize::scalar::train

Initializes a scalar quantizer to be used later for quantizing the dataset.

1
quantizer<double> train(raft::resources const& res,
2
const params params,
3
raft::host_matrix_view<const double, int64_t> dataset);

Usage example:

Parameters

Returns

quantizer<double>

preprocessing::quantize::scalar::transform

Applies quantization transform to given dataset

1
void transform(raft::resources const& res,
2
const quantizer<double>& quantizer,
3
raft::device_matrix_view<const double, int64_t> dataset,
4
raft::device_matrix_view<int8_t, int64_t> out);

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::transform

Applies quantization transform to given dataset

1
void transform(raft::resources const& res,
2
const quantizer<double>& quantizer,
3
raft::host_matrix_view<const double, int64_t> dataset,
4
raft::host_matrix_view<int8_t, int64_t> out);

Usage example:

Parameters

Returns

void

preprocessing::quantize::scalar::inverse_transform

Perform inverse quantization step on previously quantized dataset

1
void inverse_transform(raft::resources const& res,
2
const quantizer<double>& quantizer,
3
raft::device_matrix_view<const int8_t, int64_t> dataset,
4
raft::device_matrix_view<double, int64_t> out);

Note that depending on the chosen data types train dataset the conversion is not lossless.

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::inverse_transform

Perform inverse quantization step on previously quantized dataset

1
void inverse_transform(raft::resources const& res,
2
const quantizer<double>& quantizer,
3
raft::host_matrix_view<const int8_t, int64_t> dataset,
4
raft::host_matrix_view<double, int64_t> out);

Note that depending on the chosen data types train dataset the conversion is not lossless.

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::train

Initializes a scalar quantizer to be used later for quantizing the dataset.

1
quantizer<float> train(raft::resources const& res,
2
const params params,
3
raft::device_matrix_view<const float, int64_t> dataset);

Usage example:

Parameters

Returns

quantizer<float>

Additional overload: preprocessing::quantize::scalar::train

Initializes a scalar quantizer to be used later for quantizing the dataset.

1
quantizer<float> train(raft::resources const& res,
2
const params params,
3
raft::host_matrix_view<const float, int64_t> dataset);

Usage example:

Parameters

Returns

quantizer<float>

Additional overload: preprocessing::quantize::scalar::transform

Applies quantization transform to given dataset

1
void transform(raft::resources const& res,
2
const quantizer<float>& quantizer,
3
raft::device_matrix_view<const float, int64_t> dataset,
4
raft::device_matrix_view<int8_t, int64_t> out);

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::transform

Applies quantization transform to given dataset

1
void transform(raft::resources const& res,
2
const quantizer<float>& quantizer,
3
raft::host_matrix_view<const float, int64_t> dataset,
4
raft::host_matrix_view<int8_t, int64_t> out);

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::inverse_transform

Perform inverse quantization step on previously quantized dataset

1
void inverse_transform(raft::resources const& res,
2
const quantizer<float>& quantizer,
3
raft::device_matrix_view<const int8_t, int64_t> dataset,
4
raft::device_matrix_view<float, int64_t> out);

Note that depending on the chosen data types train dataset the conversion is not lossless.

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::inverse_transform

Perform inverse quantization step on previously quantized dataset

1
void inverse_transform(raft::resources const& res,
2
const quantizer<float>& quantizer,
3
raft::host_matrix_view<const int8_t, int64_t> dataset,
4
raft::host_matrix_view<float, int64_t> out);

Note that depending on the chosen data types train dataset the conversion is not lossless.

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::train

Initializes a scalar quantizer to be used later for quantizing the dataset.

1
quantizer<half> train(raft::resources const& res,
2
const params params,
3
raft::device_matrix_view<const half, int64_t> dataset);

Usage example:

Parameters

Returns

quantizer<half>

Additional overload: preprocessing::quantize::scalar::train

Initializes a scalar quantizer to be used later for quantizing the dataset.

1
quantizer<half> train(raft::resources const& res,
2
const params params,
3
raft::host_matrix_view<const half, int64_t> dataset);

Usage example:

Parameters

Returns

quantizer<half>

Additional overload: preprocessing::quantize::scalar::transform

Applies quantization transform to given dataset

1
void transform(raft::resources const& res,
2
const quantizer<half>& quantizer,
3
raft::device_matrix_view<const half, int64_t> dataset,
4
raft::device_matrix_view<int8_t, int64_t> out);

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::transform

Applies quantization transform to given dataset

1
void transform(raft::resources const& res,
2
const quantizer<half>& quantizer,
3
raft::host_matrix_view<const half, int64_t> dataset,
4
raft::host_matrix_view<int8_t, int64_t> out);

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::inverse_transform

Perform inverse quantization step on previously quantized dataset

1
void inverse_transform(raft::resources const& res,
2
const quantizer<half>& quantizer,
3
raft::device_matrix_view<const int8_t, int64_t> dataset,
4
raft::device_matrix_view<half, int64_t> out);

Note that depending on the chosen data types train dataset the conversion is not lossless.

Usage example:

Parameters

Returns

void

Additional overload: preprocessing::quantize::scalar::inverse_transform

Perform inverse quantization step on previously quantized dataset

1
void inverse_transform(raft::resources const& res,
2
const quantizer<half>& quantizer,
3
raft::host_matrix_view<const int8_t, int64_t> dataset,
4
raft::host_matrix_view<half, int64_t> out);

Note that depending on the chosen data types train dataset the conversion is not lossless.

Usage example:

Parameters

Returns

void