Data Structures

Module: polygraphy.common

class TensorMetadata(dct=None)[source]

Bases: polygraphy.common.interface.TypedDict.<locals>.Interface

An OrderedDict[str, MetadataTuple] that maps input names to their data types and shapes.

Shapes may include negative values, None, or strings to indicate dynamic dimensions.

Example:

shape = tensor_meta["input0"].shape
dtype = tensor_meta["input0"].dtype
static from_feed_dict(feed_dict)[source]

Constructs a new TensorMetadata using information from the provided feed_dict.

Parameters

feed_dict (OrderedDict[str, numpy.ndarray]) – A mapping of input tensor names to corresponding input NumPy arrays.

Returns

TensorMetadata

add(name, dtype, shape)[source]

Convenience function for adding entries.

Parameters

  • name (str) – The name of the input.

  • dtype (numpy.dtype) – The data type of the input.

  • shape (Sequence[Union[int, str]]]) – The shape of the input. Dynamic dimensions may be indicated by negative values, None, or a string.

Returns

The newly added entry.

class FormattedArray(array, shape, dtype)[source]

Bases: object

[EXPERIMENTAL, UNTESTED] This API is experimental and untested and may be significantly modified in future releases. Use with caution!

Representes an array whose semantic shape differs from its physical size in memory.

For example, consider an NCHW tensor of shape (1, 3, 28, 28). If we use a vectorized format like N(C/4)HW4, then the physical size of the array would be (1, 1, 28, 28 * 4) since the channel dimension would be padded to a multiple of 4. However, we still need a way to keep track of the semantic shape for things like shape inference.

This class provides a mechanism to specify the shape and dtype of an array independently of the underlying array.

Parameters

  • array (Union[np.ndarray, polygraphy.cuda.DeviceView]) – The array. In most cases, this will be a raw byte-array.

  • shape (Sequence[int]) – The semantic shape of the data.

  • dtype (np.dtype) – The data type.

static from_json(src)

Decode a JSON object and create an instance of this class.

Parameters

src (str) – The JSON representation of the object

Returns

The decoded instance

Return type

FormattedArray

Raises

PolygraphyException – If the JSON cannot be decoded to an instance of FormattedArray

static load(src)

Loads an instance of this class from a JSON file.

Parameters

src (Union[str, file-like]) – The path or file-like object to read from.

Returns

The decoded instance

Return type

FormattedArray

Raises

PolygraphyException – If the JSON cannot be decoded to an instance of FormattedArray

save(dest)

Encode this instance as a JSON object and save it to the specified path or file-like object.

Parameters

dest (Union[str, file-like]) – The path or file-like object to write to.

to_json()

Encode this instance as a JSON object.

Returns

A JSON representation of this instance.

Return type

str