core.models.multimodal.utils#

Module Contents#

Functions#

patchify_image

Patchify an image: Option 1: (C,H,W) == (3,H,W) -> (L,3patch_dimpatch_dim) Option 2: (B,C,H,W) == (B,3,H,W) -> (B,L,3patch_dimpatch_dim)

unpatchify_image

Unpatchify an image (reverse of patchify_image()): Option 1: (L,C) == (L,3patch_dimpatch_dim) -> (3,H,W) Option 2: (B,L,C) == (B,L,3patch_dimpatch_dim) -> (B,3,H,W)

API#

core.models.multimodal.utils.patchify_image(x: torch.Tensor, patch_dim: int) torch.Tensor#

Patchify an image: Option 1: (C,H,W) == (3,H,W) -> (L,3patch_dimpatch_dim) Option 2: (B,C,H,W) == (B,3,H,W) -> (B,L,3patch_dimpatch_dim)

core.models.multimodal.utils.unpatchify_image(
x: torch.Tensor,
img_H: int,
img_W: int,
patch_dim: int,
) torch.Tensor#

Unpatchify an image (reverse of patchify_image()): Option 1: (L,C) == (L,3patch_dimpatch_dim) -> (3,H,W) Option 2: (B,L,C) == (B,L,3patch_dimpatch_dim) -> (B,3,H,W)