core.models.multimodal.utils#
Module Contents#
Functions#
Patchify an image: Option 1: (C,H,W) == (3,H,W) -> (L,3patch_dimpatch_dim) Option 2: (B,C,H,W) == (B,3,H,W) -> (B,L,3patch_dimpatch_dim) |
|
Unpatchify an image (reverse of patchify_image()): Option 1: (L,C) == (L,3patch_dimpatch_dim) -> (3,H,W) Option 2: (B,L,C) == (B,L,3patch_dimpatch_dim) -> (B,3,H,W) |
API#
- core.models.multimodal.utils.patchify_image(x: torch.Tensor, patch_dim: int) torch.Tensor#
Patchify an image: Option 1: (C,H,W) == (3,H,W) -> (L,3patch_dimpatch_dim) Option 2: (B,C,H,W) == (B,3,H,W) -> (B,L,3patch_dimpatch_dim)
- core.models.multimodal.utils.unpatchify_image(
- x: torch.Tensor,
- img_H: int,
- img_W: int,
- patch_dim: int,
Unpatchify an image (reverse of patchify_image()): Option 1: (L,C) == (L,3patch_dimpatch_dim) -> (3,H,W) Option 2: (B,L,C) == (B,L,3patch_dimpatch_dim) -> (B,3,H,W)