mmagic.models.editors.edvr

Package Contents

Classes

EDVR	EDVR model for video super-resolution.
EDVRNet	EDVR network structure for video super-resolution.

class mmagic.models.editors.edvr.EDVR(generator, pixel_loss, train_cfg=None, test_cfg=None, init_cfg=None, data_preprocessor=None)

Bases: mmagic.models.BaseEditModel

EDVR model for video super-resolution.

EDVR: Video Restoration with Enhanced Deformable Convolutional Networks.

Parameters

• generator (dict) – Config for the generator structure.

• pixel_loss (dict) – Config for pixel-wise loss.

• train_cfg (dict) – Config for training. Default: None.

• test_cfg (dict) – Config for testing. Default: None.

• init_cfg (dict, optional) – The weight initialized config for BaseModule.

• data_preprocessor (dict, optional) – The pre-process config of BaseDataPreprocessor.

forward_train(inputs, data_samples=None)

Forward training. Returns dict of losses of training.

Parameters

• inputs (torch.Tensor) – batch input tensor collated by data_preprocessor.

• data_samples (List[BaseDataElement], optional) – data samples collated by data_preprocessor.

Returns

Dict of losses.

Return type

dict

class mmagic.models.editors.edvr.EDVRNet(in_channels, out_channels, mid_channels=64, num_frames=5, deform_groups=8, num_blocks_extraction=5, num_blocks_reconstruction=10, center_frame_idx=2, with_tsa=True, init_cfg=None)

Bases: mmengine.model.BaseModule

EDVR network structure for video super-resolution.

Now only support X4 upsampling factor. Paper: EDVR: Video Restoration with Enhanced Deformable Convolutional Networks.

Parameters

• in_channels (int) – Channel number of inputs.

• out_channels (int) – Channel number of outputs.

• mid_channels (int) – Channel number of intermediate features. Default: 64.

• num_frames (int) – Number of input frames. Default: 5.

• deform_groups (int) – Deformable groups. Defaults: 8.

• num_blocks_extraction (int) – Number of blocks for feature extraction. Default: 5.

• num_blocks_reconstruction (int) – Number of blocks for reconstruction. Default: 10.

• center_frame_idx (int) – The index of center frame. Frame counting from 0. Default: 2.

• with_tsa (bool) – Whether to use TSA module. Default: True.

• init_cfg (dict, optional) – Initialization config dict. Default: None.

forward(x)

Forward function for EDVRNet.

Parameters

x (Tensor) – Input tensor with shape (n, t, c, h, w).

Returns

SR center frame with shape (n, c, h, w).

Return type

Tensor

init_weights()

Init weights for models.