Open topic with navigation
Motion Blur GL4/GLES3 Advanced Sample
This sample shows a filtering method for simulating motion blur of fast-moving objects. The method used is a 2D full-screen post-process that works on a normal framebuffer augmented with a screen-space velocity buffer; thus, filtering performance is not dependent on scene geometric complexity. The algorithm is based on the paper 'A Reconstruction Filter for Plausible Motion Blur,' by McGuire et. al. (SIGGRAPH I3D'12)
- GLSL 'texelFetch'
- GLSL 'textureSize'
Shared User Interface
The OpenGL samples all share a common app framework and certain user interface elements, centered around the "Tweakbar" panel on the left side of the screen, which lets you interactively control certain variables in each sample.
To show and hide the Tweakbar, simply click or touch the triangular button positioned in the top-left of the view.
Other controls are listed below:
This sample is an implementation of a plausible reconstruction filter for motion blur. It is a 2D multi-pass post-process implemented mostly in a GPU shader language, which has the following advantages over competing alternatives:
- Since it is a 2D post-process, it does not require significant changes to a rendering pipeline when inserting it.
- Since it does not require scene-dependent computations (other than the creation of the vertex half-velocity buffer), its performance is not tied to scene complexity, but rather to screen resolution
- For the same reasons as above, it can be used on an entire scene (as opoposed to being enabled on specific scene objects, like the "Motion Blur ES2" sample does).
- Since motion blur is computed in screen space, the motion blur effect can be made specific to what is being tracked by the camera. For example, if the virtual camera pose is attached to a moving scene object, the objects not moving in relation to the camera (i.e. the moving scene object the camera is attached to) will not be blurred, but the rest of the environment will. Conversely, if the virtual camera is attached to a stationary pose in the scene, only moving objects will be blurred.
The algorithm takes the following as inputs:
- A set of buffers (from previous render-to-framebuffer-object operations) containing the color, depth and vertex half-velocities of the objects in the scene (this is the only scene-complexity-dependent step in the algorithm, from a performance point of view).
- A maximum motion blur radius
K (suggested values around 20).
- An odd number of reconstruction filter sample taps
S (suggested values around 15).
Figure 1: Color buffer (Click to enlarge)
Figure 2: Depth buffer (Click to enlarge)
Figure 3: Half-velocity buffer (Click to enlarge)
Once the color buffer
C, depth buffer
Z and vertex half-velocity buffer
V (all of size
h) have been generated, the algorithm performs the following passes:
- Takes the vertex half-velocities
V as input.
- It is a downsampling pass: it produces a buffer of size (
h/K), where each pixel represents a tile.
- Each tile stores the dominant (i.e. highest magnitude) half-velocity for all the original values within that tile.
Figure 4: TileMax pass output (Click to enlarge)
- Takes the output of
TileMax(V) as input.
- Both input and output buffers are of size (
- Each tile's dominant half-velocity is compared against its neighbors', and it stores the highest dominant half-velocity found. This effectively "smears" the highest velocities onto other neighboring tiles.
Figure 5: NeighborMax pass output (Click to enlarge)
Final gathering (reconstruction) pass:
- It takes
NeighborMax as inputs.
- Its output goes directly to the default framebuffer (or to other post-processes, if appropriate), using the entire screen size.
- Each output pixel is blurred in the direction of the dominant half-velocity for its tile (obtained from
NeighborMax). This is done by selecting S pixels in a pseudorandom fashion along that dominant half-velocity, and the selected pixel is then weighted against the current one. This weighing takes into account depth differences and ordering (by consulting
Figure 6: Final reconstruction pass output (Click to enlarge)
Using our sample implementation
In addition to the shared controls above, the following items have been added to the TweakBar:
- Pause Animation: Pauses the windmill sails' movement (though it still allows for motion blur to be computed and displayed).
- Sky Box: Toggles the skybox on and off.
- Sail Speed: Changes the angular speed of the windmill sails.
- Exposure Fraction: Changes the exposure (fraction of a frame that represents the amount of time the camerais receiving light, thus creating motion blur).
- Maximum Motion Blur Radius: Number of tiles created in
TileMax pass (
- Reconstruction Sample Taps: Number of sample taps obtained along the dominant half-velocity of the tile for a single output pixel (
- Render Options: Selects a specific buffer visualizations to be rendered. Available: "Color only", "Depth only", "Velocity", "TileMax", "NeighborMax", "Gather (final result)", and "MotionBlurES2".
Implementation details and observations
NeighborMax need to be scaled and biased (from range [-1.0, 1.0] to [0.0, 1.0]) for storage in buffers.
- Color and depth texture generation can easily be implemented in the same render-to-FBO pass by using the appropriate FBO attachments; using Multiple Render Targets (MRT) can also yield the vertex half-velocity texture in the same pass (not currently implemented in our sample).
NVIDIA® GameWorks™ Documentation Rev. 1.0.200608 ©2014-2020. NVIDIA Corporation. All Rights Reserved.