Video Summary - The Secret Behind Photorealistic And Stylized Graphics

Scientific concepts / nature phenomena presented

Rendering equation (historically introduced in the context of this discussion, attributed in the video to 1986):
- Outgoing light from a surface point equals:
  - emitted light + reflected light
Shading models
- Aim to approximate (or solve) the rendering equation.
- No exact general solution is feasible in real-time engines.

Incident vs outgoing light directions
- How their relationship depends on surface orientation.
Normals
- The surface “perpendicular direction.”
- The incident angle between the light direction and the normal.
Cosine law / angle-based attenuation
- Expressed using the dot product in linear algebra.

BRDF (Bidirectional Reflectance Distribution Function)
- Models how light reflects from a surface given an incoming/outgoing direction pair.
BSDF (Bidirectional Scattering Distribution Function)
- Broader umbrella that can include transmission and other scattering effects.
Global illumination
- Involves integrating over the hemisphere of incoming directions (conceptually an indefinite integral).

Transmission (e.g., glass/water)
Subsurface scattering (e.g., jade, foliage)
Polarization
Phosphorescence (delayed release of absorbed light)
Light interference (wave interference)
Fluorescence (glow ceases quickly after excitation)
Nonlinear effects (e.g., two-photon absorption—noted as requiring atomic-physics detail)
Doppler effect
- Only relevant at speeds close to the speed of light

Conservation of energy
- Outgoing light shouldn’t exceed what’s emitted/incoming.
Helmholtz reciprocity
- The BRDF should be symmetric when swapping incoming and outgoing directions.

Surfaces are modeled as many microscopic facets (microstructure).
Light reflects from microfacets; macroscopic roughness emerges from a distribution of microfacet orientations.
Key microfacet components:
- Normal distribution function (e.g., GGX or Beckmann)
- Fresnel term
  - Based on Fresnel equations / approximations (often Schlick-style approximations)
- Geometric attenuation term
  - Accounts for microfacet shadowing/masking
  - Linked to off-specular peak behavior
- Specular BRDF composition
  - Assembled from these terms using a denominator structure (per the microfacet formulation)

Constructed from multiple lobes/terms controlled by artist parameters to represent many material types.
Includes:
- Diffuse lobe
  - Disney/Burley-style diffuse (described as Fresnel-influenced)
- Subsurface approximation
  - Artist-controllable approximation; not true subsurface scattering
- Sheen
  - Grazing-angle tinted additive lobe
  - Explicitly stated to have no strict physical basis (artist parameter)
- Specular lobe (microfacet-based)
  - GGX distribution (isotropic)
  - Fresnel (Schlick approximation)
  - Smith-style geometry/attenuation
- Metallic workflow
  - Reduces diffuse for metals
  - Tints specular toward base color
- Clear coat layer
  - Extra specular lobe with its own roughness and strength

Start with the rendering equation
- Determine how much light exits a surface in a direction that becomes a pixel color.
Simplify by removing emission
- For most non-emissive surfaces, focus on reflected light.
Angle-based attenuation using cosine/dot product
- Introduce the surface normal and compute how reflection depends on angle.
Generalize from simple diffuse to BRDF/BSDF
- Use BRDF to represent different scattering behaviors per surface.
Extend to physically based specular using microfacet theory
- Choose:
  - a microfacet distribution function (GGX/Beckmann),
  - a Fresnel model (often Schlick approximation),
  - a geometry/attenuation model (shadowing/masking; Smith framework).
- Combine terms to form the specular BRDF.
Build Disney’s practical shader
- Diffuse lobe (Burley/Disney diffuse)
- Add subsurface approximation
- Add sheen
- Add GGX-based specular
- Apply metallic behavior
- Add clear coat layer
Rendering integration (real-time constraint)
- Full rendering equation requires integrating over all incoming directions (global illumination).
- For real-time, the video describes approximate indirect lighting (e.g., sampling a skybox based on surface normal).
- For offline-quality indirect lighting, it mentions path tracing.

David Imel (introduced a general equation in 1986, per the video)
James Kajiya (1986, introduced the rendering equation per the video)
Johan Lambert (named for Lambertian concepts and referenced for cosine/angle reflectance background; tied to Lambert’s 1760 work in the video)
Jim Blinn (1977) — half-vector optimization for specular (Blinn-Phong)
Brent Burley
- Disney’s physically based shading and BRDF development (SIGGRAPH 2012; extensions mentioned later)
Eric N. Hoffman / “Natty Hoffman” (named in the video)
- Referenced for “Fresnel equations considered harmful”
Kristoff Schlick (1994) — Schlick Fresnel approximation
J. C. Smith (via “Smith model” for geometry attenuation; first name not provided in the subtitle naming)
Wikipedia (cited as a style/source for dot product vs cosine presentation)
Disney / DreamWorks (studios referenced; Disney shading solution is the core focus)
Unspecified engines / games used as examples:
- God of War
- Horizon Forbidden West
- God of War Ragnarok
- Wreck-It Ralph
- Moana