The Khronos Group has announced the release of a glTF 2.0 extension that incorporates Gaussian splatting, a cutting-edge rendering technology. This new standard is poised to revolutionize the way 3D assets are stored and visualized, particularly in industries such as architecture, engineering, and construction (AEC), as well as infrastructure.
The announcement introduces a release candidate for the glTF 2.0 extension, known as KHR_gaussian_splatting. This step allows for comprehensive industry feedback before the standard is officially ratified, ensuring it meets the diverse needs of its users. Gaussian splatting is a significant advancement in geometry and visualization technology, supporting applications in real-time graphics, digital twins, and large-scale geospatial visualization.
Understanding Gaussian Splatting
Neil Trevett, president of the Khronos Group, explains that Gaussian splatting is a radiance field representation technique that transforms multiple 2D images into realistic 3D models. This technology is particularly useful in creating 3D point cloud data from collections of photos and videos, a process increasingly utilized in the AEC and infrastructure sectors. Cesium, a prominent visualization platform, is among those supporting Gaussian splatting.
Gaussian splats offer significant benefits for infrastructure projects, as demonstrated by Bentley’s visualization of a chemical plant. The technology is well-suited for various workflows, including:
- City-scale and corridor-scale reality capture
- Complex natural environments with vegetation and irregular geometry
- Reflective, translucent, or detail-rich urban surfaces
- Rapid field acquisition using commodity cameras, drones, or mobile devices
Broader Applications and Industry Impact
Beyond AEC and infrastructure, Gaussian splatting is gaining traction in diverse fields such as photojournalism, media and entertainment, robotics training, and cultural preservation. It is also poised to enhance 3D reality capture for social media platforms. Despite its growing adoption, techniques for generation, training, rendering, and compression are continuously evolving.
The need for standardization is critical to prevent fragmentation in this emerging technology. The Khronos Group, known for its stewardship of numerous industry standards in CAD and 3D technologies, is spearheading this initiative through its 3D Formats Working Group.
The Path to Standardization
The KHR_gaussian_splatting extension enhances the glTF 2.0 mesh primitive to represent 3D Gaussian splat datasets. It includes attributes such as position, orientation, scale, color, and opacity, along with rules for rendering splats instead of traditional triangles.
“Gaussian splatting is a transformative technology that enables realistic 3D visualization from 2D images, offering immense potential across multiple industries.” – Neil Trevett, President of the Khronos Group
This development represents a significant step forward in the standardization of 3D rendering technologies, aiming to unify industry practices and foster innovation. The Khronos Group’s commitment to developing open standards ensures that Gaussian splatting will be accessible and beneficial to a wide range of industries.
Looking Ahead
As the industry continues to provide feedback on the release candidate, the Khronos Group is poised to refine and finalize the KHR_gaussian_splatting extension. This process will ensure that the standard is robust and versatile enough to meet the evolving needs of its users.
The adoption of Gaussian splatting in glTF 2.0 marks a pivotal moment in the evolution of 3D rendering technologies. With the potential to enhance visualization capabilities across numerous sectors, this new standard is set to drive innovation and efficiency in 3D asset creation and management.
