StegaNeRF: Embedding Invisible Information within Neural Radiance Fields


StegaNeRF achieves reliable recovery of hidden information with minimal impact on the NeRF rendering quality. This work offers a promising outlook on ownership identification in NeRF and calls for more attention and effort on related problems.

Abstract


Recent advances in neural rendering imply a future of widespread visual data distributions through sharing NeRF model weights. However, while common visual data (images and videos) have standard approaches to embed ownership or copyright information explicitly or subtly, the problem remains unexplored for the emerging NeRF format. We present StegaNeRF, a method for steganographic information embedding in NeRF renderings. We design an optimization framework allowing accurate hidden information extractions from images rendered by NeRF, while preserving its original visual quality. We perform experimental evaluations of our method under several potential deployment scenarios, and we further discuss the insights discovered through our analysis. StegaNeRF signifies an initial exploration into the novel problem of instilling customizable, imperceptible, and recoverable information to NeRF renderings, with minimal impact to rendered images.
TL;DR: The first framework to instill customizable, imperceptible, and recoverable information to NeRF renderings.



Left: Rendering produced by StegaNeRF. Right: Recovered hidden image from the corresponding rendered frame.

Results

Single-Scene Steganography

Applying StegaNeRF on single-scene NeRF training.

The hidden information are embedded in the rendering and can be revealed through visualizing the residual error against the rendering produced by a standard NeRF without steganographic training. Across all the rendering viewpoints, the same hidden information is robustly recovered, with only very slight variations.




Renderings

Error (5x)

Error (25x)

Recovered Signal


Multi-Scene Steganography

Applying StegaNeRF on multiple scenes at once.




Rendering

Error (5x)

Error (25x)

Recovered Signal


Multi-Modal Steganography

Applying StegaNeRF to embed multi-modal information. Please see the video below for the detailed exhibition.



Rendering

Error (25x)

Recovered Image

Recovered Audio + Text


Video

Citation