中文标题#
時空混合和增強現實體驗描述用於互動式回放
英文标题#
Spatio-Temporal Mixed and Augmented Reality Experience Description for Interactive Playback
中文摘要#
我們提出了時空混合增強現實體驗描述（MAR-ED），這是一種新的框架，用於標準化過去事件的表示，以便在用戶當前的物理空間中進行互動和自適應播放。 儘管當前的空間媒體技術主要專注於將內容作為靜態資產進行捕獲或回放，通常與觀看者的環境脫節或提供有限的互動性，但描述體驗底層語義和互動結構的方法仍缺乏深入研究。 我們提出了一種稱為 MAR-ED 的描述框架，該框架基於三個核心原語：1）事件原語用於語義場景圖表示，2）關鍵幀原語用於高效且有意義的數據訪問，以及 3）播放原語用於用戶驅動的自適應互動式播放記錄的 MAR 體驗。 所提出的 MAR-ED 框架的三階段過程的流程圖在播放期間將記錄的體驗轉換為獨特的自適應 MAR 體驗，其中其時空結構動態適應新環境，其敘述可以通過實時用戶輸入進行更改。 基於此框架，個人數字記憶和記錄的事件可以超越被動的 2D/3D 視頻，進入沉浸式的、空間集成的群體體驗，為培訓、文化遺產和互動敘事開闢新的範式，而無需複雜的、針對每個用戶的自適應渲染。
英文摘要#
We propose the Spatio-Temporal Mixed and Augmented Reality Experience Description (MAR-ED), a novel framework to standardize the representation of past events for interactive and adaptive playback in a user's present physical space. While current spatial media technologies have primarily focused on capturing or replaying content as static assets, often disconnected from the viewer's environment or offering limited interactivity, the means to describe an experience's underlying semantic and interactive structure remains underexplored. We propose a descriptive framework called MAR-ED based on three core primitives: 1) Event Primitives for semantic scene graph representation, 2) Keyframe Primitives for efficient and meaningful data access, and 3) Playback Primitives for user-driven adaptive interactive playback of recorded MAR experience. The proposed flowchart of the three-stage process of the proposed MAR-ED framework transforms a recorded experience into a unique adaptive MAR experience during playback, where its spatio-temporal structure dynamically conforms to a new environment and its narrative can be altered by live user input. Drawing on this framework, personal digital memories and recorded events can evolve beyond passive 2D/3D videos into immersive, spatially-integrated group experiences, opening new paradigms for training, cultural heritage, and interactive storytelling without requiring complex, per-user adaptive rendering.
文章页面#
PDF 获取#
抖音掃碼查看更多精彩內容