Transcript
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Uncompressed High-Definition (HD) Video over IP and its Stereoscopic extension JongKwon Chae, JongWon Kim, *JinYong Jo Networked Media Laboratory Gwangju Institute of Science and Technology
[email protected] *KISTI
[email protected]
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Outline 1
2
3
4
Introduction Review Previous System Motivations Goals and Challenges Separated Audio Session Proposed Audio System Architectural Details Implementation Considers Experiments Ongoing works Dual-Stream Transport Stereoscopic HD Video Transport Experiments Conclusion and Future work JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Review Previous System Motivations Goals and Challenges
Review : Uncompressed HD Video transport System
Uncompressed HD Video transport System (2005) Cost effective system integration Software display Hardware display (XENA HS) JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Review Previous System Motivations Goals and Challenges
Problems About Audio... Audio/Video captured with combined form Embedded audio limits control flexibility Some hardware(AJA HDP) required to play embedded audio About High Speed Transport Requires supporting multi-link real-time high-speed transport Which can enhance throughput to support 1.5Gbps 1 GigE interfaces can not guarantee transfer rate of beyond 800Mbps using copper wire.
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Review Previous System Motivations Goals and Challenges
Goals and Challenges Split Embedded Audio and Software Play Make additional RTP stream and transmit Allows App. to request different QoS for different media Required for RTCP operations of each A/V stream High-speed dual-stream transport A mechanism to aggregate the bandwidth of dual IP links By splitting a data flow across multiple network interfaces and merging Uncompressed Stereoscopic HD transport Transmitting high quality 3D video is the useful app. JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Proposed Audio System
Figure: Split Embedded Audio and Software Display JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Architectural Details Session A set of participants and data streams flowing between participants Audio Session differs... No depth 24bit 48KHz
Figure: Audio Transport Architecture JongKwon Chae, JongWon Kim, JinYong Jo
Captured samples are time varying
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Video & Audio Capture Captured Frame Capture audio frame at that time video frame captured 29.97 audio frames sent in 1 sec send/receive ’audio frame’ makes lip sync easy
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Audio Frame Packetization
RTP Packetization for Audio Frame Timestamp : Increased by amount of samples M bit : Mark end of audio frame Payload Header : Metadata of audio frame JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Timestamp Setting Samples Per Audio Frame Audio frame captured at the same time video frame captured So, audio frame rate also 29.97 fps 48000 / 29.97 = 1601.6 (samples / frame) ”How much samples captured in a frame?” Sequence of Frame Capture (using XENA Capture card) 1600, 1600, 1605, 1600, 1600, 1605, 1600, 1600, 1606, 1600 Total samples (1601.6 x 30) = (1600 x 7 + 1605 x 2 + 1606 x 1) x 3 Set timestamp field with this captured sample count. JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Test Result
Experiment Result Path MTU 9180 & Display with H/W Bandwidth - 0.9 Gbps (8bit), 1.3 Gbps (10bit) Loss - 0.00% Jitter - 2-40 usec CPU load - sender : 56 % (8bit), 70% (10bit) - receiver : 48 % (8bit), 65% (10bit)
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Proposed Audio System Architectural Details Implementation Considers Experiments
Experiments
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Dual-Stream Transport Stereoscopic HD Video Transport Experiments
Design Issue of Dual-Stream Transport
Figure: Dual-stream transport design JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Dual-Stream Transport Stereoscopic HD Video Transport Experiments
Functional View of Components
Figure: Functional view of Dual-stream transport JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Dual-Stream Transport Stereoscopic HD Video Transport Experiments
Uncompressed Stereoscopic HD Transmission
Figure: Uncompressed Stereoscopic AV Transport
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Dual-Stream Transport Stereoscopic HD Video Transport Experiments
Experiments (Ongoing)
Figure: Uncompressed Stereoscopic AV Transport
Stereo visualized service model Real-time acquisition of stereo media Transmission procedure follows proposed system Receiver side interpret data using 3D display device JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Future directions Conclusion Supporting voice communication by adding new audio session Audio RTP session is separated from video session Dual-stream will transport media stream simultaneously across 2 GigE links Future work Frame rate adjustment Bidirectional system Error resilient, error control
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Investigation of Bidirectional Code Level Bottleneck Send and receive using only one port When capture or display the frame, driver use the same memory area. Hardware Problem Capture card operates with only one mode (send or display) when driver is loaded CPU Bottleneck Unidirectional operation occupy CPU about 50-70% Code level bottleneck makes CPU inefficiency JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
Introduction Separated Audio Session Ongoing works Conclusion and Future work
Thank you Send Inquiry to
[email protected]
JongKwon Chae, JongWon Kim, JinYong Jo
Uncompressed HD Video over IP and its Stereoscopic ext.
