Transcript
High-Definition Video Streaming in Environmental and Ecological Research Shi-Wei Lo, Sun-In Lin, Yi-Haur Shiau, Hsiu-Mei Chou, Yi-Hsuan Chen, Jia-Shin Cheng, Kuo-Tai Tseng, Fang-Pang Lin TDW Team, National Center for High-performance Computing, Taiwan DATE : 2009/10/28
Basic Concept of Video Streaming - Downloading (pre-recorded video) - Streaming (pre-recorded video, real time streaming) Video server/Stream Server
Network
Issue: heavy loading of streaming server, requires hi-end machine 2
DV Streaming for the Electronic Microscope from Osaka U.
NCHC-Osaka Univ. 1st IPv6 Telescience tested 3
Group and Group Communication On-Line Information Sharing
SARS Grid
Multiple Communication
AG for EDU Grid/E-learning
Web-Based Access Grid
GIS Sensor net
4
What is the Media Grid ? A Framework for the Real-Time Video Streaming 5
Goal: Plug-n-Stream
Streaming Box @ NCHC
Thin client
Centralized streaming service
6
Functional Requirements Real time stream processing capture broadcast re-processing Multiple formats & protocols Easy to scale up Video preservation and management Users authentication authorization
7
System Blocks Diagram
8
System Blocks Diagram
9
System Blocks Diagram
10
System Blocks Diagram
11
Three-tier Architecture
12
Three-tier Architecture (1/3) Stream Receiver Unit Image Processor Image Base Navigation
Video input (Device/Interface)
Format (Tool/Stream Format)
HDV(1394)
WEB-CAM(USB)
HD/MPEG2TS DVTS/RAW DV VLC/MPEG-4
CABLE
VLC/MPEG-4
DV(1394)
(CAPTURE CARD)
VLC + FFMPEG
*HD, DVTS, and VLC are open source software
13
Distributed Stream Compression Two compression concepts have been implemented Client-Server based Reduces network bandwidth Transfers video stream to multiformats(mp4,wmv,flv,mjpeg)
Server-side based Dynamically assign the video stream to suitable servers depending on loading. Compresses the video stream to a variety of bit-rates for different network bandwidth 14
Distributed Stream Compression Client-Server based
Server-side based
15
Distributed Stream Compression Before vs. After Compression
Case: MPEG-2, 20Mbps * 2 16
Three-tier Architecture (2/3) Stream Receiver Unit Image Processor Image Base Navigation
Light Change
Divide stream into each frame slice, put it into Round-Robin Queue Event Detection, Image Retrieval …
Motion in Screen 17
Link to SRB Stream Receiver Unit Image Processor Image Base Navigation
To preserve these data in a long term requires huge amounts of storage spaces. Adapted SRB
18
Link to RBNB & DataTurbine Kenting
NCHC Display Room
Internet (2 x ADSL 512mbps)
WLAN
Relay Server
Permanen t Data Storage
DataTurbine
Analysis Video Server (On-shore)
Clients Video Camera
Video Camera
Numerical Data
RDV Viewer
VLC
Web Interfaces
19
Three-tiers Architecture (3/3) Stream Receiver Unit Image Processor Image Base Navigation
Web browser, Player, Mobile device Supports multiple display devices handy to end users. Supports HTTP,RTP,UDP
Live @ 4k TDW. NMNS, TaiChung.
View on iPhone
20
Case Study
21
Direct Streaming Application: Live Ecology Observation 22
Kenting's Coral Reefs Observatory 4 CCD cameras installed underwater. Used by researchers in NMMBA (Kenting) for coral reef studies Academia Sinica (Taipei) for fish behavioral studies
23
Overview
Water Temperature
web-based presentation interface of four underwater cameras 24
Ecology Observation in Ken-Ting
Ken-Ting 25
Underwater <-> TaiPower Coast <-> TaiPower Control Center <->TaiPower Museum <-> NCHC
26
Snapshot
Underwater <-> TaiPower Coast <-> TaiPower Control Center <->TaiPower Museum <-> NCHC
Set up underwater cameras
27
Snapshot
Underwater <-> TaiPower Coast <-> TaiPower Control Center <->TaiPower Museum <-> NCHC
Wireless AP
Outdoor Directional Antenna
< TaiPower Shore> 28
Snapshot
Underwater <-> TaiPower Coast <-> TaiPower Control Center <->TaiPower Museum <-> NCHC Outdoor Directional Antenna
29
Snapshot
Underwater <-> TaiPower Coast <-> TaiPower Control Center <->TaiPower Museum <-> NCHC
30
Snapshot
Water Temperature
web-based presentation interface of four underwater cameras 31
History Data
32
Direct Streaming Application: HD Live Ecology Observation 33
HD Observation on Land
34
Whale Shark Observation using HDV
HDV (1280x1080i) broadcasted over internet, content from NMMBA whale shark observation window 35
HD Observation in Water 1394 Repeater
Optical Fiber
Waterproof Case
HDV
36
HD Observation in Water
FLV
MJPEG
MPEG2
37WMV
HD History in Event Detection
38
Direct Streaming Application: LightPath Stream
39
4K Projector & TDW
PRAGMA14 Live @ 4k TDW. NMNS, TaiChung.
40
Live @ TDW in Calit2, UCSD. Rigged by: Sameer Tilak & Raj Singh.
40
HD from Ken-Ting @ SC08 NCHC, NMMBA, UCSD, TORI
OptIPuter
NCHC, Hsinchu NMMBA, Kenting (2G)
UCSC, San Diego SC08, Austin (1G)
Supported by Network Technology Division of NCHC, TW 41
SC2008 – LightPath Stream Video Streaming from NCHC to SC: PC_199 (67.58.33.199) : outgoing rates => 531 Mb PC_200 (67.58.33.200) : outgoing rates => 563 Mb
Supported by Network Technology Division of NCHC, TW 42
http://tdw.nchc.org.tw/ http://www.lsi.idv.tw/ http://horse.nchc.org.tw/Viz/ http://horse.nchc.org.tw/IPv6/
Thank You !! 43
