Transcript
Rick McGeer Chief Scientist, US IGNITE October 28, 2013
Making GENI Simple for Simple Things: The GENI Experiment Engine Rick McGeer, Chief Scientist, US IGNITE
GENI Experiment Lifecycle
3
GEE Experiment Lifecycle
4
Analog in Commercial World: EC2 vs Google App Engine • EC2: – Create VM(s) – Install and configure software – Deploy…
• Google App Engine – Write program – Upload
• Not magic! – When you need a VM, you need a VM… – Google App Engine is simple because it makes most decisions for you…
5
TransGeo: A Model TransCloud Application • Scalable, Ubiquitous Geographic Information System • Open and Public – Anyone can contribute layers – Anyone can host computation
• Why GIS? – – – – – –
6
Large and active community Characterized by large data sets (mostly satellite images) Much open-source easily deployable software, standard data formats Computation naturally partitions and is loosely-coupled Collaborations across geographic regions and continents Very pretty…
TransGeo Sites (May 2013)
7
TransGeo Architecture
8
Opening up TransGEO: The GENI Experiment Engine • Key Idea: Genericize and make available the infrastructure behind the TransGEO demo – Open to every GENI, FIRE, JGN-X,…experimenter who wants to use it
• TransGEO is a trivial application on a generic infrastructure – Perhaps 1000 lines of Python code on top of • • • • • •
9
Key-Value Store Layer 2 network Sandboxed Python programming environment Messaging Service Deployment Service GIS Libraries
GENI Experiment Engine McGeer, Mambretti, Bavier, Coady,
• • • • • • • • •
10
Permanent, Long-Running, Distributed File System Permanent, Long-Running, GENI-wide Message Service Permanent, Long-Running, Distributed Python Environment Permanent, world-wide Layer-2 VLANs on high-performance networks All offered in slices All shared by many experimenters Model: Google App Engine Advantage for GENI: Efficient use of resources Advantage for Experimenters: Up and running in no time
GENI Experiment Engine Architecture
11
Staged Rollout • Permanent Layer-2 Network Summer 2013 • Shared Fole System based on (Swift) Summer 2013 • First Python Users Fall 2013 • Shared Python environment Summer 2014 12