Transcript
! " # ! $ %&''(
- ! *! $ )+ 4 1 42 ! * "
! "
! " * * + ) ! 3 ! 5 " "
! " !
! " ! # $ % & & ' ! ( ) & *+, - * * %
**%
) " ! * Æ ! + * ! ! +
* , )
- " + * " .*
* " !/ +
! " * ! * ! " * ! * "
0 - " " 1 ) 2 )
" + - )! ) ) + ! , ) ) + ! * + , " * Æ !
) ! * * +
3 ! -
!" # $%
6 " + * * * ! " ! ) )+ " ) * ! )
+ ! 1 - 2 * 0 ' 4- ) + " " " , 0 4- 1+ ,042 7'8 " ! " + ,04 * )! '
" 4 !/ , + / 1, 2 , , 1, ,2 798 $ ) * + ,04 ) ! Æ ! !! +
) " ) * + " '::::: ; %::: ) + ! + $ ) ! " < " 4 * ) * ) ) * ) = ½ >4 , 1,2
$ " 5 * ) 7'E '&8 * + 3 * ) ) * ) ! 3 " ) ) ) " $ )
" ) " )
7'F8 7':8 1 2 ! * * +
" * ) ! +
5 " " )
&$& ($ , " + $ ) ($ & $ )! / * (
) + !! + !)
5 " . ! ) )! *
" '?%@ A5 +
1A 2 * "* + ) 7@8= B *
! C ! * & * '& $ & + * )! * )! + $ " &$& * + ! ! "! * ! $ + ) " !D , ) 4 + 1 42 7'98 " " " ) + 4 + )! * + " " * " ! , 4 +
! ! 5
) * "! " / + 6 ) ) )
" ! " " " + " ) +
) ! '*& $& & ($ & $
4 * " !
)G H* ! ! + ! " * +
) ! ! + ) + ! $ + " ) ) .* +)
H* " ) ! ) + !
½
(
+ *! + *
! * ! + " > <, # 7E8 # Æ ! -+ 3 ! )
! !+ ! 5 ! ) 0 , * ! "! $ $& & $$ ) * +
! " " )! # $ ! " )! + ) + " $ , ) ! " +
) !
* ! " ! $ ) *
" .* + " +) ! " + !
" " ,
0 ! Æ H*
$ , 0 7( &8 * + " + * ) ! !
" ! " " " " + ! * " +
, ) -+ ) " " *
" " ! 5
) + , $ $ , , $ ) "!
! ) + !
1 $ $ 2 * * 5 +
+ + + " 1 $&& $ 2 , - " , * 0 E MPI
MPI
* " * ! " ) - ! ) "
4 * + " + ! "
, * ) ) " + 6 " ! ! ) " ) " * " ) "
MPI
A B Collective directly connected ports
C
Process
Shared memory
Parallel application Collective distributed ports
D
Components A B
E
Visualization
C D E
Mesh Krylov solver Preconditioner Interpolation Visualization
5 )! + * 3 & " )
3 & " , +
) )! - + 5 * H* * * , "! )! 4 +
" " *
* " 3 ! + ) "
+ # $ $& & '& $&
$ , 3
* " ) ! )! + * +*
*
$ &, & ,& $& & 1 #2 7F8 ! +
" *+ E
" * * + - ) " ) + , $ " * +
! " + $ ) !
" +
* !
" ! $ ) ! "
" ) ! , ! " + ) ) ! " 6 " - > <, > $ ) ! " * ) *
B* D 0+
, 3 " ) " - ) B* D , ) ) * Æ *! " ) ! " * )
! " ,
$& $ $ 12 * +
B D * 6
- * +
" $ * " , ) * $& $ $ 1 2 ) + 6 ! ) 7%8 $ *
- ! " *! $ +
! ! " * + *
> ) + * ) + ! !
$ + ! " $ 16$2 *
" * * )! *
,
! ! ) ! )
+
$ " * ) * , " - ; 0 ! ) " + ! " ! ! " " , - " &
$ ) " " " ! " ( '(% $ *
. $ " +
" ! " " * + + ! + - ! * 5 ) + !+ ! + " + , " ) +* 0 - ! " + " " + )! * " * ! ! ) ! * / ) ! " + Æ $
) )!
Key:
Control Workstation Simulation Control GUI
Master Controller
Nexus Low Bandwidth Channel High Bandwidth Channel (Nexus and/or MPI) As Necessary
Individual Module GUI Slave Controller
One Per Virtual Cluster
MPI Communication Worker Process Shared Memory Communication Thread One Per Virtual Address Space
- .& # /$& !
&
Control Workstation (taurus.cs.utah.edu) (taurus.cs.utah.edu)
, " )
! - *! ! " " ) " +
! $ Æ )! " ! " + 1 , 2 * ! - ) ) * +
+ ! #+) $ " !
I - 7?8 ! I - Æ ) ! * + + ! " , 5 " * + /
) *
" 1 2 " + ) * * ) H -) + " ! +
! ) ! " + *
/ !
! " " +
, ! + ! ) " + * " *
+" ) +
" + 5 , - " - ! " 9 . " 1 2 * " '(% * " # , I #) < + * )
! ) $ * * E( " 5 I - 7?8 $ "
5 /
MPM GUI
Uintah PSE Master Controller Process
Nexus
VIZ GUI
SGS Prop MPM
Fire
VIZ
VIZ
DISPLAY
Uintah PSE
Nexus
Nexus
Nexus or OpenGL 1 Process Uintah PSE Slave Controller
1 Process
PSE Worker Proc
PSE Worker Proc
MPM / Fire Modules
MPM / Fire Modules
128 Processes Shared Memory Comm
Uintah PSE Slave Controller
MPI Communication
128 Processes Shared Memory Comm
128 Node SM Cluster 128 Node SM Cluster
LANL Super Computer (nirvana.lanl.gov)
Parallel Nexus
PSE Worker Proc VIZ Module
32 Processes Shared Memory Comm
32 Node SM Cluster
Utah Super Computer (rapture.cs.utah.edu)
0 .& "1
* " 5 /
+
" " " 1* - 2 * " ) ! * +
! * * ) )* " ) + " * ) ! G + " 1 "! + *!2
< ! " + * + ) + ) ) * ) " ! ) ! + " -
5 $ -+ !
" !
! + ,04 ) = ! * + !
) " ! ) " ) * H * 0 ' 4 ! " H 9
! + ! - + "
) ! + ! * ! ) +
! Keronsene Pool 15m diameter @ z=0 Ignition Source
- )+ G " + ,04 +
$ - " +
! "* "
! $ " +
* ) - 0 F $ * " " * ) )
* ) - ! " !+
Metal Pipe 1m long @ z=1m stainless steel containing HMX
CFD State Time 0
Solid State Time 0
Still Air
Still Air BC (Top, Sides)
CFD State Time t
Implicit CFD (Combustion)
Reflective BC (Bottom)
Solid State Time t
MPM (Solid Dynamics)
CFD State Time t+1 Algorithmic Coupling
0 F 6 * ! * " + " " +
$ * * ) " ) + ! * " $ * * " + ) " ! Æ *! , + ! * )
" $ * ) " " / , + / * * + ) *! + " " *
) )! ! " " $ " * - ) ! )
" ! ) + B D !
" A5 " " * ! "
$ 5
* " ) " 1 ; 2 + 5 / G) " ! "
Molecular Dyn. (HE Material)
Solid State Time t+1 Dataflow
2 & "1 .& $ $&
, * 0 F * )! ) " -
* !
* ) H ! 102 7'' '(8 ! ) ) *
12 7'%8 " " !
* ! $ " + ! +
5 + +
! $ " + ! 7'@8 " * ! 6 0 ) ! "+
" ) * $ 0 / 5
! "! / $ "! " + ) " ) ) =
" ! " - , ) " ' )
- .J ! ) $ ! )!
$ + 12 )
4 "
$ ! * 4 )! + " " ) ) +
F
0 ( $ " ! ! ! * + ,04 * ) * ! ) 4 +
" 1 2 " > ) 4
" +
1" !2 * !
6 ) + 1 " 2
) 12 * $ *
+ 1 2 " 1 ! 2
* ) ; $ * ) 1 ) " ! 2
! ) " * *
- " "
- * ? '(%+ > (::: )- ? '(% !
" " > * 0 @ $ + ! " )
) * 0 ! ) *
- " ) ) * 3 * " )
3 Processor nirvana:1 Still Air BC (Top, Sides)
Processor nirvana:2
CFD Region 1 (plus ghost cells) Time t
Still Air BC (Top, Sides)
Implicit CFD (Combustion)
Reflective BC (Bottom)
CFD Region 2 (plus ghost cells) Time t
Implicit CFD (Combustion)
CFD Region 1 Time t+1
Reflective BC (Bottom)
CFD Region 2 Time t+1
Processor nirvana:1025 Processor nirvana:1024
MPM Region 1 (plus ghost MPs) Time t
Molecular Dyn. (HE Material)
Still Air BC (Top, Sides)
MPM (Solid Dynamics)
Implicit CFD (Combustion)
MPM Region 1 Time t+1
CFD Region 1024 (plus ghost cells) Time t
Reflective BC (Bottom)
CFD Region 1024 Time t+1
Processor nirvana:1088 MPM Region 64 (plus ghost MPs) Time t
,* * ) " ! 0 F " + " * " * ) ! + ) " 0 - + 0 ) + ! ) ! ) " ) " )
)! " 4 +
" " * - * ) )! + " * ! * " " + $ " * - " # ) 5 * + 3 " * + *
)- I - +) + " " " +
Molecular Dyn. (HE Material)
MPM (Solid Dynamics)
MPM Region 64 Time t+1
3 4& #$% ! & $ $ $& & 2
$ " ! )! ) " " ! + )! ! $ " 5 + 5 " " !
) )! )G " + * ) ! "
> ! )
- ! ) +
/ "+
) * - $ " ) ! * ! ! @
E(+ 5 $ - ! ) " $ 5 + " " * + 5 " * " $ + "
* 3 + *! ! 0 -+ * ) 3 " + " ! -
! * * ! * KK 5 " 0 ) ! $ # * ) ) " +
" ! - 0 ) ! +
" I* ! *
* 4 ) + 0 * *
+ < $ + * )- > - ) ! + < * " " 0 " * * !+* <
0 + ) *
* ) " " "
3 ) ! " *! +
" ! " / " * + * " +! + 3
"
3
! 5 " * + / ! ) 5 " / " $ " )
1 " + 2 $ *
)! 1 2 " ) *
)! I - ) " " " )! # ) , ! "
) ) ) + )! ! )
) * > "! + ) ) -
" - * / ) ) * $ ! 5 "
! " * ! 5 ) * * ! "* " + ) " #
> H+ " ) = ! + * 3 " - * ! * $ * ) 0 - )
! )! " + 5 ) $
! "! *
+ 0 - *
5 ! 3 "
¾ 6 4 " * * ! "
$ * 5 * + $ " )
!
$ 4 " * + * ! * * ! - 3 " ! ! ) " + < " / * * " ) ! - " 3 %
) $ 4 ! * "
) " $ " ) )
! ) ! " ) * " *
" ) * 1 H* ; " + 2 * ) " ) " 1 $# 6 ) < 2 ) ) " *
+ ) " + , $ * ) " ) !
F , @<8
8 ' 2 : "
&
+ + / - * /-*9 0 8 % :
38 44>
6
$
=
1
1
7
8
-
7
1
>
,
>
' 2 : @ #
* 4
A=B 4>?
: 7 1 )
$ : '
-
0
+ 5 %
A B 5C > 44?
4
: 7 '-
' D
:$ $ 0 $
5 - *
&? ?/C> 44=
/
3 1 ;- 0 E $ :
$ ; $ $ %
678
J
< 9 8
;
*
> 446
$ * * )! * " >4 , 6 * + ,04 " )
" * ) 6 * !$&% '& $ & .& $ ! " " 0 '
:
( ) 44>
. $
)
+%0 1" 2 3 2 0 + * ?
2 -8
0 % 0
9$$ : ) 8 0 < $
; .
0
0 < 8 2 0
; $
1 2 F ; 0 0 -) 9 F
!!""" $ %!
+ *
0
:
:
8 6 8)
444
=
$ =/C= 445
2 H < I 0 2 $
7 8
. + + / - * ; . $
$
3 3 09
' " < $
:$ ; ) % $ %
2 $
7 9 0: ;- , -
5
1 ;- 0 0 2 < 3
: % 0 2.) 2%
? 2
445
($ /! + * /+*($
445 $
678
44>
' ()* + , -
.
' : $ 8 :
. % / (01 2 3
6
1 ;- 3 :
; $ $ %
!!# $ %! &
0 0 2 < 1 ;- 3 $ " : 2 )
; 2 2 2
$ $ E % 8 E 444
!!""" !
7 % 8
' 9
E4&&4 9 D 9) 8 446
5
G "
, 7 " D ' ; 0 #
$ C4 445
?
