Transcript
NEC EXPRESS5800/R320b-M4 Configuration Guide Linux model
Introduction This document contains product and configuration information that will enable you to configure your system. The guide will ensure fast and proper configuration of your NEC EXPRESS5800 server.
November 2013 Revision 6.0 NEC Corporation
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Contents TECHNICAL SPECIFICATION ........................................................................................ 3 Key Features .......................................................................................................................................... 3 Specification .......................................................................................................................................... 3
EXTERNAL VIEWS ......................................................................................................... 5 Front and Rear Views ........................................................................................................................... 5 Dimensions (mm) .................................................................................................................................. 7
CONFIGURATION DIAGRAM ......................................................................................... 8 SERVER CONFIGURATION ........................................................................................... 9 1 2 3 4 5 6 7 8
Base Models ................................................................................................................................... 9 2nd Processor ................................................................................................................................ 9 Memory ........................................................................................................................................... 9 Internal Hard Disk Drives ............................................................................................................ 10 Optical Drive ................................................................................................................................. 11 PCI Card ........................................................................................................................................ 12 Other Add-in Components .......................................................................................................... 12 7.1 Input Devices ....................................................................................................................... 12 Add-on Components ................................................................................................................... 13 8.1 17-inch LCD Console Drawer .............................................................................................. 13 8.2 KVM Switch ......................................................................................................................... 13 8.3 Flash FDD............................................................................................................................ 13 8.4 Operating System ................................................................................................................ 13 8.5 Tower Conversion Kit ........................................................................................................... 14 8.6 External Tape Drives ........................................................................................................... 14
REFERENCES............................................................................................................... 16 Note for Ordering ................................................................................................................................ 16 Server Management ............................................................................................................................ 16 Supported PCI Cards and Installable Slots ...................................................................................... 17 Copyright Notice and Liability Disclaimer ........................................................................................ 17
REVISION HISTORY ..................................................................................................... 18
NEC Corporation
Revision 6.0, November 2013
2
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Technical Specification Key Features
TM
Fault tolerant technology based on GeminiArchitecture Full manageability by integrated EXPRESSSCOPE Engine 2 High performance with the latest Intel® Xeon® processor 5600 series Up to 96GB of high speed DDR3-1333 memory
Specification Model
R320b-M4
Part Number Processor
N8800-163F Type
Intel® Xeon® processor X5670
Clock speed
2.93 GHz
Logical Number of Processors Cache
1 or 2
Cores and Threads
6C / 12T
Chipset Memory
Internal Storage
Expansion Slots [free] Video
12 MB Intel® 5500 Chipset with GeminiEngine
Type
DDR3-1333 ECC Registered DIMM
Logical Standard Capacity Logical Maximum Capacity Memory protection
0GB
Standard Capacity
0GB
Maximum Capacity
4.8 TB (8 x 600GB)
Disk Controller
SAS: 3Gb/s (Standard)
RAID
SAS : RAID 1 (Standard)
Hot Plug
Supported
Optical Disk Drive
DVD Super Multi drive
Optical Drive Bays [free] Logical Disk Drive Bays [free] Standard
1 [0]
TM
96GB (12 x 8GB) ECC, x4 SDDC
1
8 [8] Total: 4 slots available 2[2] x PCIe 2.0 x4 (x8 connector) 2[2] x PCIe 1.0 x4 (x8 connector)
Controller (VRAM)
Integrated in Server Management Controller (32MB)
Resolution / Color Supported
800 x 600 / 16.7M, 1024 x 768 / 16.7M, 1280 x 1024 / 65K
Interfaces
1 x VGA (15-pin mini D-sub, 1 x rear per system) 4 x USB (1 x front, 3 x rear per system) 4 x 1000BASE-T LAN connector (1000BASE-T / 100BASE-TX / 10BASE-T, RJ-45, 2 x rear per CPU/IO module) 2 x Management LAN connector (100BASE-TX / 10BASE-T, RJ-45, 1 x rear per CPU/IO module)
Server Management
EXPRESSSCOPE Engine 2
Power Supply Power Consumption
NEC Corporation
100-240 VAC ± 10% 50 / 60 Hz ± 3 Hz (Max. Config, Operating)
1,400 VA / 1,390 Watt
Revision 6.0, November 2013
3
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
1 2 3
Model
R320b-M4
Dimensions (W x D x H )
483.0 x 736.0 x 178 mm / 19.0 x 29.0 x 7.0 in (4U)
Weight (Minimum / Maximum)
46 kg / 52 kg, 101.41 lbs. / 114.64 lbs.
Temperature, Relative Humidity (non-condensing)
Operating: 10° to 35° C / 50° to 95° F, 20 to 80% Non-Operating: -10° to 55° C / 14° to 131° F, 20 to 80%
Regulatory and Safety
FCC, CE, BSMI, CCC, UL, CB, RoHS
Operating Systems
Red Hat® Enterprise Linux® 5.5/5.6/5.7/6.1/6.2 (EM64T)
23
Writing software is not provided for this DVD drive. Xen/KVM (Kernel-based Virtual Machine) is not supported. For Red Hat® Enterprise Linux® 5.6/5.7/6.1/6.2, new version of ft Server Control Software is required. Refer to 8.4 Operating System for details.
NEC Corporation
Revision 6.0, November 2013
4
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
External Views Front and Rear Views Front View B
A
C D
E F
G
H I J
A
N
B K
L
M
P
Q
R
O
S
T
U
Legend A.
Drive Bays
L.
CPU Fault LED
B.
UID Button
M.
Memory Fault LED
C.
DVD Super Multi Drive
N.
Module Power LED
D.
System Power LED
O.
SAFE TO PULL LED
E.
System Status LED
P.
PRIMARY LED
F.
System FT LED
Q.
IO Module Fault LED Fan Fault LED
G.
UID LED
R.
H.
USB Connector
S.
PSU Fault LED
I.
Pull-out Tab
T.
DC Power Fault LED
J.
Power Button
U.
Temperature Fault LED
K.
Module ID LED
NEC Corporation
Revision 6.0, November 2013
5
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Rear View B
C
D
E
A
F
F
I
G
E
H Legend
1
A.
USB Connectors
F.
AC Inlet
B.
Management LAN Connector
G.
Serial Port Connector
C.
Module ID LED
H.
VGA Connector
D.
Data LAN Connectors
I.
PCI Slots (Full-Height)
E.
PCI Slots (Low-Profile)
1
For service personnel only.
NEC Corporation
Revision 6.0, November 2013
6
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Dimensions (mm) Rack mount
736
178
450
483 689
Tower Conversion (Optional) 220
804
592
327
NEC Corporation
Revision 6.0, November 2013
7
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Configuration Diagram Server CHASSIS REAR
CHASSIS FRONT HDD Bay
HDD Bay HDD Bay
HDD Bay
HDD Bay
HDD Bay
HDD Bay
HDD Bay HDD Bay
HDD Bay
HDD Bay HDD Bay HDD Bay
HDD Bay
HDD Bay
Backplane
CPU/IO Module
HDD Bay
Optical Drive Bay
CPU/IO Module
HDD Bay HDD Bay
Drive Cage
HDD Bay
DIMM #7 DIMM #8 DIMM #9 DIMM #10 DIMM #11 DIMM #12
PCIe 1.0 x4 (x8 socket) LP PCIe 1.0 x4 (x8 socket) LP
CHASSIS FRONT
HDD Bay
Processor
HDD Bay
PCIe 2.0 x4 (x8 socket) FH
Cooling Fan #1 - #4
Processor
PCI Riser
HDD Bay
DIMM #1 DIMM #2 DIMM #3 DIMM #4 DIMM #5 DIMM #6
HDD Bay
CHASSIS REAR
HDD Bay
CPU/IO module #0 :
Power Supply
HDD Bay HDD Bay
DIMM #7 DIMM #8 DIMM #9 DIMM #10 DIMM #11 DIMM #12
PCIe 1.0 x4 (x8 socket) LP PCIe 1.0 x4 (x8 socket) LP
HDD Bay
HDD Bay
Drive Cage HDD Bay
Processor
HDD Bay
PCIe 2.0 x4 (x8 socket) FH
Cooling Fan #1 - #4
Processor
PCI Riser
HDD Bay
DIMM #1 DIMM #2 DIMM #3 DIMM #4 DIMM #5 DIMM #6
HDD Bay
CPU/IO module #1 :
Power Supply
Legend:
NEC Corporation
Minimum required components
Revision 6.0, November 2013
Standard components
8
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Server Configuration 1 Base Models Product Name / Description
Part Number
NEC EXPRESS5800/R320b-M4 no RAM, no 2.5-inch HDD Including: Intel Xeon Processor X5670, 1 x DVD Super Multi, EXPRESSBUILDER DVD
N8800-163F
2 2nd Processor Available logical sockets: 1 Product Name / Description
Part Number
Intel® Xeon® Processor X5670 2nd Processor Kit : 2.93 GHz / 6C-12T / 12 MB, 2 processors included
N8801-043
3 Memory Available logical slots: 6 per processor Product Name / Description
Part Number
2GB DDR3-1333 REG Memory Kit : 2 x 2GB DIMM included
N8802-050
12GB DDR3-1333 REG Memory Kit : 2 x 3 x 4GB DIMM included
N8802-051
24GB DDR3-1333 REG Memory Kit : 2 x 3 x 8GB DIMM included
N8802-046
NOTE:
Minimum one memory kit must be installed. For RHEL6.1 and 6.2, at least 4GB of logical main memory is required.
Memory Configuration Guideline See the table below for the number of memory kits required in accordance with logical main memory size and number of logical processors. Memory configurations which are not listed below are not supported in the system.
Number of Logical Processors
1
Logical Main Memory Size
2GB
12GB
24GB
2GB
1
-
-
4GB
2
-
-
6GB
3
-
-
8GB
4
-
-
10GB
5
-
-
12GB
6
-
-
-
1
-
-
2
-
24GB
NEC Corporation
Number of Memory Kits Required
-
-
1
36GB
-
1
1
48GB
-
-
2
Revision 6.0, November 2013
9
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Number of Logical Processors
2
Logical Main Memory Size
Number of Memory Kits Required 2GB
12GB
24GB
2GB
1
-
-
4GB
2
-
-
6GB
3
-
-
8GB
4
-
-
10GB
5
-
-
12GB
6
-
-
16GB
8
-
-
20GB
10
-
-
24GB
12
-
-
-
2
-
36GB
6
2
-
48GB
-
4
-
-
-
2
72GB
-
2
2
96GB
-
-
4
4 Internal Hard Disk Drives Available bays: 8 Product Name / Description
Part Number
146.5GB 10K Hot Plug 2.5-inch SAS HDD : 1 x 146.5GB
N8850-042
300GB 10K Hot Plug 2.5-inch SAS HDD : 1 x 300GB
N8850-043
600GB 10K Hot Plug 2.5-inch SAS HDD : 1 x 600GB
N8850-044
73.2GB 15K Hot Plug 2.5-inch SAS HDD : 1 x 73.2GB
N8850-045
146.5GB 15K Hot Plug 2.5-inch SAS HDD : 1 x 146.5GB
N8850-046
NOTE: Hard drives must be installed in identical pairs to configure RAID 1.
NEC Corporation
Revision 6.0, November 2013
10
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Required System Disk Capacity Required system disk capacity depends on the partition configuration pattern and memory size. Refer to the tables below for HDD requirements. For example, pattern 1 with 24GB memory requires 146.5GB or larger capacity HDD and pattern 3 with 96GB memory requires 300GB HDD. It is recommended to install hard drives providing the minimum required system disk capacity to reduce the time to resynchronize after a hard drive replacement. Setting Pattern Partition 1
2
3
1
File system
Size
/boot
ext3
256MB
/var/crash
ext3
33GB
/
ext3
15GB
swap
swap
4 to 96GB
Free area
-
Remaining
/boot
ext3
256MB
/var/crash
ext3
33GB
/
ext3
15GB
swap
swap
4 to 96GB
/home
ext3
Remaining
/boot
ext3
256MB
/var/crash
ext3
33GB
/
ext3
Remaining
swap
swap
4 to 96GB
1
1
1
Below 32GB: Memory size + 2GB, Over 32GB: Memory size
Pattern
Memory Size
Required System Disk Capacity
1, 2
Up to 20GB 24GB to 48GB 72GB to 96GB Up to 24GB 36GB to 72GB 96GB
73.2GB 146.5GB 300GB 73.2GB 146.5GB 300GB
3
5 Optical Drive Available bays: 1 Product Name / Description
Part Number
Internal DVD Super Multi Drive : 1 x DVD Super Multi drive, not including writing software
(Standard)
NEC Corporation
Revision 6.0, November 2013
11
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
6 PCI Card Category
Product Name / Description
Part Number
LAN Controller
1000BASE-T 2ch board kit : 2 x GbE NIC Intel Gigabit ET Dual Port Server Adapter Fibre Channel board kit (8Gbps) : 2 x FC Controller QLogic QLE2560-SP 8Gbps Fibre Channel Adapters SAS Controller : 1 x SAS Controller LSI SAS3442E-R Host Bus Adapter NOTE: Up to one controller per module
N8804-009
Fibre Channel Controller SAS Controller
N8803-038 N8803-037
NOTE:
For supported NEC Storage products to connect with N8803-038, contact your sales representative or refer to the NEC Storage WEB site. (http://www.nec.com/global/prod/storage/)
7 Other Add-in Components 7.1 Input Devices Category
Product Name / Description
Part Number
Keyboard
USB Keyboard
N8870-002AF
Mouse
USB Optical Wheel Mouse
N8870-012
Cable
USB cable : 1.5m USB extension cable
K410-177(1A)
NEC Corporation
Revision 6.0, November 2013
12
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
8 Add-on Components 8.1 17-inch LCD Console Drawer Category Drawer
Drawer w/ KVM Switch
Cable
Drawer
Drawer w/o KVM Switch
Product Name / Description
Part Number
17inch LCD Console Unit (1U/8port) 17-inch LCD, US 83-keys Keyboard, Optical mouse, 8 port KVM switch, 1U height Switch Unit Connection Cable Set (USB, 1.8m) 1.8 m, 1 x 15-pin mini D-SUB to 1 x 15-pin mini D-SUB / 1 x 4-pin USB A Switch Unit Connection Cable Set (USB, 3m) 3 m, 1 x 15-pin mini D-SUB to 1 x 15-pin mini D-SUB / 1 x 4-pin USB A Switch Unit Connection Cable Set (USB, 5m) 5 m, 1 x 15-pin mini D-SUB to 1 x 15-pin mini D-SUB / 1 x 4-pin USB A 17inch LCD Console Unit 1U 17-inch LCD, US 83-keys Keyboard, Optical mouse, 1U height, 4-pin USB B to 4-pin USB A cable 2m, PS/2 Y-splitter cable 2m, 15-pin mini D-sub VGA cable 2m
N8143-77F
K410-118(1A)
K410-118(03)
K410-118(05)
N8143-76F
8.2 KVM Switch Category
Product Name / Description
Part Number
KVM Switch
Server Switch Unit (8 server) 1U USB 8 port KVM switch
N8191-12F
Switch Unit Connection Cable Set (USB,1.8m) 1.8 m, 1 x 15-pin mini D-sub to 1 x 15-pin mini D-sub / 1 x 4-pin USB A Switch Unit Connection Cable Set (USB,3m) 3 m, 1 x 15-pin mini D-sub to 1 x 15-pin mini D-sub / 1 x 4-pin USB A Switch Unit Connection Cable Set (USB,3m) 5 m, 1 x 15-pin mini D-sub to 1 x 15-pin mini D-sub / 1 x 4-pin USB A Switch Unit Connection Cable 1.8 m 1.8 m, 1 x 15-pin mini D-sub - 1x 15-pin mini D-Sub / 2x PS/2
K410-118(1A)
Cable
KVM
Cascading
K410-118(03)
K410-118(05)
K410-119(1A)
8.3 Flash FDD Order the Flash FDD if you need to prepare an alternative for a floppy drive. Product Name / Description
Part Number
Flash FDD USB flash emulating USB floppy disk, Native capacity 1.44 MB
N8160-86
8.4 Operating System Red Hat® Enterprise Linux® 5.5 (EM64T) is supported on the R320a/R320b series. Purchase the OS and support service from a Red Hat reseller directly. To update to Red Hat® Enterprise Linux® 5.6/5.7 (EM64T), ft Server Control Software update is also required. For Red Hat® Enterprise Linux® 6.1 (EM64T), OS clean installation with new version of ft Server Control Software is required. For Red Hat® Enterprise Linux® 6.2 (EM64T), ft Server Control Software update is also required. The ft Server Control Software and installation procedures can be downloaded at http://www.nec.com/en/global/prod/express/download/
NEC Corporation
Revision 6.0, November 2013
13
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
8.5 Tower Conversion Kit Product Name / Description
Part Number
Tower Conversion Kit 23 inch height pedestal with front bezel
N8843-003
8.6 External Tape Drives 8.6.1 Tape Drive Selection Refer to the section in accordance with your type of tape drives. LTO
LTO2
SAS
Refer to 8.6.2
LTO3
SAS
Refer to 8.6.2
LTO4
SAS
Refer to 8.6.2
8.6.2 LTO / SAS Category
Product Name / Description
Part Number
Controller Required
SAS Controller LSI SAS3442E-R Host Bus Adapter
N8803-037
External Cable Required
External SAS cable 2 m, 1 x SFF-8470 SAS to 1 x SFF-8088 Mini-SAS
K410-168(02)
Tape Enclosure Required
2U Tape Drive Enclosure 4 x 5-inch media bays, two internal SAS cables included
N8141-59F
Power Module Recommended
Power Supply 1 x non-hot plug power supply unit for redundant configuration
N8181-54F
Internal Cable Required
Internal SAS cable 2 m, for 2U Tape Drive Enclosure internal connection NOTE: Required when three or more SAS connections (including other general purpose servers) to the N8141-59F
K410-249(00)
Drive 2 bays available
Internal LTO (SAS) LTO3, Half height, Native capacity 400GB Internal LTO (SAS) LTO4, Half height, Native capacity 800GB Internal LTO (SAS) LTO5, Half height, Native capacity 1500GB Internal LTO (SAS)
N8151-102 N8151-90 N8151-103 N8151-106
LTO6, Half height, Native capacity 2.5 TB
NEC Corporation
Revision 6.0, November 2013
14
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
8.6.3 Notes for double backup In a single backup configuration, in case a CPU/IO module or backup device fails, backup is not possible until the failed part is repaired or replaced. If this does not meet your system requirements, consider a double backup configuration. Refer to the following notes on double backup configuration.
When configuring two sets of a SAS controller, a SAS cable and a backup device, two backup devices are recognized separately by the OS. When scheduling an automatic backup job, make a job for each backup device so that the other backup device can backup in case one device fails. In a double backup configuration, the device numbers of the tape devices may switch in the event of an IO module failover. When this occurs, automatic backup cannot be performed. To resolve the situation, re-enter the appropriate device settings again.
8.6.4 Supported backup software See the table below for the supported backup software on NEC EXPRESS5800/R320b. Tape drive Product Name / Description
Backup software Part Number
NetVault8.5/8.6
NetVault9.0
RHEL5.5 or later
RHEL5.5 or later
Internal LTO (SAS) LTO3, Half height, Native capacity 400 GB
N8151-102
Internal LTO (SAS) LTO4, Half height, Native capacity 800 GB
N8151-90
N8151-103
N8151-106
-
Internal LTO (SAS) LTO5, Half height, Native capacity 1.5 TB Internal LTO (SAS) LTO6, Half height, Native capacity 2.5 TB
NEC Corporation
Revision 6.0, November 2013
15
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
References Note for Ordering Part numbers provided may be needed to modify by country/region when you order the products. For example, the operable part number for N8100-1738F in EMEA is N8100-1738F-O, adding "-O", the country-specific identifier for EMEA, after the part number. Please consult your sales representative for your country identifier.
Server Management The EXPRESSSCOPE Engine 2, integrated into the server, provides superior remote control and system management features listed in the table below.
Temperature/voltage/power/ fan /degeneration (memory/hard drive)
Hardware event log collection
Boot monitoring
Booting, BIOS/POST stall, OS stall, shutdown
Alerting
HW error, Boot error and OS panic (by SNMP, E-Mail)
Remote console
POST/BIOS setup, DOS utility
(via LAN)
Panic screen, Boot screen
Text-based screen (OS console)
-
Hardware monitoring
1
GUI-based screen (OS console)
Remote control
Remote reset
-
(via LAN)
power on-off/ dump
OS shutdown
Remote media (CD/DVD/FD)
Server Management Command Line Protocol (DMTF compliant)
Remote control via Web browser (without dedicated app)
Remote batch
1
Scheduling (without UPS)
1
Others
Set automatic IP address via DNS/DHCP
Remote wakeup
Wake On LAN
Centralized management
Monitoring of multiple servers
Control of multiple servers
Industry standard
IPMI
2.0
1
DianaScope is required.
NEC Corporation
Revision 6.0, November 2013
16
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Supported PCI Cards and Installable Slots Part Number
Product Name
Slots
Notes
Slot # :
#1
#2
#3
#4
PCI Slot:
x4
x4
x4
x4
Card height:
LP
LP
FH
FH
Slot type:
x8
x8
x8
x8
N8804-009
1000BASE-T 2ch board kit
N8803-037
SAS Controller
N8803-038
Fibre Channel board kit
-
-
Max. 1
Copyright Notice and Liability Disclaimer The information contained herein is subject to change without notice. Microsoft and Windows Server are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries Intel and Xeon are registered trademarks or trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a trademark of Linus Torvalds. Red Hat is a registered trademark of Red Hat, Inc. in the U.S. All other products, brands, or trade names used in this document are trademarks or registered trademarks of their respective holders. NEC shall not be liable for technical or editorial errors or omissions contained herein. For hard drive capacity measurements, 1 GB = 1 billion bytes. Actual formatted capacity is less.
NEC Corporation
Revision 6.0, November 2013
17
CONFIGURATION GUIDE – NEC EXPRESS5800/R320b-M4 / Linux model
Revision History Revision
Date
Description
6.0
2013.11.20
New products added: Internal LTO / N8151-106 Discontinued products removed: N8151-101 Internal LTO(SAS) Others: Supported backup software matrix updated
5.1
2013.7.1
Red Hat® Enterprise Linux® 6.2 supported
5.0
2012.10.3
Red Hat® Enterprise Linux® 5.7 supported N8141-41F deleted (EOL) N8141-59F 2U Tape Drive Enclosure added N8151-77 (LTO4) deleted (EOL) Backup software support matrix added K410-119(1A) (cable for KVM switch cascading) added Description of K410-168(02) corrected
4.2
2012.5.23
SCSI Controller and related products deleted (EOL) 17-inch LCD Console Drawer and KVM Switch Part Numbers changed
4.1
2012.4.23
Keyboard Part Number corrected Mouse Part Number changed from N8170-22 to N8870-012
4.0
2011.11.25
Document form changed. Red Hat® Enterprise Linux® 5.6/6.1 supported Memory P/N changed. N8151-103 (LTO5) added in 8.6 External Tape Drives
3.0
2011.9.13
Mouse P/N corrected
2.0
2011.7.20
N8870-010A is deleted. (EOL) Supported software matrix for tape backup updated
1.0
2011.4.18
Initial release
NEC Corporation
Revision 6.0, November 2013
18