Linux

Introduction à Linux on Power
Thibaud Besson – IBM France
IBM Power Systems Specialist
Les qualités intrinsèques de Linux assurent son succès
Linux est :

Mature

Standard

Innovant
WW OS Revenue Market Share (2003-2012)
Unix
Linux
Source:
Linux est devenu critique pour nos clients
IDC Dec 2012
Don't
Don't be
be too
too busy
busy to
to innovate
innovate
Imagine : What if you could...
Reduce server sprawl ?
Gain competitive advantage with faster insights ?
Host more users ?
Reduce sofware costs ?
Gain market shares ?
Achieve your business goals with IBM POWER8
2x core performance vs x86:
Reduce HW/SW costs
1 TB of memory per socket:
Consolidate massively
4x Memory Bandwidth vs x86: Accelerate access to data
8 threads / core:
Increase throughput & users
Transactionnal Memory:
Improve Java performance
> 70 % utilisation rates:
Fully exploit your hardware
Open Source KVM, OpenStack: Capitalize on your skills
PowerLinux associe les performances de POWER
à la rentabilité de Linux
IBM Power Systems :
Linux :
fortement virtualisables,
ultra performants, donc ultra
rentables, pour les charges de
travail les plus lourdes et les plus
critiques
un système d’exploitation robuste
et évolutif, qui repose sur
l’innovation open source
• Des économies significatives
• Une stabilité et une sécurité éprouvées
• Des performances à la hauteur des attentes
• La consolidation sur Power est la plus efficace
du marché Unix/Linux
• La fiabilité de Power et PowerVM assure une
disponibilité maximale
• Le processeur Power excelle dans l’analytique
métier, la base de données et les applications
Java
PowerLinux intègre ces deux
technologies puissantes, pour
atteindre des niveaux inégalés en :
• De nombreuses opportunités d’innovation
• Efficacité
• Fiabilité
• Disponibilité
• Évolutivité
• Sécurité
• Réduction des coûts
POWER8, conçu pour traiter les données massives
Technologie: 22nm Silicon On Insulator, eDRAM, 15 niveaux de métal 650mm2
Coeurs
• 12 coeurs
• 8 Threads par coeur (SMT8)
• 8 dispatch, 10 issue, 16 exec pipe
• Enhanced prefetching
Caches
Mémoire
• L2 : 512 KB SRAM / coeur
• Jusqu'à 230 GB/s en mode soutenu
• L3 : 96 MB eDRAM partagé / chip
• Cache L4 sur les barrettes
• L4 : Jusqu'à 128 MB eDRAM offchip
Buses et Interfaces
• Topologie SMP 192-way 2 sauts multi-chemins
• Protocole de cohérence à 3 niveaux : processeur, node, système
• PCIe Gen3 intégré au chip
• CAPI (Coherent Accelerator Processor Interface)
Accélérateurs matériels
• Cryptographie
• Active Memory Expansion : compression mémoire
• Mémoire Transactionnelle
• Virtual Machine Monitor assist
• Data Move / VM Mobility
Gestion de l'énergie
• Micro-controleur de gestion de la
puissance
• Gestion de la tension d'alimentation par
coeur (VRM)
• Critical Path Monitors
7
POWER Is Designed For Superior Performance
Sandy
Bridge EP
E5-26xx
Ivy Bridge
EP
E5-26xx v2
Haswell EP
E5-26xx v3
Ivy Bridge
EX
E7-88xx v2
POWER 7+
POWER8
1.7-3.7GHz
1.7-3.7GHz
1.9-3.4 GHz
3.1-4.4 GHz
3.0-4.15 GHz
1,2*
1, 2*
1, 2*
1, 2*
1, 2, 4
1, 2, 4, 8
Cores per socket
8
12
18
15
8
12
Max Threads / sock
16
24
36
30
32
96
Max L1 Cache
32KB
32KB*
32KB*
32KB*
32KB
64KB
Max L2 Cache
256 KB
256 KB
256 KB
256 KB
256 KB
512 KB
Max L3 Cache
20 MB
30 MB
45 MB
37.5 MB
80 MB
96 MB
Max L4 Cache
0
0
0
0
0
128 MB
51.2-68.3 GB/s
68-85**
GB/s
100 – 180
GB/sec
230 - 410 GB/sec
Clock rates
SMT options
Memory Bandwidth
1.8–3.6GHz
31.4-51.2 GB/s
42.6-59.7 GB/s
x2
x3
* Intel calls this Hyper-Threading Technology (No HT and with HT)
*32KB running in “Non-RAS mode” Only 16KB in RAS mode
**85GB running in “Non-RAS mode” = dual-device error NOT supported
Gamme POWER8 Scale-Out
S812L
1 SOCKET
10 ou 12 coeurs
Max 512 Go
RHEL7.0 & 6.5 BE
RHEL 7.1 BE/ LE
S822L
S822
S814
2 SOCKETS
20 ou 24 coeurs
Max 1 To
2 SOCKETS
6,12, 10 ou 20 coeurs
Max 1 To
1 SOCKET
4, 6 ou 8 coeurs
Max 512 Go
SLES 11 SP3 BE
SLES 12 LE
14.04 LTS LE
14.10 LE
15.04 LE
S824L
2 SOCKETS
20 ou 24 coeurs
Max 1 To
8 « Jessie » LE
S824
2 SOCKETS
De 6 à 24 coeurs
Max 2 To
7.1
6.1
© 2014 IBM Corporation
7.2
7.1
Gamme POWER8 Enterprise
E870
E880
4 SOCKETS par node
4 ou 4,2 GHz
De 1 à 2 nodes
De 32 à 80 coeurs installés
De 8 à 80 coeurs activés
Max 4 To de mémoire
Maximum 800 VMs
RHEL7.0 & 6.5 BE
4 SOCKETS par node
4,35 GHz
De 1 à 2 nodes en 2014
De 1 à 4 nodes en 2015
De 32 à 192 coeurs installés
De 8 à 192 coeurs activés
Max 16 To de mémoire
Maximum 1000 VMs
SLES 11 SP3 BE
7.1
6.1
7.2
7.1
RAS – Reliability, Availability, Serviceability
Fonctions avancées
 Totalement redondé
 Coeurs dédiés Linux « IFL », à 70 PVU
 Maintenance / upgrade à chaud
 Capacity on Demand mémoire et coeurs
 Clocks redondantes
 Capacity upgrade on demand mémoire et coeurs
 Active Memory Mirroring
 Power Enterprise Processor Pools
© 2014 IBM Corporation
La performance de POWER progresse tandis que x86 régresse
Les processeurs IBM POWER améliorent leur
performance :
Par coeur +35% de POWER7+ à POWER8,

En augmentant le nombre de coeurs par chip

Les processeurs x86 régressent de 10% en
passant de Sandy Bridge à Ivy Bridge
Impact sur la facture logicielle
1 Based on generational comparisons of SW that utilizes per core pricing and 50% more cores in per system (Power: 8c POWER7 to 12c POWER8; x86:8c E5-2690 to 12c E5-2697 v2)
2 Performance is based on published x86 data and published/projected POWER8 data averaged across multiple workloads (ERP, Integer, Floating Point, Java)
Performance par coeur – POWER8 vs x86
La performance par coeur du POWER8 dépasse d'un facteur x6
La performance du x86 Xeon E5-2697 v2 en utilisation typique
•
•
•
•
Industry Standard Benchmarks
All Ivy Bridge performance numbers are IBM internal projections
and publishes where available
IBM S824 data is published/projected
x86
IBM
“Ivy Bridge”
Power S824
Intel Xeon E52697 v2
Power 8
P8 Util: 100%
P8 Util: 65%
P8 Util: 65%
@ 3.5 GHz
x86 Util: 100%
x86 Util: 40%
x86 Util: 20%
24
24
B’mark Utilization
IBM Consv.
Utilization
Typical Cust.
Utilization
2100
3585
1.7
2.8
5.5
10240
21212
2.1
3.4
6.7
SPECjbb (k JOPS)
2120
3777
1.8
2.9
5.8
SPECint_rate
1020
1750
1.7
2.8
5.6
SPECfp_rate
734
1370
1.9
3.0
6.0
11260
22543
2.0
3.3
# Cores
OLTP
ERP SAP 2-Tier
SPECjEnterprise2010
POWER8 vs x86 Core Performance Ratio
Legend :
6.5
Projected
Jusqu’à 2 fois la performance de la concurrence INTEL
ERP – SAP 2-Tier (Users)
1.9x Performance
Java SPECjEnterprise2010
(EjOPS)
2x Performance
SPECint_rate2006
1.8x Performance
Nearly
Nearly Equal
Equal
Performance
Performance with
with both
both
AIX
AIX and
and LINUX
LINUX on
on
POWER8
POWER8
AIX
Dell PowerEdge R730
E5-2699 v3
RHEL / SAP ASE
2p/36c/72t
IBM POWER S824
AIX / DB2
4p/24c/192t
Oracle Sun X4-2
2s/24c/48t
Intel Xeon Ivy Bridge
POWER S824
2s/24c/192t
IBM POWER8
Dell PowerEdge T620
2s/36c/72t
Intel Xeon Haswell
LoP (RHEL)
POWER S824
2s/24c/192t
IBM POWER8
SPECfp_rate2006
2.1x Performance
Nearly
Nearly Equal
Equal
Performance
Performance with
with both
both
AIX
AIX and
and LINUX
LINUX on
on
POWER8
POWER8
AIX
Dell PowerEdge T620
2s/36c/72t
Intel Xeon Haswell
LoP (RHEL)
POWER S824
2s/24c/192t
IBM POWER8
1)Results are based on best published results on Xeon E5-2697 v2 and E5-2699 v3 from the top 5 Intel system vendors (HP, Oracle, IBM, Dell, Fujitsu).
2)Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor
2699v3; 2.30 GHz, 256 GB memory; 16,500 SD benchmark users, running RHEL 7 and SAP ASE 16; Certification # 2014033. Source: http://www.sap.com/benchmark.
3)IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8;
3.52GHz, 512 GB memory, 21,212 SD benchmark users, running AIX® 7.1 and DB2® 10.5, Certification # 2014016. Source: http://www.sap.com/benchmark All results valid as of October 3, 2014
4)SPECjEnterprise2010 results are valid as of 9//8/2014. For more information go to http://www.specbench.org/jEnterprise2010/results/
5)SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/
Performance de MariaDB sur POWER8
Too good to be true ?
Myths busting on IBM POWER servers
Myth n°1 : are IBM POWER servers expensive ?
●
●
Ask the real question: how much do I pay to run my workloads ?
Linux-only IBM POWER servers are at the same price as Intel same
configuration
●
Cores are 2x more powerful
●
Hypervisor is very efficient
●
You can do more with less : more VM, more users, more batches, etc.
●
Open Source & Community-supported distributions / applications available
IBM Power 822L pricing comparison ($US) – vs. Ivy Bridge
Comparable
TCA
Linux on Intel
Ivy Bridge +
VMware
Vs.
Linux on
POWER8 + with
PowerVM
Server list price*
3-year warranty, on-site
Virtualization
- OTC + 3yr. 9x5 SWMA
Linux OS list price
- RHEL, 2 sockets, unlimited
guests, 9x5, 3 yr. sub./ supp.
Total list price:
(Total cost of acquisition)
Server model
Processor / cores
Configuration
Dell PowerEdge
R720
HP ProLiant
DL380 G8
IBM Power
822L
$28,366
$29,829
$29,264
$12,605
$14,068
$14,895
$10,064
$ 10,064
$9,880
VMware vSphere Enterprise 5.1
VMware vSphere Enterprise 5.1
PowerVM for IBM PowerLinux
$5,697
$5,697
$4,489
Red Hat subscription and Red
Hat support
Red Hat subscription and Red
Hat support
Red Hat subscription and IBM
support
$28,366
$29,829
$29,264
Dell R720
HP Proliant DL380p G8
IBM Power 822L
Two 2.7 GHz , E5-2697, Ivy Bridge, 12-core processors
Two 3.4 GHz POWER8, 10-core
64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port
Same memory, HDD, NIC
* Based on US pricing for s822L announced matching configuration table below. Source: hp.com, dell.com, vmware.com
IBM Power 822L comparison ($US) - Scale-Out Cloud with KVM
Comparable TCA
Dell PowerEdge
R720
HP ProLiant
DL380 G8
Linux on Intel
Ivy Bridge + KVM
Vs.
Linux on
POWER8 + KVM
$21,300
$22,763
Server list price*
$12,605
$14,068
$2,998
$ 2,998
3-year warranty, on-site
Virtualization
- 2 sockets, 3 yr. 9x5 sub./supp.
Linux OS list price
- RHEL, 2 sockets, unlimited
guests, 9x5, 3 yr. sub./ supp.
Total list price:
(Total cost of acquisition)
Server model
Processor / cores
© 2015 IBM Corporation
Configuration
KVM for Red Hat on x86 (RHEV)
$5,697
KVM for Red Hat on x86 (RHEV)
$5,697
IBM Power
822L
$22,382
$14,895
$2,998
KVM for Linux on Power
(PowerKVM)
$4,489
Red Hat subscription and Red
Hat support
Red Hat subscription and Red
Hat support
Red Hat subscription and IBM
support
$21,300
$22,763
$22,382
Dell R720
HP Proliant DL380p G8
IBM Power 822L
Two 2.7 GHz , E5-2697, Ivy Bridge, 12-core processors
Two 3.4 GHz POWER8, 10core
64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port
Same memory, HDD, NIC
Why using LAMP on POWER 8
© Copyright IBM Corporation 2014
Magento E-commerce on Turbo LAMP
on Premise Comparison
5,000 users/hour *
• 4 Dell servers
• Intel Sandy Bridge
• Open Source LAMP,
bare metal
• PHP Server,
MySQL, CentOS
PHP Server/ Magento
2s/16c 2.10 Ghz (SB) 24 GB
PHP Server/ Magento
2s/16c 2.10 Ghz (SB) 24 GB
DB / MySQL
2s/16c 2.10 Ghz (SB) 24 GB
Redis Server
1s/4c - 2.53 Ghz (Lyn) 32 GB
* @ < 2 sec response time for 86% of users
24,000 users/hour *
ZEND
Magento 1
ZEND
Magento 2
MariaDB
REDIS
PowerKVM + Ubuntu
Single Power S822L
2s/20c 3.42 Ghz 128GB
• 1 POWER8 server
• PowerKVM with PCI pass
thru
• Turbo LAMP stack
• Ubuntu, MariaDB, ZEND
• Mellanox 40GB
network
Mellanox
* @ < 2 sec. response time for > 90% of users
• TCA = $19,885
• $3.98 /user/hour
Key Advantages with Turbo LAMP on POWER8
• 53% less $$ per user / hour
• 4.8x more users per hour
• 12.5x more users per hour per core
• 4:1 less physical servers
• 2:1 less rack space
• TCA = $45,100
• $1.88 /user/hour
Solutions cibles pour PowerLinux (non exaustif)
InfoSphere
BigInsights
InfoSphere
Streams
Big Data
Données massives
Analytique
Solutions
applicatives
des éditeurs
Applications
Open Source
Explorez vos données,
découvrez de nouvelles informations,
pilotez votre entreprise avec Apache
Hadoop, la distribution Hadoop IBM
InfoSphere BigInsights, Streams,
Cognos, SPSS
Délivrez de nouveaux services plus
rapidement en déployant des logiciels
optimisés pour la plateforme PowerLinux
Déployez toutes les applications Open
Source sur la meilleure plateforme du
marché pour conjuguer innovation et
excellence technique
Myth n°2 : virtualization is different on POWER
●
KVM runs on POWER
●
POWER servers are fully OpenStack compliant
●
Ubuntu Juju / Chef / etc. runs on Linux on Power
●
MSPs are introducing POWER in their cloud
MAAS
Les hyperviseurs disponibles sur POWER8
Choix de l'Open source pour les clients
POWER8 qui ne sont pas familiers avec
PowerVM, qui virtualisent déjà avec KVM,
pour des workload linux uniquement
Q2 2014
Offre initiale
2004
Offre initiale
PowerVM est l'hyperviseur le plus performant, le plus fiable et le plus sûr du marché.
IBM continue à supporter et développer PowerVM pour AIX, Linux and IBM i
Comparaison du stack PowerVM vs PowerKVM
HMC, IVM, PowerVC, OpenStack
PowerVC, OpenStack, libvirt,
Open Source Tools
VIO Server
IO Virtualization
Linux MCP/KVM
Firmware
Phyp Firmware - Hypervisor
OPAL Firmware
Hardware
P6, P7, P8 Hardware
Managers
Guest VM Types
Host Software
Hypervisor
Hardware Abstraction
Boot services
Standalone Diagnostics
Power 8 Linux only Hardware
Myth n°3 – POWER Architecture is proprietary
and closed
POWER8 chip
POWER8 core
August 2013
Foundation Overview
March 2015
The goal of the OpenPOWER Foundation is to create
an open ecosystem, using the POWER Architecture
to share expertise, investment, and server-class intellectual
property to serve the evolving needs of customers.
L'écosystème OpenPOWER :
dense, riche, complet
Implementation / HPC / Research
System / Software / Services
I/O / Storage / Acceleration
Boards / Systems
Chip / SOC
OpenPOWER Foundation - Structure
OpenPOWER est une fondation basée sur l'architecture POWER, qui permet à une communauté ouverte
de développer des solutions innovante en mutualisant les savoirs et les compétences.
32
Parmi les premières solutions OpenPower
Plate-forme de tests Google
Chuanghe 1U/1S POWER8 Server
Cirrascale RM4950 - NVIDIA Tesla Accelerated
serveur Tyan ATX Power8
Convey's CAPI Developer Kit for Xilinx FPGAs
Codename Firestone, IBM Wistron are jointly developing using
technology from NVIDIA and Mellanox.
Suzhou PowerCore CP1
CAPI – an open invitation to innovate on POWER
Coherent Attached Processor Proxy (CAPP) in processor
• Unit on processor that extends coherency to an attached device
Coherency protocol tunneled over standard PCIe
• Eliminates the need for special I/Os and protocol logic
Enables attached device to be a peer to the processor
• Simplifies programming model between application
• Enables device to use same effective address as application running in
processor
• Eliminates the cumbersome I/O Device Driver requirements
Typical I/O Model Flow
DD Call
Copy or Pin
Source Data
MMIO Notify
Accelerator
Poll / Int
Completion
Acceleration
Flow with a Coherent Model
Shared Mem.
Notify Accelerator
Acceleration
34
Shared Memory
Completion
Copy or Unpin
Result Data
Ret. From DD
Completion
4Q ANNOUNCE: CAPI “Developer Kit” for early adopters
An invitation to innovate
Introducing the CAPI Developer Kit
CAPI card and Support documentation will be made available for early adopters
who wish to innovate custom logic / accelerator logic on an FPGA attached via CAPI
This will be an offering from OpenPOWER member Nallatech
FPGA
IBM Supplied POWER
Service Layer
Can be plugged into an
Existing Capi enabled
Tuleta system
Open space for
Customization and
innovation
AFU
35
IBM Data Engine for NoSQL - Power Solution Edition
Gagnant sur tous les tableaux
6x moins encombrant

24x moins de serveurs

Réduction de l'infrastructure

Augmentation des performances

TCA divisé par 3

La solution :
Le problème :
• Scale-out x86 servers limités en taille mémoire
• Infrastructure coûteuse, complexe
• Serveur POWER8 hébergeant l'application
Redis uni à une baie FlashSystem par CAPI
WWW
Load Balancer
24U
500GB Cache
500GB
NodeCache
500GB
NodeCache
500GB
NodeCache
1U x86
server (24)
Node
512 GB memory
WWW
Power S822L/S812L
Ubuntu 14.10
4U
FlashSystem 840
2TB to 40 TB Flash
24:1 server
consolidation3
Up to 3x
lower TCA
Comment tester Linux on Power ?
●
Installez une VM sur un serveur POWER
●
Réservez une VM sur un cloud public :
●
–
OVH : www.runabove.com
–
Minicloud : http://openpower.ic.incamp.br/minicloud/index.html
Réservez une VM sur IBM PartnerWorld : Power Developpement
Plateform
●
IBM et ses partenaires peuvent prêter des serveurs à des fins de test
●
Linux Technology Center de Montpellier PoC, benchmarks, portage
●
IBM Innovation Center (IIC) Marne-La-Vallée : portage
OpenPower Foundation : un aperçu du futur
Open Compute server design and
prototype motherboard
Aaron Sullivan, senior director and
distinguished engineer, infrastructure
strategy at Rackspace, pictured here
at the OCP U.S. Summit, shows off an
Open Compute server design and
prototype motherboard ahead of the
first ever OpenPOWER Summit. The
system is a new design by Rackspace
and its OCP partners that combines
the OpenPOWER, POWER8, and
Open Compute design principles,
targeted to run OpenStack services.
IBM Memory Technology Innovation Utilizing Altera FPGAs
Collaborators: IBM, Altera
IBM is working with partners across the industry to innovate on the Power memory bus. Utilizing
an Altera FPGA, the Con Tutto card enables in-system experimentation with new memory
technologies as well as combinations of Flash and DRAM. Additionally, acceleration
prototyping on the POWER memory bus is explored.
NVLINK remplacera PCIE Gen3
Le développement du POWER9 a démarré
Each [Summit] node will contain multiple IBM POWER9 CPUs and Nvidia Volta GPUs all connected together with
NVIDIA’s high-speed NVLink. Each node will have over half a terabyte of coherent memory (high bandwidth memory
plus DDR4) addressable by all CPUs and GPUs, plus 800GB of non-volatile RAM that can be used as a burst buffer
or as extended memory. To provide a high rate of I/O throughput, the nodes will be connected in a non-blocking fat-tree
using a dual-rail Mellanox EDR InfiniBand interconnect.
Open Innovation to Put Data to Work