Introduction à Linux on Power. Thibaud Besson IBM France IBM Power Systems Specialist

Introduction à Linux on Power Thibaud Besson IBM France IBM Power Systems Specialist

Les qualités intrinsèques de Linux assurent son succès Linux est : Mature Standard Innovant WW OS Revenue Market Share (2003-2012) Unix Linux Source: Linux est devenu critique pour nos clients IDC Dec 2012

Don't Don't be be too too busy busy to to innovate innovate

Imagine : What if you could... Reduce server sprawl? Gain competitive advantage with faster insights? Host more users? Reduce sofware costs? Gain market shares?

Achieve your business goals with IBM POWER8 2x core performance vs x86: Reduce HW/SW costs 1 TB of memory per socket: Consolidate massively 4x Memory Bandwidth vs x86: Accelerate access to data 8 threads / core: Increase throughput & users Transactionnal Memory: Improve Java performance > 70 % utilisation rates: Fully exploit your hardware Open Source KVM, OpenStack: Capitalize on your skills

PowerLinux associe les performances de POWER à la rentabilité de Linux IBM Power Systems : Linux : fortement virtualisables, ultra performants, donc ultra rentables, pour les charges de travail les plus lourdes et les plus critiques un système d exploitation robuste et évolutif, qui repose sur l innovation open source Des économies significatives Une stabilité et une sécurité éprouvées Des performances à la hauteur des attentes La consolidation sur Power est la plus efficace du marché Unix/Linux La fiabilité de Power et PowerVM assure une disponibilité maximale Le processeur Power excelle dans l analytique métier, la base de données et les applications Java PowerLinux intègre ces deux technologies puissantes, pour atteindre des niveaux inégalés en : De nombreuses opportunités d innovation Efficacité Fiabilité Disponibilité Évolutivité Sécurité Réduction des coûts

POWER8, conçu pour traiter les données massives Technologie: 22nm Silicon On Insulator, edram, 15 niveaux de métal 650mm2 Coeurs 12 coeurs 8 Threads par coeur (SMT8) 8 dispatch, 10 issue, 16 exec pipe Enhanced prefetching Caches Mémoire L2 : 512 KB SRAM / coeur Jusqu'à 230 GB/s en mode soutenu L3 : 96 MB edram partagé / chip Cache L4 sur les barrettes L4 : Jusqu'à 128 MB edram offchip Buses et Interfaces Topologie SMP 192-way 2 sauts multi-chemins Protocole de cohérence à 3 niveaux : processeur, node, système PCIe Gen3 intégré au chip CAPI (Coherent Accelerator Processor Interface) Accélérateurs matériels Cryptographie Active Memory Expansion : compression mémoire Mémoire Transactionnelle Virtual Machine Monitor assist Data Move / VM Mobility Gestion de l'énergie Micro-controleur de gestion de la puissance Gestion de la tension d'alimentation par coeur (VRM) Critical Path Monitors 7

POWER Is Designed For Superior Performance Sandy Bridge EP E5-26xx Ivy Bridge EP E5-26xx v2 Haswell EP E5-26xx v3 Ivy Bridge EX E7-88xx v2 POWER 7+ POWER8 1.7-3.7GHz 1.7-3.7GHz 1.9-3.4 GHz 3.1-4.4 GHz 3.0-4.15 GHz 1,2* 1, 2* 1, 2* 1, 2* 1, 2, 4 1, 2, 4, 8 Cores per socket 8 12 18 15 8 12 Max Threads / sock 16 24 36 30 32 96 Max L1 Cache 32KB 32KB* 32KB* 32KB* 32KB 64KB Max L2 Cache 256 KB 256 KB 256 KB 256 KB 256 KB 512 KB Max L3 Cache 20 MB 30 MB 45 MB 37.5 MB 80 MB 96 MB Max L4 Cache 0 0 0 0 0 128 MB 51.2-68.3 GB/s 68-85** GB/s 100 180 GB/sec 230-410 GB/sec Clock rates SMT options Memory Bandwidth 1.8 3.6GHz 31.4-51.2 GB/s 42.6-59.7 GB/s x2 x3 * Intel calls this Hyper-Threading Technology (No HT and with HT) *32KB running in Non-RAS mode Only 16KB in RAS mode **85GB running in Non-RAS mode = dual-device error NOT supported

Gamme POWER8 Scale-Out S812L 1 SOCKET 10 ou 12 coeurs Max 512 Go RHEL7.0 & 6.5 BE RHEL 7.1 BE/ LE S822L S822 S814 2 SOCKETS 20 ou 24 coeurs Max 1 To 2 SOCKETS 6,12, 10 ou 20 coeurs Max 1 To 1 SOCKET 4, 6 ou 8 coeurs Max 512 Go SLES 11 SP3 BE SLES 12 LE 14.04 LTS LE 14.10 LE 15.04 LE S824L 2 SOCKETS 20 ou 24 coeurs Max 1 To 8 «Jessie» LE S824 2 SOCKETS De 6 à 24 coeurs Max 2 To 7.1 6.1 2014 IBM Corporation 7.2 7.1

Gamme POWER8 Enterprise E870 E880 4 SOCKETS par node 4 ou 4,2 GHz De 1 à 2 nodes De 32 à 80 coeurs installés De 8 à 80 coeurs activés Max 4 To de mémoire Maximum 800 VMs RHEL7.0 & 6.5 BE 4 SOCKETS par node 4,35 GHz De 1 à 2 nodes en 2014 De 1 à 4 nodes en 2015 De 32 à 192 coeurs installés De 8 à 192 coeurs activés Max 16 To de mémoire Maximum 1000 VMs SLES 11 SP3 BE 7.1 6.1 7.2 7.1 RAS Reliability, Availability, Serviceability Fonctions avancées Totalement redondé Coeurs dédiés Linux «IFL», à 70 PVU Maintenance / upgrade à chaud Capacity on Demand mémoire et coeurs Clocks redondantes Capacity upgrade on demand mémoire et coeurs Active Memory Mirroring Power Enterprise Processor Pools 2014 IBM Corporation

La performance de POWER progresse tandis que x86 régresse Les processeurs IBM POWER améliorent leur performance : Par coeur +35% de POWER7+ à POWER8, En augmentant le nombre de coeurs par chip Les processeurs x86 régressent de 10% en passant de Sandy Bridge à Ivy Bridge Impact sur la facture logicielle 1 Based on generational comparisons of SW that utilizes per core pricing and 50% more cores in per system (Power: 8c POWER7 to 12c POWER8; x86:8c E5-2690 to 12c E5-2697 v2) 2 Performance is based on published x86 data and published/projected POWER8 data averaged across multiple workloads (ERP, Integer, Floating Point, Java)

Performance par coeur POWER8 vs x86 La performance par coeur du POWER8 dépasse d'un facteur x6 La performance du x86 Xeon E5-2697 v2 en utilisation typique Industry Standard Benchmarks All Ivy Bridge performance numbers are IBM internal projections and publishes where available IBM S824 data is published/projected x86 IBM Ivy Bridge Power S824 Intel Xeon E52697 v2 Power 8 P8 Util: 100% P8 Util: 65% P8 Util: 65% @ 3.5 GHz x86 Util: 100% x86 Util: 40% x86 Util: 20% 24 24 B mark Utilization IBM Consv. Utilization Typical Cust. Utilization 2100 3585 1.7 2.8 5.5 10240 21212 2.1 3.4 6.7 SPECjbb (k JOPS) 2120 3777 1.8 2.9 5.8 SPECint_rate 1020 1750 1.7 2.8 5.6 SPECfp_rate 734 1370 1.9 3.0 6.0 11260 22543 2.0 3.3 # Cores OLTP ERP SAP 2-Tier SPECjEnterprise2010 POWER8 vs x86 Core Performance Ratio Legend : 6.5 Projected

Jusqu à 2 fois la performance de la concurrence INTEL ERP SAP 2-Tier (Users) 1.9x Performance Java SPECjEnterprise2010 (EjOPS) 2x Performance SPECint_rate2006 1.8x Performance Nearly Nearly Equal Equal Performance Performance with with both both AIX AIX and and LINUX LINUX on on POWER8 POWER8 AIX Dell PowerEdge R730 E5-2699 v3 RHEL / SAP ASE 2p/36c/72t IBM POWER S824 AIX / DB2 4p/24c/192t Oracle Sun X4-2 2s/24c/48t Intel Xeon Ivy Bridge POWER S824 2s/24c/192t IBM POWER8 Dell PowerEdge T620 2s/36c/72t Intel Xeon Haswell LoP (RHEL) POWER S824 2s/24c/192t IBM POWER8 SPECfp_rate2006 2.1x Performance Nearly Nearly Equal Equal Performance Performance with with both both AIX AIX and and LINUX LINUX on on POWER8 POWER8 AIX Dell PowerEdge T620 2s/36c/72t Intel Xeon Haswell LoP (RHEL) POWER S824 2s/24c/192t IBM POWER8 1)Results are based on best published results on Xeon E5-2697 v2 and E5-2699 v3 from the top 5 Intel system vendors (HP, Oracle, IBM, Dell, Fujitsu). 2)Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory; 16,500 SD benchmark users, running RHEL 7 and SAP ASE 16; Certification # 2014033. Source: http://www.sap.com/benchmark. 3)IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD benchmark users, running AIX 7.1 and DB2 10.5, Certification # 2014016. Source: http://www.sap.com/benchmark All results valid as of October 3, 2014 4)SPECjEnterprise2010 results are valid as of 9//8/2014. For more information go to http://www.specbench.org/jenterprise2010/results/ 5)SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/

Performance de MariaDB sur POWER8

Too good to be true? Myths busting on IBM POWER servers

Myth n 1 : are IBM POWER servers expensive? Ask the real question: how much do I pay to run my workloads? Linux-only IBM POWER servers are at the same price as Intel same configuration Cores are 2x more powerful Hypervisor is very efficient You can do more with less : more VM, more users, more batches, etc. Open Source & Community-supported distributions / applications available

IBM Power 822L pricing comparison ($US) vs. Ivy Bridge Comparable TCA Linux on Intel Ivy Bridge + VMware Vs. Linux on POWER8 + with PowerVM Server list price* 3-year warranty, on-site Virtualization - OTC + 3yr. 9x5 SWMA Linux OS list price - RHEL, 2 sockets, unlimited guests, 9x5, 3 yr. sub./ supp. Total list price: (Total cost of acquisition) Server model Processor / cores Configuration Dell PowerEdge R720 HP ProLiant DL380 G8 IBM Power 822L $28,366 $29,829 $29,264 $12,605 $14,068 $14,895 $10,064 $ 10,064 $9,880 VMware vsphere Enterprise 5.1 VMware vsphere Enterprise 5.1 PowerVM for IBM PowerLinux $5,697 $5,697 $4,489 Red Hat subscription and Red Hat support Red Hat subscription and Red Hat support Red Hat subscription and IBM support $28,366 $29,829 $29,264 Dell R720 HP Proliant DL380p G8 IBM Power 822L Two 2.7 GHz, E5-2697, Ivy Bridge, 12-core processors Two 3.4 GHz POWER8, 10-core 64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port Same memory, HDD, NIC * Based on US pricing for s822l announced matching configuration table below. Source: hp.com, dell.com, vmware.com

IBM Power 822L comparison ($US) - Scale-Out Cloud with KVM Comparable TCA Dell PowerEdge R720 HP ProLiant DL380 G8 Linux on Intel Ivy Bridge + KVM Vs. Linux on POWER8 + KVM $21,300 $22,763 Server list price* $12,605 $14,068 $2,998 $ 2,998 3-year warranty, on-site Virtualization - 2 sockets, 3 yr. 9x5 sub./supp. Linux OS list price - RHEL, 2 sockets, unlimited guests, 9x5, 3 yr. sub./ supp. Total list price: (Total cost of acquisition) Server model Processor / cores 2015 IBM Corporation Configuration KVM for Red Hat on x86 (RHEV) $5,697 KVM for Red Hat on x86 (RHEV) $5,697 IBM Power 822L $22,382 $14,895 $2,998 KVM for Linux on Power (PowerKVM) $4,489 Red Hat subscription and Red Hat support Red Hat subscription and Red Hat support Red Hat subscription and IBM support $21,300 $22,763 $22,382 Dell R720 HP Proliant DL380p G8 IBM Power 822L Two 2.7 GHz, E5-2697, Ivy Bridge, 12-core processors Two 3.4 GHz POWER8, 10core 64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port Same memory, HDD, NIC

Why using LAMP on POWER 8 Copyright IBM Corporation 2014

Magento E-commerce on Turbo LAMP on Premise Comparison 5,000 users/hour * 4 Dell servers Intel Sandy Bridge Open Source LAMP, bare metal PHP Server, MySQL, CentOS PHP Server/ Magento 2s/16c 2.10 Ghz (SB) 24 GB PHP Server/ Magento 2s/16c 2.10 Ghz (SB) 24 GB DB / MySQL 2s/16c 2.10 Ghz (SB) 24 GB Redis Server 1s/4c - 2.53 Ghz (Lyn) 32 GB * @ < 2 sec response time for 86% of users 24,000 users/hour * ZEND Magento 1 ZEND Magento 2 MariaDB REDIS PowerKVM + Ubuntu Single Power S822L 2s/20c 3.42 Ghz 128GB 1 POWER8 server PowerKVM with PCI pass thru Turbo LAMP stack Ubuntu, MariaDB, ZEND Mellanox 40GB network Mellanox * @ < 2 sec. response time for > 90% of users TCA = $19,885 $3.98 /user/hour Key Advantages with Turbo LAMP on POWER8 53% less $$ per user / hour 4.8x more users per hour 12.5x more users per hour per core 4:1 less physical servers 2:1 less rack space TCA = $45,100 $1.88 /user/hour

Solutions cibles pour PowerLinux (non exaustif) InfoSphere BigInsights InfoSphere Streams Big Data Données massives Analytique Solutions applicatives des éditeurs Applications Open Source Explorez vos données, découvrez de nouvelles informations, pilotez votre entreprise avec Apache Hadoop, la distribution Hadoop IBM InfoSphere BigInsights, Streams, Cognos, SPSS Délivrez de nouveaux services plus rapidement en déployant des logiciels optimisés pour la plateforme PowerLinux Déployez toutes les applications Open Source sur la meilleure plateforme du marché pour conjuguer innovation et excellence technique

Myth n 2 : virtualization is different on POWER KVM runs on POWER POWER servers are fully OpenStack compliant Ubuntu Juju / Chef / etc. runs on Linux on Power MSPs are introducing POWER in their cloud MAAS

Les hyperviseurs disponibles sur POWER8 Choix de l'open source pour les clients POWER8 qui ne sont pas familiers avec PowerVM, qui virtualisent déjà avec KVM, pour des workload linux uniquement Q2 2014 Offre initiale 2004 Offre initiale PowerVM est l'hyperviseur le plus performant, le plus fiable et le plus sûr du marché. IBM continue à supporter et développer PowerVM pour AIX, Linux and IBM i

Comparaison du stack PowerVM vs PowerKVM HMC, IVM, PowerVC, OpenStack PowerVC, OpenStack, libvirt, Open Source Tools VIO Server IO Virtualization Linux MCP/KVM Firmware Phyp Firmware - Hypervisor OPAL Firmware Hardware P6, P7, P8 Hardware Managers Guest VM Types Host Software Hypervisor Hardware Abstraction Boot services Standalone Diagnostics Power 8 Linux only Hardware

Myth n 3 POWER Architecture is proprietary and closed POWER8 chip POWER8 core August 2013

Foundation Overview March 2015 The goal of the OpenPOWER Foundation is to create an open ecosystem, using the POWER Architecture to share expertise, investment, and server-class intellectual property to serve the evolving needs of customers.

L'écosystème OpenPOWER : dense, riche, complet Implementation / HPC / Research System / Software / Services I/O / Storage / Acceleration Boards / Systems Chip / SOC

OpenPOWER Foundation - Structure OpenPOWER est une fondation basée sur l'architecture POWER, qui permet à une communauté ouverte de développer des solutions innovante en mutualisant les savoirs et les compétences. 32

Parmi les premières solutions OpenPower Plate-forme de tests Google Chuanghe 1U/1S POWER8 Server Cirrascale RM4950 - NVIDIA Tesla Accelerated serveur Tyan ATX Power8 Convey's CAPI Developer Kit for Xilinx FPGAs Codename Firestone, IBM Wistron are jointly developing using technology from NVIDIA and Mellanox. Suzhou PowerCore CP1

CAPI an open invitation to innovate on POWER Coherent Attached Processor Proxy (CAPP) in processor Unit on processor that extends coherency to an attached device Coherency protocol tunneled over standard PCIe Eliminates the need for special I/Os and protocol logic Enables attached device to be a peer to the processor Simplifies programming model between application Enables device to use same effective address as application running in processor Eliminates the cumbersome I/O Device Driver requirements Typical I/O Model Flow DD Call Copy or Pin Source Data MMIO Notify Accelerator Poll / Int Completion Acceleration Flow with a Coherent Model Shared Mem. Notify Accelerator Acceleration 34 Shared Memory Completion Copy or Unpin Result Data Ret. From DD Completion

4Q ANNOUNCE: CAPI Developer Kit for early adopters An invitation to innovate Introducing the CAPI Developer Kit CAPI card and Support documentation will be made available for early adopters who wish to innovate custom logic / accelerator logic on an FPGA attached via CAPI This will be an offering from OpenPOWER member Nallatech FPGA IBM Supplied POWER Service Layer Can be plugged into an Existing Capi enabled Tuleta system Open space for Customization and innovation AFU 35

IBM Data Engine for NoSQL - Power Solution Edition Gagnant sur tous les tableaux 6x moins encombrant 24x moins de serveurs Réduction de l'infrastructure Augmentation des performances TCA divisé par 3 La solution : Le problème : Scale-out x86 servers limités en taille mémoire Infrastructure coûteuse, complexe Serveur POWER8 hébergeant l'application Redis uni à une baie FlashSystem par CAPI WWW Load Balancer 24U 500GB Cache 500GB NodeCache 500GB NodeCache 500GB NodeCache 1U x86 server (24) Node 512 GB memory WWW Power S822L/S812L Ubuntu 14.10 4U FlashSystem 840 2TB to 40 TB Flash 24:1 server consolidation3 Up to 3x lower TCA

Comment tester Linux on Power? Installez une VM sur un serveur POWER Réservez une VM sur un cloud public : OVH : www.runabove.com Minicloud : http://openpower.ic.incamp.br/minicloud/index.html Réservez une VM sur IBM PartnerWorld : Power Developpement Plateform IBM et ses partenaires peuvent prêter des serveurs à des fins de test Linux Technology Center de Montpellier PoC, benchmarks, portage IBM Innovation Center (IIC) Marne-La-Vallée : portage

OpenPower Foundation : un aperçu du futur

Open Compute server design and prototype motherboard Aaron Sullivan, senior director and distinguished engineer, infrastructure strategy at Rackspace, pictured here at the OCP U.S. Summit, shows off an Open Compute server design and prototype motherboard ahead of the first ever OpenPOWER Summit. The system is a new design by Rackspace and its OCP partners that combines the OpenPOWER, POWER8, and Open Compute design principles, targeted to run OpenStack services.

IBM Memory Technology Innovation Utilizing Altera FPGAs Collaborators: IBM, Altera IBM is working with partners across the industry to innovate on the Power memory bus. Utilizing an Altera FPGA, the Con Tutto card enables in-system experimentation with new memory technologies as well as combinations of Flash and DRAM. Additionally, acceleration prototyping on the POWER memory bus is explored.

NVLINK remplacera PCIE Gen3

Le développement du POWER9 a démarré Each [Summit] node will contain multiple IBM POWER9 CPUs and Nvidia Volta GPUs all connected together with NVIDIA s high-speed NVLink. Each node will have over half a terabyte of coherent memory (high bandwidth memory plus DDR4) addressable by all CPUs and GPUs, plus 800GB of non-volatile RAM that can be used as a burst buffer or as extended memory. To provide a high rate of I/O throughput, the nodes will be connected in a non-blocking fat-tree using a dual-rail Mellanox EDR InfiniBand interconnect.

Open Innovation to Put Data to Work