Les solutions idataplex Pour un data center dense et économique
The majority of clients technology budget goes to management, power, and cooling Power and Management are more than two thirds of IT budget Source: The IT Infrastructure of the Future: New Technologies in a Constrained Market, Matt Eastwood, March 2009 3
Data Center Challenges Data Center IT Resources Reducing Data Center Cost Acquisition, Operational and Management costs 55% Power/ Cooling 45% IT Load 70% Design 30% Processor Density Meeting increasing computing demands within the current Data Center footprint, power and cooling infrastructure Scaling Growing Data Center capacity rapidly Unique Requirements Solutions optimized for your workloads 4
Introducing idataplex Fast, Cool, Dense, Flexible. TCO without compromise! idataplex is an innovative x86 solution from IBM : Optimized both mechanically as a half-depth server solution and component-wise for maximum power and cooling efficiency Designed to maximize utilization of Data Center floor space, power and cooling infrastructure with Industrystandards based server platform. Easy-to to-maintain solution with individually serviceable servers, front access hard drives/cabling, Configurable for customer-specific specific compute, storage, or I/O needs and delivered pre-configured for rapid deployment Common tools Common tools across the System x portfolio for management at the node, rack or Data Center level 5
The Right Solution Depends on Nature & Size of Business Need Scale Out with Massive Parallel SW Resilient Computing Application Consolidation Business Nature Business Applications System x Enterprise System x Rack BladeCenter System x idataplex Infrastructure Applications System x Tower 1 s 10 s 100 s 1000 s 10,000 s Implementation Size
Introducing Idataplex Twice the number of servers in the same footprint
idataplex Data Center efficiency comes from the design Innovative Design to minimize power without compromising performance Server design for density & power efficiency Half-Depth servers and rack, double wide rack designed to match standard data center floor tile layouts 2x servers in same footprint 84 servers per rack Additional 16U (vertical) to house network switches and PDU s without taking server space Click image to view animation Top View - Floor Tile Layout (2x) Cutouts in Floor Tiles Networking and Hoses for RDHx (4x) Outboard Casters (removable) Mechanical design for cooling efficiency Half the airflow distance 20% less cooling required, 63% less fan power Optional Rear Door Heat Exchanger can extract >100% of server heat, eliminating hot/cold aisles for even more Data Center density Power Cabling Cutout (4x) Leveler Feet (underside) 8
Example : 588 servers in the Data Center 7 racks, 28 tiles Vs 19 racks, 57 tiles! 84 Servers 84 Servers 84 Servers 84 Servers 84 Servers 84 Servers 84 Servers VS. 32 svrs + 32 svrs + 32svrs + 32 svrs + 32svrs + 32svrs + 32 svrs + 32 svrs + 32 svrs + 32 svrs + 32svrs + 32 svrs + 32 svrs + 32svrs + 32 svrs + 32 svrs + 32 svrs + 32 svrs + 32 svrs + Compromising Results: Half the footprint Standard solution increases power and cooling costs
Increase Server Density in a standard 42U rack Take advantage of Idataplex design even in standard rack 10U wasted! Many Data Centers have limited power and / or cooling envelopes per rack Typical 1U servers require more power and cooling per server, limiting how many can be deployed Same cooling airflow idataplex s efficiency results in more density within the same infrastructure, even in a standard rack Get more on the floor with idataplex! Same cooling airflow
IBM System x idataplex Rack : Front 42 Flex 2U chassis Side by Side Layout 16 units of Vertical Space for switches, cables & PDU s Latch Lock for Security Labeled vertical slots on front and rear 100 Units of capacity in same standard 42U rack dimensions Double Perforated Doors for Airflow Flexible Cable Layout connect top (ceiling) or bottom (floor) Caster wheels for rolling onto floor
idataplex Rear Door Heat Exchanger A new and more efficient way to cool the Data Center Increase density by eliminating hot/cold aisles Eliminate rack heat exhaust Liquid cooling at the rack is 75%-95% more efficient than air cooling by a CRAC No electrical or moving parts T (door) = 18 No condensation! Provides Up to 115% Heat Extraction, and can even cool the room! 12
Easily Serviceable Integrated x86 Packaged Design Designed for Data Center Serviceability All-front access eliminates accessing rear of rack Swappable server trays in chassis Chassis docks directly into power Chassis guides keep upper servers in place Rack-side pockets for cables provide highly efficient cable routing Shared dual domain power supply with hot dock ports so planars dock into power connector High Efficiency shared 80mm fans provide superior cooling at a low wattage draw and low noise levels Asset Tags - Confirm Asset I/Ds 2U Flex Chassis Chassis Guides & Rail kits - Individual Chassis Rails for reliable fit & safe servicing 13 Flex Node Technology Innovative design so planar trays are independent & swappable for multiple configurations Tool-less server and chassis changes done easily with innovative server latch locks
Front-access Benefits Easier management of nodes and cabling at the rack and row level idataplex is serviced from the front of the rack (Cold aisle) Tool-less access to servers Hard Drive & Networking cables Network Switch access Simple cable routing What aisle do you want to work in? 18-27ºC >38 ºC!!! Front vs. Back Know what cable you are pulling! 14
idataplex with Cluster 1350 Rapid Deployment, Integrated & Single Point of Contact Which would you rather deal with... or Roll Your Own? Pre-integrated solution Servers, switches, PDU s, cabling Ready to roll into place, apply power and networking and get to work! 15
IBM idataplex 2U Flex Chassis Designed to optimize airflow and power consumption High-Efficiency Shared Power Supply High-efficiency Shared Cooling Fans Dual Independent Motherboards 20% Improved Performance in Standard Air Cooled Centers The idpx 2U chassis design draws less than half the fan power of 1U servers idpx fans draw 2% of total power per server compared to typical 1U fans which draw 10-11% of total power idpx is compatible with standard forced air environments - no external air movement assistance is required Estimated Savings: Approximately $3,500 in electricity expense per year
IBM idataplex 2U Flex Chassis Flex node chassis and server building blocks simplify configuration 2U 1U Compute Node Space for two 1U nodes or trays Rear of Chassis Front of Chassis 1U Drive Tray Power Supply 1U I/O Tray Fan assembly 17 1U Dual GPU I/O Tray
dx360m3 idataplex Node Configurations Compute Intensive Maximum Processing 2U, 2 Compute Nodes 1U Compute Node Compute + Storage Balanced Storage and Processing 2U, 1 Node Slot & Drive Tray HDD: up to 5 (3.5 ) 1U Drive Tray Acceleration Compute + I/O Maximum Component Flexibility 2U, 1 Node Slot I/O: up to 2 PCIe, HDD up to 8 (2.5 ) 1U Dual GPU I/O Tray 3U Storage Chassis Maximize Storage Density 3U, 1 Node Slot & Triple Drive Tray HDD: 12 (3.5 Drives) up to 24TB I/O: PCIe for networking + PCIe for RAID 900W Power Supply 550W Power Supply 750W N+N Redundant Power Supply
dx360 M3 Power Supply Offerings Maximum Efficiency for lower power requirements New High Efficiency 550W Power Supply for optimum efficiency in low power configurations More efficiency by running higher on the power curve Flexibility to optimize power supply to workload appropriately 550W (non-redundant) for lower power demands 900W (non-redundant) for higher power demands 750W N+N for node and line feed redundancy 900W HE 550W HE 750W N+N Redundant Power Supply option for the idataplex chassis Node-level power protection for smaller clusters, head node, 3U storage-rich, VM & Enterprise Rack-level line feed redundancy with discreet feeds Tailor rack-level solutions that require redundant power in some or all nodes Maintains maximum floor space density with the idataplex rack Graceful shutdown on power supply failure for virtualized environments Flexibility per chassis to optimize rack power Power supply is per 2U or 3U chassis Mix across the rack to maximize flexibility, minimize stranded power AC 1 AC 2 PS 1 750W Max PS 2 750W Max 750W Total in redundant mode 200-240V only C B A Redundant supply block diagram
dx360 M3 16 max.(8x per) DDR3 DIMMs (2GB, 4GB & 8GB) 1.5V and 1.35V CPU 1- Supports DIMM Bank 0 (Intel Westmere EP) DIMM Bank 2 Mini PCIe SAS Card Slot Virtual Media Key CPU 0-Supports DIMM Bank 1 (Intel Westmere EP) SATA ports 6x DIMM Bank 1 Hard drive carrier Ethernet Ports & Management 16x PCIe Riser card slot Battery 20
dx360 M3 Refresh - Server GPU Configuration 4-2.5 SS SAS 6Gbps (or SATA, or 3.5, or SSD ) NVIDIA Tesla M2050 #1 or NVIDIA Tesla M2070, NVIDIA Tesla M2050 #2 or NVIDIA Tesla M2070 Server level value Each server is individually serviceable Balanced performance for demanding GPU workloads 6Gbps SAS drives and controller for maximum performance Service and support for server and GPU from IBM Infiniband DDR (or QDR, or 10GbE )
dx360 M3 Refresh - 3-slot Riser and I/O Tray 2 PCIe x16 (1 per side) GPU 1 GPU 2 HBA PCIE x8
Do More with Maximum Performance Density Compared to first-generation Intel Xeon processor-based idataplex servers, the dx360 M3 server with 2 GPUs improves performance density in the data center for massive parallel computations after software porting dx360 M3 Refresh 49 Teraflops of Sustained performance 4X increased performance per rack 10X increased performance per node 65% Less acquisition costs 3.7X increase in Flops/Watt dx360 M2 672 Cores Xeon X5570 2.93GHz / 4C / 95W dx360 M3 1008 Cores Xeon X5670 2.93GHz / 6C / 95W 38,136 Cores NVIDIA GPU 448C / 225W Xeon X5670 2.93GHz / 6C / 95W
Powering the remote desktop with Microsoft RemoteFX Give end users the computing experience they expect while saving on energy, deployment and maintenance costs Up to 24 users per server + 42 servers per rack = 1,000 users per rack dx360 M3 servers offer performance and flexibility for Microsoft RemoteFX VDI environments idataplex density provides support for as many as 2 NVIDIA Tesla M2070Q GPUs per server for enough power to support 1,000 users Energy-efficient design can reduce the incoming energy requirement by up to 40 percent versus standard 1U servers
idataplex Partner Ecosystem Technology Collaboration Partners 25
The Total Systems Management Experience Delivering innovations throughout the systems management stack Upward integration into Tivoli Service Management IBM Systems platform solution for System x, BladeCenter, Power Systems, System z and storage Redesigned system tool portfolio for single-system management and scripting IBM Tivoli IBM Systems Director Platform management that is easy and efficient Management of physical and virtual resources across heterogeneous systems ToolsCenter Consolidated, integrated suite of management tools Powerful bootable media creator Hardware and firmware advances which are standard across all new systems Remote Deployment & Management Intelligent workload management Integrated Management Module (IMM) Standards-based hardware which combines diagnostic and remote control UEFI next generation BIOS Richer management experience and future-ready XCAT Clustering Tool Provide remote & unattended methods to assist with Deploying, Updating, Configuring, and Diagnosing Moab Adaptive HPC Suite Cluster Software Graphical workload, policy administration, and management reporting tools Provide guaranteed SLA time 26
ServiWare Un acteur majeur du Calcul Scientifique 17 années d activité croissante et soutenue Partenaire IBM depuis 10 ans Une sociétéau capital de 1 000 000 CA 25 M 60 personnes plus de 500 solutions de calcul scientifique installées Stratégie : R&D, fabrication, vente, mise en production, support Agence IDF 6 sites en France Bureau St Nazaire Bureau Strasbourg Agence Lyon Cluster de Calcul - Serveurs en grappe Solutions de Stockage Remote Visualisation Station de travail Agence Toulouse Bureau PACA 27
Nos Activités Matériels Serveurs Data Centers & Stockage Postes graphiques haut de gamme Produits de réseaux rapides Services - Intégration atelier pré-installation - Installation au forfait sur site - Contrat de support spécifique - Location Serveurs et stations - Aménagement de salle informatique - Location de puissance à la demande Logiciel - Système d exploitation - Compilateur, ordonnanceur, middleware HPC - Environnement de développement - Sauvegarde et archivage - Remonte visualisation
References communes IBM/Serviware sur IDPX 1500 serveurs en production Mac Guff Ligne 336 serveurs IDPX Institut d Astrophysique de Paris 140 serveurs IDPX CNRS Centre de Calcul IN2P3 440 serveurs IDPX INRA Toulouse 44 serveurs IDPX TOTAL 96 serveurs IDPX SNECMA Moteurs 52 serveurs IDPX CIRAD Montpellier 26 serveurs IDPX Bibliothèque Nationale de France 80 serveurs IDPX Université de Montpellier 92 serveurs IDPX SNPE 44 serveurs IPDX St Micro 32 serveurs IDPX AMESYS 84 serveurs IDPX
Zoom sur un cas concret Mac Guff Mac Guff est l'un des principaux studios de création d'effets visuels numériques en Europe. Il étend sa pratique de l'industrie cinématographique à la publicité, des programmes TV aux clips musicaux.
La problématique de Mac Guff Maximiser le nombre de serveurs dans un environnement très contraint Salle informatique obsolète en terme de refroidissement Pas de place pour les infrastructure de climatisation Limite énergétique Beaucoup de mémoire par serveur Un objectif de mise en production très court Des contraintes de livraison complexes Application maison sous linux àqualifier sur la solution La réponse de IBM et ServiWare Machine de test pour validation performance et application 4 racks Idataplex 336 serveurs «Intelligent Cluster»(1350) Solution de porte àeau RDHX ( RearDoorHeateXchanger) CDU ( coolingdistribution unit) Eaton150 Kw+ groupe de production d eau glacé Réseau de distribution d eau dans la salle Livraison, mise en production très rapide Des contraintes de livraison complexes Application maison sous linux àqualifier sur la solution
Refroidissement Air Corridor froid Rack confiné RDHX IBM
Augmenter le débit d air d une salle Pour des racks à 20 à 30 kw en moyenne, il faut multiplier le débit des climatiseurs par 3 ou 4 Dans la pratique, il est difficile d installer en périphérie de salle plus d un climatiseur (100kW) pour 10 armoires Multiplier par 3 ou 4 le débit des climatiseurs pose problème : la puissance des climatiseurs ferait exploser leur consommation (effet quadratique de la perte de charge en fonction de la vitesse) De plus augmenter la vitesse d air dans les salle inconfort V air [m/s] 6 m Conso Clim [W] 2 m Ra ck 12 m 2 V air Clim 2 m 2 6 x V air
Optimiser les surfaces d échanges Optimiser le rendement du système de refroidissement = maximiser la surface d échange. Au niveau du débit des serveurs La surface de l échangeur doit augmenter proportionnellement au besoin Conceptuellement, équilibrer la section de la veine d air chaude et froide est important pour l efficacité (minimise les vitesses d air) Taille de l échangeur = Taille de la porte à eau (climatiseur embarqué) 6 m 2 m Rack 12 m 2 V air Clim 12 m 2 V air
35 idataplex Rear Door Heat Exchanger
Zoom sur un cas concret Mac Guff
Heat removal as a function of H 2 O temp and flow rate % Heat Removal 150 140 130 120 110 100 90 80 % Heat Removal as function of Water Temperature and Flowrate for: 24C rack inlet air, 20KW load, Min Fan Speed H2O Temp 12 C * 14 C * 16 C * 18 C 20 C Procedure for Using Chart:: 1. Select chart closest to rack power (20KW or 32KW) 2. Select curve for temperature of available water 3. Select water flowrate to get desired heat removal Example: 1. Select Upper Chart for 20KW Rack 2. 18C water available, use light blue curve 3. For 110% heat removal, provide 15 gpm For 100% heat removal, provide 10.5 gpm For 92% heat removal, provide 8 gpm 8 10 12 14 Water Flowrate (gpm) 120 % Heat Removal as function of Water Temperature and Flowrate for: 24C rack inlet air, 32KW load, Min Fan Speed 115 Heat removal >100% implies average air temperature leaving the rack is COOLER than the air entering the rack % Heat Removal 110 105 100 95 90 85 80 H2O Temp 12 C * 14 C * 16 C * 18 C 20 C 75 8 10 12 14 Charts available in the IDPX RDHX Installation and Maintenance Guide Water Flowrate (gpm)
Merci! Merci! nicolas.joly@fr.ibm.com Merci! Merci!