5057734697287680

Introducing DRS DumpInsight

In an effort to provide a more insightful user experience and to help understand how vSphereDRS works, we recently released a fling:DRS Dump Insight.

DRS Dump Insight is a service portal where users can upload drmdump files and it provides a summary of the DRS run, with a breakup of all the possible moves along with the changes in ESX hosts resource consumption before and after DRS run.

Users can get answers to questions like:

  • Why did DRS make a certain recommendation?
  • Why is DRS not making any recommendations to balance my cluster?
  • What recommendations did DRS drop due to cost/benefit analysis?
  • Can I get all the recommendations made by DRS?

Once the drmdump file is uploaded, the portal provides a summary of all the possible vMotion choices DRS went through before coming up with the final recommendations.

The portal also enables users to do What-If analysis on their DRS clusters with options like:

  • Changing DRS Migration Threshold
  • Dropping affinity/anti-affinity rules in the cluster
  • Changing DRS advanced options

 

The post Introducing DRS DumpInsight appeared first on VMware VROOM! Blog.

Read more..

SPBM Performance Whitepaper

VMware Storage Policy Based Management (SPBM) is a storage policy framework that helps administrators match VM workload requirements against storage capabilities. SPBM runs as an independent service in the vCenter Server. We recently released a white paper [click here to download] that covers SPBM performance in two sections.

  1. Performance comparison of vCenter 6.5 v/s vCenter 6.0U3

    In the first section, we have covered performance improvements of SPBM in vCenter 6.5 over vCenter 6.0 U3. Here is a chart from the whitepaper showing improvement in one of the SPBM workflows.

  2. Scaling API Latency for vCenter 6.5

    In the next section, we have covered scaling trends of SPBM APIs in vCenter 6.5. To determine scaling patterns we passedincreasing number of entities to these APIs as input . The charts are plotted for number of entities against the time it took to complete the task. Below is one such chart from the whitepaper.

 

The post SPBM Performance Whitepaper appeared first on VMware VROOM! Blog.

Read more..

New White Paper: Fast Virtualized Hadoop and Spark on All-Flash Disks – Best Practices for Optimizing Virtualized Big Data Applications on VMware vSphere 6.5

A new white paper is available showing how to best deploy and configure vSphere 6.5 for Big Data applications such as Hadoop and Spark running on a cluster with fast processors, large memory, and all-flash storage (Non-Volatile Memory Express storage and solid state disks). Hardware, software, and vSphere configuration parameters are documented, as well as tuning parameters for the operating system, Hadoop, and Spark.

The best practices were tested on a 13-server cluster, with Hadoop installed on vSphere as well as on bare metal. Workloads for both Hadoop (TeraSort and TestDFSIO) and Spark Machine Learning Library routines (K-means clustering, Logistic Regression classification, and Random Forest decision trees) were run on the cluster. Configurations with 1, 2, and 4 VMs per host were tested as well as bare metal. Among the 4 virtualized configurations, 4 VMs per host ran fastest due to the best utilization of storage as well as the highest percentage of data transfer within a server. The 4 VMs per host configuration also ran faster than bare metal on all Hadoop and Spark tests but one.

Here are the results for the TeraSort suite:

And for Spark Random Forest decision trees:

Here are the best practices cited in this paper:

  • Reserve about 5-6% of total server memory for ESXi; use the remainder for the virtual machines.
  • Do not overcommit physical memory on any host server that is hosting Big Data workloads.
  • Create one or more virtual machines per NUMA node.
  • Limit the number of disks per DataNode to maximize the utilization of each disk: 4 to 6 is a good starting point.
  • Use eager-zeroed thick VMDKs along with the ext4 or xfs filesystem inside the guest.
  • Use the VMware Paravirtual SCSI (pvscsi) adapter for disk controllers; use all 4 virtual SCSI controllers available in vSphere 6.5.
  • Use the vmxnet3 network driver; configure virtual switches with MTU=9000 for jumbo frames.
  • Configure the guest operating system for Hadoop performance including enabling jumbo IP frames, reducing swappiness, and disabling transparent hugepage compaction.
  • Place Hadoop master roles, ZooKeeper, and journal nodes on three virtual machines for optimum performance and to enable high availability.
  • Dedicate the worker nodes to run only the HDFS DataNode, YARN NodeManager, and Spark Executor roles.
  • Run the Hive Metastore in a separate MySQL database.
  • Set the YARN cluster container memory and vcores to slightly overcommit both resources
  • Adjust the task memory and vcore requirement to optimize the number of maps and reduces for each application.

All details are in the paper.

The post New White Paper: Fast Virtualized Hadoop and Spark on All-Flash Disks - Best Practices for Optimizing Virtualized Big Data Applications on VMware vSphere 6.5 appeared first on VMware VROOM! Blog.

Read more..

DRS Lens – A new UI dashboard for DRS

DRS Lens provides an alternative UI for a DRS enabled cluster. It gives a simple, yet powerful interface to monitor the cluster real time and provide useful analyses to the users. TheUI is comprised ofdifferent dashboards in the form of tabs for each cluster being monitored.

Cluster Balance

Dashboardshowing the variations in the cluster balance metric plotted over time with DRS runs. This shows how DRS reacts to and tries to clear cluster imbalance every time it runs.

VM Happiness

This dashboard shows VM happiness for the first time in a UI. This chart shows the summary of total VMs in the cluster that are happy and those that are unhappy based on the user defined thresholds. Users can then select individual VMs to view performance metrics related to its happiness, like CPU ready time and memory swapIn rate.

vMotions

This dashboard provides a summary of vMotions that happened in the cluster over time. For each DRS run period, there will be a breakdown of vMotions as DRS-initiated and user-initiated. This helps users see how actively DRS has been working to resolve cluster imbalance. It also helps to see if there are vMotions outside of DRS control, which may be affecting cluster balance.

Operations

This dashboard tracks different operations (tasks, in vCenter Server) that happened in the cluster, over time. Users can correlate information about tasks from this dashboard against DRS load balancing and its effects from the other dashboards.

 

Users can download DRS Lens from VMware flings website.

The post DRS Lens - A new UI dashboard for DRS appeared first on VMware VROOM! Blog.

Read more..

The Extreme Performance Series at VMworld 2017

I&#rsquo;m excited to announce that the &#rsquo;Extreme Performance Series&#rdquo; is back for its 5th year, and with 7 additional sessions, it’s our largest year ever! These sessions are created and presented by VMware&#rsquo;s best and most distinguished performance engineers, principals, architects and gurus. You do not want to miss these advanced sessions.

Sessions and Group Discussion

Spread across four different VMworld tracks, you’ll find these sessions chalk full of performance details that you won’t get anywhere else. They’ll also be recorded so if the sessions you want to see aren’tbeing hosted in your region, you’ll still get access to it.

See the VMworldcatalog for a more detailed abstract and list of speakers!

Session ID LAS BCN Title
SER1504BU vCenter Performance Deep Dive
SER1756PU X Customers Share vCenter War Stories
SER2734BU X Extreme Performance Series: Byte Addressable Non-Volatile Memory in vSphere
SER2849BU Extreme Performance Series: Predictive DRS - Performance and Best Practices
SER1494BU X Encrypted vMotion in vSphere 6.5: Architecture, Performance, and Futures
SER2724BU Extreme Performance Series: Performance Best Practices
SER2723BU X Extreme Performance Series: Benchmarking 101
SER2343BE Extreme Performance Series: vSphere Compute & Memory Schedulers
STO1515BU X Extreme Performance Series: vSAN Performance Troubleshooting
STO3189GU X Group Discussion: vSAN Performance Tips
VIRT1445BU Extreme Performance Series: Fast Virtualized Hadoop and Spark on All-Flash Disks
VIRT1397BU Extreme Performance Series: Optimize & Increase Performance of Mission/Business Critical Architectures Using VMware NSX and vRNI
VIRT2550BU X Reducing Latency in Enterprise Applications Caused by Hairpinning with VMware NSX
VIRT1052BU Extreme Performance Series: Monster VM Database Performance
VIRT1983BU X Making the Complicated Simple: Cycle Stealing from the VDI Estate for Financial Modeling and Simulation
VIRT1997BU X Machine Learning and Deep Learning on VMware vSphere: GPUs are invading the SDDC
VIRT2368GU X Group Discussion: Maximum Performance with Mark Achtemichuk
FUT2020BU Wringing Maximum Performance from vSphere for Extremely Demanding Workloads and Customers
FUT2761BU X Sharing High Performance Interconnects across Multiple VMs: Machine Learning and Scientific Computing Use-cases


TAM Customer Day

For our customers that are part of the TAM program, Performance will be represented with a unique performance breakout and specialist roundtables the Sunday before VMworld.

Bootcamps

New this year for VMworld 2017 in Las Vegas, we will be offering a pre-VMworld bootcamp focused on vSphere platform performance.

vSphere Advanced Performance Design, Configuration and Troubleshooting

The VMware vSphere Advanced Performance Bootcamp provides the most advanced technical performance oriented training available about vSphere performance design, tuning and troubleshooting. VMware Certified Design Expert Mark Achtemichuk and a team of VMware Performance Engineers will cover a broad range of topics that cover all resource dimensions including the ESXi scheduler, memory management, storage and network optimization. Attendees will learn how to identify the location of performance issues, diagnose their root cause and remediate a wide variety of performance conundrums using the many techniques practiced by the most seasoned vSphere veterans and other VMware experts.

Ask The Experts

This program allows you to book some one-on-one time with various highly skilled VMware professionals. Performance experts will be available to sit down and talk with, as well as challenge them with your most difficult questions. This is a great forum to get specific questions answered or to explore your particular environment.

Hands On Labs

Lastly, don&#rsquo;t miss the new Performance focused Hands-On-Labs.

  • HOL-1804-01-SDC vSphere 6.5 Performance Diagnostics and Benchmarking

This Performance lab is always extremely popular and has been rebuilt to include topics such as using benchmark tools like DVD Store and Weathervane, rightsizing your virtual machines, how power policy affect performance and basic troubleshooting of CPU, MEM, storage and Network dimensions. With over 5 hours of content, you&#rsquo;ll need to take this lab several times.

  • HOL-1804-02-CHG vSphere Challenge Lab

This challenge format lab, in which you take the lead and diagnose and fix various vSphere issues, includes new scenarios around vNUMA, Latency Sensitivity, Poor Performance and Resource Pools. This is great way to experience some off the most common performance issues and how to resolve them in a fun and prescriptive way.

2017 will be a banner year for the Extreme Performance Series and we look forward to you joining us! Look out for a few surprises such as, draws for Frank & Niels new Host Resource Deep Dive Book (https://twitter.com/hostdeepdive), performance stickers and I&#rsquo;m told Melvin the Monster VM will even make some appearances

See you at VMworld 2017.

@vmMarkA #xPerfSeriesPerfBootcamp

The post The Extreme Performance Series at VMworld 2017 appeared first on VMware VROOM! Blog.

Read more..

The Extreme Performance Series at VMworld 2017

I&#rsquo;m excited to announce that the &#rsquo;Extreme Performance Series&#rdquo; is back for its 5th year, and with 7 additional sessions, it’s our largest year ever! These sessions are created and presented by VMware&#rsquo;s best and most distinguished performance engineers, principals, architects and gurus. You do not want to miss these advanced sessions.

Sessions and Group Discussion

Spread across four different VMworld tracks, you’ll find these sessions chalk full of performance details that you won’t get anywhere else. They’ll also be recorded so if the sessions you want to see aren’tbeing hosted in your region, you’ll still get access to it.

See the VMworldcatalog for a more detailed abstract and list of speakers!

Session ID LAS BCN Title
SER1504BU vCenter Performance Deep Dive
SER1756PU X Customers Share vCenter War Stories
SER2734BU X Extreme Performance Series: Byte Addressable Non-Volatile Memory in vSphere
SER2849BU Extreme Performance Series: Predictive DRS - Performance and Best Practices
SER1494BU X Encrypted vMotion in vSphere 6.5: Architecture, Performance, and Futures
SER2724BU Extreme Performance Series: Performance Best Practices
SER2723BU X Extreme Performance Series: Benchmarking 101
SER2343BE Extreme Performance Series: vSphere Compute & Memory Schedulers
STO1515BU X Extreme Performance Series: vSAN Performance Troubleshooting
STO3189GU X Group Discussion: vSAN Performance Tips
VIRT1445BU Extreme Performance Series: Fast Virtualized Hadoop and Spark on All-Flash Disks
VIRT1397BU Extreme Performance Series: Optimize & Increase Performance of Mission/Business Critical Architectures Using VMware NSX and vRNI
VIRT2550BU X Reducing Latency in Enterprise Applications Caused by Hairpinning with VMware NSX
VIRT1052BU Extreme Performance Series: Monster VM Database Performance
VIRT1983BU X Making the Complicated Simple: Cycle Stealing from the VDI Estate for Financial Modeling and Simulation
VIRT1997BU X Machine Learning and Deep Learning on VMware vSphere: GPUs are invading the SDDC
VIRT2368GU X Group Discussion: Maximum Performance with Mark Achtemichuk
FUT2020BU Wringing Maximum Performance from vSphere for Extremely Demanding Workloads and Customers
FUT2761BU X Sharing High Performance Interconnects across Multiple VMs: Machine Learning and Scientific Computing Use-cases


TAM Customer Day

For our customers that are part of the TAM program, Performance will be represented with a unique performance breakout and specialist roundtables the Sunday before VMworld.

Bootcamps

New this year for VMworld 2017 in Las Vegas, we will be offering a pre-VMworld bootcamp focused on vSphere platform performance.

vSphere Advanced Performance Design, Configuration and Troubleshooting

The VMware vSphere Advanced Performance Bootcamp provides the most advanced technical performance oriented training available about vSphere performance design, tuning and troubleshooting. VMware Certified Design Expert Mark Achtemichuk and a team of VMware Performance Engineers will cover a broad range of topics that cover all resource dimensions including the ESXi scheduler, memory management, storage and network optimization. Attendees will learn how to identify the location of performance issues, diagnose their root cause and remediate a wide variety of performance conundrums using the many techniques practiced by the most seasoned vSphere veterans and other VMware experts.

Ask The Experts

This program allows you to book some one-on-one time with various highly skilled VMware professionals. Performance experts will be available to sit down and talk with, as well as challenge them with your most difficult questions. This is a great forum to get specific questions answered or to explore your particular environment.

Hands On Labs

Lastly, don&#rsquo;t miss the new Performance focused Hands-On-Labs.

  • HOL-1804-01-SDC vSphere 6.5 Performance Diagnostics and Benchmarking

This Performance lab is always extremely popular and has been rebuilt to include topics such as using benchmark tools like DVD Store and Weathervane, rightsizing your virtual machines, how power policy affect performance and basic troubleshooting of CPU, MEM, storage and Network dimensions. With over 5 hours of content, you&#rsquo;ll need to take this lab several times.

  • HOL-1804-02-CHG vSphere Challenge Lab

This challenge format lab, in which you take the lead and diagnose and fix various vSphere issues, includes new scenarios around vNUMA, Latency Sensitivity, Poor Performance and Resource Pools. This is great way to experience some off the most common performance issues and how to resolve them in a fun and prescriptive way.

2017 will be a banner year for the Extreme Performance Series and we look forward to you joining us! Look out for a few surprises such as, draws for Frank & Niels new Host Resource Deep Dive Book (https://twitter.com/hostdeepdive), performance stickers and I&#rsquo;m told Melvin the Monster VM will even make some appearances

See you at VMworld 2017.

@vmMarkA #xPerfSeriesPerfBootcamp

The post The Extreme Performance Series at VMworld 2017 appeared first on VMware VROOM! Blog.

Read more..

Introducing VMmark3: A highly flexible and easily deployed benchmark for vSphere environments

VMmark 3.0, VMware&#rsquo;s multi-host virtualization benchmark is generally available here. VMmark3 is a free cluster-level benchmark that measures the performance, scalability, and power of virtualization platforms.

VMmark3 leverages much of previous VMmark generations&#rsquo; technologies and design. It continues to utilize a unique tile-based heterogeneous workload application design. It also deploys the platform-level workloads found in VMmark2 such as vMotion, Storage vMotion, and Clone & Deploy. In addition to incorporating new and updated application workloads and infrastructure operations, VMmark3 also introduces a new fully automated provisioning service that greatly reduces deployment complexity and time.

Figure 1: VMmark3

The VMmark3 Benchmark:

  • Allows accurate and reliable benchmarking of virtual data center performance and power consumption of host and storage components.
  • Allows heterogeneous workload comparisons between different virtualization platforms.
  • Allows the analysis of changes in hardware, software, and configuration within virtualization environments.

VMmark3 Application Workloads:

  • DVDstore3: The third generation DVDstore benchmark is a complete online e-commerce test application with a back-end database component, a web application tier, and driver programs. The application simulates users logging into a web server and browsing a catalog of products using basic queries. VMmark3 utilizes DVDstore3 with 4 virtual machines, 3 Apache web-tier VMs and 1 MySQL database VM. One of the web servers delivers a constant load to the database, while the other two deliver a cyclical load to generate a bursty profile.
  • Weathervane: This is a highly scalable web application that contains a variety of support services working with a core application that simulates an online auction. Each VMmark3 tile contains two independent instances of the Weathervane Auction application, one static and one elastic, for a sum of 14 VMs (8 static and 6 elastic). The elastic workload mimics self-scaling applications by periodically adding and removing an application server and web server throughout the benchmark run.
  • Standby: The standby server mimics a heartbeat server.

VMmark3 Infrastructure Operations:

  • vMotion: This infrastructure operation live migrates one of the Weathervane Auction RabbitMQ VMs in a round-robin fashion to simulate modern sysadmin operations.
  • Storage vMotion: For this operation, one of the Standby VMs is migrated to a user-specified maintenance partition and then, after a period of rest, returns to the original location.
  • XvMotion: This operation simultaneously moves one of the DS3WebA VMs to an alternate host and maintenance partition. Similar to Storage vMotion, after a period of rest, the VM will return to its original location.
  • Automated Load Balancing (DRS): VMmark requires that DRS be enabled and running to ensure typical rebalancing operations occur within the environment under test.

VMmark3 Provisioning Service:

  • VMmark3 features a highly-automated setup and tile-creation process that makes benchmark deployment fast and easy, with little to no manual intervention. The entire process is seeded from a single OVA and can be utilized in an unattended mode for tile0 to N.VMmark3 uses CentOS-based free or open-source software throughout, eliminating the need for purchasing additional software licenses.

 

The post Introducing VMmark3: A highly flexible and easily deployed benchmark for vSphere environments appeared first on VMware VROOM! Blog.

Read more..

NEW VMworld 2017 Bootcamp – vSphere Advanced Performance Design, Configuration and Troubleshooting

New this year for VMworld 2017 in Las Vegas, we will be offering a pre-VMworld bootcamp focused on vSphere platform performance. Specific SQL and Oracle bootcamps will still be offered, but we have had many requests for a workload agnostic program. This bootcamp will enable you to confidently support all your virtual workloads and give you an opportunity to directly interact with VMware Performance Engineering.

vSphere Advanced Performance Design, Configuration and Troubleshooting

The VMware vSphere Advanced Performance Bootcamp provides the most advanced technical performance oriented training available about vSphere performance design, tuning and troubleshooting. VMware Certified Design Expert Mark Achtemichuk and a team of VMware Performance Engineers will cover a broad range of topics that cover all resource dimensions including the ESXi scheduler, memory management, storage and network optimization. Attendees will learn how to identify the location of performance issues, diagnose their root cause and remediate a wide variety of performance conundrums using the many techniques practiced by the most seasoned vSphere veterans and other VMware experts.

Reference: https://www.vmworld.com/en/us/learning/sessions.html

Here are the details:

Cost: $725 / seat

Schedule:

Saturday August 26, 2017
8:00am to 5:00pm
(registration opens at 6:30am)

Location:

Mandalay Bay, South Convention Centre
3rd Floor Jasmine Rooms

To register:

Be sure to add the bootcamp in step 4 of your VMworld conference registration, under Educational Offerings, after you&#rsquo;ve selected your conferences pass.

Registration is open, seating is limited! Lunch and breaks provided.

I look forward to seeing you all there!

#PerfRocks #xPerfSeries #PerfBootcamp

@vmMarkA

The post NEW VMworld 2017 Bootcamp - vSphere Advanced Performance Design, Configuration and Troubleshooting appeared first on VMware VROOM! Blog.

Read more..

Introducing TPCx-HS Version 2 – An Industry Standard Benchmark for Apache Spark and Hadoop clusters deployed on premise or in the cloud

Since its release on August 2014, the TPCx-HS Hadoop benchmark has helped drive competition in the Big Data marketplace, generating 23 publications spanning 5 Hadoop distributions, 3 hardware vendors, 2 OS distributions and 1 virtualizationplatform. By all measures, it has proven to be a successful industry standard benchmark for Hadoop systems. However, the Big Data landscape has rapidly changed over the last 30 months. Key technologies have matured while new ones have risen to prominence in an effort to keep pace with the exponential expansion of datasets. One such technology is Apache Spark.

According to a Big Data survey published by the Taneja Group, more than half of the respondents reported actively using Spark, with a notable increase in usage over the 12 months following the survey. Clearly, Spark is an important component of any Big Data pipeline today. Interestingly, but not surprisingly, there is also a significant trend towards deploying Spark in the cloud. What is driving this adoption of Spark? Predominantly, performance.

Today, with the widespread adoption of Spark and its integration into many commercial Big Data platform offerings, I believe there needs to be a straightforward, industry standard way in which Spark performance and price/performance could be objectively measured and verified. Just like TPCx-HS Version 1 for Hadoop, the workload needs to be well understood and the metrics easily relatable to the end user.

Continuing on the Transaction Processing Performance Council&#rsquo;s commitment to bringing relevant benchmarks to the industry, it is my pleasure to announce TPCx-HS Version 2 for Spark and Hadoop. In keeping with important industry trends, not only does TPCx-HS support traditional on premise deployments, but also cloud.

I envision that TPCx-HS will continue to be a useful benchmark standard for customers as they evaluate Big Data deployments in terms of performance and price/performance, and for vendors in demonstrating the competitiveness of their products.

 

Tariq Magdon-Ismail

(Chair, TPCx-HS Benchmark Committee)

 

Additional Information: TPC Press Release

The post Introducing TPCx-HS Version 2 – An Industry Standard Benchmark for Apache Spark and Hadoop clusters deployed on premise or in the cloud appeared first on VMware VROOM! Blog.

Read more..

Oracle Database Performance on vSphere 6.5 Monster Virtual Machines

We have just published a new whitepaper on the performance of Oracle databases on vSphere 6.5 monster virtual machines. We took a look at the performance of the largest virtual machines possible on the previous four generations of four-socket Intel-based servers. The results show how performance of these large virtual machines continues to scale with the increases and improvements in server hardware.

Oracle Database Monster VM Performance on vSphere 6.5 across 4 generations of Intel-based four-socket servers

In addition to vSphere 6.5 and the four-socket Intel-based servers used in the testing, an IBM FlashSystem A9000 high performance all flash array was used. This array provided extreme low latency performance that enabled the database virtual machines to perform at the achieved high levels of performance.

Please read the full paper, Oracle Monster Virtual Machine Performance on VMware vSphere 6.5, for details on hardware, software, test setup, results, and more cool graphs. The paper also covers performance gain from Hyper-Threading, performance effect of NUMA, and best practices for Oracle monster virtual machines. These best practices are focused on monster virtual machines, and it is recommended to also check out the full Oracle Databases on VMware Best Practices Guide.

Some similar tests with Microsoft SQL Server monster virtual machines were also recently completed on vSphere 6.5 by my colleague David Morse. Please see his blog post and whitepaper for the full details.

This work on Oracle is in some ways a follow up to Project Capstone from 2015and the resulting whitepaper Peeking at the Future with Giant Monster Virtual Machines . That project dealt with monster VM performance from a slightly different angle and might be interesting to those who are also interested in this paper and its results.

 

The post Oracle Database Performance on vSphere 6.5 Monster Virtual Machines appeared first on VMware VROOM! Blog.

Read more..

Go Que Newsroom Categories

Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 40 bytes) in /home/content/36/8658336/html/goquecom/wp-includes/wp-db.php on line 1995