Wednesday, September 18, 2019

New install of ESXi 6.5 creates VMFS5 datastore instead of VMFS6 !!


New install of ESXi 6.5 creates VMFS5 datastore instead of VMFS6 !!

To upgrade the ESX boot datastore to VMFS 6 version, please follow below steps !!


1. Note down the NAA ID of the data store.
2. Put ESX host into maintenance mode.
3. Unmount the data store from ESX host.
4. Delete the data store from ESX host..
5. Go to ESX host and choose New Datastore option and re-add the same data store. 
6.Choose type VMFS, give name, choose VMFS 6 version this time and finish the wizard.
7. Successfully upgrade the data store to VMFS 6.

How to upgrade the ESX data store from VMFS 5 to VMFS 6.

How to upgrade the ESX data store from VMFS 5 to VMFS 6.

Upgrading the VMFS 5 data store to VMFS 6 is quite simple. Follow below steps:-

Note:- Before upgrade the data store to VMFS 6 make sure all ESX host has been upgraded to ESXi 6.5 version.

1. Migrate all VMs from the data store to another data store.
2. Move all ISO/Orphaned data from data store to another data store if exist.
3. Note down the NAA ID of the data store.
4. Unmount the data store from all ESX hosts.
5. Delete the data store.
6. Go to any ESX host and choose New Datastore option and re-add the same data store. 
7.Choose type VMFS, give same name as earlier, choose VMFS 6 version this time and finish the wizard.
8. Successfully upgrade the data store to VMFS 6.
9. Move back the VMs to this data store.




Thursday, April 18, 2019

Host Cannot Download Files From VMware vSphere Update Manager Patch Store.

ESX host is not able to scan the baseline and throw error like "Host cannot download files from VMware vSphere Update Manager patch store.  Check the network connectivity and firewall setup, and check esxupdate logs for details."


Check the ESXupdate log at /var/log/esxupdate.log location and will you find the error for this issue.

There are multiple issue like firewall port block, DNS misconfiguration on ESX host, Primary DNS not reachable and secondary DNS not configured.

1. To check and resolve firewall port issue. Check if port 9084 is able to telnet from ESX host to update manager IP. Port 9084 should be allowed between ESX and VC/VUM server.

Command:- # nc -z VC/VUM IP port number  #nc -z 10.10.10.5 9084
if port is not blocked the you will get output like "Connection to 10.10.10.5 9084 port [tcp/*] succeeded!"

But if port is blocked then you will get output like "nc: connect to 10.10.10.5 port 9084 (tcp) failed: Connection timed out"

2. To check and resolve DNS server issue. Make sure Primary and secondary DNS IP are set on ESX host and able to ping/resolve and telnet on port 53, 389 to DNS servers.








Friday, April 12, 2019

Update vCSA from 6.7 to 6.7 U1b version via CLI

This is to update a vCSA 6.7 with Embedded PSC to 6.7 U1b version via CLI (Command Line Interface).

1. First download the 6.7 patch ISO from VMware portal.
2. Take a full backup of vCSA appliance.
3. Take a snaphsot with memory option of vCSA appliance.
4. Mount the downloaded patch ISO on vCSA appliance.
5. SSH vCSA appliance and check the current vCSA version as per below command.
6. Enable appliance shell via command- chsh -s /bin/appliancesh root



6. Run the following command to stage the ISO.

7. Here, ISO mounted successfully but Root password of vCSA appliance expired. we need to change the password first before proceeding further. Reset Root password as per below command lines.

8. Password has been reset successfully, now Run the following command to stage the patches.


9. Run command to see the stage patches details like release date,version and build number etc.


10. Now, we are ready to install the patch packages, run below command for that.


11. Now, packages has been upgraded successfully, need to reboot the vCSA appliance now to take the changes into affect.



This is how we have updated our vCSA 6.7 to U1b successfully. 

Please comment or share your views on this !!!!



Tuesday, April 9, 2019

VMware Basics Part 2

  1. How many hosts can be managed by a cluster in vSphere 6.0?
A single cluster can manage maximum 64 hosts
  1. How can maximum VMs be managed by a single cluster?
A single cluster can manage the maximum of 8000 VMs.
  1. What is VVol?
Virtual Volume a new VM disk management concept introduced in vSphere 6.0 that enables array-based operations at the virtual disk level. VVol is automatically created when a virtual disk is created in a virtual environment for a VM.
  1. How many licensing options for vSphere 6.0?
There are three licensing options for vSphere 6.0:
  • Standard Edition: Contains 1 vCenter Server Standard license, up to 2 vCPUs for Fault Tolerance, vMotion, Storage vMotion, HA, VVols etc.
  • Enterprise Edition: Same as Standard Edition additionally APIs for Array Integration and Multipathing, DRS, and DPM.
  • Enterprise Plus: Includes all features of Standard and Enterprise Editions with additionally Fault Tolerance upto 4 vCPUs and 64GB of RAM. It also includes Distributed vSwitch and the most expensive licensing option of vSphere 6.0.
  1. How much Maximum RAM can support vSphere 6.0?
It supports upto 12TB of RAM.
  1. What is the Content Library?
Content Library is the central location point between two different geographical locations with vCenter Servers where you can store VM templates, ISO images, scripts etc. and share them between geographical locations
  1. What are the main benefits of content libraries?
We create VM templates and can share on another geographical location of a company without creating again on other locations. It has many benefits such as sharing and consistency, storage efficiency, and secure subscription.
  1. How many types of Content Libraries have?
It has three types:
  1. Local: library of local control.
  2. Published: local library which contents (VM templates, ISO images etc) for subscription.
  3. Subscribed: A library which syncs with the published library
  4. What are the requirements and limitations of Content Libraries?
A content library has the following requirements and limitations
  • Single storage which can size upto 64TB
  • Maximum of 256 items per library
  • Sync occurs once every 24 hours
  1. What is VMFS?
VMFS is a file system for a VM in VMware vSphere. VMFS is a datastore that responsible for storing virtual machine files. VMFS can also store large files which size can up to 64TB in vSphere 6.0
  1. What is vSAN?
Virtual SAN is a software-defined storage first introduced in vSphere 5.5 and is fully integrated with vSphere. It aggregates locally attached storage of ESXi hosts which are part of a cluster and creates a distributed shared solution.
  1. What is cold migration?
To move a powered-off VM from one host to another is called cold migration.
  1. What is Storage vMotion?
To move a powered-on VM from one datastore to another is called Storage vMotion.
  1. What are the different configuration options for VSAN?
There are two configuration options for  vSAN:
  • Hybrid: Uses both flash-based and magnetic disks for storage. Flash are used for cashing, while magnetic disks are used for capacity or storage.
  • All-Flash: Uses flash for both caching and for storage
  1. Are there VSAN ready nodes are available in the market?
Yes, vSAN-ready such as VxRail 4.0 and 4.5 are available in the market. VxRail is the combination of min 3 servers which are part of a cluster and can scale up to 64 servers.
  1. How are many maximum ESXi hosts allowed for vSAN?
       64 hosts are max allowed to configure a vSAN cluster.
  1. How many disk groups and max magnetic disks are allowed in single disk group?
Maximum 5 disk groups are allowed on an ESXi host which is a part of a vSAN cluster and a maximum of 7 magnetic and 1 SSD per disk group is allowed.
  1. How many types of storages can we use in our virtual environment?
  • Direct Attached Storage
  • Fiber Channel (FC)
  • iSCSI
  • Network Attached Storage (NAS)
  1. What is NFS?
Network File System (NFS) is a file sharing protocol that ESXi hosts use to communicate with a NAS device. NAS is a specialized storage device that connects to a network and can provide file access services to ESXi hosts.
  1. What is Raw Device Mapping (RDM)?
Raw Device Mapping (RDM) is a file stored in a VMFS volume that acts as a proxy for a raw physical device. RDM enables you to store virtual machine data directly on a LUN. RDM is recommended when a VM must interact with a real disk on the SAN.
  1. What is iSCSI storage?
An iSCSI SAN consists of an iSCSI storage system, which contains one or more storage processors. TCP/IP protocol is used to communicate between host and storage array. an iSCSI initiator is configured with the ESXi host. an iSCSI initiator can be a hardware-based either dependent or independent and software-based known as iSCSI software initiator.
  1. What is the format of iSCSI addressing?
It uses TCP/IP to configure.
  1. What are iSCSI naming conventions?
iSCSI names are formatted in two different ways:
  • the iSCSI qualified name (IQN)
  • extended unique identifier (EUI)
  1. What is vApp?
vApp is a container or group where more than one VM can be package and manage multi-tiered applications for specific requirements for example, Web server, database server, and application server can be configured as a vApp and can be defined their power-on and power-off sequence.
  1. What settings can be configured for vApp?
We can configure several settings for vApp such as CPU and memory allocation, and IP allocation policy etc.

Miscellaneous

  1. What is VMware DRS?
DRS stands for Distributed Resource Scheduler; that automatically balances available resources among various hosts by using cluster or resource pools. With the help of HA, DRS can move VMs from one host to another to balance the available resources among VMs.
  1. What is share, limit, and reservation?
Share: A value that specifies the relative priority or importance of a VM access to given resource.
Limit: Consumption of a CPU cycle or host physical memory that cannot cross the defined value (limit).
  1. What are the alarms why we use them?
An alarm is a notification which appears when an event occurs. Many default alarms exist for many inventory objects. Alarms can be created and modified using vSphere Web Client;
  1. What are the hot-pluggable devices which can be added while VM is running?
We can add HDDs and NIC while VM is running.
  1. What is a Template?
When a VM is converted into a format which can be used to create a VM with pre-defined settings is called a template. An installed VM can be converted into a template but it cannot be powered-on.
  1. What is Snapshot?
To create a copy of a VM with the timestamp as a restore point is called a snapshot. Snapshots are taken when an upgrade or software installation is required. For better performance, a snapshot should be removed after a particular task is performed.
  1. How to convert a physical machine into a VM?
Three steps are required to convert a physical machine to a VM:
  • An agent needs to be installed on the Physical machine
  • VI client needs to be installed with Converter Plug-in
  • A server to import/export virtual machines
  1. What is vMotion and what is the main purpose to use it in a virtual environment?
It is a very prominent feature of VMware vSphere used to live migrate running VMs from one ESXi host to another without any downtime. Datastores and ESXi hosts both can be used while vMotion.
  1. What is the difference between a clone and a template?
A clone is a copy of a virtual machine. By cloning a VM, it will save time if multiple VMs with the same configurations are required to configure. While a template is a master copy of an image created from a VM which can be later used to create many clones. After converting a VM to a template, it can’t be powered-on or edited.
  1. What monitoring method is used in vSphere HA?
  • Network Heartbeat
  • Datastore Heartbeat
  1. How is master host elected in vSphere HA?
When HA is enabled in a cluster, all hosts take part in a selection process to be selected as a master host. A host which has the highest number of datastores mounted will be selected as a master host. All other hosts will remain slave hosts.
  1. What is the purpose of VMware Tools?
It is a suite of utilities which are used to enhance the performance of a VM in the form of graphics, mouse/keyboard movement, network card, and other peripheral devices.
  1. What is VMware DPM?
Stands for Distributed Power Management is a feature of VMware DRS is used to monitor required resources in a cluster. When the resources are decreases due to low usage, VMware DPM consolidates workloads and shut down the hosts which are not being used, and when resources are increased it automatically power on the un-used hosts.
  1. What is the ESXi Shell?
It is a command-line interface is used to run repair and diagnostics of ESXi hosts. It can be accessed via DCUI, vCenter Server enable/disable, and via SSH.
  1. How to run ESXTOP on ESXi host?
Enable SSH on ESX host. Open putty, type ESX host name.
Login via root access. Type ESXTOP
types of port binding:-

These three different types of port binding determine when ports in a port group are assigned to virtual machines:
Static Binding
Dynamic Binding
Ephemeral Binding

Static binding:-
When you connect a virtual machine to a port group configured with static binding, a port is immediately assigned and reserved for it, guaranteeing connectivity at all times. The port is disconnected only when the virtual machine is removed from the port group. You can connect a virtual machine to a static-binding port group only through vCenter Server.
Note: Static binding is the default setting, recommended for general use.

Dynamic binding:-
In a port group configured with dynamic binding, a port is assigned to a virtual machine only when the virtual machine is powered on and its NIC is in a connected state. The port is disconnected when the virtual machine is powered off or the NIC of the virtual machine is disconnected. Virtual machines connected to a port group configured with dynamic binding must be powered on and off through vCenter.
Dynamic binding can be used in environments where you have more virtual machines than available ports, but do not plan to have a greater number of virtual machines active than you have available ports. For example, if you have 300 virtual machines and 100 ports, but never have more than 90 virtual machines active at one time, dynamic binding would be appropriate for your port group.
Note: Dynamic binding is deprecated from ESXi 5.0, but this option is still available in vSphere Client. It is strongly recommended to use Static Binding for better performance.

Ephemeral binding:-
In a port group configured with ephemeral binding, a port is created and assigned to a virtual machine by the host when the virtual machine is powered on and its NIC is in a connected state. When the virtual machine powers off or the NIC of the virtual machine is disconnected, the port is deleted.
You can assign a virtual machine to a distributed port group with ephemeral port binding on ESX/ESXi and vCenter, giving you the flexibility to manage virtual machine connections through the host when vCenter is down. Although only ephemeral binding allows you to modify virtual machine network connections when vCenter is down, network traffic is unaffected by vCenter failure regardless of port binding type.
Note: Ephemeral port groups must be used only for recovery purposes when you want to provision ports directly on host bypassing vCenter Server, not for any other case. This is true for several reasons:


Promiscuous Mode:-
■  Reject — Placing a guest adapter in promiscuous mode has no effect on which frames are received by the adapter.
■  Accept — Placing a guest adapter in promiscuous mode causes it to detect all frames passed on the vSphere standard switch that are allowed under the VLAN policy for the port group that the adapter is connected to.

MAC Address Changes :-
■  Reject — If you set the MAC Address Changes to Reject and the guest operating system changes the MAC address of the adapter to anything other than what is in the .vmx configuration file, all inbound frames are dropped.
If the Guest OS changes the MAC address back to match the MAC address in the .vmx configuration file, inbound frames are passed again.
■  Accept — Changing the MAC address from the Guest OS has the intended effect: frames to the new MAC address are received.

Forged Transmits:-
■  Reject — Any outbound frame with a source MAC address that is different from the one currently set on the adapter are dropped.
■  Accept — No filtering is performed and all outbound frames are passed.


Upgrading ESXi 5.5 U3 to ESXi 6.5

This article is for how to upgrade a ESXi 5.5 U3 to ESXi 6.5 via update manager.

I know, upgrading a ESXi host via update manager is very easy task but you may face some issues while upgrading due to some incompatible "VIBs". To overcome from this situation, you need to manually remove these VIBs from ESXi host and then proceed further for upgrade. Below is the screenshots of errors.
Below scan result showing compliance status as "Incompatible" not "non-compliant". As per below screenshot, some vibs are conflicting and needs to be removed before upgrade.

"Remove the conflicting VIBs or use Image Builder to create a custom upgrade ISO image that contains the newer versions of the conflicting VIBs, and try to upgrade again."



1. Check the ESXi host hardware compatibility with ESXi 6.5.
2. Download ESXi 6.5 ISO from VMware portal.
3. Upload ISO in update manager.
4. Create a Host upgrade baseline with the ESXi 6.5 ISO.
5. Put ESX host in maintenance mode.
6. Attached host upgrade baseline and scan the ESX host.
7. Compliance status should be "non-compliant" not Incompatible or any other.
8. SSH to ESX host and search for these conflicting VIBs.
9. Run command like below to find the VIBs

The net-qlcnic is the VIB package containing the Qlogic driver.
Now run the following command to check drivers used on your HBA interfaces:
# esxcli storage core adapter list

Looking at the drivers displayed, Qlogic driver is not in use by any HBA adapters.
The net-qlcnic package can be safely removed from the system through the command:
# esxcli software vib remove -n net-qlcnic


Removed other VIBs as well if required as per above process.

To complete the driver removal procedure, you need to reboot the host
Once ESX host rebooted and came UP in vCenter. Re-scan with upgrade baseline and compliance status should be "non-compliant" now.


Now, Remediate the ESX host with upgrade baseline. Click on finish.


A Remediate task will start and it will take 15-20 mins at least to successfully upgrade the ESX host to 6.5 version.

Once the ESX host upgrade, check the ESXi version, upgrade enic and fnic drivers as well and exit from maintenance mode.

This is a complete process of a ESXi host upgrade !!! Plz share your views and comments.

Thursday, April 4, 2019

VMware Basics Part 1

  1. What is VMKernel and why it is important?
VMkernel is a virtualization interface between a Virtual Machine and the ESXi host which stores VMs. It is responsible to allocate all available resources of ESXi host to VMs such as memory, CPU, storage etc. It’s also controlled special services such as vMotion, Fault tolerance, NFS, traffic management and iSCSI. To access these services, VMkernel port can be configured on ESXi server using a standard or distributed vSwitch. Without VMkernel, hosted VMs cannot communicate with ESXi server.
  1. What is the hypervisor and its types?
A hypervisor is a virtualization layer that enables multiple operating systems to share a single hardware host.  Each operating system or VM is allocated physical resources such as memory, CPU, storage etc by the host. There are two types of hypervisors
  • Hosted hypervisor (works as application i-e VMware Workstation)
  • Bare-metal (is virtualization software i-e VMvisor, Hyper-V which is installed directly onto the hardware and controls all physical resources).
  1. What is Virtualization?
The process of creating virtual versions of physical components i-e Servers, Storage Devices, Network Devices on a physical host is called virtualization. Virtualization lets you run multiple virtual machines on a single physical machine which is called ESXi host.
  1. What are the different types of virtualization?
There are 5 basic types of virtualization
  • Server virtualization: consolidates the physical server and multiple OS can be run on a single server.
  • Network Virtualization: Provides complete reproduction of physical network into a software-defined network.
  • Storage Virtualization: Provides an abstraction layer for physical storage resources to manage and optimize in virtual deployment.
  • Application Virtualization: increased mobility of applications and allows migration of VMs from a host on another with minimal downtime.
  • Desktop Virtualization: virtualize desktop to reduce cost and increase service
  1. What is VMware FT?
FT stands for Fault Tolerance very prominent component of VMware vSphere. It provides continuous availability for VMs when an ESXi host fails. It supports up to 4 vCPUs and 64 GB memory. FT is very bandwidth intensive and 10GB NIC is recommended to configure it. It creates a complete copy of an entire VM such as storage, compute, and memory.
  1. How many vCPUs can be used for a VM in FT?
In vSphere 6.0, there can be up to 4 vCPUs and 64 GB RAM can be used.
  1. What is the name of the technology used by VMware FT?
vLockstep technology is used by VMware FT
  1. What is Fault Tolerant Logging?
The communication between two ESXi hosts is called FT logging when FT is configured between them. The pre-requisition of configuring FT is to configure VMKernel port.
  1. Will the FT work if vCenter Server goes down?
    vCenter server is only required to enable Fault Tolerance on a VM. Once it is configured, vCenter is not required to be in online for FT to work. FT failover between primary and secondary will occur even if the vCenter is down.
  2. What is the main difference between VMware HA and FT?The main difference between VMware HA and FT is: HA is enabled per cluster and VMware FT is enabled per VM. In HA, VMs will be re-started and powered-on on another host in case of a host failure, while in FT there is no downtime because the second copy will be activated in case of host failure.
  3. What is virtual networking?
  4. A network of VMs running on a physical server that is connected logically with each other is called virtual networking.
    1. What is vSS?
    vSS stands for Virtual Standard Switch is responsible for communication of VMs hosted on a single physical host. it works like a physical switch automatically detects a VM which want to communicate with other VM on a same physical server.
    1. What is vDS?
    vDS stands for Virtual Distributed Switch acts as a single switch in a whole virtual environment and is responsible to provide central provisioning, administration, and monitoring of the virtual network.
    1. What are the main benefits of distributed switch (vDS)?
    vDS can provide:
    • Central administration for a data center
    • Central provision, and
    • Monitoring
    1. What is VMKernal adapter and why it used?
    VMKernel adapter provides network connectivity to the ESXi host to handle network traffic for vMotion, IP Storage, NAS, Fault Tolerance, and vSAN. For each type of traffic such as vMotion, vSAN etc. separate VMKernal adapter should be created and configured.
    1. What are three port groups are configured in ESXi networking?
    • Virtual Machine Port Group – Used for Virtual Machine Network
    • Service Console Port Group – Used for Service Console Communications
    • VMKernel Port Group – Used for VMotion, iSCSI, NFS Communications
    1. What is VLAN and why use in virtual networking?
    A logical configuration on the switch port to segment the IP Traffic where each segment cannot communicate with other segments without proper rules mentioned is called VLAN and every VLAN has a proper number called VLAN ID.
    1. What is VLAN Tagging?
    The practice of inserting VLAN ID into a packet header to identify which VLAN packet belongs to is called VLAN tagging.
    1. What are three network security policies/modes on vSwitch?
    • Promiscuous mode
    • MAC address change
    • Forged transmits
    1. What is promiscuous mode on vSwitch?
    The default mode is Reject. If Accept is selected, VM will receive all traffic port group via vSwitch.
    1. What is MAC address changes network policy?
    The default mode of this policy is Reject. If the Accept is selected, a host will accept requests to change the effective MAC address.
    1. What is Forged transmits network policy?
    The default mode is Reject. If Accept is selected, a host will not compare the source and effective MAC address transmitted from a VM.

    vCenter Server

    1. What are the main components of vCenter Server architecture?
    There are three main components of vCenter Server architecture.
    • vSphere Client and Web Client: a user interface.
    • vCenter Server database: SQL server or embedded PostgreSQL to store inventory, security roles, resource pools etc.
    • SSO: a security domain in a virtual environment
    1. What is PSC and its components?
    PSC stands for Platform Services Controller first introduced in version 6 of VMware vSphere which handles infrastructure security functions. It has three main components.
    • Single Sign-On (SSO)
    • VMware Certificate Authority (CA)
    • Licensing service
    1. What are the two main deploying methods of PSC
    You can install PSC in two ways:
    • Embedded
    • centralized
    1. What are different types of vCenter Server deployment?
    It has two deployment types
    • Embedded Deployment
    • External deployment
    1. What is vRealize Operation (vROP)
    vROP provides the operation dashboards for performance analytics, capacity optimization and monitoring the virtual environment.
    1. What is datastore?
    Datastore is a storage location where virtual machine files are stored and accessed. Datastore is based on a file system which is called VMFS, NFS.
    1. What is the .vmx file?
    It is the configuration file of a VM
    1. What information .nvram file stores?
    It stores BIOS related information of a VM.
    1. What .vmdk file does and used?
    Vmdk is a VM disk file and stores data of a VM. It can be up to 62 TB in size in vSphere 6.0 version.
    1. How many disk types are in VMware?
    There are three disk types in vSphere.
    1. Thick Provisioned Lazy Zeroes: every virtual disk is created by default in this disk format. Physical space is allocated to a VM when a virtual disk is created. It can’t be converted to thin disk.
    2. Thick Provision Eager Zeroes: this disk type is used in VMware Fault Tolerance. All required disk space is allocated to a VM at time of creation. It takes more time to create a virtual disk compare to other disk formats.
    3. Thin provision: It provides an on-demand allocation of disk space to a VM. When data size grows, the size of a disk will grow. Storage capacity utilization can be up to 100% with thin provisioning.
    4. What is Storage vMotion?
    It is similar to traditional vMotion, in Storage vMotion, a virtual disk of a VM is moved from datastore to another. During Storage vMotion, virtual disk types think provisioning disk can be transformed to thin provisioned disk.
    1. What is VM Hardware version for vSphere 6.0?
    Version 11
    1. What VM hardware version for vSphere 6.5?
    Version 13
    1. In which version of vSphere PSC was introduced?
    Platform Services Controller (PSC) is introduced in vSphere 6.0. 

Edge node vmid not found on NSX manager

  Hello There, Recently , we faced an issue in our NSX-T envrironment running with 3.2.x version. We saw below error message while running t...