nimbleos 5.1.4.200 release notes - infosight.hpe.com · end of the software update, you can check...

NimbleOS 5.1.4.200 ReleaseNotes

Version 5.1.4.200

Published May, 2020

Legal Notices

© Copyright 2020 Hewlett Packard Enterprise Development LP. All rights reserved worldwide.

Notices

The information contained herein is subject to change without notice. The only warranties for Hewlett PackardEnterprise products and services are set forth in the express warranty statements accompanying such productsand services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterpriseshall not be liable for technical or editorial errors or omissions contained herein.

Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use, orcopying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documen-tation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standardcommercial license.

Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard Enterprisehas no control over and is not responsible for information outside the Hewlett Packard Enterprise website.

Acknowledgments

Intel®, Itanium®, Pentium®, Intel Inside®, and the Intel Inside logo are trademarks of Intel Corporation in theUnited States and other countries.

Microsoft® and Windows® are either registered trademarks or trademarks of Microsoft Corporation in the UnitedStates and/or other countries.

Adobe® and Acrobat® are trademarks of Adobe Systems Incorporated. Java® and Oracle® are registered trade-marks of Oracle and/or its affiliates.

UNIX® is a registered trademark of The Open Group.

Publication Date

Monday May 18, 2020 16:10:59

Document ID

kri1583967556032

Support

All documentation and knowledge base articles are available on HPE InfoSight at https://infosight.hpe.com.To register for HPE InfoSight, click the Create Account link on the main page.

Email: [email protected]

For all other general support contact information, go to https://www.nimblestorage.com/customer-support/.

2Copyright © 2020 by Hewlett Packard Enterprise Development LP. All rights reserved.

Legal Notices

https://infosight.hpe.com

mailto:[email protected]

https://www.nimblestorage.com/customer-support/

Contents

NimbleOS 5.1.4.200......................................................................................4Important Update Note.........................................................................................................................4

Special Notes.......................................................................................................................................4

New Features in 5.1.4.200.................................................................................................................10

Recent Release Features..................................................................................................................10

Documentation...................................................................................................................................12

Verified Update Paths........................................................................................................................13

Known Critical Issues.........................................................................................................................17

Resolved Critical Issues.....................................................................................................................21

Resolved Issues.................................................................................................................................21

Known Issues.....................................................................................................................................22

Copyright © 2020 by Hewlett Packard Enterprise Development LP. All rights reserved.

Nimble

NimbleOS 5.1.4.200

5.1.4.200Version:

Monday May 18, 2020 16:10:59Revision:

The release notes describe the major changes, fixes, and known issues for this release of the NimbleOS.They do not include all individual fixes and internal changes.

For technical support, contact HPE Nimble Storage Support at:

mailto:[email protected] (877-364-6253), option 2.

Important Update NoteUpdating NimbleOS can involve an update to component firmware on the standby controller. This can causean email alert and automated case indicating "Standby Controller Not Available" when the firmware updateprocess takes longer than five minutes. This is expected behavior and does not affect data services. At theend of the software update, you can check status of both controllers in the Web UI under Manage > Hardware.One controller will be ACTIVE and the other STANDBY under normal operating conditions following asuccessful software update.

All third-party software notices can be found on HPE InfoSight (https://infosight.hpe.com) on the Resources >Nimble Storage > Documentation page:

https://infosight.hpe.com/resources/nimble/docs

The Documentation page also includes the General Terms and Conditions document. You can display thisdocument by performing the following steps:

1 In the navigation pane on the HPE InfoSight Documentation page, scroll through the Document Typelist and select Support Policy.

2 In the page that appears, select General Terms and Conditions. This document opens in a browsertab.

Special Notes

DescriptionNote

HPE Nimble Storage continues to qualify configurations between releas-es. The Validated Configuration Matrix provides information about vali-dated configurations and is updated frequently. It is a good practice tocheck your system configuration against this online tool. The ValidatedConfiguration Matrix tool is available on HPE InfoSight:

https://infosight.hpe.com/resources/nimble/validated-configuration-matrix

CRITICAL

Arrays must be running one of the following versions to update directlyto NimbleOS 5.1.4.200:

• NimbleOS 4.5.4.0 or later• NimbleOS 5.0.4.0 to 5.0.8.0• Nimble 5.1.1.0 or later

CRITICAL


NimbleOS 5.1.4.200 Important Update Note

mailto:[email protected]




DescriptionNote

Arrays with Automatic Switchover (ASO) enabled must have ASO dis-abled before the update to NimbleOS 5.1.4.200 can be performed. Thesoftware update will not proceed if ASO is enabled.

Disable ASO using the steps below:

1 Log in to the array GUI.

2 Choose Administration Availability .

3 Deselect the Enable check box for AutomaticSwitchover.

4 Click Save.

Use Manual Failover for synchronously replicated volumes instead ofASO, or update to NimbleOS version 5.2.1.0 or later.

CRITICAL

Internet Explorer 10 and earlier versions are not supported in NimbleOS4.x and later.

CRITICAL

An extended data services outage may occur with MS iSCSI initiatorand Intel NICs using the built-in Windows driver e1q60x64.sys (version11.0.5.21/11.0.5.22).

If you encounter this problem, please update your system to use thelatest Windows driver.

CRITICAL

A service outage may occur on Windows 2012 R2 hosts using Emulexor Broadcom Fibre Channel HBAs with firmware/driver prior to 11.2.Update the Emulex or Broadcom firmware/driver to 11.2 or later

CRITICAL

Due to a known Red Hat Enterprise Linux bug 1002727, while runningvirtualized in VMware ESX, manually rebooting the active controller inpresence of heavy IOs using the reboot --controller command on aFibre Channel array may trigger an incorrect retry initiated by RHELguests running the following kernel versions:

• 6.4 and earlier• 6.5 without the patch• 7.0 without the patch

This incorrect retry logic may lead to unexpected application behavior.In these environments, we recommend the failover command instead.

CRITICAL

Due to a known Red Hat Enterprise Linux bug 3550561, unexpectedapplication behavior may occur on RHEL 7.5 hosts with kernel-3.10.0-862.3.2.el7 or derivatives using Emulex FC FCoE HBAs (lpfc driver)and raw devices. To avoid this issue:

• If running RHEL 7.6, update to kernel-3.10.0-957.el7 or later.• If running RHEL 7.5z, update to kernel-3.10.0-862.25.3.el7 or later.

CRITICAL


NimbleOS 5.1.4.200 Special Notes

DescriptionNote

As outlined in the current Validated Configuration Matrix, HPE NimbleStorage fully supports Windows guest operating systems on MicrosoftHyper-V, including Virtual Fibre Channel (VFC) connectivity and multi-pathing with HPE Nimble Storage DSM and VSS support. However,Linux guest operating systems running in Hyper-V VFC configurationsare not qualified. Running Red Hat Linux guest operating systems withthe “Linux Integration Services” kit installed, or with hv_storvsc driversin such configurations can lead to Red Hat bug 1364282, which cancause an unexpected service outage.

CRITICAL

Starting with NimbleOS 5.1.1.0, the size of the software package nowexceeds 2 GB, which may lead to lengthier software download times.Previously, the sizes of the NimbleOS 5.0.x download packages wereapproximately 1.6 GB, and NimbleOS 4.x packages were approximately900 MB.

Important

Starting with NimbleOS version 5.1.3.0, the array group now uses JavaDevelopment Kit (JDK) version 1.8.0.212.

This addresses several security vulnerabilities identified in the previousversion of the JDK listed at https:/infosight.hpe.com/user/bulletins.

Important

HPE Nimble Storage CS2xx (except CS235) and CS4xx arrays areblocked from updating to NimbleOS 5.1.1.0 and later releases by default.These arrays will be allowed to update in special circumstances, suchas for group merge and evacuation purposes, and temporary data mi-gration workloads. Contact HPE Nimble Storage Support if you wish toupdate your CS2xx or CS4xx array to NimbleOS 5.1.x.x.

Important

Microsoft Offload Data Transfer (ODX) is not supported if the destinationvolume has synchronous replication enabled.

Important

TRIM on ReFS is not supported by Microsoft on Windows Server ver-sions prior to 2019.

Important

Starting with NimbleOS version 5.0.7.0, the Fibre Channel HBAs willuse an updated firmware (11.4.204). The new firmware addresses anissue in which some 16Gb Fibre Channel HBAs might not auto-negotiateto 16Gb on all ports due to a timing issue within the code of the previousversion of the firmware.

Important

As of vSphere 6.5, VMware is discontinuing the Thick Client (also knownas the desktop or C# Client). As a result, the HPE Nimble StoragevCenter Plugin is deprecating the Thick Client and future releases ofNimbleOS will not support it.

Important



https://infosight.hpe.com/user/bulletins

DescriptionNote

Starting with version 5.0.3.0, NimbleOS includes a restriction that pre-vents you from enabling deduplication when you are using a CS3000,CS5000, CS7000, HF20, HF40, or HF60 array that has fewer than sixSSDs. This restriction is necessary to prevent the possibility of significantperformance issues.

Because NimbleOS 5.0.2.0 and 5.0.1.0 did not enforce this restriction,arrays upgrading from those releases may already have volumes withdeduplication enabled. Any array upgrading to 5.0.3.0 or later withdeduplicated volumes will continue to operate as a dedupe capablearray, regardless of the number of installed SSDs. Such configurationsare not recommended by HPE Nimble Storage.

The following table lists the number of SSDs required for the differentarrays:

Required Number of SSDsArray Model

2 SSDsHF20H

4 SSDsHF20H upgraded to full population

4 SSDsHF20H fully populated and upgrad-ed to HF40H

6 SSDsHF20, HF40, HF60

4 SSDsCS500

4 SSDsCS700

3 SSDsCS1000

6 SSDsCS3000

6 SSDsCS5000

6 SSDsCS7000

Important

You can enable deduplication for CS1000, CS3000, CS5000, CS7000,CS700, and CS500 arrays on a volume only if the corresponding storagepool has a Flash to Disk Ratio (FDR) greater than 4%. To calculate theFDR, obtain the "Total array capacity (MiB)" and "Total array cachecapacity (MiB)" values by using the HPE Nimble Storage CLI commandpool --info pool_name. This command returns the Pool capacity(MiB), which is the "Total array capacity (MiB)", and the Pool cachecapacity (MiB), which is the "Total array cache capacity (MIB)".

Then perform the following calculation:

FDR = "Total array cache capacity (MiB)"/"Total array capacity(MiB)" * 100

If the array has sufficient capability for deduplication, the pool --infocommand will also show a value for dedupe capacity (MiB).

Note On the HF20H, HF20, HF40, and HF60 platforms, pool --infodisplays "N/A" as the value for dedupe capacity (MiB). This becauseyou can enable deduplication for the entire array.

Important



DescriptionNote

For connections to the NimbleOS GUI, you must have port 5392 openfor the Group Management IP address and both diagnostic IP addresses.

Important

VMware has announced End of General Support for vSphere 5.0, 5.1,and 5.5, which includes vSphere Hypervisor ESXi 5.0, 5.1, and 5.5, andvCenter Server 5.0, 5.1, and 5.5. To maintain your full level of supportand subscription from VMware, you should upgrade to a supportedversion of vSphere. Refer to the VMware Knowledge Base articleKB51491.

Important

During deployment of a desktop using VMware Horizon View, a VVol(mapping to a disposable disk) is created. A clone of this VVol is alsocreated and placed within a directory under the virtual machine directorynamed sdd.

When this desktop is deleted from Horizon View, VMware fails to deletethe VVol clone of the disposable disk; only the disposable disk itself isdeleted. This will be fixed in the next vSphere release. VMware bugnumber 1807857 should be used to track this fix.

This issue occurs on all versions of VMware Horizon and vSphere thatsupport VVols:

• Horizon 6 version 6.1 and later• vSphere 6.0 and later

Important

On Windows Server 2012, 2012 R2, 2016, and 2019, the disk optimiza-tion process may record the following error in the Application event log:"The volume was not optimized because an error was encountered:Neither Slab Consolidation nor Slab Analysis will run if slabs are lessthan 8 MB. (0x8900002D)". Although Windows records this as an Errorin the event log, the event can be safely ignored for HPE Nimble Storagevolumes. HPE Nimble Storage volumes do not benefit from or requireslab consolidation.

Important

Numerous host integration toolkits are supported in NimbleOS 5.1.4.200.It is strongly recommended that they be installed on all Windows, Linux,and VMware hosts. For more information about supported toolkits, referto the Validated Configuration Matrix, which is available on HPE NimbleStorage InfoSight:


Important



https://kb.vmware.com/s/article/51491?lang=en_US#q=end%20of%20general%20support%20for%20vsphere%205%205


DescriptionNote

HPE Nimble Storage recommends that you update to HPE NimbleStorage Windows Toolkit (NWT) 7.0.1 or later if you are using MicrosoftVSS Synchronization and NimbleOS 5.1.4.200 or later.

Using application consistent snapshots with earlier versions of NWTand NimbleOS 5.1.4.100 may result in the following error messages:

• In the host's VSS requestor log (C:\ProgramData\Nimble Stor-age\Logs\VssRequestor.log):

PID:1996 TID:5752 ERR reqcommon. cpp:683 Request-Status=QueryStatus(), Function=pAsync->QuerySta-tus(), Error=VSS_E_PROVIDER_VETO, rc=SystemError,ca=ContactSupport

• In the Windows event viewer:

event id 4100: EndPrepareSnapshots method: failedto find LUN s/n <SERIAL_NUMBER> on connected ar-rays. Make sure that the Nimble array version iscompatible with this version of Nimble WindowsToolkit.

event id 4170: Nimble VSS provider is not compati-ble with the current version of the Nimble arraysoftware(). Install appropriate version of theNimble VSS provider.

NWT 7.0.1 resolves this issue.

Important

HPE Nimble Storage Connection Manager (NCM) for VMware 6.1.0 issigned by VMware for ESXi 6.x. It can be installed through the VMwareUpdate Manager or esxcli command without the --no-sig-checkflag.

See NCM for VMware Release Notes 6.1.0 or later and the latestVMware Integration Guide for further details. To locate the latest versionof the guide, log in to HPE InfoSight. Choose Resources > NimbleStorage Documentation. In the left pane, click Integration Guide,then click Connection Manager (NCM) for VMware. From the list dis-played, choose the version of the guide that you want.

Important

Performing a group merge from a source group that contains runningHyper-V virtual machines requires additional care. Group merges requirechanges to the discovery IP address that can adversely impact runningsystems. Therefore, if you perform a group merge, you should plan amaintenance outage to gracefully stop all applications and Hyper-Vvirtual machines on the source group to eliminate unexpected downtimecaused by changing IP address during the group merge process. Atypical group merge should take only a few minutes to complete andthen virtual machines and applications can be restarted.

The group merge and pool merge operations will also have impact onSCVMM. The impact will depend on whether the source and destinationgroups or pools are under SCVMM's management.

Refer to the SMI-S Integration Guide, which includes details aboutSCVMM and the impacts in these situations before performing mergeoperations.

Important



DescriptionNote

Various timeout values affect HPE Nimble Storage targets from Win-dows/Linux hosts. Before you update the NimbleOS, install the HPENimble Storage Windows Toolkit (NWT) or HPE Nimble Storage LinuxToolkit (NLT) on the host or tune the timeout values. Timeout detailsfor various operating systems can be found on HPE InfoSight underResources > Documentation. From the HPE Nimble Storage Docu-mentation page, locate the article you want.

The following Knowledge Base articles and Integration Guides explainhow to configure and verify host timeout settings for the major supportedoperating systems (OS):

• For Windows, refer to KB-000052: Windows Host Disk TimeoutValues.

In the context of Microsoft Windows, the following article should alsobe considered:

KB-000246 MPIO Timeout Parameters for MSDSM and NimbleDSMin Windows 2012 R2

• For VMware, refer to the Common Tasks and Best Practices >Host Timeout Values section of the VMware Integration Guide.

• For Linux, refer to KB-000304: Linux Host Disk Timeout Values.

Important

The Backup Repository performance policy introduced in NimbleOS4.2 cannot be used when replicating against a downstream array runningan older release. Replicated volumes need to be associated at the timeof creation with a performance policy that either exists downstream orthat can be manually created on the downstream array.

Important

New Features in 5.1.4.200The following new feature is introduced in NimbleOS 5.1.4.200:

Support for vSphere 7

NimbleOS 5.1.4.200 provides support for VMware vSphere 7.

Support for SRM 8.3

NimbleOS 5.1.4.200 provides support for VMware Site Recovery Manager (SRM) 8.3. SRM 8.3 provides afully integrated environment for using VMware Virtual Volumes (vVols). It provides protection granularity tothe level of a single virtual machine (VM) on an HPE Nimble Storage array. SRM uses the VASA Providerinstead of the Storage Replication Applicator (SRA) to ensure ease of use when managing vVols.

Support for 32GB Dual-Port Fibre Channel Cards

32GB Dual-port Fibre Channel (FC) cards are supported on all HPE Nimble Storage model AFxx and HFxxarrays.

Recent Release FeaturesThe following new features were introduced in NimbleOS 5.1.x:

SSL Certificate Management GUI Application

The SSL Certificate Management GUI application provides a user-friendly interface to install, import, create,verify and delete various kinds of certificates and certificate signing requests (CSR) for the Certificate Authorityto process.


NimbleOS 5.1.4.200 New Features in 5.1.4.200



https://infosight.hpe.com/InfoSight/media/kb/active/htr1455131698674.whz/index.html


https://infosight.nimblestorage.com/InfoSight/media/kb/active/htr1455131726154.whz

https://infosight.nimblestorage.com/InfoSight/media/kb/active/htr1455131726154.whz


Usage Analytics

HPE Nimble Storage uses Google Analytics to gather data related to GUI usage. The data gathered is usedto evaluate and improve the product.


NimbleOS 5.1.4.200 Recent Release Features

DocumentationThese Release Notes and other user documentation are available on HPE InfoSight:


You can manually reach the documentation page by logging onto HPE InfoSight and selecting Resources >Nimble Storage > Documentation.

Document Search Interface

There are several methods you can use to locate the documents you need.

The Nimble Storage Documentation page provides a search interface that allows you to search for informationacross all documentation, including support and knowledge base articles, best practices, solutions andintegration guides, product documentation, and configuration matrices.

To go directly to a document, use the navigation pane on the left side of the Nimble Storage Documentationpage. The navigation pane organizes documents into categories, including:

• Document Type• Nimble Software and Solutions• Software Version• Integration• Platform

You can use the page scroll bar to move up and down the navigation pane.

Third-Party Software Notices

All third-part software notices can be found in the Documentation Portal on HPE InfoSight.

Here are the steps to manually access the third-party software notices.

1 Log in to HPE InfoSight at https://infosight.hpe.com.

2 From the menu, select Resources Nimble Documentation .

3 In the left navigation pane of the Documentation Portal, scroll through the Document Type sectionand select Support Policy.

4 From the list displayed, select General Terms and Conditions. The document opens in a web browser.

Core User Documentation

The following is the core user documentation for NimbleOS:

• GUI Administration Guide• CLI Administration Guide• SNMP Reference• Command Reference• REST API Reference

Workflow Documents

There are several workflow guides that contain procedures you can perform using either the CLI or the GUI.Each workflow guide covers a specific, frequently performed task related to HPE Nimble Storage products.Each task described by a workflow document is explained in detail in the GUI Administration Guide and theCLI Administration Guide.


NimbleOS 5.1.4.200 Documentation


Hardware

Documentation for all hardware components is available on HPE InfoSight. Click the Hardware Guide link inthe Document Type category. Hardware documentation includes array and expansion shelf installation quickstart guides, upgrade, and replacement guides, and comprehensive hardware guides.

Host Integration Guides

Host Integration Guides are available from HPE InfoSight. To locate these documents on the HPE InfoSightDocumentation page, scroll down the navigation pane to the section called Integration Guide. The availableguides include the following:

• Linux Integration Guide• OpenStack Cinder Driver Integration Guide• SMI-S Integration Guide• UCS Director Open Automation Module Integration Guide• VMware Integration Guide• Windows Integration Guide

Note The version numbers of the host integration guides match the version numbers of their companionIntegration Toolkit software packages.

Integration Toolkits

The following Integration Kits include documents that are associated with the toolkit software. You can searchfor them by entering the HPE Nimble Storage software type and version. The following integration toolkitsare supported:

• HPE Nimble Storage Adaptive Flash Cinder Driver for OpenStack• HPE Nimble Storage AIX ODM• HPE Nimble Storage Connection Manager (NCM) for Linux• HPE Nimble Storage Connection Manager (NCM) for VMware• HPE Nimble Storage PowerShell Toolkit (PSTK)• HPE Nimble Storage Replication Adapter (SRA)• HPE Nimble Storage UCS Director Open Automation for Cisco UCS Director• HPE Nimble Storage Windows Toolkit (NWT)

Note To download Integration Kit software, go to HPE InfoSight (https://infosight.hpe.com) and chooseResources > Software Downloads.

Verified Update Paths

Table 1: From Versions 5.x

From Versions 5.x

To VersionFrom Version

5.1.4.2005.1.4.100

5.1.4.2005.1.4.0

5.1.4.2005.1.3.100

5.1.4.2005.1.3.0

5.1.4.2005.1.2.100

5.1.4.2005.1.2.0


NimbleOS 5.1.4.200 Verified Update Paths


From Versions 5.x


5.1.4.2005.1.1.0

5.1.4.2005.0.8.0

5.1.4.2005.0.7.300

5.1.4.2005.0.7.200

5.1.4.2005.0.7.100

5.1.4.2005.0.7.0

5.1.4.2005.0.6.0

5.1.4.2005.0.5.200

5.1.4.2005.0.5.0

5.1.4.2005.0.4.0

5.0.8.05.0.3.100

5.0.8.05.0.3.0

5.0.8.05.0.2.0

5.0.8.05.0.1.100

5.0.8.05.0.1.0


From Versions 4.x


5.1.4.2004.5.6.0

5.1.4.2004.5.5.0

5.1.4.2004.5.4.0

5.0.8.04.5.3.0

5.0.8.04.5.2.0

5.0.8.04.5.1.0

5.0.8.04.5.0.0

5.0.8.04.4.1.0

5.0.8.04.4.0.0

5.0.8.04.3.1.0

5.0.8.04.3.0.0

5.0.8.04.2.1.0

5.0.8.04.2.0.0

5.0.8.04.1.0.0




From 3.x Versions


5.0.8.03.9.2.0

5.0.8.03.9.1.0

5.0.8.03.9.0.0

5.0.8.03.8.1.0

5.0.8.03.8.0.0

5.0.8.03.7.0.0

5.0.8.03.6.2.0

5.0.8.03.6.1.0

5.0.8.03.6.0.0

5.0.8.03.5.4.0

5.0.8.03.5.3.0

5.0.8.03.5.2.0

5.0.8.03.5.0.0

5.0.8.03.4.1.0

5.0.8.03.4.0.0

5.0.8.03.3.0.0

5.0.8.03.2.1.0

5.0.8.03.1.0.0


From 2.0.x VersionsFrom 2.1.x VersionsFrom 2.2.x, 2.3.x Versions

To VersionFrom VersionTo VersionFrom VersionTo VersionFrom Version

2.1.9.12.0.8.02.3.18.02.1.9.14.5.5.02.3.18.0

2.1.9.12.0.7.02.3.18.02.1.9.04.5.5.02.3.16.0

2.1.9.12.0.6.*2.3.18.02.1.8.04.5.5.02.3.15.0

2.1.9.12.0.5.02.2.9.02.1.7.04.5.5.02.3.14.0

2.1.9.12.0.4.02.2.9.02.1.6.04.5.5.02.3.12.*

2.2.9.02.1.5.04.5.5.02.3.9.*

2.2.9.02.1.4.04.5.5.02.3.8.0

2.2.9.02.1.3.04.5.5.02.3.7.0

2.2.9.02.1.2.04.5.5.02.3.6.0

2.1.9.12.1.1.04.5.5.02.3.4.0



From 2.0.x VersionsFrom 2.1.x VersionsFrom 2.2.x, 2.3.x Versions


2.1.9.12.1.0.04.5.5.02.3.3.0

4.5.5.02.3.2.1

4.5.5.02.3.2.0

4.5.5.02.3.1.0

3.9.2.02.2.11.0

3.9.2.02.2.10.0

3.9.2.02.2.9.0

3.9.2.02.2.7.*

3.9.2.02.2.6.0

3.9.2.02.2.5.*

2.2.11.02.2.3.*

2.2.11.02.2.2.0

2.2.11.02.2.1.0

2.2.11.02.2.0.0


From 1.0.x VersionsFrom 1.3, 1.2, 1.1 VersionsFrom 1.4.x Versions


Contact Support1.0.7.*1.4.6.01.3.*.*2.1.9.11.4.12.0

Contact Support1.0.6.*1.4.6.01.2.*.*2.1.9.11.4.11.0

1.2.2.01.1.*.*2.1.9.11.4.10.0

2.1.9.11.4.9.0

2.1.9.11.4.8.0

2.1.9.11.4.7.0

1.4.12.01.4.*.*



Known Critical Issues

Known Critical Issues in NimbleOS version 5.1.4.200

WorkaroundDescriptionTitleComponentID

When planning to removea member array from group,schedule a planned mainte-nance window and place allESX hosts into mainte-nance mode to minimizeimpact to availability. ESXtypically resumes connec-tion to vVol datastores, andreconnects to VMs, after aperiod of 15-30 minutes au-tomatically without a manu-al intervention.

Scaled vVol environmentswith 500 vVol VDI VMs ormore than 5000 NimblevVol volumes may experi-ence IO disruption whenremoving a member arrayfrom group. Symptom ofproblem would appear asvVol datastores being (inac-cessible). Virtual Machinestatus would also appear as(inaccessible).

Removing mem-ber array frommulti-arraygroup maycause IO disrup-tion to scaledvVol environ-ments

Data ServiceAS-77607

Not applicableDuring snapshot replicationof a dedupe-enabled vol-ume, the downstream arrayfile system may restart dueto an out-of-memory condi-tion.

Snapshot replica-tion of deduplica-tion-enabled vol-umes may leadto File Systemrestart


Not applicableWhen attempting to performa pool merge operation, ifthere are a large number ofvolumes that must bestriped across the pool, andone of the arrays has alarge number of pendingdeletes, then it is possiblefor the operation to fail dueto the Data Service beingoverloaded. Symptoms ofthis behavior are if the poolmerge operation hangs forseveral minutes and returnsthe following message: Therequest could not be under-stood by the server.

Pool merge failsdue to too manypending deletes


Not applicableOn new array installations,when creating the first vVoldatastore on the host, thereis a possibility that thedatastore is inaccessibleinitially. However, it will be-come accessible within 5minutes.

Delay for firstvVol datastorebecoming acces-sible

Host IntegrationAS-100561


NimbleOS 5.1.4.200 Known Critical Issues



Please contact HPE NimbleStorage Support.

Missing IPMI sensors onController B of AFXX andHFXX arrays may lead toincorrect power supply, fanand temperature readings.This may result in falsepower supply, fan, andtemperature alerts followinga controller reboot orfailover.

False powersupply, fan, andtemperaturereadings onController B ofAFXX and HFXXarrays

PlatformAS-89324

Contact HPE Nimble Stor-age Support if there aremultiple restarts to workaround the issue.

In rare cases while commit-ting large internal transac-tions, the process maytimeout. As a result, theData Service may restart torecover the condition.

Data Servicemay restartwhile committinglarge internaltransactions

PlatformAS-103129

Not applicableA file operation which holdsa key lock was taking morethan 30 seconds to com-plete, triggering a healthcheck and restart of dataservices.

Lengthy file oper-ations causedeadlock, restartof services

PlatformAS-86099

In order to add more 4 ormore Proliant Servers, theworkaround is to add up to3 servers at a time from theplugin.

Currently, if customer plansto add 4 or more Proliantsservers in their dHCI deploy-ment via the plugin, the op-eration fails.

Plugin: Cannotadd 4 or moreservers in thedHCI deploy-ment

Not applicableAS-104924

Not applicableThe Automatic SwitchoverService internally createsand closes threads eachtime during AutomaticFailover (AFO) quorum set-up and tear down. This maycause the service to eventu-ally crash after reaching themaximum thread limit. Thesystem recovers automati-cally when the AutomaticSwitchover Service restarts.

AutomaticSwitchover Ser-vice restarts dueto thread limita-tions

System Manage-ment

AS-89701





Not applicable. The ArrayManagement Service recov-ers after the restart.

In some cases, when theBackup Group Leader istransitioning to a memberarray role, the Array Man-agement Service mayrestart unexpectedly. Thisoccurs if the array experi-ences a timeout when theArray Management Serviceis attempting to stop theBackup Group Leader pro-cesses.

Array Manage-ment Servicerestarts when at-tempting to stopthe BackupGroup Leaderprocesses.

System Manage-ment

AS-99277

Reenter passphrase afterAutomatic Failover.

If encrypted volumes areconfigured and AutomaticFailover happens, encrypt-ed volumes wont come on-line automatically after theother array takes overGroup Management ser-vices. The user will need toenter the passphrase onnew group leader array inorder to bring the encryptedvolumes back online.

AutomaticFailover ofGroup Servicesis not supportedfor EncryptedVolumes

System Manage-ment

AS-93553

A Manual Group LeaderFailover will be required torestore Fibre Channel con-nectivity to the hosts.

An Automatic Failover(AFO) of the Group Manage-ment Services will not beinitiated if all Fibre Channel(FC) interfaces on theGroup Leader array fail onboth controllers.

No AutomaticFailover in theevent the hostloses all FC con-nectivity to anarray

System Manage-ment

AS-94737

A failover can be initiated inorder to restart the GroupManagement Service. Youmay also contact HPE Nim-ble Storage Support torestart the service manually.

When performing a con-troller upgrade to a high-end model, the object limitswill still show the lower lim-its if the Group Manage-ment Service is not restart-ed.

Group Manage-ment Servicemust be restart-ed to unlock ad-ditional volumelimits after con-troller upgrade

System Manage-ment

AS-65615





There is no workaround. Toavoid encountering this is-sue, reduce IO load whenperforming software update.

The underlying scale-outdatabase competes withCASL and other systemprocesses for IOPS. Duringsoftware update, a migra-tion script runs against thedatabase. Under heavy filesystem load, the migrationsteps may not completewithin the expected amountof time. As a result, the mi-gration may timeout leadingto a restart of the GroupData Service. After therestart, the migration shouldeventually complete as nor-mal without any user impactor intervention.

Group Data Ser-vice may restartwhen the arrayis under heavyload during soft-ware update

System Manage-ment

AS-81279

Not applicableA system managementprocess can restart whenthe system is under heavyload. The system recoversautomatically. The Dataservice is not affected.

Group Manage-ment Servicerestarts underheavy load

System Manage-ment

AS-100254

Not applicableIn rare occurrences, a cus-tomer-initiated reboot maycause a kernel reboot onthe active controller. Thiswill cause a longer rebootcycle.

Graceful shut-down takeslonger than ex-pected

System Manage-ment

AS-95169

Not applicablePasswords for importing aPKCS12 bundle using cert--import custom --pkcs12...must not contain shellmetacharacters or blanksspaces, because they aremodified by shell parsing.

Shell metachar-acters and blankspaces are notsupported forPKCS12 customcertificate bun-dle passwords

System Manage-ment

AS-99583



Resolved Critical Issues

Resolved Critical Issues in NimbleOS version 5.1.4.200


None. The controller rebootis enough to restore theHigh Availability state.

The array runs post-mortemanalysis when one of theessential NimbleOS ser-vices terminates abnormal-ly. In rare occasions, suchanalysis may consumeenough memory to trip theout-of-memory threshold, atwhich point, the controlleris rebooted in an attempt torestore normal service. HPENimble Storage is currentlystudying ways to run post-mortem analysis with alower memory footprint im-pact.

Unexpectedcontrollertakeover due toout-of-memorycondition

PlatformAS-105757

Not applicableWhen using the Array CLI,the manual pages containoutdated COPYRIGHT infor-mation.

CLI ManualPages have out-dated COPY-RIGHT informa-tion

System Manage-ment

AS-105058

Resolved Issues

Resolved Issues in NimbleOS version 5.1.4.200


For arrays with existingmultiple data subnets hittingthe issue, update the sub-net in the replication partner-ship, as examples: + CLI: ---- partner --pause ---- part-ner --edit --subnet ---- part-ner --resume + GUI: ----Manage -> Data Protec-tion -> Replication Part-ner ---- Pause the partner ---- Edit the partner and setthe replication subnet toManagement ---- Save ----Edit the partner and set thereplication subnet back tothe Data subnet ----Save ---- Resume the partner

In specific circumstanceson array groups with multi-ple subnets configured andsnapshot replication en-abled on a data subnet, theData Service may restartrepeatedly. In some in-stances, this may lead tounexpected host behavioror the array’s inability toserve data to the connectedhosts.

Arrays withReplication en-abled and multi-ple data subnetsconfigured are atrisk of experienc-ing repeated Da-ta Servicerestarts



NimbleOS 5.1.4.200 Resolved Critical Issues

Known Issues

Known Issues in NimbleOS version 5.1.4.200


If RAID is degraded for anextended period and DataService restarts occur, con-tact HPE Nimble Storage toassess adjusting allocatedbuffer resources.

When RAID is degraded, IOneeds to be reconstructedby reading from multipledisks, and an internal buffermay exhaust its allocatedresources. In rare caseswhen multiple disks are de-graded, the Data Servicemay restart unexpectedly.

Data Servicemay restart unex-pectedly whenRAID is in de-graded mode


Data service will be avail-able after restart.

During NimbleOS metadatasync, in rare instances, thedata service may restartunexpectedly. The metada-ta sync operation itself wontbe affected and the restartwill reset the race condition;the data service will stabi-lize after the restart.

Data ServiceRestart due to arace conditionduring metadatasync


Contact HPE Nimble Stor-age Support if the servicerestarts multiple times.

During a volume move, theData Service may restart onthe destination array if in-coming writes reach theirinternal system limit.

Data Servicemay restart dur-ing volumemove operations


Pause the replication tem-porarily, contact HPE Nim-ble Storage Support to ap-ply a workaround, and thenresume replication. Pleasedo not pause replicationpartner if there are any ac-tive snapshots in replicationprogress.

Due to a data structureoverflow in the NimbleOSreplication module, the DataService may restart unex-pectedly when there is ahigh throughput replicationin progress.

Data Servicerestarts unex-pectedly due toreplication mod-ule



NimbleOS 5.1.4.200 Known Issues



Not applicableWhen zero data is writtento an upstream volume in-volved in SynchronousReplication, an internal flagis not passed properlyamong various layers fromupstream to downstream.Then, zero data on the up-stream is treated as SCSIunmaps on the down-stream. As a result, a largespace reporting discrepancycan occur between the up-stream and downstreamvolumes.

Space reportingdiscrepancy be-tween upstreamand downstreamvolume in Syn-chronous Repli-cation configura-tion


Retry operation after a fewminutes to reassign array topool.

Assigning an array to a poolimmediately after unassign-ing it from the same poolwill fail with the followingerror - Failed to assign ar-rays to the pool: A serviceis not running or is notreachable

Unassigning andreassigning ar-ray to a poolwithin 5 minuteswill fail


Remove downstream repli-ca using the correct stepsordered below. 1.Claim the replica volume. 2.Delete all of the snapshotsfor the replica volume. 3.Delete the replica volume.

The service may restartwhen removing the down-stream replica using thesteps below. 1.Deletion of all snapshots forthe replica volume. 2. Claimthe replica volume 3. Deletethe replica volume

Very rare racebetween Volclaim (with allsnapshotsmarked for dele-tion) and spacerecalculation onreplica down-stream volume


None. The Data ServiceRestart would resume nor-mal I/O operations.

A rare scenario can resultinto a race condition be-tween clone creation andI/O operations on an en-crypted volume; during thistime while fetching the en-cryption keys Data Servicemay restart and resumenormal I/O operations.

Data Servicerestart due to arace condition






DSD restart fixes the issue.Volume Manager moduledoes not reset up-calls fromthe Mir module when thearray is trying to shutdown.If the Mir module starts aglobal checkpoint during ashutdown, it may lead to adsd restart since the pend-ing checkpoint was not re-set. Since the array is shut-ting down anyways, the Im-pact of the bug is not huge.A restart fixes the issue.

Volume manag-er does not resetfew callbacksduring the shut-down phasecausing a crash.


To see the correct poolswithin the group, close thecreateDatastore dialog andlaunch the dialog again, se-lecting the group for creat-ing datastore.

When attempting to createa vVol datastore, changingthe selection of the groupdoes not fetch the latestgroup-related pools data.This is caused by a cachingissue.

Error: Could notfind pool in vVoldatastore cre-ation wizard


When this problem occurs,click on any item in themenu (Home, vVOLVMs,etc). and then click on thedatastore to show the prop-er results.

The list view result is notdisplayed properly afterswitching between theVMFS/vVOL datastorewhen clicking paginationrapidly, without waiting forthe resulting pages to load.

Datastore list isnot displayingproperly if previ-ous and nextbuttons arerapidly clickedrepeatedly.


No workaroundWhen you use the HPENimble Storage vCenterPlugin for the HTML 5client, the NimbleOS arraytable header displays ablank instead of displayingthe vVol virtual machine ti-tle. This does not affect howthe client performs.

Instead of vVolVM name, blankspace is dis-played in vCen-ter plugin


Not applicableThe Data Service mayrestart due to a transientresource allocation failure.This happens when theservice cannot complete adisk IO due to transientmemory allocation failure.This does not cause a ser-vice outage as Data servicecontinues normally after arestart.

Data Servicerestart due to re-source allocationfailure.

PlatformAS-103802





Please contact HPE NimbleStorage Support

In rare incidents, controllersdo not power on followingpower cycle.

Controller doesnot power on fol-lowing a powercycle.

PlatformAS-100088

After the controller reboots,BMC firmware is restartedand is functional again auto-matically.

In rare cases, out of ordercommands being sent tothe Baseboard Manage-ment Controller (BMC) mayreturn out of order respons-es that are not handled inthe correct order by Intelli-gent Platform ManagementInterface (IPMI) software. Inthis instance, the IPMImessage queue loses trackof message order. The IPMImessage queue not beingable to return IPMI Watch-dog messages to thewatchdog thread causes thewatchdog thread to timeoutleading to an automatic re-boot. While this BMCWatchdog timeout issue isspecific to the AFx/HFxsystems, this is not a hard-ware issue. Therefore,hardware replacement isunnecessary.

IPMI softwaremay not handlecommand ex-change correctlywith BMC lead-ing to unexpect-ed reboots ofAFx/HFx con-trollers

PlatformAS-90455

Not applicableThe Nimble Drive Error Re-covery (NDER) is activatedfor drives failing I/O in anattempt to recover the drive.In rare cases, the processsurpass the typical SCSItimeout of 60 seconds,causing host I/O inaccessi-bility.

NDER processmay lead to hostreconnects

PlatformAS-96053

Not applicableIn rare cases, an SSD mayreach its endurance limit butcontinues to pass NimbleDrive Error Recovery algo-rithm. This causes a never-ending process of off-liningand on-lining the drive. Thismay occur for Intel andToshiba SSDs.

SSD hasreached its en-durance limit(wear leveling)but the disk isnot markedfailed.

PlatformAS-91522





No workaround is required.The array will recover itselfautomatically by restartingthe Data Service.

On rare occasions, the ar-ray groups Data Servicemay fail to initialize if a shelfstate change occurs simul-taneously.

Delay with DataService startingduring shelfstate change

PlatformAS-101570

Contact HPE Nimble Stor-age Support.

When the SAS HBA detectsfaulty states, to recover, thearray needs to reset theSAS HBA’s firmware. TheSAS HBA firmware resetcan block disk I/Os signifi-cantly longer than our HighAvailability monitoring time-outs allow. Instead, a con-troller reboot is triggeredimmediately if this state isdetected, resulting in anunexpected takeover event.

Unexpectedcontrollertakeover due toincorrect state ofthe SAS HBA

PlatformAS-33725

A valid ESXi license mustbe assigned to the server.

When adding a server withan expired ESXi licensethrough the vCenter plugin,you may see an error say-ing - Failed to submit a taskto add server.

Addition of aserver with ex-pired ESXi li-cense fails

Not applicableAS-95054





NoneIn NimbleOS, the Data Ser-vice and the SCSI HighAvailability Service use thesame logic for processingFibre Channel connections.Due to a software defect inthe Fibre Channel connec-tion termination logic, eitherof these services may stopunexpectedly with a corefileand restart. The softwaredefect occurs when code-paths related to connectiontermination are simultane-ously processed: - process-ing a Connection_Lossevent from the FC driver, forconnection A - performingan implicit logout of connec-tion A, due to receipt of aNew_Connection event fora conflicting connection B(between the same host/ar-ray ports). The restart of theaffected service causes abrief interruption in the ar-rays ability to service incom-ing requests.

Data Service orSCSI High Avail-ability ServiceRestart whenprocessing FibreChannel connec-tions

SANAS-94539

Not applicableWhen shutting down or re-booting the array in aplanned or unplanned fash-ion, or working with HPENimble Storage Support torestart the service individu-ally, the Data Service maycrash unexpectedly duringits normal shutdown se-quence. The service will re-cover automatically. Thereshould be no impact sincethe service is already in theshutdown sequence.

Data Servicemay restart unex-pectedly duringshutdown

SANAS-89933

Not applicableWhen the active controlleris being shutdown, the DataService runs into an internalerror condition that causesthe service to restart unex-pectedly. Since the processis already being shutdown,there is no impact to userdata availability.

The Data Ser-vice restarts un-expectedly dur-ing shutdown

SANAS-98042





Not applicableUnder certain conditions,the Data Service on theGroup Leader array mayrestart unexpectedly whileremoving member array.This is due to a race condi-tion when processing SCSIRTPG (REPORT TARGETPORT GROUPS) com-mands. The service shouldstabilize on its own shortlyfollowing the restart.

Data Servicemay restart unex-pectedly whileremoving mem-ber array

SANAS-101325

Validate the DNS serversdefined on the array andeliminate any inaccessibleor unresponsive DNSservers. If all defined DNSservers have been con-firmed and the Event ser-vice continues to crash,contact HPE Nimble Stor-age Support.

Due to the use ofSIGALARM signals to indi-cate a DNS timeout inlibcurls standard system re-solver, when the signalhappens it can sometimesswitch the application con-text to the signal handler,causing the Event serviceto crash unexpectedly.

The Event ser-vice may crashduring applica-tion contextswitch

System Manage-ment

AS-82317

Correct the DNS or SMTPconfiguration to a valid ad-dress by ensuring that aping to the defined addresssucceeds.

We create multiple threadsto deliver emails, but weuse a non-threadsafe libcurlcall to dispatch them.Therefore, the lock needsto be around libcurl call. Ifthere is a misconfiguredDNS or SMTP server, thecurl call will timeout. If thereare greater than 7 emailswaiting to be delivered andall are suffering a timeout,we will starve the healthchecking for more than the300-second health checktimeout causing the EventManagement service torestart.

Flood of time-outs causingEvent Manage-ment servicerestart

System Manage-ment

AS-68651

Not applicableIf a user tries to create anew user account, but theuser doesnt have the privi-lege to do so, the user cre-ation will fail. However, anaudit log entry is not creat-ed.

No Audit Log en-try is created ifuser does nothave the privi-lege to createuser

System Manage-ment

AS-71090





Not applicableEvery night, when inactivekeys for deleted encryptedvolume are deleted by thearray, it creates an audit logentry with root as the userperforming the action.

Purge inactiveencrypted keysappears in auditlog.

System Manage-ment

AS-107980

When the array is unreach-able at the time of AMT Opscommand marked as NULLand aborted, perform theextract/remove the givenAMT Op from the cookietable. So that It should notcause the check conditionfailure.

To perform the autosupportconfiguration validation, Ni-mOs creates one ATM opi.e., SmAsyncWsSendOp.This ATM op will be addedin the cookie table(i.e.,SmAsyncOpCookieTbl ) sothat the asup validate re-sponse request extract/re-move the given ATM opfrom the cookie table andperform the asup response.The real problem is whenthe array intermediately re-ports unreachable, as percode the given AMT opscommand(i.e., specific toAMT operation) marked asNULL and aborted. But thecookie table has this ATMop which is not clean up.So, when the asupVali-dateResp tries to processATM op, since there is novalid AMT ops commandinformation, causing acheck condition which leadsto GMD crash.

Avoid GMDcrash while per-forming the vali-date autosup-port.

System Manage-ment

AS-104185

Reduce the total email ad-dresses to be fewer than255 characters in bothgroups. Then, retry thegroup merge operation.

The maximum length of theemail addresses is 255characters. The GroupManagement servicerestarts when a user tries toinput email addresses thatmay cross the limit of 255characters during groupmerge operation.

Group Manage-ment servicerestarts whenemail lengthcrosses the limit

System Manage-ment

AS-104440





Not applicableIf there is a network connec-tivity issue between the wit-ness and Group Leader ar-ray, the group status CLIoutput will update theFailover Mode from Auto-matic to Manual until theconnection is reestablished.It also displays the WitnessStatus as N/A as opposedto Unreachable.

group status CLIoutput shows in-correct FailoverMode duringnetwork connec-tivity issues

System Manage-ment

AS-99704

No workaround is needed.The service recovers on itsown.

In Automatic Switchoverenvironments, in rare in-stances, network isolationof the Group Leader andBackup Group Leader maycause the service that han-dles the automaticswitchovers to restart unex-pectedly.

Network isola-tion of the GroupLeader andBackup GroupLeader arraymay lead to Auto-maticSwitchover ser-vice restarts

System Manage-ment

AS-94683

Not applicableWhen network connectivityat a site is flapping, it cancause back to to back auto-shutoffs of the ASD. Theseback to back auto-shutoffsof the ASD can sometimescause a rare ASD crashunder certain conditions.But ASD will come rightback up after the crash andthe system recovers auto-matically

ASD can crashwhen networkconnectivity atthe site is flap-ping

System Manage-ment

AS-95648

This restart is non-disrup-tive to the data on the array,and the Array Managementrecovers after the restartoccurs.

The arrays database sys-tem may become unavail-able for a limited time whenthere is a failure in settingup the Backup GroupLeader. When attempting todiscover a new BackupGroup Leader, the ArrayManagement Service mayrestart due to a race condi-tion.

Array Manage-ment Servicerestarts duringBackup GroupLeader discov-ery

System Manage-ment

AS-98953





Not applicableThe array group CLI com-mand with limits option(group --list-limits) displaysnumeric internal identifiersas part of the informationlisted for the volume infor-mation. These numericidentifiers are used by thearray only and can be ig-nored.

Group limitscommand listsinternal identi-fiers

System Manage-ment

AS-101342

Please contact HPE NimbleSupport.

Following a power outage,it is possible that the Back-up Group Leader is not as-signed to the group. Thismay occur if the SODBdatabase does not start dueto an SSH key issue.

Backup GroupLeader is not as-signed due topower outage

System Manage-ment

AS-99702

Not applicableThere is a --force switchavailable when deleting aperformance policy via theHPE Nimble Storage ArrayCLI. This --force switchdoes not work and will failwith the following: ERROR:Failed to delete perfor-mance policy. Resourcebusy. The --force commandis not supported since thespecified performance poli-cy should not be removedwithout first checking itsvolume or folder associa-tions.

Force deletion ofuser definedperformancepolicy should notbe supported

System Manage-ment

AS-74242

The service will stabilize onits own following therestarting.

The Array Managementservice may restart unex-pectedly when the array isunder high workload.

Array Manage-ment Servicerestarts unex-pectedly underhigh load

System Manage-ment

AS-101420





When attempting to deletea volume collection that isreplicated to the down-stream, make sure thedownstream replicationpartner is not paused.

On a downstream replica-tion partner, the internal ar-ray attributes pertaining tovolumes within a replicatedvolume collection may notbe correctly initialized follow-ing a NimbleOS softwareupdate. If this volume collec-tion is deleted from the up-stream array while thedownstream replicationpartner is paused, the incor-rect attributes may causeGroup Management Serviceto restart on the down-stream replication partner.

Group Manage-ment Servicerestarts whenvolume collec-tion is deleted

System Manage-ment

AS-98363

Not applicableSome internal operationsmay timeout when configur-ing the replication partner,and the following errormessage occurs: Failed tosynchronize configurationto partner. Internally, it willretry as needed in order tocomplete the necessaryprocess to set the Syn-chronous Replication part-ner. No user action is neces-sary.

While editing theschedule to as-sign the Syn-chronous Repli-cation partnerfor a volume col-lection, the fol-lowing error oc-curs: Failed tosynchronizeconfiguration topartner.

System Manage-ment

AS-98561

Please reissue the com-mand. If the operation wasalready performed by theearlier command, an appro-priate message will be re-turned.

Under system busy condi-tions, when an excessiveamount of operations arebeing issued in parallel ortoo many internal retries areoccurring to perform tasks,you may receive a No mes-sage received error after is-suing a CLI command.

Error No mes-sage receivedafter issuing CLIcommand

System Manage-ment

AS-90633

Not applicableDue to a race condition be-tween snapshot creationand deletion, the GroupManagement Service doesnot process a deletedsnapshot properly, causingthe service to restart.

Group Manage-ment restartswhen deleting asnapshot

System Manage-ment

AS-100703





Not applicableIn the case where thedownstream array is reach-ing its snapshot rate limitand the user performs thevolume collection handover,the handover will be abortif the limit is surpassed. Analert will be raised but thealert message may bemissing the reason foraborting handover.

Alert for abortedhandover doesnot specify rea-son

System Manage-ment

AS-98650

vol --list can be used to de-termine pool/folder at-tributes of these volumes.

For the volcoll --info outputfor sync replication volumecollections, the Associatedvolumes: and Associatedpinned volumes: fields lackpool/folder qualification forthe associated volumes.

volcoll --info out-put lackspool/folder quali-fications for asso-ciated volumes

System Manage-ment

AS-90286

Not applicableThe group --list_limits CLIcommand does not list theSynchronous Replicationvolume count Limit. Syn-chronous Replication on5.1.0.0 and later can protectup to 128 volumes.

SynchronousReplication Vol-ume Count Limit

System Manage-ment

AS-89124

Not applicableIn NimOS, we have a de-fined state machine for thereplication workflow. At theend of the execution ofeach step defined in thestate machine, it moves tothe next step. If it leads toany unexpected stepthroughout the workflowthen it will lead to assertfailure which results in GMDrestart.

Group manage-ment servicemay restart dueto assert failure

System Manage-ment

AS-96143

Update the downstreampools Deduplication settingto match the upstream pool.

If the Default Deduplicationsetting differs for upstreamand downstream pools, theconfiguration of deduplica-tion volumes for replicationmight fail with the followingerror Deduplication not al-lowed since no applicationcategory is assigned to theperformance policy

Configuration ofdeduplicationvolumes for syncreplication mightfail

System Manage-ment

AS-90649





Not applicableIn a rare timing issue, theGroup Management Servicefor an array group mayrestart unexpectedly if asnapshot is deleted whileits checksums are beingsent to the downstream ar-ray.

Group Manage-ment Servicerestarts unex-pectedly whensnapshot isdeleted

System Manage-ment

AS-100171

Not applicableIf a user performs multiplevolume collection han-dovers between two arraysduring a short time span,this may cause a situationwhere both upstream anddownstream array mayclaim volume collectionownership. This is due to arace condition in the work-flow.

Both upstreamand downstreammay claim thevolume collec-tion ownershipwhen excessivehandovers areperformed

System Manage-ment

AS-99520

Not applicableIn rare instances the ArrayManagement Service mayrestart unexpectedly after itreceiving a large amount ofinvalid REST API requests.In this case, the REST APIrequest is sent without anobject set, so the segmentin the REST request has anempty object set. When ar-ray attempts to access thesame segment for the ob-ject set information, thatcauses a segmentation faultand leads to an Array Man-agement Service restart.This service restart is non-disruptive.

Array Manage-ment Servicerestarts due toinvalid RESTAPI Requests

System Manage-ment

AS-101941





Please review the networkand see if there is a consis-tent packet loss and fix anynetwork glitches. If youneed any assistance,please reach out to HPENimble Storage Support.

If the network response toa REST request takes morethan 5 minutes, a threadperforming the REST re-quest times out and as aresult Group ManagementService restarts. The ser-vice stabilizes itself and aslong as the network is serv-ing the requests faster. Asingle instance of the GroupManagement service restartshould not cause any disrup-tions.

Group Manage-ment Servicerestarts due topacket loss innetwork

System Manage-ment

AS-91638

Retry the command for thefailed volumes.

Due to a rare race condi-tion, the Group Manage-ment Service may restartunexpectedly during a bulkvolume update operation.

Group Manage-ment Servicerestarts duringbulk volume up-date

System Manage-ment

AS-95610

Not applicableThe Group ManagementService may restart unex-pectedly when an initiatorgroup is created and asnapshot is set offline con-currently. The Group Man-agement Service will stabi-lize following the restart.

Group Manage-ment Servicerestarts whensnapshot is setoffline and initia-tor group is creat-ed

System Manage-ment

AS-99872

The Group ManagementService should self-stabilizefollowing the restart.

In extremely rare instances,due to a race condition withvolume deletion, the GroupManagement service canrestart unexpectedly whenlisting snapshots.

Group Manage-ment servicemay restart dueto a race condi-tion

System Manage-ment

AS-102784

Not applicableIf clones are created usingan unmanaged snapshot,then this unmanaged snap-shot will not be deletedeven if cleanup is enabled.

Unmanagedsnapshots re-main aftercleanup is en-abled

System Manage-ment

AS-93113

Please contact HPE NimbleStorage Support

When the array is poweredon and off excessively, ser-vices may fail to start on thearray.

Services maynot start on thearray after it ispowered on andoff several times

System Manage-ment

AS-101392





Not applicableThe Group ManagementService may restart unex-pectedly when the array isunder heavy load, hasmany snapshots scheduled,has performed a groupmerge in the past, and hasrecently performed an auto-matic Group LeaderFailover.

Group Manage-ment Servicerestarts unex-pectedly follow-ing automaticGroup LeaderFailover

System Manage-ment

AS-100382

Not applicableThe Array ManagementService restarts unexpected-ly following automaticGroup Leader Failover(AFO). The restart is non-disruptive.

Array Manage-ment Servicerestarts unex-pectedly follow-ing automaticGroup LeaderFailover

System Manage-ment

AS-99615

The alarms can be deletedmanually either in the GUIor on the CLI.

After the update to 5.1.x.xor later, the Snapshot limitwarning alarm is no longerused. This presents a situa-tion where stale alarms arepresent on the array andthey will not be clearedeven if the space situationis rectified. The alarm fol-lows the following format:WARNING Mon DD YYYYHH:MM:SS Acknowledged- Volume <volumename> snapshot spaceusage is over the config-ured warning limit.

Snapshot limitwarning alarmspersist after up-date to 5.1.x.x orlater

System Manage-ment

AS-98694

The ASO checkbox is en-abled by default, howeverASO is not enabled until awitness has been config-ured. In the GUI, navigateto Administration >Availability. If witness isconfigured and the ASOcheck box is checked, dis-able ASO by uncheckingthe box and clicking save.Perform the array softwareupdate again. If the updatecontinues to fail with gener-ic messaging, contact HPENimble Support.

Software updates to5.1.4.200 are not allowedwhen Automatic Switchover(ASO) is configured. If asoftware update to5.1.4.200 fails for this rea-son, a generic software up-date failure message is re-turned in the GUI. Thecause of the failure wouldneed to be determined bylooking at the system config-uration and determining ifASO is configured.

Arrays with Auto-maticSwitchover en-abled fail soft-ware updatewith genericmessage

System Manage-ment

AS-106848





Not applicableGroup management servicemay restart during softwareupdate due to race condi-tion involving unlocking thedownload lock file.

Group manage-ment servicemay restart dur-ing software up-date

System Manage-ment

AS-72559

This is an intermittent issue,so if the software updatefails in this manner it shouldpass if the software updateis resumed.

The timing is close enoughthat it is possible for the in-dividual array precheckduring software update totake long enough that thehealth check timeout is trig-gered, causing the groupmanagement process torestart and the software up-date to fail.

Health checktimeout maycause softwareupdate failure

System Manage-ment

AS-66997

Not applicableWhen the HPE NimbleStorage array is configuredto use Active Directory inte-gration, the array is joinedto one specific domain, asa domain member. Undernormal circumstances,users in trusted domainswill also be able to authenti-cate to the array. If one ormore trusted domains arejoined to the forest using anMIT Kerberos type trust re-lationship, users and groupsin any trusted domain (e.g.not the domain the array isjoined to) will be unable toauthenticate to the array.

HPE NimbleStorage arraycompatibility is-sues with MITKerberos trusttypes

System Manage-ment

AS-95212

Once the array is able todetermine its deduplicationcapability, all newly createdvolumes will have dedupeenabled, if specified. In or-der to enable dedupe on thepreviously created volumes,you may run the followingcommand via the HPENimble Storage Array CLI:vol --edit <vol_name>--dedupe_enabled yes

After a CSx000 array is in-stalled, it takes one minutefor the array to determineits deduplication capability.If a volume is created priorto this, it will not havededupe enabled even if thearray is dedupe capable.

Unable to creatededupe enabledvolumes on anew install

System Manage-ment

AS-86545





The Group ManagementService will eventuallyrestart itself

Enabling and disabling thededupe setting on volumesand concurrently deletingvolumes can cause theGroup Management Ser-vices to become temporarilyunavailable on the array.

Group Manage-ment Service istemporarily un-available afterdeleting volumes

System Manage-ment

AS-101535

Not applicableIn rare instances, the GroupManagement Service mayrestart unexpectedly whenthe Group Leader losesconnectivity with its BackupGroup Leader. This occursdue to an erroneous issuewhen one of the arraysdatabase tables is synchro-nizing while the GroupManagement Service isperforming group opera-tions.

Group Manage-ment Servicerestarts whenGroup Leaderloses connectivi-ty to BackupGroup Leader

System Manage-ment

AS-101822

Not applicableCurrently, there is no CLIsupport for changing thewitness port. The nimble-witnessd.service file needsto be edited manually.

No CLI supportfor changing theWitness Port

System Manage-ment

AS-92157

Not applicableA member array might notbe listed under the Add Ar-ray to Group option withinthe GUI if the member isconfigured with a differentprotocol (iSCSI vs FibreChannel). Also when thereare multiple arrays in thesubnet, arrays which cantbe discovered within thestipulated time may not belisted in Add Array toGroup.

Member arraymight not be dis-played underAdd Array toGroup option

System Manage-ment

AS-100067

Not applicableIn rare circumstances, fol-lowing an AutomaticFailover (AFO) a race condi-tion may cause the ArrayManagement Service torestart or an unexpectedcontroller takeover.

Array Manage-ment Servicerestarts orTakeover occursunexpectedlyfollowing auto-matic GroupLeader Failover

System Manage-ment

AS-99431





Not applicableWithin the Nimble ArrayGUI when browsing to theDiagnostics page underAlerts and Monitoring,clicking save without updat-ing the user analyticscheckbox value incorrectlyshows a successful mes-sage.

Clicking savewithout updatingthe user analyt-ics checkboxvalue incorrectlyshows a suc-cessful message

System Manage-ment

AS-100463

Click the X-icon button todelete any unused/emptyinput fields under the sec-tion of FQDN or IP Address-es.

When generating a customcertificate, the user is al-lowed to add empty FQDNor IP Address input fieldson the form and then clickthe GENERATE button.This will produce an errormessage popup (modal)returned from the network(backend).

User is able tosubmit emptyFQDN or IP Ad-dresses whenrequesting cus-tom certificate

System Manage-ment

AS-100989

Not applicableOn the certificate list page,although every listed certifi-cate entry has a checkboxnext to it, the user cannotchoose multiple selectionsfor deletion. The user is al-lowed to only select oneentry to delete at a time.

Only one certifi-cate may be se-lected at a time.

System Manage-ment

AS-99584

Not applicableWithin the HPE NimbleStorage array GUI, customSSL certificate import is on-ly supported on GoogleChrome version 71 or later.

Custom SSLcertificate importnot supported onolder versions ofGoogle Chrome

System Manage-ment

AS-99343

Not ApplicableThe PASSWORD refers tothe one the user needs toenter for the PKCS12 bun-dle file to be imported. Thecorrect phrasing should beBUNDLE PASSWORD.

Ambiguity ofPASSWORDwhen importinga PKCS12 bun-dle

System Manage-ment

AS-99353





To keep the same reminderfrequency and reset thenext reminder time basedon the current time, changethe reminder frequency toa different value, save it,and change it back andsave it, or use CLI to makethe change.

When updating an alarmfrom the Events > Alarmspage in GUI, selecting analarm and clickingCHANGE REMINDER but-ton, without changing thereminder frequency time,and clicking SAVE button,does not change next re-minder time. This behavioris different from CLI. Settingalarm reminder frequencyto the same value from CLIresets the next remindertime based on the currenttime.

Setting alarm re-minder frequen-cy to the samevalue from GUIdoes not changenext remindertime

System Manage-ment

AS-98177

When the controller is backup, all the information isdisplayed correctly onhardware page.

When a controller is down,the user may see incorrectrepresentation of physicalports within the HardwarePage of the array GUI. Thisis due to the lack of informa-tion from the missing con-troller.

Incorrect informa-tion on hardwarepage displayedwhen controlleris down

System Manage-ment

AS-87701

To work around this issue:1. Log into the destinationarray to resolve the con-flicts. 2. Attempt the groupmerge again.

Currently within the HPENimble Storage Array GUI,when performing a groupmerge, if there is a largeamount of group mergeconflicts (1000 or more), theGUI is unable to processand resolve all of them.

Group Merge viaGUI unable toprocess largeamount of con-flicts

System Manage-ment

AS-77372

Not applicableDuring group merge, theGUI might show Successfulmessage even though thegroup merge backend pro-cessing fails.

GUI may showSuccessful mes-sage whengroup mergefails

System Manage-ment

AS-87886

Edit the pool name and as-sign / un-assign the array ain separate steps.

When attempting to edit astorage pool and assign anarray at the same time, youreceive the following error:Cannot update array listand name or description si-multaneously.

Unable to edit astorage pool andassign an arrayat the same time

System Manage-ment

AS-94575





Pool merge is not allowedif Synchronous Replicationis enabled and pool mergeis not allowed when a wit-ness configured. If an arraygroup has a witness config-ured for AutomaticSwitchover and has Syn-chronous Replication config-ured, when a user tries toperform a pool merge, thefollowing error is generated:“pool merge is not allowedwhen witness is config-ured”. In this case, if theuser removes the witnessand then re-attempts thepool merge, the followingerror is then generated:“Pool merge is not allowedwhen involved in sync repli-cation”. This error shouldsupersede the previous er-ror.

Incorrect order-ing of poolmerge errormessages whenSynchronousReplication andWitness are con-figured

System Manage-ment

AS-95591

Run the following commandvia CLI: snap --list --all --unmanaged

The Array GUI does notspecify which snapshots areunmanaged and no longerbelong to a volume collec-tion.

Array GUI doesnot specifywhich snapshotsare unmanaged

System Manage-ment

AS-93157

After a new custom certifi-cate has been imported orexisting certificate is delet-ed, please close the brows-er where the action wasperformed and reopen anew one to guarantee anew connection request tothe NimbleOS web inter-face.

After changing a certificate,the GUI may present an er-ror such as follows: Theweb service is very slow orunreachable...

Browser be-comes unstableupon certificatechange

System Manage-ment

AS-99024

Not applicableWhen updating Users andGroups the ENABLE, DIS-ABLE, and UNLOCK ac-tions now appear under theMore Actions drop-downmenu.

Users andGroups actionshave beenmoved

System Manage-ment

AS-94307

