Kubera Release Notes

Avatar
Abhishek Raj
  • Updated

Topics covered in the article:

 

Kubera v2.0.0

Release Summary

The Kubera v2.0.0-ee release emphasizes improvements in CSI-based cStor storage engines. It includes the provisioning of Storage Class for cStor and upgrading OpenEBS from the community to enterprise edition through Kubera. The enhanced supportability features of Mayastor and ZFS Local PV(Beta) are remarkable. Significant improvements have been made in NDM for supporting (and better handling) of partitions and virtual block devices across reboots.

Kubera Director

  • New features and enhancements:

    • Supports installation of the latest version of OpenEBS Enterprise Edition (v2.0.0).
    • Supports upgrade to the latest version of OpenEBS Enterprise Edition (v2.0.0).
    • Supports provisioning a Storage Class for CAS type CStor. With this, a Kubernetes SRE running OpenEBS can perform end-to-end Day-0 operations starting with installation of OpenEBS, provisioning CStor pools to creating Storage Classes.
    • Supports adopting a pre-installed OpenEBS configuration in the following scenarios:
      1. A user’s cluster is running the community edition of OpenEBS 2.0.0 and prior. Kubera provides a UI workflow to upgrade to the latest enterprise edition i.e. OpenEBS 2.0.0-ee for management and future upgrades.
      2. A user’s cluster is running an older enterprise edition of OpenEBS (1.12.0-ee and prior). Kubera provides a UI workflow to upgrade to the latest enterprise edition i.e. OpenEBS 2.0.0-ee for management and future upgrades.

  • Key bug fixes:
    • Fixed an issue with DMaaS where restore was being allowed for a partially failed backup.
    • An enhancement fix to support namespace selection for OpenEBS CSI driver installation based on the Kubernetes version. Starting with OpenEBS 2.0.0-ee, if K8s version is < 1.17, the CSI drivers will be installed in the kube-system namespace. If K8s version >= 1.17, the CSI drivers will be installed in the same namespace as the other OpenEBS components.
    • Fixed an issue with DMaaS where the backup transfer size was being reported as 0 bytes.
    • An enhancement fix to display all DMaaS restores at a project level. This addresses the issue of missing restores in UI if the associated schedule was deleted by the user.
    • Fixed user-audit issues with UI.
    • Fixed an issue for loading state of buttons in UI.
    • Fixed a bug in updating the usages record for Standard subscription.

OpenEBS Enterprise Edition

  • New features and enhancements:

    • OpenEBS cStor provisioning with the new schema and CSI drivers has been declared as a beta version. For detailed instructions on how to get started with new cStor Operators please refer to the Quickstart Guide.
    • Significant improvements to NDM in supporting (and better handling) of partitions and virtual block devices across reboots.
    • OpenEBS Mayastor continues its momentum by adding support for Rebuild, NVMe-oF Support, enhanced supportability, and several other fixes. To know more please refer to this Quickstart Guide.
    • Enhanced the Jiva target controller to track the internal snapshots and re-claim the space.
    • Support for enabling/disabling leader election mechanism which involves interacting with kube-apiserver.
    • Continuing the focus on additional integration and e2e tests for all engines, more documentation.
    • Note that existing StoragePoolClaim (SPC) pools will continue to function as-is and there is support available to migrate from SPC schema to new CSPC schema. In addition to supporting all the features of SPC based cStor pools, the CSPC ( cStor Storage Pool Cluster) enables the following:
      1. cStor Pool expansion by adding block devices to CSPC YAML.
      2. Replace a block device used within the cStor pool via editing the CSPC YAML.
      3. Scale-up or scale down the cStor volume replicas via editing cStor Volume Config YAML.
      4. Expand Volume by updating the PVC YAML.

     

  • Key bug fixes:

    • Fixes an issue where NDM would fail to wipe the filesystem of the released sparse block device.
    • Fixes an issue with the mounting of the XFS cloned volume.
    • Fixes an issue when PV with fsType: ZFS will fail if the capacity is not a multiple of record size specified in StorageClass.

  • Major Limitations and Notes:

    • Provisioning of cStor Pools using StoragePoolClaim(SPC) is supported but it will be deprecated in future releases. The pools provisioned using SPC can be easily migrated to cStorPoolCluster (CSPC).
    • When using cStor Pools, make sure that raw block devices are available on the nodes. If the block devices are formatted with a filesystem or mounted, then cStor Pool will not be created on the block device. For manual steps, please refer to this link.
    • If you are using cStor pools with ephemeral devices, starting with 1.2 - upon node restart, cStor Pool will not be automatically re-created on the new devices. The steps to recover from such a situation are provided here.
    • Capacity over-provisioning is enabled by default on the cStor pools. If you don’t have alerts set up for monitoring the usage of the cStor pools, the pools can be fully utilized and the volumes can get into a read-only state. To avoid this, set up resource quotas as described here.


 

Kubera v1.12.0

Release Summary

The Kubera v1.12.0 release emphasizes improvements in CSI-based cStor storage engines and DMaaS backups. It includes a new onboarding demo feature and a Premium Enterprise Subscription tier for the users. Enhanced supportability features of Mayastor and ZFS Local PV(Beta) are remarkable. The upgradation feature of CSI based cStor pools and volumes makes the OpenEBS Enterprise Edition well grounded and steadfast.

Kubera Director

  • New features and enhancements:

    • Supports installation of the latest version of OpenEBS Enterprise Edition (v1.12.0).
    • Supports upgrades to the latest version of OpenEBS Enterprise Edition (v1.12.0).
    • Supports enabling premium Enterprise subscription on Kubera. User needs to get in touch with the sales/support for availing custom Enterprise subscription.
    • Enabled a new onboarding demo feature where-in a user, post sign-up, is given an option to either connect a cluster or view a demo cluster.
    • Supports listing of Storage Classes of different storage engines.
    • Supports upgrade of cStor pools of kind CSPC/CSPI.
    • Supports upgrade of cStor CSI-based volumes.
    • Supports complete air-gapped installation of Kubera OnPrem.
    • Kubera integration with new CRM - HubSpot.
    • Rebranding existing ‘Data-Motion schedules’ as ‘Backup Strategy’.
    • Supports DMaas for CSI based cStor Volumes.
    • Enhanced user experience of DMaaS to show:
      1. List of strategies and their configuration.
      2. schedules created under a Strategy, their retention duration, backup count under a schedule, last successful backup.
      3. backups under a schedule, volume backups progress, K8s resources that are part of backup, backup expiry time, and few other details.
  • Key bug fixes:
    • Fixed an issue where PVC name was missing in the cluster volumes monitoring graphs.
    • Fixed an issue where the Volumes link was pointing to the Application page in the Project Home dashboard.
    •  Fixed a multithreading issue due to which users couldn't login.
    • Fixed user-audit UI issues.

OpenEBS Enterprise Edition

  • New features and enhancements:

    • Refactoring and adding multi-arch image generation support on the NDM repository.
    • Enhanced NDM Operator to attach events to Block-device CR while processing BDC operations.
    • Added support for btrfs as an additional FS Type.
    • Added support for a shared mount on ZFS Volume to support RWX use cases.
    • Added support for Rebuild, NVMe-oF Support, enhanced supportability for MayaStor.
    • Declared ZFS Local PV as beta.
    • Marked cStor CSI support as a complete feature.
    • Specified the webhook validation policy to fail/ignore via ENV on admission server deployment.

  • Key bug fixes:

    • Fixes a panic on maya-apiserver caused due to PVC names longer than 63 chars.
    • Fixes an issue where the upgrade was failing due to some pre-flight checks when the maya-apiserver was deployed in HA mode.
    • Fixes an issue where the upgrade was failing if the deployment rollout was taking longer than 5 minutes.

  • Major Limitations and Notes:

    • Automatic selection of block-devices for deploying cStor has very limited support.
    • cStor Pool will not be created on the block-device if it is formatted with a filesystem, partitioned, or mounted.
    • cStor Pool will not be automatically re-created on the new devices upon node restart when using ephemeral devices.
    • Capacity over-provisioning is enabled by default on the cStor pools.
    • Working on migration features to easily migrate the clusters to the new cStor schema.

 


Kubera v1.11.0

Release Summary

The Kubera v1.11.0 release features improvements in ZFS Local PV (now in beta), Mayastor (now in alpha), CSI-based cStor storage engines and DMaaS backups. We have built on top of Kubera’s existing foundation in data-agility. A notable highlight of this release: Support for the installation of Mayastor using Kubera Director -- gives you quick access to Mayastor (now in alpha), an SPDK-based storage engine for performance-intensive workloads.

Kubera Director

  • New features and enhancements:

    • Supports installation of the latest version of OpenEBS Enterprise Edition (v1.11.0).
    • Status and replica-count fields added for CSI-based cStor volumes.
    • Workload monitoring is now supported for the latest MinIO versions.
    • Kubera Director UI now supports the latest version of Ember.js (v3.4).
    • Pagination quantity is now available across all screens.
    • Added subscription enhancements for adding webhook handler support in Kubera Director Online.
    • Added detailed extended logging support for Github OAuth.
    • Enhanced stability of subscription feature.
    • Support for ‘Retention count’ feature to delete older backups at backup location.
    • Added support for ‘schedule intervals’ for taking full backups of cStor based volumes.
    • Added Cloudian as a supported backup-provider for DMaaS.
    • Added protection for stateless and stateful applications that are using any kind of Kubernetes persistent volume (DMaaS).

  • Key bug fixes:

    • Fixed issues related to OpenEBS Enterprise Edition installation workflow.
    • Fixed an issue related to missing Google OAuth refresh token.
    • Fixed an issue with UI table filters.
    • Fixed an issue with OpenEBS Enterprise Edition components naming in Kubera OnPrem helm chart.
    • Fixed a memory leak in the server.

  • Alpha Features:

    • Added support for installation of Mayastor using the Kubera Director UI along with OpenEBS Enterprise Edition (advanced installation).

OpenEBS Enterprise Edition

  • New features and enhancements:

    • Added support for Rebuild, NVMe-oF, enhanced supportability to Mayastor (alpha). Click here to read more.
    • ZFS based Local PV storage engine moves to beta. Click here to read more.
    • CSI plugin based cStor storage engine marked as feature-complete.
    • Made enhancements to NDM filters to exclude unusable blockdevices.
    • Enhanced readability for BlockDevice resources in kubectl commands by adding filesystem information.
    • Add support to mount ZFS datasets using legacy mount property to allow for multiple mounts on a single node.
    • Add additional automation tests for validating ZFS Local PV and cStor Backup/Restore.

  • Key bug fixes:

    • Fixes an issue where volumes meant to be filesystem datasets got created as zvols due to misspelled case for StorageClass parameter. The fix makes the StorageClass parameters case insensitive.
    • Fixes an issue where the read-only option was not being set on ZFS volumes.
    • Fixes an issue where incorrect pool name or other parameters in Storage Class would result in stale ZFS Volume CRs being created.
    • Fixes an issue where the user configured ENV variable for MAX_CHAIN_LENGTH was not being read by Jiva.
    • Fixes an issue where cStor Pool was being deleted forcefully before the replicas on cStor Pool were deleted. This can cause data loss in situations where SPCs are incorrectly edited by the user, and a cStor Pool deletion is attempted.
    • Fixes an issue where a failure to delete the cStor Pool on the first attempt will leave an orphaned cStor custom resource (CSP) in the cluster.

  • Major Limitations and Notes:

    • Cloning feature is not available for XFS filesystem on CentOS for ZFS Local PV storage.
    • Labels in CSPI pods show incorrect versions.

 


Kubera v1.10.0

Release Summary

This first-ever release of Kubera includes services and enterprise support plans from MayaData to improve the operations of Kubernetes as a data layer. Kubera includes a free-forever individual tier, as well as paid tiers. Kubera introduces the OpenEBS Enterprise Edition, a platform validated and long-term support distribution of the open-source CNCF project OpenEBS and related components. The Enterprise Edition of OpenEBS brings automated life-cycle management of data layer components in addition to all of the features of OpenEBS 1.10.0 along with rigorous e2e testing, enterprise-grade platform validations, and hardening. Kubera Director introduces a large number of usability improvements and application-focused workflows including off cluster logging and alerting and enhanced back-ups and disaster recovery. Kubera includes all of these features under a single license.

Highlights

Kubera’s key features:

  • Enterprise-grade dataplane on Kubernetes with OpenEBS Enterprise
  • Free-Forever tier so you can always manage your clusters and apps
  • Live Chat with Kubera Engineers: 5 minute SLAs available
  • Monitoring, Logging, and Reporting via Kubera Director
  • Improvements to the Kubera Director and Enterprise Edition components

Kubera Director

  • New features and enhancements:

    • Added basic and advanced UI-based provisioner for OpenEBS Enterprise Edition based dataplane using the Kubera Director GUI. Install OpenEBS simply with one click.
    • Added GUI-based upgrade support for OpenEBS control plane components and cStor (OpenEBS storage engine) pool components, for assisted upgrades to existing pools.
    • Added support for the creation of cStor Pool Clusters (CSPC) and deletion of SPC and CSPC pools using Kubera Director UI. Provision your storage through Kubera Director.
    • Subscription and Billing management: Start using Kubera instantly 
    • Added support for OpenEBS Local PV (local disk and hostdir based storage engine) volume metrics.
    • Added data protection feature for applications using all types of OpenEBS persistent volumes (DMaaS).
    • Kubera OnPrem now comes with an easy-to-use integrated helm3-based installer for both OpenEBS Enterprise Edition 1.10.0-ee and Kubera Director OnPrem 1.10.0-ee. Click here to know more.

  • Key bug fixes:

    • Fixed UI bug where the ‘Upgrade’ button remains in view during an on-going upgrade.
    • Added check for specific components in install jobs.
    • Optimized API calls for labelling nodes.
    • Added check to wait until label values are reflected in the API.

OpenEBS Enterprise Edition

  • New features and enhancements:

    • Replaced cStor orchestration components with new and improved cStorPoolCluster (CSPC) cStor pool and CSI driver based cStor volume provisioner.
    • Added Grafana dashboard to monitor ZFS based Local Persistent Volumes (PV).
    • Added increased granular control over the installation of OpenEBS custom resource components (CRD) using Helm v3.
    • Improved upgrade framework for OpenEBS components.
    • Improved cStor Volume Config operator to support reconciliation of changes for the volume-target deployment.
    • Added refinements to OpenEBS Node Disk Manager’s (NDM) filter to optimize disk detection.
    • Optimized ZFS based Local PV operations.
    • Added flexibility in cStor (OpenEBS storage engine) backup and restore locations.
    • Added support for Chaos testing with Litmus Chaos framework experiments (litmusbook) to validate Jiva’s (OpenEBS storage engine) successful logging.
    • Command line tool ‘jivactl’ can now fetch volume rebuild time estimates when using Jiva storage engine.
    • Added advanced option to increase timeout on cStor volume-replica timeout to optimize rebuild attempts on unstable network environments and low-cost cloud vendors.
    • Kubera E2E testing focuses on all aspects of the product instead of just functionality testing.
    • End-to-end platform validation on Amazon Elastic Kubernetes Service (Amazon EKS) Google Kubernetes Engine (GKE), Azure Kubernetes Service (AKS), D2iQ Konvoy, Red Hat OpenShift, Rancher.
    • Added support for installation via Kubera Director.
    • Critical fixes will be backported to the last two monthly releases and the last major stable release.

  • Key bug fixes:

    • OpenEBS components have been assigned tighter RBAC permissions. (#2850)
    • Fixed issue where the third Jiva replica takes longer to come to RW state. (#2999)
    • Pool size increases when underlying disk capacity is increased. (#3001)
    • Fixed issue where ‘jivactl info’ showed two children for a metafile. (#2965)

  • Major Limitations and Notes:

    • Stale BlockDeviceClaim resource issue where OpenEBS storageClass openebs-device (Local PV storage engine) could not bind to a BlockDevice resource.
    • OpenEBS cStor storage engine does not support NVMe disks with Gravitational Gravity clusters.
    • Detachment and reattachment of virtual disks (e.g. VMware .vmdk files) is not supported for cStor and Local PV storage engines.
    • Migration of cStor pools from one node to another is not supported.

  • Alpha Features:

    • Added upgrade support for CSPC components.
    • Added webhook validation for CSPC expansions.
    • Added upgrade support for cStor CSI.
    • Removed finalizer on Block Device Claim (BDC) CRs once the corresponding Block Device (BD) has been replaced from the CSPC pool.

Related articles

Articles in this section