Home

v4.5.2.1 Release notes

Focused on Amazon EMR, Azure HDInsight, and Azure Databricks
Software version

Release Date: 08/23/2019

See v4.5.2.1 for download information.

Software Upgrade support
  • Upgrade from 4.5.2.0 only. See here for specific upgrade information.

Unravel sensor upgrade
  • You must install the new sensor when upgrading from Unravel v.4.5.0.5.

Certified platforms

Please review your platform's compatibility matrix below before you upgrade/install.

Updates to Unravel's configuration properties
  • None

Unsupported

All On-Demand Features

  • Sessions

  • Reports

    • Capacity Forecasting

    • Migration Planning

    • Cluster Optimization

    • File Reports

    • Queue Analysis

    • Small Files

    • Top X

  • AutoActions

  • Incorporating true “workflows”, e.g., Databricks jobs orchestration via services like ADF.

  • We have not examined the functionality provided by Cluster Pools and how it can affect Unravel functionality.

  • No support for "interactive clusters"; only Job clusters supported including when New Job Clusters are created.

  • The following have not been tried out/tested.

    • Behavior on setting Maximum Concurrent Runs value to > 1.

    • Spark streaming applications.

  • Unravel's APIs

  • Clusters created without Unravel bootstrap and have an auto-scaling setup are not supported

  • ATSv2.0

  • Head node HA.

  • YARN aggregate logs are not captured for MR jobs. Therefore, the

    • Logs tab for MR jobs is empty.

    • Information in the Errors tab which is derived from the logs isn't available.

  • AutoActions

    • Kill and move actions. (AA-103)

    • Rules that span across multiple clusters, i.e., you can not specify a rule that aggregates metrics from multiple clusters and monitor its violation. (AA-131)

  • AMI/CFN/ARM Template based installation support.

  • No special support for cloud-native constructs, e.g., IAM roles for RBAC etc.

  • Multi-Metastore

    • Unsupported scenario

      When a cluster has more than one metastore or if an external metastore is used (as opposed to the one that comes default with the cluster).

    • Also, the Unravel node, at a given time, can retrieve data from one metastore (it needs to be configured as described in Hive Metastore configuration documentation).

  • Workflows

    • Airflow

  • Azure Marketplace has older versions of Unravel, not this current 4.5.2.1 cloud release.

  • Automatic configuration when Kafka cluster scales up/down.

  • Linking Spark Streaming app topic to Kafka page.

New features and improvements
Bug fixes
Known issues

For support issues, visit Unravel Support.