Home

v4.4.0 Release notes

Software version

Release Date: 09/17/2018 for 4.4

For details on downloading updates see here.

4.4.0.1 Hotfix

Certified platforms

Please also review the Compatibility Matrix before upgrade/install.

  • CDH: On-premise CDH 5.12, 5.13 & 5.14 (incl. Spark 2.3.x) with Kerberos.

  • HDP: On-premise HDP 2.6.3.0 with Kerberos & spnego enabled.

  • MapR: 6.0.0 with MapR Expansion Packs 4.1.1.

Unravel sensor upgrade

  • Not Applicable for Fresh Installation

New features

  • Reports

    Multiple reports have been added to enable to you manage and tune your cluster and its resources. You must have OnDemand installed and use MySQL to use these features.

    • You can schedule reports to run at specific times and days.

    • All reports are archived and available to be viewed or downloaded until you delete them.

    • Cluster Optimization - generates cluster wide default recommendations to tune your cluster. Hive and MapReduce is currently supported.

    • Forecasting – uses historical disk capacity usage to extrapolate future disk needs.

    • Small Files – analyzes your directories, using your file size criteria, to help manage costly small file proliferation.

  • Impala

    • Insights have been greatly enhanced.

    • Auto actions templates for long-running Impala queries and rogue Impala HDFS RW have been added.

  • HBase Cluster - Support for HBase Cluster has been added.

  • Sessions - Ability to tune/auto tune your applications.

  • PostgreSQL 10.2.1 is now the default database embedded in the RPM

Improvements and bug fixes

Improvements
  • Improved detection of unresponsive YARN applications. (PLATFORM-659)

Bug fixes
  • Customer fixes

    • Failed jobs are only shown if Application ID is available (CUSTOMER-192)

    • Cluster Workload Report populates correctly. (CUSTOMER-209, CUSTOMER-211)

    • Reduced unravel_ngui daemon startup time. (CUSTOMER-244)

    • Enabled "search" by app name field on Applications page tabs. (CUSTOMER-263)

    • Removed unnecessary fields from MapReduce Timeline view. (CUSTOMER-279)

    • Tez tagged workflows are now working correctly. (CUSTOMER-272, CUSTOMER-282)

  • Kafka

    • Added the ability to show more than one active broker at a time (CUSTOMER-93)

    • Need the ability to show Kafka graphs aggregated at cluster level not per broker (UIX-660)

  • com.sun.management.jmxremote.port is disabled for all unravel processes due to JMX vulnerability concerns. (PLATFORM-382)

  • Spark

    • Spark UI Navigational issues are fixed (USPARK-122,USPARK-127)

    • Spark Execution DAG arrow direction is fixed (USPARK-120)

    • Spark Event will be shown only if Events are available (USPARK-124)

  • Tez

    • Various improvements in Tez pipeline efficiency (TEZLLAP-110)

Known issues

  • YARN applications might be reported as RUNNING even though they are still waiting to be scheduled. (PLATFORM-715)

  • Global search returns multiple results for single Hive Query ID (UIX-1224)

  • CMP API issue picks up data ~4 days later than the earliest data point viewable (SESS-60)

  • AutoActions are not triggering for long running Hive apps with Tez as Execution Engine (PLATFORM-643)

Configuration properties

See here.

Software Upgrade Support

  • New install only; upgrades are not supported.

4.4.0.1 Hotfix

Release Date: 10/11/2018

This hotfix addresses the below issues.

Issue ID

Component

Description

CUSTOMER-352 / PLATFORM-736

Tez

Tez applications don't show up in Unravel UI.

TEZLLAP-189

Tez

Event Worker will crash when "com.unraveldata.yarn.timeline-service.webapp.address" is not configured.

CUSTOMER-358

LDAP

LDAP Authentication fails when hive.server2.authentication.ldap.groupFilter is configured.

SENSOR-73

Hive Sensors

Hive apps don't show up due to differences in API return values in FileSinkDesc API

For support issues, contact Unravel Support.