v4.8.1.0 Release notes
Software version
Release date: August 10, 2023
See 4.8.1.0 for download information.
Software upgrade support
Upgrade is not supported in this release.
For fresh installations, see Installing Unravel.
Certified platforms
The following platforms are tested and certified in this release:
Cloud platforms
Google Cloud Platform (GCP) - BigQuery
Updates to Unravel's configuration properties
See 4.8.x - Updates to Unravel properties.
New features
Installation
More secure ways to get BigQuery data for Unravel monitoring
You can set up Unravel, using any of the following secure authentication methods, to receive data from BigQuery for Unravel monitoring.
VM-based authentication: This method is used when Unravel is hosted on a VM in the GCP compute engine service.
In this method, a service account is created in the project in which Unravel is hosted. Instead of downloading the service account key, the service account is attached to the Unravel VM.
Single key-based authentication: This method is ideal for cases where Unravel is installed on a VM that is hosted outside GCP on any other cloud or on-prem environment.
Only one service account key representing all the projects is integrated with Unravel, which is downloaded and used. This method lets you use a single key instead of multiple keys to help in key rotation.
Terraform is separately provided independent of the installer
Terraform is an open-source software for infrastructure provisioning. The Terraform creates resources on the GCP account and facilitates the smooth integration of Unravel with your cloud platform. Terraform is now provided in both ways; bundled with the installer as well as separated from the installer for independent handling of resource creation and state management.
The external Terraform is available for all the authentication (VM authentication, Single key authentication, and Multiple key authentication) methods available for integrating BigQuery projects.
Refer to BigQuery installation in Installing Unravel.
Support for integration of administration projects
The integration of administrator projects is now supported. These projects help in retrieving reservations data required for Cost 360 observability dashboards.
Support for integrating billing data
You can now export and integrate BigQuery billing data for Unravel querying.
Capture complete cost
Unravel can now capture the complete cost concerning BigQuery, which includes computing, storage, and services. For computing, Unravel can capture the cost for both on-demand and capacity-based (Standard, Enterprise, Enterprise Plus) pricing plans.
Cost optimization
Get 360 degree view into BigQuery spends
You can get a detailed view of your BigQuery spending in terms of services, projects, users, and jobs.
Insights
TopK insights with the highest potential for cost optimization
The TopK insights are provided in the following categories for cost optimization.
Reservations
Jobs
Scheduled Queries
Projects
Alerting
Set alerting based on OpenSearch to detect violations
You can set alerting based on OpenSearch to detect violations and get alerts in your specified notification channels.
Jobs
Side-by-side job comparison
You can compare any two jobs side-by-side to easily identify the difference between the two jobs.
Improvements and enhancements
App Store
Appstore works seamlessly for both MySQL and PostgreSQL DB over SSL/TLS. (APP-674)
Jobs
The sink query in GCP is modified to get only the jobs which has job ID. (BQ-361)
Properties setting
Changed the default behavior of manager config property set command to not override by default, and instead add an explicit --force' option to override. (INSTALL-3230)
Bug fixes
None
Unsupported
On the Data page, File Reports, Small File reports, and file size information are not supported for Dataproc clusters.
Event logs and YARN logs are not loaded for some applications in Google Dataproc clusters. (ASP-1372)
The reservation details in projects from different locations are not immediately visible once it is assigned. It is visible only after you run the first job from that location. Also, the reservation details in projects from different locations do not get removed immediately from the Unravel UI; they are removed only after the completion of the polling period, which is 24 hours. (BIGQ-449)
Cached query jobs are not analyzed on the Data page.(BIGQ-603)
When comparing two jobs on the Jobs page, the Creation time is not shown on the Job details page when Show differences is enabled, even though the creation time is different. (BIGQ-615)
For some cached jobs, if many jobs are running in parallel, the View original query link does not show on the Job details page. (BiGQ-466)
Terraform not deleting SA and Role in specified project ID after running the remove command. (INSTALL-3268)
On the Application details page, the original query link is missing for some cached queries due to the parallel processing of original and cached queries. (BIGQ-61)
Issue: Sometimes, when you process a large number of BigQuery projects with the manager config bigquery integrate command, you may see the following error:
Provider produced inconsistent result after applyWorkaround: Wait for a few minutes and re-run the command. (INSTALL-2860, INSTALL-2934)
Google Cloud Dataproc: Executor Logs are not loaded for Spark applications. (ASP-1371)
SQL events generator generates SQL Like clause event if the query contains a like pattern even in the literals. (TEZLLAP-349)
After upgrading from v4.7.1.1 to v4.7.5.0, the Hive jobs running with the Tez application as an execution engine are not linked. (EMR-406)
After upgrading to v4.7.1.0, Notebooks do not work. You can configure them separately. (REPORT-1895)
After upgrading from v4.6.x to v4.7.1.0, the Tez application details page does not initially show DAG data. The DAG data is visible only after you refresh the page. (ASP-1126)
Jobs are falsely labeled as a Tez App for Oozie Sqoop and Shell actions. (PLATFORM-2403)