Varada Solution Overview

Varada provides the following key features and capabilities:

Varada Catalog

Varada can work with data stored in an Apache Hive data warehouse, as well as with data stored in Apache Iceberg table format.

  • Hive: Varada creates a full copy of the Hive catalog, so that you can access all Hive catalog schemes and tables in Varada under the same full path. For example, you can find the Hive table hive.<schema>.<table> in Varada under varada.<schema>.<table>.

  • Iceberg: Varada creates a full copy of the Iceberg catalog, so that you can access all Iceberg catalog schemes and tables in Varada under the same full path. For example, you can find the Iceberg table iceberg.<schema>.<table> in Varada under varada_iceberg.<schema>.<table>.

👍

The default catalog names are varada for Hive and varava_iceberg for Iceberg. You can customize these by changing the names of the varada.properties and varada_iceberg.properties files.

📘

Learn more about the Hive connector and the Iceberg connector.

Acceleration Instructions

An acceleration instruction defines the materialization type Varada will perform on a column in a table in the Varada Catalog‍ in order to warm up the data in the column. The actual warmup takes place when a query hits the column.

You can manually define instructions from your Varada Control Center‍ or using REST API commands‍.

Supported Data Types

Varada supports all of Presto's built-in data types, including structural data types. While structural data types are accessible with Varada they are not indexed, which can affect performance time.

Text Analytics

Varada provides you with high-performance, full-text-search capabilities based on Lucene. You can create a Lucene index for a string column, and then run queries to quickly and precisely search through large quantities of data.