Spin Up a Varada Cluster

The final step in Deploying Varada Using the Varada Control Center is to spin up a Varada cluster from the Varada Control Center.

📘

Prerequisites

Before you spin up a Varada cluster, ensure you have installed the Varada Control Center.

  1. Go to https://<VCC-HOST>:8888.
    The Varada Control Center onboarding wizard appears to guide you through the setup process.

👍

We recommend that you use the Varada Control Center in Google Chrome.

  1. On the Welcome to Varada Control Center page, define the following values:

    • S3 Location: An S3 bucket for Varada to store configuration information.
    • Metastore: Either glue or the full URI of the metastore, such as thrift://<host>:9083.
    • Schema: The schema associated with Varada.

❗️

The S3 location you specify must be in the AWS region in which you installed your Varada Control Center.

  1. Select Apply. Your entries are validated, and if they are valid the Welcome to Varada page appears.
  1. Click Create New Cluster.
    The Create Cluster page appears with the Configuration tab selected.
  1. In the Configuration tab, define the following details:

    • Name: Type a name for the cluster.
    • Coordinator Machine Type: Select the coordinator machine type.
    • Worker Machine Type: Select the worker machine type.
    • Number of Workers: Type the number of worker nodes for the cluster.
    • IAM Role: Type the name of the IAM role you created for spinning up the Varada cluster in Create Policies and Roles for Varada.
    • SSH Key Name: Select an SSH key.
  2. In the Metastore tab, select the metastore type for the cluster as either Glue or Hive Metastore.

  1. In the Network tab, define the following details:

    • Subnet: Select the subnet in your VPC in which to spin up the cluster.
    • Security Groups: Select Security Groups that allow internal communication and access to port 8080. You can select multiple Security Groups by clicking Add after each selection.
  2. Optionally, in the Tags tab, define AWS tags to be assigned to the cluster.

  1. Optionally, in the Advanced tab, define the following details:

    • SSH Public Key RSA: Specify a key in addition to the SSH Key Name that will be placed on the cluster and will allow users with this public key to establish an SSH connection to the machine.
    • Presto Port: Specify the server port to which applications and clients can be connected via JDBC.
    • Config Properties: Override or add configuration properties such as JMX properties and node properties.
    • User Data: Edit the User Data script.
  2. Click Create.
    When the cluster is up, it appears on the Clusters page.