Administering a Databricks workspace

1. Administering a Databricks workspace

Hello again! This video will cover the basics of administering a Databricks workspace in your cloud environment. It is important to note that you will not have access to the setting discussed in the lesson as part of your learning environment. If you are a Databricks administrator at your organization, you can test these out in another environment you can access. If you are not an administrator, it will still be important to understand the concepts we will discuss here.

2. Account Administrators

The highest level of administration in Databricks is the Account Admin. This initial individual sets up the Databricks Account and has full control over the Databricks deployment. Think of the Account Administrator as your organization's Vice President of Databricks. They will oversee all Databricks activity and typically focus on ensuring that all Databricks environments are set up correctly. Their key responsibilities include creating workspaces, adding users to specific workspaces, governing access to those workspaces, and monitoring the account subscription for billing.

3. Account Console

If you are the Account Admin for your Databricks deployment, you will have access to the Account Console. This can be found at the URL on the screen and allows for various account-wide activities. As you will see later, this will be a key location during the initial setup. In the account console, you can see the total number of workspaces in your account, where your datasets are hosted in the data lakehouse, and how much your account uses from a Databricks Unit, or DBU, perspective.

4. Workspaces

The Workspaces section allows you to see information about all workspaces in your account and even create new workspaces in any cloud as part of your account.

5. Data

The Data section is a single location where you can view and manage your various data catalogs as part of your overall data governance strategy with Unity Catalog.

6. Users & Groups

The Users and Groups section provides a single location to manage how you provide access to your organization once users have been added to your account.

7. Workspace Administrators

Next, we have the Workspace Admin. Think of the Workspace Admin as a Director of a particular area of your organization's Databricks environment. This individual focuses on a specific set of workspaces, usually as part of their business unit within the organization. Their key responsibilities revolve around ensuring their teams have access to the workspace and the needed capabilities to deliver their workloads.

8. Other Administrative Activities

You may also complete many other administrative tasks with Databricks. One common task for administrators is ensuring that Databricks can connect to the rest of your data ecosystem. Within Databricks, there are a couple of main areas where you can accomplish this. Partner Connect lets you directly connect to other technologies in your technology stack. Its UI-based approach lets you easily connect and integrate different tools to Databricks. These tools can include BI tools like Power BI, data ingestion tools like Fivetran, and many more. The Databricks Marketplace lets you discover and acquire third-party datasets from various data providers. You can then easily integrate these third-party datasets into your existing data catalogs, enriching your analytics.

9. Let's review!

Let's review some key concepts to set up our Databricks environment!

Create Your Free Account

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.