Unity catalog explorer by misha-db · Pull Request #1871 · databricks/databricks-vscode

misha-db · 2026-03-31T15:43:55Z

Changes

Unity Catalog Features

Tree View

Hierarchical browser: Catalogs → Schemas → Tables / Volumes / Functions → Columns
Filterable by typing (filterOnType)
Only visible when authenticated and extension is active

Node Types

Catalog — name, tooltip with comment
Schema — name, tooltip with comment
Table — type badge (TABLE / VIEW / MATERIALIZED_VIEW), format (delta, parquet, …), tooltip with owner, timestamps, comment; expandable to columns
Volume — type badge (MANAGED / EXTERNAL), tooltip with owner, comment
Function — full name in tooltip
Column — name, data type, nullable indicator (key icon for non-nullable), comment

Context Menu Actions

Copy — copies full qualified name (e.g. catalog.schema.table) for all nodes; copies just column name for columns
Copy storage location — copies storage path for tables/volumes that have one
Copy view SQL — copies view definition SQL for views and materialized views
Open in Databricks — opens the item in the Databricks Explore UI in a browser (not available for columns)
Refresh — re-fetches a specific node and its children (not available for columns)

Toolbar

Refresh button — refreshes the entire Unity Catalog tree

Error Handling

Error nodes displayed inline when a catalog/schema/table listing fails

Tests

UnityCatalogTreeDataProvider.test.ts

anton-107 · 2026-05-28T14:03:38Z

+    ) {
+        this.disposables.push(
+            this.connectionManager.onDidChangeState(() => {
+                this.catalogsCache = undefined;


do we need to clean the childrenCache here as well?

anton-107 · 2026-05-28T14:06:49Z

+            return cached;
+        }
+        const result = await loader();
+        this.childrenCache.set(key, result);


A transient API blip turns this into a sticky error state that survives until the user manually refreshes that exact node. Detect error/empty results and skip caching, or attach a TTL here.

Done, skipping caching results with error nodes

anton-107 · 2026-05-28T14:09:31Z

+    schemaName: string
+): Promise<UnityCatalogTreeNode[]> {
+    const [tablesResult, volumesResult, functionsResult, modelsResult] =
+        await Promise.allSettled([


For workspaces with thousands of tables in a schema this is a heavy initial load, and loadSchemaChildren (loaders.ts:107) fires four such drains in parallel before the user sees anything. Consider adding a max-items cap with a "load more" sentinel

anton-107 · 2026-05-28T14:11:55Z

+            "databricks.unityCatalog.showDetail",
+            showDetail
+        ),
+        treeView.onDidChangeSelection(async (event) => {


Performance concern for big catalogs:

Selection auto-opens the detail panel on every keyboard arrow — onDidChangeSelection fires on every focus change, not just clicks. Arrow-key browsing through a large tree will repeatedly create + post to the webview, and on schema/table selection will kick off loadNodeEnrichments (4 parallel API calls each). Consider gating this on an explicit user action or introduce a debounce.

anton-107 · 2026-05-28T14:13:27Z

+        }
+
+        // eslint-disable-next-line @typescript-eslint/no-explicit-any
+        const stored: StoredFavoriteNode = {...node} as StoredFavoriteNode;


This will carry stale metadata as it deep-copies the whole node and stores it in workspace state.

Owner/comment/format/storageLocation will silently age until the table is re-fetched; renamed or deleted favorites will display indefinitely. Store only {kind, fullName, version?} and rehydrate from a fresh fetch when the Favorites root is expanded.

I haven't found API for loading UC resources in bulk by fullnames, meaning if we rehydrate from a fresh fetch it will be N calls (where N is the number of pinned/favorite nodes). this might not be an issue, assuming most users might have 2-5 favorite resources

anton-107 · 2026-05-28T14:16:04Z

+    }>;
+}
+
+async function loadChildrenForNode(


Does this re-implement loaders.ts:loadSchemaChildren for the no-cache path? Consider deduplicating; otherwise the two implementations will drift

cleaned up detailLoader.ts, re-uses loaders, extracting mapping code into mappers.ts

- introduce mappers tor reduce boilerplate

anton-107 · 2026-06-03T13:15:40Z

+        const staleKeys = new Set(
+            refs.filter((_, i) => results[i] === null).map(favoriteKey)
+        );
+        if (staleKeys.size > 0) {
+            const cleaned = refs.filter((r) => !staleKeys.has(favoriteKey(r)));
+            await this.stateStorage.set(
+                "databricks.unityCatalog.favorites",
+                cleaned
+            );
+        }


New issue introduced by the favorites-ref refactor: this prunes any ref whose loadFavoriteNode returned null and persists the removal. But loadFavoriteNode wraps everything in catch { return null }, so a transient network/5xx/auth error is indistinguishable from a genuinely deleted object — meaning a single API blip while expanding Favorites will permanently delete the user's favorites from workspace state.

This is the same failure mode as the error-caching comment from the last round (transient blip → wrong durable state), but worse here since it's destructive and persisted rather than just a stale cache entry.

Suggestion: only prune on a confirmed "not found" (404). Have loadFavoriteNode return a discriminated result, e.g. {status: "ok", node} | {status: "gone"} | {status: "error"}, and remove the ref only on "gone". On "error", keep the ref and surface an error/placeholder node instead of silently dropping it.

github-actions · 2026-06-03T15:27:18Z

If integration tests don't run automatically, an authorized user can run them manually by following the instructions below:

Trigger:
go/deco-tests-run/vscode

Inputs:

PR number: 1871
Commit SHA: 5b51d3485fb0b69b1e74d711bc6e3d5aa2a58ed0

Checks will be approved automatically on success.

misha-db added 10 commits March 24, 2026 16:26

Unity Catalog

3da6754

[WIP] Unity catalog explorer

f6d7ce2

Merge branch 'main' into unity-catalog

518af44

Open links of unity catalog items in Databricks

ef21013

Adjust color scheme for dark/light themes

56cc6bb

Fix explore url

5569d33

Fix function explore url

8f2013e

Allow explore external links for tables and volumes

f1cb458

Fix copy for nodes

26eb963

Refactor and do cleanup

4181213

misha-db requested a review from ilia-db March 31, 2026 15:44

ilia-db reviewed Apr 2, 2026

View reviewed changes

misha-db added 4 commits April 2, 2026 18:33

Add search item icon. Show empty node when no children returned.

dd417b0

Pin/Unpin schema

c9981d0

Sort by ownership

7945371

Add TODO

f9db373

misha-db temporarily deployed to test-trigger-is April 3, 2026 09:38 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is April 3, 2026 09:39 — with GitHub Actions Failure

Support registered models

d6ca008

misha-db temporarily deployed to test-trigger-is April 3, 2026 14:48 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is April 3, 2026 14:49 — with GitHub Actions Failure

misha-db added 3 commits April 3, 2026 19:12

Address PR comments

a47de90

Move logic out of tree provider

5d2ff6a

Fix tests

c95375d

misha-db temporarily deployed to test-trigger-is April 3, 2026 21:32 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is April 3, 2026 21:33 — with GitHub Actions Failure

Add details view

9a4dc47

misha-db temporarily deployed to test-trigger-is April 7, 2026 17:26 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is April 7, 2026 17:27 — with GitHub Actions Failure

Merge branch 'main' into unity-catalog

94eed51

misha-db temporarily deployed to test-trigger-is May 21, 2026 12:20 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is May 21, 2026 12:20 — with GitHub Actions Failure

Fix tests

e772ca9

misha-db temporarily deployed to test-trigger-is May 25, 2026 11:09 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is May 25, 2026 11:10 — with GitHub Actions Failure

Fix linter warnings

b1c0c1a

misha-db temporarily deployed to test-trigger-is May 25, 2026 12:48 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is May 25, 2026 12:49 — with GitHub Actions Failure

Fix tree node children edge case

2661c0a

misha-db temporarily deployed to test-trigger-is May 25, 2026 14:11 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is May 25, 2026 14:12 — with GitHub Actions Failure

misha-db added 2 commits May 25, 2026 21:09

Fix node expansion test

3ccb1a4

Fix test

c7e1972

misha-db temporarily deployed to test-trigger-is May 25, 2026 17:10 — with GitHub Actions Inactive

misha-db had a problem deploying to test-trigger-is May 25, 2026 17:11 — with GitHub Actions Failure

misha-db added 2 commits May 27, 2026 14:55

Cleanup

57e35b0

Formatting

1c14059

anton-107 requested changes May 28, 2026

View reviewed changes

misha-db added 5 commits May 28, 2026 18:45

Invalidate children cache as well

c3d3440

Skip caching children in case of errors

e0713d9

Cleanup

64eeddc

Store favorite references instead of full data and hydrate on load

8323d60

- introduce mappers tor reduce boilerplate

remove duplicated code in detailLoader.ts

1fd8334

anton-107 reviewed Jun 3, 2026

View reviewed changes

misha-db added 3 commits June 3, 2026 18:01

Handle loading favorites error case

c4cf609

Revert databricks icon resize

60cc1fa

Merge branch 'main' into unity-catalog

5b51d34

anton-107 approved these changes Jun 3, 2026

View reviewed changes

github-actions Bot mentioned this pull request Jun 4, 2026

Release: v2.11.0 #1902

Merged

Conversation

misha-db commented Mar 31, 2026

Changes

Unity Catalog Features

Tree View

Node Types

Context Menu Actions

Toolbar

Error Handling

Tests

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

github-actions Bot commented Jun 3, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants