The Data intelligence platform

The Databricks Data Intelligence Platform allows your entire organization to use data and AI. It’s built on a lakehouse to provide an open, unified foundation for all data and governance, and is powered by a Data Intelligence Engine that understands the uniqueness of your data.

Build Your own RAG Application on Databricks

Databricks Vector Search is engineered for optimal performance at a reduced total cost of ownership (TCO), boasting up to 5 times lower latency compared to alternative providers. It offers a streamlined and rapid developer experience, allowing easy synchronization of any Delta Table into a vector index with a single click, eliminating the need for intricate, custom data ingestion or synchronization pipelines. Additionally, Vector Search provides unified governance by leveraging the same Unity Catalog-based security and data governance tools as the Data Intelligence Platform, eliminating the necessity for developing and managing a separate set of data governance policies for unstructured data.

Get to know how to get started with Databricks Vector Search

Ai Generated Comments

-Building your semantic layer is getting easier. AI-Generated table comments automatically describe your data assets.

Databricks Assistant

• Databricks Assistant is a context-aware AI assistant, available natively in Databricks notebooks, SQL editor and file editor. Databricks Assistant lets you query data through a conversational interface, making you more productive inside Databricks.

Get to know how to get started with the Databricks Assistant

AI Chatbot

The AI chatbot is intended to help quickly answer questions that can be answered with Databricks documentation and knowledge bases. Its answers are based on documentation that the AI can find related to the question.

Get to know how to get started with the AI Chatbot

Databricks marketplace

It’s an open marketplace for all your data analytics and AI which expands your opportunity to deliver innovation and advance all your analytics and AI initiatives.

Databricks marketplace now includes the solution accelerators which provide fully functional notebooks,best practices and sample data to get your set up quickly with popular use cases.

You can get the data product from the marketplace with Delta Sharing connectors to access various platforms like Power BI, Excel, Apache Spark and Databricks Workspace without Unity Catalog

In order to simplify the user experience you can now find data sets, AI Models and Solution Accelerators in the marketplace using the global search Bar.

Unified Data Platform

Lakehouse Federation addresses critical pain points that make it simple for organizations to expose, query and govern siloed data systems as an extension of their lakehouse. To enrich the user experience, you can now configure Lakehouse federation to run queries with the BigQuery Connector Type.

Evolution of Data governance in Databricks

Unity Catalog will be enabled automatically for all the new workspaces.

Improvements in Unity Catalog:

-You can Delete/ Download files in the catalog explorer for files in Volume

-You can now install libraries stores as a workspace files to compute configured with no-isolation shared access mode in DBR 14.1 +

-You can now grant user permission to create a storage credential in a Unity Catalog metastore using the new privilege. For more information documentation

-Shallow clone for Unity Catalog external tables ( DBR 14.1+)

In a nutshell

• Databricks Runtime 14.2 is GA. For more information: Link
• Authentication using OAuth is GA
• Deprecation of Workspace Libraries
• Access Controls lists can no longer be disabled
• IAM Policies for storage credentials now require an external ID