Platform Serverless Real time inference exposes your Mlflow ML model as a rest api endpoint. Databricks terraform provider updated to version 1.10.1 Variable explorer in Databricks Notebooks, you can directly observe current Python variables and their value in the notebook UI. (Requires DBR12.x) Databricks extension for Visual Studio Code lets developers leverage the powerful authoring […]
Platform We have added left and right sidebars to the Databricks notebook. You can now find the notebook’s table of contents in the left-hand sidebar, and you can find comments, MLflow experiments, and the notebook revision history in the right-hand sidebar. Databricks integration with Confluent Schema registry now supports external schema registry addresses with authentication. […]
Platform The workspace administrator setting to disable the uploads data UI now applies to the new upload data UI Memory profiling is now enabled for PySpark UDF.(Runtime 12) Jobs are now available in global search DBR 12.0 and 12.0 ML are GA Databricks Terraform provider updated to version 1.7.0 Databricks ODBC and JDBC drivers were […]
Platform You can filter by job name with the List all jobs operation ( GET/Jobs/List) in the jobs API Databricks Terraform provider updated to version 1.6.4 to add the warehouse_type parameter to the databricks_sql_endpoint resource to support additional Databricks SQL warehouse types, and more. When you click the Search field in the top bar of […]
Platform Databricks Runtime 11.2 and 11.2 ML are GA Support for AWS Graviton instances is GA You can use Data Explorer to search for tables that are registered in Unity Catalog, only the tables that you have permissions to see appear in search results View and organize assets in the workspace browser across personas Table […]
Governance Unity Catalog is now GA Delta Sharing is now GA Identity Federation is now GA Databricks SQL Serverless SQL Warehouse: Worker nodes are private, which means they do not have public IP addresses. Serverless warehouses use a private network for communication between the Databricks control plane and the Serverless data plane, which are both […]
Destination Lakehouse Focus on the Lakehouse as a next generation platform, merging data lake & lakehouse. Simplify all data with 1 platform for data & AI instead of a separate DW for SQL/ dashboarding. Benchmarks on Data Warehousing & lakehouse workload. But beyond benchmarks & costs this allows companies to unlock advanced use-cases that we […]