A data engineer uploads a CSV file using the Create or modify a table using file upload option in Databricks. To avoid incorrect schema inference, the engineer disables Automatically detect column types before creating a Unity Catalog-managed table.
What is the outcome?
A departing platform owner currently holds ownership of multiple catalogs and controls storage credentials and external locations. The data engineer wants to ensure continuity: transfer catalog ownership to the platform team group, delegate ongoing privilege management, and retain the ability to receive and share data via Delta Sharing .
Which role must be in place to perform these actions across the metastore?
A Delta Live Table pipeline includes two datasets defined using STREAMING LIVE TABLE. Three datasets are defined against Delta Lake table sources using LIVE TABLE.
The table is configured to run in Production mode using the Continuous Pipeline Mode.
Assuming previously unprocessed data exists and all definitions are valid, what is the expected outcome after clicking Start to update the pipeline?
A data engineer investigates a slow stage in the Databricks Spark UI. The engineer scrolls down to the Summary Metrics section for task durations and observes the following metrics for that stage:
25th-percentile duration: 40 seconds
Median duration: 45 seconds
75th-percentile duration: 50 seconds
Maximum duration: 80 seconds
What is the correct interpretation of these metrics?