Databricks Databricks-Certified-Data-Engineer-Associate Exam With Confidence Using Practice Dumps

 The Tasks tab in the Jobs UI shows the list of tasks that are part of a job, and allows the user to view the details of each task, such as the notebook path, the cluster configuration, the run status, and the duration. By clicking on the active run of a task, the user can access the Spark UI, the notebook output, and the logs of the task. These can help the user to identify the performance bottlenecks and errors in the task. The Runs tab in the Jobs UI only shows the summary of the job runs, such as the start time, the end time, the trigger, and the status. It does not provide the details of the individual tasks within a job run. References: Jobs UI, Monitor running jobs with a Job Run dashboard, How to optimize jobs performance

 Databricks SQL allows users to schedule queries to run automatically at a specified frequency and time zone. This can help users to keep their dashboards or alerts updated with the latest data. To schedule a query, users need to do the following steps:

• In the Query Editor, click Schedule > Add schedule to open a menu with schedule settings.
• Choose when to run the query. Use the dropdown pickers to specify the frequency, period, starting time, and time zone. Optionally, select the Show cron syntax checkbox to edit the schedule in Quartz Cron Syntax.
• Choose More options to show optional settings. Users can also choose a name for the schedule, and a SQL warehouse to power the query.
• Click Create. The query will run automatically according to the schedule.

The other options are incorrect because they do not refer to the correct location or frequency to schedule the query. The query’s page in Databricks SQL is the place where users can edit, run, or schedule the query. The SQL endpoint’s page in Databricks SQL is the place where users can manage the SQL warehouses and SQL endpoints. The Jobs UI is the place where users can create, run, or schedule jobs that execute notebooks, JARs, or Python scripts. References: Schedule a query, What are Databricks SQL alerts?, Jobs.

The query performing a streaming hop from raw data to a Bronze table is identified by using the Spark streaming read capability and then writing to a Bronze table. Let's analyze the options:

• Option A: Utilizes .writeStream but performs a complete aggregation which is more characteristic of a roll-up into a summarized table rather than a hop into a Bronze table.
• Option B: Also uses .writeStream but calculates an average, which again does not typically represent the raw to Bronze transformation, which usually involves minimal transformations.
• Option C: This uses a basic .write with .mode("append") which is not a streaming operation, and hence not suitable for real-time streaming data transformation to a Bronze table.
• Option D: It employs spark.readStream.load() to ingest raw data as a stream and then writes it out with .writeStream, which is a typical pattern for streaming data into a Bronze table where raw data is captured in real-time and minimal transformation is applied. This approach aligns with the concept of a Bronze table in a modern data architecture, where raw data is ingested continuously and stored in a more accessible format.

References:Databricks documentation on Structured Streaming: Structured Streaming in Databricks