Prepare with Databricks : Databricks-Certified-Professional-Data-Engineer exam braindumps as your best preparation materials

An hourly batch job is configured to ingest data files from a cloud object storage container where each batch represent all records produced by the source system in a given hour. The batch job to process these records into the Lakehouse is sufficiently delayed to ensure no late-arriving data is missed. The user_id field represents a unique key for the data, which has the following schema:
user_id BIGINT, username STRING, user_utc STRING, user_region STRING, last_login BIGINT, auto_pay BOOLEAN, last_updated BIGINT New records are all ingested into a table named account_history which maintains a full record of all data in the same schema as the source. The next table in the system is named account_current and is implemented as a Type 1 table representing the most recent value for each unique user_id .
Assuming there are millions of user accounts and tens of thousands of records processed hourly, which implementation can be used to efficiently update the described account_current table as part of each hourly batch job?

• A. Use Delta Lake version history to get the difference between the latest version of account history and one version prior, then write these records to account current.
• B. Filter records in account history using the last updated field and the most recent hour processed, making sure to deduplicate on username; write a merge statement to update or insert the most recent value for each username.
• C. Filter records in account history using the last updated field and the most recent hour processed, as well as the max last iogin by user id write a merge statement to update or insert the most recent value for each user id.
• D. Overwrite the account current table with each batch using the results of a query against the account history table grouping by user id and filtering for the max value of last updated.
• E. Use Auto Loader to subscribe to new files in the account history directory; configure a Structured Streaminq trigger once job to batch update newly detected files into the account current table.

Which REST API call can be used to review the notebooks configured to run as tasks in a multi-task job?

• A. /jobs/get
• B. /jobs/list
• C. /jobs/runs/get
• D. /jobs/runs/list
• E. /jobs/runs/get-output

A data engineer is configuring a pipeline that will potentially see late-arriving, duplicate records.
In addition to de-duplicating records within the batch, which of the following approaches allows the data engineer to deduplicate data against previously processed records as it is inserted into a Delta table?

• A. Perform an insert-only merge with a matching condition on a unique key.
• B. Perform a full outer join on a unique key and overwrite existing data.
• C. VACUUM the Delta table after each batch completes.
• D. Set the configuration delta.deduplicate = true.
• E. Rely on Delta Lake schema enforcement to prevent duplicate records.

The following table consists of items found in user carts within an e-commerce website.

The following MERGE statement is used to update this table using an updates view, with schema evaluation enabled on this table.

How would the following update be handled?

• A. The new restored field is added to the target schema, and dynamically read as NULL for existing unmatched records.
• B. The new nested field is added to the target schema, and files underlying existing records are updated to include NULL values for the new field.
• C. The update is moved to separate ' ' restored ' ' column because it is missing a column expected in the target schema.
• D. The update throws an error because changes to existing columns in the target schema are not supported.

A table named user_ltv is being used to create a view that will be used by data analysts on various teams.
Users in the workspace are configured into groups, which are used for setting up data access using ACLs.
The user_ltv table has the following schema:
email STRING, age INT, ltv INT
The following view definition is executed:

An analyst who is not a member of the marketing group executes the following query:
SELECT * FROM email_ltv
Which statement describes the results returned by this query?

• A. The email and ltv columns will be returned with the values in user itv.
• B. The email, age. and ltv columns will be returned with the values in user ltv.
• C. Only the email and itv columns will be returned; the email column will contain all null values.
• D. Three columns will be returned, but one column will be named " redacted " and contain only null values.
• E. Only the email and ltv columns will be returned; the email column will contain the string " REDACTED " in each row.