Prepare with Databricks : Certified-Data-Engineer-Professional exam braindumps as your best preparation materials

A data engineer us ingesting JSON files from cloud object storage using Databricks Auto Loader.
The source folder may occasionally receive large files of data, which risks overwhelming the stream. To ensure predictable micro-batch sizes, the team wants to throttle ingestion based on the volume of data scanned at 1 GB, regardless of the number of files. Which Auto Loader configuration should the data engineer used to achieve this?

• A. Configure cloudFiles.maxFilesPerTrigger and estimate the average file size to approximate a size-based throttle of 1 GB.
• B. Configure cloudFiles.maxPartitionBytes with 1GB to limit data in each partition.
• C. Configure cloudFiles.maxSizePerTrigger with 1 GB to place a limit.
• D. Configure cloudFiles.maxBytesPerTrigger with 1 GB to place a limit.

The downstream consumers of a Delta Lake table have been complaining about data quality issues impacting performance in their applications. Specifically, they have complained that invalid latitude and longitude values in the activity_details table have been breaking their ability to use other geolocation processes.
A junior engineer has written the following code to add CHECK constraints to the Delta Lake table:

A senior engineer has confirmed the above logic is correct and the valid ranges for latitude and longitude are provided, but the code fails when executed.
Which statement explains the cause of this failure?

• A. The current table schema does not contain the field valid coordinates; schema evolution will need to be enabled before altering the table to add a constraint.
• B. The activity details table already exists; CHECK constraints can only be added during initial table creation.
• C. The activity details table already contains records that violate the constraints; all existing data must pass CHECK constraints in order to add them to an existing table.
• D. The activity details table already contains records; CHECK constraints can only be added prior to inserting values into a table.
• E. Because another team uses this table to support a frequently running application, two-phase locking is preventing the operation from committing.

A platform engineer needs to report the resource consumption, categorized by SKU tier, across all workspaces. The engineer decides to use the system.billing.usage system table to create a query. Which SQL query will accurately return the daily usage by product?

• A.
  
• B.
  
• C.
  
• D.
  

A data team is working to optimize an existing large, fast-growing table 'orders' with high cardinality columns, which experiences significant data skew and requires frequent concurrent writes. The team notice that the columns 'user_id', 'event_timestamp' and 'product_id' are heavily used in analytical queries and filters, although those keys may be subject to change in the future due to different business requirements. Which partitioning strategy should the team choose to optimize the table for immediate data skipping, incremental management over time, and flexibility?

• A. Z-order the table with OPTIMIZE orders ZORDER BY (user_id, product_id, event_timestamp)
• B. Partition the table with: ALTER TABLE orders PARTITION BY user_id, product_id, event_timestamp
• C. Cluster the table with: ALTER TABLE orders CLUSTER BY user_id, product_id, event_timestamp
• D. Use z-order after partitiing the table: OPTIMIZE orders ZORDER BY (user_id, product_id) WHERE event_timestamp = current date () - 1 DAY

A Delta Lake table representing metadata about content posts from users has the following schema:
user_id LONG, post_text STRING, post_id STRING, longitude FLOAT,
latitude FLOAT, post_time TIMESTAMP, date DATE
This table is partitioned by the date column. A query is run with the following filter:
longitude < 20 & longitude > -20
Which statement describes how data will be filtered?

• A. Statistics in the Delta Log will be used to identify partitions that might Include files in the filtered range.
• B. No file skipping will occur because the optimizer does not know the relationship between the partition column and the longitude.
• C. The Delta Engine will use row-level statistics in the transaction log to identify the flies that meet the filter criteria.
• D. Statistics in the Delta Log will be used to identify data files that might include records in the filtered range.
• E. The Delta Engine will scan the parquet file footers to identify each row that meets the filter criteria.