Azure Data Engineer Interview Questions

EY Interview Question For Azure Data Engineer  - 1st Round

=================================================

1)How do you identify and remove duplicate records from a table in SQL Server or Azure SQL Database?

2)Is it possible to delete records from the main table using a Common Table Expression (CTE)? If yes, how?

3)If your sink tables are empty, how can you copy multiple tables from Azure SQL Database efficiently using Azure Data Factory?

4)What is the difference between the Web activity and the Webhook activity in Azure Data Factory?

5)Can you explain the purpose and use cases of the Script Activity in Azure Data Factory?

6)How do you securely connect to an Azure SQL Database using Azure Key Vault instead of directly using credentials like username and password?

7)If Azure Databricks is already being used for data transformations, in what scenarios would you still prefer to use Azure Data Flow?

8)Can you explain Slowly Changing Dimension (SCD) Type 2 and its implementation in a data warehouse?

9)In SCD Type 2, what is the significance of the ‘End Date’ column, and how is it used to maintain historical data?

10)What is a surrogate key, and why do we use it when a primary key already exists in the source system?

11)In a data warehouse loading process, which tables should be loaded first — fact tables or dimension tables — and why?

Volkswagon Interview Question For Azure Data Engineer  - 1st Round

========================================================

1)Explain the concept of a Broadcast Join in Spark. When and why is it used?

2)What is the difference between DELETE, DROP, and TRUNCATE commands in SQL?

3)What types of constraints are available in SQL?

4)Differentiate between a Primary Key and a Foreign Key.

5)What is the difference between a Primary Key and a Unique Key?

6)Why does SQL Server allow only one NULL value in a Unique Key, while MySQL allows multiple NULLs?

7)If you perform all types of SQL joins between two tables, how many records would you expect to retrieve?

8)What is the order of execution of SQL clauses in a query?

9)What Integration Runtimes (IR) are available in Azure Data Factory?

10)What are triggers in Azure SQL Database, and how are they used?

11)What is the difference between Azure Data Lake Storage Gen2 and Azure Blob Storage?

12)You have 10 on-premises files. How would you use Azure Data Factory to load them into a single ADLS table in Parquet format?

13)Explain the Medallion Architecture (Bronze, Silver, Gold layers) in Azure Databricks.

14)What are the advantages of using Delta Tables in Azure Databricks?

15)Can you describe a scenario where you use both daily full loads and incremental loads in your data pipelines?

16)What is the difference between a List and a Tuple in Python?

17)Explain the difference between local and global variables in Python.

18)Write a Python program to display even numbers, considering that 0 is neither even nor odd.

19)How can you access one Databricks notebook from another notebook?

20)What is the difference between Wide and Narrow transformations in Spark? Provide examples.

21)Differentiate between Cache and Persist in Spark.

22)Explain the difference between RDD, DataFrame, and Dataset in Spark.

23)What are Broadcast Variables in Spark, and what different types exist?

24)What is the difference between Coalesce and Repartition in Spark?

25)What is Data Skewness, and how can you handle it in Spark?

26)What file formats have you worked with in your data engineering projects (e.g., CSV, Parquet, Avro, ORC)?

27)Explain the difference between Bucketing and Partitioning in Hive or Spark.

28)Have you implemented CI/CD pipelines for data engineering projects? If yes, explain your approach.