Senior Data Engineer - Azure Data Factory (ADF), Databricks

Job Summary

The Senior Developer will be responsible for overseeing the development and implementation of solutions using Snowflake, Azure Data Factory (ADF), and Data Bricks. They will play a key role in coding, testing, and deploying data solutions to meet business needs efficiently.

Key Responsibilities

1. Developing, and maintaining scalable data pipelines using snowflake, azure data factory (adf), and data bricks.
2. Collaborating with stakeholders to gather requirements and understand business needs for data processing and analysis.
3. Optimizing and tuning data solutions to ensure high performance and reliability.
4. Implementing data security measures and best practices to protect sensitive information.
5. Troubleshooting and debugging data pipelines and resolving issues in a timely manner.
6. Keeping uptodate with the latest trends and technologies in data engineering and recommending enhancements to existing systems.

Skill Requirements

 - 4  to 7 Years Experience in Data engineering skills with ADF, Azure Data bricks, Spark, Synapse engineering. 
- Analyze Data Mapping documents and convert into technical specification document for Data models, Data flows and ETL Process.
- Developing SQL Queries, ADF, Spark programming, Data bricks, Data flows  for Data enrichment and Transformations.
- Experience with Data Ingestion Pipeline while reading data from API’s 
- Hands on Expertise into Synapse and SQL 
- Stay till the Braze POC completes on legacy
- Knowledge Transfer (KT)
- Braze Integration
- Develop Ingestion Pipelines from Braze Data Lake
- Unit testing

Other Requirements

1.Snowflake SnowPro Core Certification, Microsoft Certified1.Azure Data Engineer Associate.