Job Title:

Lead Data Engineering

Job Description:

●Seeking an experienced and motivated Data Engineering Lead to
join our growing team.
●The ideal candidate will have a minimum of 5 years of hands-on experience in data engineering, with a strong focus on Spark.
●As a Data Engineering Lead, the candidate will play a pivotal role in designing, developing, and maintaining our data
infrastructure, as well as leading a team of data engineers to deliver high-quality.

Experience Range:

5 - 8 years

Educational Qualifications:

-B.Tech/B.E in Computers,

Job Responsibilities:

● Lead a team of data engineers in designing, building, and maintaining robust and
scalable data pipelines and ETL processes using Spark.
● Collaborate closely with cross-functional teams including data scientists,
analysts, and software engineers to understand data requirements and deliver
effective solutions.
● Architect and optimize data storage and processing solutions for performance,
reliability, and scalability.
● Design and implement data quality and data validation processes to ensure the
accuracy and integrity of our data.
● Stay up-to-date with the latest industry trends and best practices in data
engineering and big data technologies.
● Mentor and guide team members, providing technical leadership, code reviews,
and knowledge sharing.
● Participate in the full development lifecycle, from requirements gathering to
deployment and monitoring.
● Troubleshoot and resolve data pipeline issues, performance bottlenecks, and
other technical challenges.
● Develop and maintain documentation for data pipelines, processes, and
procedures.

Skills Required:

Big Data, Hive, Spark, Big Query, PostgreSQL, Good Clinical Practice (GCP),