The Job logo

What

Where

Senior Data Engineer

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi
Seeking a Data Engineer with 5+ years of relevant work experience showcasing growth. Must have hands-on programming experience and implementation experience with Kafka, Kinesis, Spark, AWS Glue, and AWS LakeFormation. Expertise in data governance, data security implementation, and performance optimization. Proficiency in Python and familiarity with Java/Scala is desired. Knowledge of high-volume transaction systems, microservice design, and data processing pipelines is a plus. AWS experience, especially with ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, and QuickSight, preferred. Strong skills in design, architecture, and building reusable tools. Certification in Data Engineering and AWS is a bonus.

Description

5+ years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation
Worked on Scheduling tools like Airflow
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Good knowledge of Python. Good to have Java/Scala.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Experience in efficient data processing using open table format Delta, Iceberg.
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration,
Capable of planning and executing on both short-term and long-term goals individually and with the team.
Design and Architecture experience (High Level and Low Level Design )
Implemented data catalog solution, data observability framework, Audit Balance control framework
Certification on Data Engineering, AWS etc.
Implemented Micro-service API to process thousands of events per second

 

Primary Location

Pune, Maharashtra, India

Job Type

Experienced

Skill

Data-AWS Glue with EMR, Spark, Redshift,Kinesis,S3,AWS Native Data Services.

Qualification

5+ years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience
Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation
Worked on Scheduling tools like Airflow
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms. Preferred:, ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Good knowledge of Python. Good to have Java/Scala.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Experience in efficient data processing using open table format Delta, Iceberg.
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration,
Capable of planning and executing on both short-term and long-term goals individually and with the team.
Design and Architecture experience (High Level and Low Level Design )
Implemented data catalog solution, data observability framework, Audit Balance control framework
Certification on Data Engineering, AWS etc.
Implemented Micro-service API to process thousands of events per second

Set alert for similar jobsSenior Data Engineer role in Pune, India
Virtusa Logo

Company

Virtusa

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 Years

Category

Data & Analytics

Locations

Pune, Maharashtra, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

Virtusa Logo

Senior Data Engineer

Virtusa

Pune, Maharashtra, India

Posted: a year ago

We are looking for a Data Engineer with at least 5 years of relevant work experience. You should have hands-on programming experience and implementation experience in technologies such as Kafka, Kinesis, Spark, AWS Glue, and AWS LakeFormation. You should also have expertise in data governance and data security implementation. In addition, experience with scheduling tools like Airflow and knowledge of Python is required. Knowledge of Java or Scala is a plus. Familiarity with systems with high volumes of transactions and experience with efficient data processing using open table formats is preferred. Certification in Data Engineering and AWS is a bonus. Join us and be a part of our team as we develop innovative data processing solutions.