Data Integration Engineer

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi

The Data Integration Engineer at Syndigo is responsible for architecting and implementing data ingestion, validation, and transformation pipelines. They should have experience in big data and cloud architecture, and be able to effectively communicate ideas. The ideal candidate should have experience with code deployment and troubleshooting data issues. They should also have knowledge of ETL/ELT patterns and distributed data processing. As a Data Integration Engineer, you will design and develop scalable software applications using best practices and design patterns. You will also be responsible for designing and enhancing REST APIs, writing automated unit tests, and collaborating with cross-functional teams. Proficiency in Javascript and experience with REST API and SQL are required.

Data Integration Engineer

The Data Integration Engineer is responsible for Architecting and implementing data ingestion, validation, and transformation pipelines at Syndigo. In collaboration with the Product, Development, and Enterprise Data teams, the Data Integration Engineer will design and maintain batch and streaming integrations across a variety of data domains and platforms. The ideal candidate is experienced in big data, cloud architecture, and is excited to advance innovative analytics solutions! The Data Integration Engineer should be able to effectively communicate ideas and concepts to peers and have experience leading projects that support the business objectives and goals.

ESSENTIAL DUTIES AND RESPONSIBILITIES:

Take ownership in building solutions and proposing architectural designs related to building efficient and timely data ingestion and transformation processes geared towards analytics work loads
Manage code deployment to various environments
Be proficient at positively critiquing and suggesting improvements via code reviews
Work with stakeholders to define and develop data ingest, validation, and transform pipelines
Troubleshoot data pipelines and resolve issues in alignment with SDLC
Ability to diagnose and troubleshoot data issues, recognizing common data integration and transformation patterns
Estimate, track, and communicate status of assigned items to a diverse group of stakeholders

REQUIREMENTS:

2-4 years of experience in developing and architecting large scale data pipelines in a cloud environment
Demonstrated expertise in Scala (Object Oriented Programming) / Python (Scala preferred), SPARK SQL
Experience with Databricks, including Delta Lake
Experience with Azure and cloud environments, including Azure Data Lake Storage (Gen2), Azure Blob Storage, Azure Tables, Azure SQL Database, Azure Data Factory
Experience with ETL/ELT patterns, preferably using Azure Data Factory and Databricks jobs
Fundamental knowledge of distributed data processing and storage
Fundamental knowledge of working with structured, unstructured, and semi structured data
Excellent analytical and problem-solving skills
Ability to effectively manage time and adjust to changing priorities
Bachelor’s degree preferred, but not required.
Design, Develop and test highly scalable software applications using software best practices and applying various design patterns
Develop innovative capabilities to add new and robust reporting capabilities using various insights/analytics to the platform.
Design, Develop and Enhance REST API along with testing using tools such as Postman.
Design and architect end to end solutions and be responsible for the deployment and maintenance of these solutions in our AWS cloud.
Implement configurable data mappings to allow custom data transformations.
Troubleshoot and issue resolution of software.
Write automated unit tests and conduct code reviews.
Collaborate with Product, DevOps and QA teams on requirements, operations, and automation.
Agile software development using Jira/Confluence.
Collaborate with team members across multiple geographic locations as well as time zones.

Technical skill and Experience:

2+ years of experience in designing and developing software using Microsoft technologies
Required:
- Proficient in Javascript
- Experience with REST API
- Experience with GitHub and Azure DevOps
- Experience with SQL
Plus:
- Dev Ops experience in AWS
- Knowledge of e-commerce platforms.
- Knowledge of data analysis.
- Experience with Elasticsearch.

Set alert for similar jobsData Integration Engineer role in Gurgaon, India

Company

Syndigo

Job Posted

a year ago

Job Type

Full-time

WorkMode

Remote

Experience Level

3-7 Years

Related Jobs

Lead, Enterprise Integration Developer

Ciena

Gurgaon, Haryana, India

Posted: a year ago

Join Ciena's Enterprise Data Integration team and make an impact in how the world connects. As the Lead MuleSoft Integration Developer, you will be responsible for handling sophisticated technical and business challenges, mentoring a team, and overseeing solutions to technical issues. Bring your expertise in design and development of integrations and contribute to our Integration Competency Center. Must have 8+ years of relevant experience and knowledge of MuleSoft platform components.

Lead QA Engineer - Continuous Integration (CI)

Ciena

Gurgaon, Haryana, India

Posted: 8 months ago

Dear Candidate, We are hiring for the position of Lead QA Engineer - Continuous Integration. As a Lead QA Engineer, you will be responsible for executing automated regression scripts, analyzing failures, and filing product defects. You will enhance and fix automation scripts as needed and ensure that the software meets standards and functional requirements to deliver a quality product to the customer. This is a full-time on-site opportunity located in Gurgaon, Haryana, India. The ideal candidate will have 8-10 years of relevant experience with a BE/B. Tech or similar degree, and skills in Python/TCL for automation, networking protocols such as L2VPN and OSPF, and traffic generators like Ixia and Spirent. Strong communication, documentation, and time management skills are required. If you have experience working in an agile environment and knowledge of D-NFVi, Containers, and Virtual Network functions, it will be a plus. If you are interested and meet the qualifications, please apply. Thank you.

Azure Integration - Senior Consultant - Bangalore

KPMG

Gurgaon, Haryana, India

Posted: 5 months ago

Senior Consultant position available in Bangalore for Azure Integration Engineer specializing in IPAAS. Responsibilities include delivering high-quality design, implementing technical solutions in Azure, Microsoft 365, and Power Platform, and adhering to technical standards. Work closely with architects, analyze integration-heavy implementations, and resolve issues. Regularly update project progress, identify risks, and ensure timely completion of processes. Must have experience with .NET, Azure Logic Apps, Azure Functions, and familiarity with technologies like Networks and Security, Databases, Active Directory, PowerShell, Python scripting, and more.

Data Integration Engineer

Hexaware Technologies

Bengaluru, Karnataka, India

Posted: 3 months ago

As a Data Integration Engineer at Hexaware Technologies in Bengaluru, Karnataka, you will design, build, and deploy scalable data solutions, including Enterprise Data Warehouse and ETL processes. You will work with SQL databases, optimize queries, and have experience with Apache Nifi. This full-time on-site role requires a Bachelor's degree in Computer Science with 6+ years of software development experience.

Data Engineer II - Data Platform

Groww

Bengaluru, Karnataka, India

+2 more

Posted: a year ago

Lead and manage a team of data engineers, collaborate with data scientists and analysts to develop data solutions. Design, build, and maintain scalable data platforms. Ensure data quality, participate in code reviews, and stay up-to-date with emerging technologies. Strong problem-solving and communication skills required.

software development engineer in test. - Platform/Applications (Automation QA)

Syndigo

Gurgaon, Haryana, India

Posted: a year ago

We are looking for a validation engineer to ensure the best quality of our platform components and applications. Your main responsibilities will include implementing automation for functional and non-functional aspects, collaborating with different teams to certify for functionality, security, compatibility, scalability, and performance. You should have 2-4 years of experience in enterprise software development with a strong focus on automation. Strong knowledge in programming languages, web technologies, and non-functional testing is required. A Bachelor's degree in Computer Science or related field is preferred.