The Job logo

What

Where

Lead Data Engineer

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi
The Lead Data Engineer is a key contributor to building, maintaining, and optimizing global BI and Analytics solutions across multiple business lines. They will take a technical lead in the design, development, delivery, and maintenance of data extract, load, and transformation (ELT/ETL) pipelines and data flows to ingest data from multiple heterogeneous sources. In addition, they will assist the project delivery team with scoping and planning integration projects and contribute to the design, implementation, and support of the data artifacts in the data lake and database. They will also leverage their knowledge and experience to coach and mentor colleagues to engender good data engineering practices across the team.

Job description 

What success looks like in this role:

 

Job Description and Purpose

The Lead Data Engineer is a key contributor to building, maintaining, & optimizing global BI and Analytics solutions across multiple business lines. They will take a technical lead in the design, development, delivery, and maintenance of data extract, load, and transformation (ELT/ETL) pipelines and data flows to ingest data from multiple heterogeneous sources. In addition, they will assist the project delivery team with scoping and planning integration projects and contribute to the design, implementation, and support of the data artifacts in the data lake and database. They will also leverage their knowledge and experience to coach and mentor colleagues to engender good data engineering practices across the team.
Responsibilities:

Support the Solution & Data Architect(s) to design, build, deliver, and maintain the technical data infrastructure that is the foundation of our BI solutions and support global data strategy initiatives
• Use Azure Databricks for complex data cleansing, preparation, and analysis to meet the functional and non-functional needs of the business, and for re-usable data processing modules
• Develop, test, and maintain Azure Data Factory pipelines and data flows to manage the extract, transform, and load of data from a variety of data sources to the data lake and data warehouse
• Manage and coach a small team of data engineers, providing technical leadership in data engineering good practice, to achieve scalability, re-usability and that accelerates delivery
• Assist the project delivery team in scope, plan, and deliver new and enhanced data integrations including the provision of high-/low-level designs and technical specifications

Knowledge & Experience (ordered by importance):
• Extensive experience (7+ years) leading and building data integrations using one or more industry-standard toolsets e.g., Databricks, Azure Data Factory, Azure Synapse, Google Dataflow, Apache Beam, Talend, Spark, Jupyter Notebooks, SSIS, Informatica, etc.
• Recent, hands-on commercial experience (3+ years) building data integration processes in Azure including Azure Data Factory, Databricks, Azure SQL Database, and Data Lake
• Solid coding experience in at least one language commonly used in data cleansing, wrangling and statistical analysis (Python, Scala, R, etc.), plus above-average knowledge of T-SQL
• Routine use of source control (Git, SVN, TFS, etc) as part of regular development activities, branching & merging, pull requests
Nice to have
• Exposure to DevOps/Deployment Automation/Continuous Delivery in Azure DevOps
• Some exposure to building and deploying cloud-native data solutions in Azure including Data Lake, Azure Key Vault, Function Apps and Azure SQL Database
• Good understanding of software engineering principles including design patterns; proper use of version control; branching & merging; partially or fully automated release builds, continuous integration/delivery etc.

 

 

•Team leader and mentor. • Give direction. • Define processes. • Recommend/develop improvements. • Communicate both within (other development organizations, Legal) and outside of Unisys (vendors and partners). Escalate issues as and when required and handle any escalations to the senior management • Act as product and system expert. Demonstrate strengths in multiple areas. Suggest new features. Research new technologies and testing methodologies. • Estimate, plan and manage multiple concurrent tasks and contribute to project planning. Compile actual efforts into status reports. Gather and report metrics. Ensure that the team meets all deadlines and commitments • Analyze technical requirements in area of expertise and proposes solutions. • Conduct technical feasibility studies. • Architect specific products, solutions or testing strategies. Identify testing configurations for the overall solution. Document specifications which provide a high level of definition of the module and describe how it interfaces/integrates with other modules • Coordinate and oversee complex feature development/testing by team members. Monitor adherence to quality and encourage the team members to adhere to quality processes. Review written code for self and others• Develop test strategies. Coordinate and oversee testing by team members. • Participate as a member of the product design team with focus on system maintainability/usability. Develop plan, write and execute tests at the system level. • Assist with analysis of difficult system problems. Consultant for product or solution problems. Recommend suggested solutions to problems. • Fix defects in multiple product areas. Solve complex problems. Coordinate and oversee defect resolution by team members. Oversee test case maintenance. Review external customer User Communication Forms (UCF’s) for a system and update or create new test cases as appropriate. • Recommend Serviceability design improvements to Engineering. Drive opportunities to improve Field Support and Engineering relationships. Provide manufacturing support. • Lead efforts of virtual teams. Understand regional cultural considerations and form tight working relationships. • Learn new technologies and continue to expand expertise. • Participates in Innovation activities by commenting and generating ideas and leading a team. Provide training to associates within or outside the organization. Creation of Knowledge Documents.

 

 

#LI-BN1

 

 

You will be successful in this role if you have:

• Computer Science/EE undergraduate degree, or demonstrated equivalent knowledge. • A minimum of 8-10 years of experience within the engineering organization with high level expertise in a specific solution/technology • Understand Product Life Cycle management in an engineering environment, with focus on agile methodologies. • Ability to work in a global team, with multiple stakeholders across functions and geographical regions • Ability to communicate task, requirements, design information with clients on a regular basis • Knowledge of engineering concepts/principles • Proactive, analytical and capable of influencing and providing decision support • Team Player, leader and mentor. • Excellent written and verbal communication skills with good command over English language • Proposing opportunities for follow-on business that result in new business.

Set alert for similar jobsLead Data Engineer role in Bengaluru, India
Unisys Logo

Company

Unisys

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

8-12 Years

Category

Software Engineering

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor or Master

Applicants

Be an early applicant

Related Jobs

Unisys Logo

Lead Networking Engineer

Unisys

Bengaluru, Karnataka, India

Posted: a year ago

Provide Tier 2 and Tier 3 support, assist with project implementation, provision and maintain system hardware, software, and related infrastructure. Troubleshoot network issues, maintain network health, and ensure system performance. Evaluate user needs and recommend hardware and software purchases. Knowledge of network security procedures and best practices. Obtain relevant industry certifications. Excellent documentation skills required.

Unisys Logo

Generative AI Lead Engineer

Unisys

Bengaluru, Karnataka, India

Posted: a year ago

Job description  What success looks like in this role:   As a Generative AI Lead Engineer, you will be at the forefront of advancing artificial intelligence technology. Your primary responsibility will be to lead a team of highly skilled engineers, researchers, and developers in the design, development, and deployment of state-of-the-art generative AI models and applications. Your leadership will be instrumental in driving innovation and pushing the boundaries of what AI can achieve in content generation, creativity, and problem-solving.       Team Leadership: You will be tasked with not only managing your team but also inspiring and guiding them to excel in their roles. Your leadership will be essential in fostering a collaborative and innovative environment where ideas flow freely, and team members are motivated to push the envelope of what generative AI can do. Research and Development: Staying at the cutting edge of AI research is a key part of your role. You will lead research initiatives to explore new techniques, algorithms, and approaches in generative AI, ensuring that your team remains at the forefront of this rapidly evolving field. Your work will contribute to breakthroughs in AI technology. Project Management: You will oversee multiple projects concurrently, managing timelines, resources, and budgets. Collaboration with cross-functional teams, including data scientists, software engineers, and product managers, will be crucial to define project goals and ensure successful execution. Algorithm Optimization: Efficiency, scalability, and performance are paramount in generative AI. You will be responsible for optimizing generative models, ensuring they are both powerful and efficient. Rigorous testing and debugging will be necessary to maintain the reliability and robustness of these models. Quality Assurance: Your role will include establishing and upholding rigorous quality standards for generative AI outputs. This will involve developing testing and validation procedures to guarantee the high quality of generated content or solutions. Documentation and Reporting: Clear documentation of research findings, algorithms, and code is essential for both internal and external stakeholders. You will prepare comprehensive reports and presentations to communicate your team's progress and findings effectively. Collaboration and Communication: Collaboration is at the heart of this role. You will work closely with cross-functional teams, translating complex technical concepts into understandable insights for both technical and non-technical colleagues. Compliance and Ethics: Ensuring that generative AI systems adhere to ethical guidelines and legal requirements is a vital aspect of this role, especially when working in areas with sensitive applications. Your leadership in ethical AI practices will be essential.   #LI-BN1     You will be successful in this role if you have: Qualifications: Your educational background should ideally include a Bachelor's degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field. A minimum of 8-10 years of experience within the engineering organization with high-level expertise Proven hands-on experience in generative AI, deep learning, and natural language processing is a must, showcasing your expertise in the field. Strong hands-on programming skills in languages like Python, TensorFlow, PyTorch, or similar are necessary to lead technical teams effectively. Experience in leading and managing technical teams is vital, as you'll be responsible for guiding your team to success. Strong problem-solving and analytical skills will aid you in addressing complex challenges. Excellent communication and presentation skills are essential to convey your ideas and findings effectively. Knowledge of ethical AI principles and best practices is crucial to ensure responsible AI development. Your adaptability to evolving technologies and research is important in keeping your team at the forefront of generative AI advancements. Preferred Qualifications: If you have published research in relevant AI conferences and journals, it demonstrates your contributions to the field. Certification in AI domain will be added advantage. Experience with cloud-based AI services and platforms showcases your familiarity with modern AI infrastructure. Familiarity with generative adversarial networks (GANs), recurrent neural networks (RNNs), and transformers indicates your depth of knowledge in generative AI techniques. Experience in working with large datasets and distributed computing is a valuable asset. Knowledge of industry-specific applications for generative AI, such as content generation, creative design, or natural language generation, can be a significant advantage in certain roles.