Job description
What success looks like in this role:
Job Description and Purpose
The Lead Data Engineer is a key contributor to building, maintaining, & optimizing global BI and Analytics solutions across multiple business lines. They will take a technical lead in the design, development, delivery, and maintenance of data extract, load, and transformation (ELT/ETL) pipelines and data flows to ingest data from multiple heterogeneous sources. In addition, they will assist the project delivery team with scoping and planning integration projects and contribute to the design, implementation, and support of the data artifacts in the data lake and database. They will also leverage their knowledge and experience to coach and mentor colleagues to engender good data engineering practices across the team.
Responsibilities:
Support the Solution & Data Architect(s) to design, build, deliver, and maintain the technical data infrastructure that is the foundation of our BI solutions and support global data strategy initiatives
• Use Azure Databricks for complex data cleansing, preparation, and analysis to meet the functional and non-functional needs of the business, and for re-usable data processing modules
• Develop, test, and maintain Azure Data Factory pipelines and data flows to manage the extract, transform, and load of data from a variety of data sources to the data lake and data warehouse
• Manage and coach a small team of data engineers, providing technical leadership in data engineering good practice, to achieve scalability, re-usability and that accelerates delivery
• Assist the project delivery team in scope, plan, and deliver new and enhanced data integrations including the provision of high-/low-level designs and technical specifications
Knowledge & Experience (ordered by importance):
• Extensive experience (7+ years) leading and building data integrations using one or more industry-standard toolsets e.g., Databricks, Azure Data Factory, Azure Synapse, Google Dataflow, Apache Beam, Talend, Spark, Jupyter Notebooks, SSIS, Informatica, etc.
• Recent, hands-on commercial experience (3+ years) building data integration processes in Azure including Azure Data Factory, Databricks, Azure SQL Database, and Data Lake
• Solid coding experience in at least one language commonly used in data cleansing, wrangling and statistical analysis (Python, Scala, R, etc.), plus above-average knowledge of T-SQL
• Routine use of source control (Git, SVN, TFS, etc) as part of regular development activities, branching & merging, pull requests
Nice to have
• Exposure to DevOps/Deployment Automation/Continuous Delivery in Azure DevOps
• Some exposure to building and deploying cloud-native data solutions in Azure including Data Lake, Azure Key Vault, Function Apps and Azure SQL Database
• Good understanding of software engineering principles including design patterns; proper use of version control; branching & merging; partially or fully automated release builds, continuous integration/delivery etc.
•Team leader and mentor. • Give direction. • Define processes. • Recommend/develop improvements. • Communicate both within (other development organizations, Legal) and outside of Unisys (vendors and partners). Escalate issues as and when required and handle any escalations to the senior management • Act as product and system expert. Demonstrate strengths in multiple areas. Suggest new features. Research new technologies and testing methodologies. • Estimate, plan and manage multiple concurrent tasks and contribute to project planning. Compile actual efforts into status reports. Gather and report metrics. Ensure that the team meets all deadlines and commitments • Analyze technical requirements in area of expertise and proposes solutions. • Conduct technical feasibility studies. • Architect specific products, solutions or testing strategies. Identify testing configurations for the overall solution. Document specifications which provide a high level of definition of the module and describe how it interfaces/integrates with other modules • Coordinate and oversee complex feature development/testing by team members. Monitor adherence to quality and encourage the team members to adhere to quality processes. Review written code for self and others• Develop test strategies. Coordinate and oversee testing by team members. • Participate as a member of the product design team with focus on system maintainability/usability. Develop plan, write and execute tests at the system level. • Assist with analysis of difficult system problems. Consultant for product or solution problems. Recommend suggested solutions to problems. • Fix defects in multiple product areas. Solve complex problems. Coordinate and oversee defect resolution by team members. Oversee test case maintenance. Review external customer User Communication Forms (UCF’s) for a system and update or create new test cases as appropriate. • Recommend Serviceability design improvements to Engineering. Drive opportunities to improve Field Support and Engineering relationships. Provide manufacturing support. • Lead efforts of virtual teams. Understand regional cultural considerations and form tight working relationships. • Learn new technologies and continue to expand expertise. • Participates in Innovation activities by commenting and generating ideas and leading a team. Provide training to associates within or outside the organization. Creation of Knowledge Documents.
#LI-BN1
You will be successful in this role if you have:
• Computer Science/EE undergraduate degree, or demonstrated equivalent knowledge. • A minimum of 8-10 years of experience within the engineering organization with high level expertise in a specific solution/technology • Understand Product Life Cycle management in an engineering environment, with focus on agile methodologies. • Ability to work in a global team, with multiple stakeholders across functions and geographical regions • Ability to communicate task, requirements, design information with clients on a regular basis • Knowledge of engineering concepts/principles • Proactive, analytical and capable of influencing and providing decision support • Team Player, leader and mentor. • Excellent written and verbal communication skills with good command over English language • Proposing opportunities for follow-on business that result in new business.