Job Summary

Responsible for transforming large, complex data into consumable business databases and applications for self-service analytics and reporting. Create system architecture, design and specification using in-depth engineering skills and knowledge to solve difficult development problems and achieve engineering goals. Determine and source appropriate data for a given analysis. Work with data modelers/analysts to understand the business problems they are trying to solve then create or augment data assets to feed their analysis. Has in-depth experience, knowledge and skills in own discipline. Usually determines own work priorities. Acts as resource for colleagues with less experience.

Job Description

Core Responsibilities

• Working within a small team of 4 to 5 engineers to deliver the overall DGE strategy in line with Sky data governance guidelines.
• Have strong knowledge of the data sets required to run the Data Intelligence business. Deliver plans with NOW TV teams on operational capability, new dashboard distribution, Adobe product interfaces
• Resolve business incidents or develop solutions for business requests, ensuring the requirements, specifications and recommendations related to a proposed solution, are tested and delivered successfully
• Work with BigQuery and GitHub integrating with Airflow as orchestrating tool to get work pipelines completed.
• Integrate modern data management and software engineering technologies into existing data structures. Develop processes for data mining, data modelling, and data production. Create custom software components and operations.
• Work effectively with other members of the team and key business stakeholders to playback the business challenges and proposed changes to ensure there is a full understanding of the impact and that requirements are met.
• Contribute towards defining the DGE Development best practice and standards and ensure consistency of delivery across the team.
• Maintaining ongoing commentary of work activity in relevant admin toolsets
• Managing workflow and team activity alongside the Lead Data Engineer and Service Manager, to ensure prioritised work is delivered to expected timelines.
• Providing mentoring and guidance to other members of the DGE Development team.

Employees at all levels are expected to:

• Self-Starter. Experienced, proactive, optimistic, logical data-led with a bias to action. Collaborate confidently with members of the team, escalating issues when appropriate.
• Strong leadership skills, providing guidance on vision setting, decision making and embedding values, creating a highperformance atmosphere to work within.
• Confident dealing with technical and business stakeholders, able to explain challenges and solutions, pitched at the right level for the audience.
• Experienced working with Github as a configuration management tool.
• Using Airflow 2.0 as orchestrating tool to schedule the jobs using cloud composer.
• Excellent SQL skills in BigQuery enabling large scale data transformation and analysis.
• Very experience in developing and testing ETL data transformation code, preferably in GCP data flow, or BigQuery.
• Maintenance of work updates using Service NOW Spark and Jira.
• Addition and maintenance of data dictionary and working practices on SharePoint.
• Knowledge of Python.

Education

Bachelor's Degree

While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

Relevant Work Experience

5-7 Years