Job description 

What you’ll do:

•    Participates as a senior member of data development team or cross functional teams; and may lead a project/ program development team; Performs analysis of functional and business requirements.

•    Completes data analysis, and develops batch, real-time, and real time streaming data integration codes to implement solutions.

•    Develops data transformation codes across data lake layers independently.

•    Participates in code reviews and may lead code reviews. 

•    Works with business and system teams to design, prepare and automate test cases. 

•    Applies in-depth or broad technical knowledge to maintain data engineering. Performs solution design. Applies the company, open source, and 3rd party technologies to highly complex infrastructure and software solutions.

Education and Experience Required: 

•    Technical bachelor’s degree and a minimum of 7+ years related experience or a master’s degree and a minimum of 5 years of IT experience.

Knowledge and Skills: 

•    3+ or more years of experience in exploratory data analysis and integration

•    3+ or more years of experience writing SQL, and at least one programming language including Python, Scala

•    Knowledge of workflow tools such as Oozie, and Airflow

•    Proficiency in big data technologies including Hive, Spark, Scala, and No SQL

•    Knowledge of data structures, algorithms 

•    Root cause analysis, identifying opportunities for continuous improvement.

•    Experience of multiple full release cycles.

•    Understanding of Software Test methodologies, and testing tools.

What you need to bring:

Education and Experience Required:

Typically a technical Bachelor's degree or equivalent experience and a minimum of 10 years of related experience or a Master's degree and a minimum of 8 years of experience.

Knowledge and Skills:

5 or more years of experience writing code (such as, and not limited to, Java, C, C++, C#, VB.Net; databases like SqlServer/ Oracle; and Testing tools Experience of multiple full release cycles.

Must have 5 years of SQL programming skills with database schema design, modeling and SQL programming, Tuning expertise.

Advanced understanding of modern software development methodologies.such as Agile, Iterative development as well as DevOps proactices.,

Familiarity with Data Ops practices and too

Advanced understanding of modern software development tools and SCM.

Advanced understanding of Software Test methodologies, and an expert in testing tools. Expert in Database Administration.

General Project Management. Customer/ Vendor Management. Business Analysis.

Advanced Web technologies. Good verbal and written communication skills; influencing skills and ability to work effectively in a geographically dispersed team. Demonstrated technical leadership skills.

Additional Skills:

Accountability, Accountability, Action Planning, Active Learning, Active Listening, Agile Methodology, Bias, Business, Coaching, Creativity, Critical Thinking, Cybersecurity, Data Analysis Management, Data Collection Management, Data Controls, Design Thinking, Development Methodologies, Empathy, Follow-Through, Growth Mindset, Implementation Methodologies, Infrastructure Design, Intellectual Curiosity, Long Term Planning, Managing Ambiguity {+ 4 more}