The Job logo

What

Where

Lead Data Engineer

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Our Purpose

We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Title and Summary

Lead Data Engineer

Job Overview:
Leads software engineering projects and creates the development and delivery of enhanced software solutions.
Researches alternative technical solutions for changing business needs.
Responsible for assuring the daily activities of the team meet the requirements of SLA’s.

Role:
•Successfully lead major projects and complex assignments with broad scope and long-term business implications. Create solutions with high level of innovation, cost effectiveness, high quality and faster time to market.
•Lead day to day system development and maintenance activities of the team to meet service level agreements (SLAs). Collaborate with business and technical partners to identify and scope the opportunities, outline potential value and ROI, identify risks, benefits and constraints. Contribute to the overall strategy and manage complex issues within functional area of expertise.
•Develop overall strategic technical plan and create architecture proposals based on identified solution gaps. As recognized subject matter expert, lead planning, design and implementation of technical solutions. Create solution definition and solution architecture. Assist Management in Business Case Development and Scenario Planning leading to an effective decision making process. Make presentations to the Management, Business Owners and other Stakeholders.
•Assist in examining commercially available and forthcoming industry technologies related to area of expertise. Research on current and upcoming technologies and application appropriate frameworks and provide recommendations to Management. Perform PoCs (Proof of Concept) and help Department in the selection of Technology. Proactively create and maintain solution and technology road maps.
•Partner with Project Managers in implementation of processes per the evolving needs of the team and the solutions. Create detailed cost and time estimates for implementing business solutions, define technical scope and requirements of the project and assist project manager with managing scope during the lifecycle of the project. Identify Quality methodology and define Quality Metrics for the Team. Define and Lead Quality Assurance and Quality Control processes in the department. Assist in vendor selection and RFI/RFP process.
•Lead Quality Assurance and Quality Control processes in the department. Ensure adequate test coverage in Unit Testing, System Testing/Integration Testing and Performance Testing. Perform Quality Inspections and Walkthroughs through out the SDLC including Requirements Review, Architecture Review, Design Review, Code Review and Security Review to ensure compliance with MasterCard standards. Co-ordinate offshore development and manage day to day activities. Support collection and reporting of project and software metrics. Actively look for opportunities to enhance standards and improve process efficiency. Mentor and guide other team members during all phases of the SDLC.
•Lead and guide team through all phases of the SDLC of an application. Successfully lead production incident and problem management, identification of root cause and remediation of the problems. Mentor, coach and assist project team members. Provide Brownbag sessions on new and upcoming technologies, methodologies and frameworks. Provide technical training to the team. Assist with selection of technical resources for the projects.
•Ensure compliance to the defined standards. Actively look for opportunities to modify and enhance standards per the needs of the department. Develop documentation templates, lead and enforce development of documentation through out the development lifecycle of the solution.
•Ensure compliance of Audit Requirements by proactively educating team on Compliance Requirements and Integrating Compliance Requirements in SDLC. Represent team during Compliance Audits.

Education:
•Bachelor's degree in Information Systems, Information Technology, Computer Science or Engineering or equivalent experience.

Knowledge / Experience:
•10+ years of experience in related field, including 6-8 years of experience in delivering secure solutions in Financial Services Sector is preferred.
•Advanced knowledge and understanding of Software Engineering Concepts and Methodologies is required.
•Demonstrate MC Core Competencies.

About you:
•Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results.
•Ability to quickly learn and implement new technologies, frameworks and tools and support multiple concurrent activities and to interface with external / internal resources, working as a member of a matrix based diverse and geographically distributed project team.
• 10+ years of experience in Data Warehouse related projects and implementing multiple end-to-end DW projects in Big Data environment
• Experience of building data pipelines through Spark with Scala/Python/Java on Hadoop or Object storage
• Experience of building Nifi pipelines
• Experience of working with Databases like Oracle, Netezza would be added advantage
• Strong analytical skills required for debugging production issues, providing root cause and implementing mitigation plan
• Strong communication skills - both verbal and written – and strong relationship, collaboration skills and organizational skills
• Ability to multi-task across multiple projects, interface with external / internal resources and provide technical leadership to junior team members
• Ability to be high-energy, detail-oriented, proactive and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results
• Ability to quickly learn and implement new technologies, and perform POC to explore best solution for the problem statement
• Flexibility to work as a member of a matrix based diverse and geographically distributed project teams

 

Corporate Security Responsibility


All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

Abide by Mastercard’s security policies and practices;

Ensure the confidentiality and integrity of the information being accessed;

Report any suspected information security violation or breach, and

Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Set alert for similar jobsLead Data Engineer role in Pune, India
Mastercard Logo

Company

Mastercard

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 years

Category

Software Engineering

Locations

Pune, Maharashtra, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

Mastercard Logo

Lead Data / ML Engineer-1

Mastercard

Pune, Maharashtra, India

Posted: a year ago

We are looking for a Lead Data Engineer who will be responsible for designing and developing enhanced data services and cloud enablement. You will lead the development of data and analytics solutions on vast datasets, enabling a frictionless customer and developer experience. You will also create high-performance analytic and ML solutions based on big data. As the Lead Data Engineer, you will collaborate with various teams to ensure long-term viability of information assets and develop technology solutions for managing data.

Mastercard Logo

Lead Database Engineer

Mastercard

Pune, Maharashtra, India

Posted: a year ago

Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results. Title and Summary Lead Database Engineer Job Overview: Provide RDMS support for MasterCard Applications. Guides and provides direction for MasterCard’s use of best practices and application database solutions. Reviews new tools and products that assist Data Architecture (DA) in providing database support and services. Major Accountabilities: •Requires very little supervision while identifying task associated with responsibilities. •Leads in creating all departmental policies and best practices. •Provides leadership by mentoring junior DBAs and by leading internal projects and initiatives. •Provide DBA oversight and helps set direction for department strategy. •Properly identifies tasks available for delegation and provides follow-up. Education: •Bachelor’s Degree in Information systems or equivalent experience. Knowledge / Experience: •Demonstrates an advanced understanding of tools, utilities, and knowledge within Data Architecture (5 to 8 years related experience) •Demonstrates an advanced understanding of Data Architecture’s role in supporting business processes. •Demonstrates an advanced understanding of Data Architecture’s role in supporting business processes. Skills/ Abilities: •Uses strong writing and verbal communication skills to build awareness and to proactively promote Data Architecture's position in support of sound database structures, data governance and other Corporate strategies. •Ability to multitask. •Displays excellent collaborative skills to facilitate cross-functional teams. •Provides the skills to consistently search for improved methods to provide customer service. Work Conditions: •Rotational pager for Production Support.   Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: Abide by Mastercard’s security policies and practices; Ensure the confidentiality and integrity of the information being accessed; Report any suspected information security violation or breach, and Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Mastercard Logo

Senior Platform Engineer (Big Data Admin)

Mastercard

Pune, Maharashtra, India

Posted: a year ago

Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results. Title and Summary Senior Platform Engineer (Big Data Admin) Purpose of the Team o Provide world-class support and expertise to all of MasterCard’s Big Data environments. o Provide Big Data thought leadership and technology roadmaps to support MasterCard’s vision and evolution. • Purpose of the Job o Represent MasterCard’s Big Data Engineering team as a subject matter expert. o Support MasterCard’s present Big Data infrastructures. o Integrate new technologies and platforms into current environments as technologies evolve and demands change. • Who would be the best fit for this role – eg: o What technologies do you have hands-on experience with, and what degree is that experience? o In your current role, what new Big Data technologies have you integrated into your current environment and how? o What experience do you have with migrating users and applications from traditional infrastructure and technologies to newer Big Data platforms? Role • Work directly with application and development teams to completely understand all requirements for project and ad hoc requests and provide accurate estimates. • Participate in a team of technical subject matter experts that provides 24x7 operational support of mission-critical Big Data environments for highly-available and contingent platforms. • Create and maintain documentation and define department best practices in support of proper change management, security and operational requirements. • Investigate and understand new technologies and additional capabilities of current platforms that support MasterCard’s vision of Big Data, leading their adoption when appropriate. • Educate peers and cross-train teammates with Big Data concepts and application of technology to serve business needs • Interact with managed services resources and direct maintenance and operational support activities per MasterCard standards and industry best-practices. All About You • Essential Knowledge, Skills and Experience o Strong knowledge of Hadoop platforms and other distributed data processing platforms. o Linux/Unix and system administration: Advanced Linux knowledge is a must. Understanding of shell, debugging things etc. The candidate should be able to get their way around Linux and get things to work. o Strong background in delivering mission-critical Big Data project work while interacting with diverse and experienced teammates across the spectrum of enterprise operational functions. o Troubleshooting: The candidate must be able to engage in solving complex problems. Programming problems are a good example. o Programming: Good in one programming language. Java would be preferable. If not Java, the candidate must have a good handle on one language and display the ability to pick up a new one if required. Experience on programming infrastructure management or automation tools is a big plus. o Communication skills: Excellent written and verbal communication skills – can communicate up to executive level. This comprises of clear and concise articulation of thoughts. • Desirable or Additional Capabilities o Understanding of and experience with network engineering in support of large IT organizations. o Knowledge in statistics and machine learning would be highly beneficial: The candidate should have a strong developed mentality with a focus on measuring and metrics o Background in ETL. Practical experience dealing with large ETL pipelines is a plus. o Databases: Basic SQL knowledge a must. Good to have advanced data warehousing and MPP knowledge but it's not a must have.   Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: Abide by Mastercard’s security policies and practices; Ensure the confidentiality and integrity of the information being accessed; Report any suspected information security violation or breach, and Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Mastercard Logo

Lead Software Engineer, Priceless Platform-3

Mastercard

Pune, Maharashtra, India

Posted: a year ago

Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results. Title and Summary Lead Software Engineer, Priceless Platform-3 Job Title: Lead Software Engineer, Priceless Platform, Pune, India Overview If you are a fantastic software engineer with experience in building and operating world-class distributed systems, and want to work in a high-growth, fast-paced startup like organization within Mastercard scaling an AWS based global platform, come talk to us. The Priceless Platform was created by a Silicon Valley startup that Mastercard acquired. We are experiencing significant growth, and we are looking for seasoned engineers in Pune, India, with experience and passion scaling an AWS cloud and cloud native platform. An e-commerce like workflow platform, Priceless Platform is Mastercard’s premium B2B2C platform. It delivers experiences and benefits to banks and partners globally, for their customers. Even after becoming part of Mastercard, we continue to run at high velocity, and drive impact. Our portfolio is expanding significantly, and we need to flawlessly execute to grow the business, while also designing and building for scale. The Role We are looking for multiple positions – with a focus on development, operations, DevOps, SRE and Automation experience. As a Lead Software Engineer at Priceless Platform, you will be responsible for designing, developing, testing, delivering, and monitoring scalable and secure cloud architectures. The tec using various AWS cloud and cloud native platforms, such as EC2, ECS, S3, RDS. You will need to improve and expand the existing Priceless platform, as well as extend the platform using sidecar services or other microservices, using AWS, open source, and in-house developed capabilities. You will need to ensure that our platform is resilient, secure, high performance and cost-efficient, as we scale it globally in more countries. You have experience in one or more of the following areas. But more importantly, you are truly passionate and care deeply about building amazing software, focusing on – UI/UX, mobile development, full-stack engineering, scaled backend, API design, and managing/administering large scale Databases. Your expertise and passion in building beautiful and high performant front ends, scale out distributed systems, cloud-native infrastructure, and robust system design will be essential in delivering beautiful, reliable, secure, and scalable systems. Which surprise and delight our customers. You will collaborate with team members in Pune, US, and UK. You will raise the bar on technical excellence through hands-on work and experience in scaling cloud platforms and processes. You will demonstrate thought leadership, execution, and communication excellence, with different audiences, including customers. This role is based out of our Mastercard location in Pune, India. Responsibilities • Responsible to lead technical conversations and decisions making in product and infrastructural aspects end-to-end. • Build software and services. Build automation tests. Build monitoring infrastructure and deployment infrastructure. We need you to be extremely hands-on. • Work with other engineers, perform design reviews and code reviews to ensure high-quality software development, foster a culture of collaboration and continuous improvement within the team. • Collaborate with cross-functional engineers to build new features at large-scale, while improving internal engineering standards, tooling, and automation processes. • Build mobile and web- friendly pages and APIs. • The technology stacks we use – GoLang, PHP, Python, React, Golang and AWS serverless application model. • The technology stacks we need to use more of – CloudFormation and other deployment automation. Monitoring and DevOps frameworks • Major focus on designing and implementing domain driven, event driven and cloud native application models with enterprise features such as in memory caching, distributed databases, AuthN and AuthZ. • Implement DevSecOps practices, integrate security throughout the software development lifecycle, ensure compliance and protect software systems. • Ensure observability through effective logging, monitoring, and alerting mechanisms for system health and performance. • Drive the adoption of agile methodologies, evolve the teams towards fast releases, and quick testing cycles through CI/CD automation. • Improve the platform resilience by adapting modern cloud native architectural patterns. • Partner with platform engineering leads to support in regulating cloud infrastructure, reduce operational cost and simplify vendor management. • Makes recommendations to improve the process efficiency and effectiveness of platform reliability and operations. • Thrive in a fast-paced startup environment, adapting quickly to changing requirements. • Stay updated with open-source emerging technologies and industry trends. • Emulate and drive Mastercard Way behaviors through collaborative behaviors, recognitions, coaching, and employee engagement. • Recruit and hire diverse talent, always bringing in someone better than at least half the individuals in the role in the organization today. • Provide technical support to our marketing campaigns and global promotions. We are looking for someone who meets the following requirements: Requirements: • Strong working experience in at least two of the technologies in – PHP, Python, React, Golang and Java • Cloud Native Application Development • Microservices, Front end development • Messaging frameworks • Strong troubleshooting skills • Ability to work effectively and collaboratively with a team in Pune and a global team in US. • Preferred experiences: o Public Cloud Environments o Serverless Application Development o Multi Region Code deployments o Distributed Databases experience   Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must: Abide by Mastercard’s security policies and practices; Ensure the confidentiality and integrity of the information being accessed; Report any suspected information security violation or breach, and Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.