The Job logo

What

Where

Sign in

Manager Data Engineering DE - Big Data AWS

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Job Description

As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing AWS Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by independently driving design discussions related to Data Ingestion, Transformation & Consumption, Data Storage and Computation Frameworks, Performance Optimizations, Infrastructure, Automation & Cloud Computing, and Data Governance & Security. The role requires a hands-on technologist with expertise in Big Data solution architecture and with a strong programming background in Java / Scala / Python.

Your Impact:

  • Provide technical leadership and hands-on implementation role in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design, and implementation.
  • Lead a team to deliver high quality big data technologies-based solutions on AWS Cloud. Manage functional & nonfunctional scope and quality.
  • Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality.
  • Manage and provide technical leadership to a data program implementation based on the requirement using agile technologies.
  • Participate in workshops with clients and align client stakeholders to optimal solutions.
  • Consulting, Soft Skills, Thought Leadership, Mentorship etc.
  • People management, contributing to hiring and capability building.

#LI-REMOTE 

Qualifications

Your Skills & Experience:

  • Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related AWS Cloud services and delivered at least 1 project as an architect.
  • Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on AWS Cloud.
  • Expert in programming languages like Java/ Scala and good to have Python
  • Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.
  • Expert in Hadoop eco-system with AWS cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional tools like Informatica, Talend etc
  • Should have worked on any of NoSQL solutions like Mongo DB, Cassandra, HBase etc or Cloud based NoSQL offerings like DynamoDB , Big Table etc.
  • Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration and kubernetes engine would be an added advantage.

Set Yourself Apart With:

  • Certification on AWS cloud platform or big data technologies.
  • Strong analytical and problem-solving skills.
  • Excellent understanding of data technologies landscape / ecosystem.

A Tip from the Hiring Manager:

Join the team to sharpen your skills and expand your collaborative methods. Make an impact on our clients and their businesses directly through your work.

 

Additional Information

  • Gender Neutral Policy
  • 18 paid holidays throughout the year
  • Generous parental leave and new parent transition program
  • Flexible work arrangements 
  • Employee Assistance Programs to help you in wellness and well being

Company Description

Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of the next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.

Set alert for similar jobsManager Data Engineering DE - Big Data AWS role in Bengaluru, India
Publicis Sapient Logo

Company

Publicis Sapient

Job Posted

a year ago

Job Type

Full-time

WorkMode

Remote

Experience Level

8-12 years

Category

IT Services and IT Consulting

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

Publicis Sapient Logo

Manager Data Engineering DE - Big Data Azure

Publicis Sapient

Bengaluru, Karnataka, India

Posted: a year ago

Job Description As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud-based big data solutions for clients. Your role will be focused on delivering high-quality solutions by independently driving design discussions related to Data Ingestion, Transformation & Consumption, Data Storage and Computation Frameworks, Performance Optimizations, Infrastructure, Automation & Cloud Computing, and Data Governance & Security. The role requires a hands-on technologist with expertise in Big Data solution architecture and with a strong programming background in Java / Scala / Python. Your Impact: Provide technical leadership and hands-on implementation role in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design, and implementation. Lead a team to deliver high quality big data technologies-based solutions on Azure Cloud. Manage functional & nonfunctional scope and quality. Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality. Manage and provide technical leadership to a data program implementation based on the requirement using agile technologies. Participate in workshops with clients and align client stakeholders to optimal solutions. Consulting, Soft Skills, Thought Leadership, Mentorship etc. People management, contributing to hiring and capability building. #LI-REMOTE  Qualifications Your Skills & Experience: Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related Azure Cloud services and delivered at least 1 project as an architect. Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions on Azure Cloud. Expert in programming languages like Java/ Scala and good to have Python Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc. Expert in Hadoop eco-system with Azure cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional tools like Informatica, Talend, etc Should have worked on any NoSQL solutions like Mongo DB, Cassandra, HBase, etc, or Cloud-based NoSQL offerings like DynamoDB, Big Table, etc. Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration, and Kubernetes engine would be an added advantage. Set Yourself Apart With: Certification on Azure cloud platform or big data technologies. Strong analytical and problem-solving skills. Excellent understanding of data technologies landscape/ecosystem. A Tip from the Hiring Manager: Join the team to sharpen your skills and expand your collaborative methods. Make an impact on our clients and their businesses directly through your work. Additional Information Gender Neutral Policy 18 paid holidays throughout the year Generous parental leave and new parent transition program Flexible work arrangements  Employee Assistance Programs to help you in wellness and well being Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of the next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.

Publicis Sapient Logo

Senior Associate L1 DE-Big Data AWS

Publicis Sapient

Hyderabad, Telangana, India

Posted: a year ago

Job Description The Senior Associate People Senior Associate L1 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to ensure the necessary health of the overall solution  Your Impact: Data Ingestion, Integration and Transformation Data Storage and Computation Frameworks, Performance Optimizations Analytics & Visualizations Infrastructure & Cloud Computing Data Management Platforms Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time Build functionality for data analytics, search and aggregation Qualifications Your Skills & Experience: Minimum 2 years of experience in Big Data technologies Hands-on experience with the Hadoop stack – HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow, and other components required in building end-to-end data pipelines. Working knowledge of real-time data pipelines is added advantage. Strong experience in at least the programming language Java, Scala, and Python. Java preferable Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDB, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery, etc. Well-versed and working knowledge with data platform-related services on AWS Bachelor’s degree and year of work experience of 4 to 5 years or any combination of education, training, and/or experience that demonstrates the ability to perform the duties of the position Set Yourself Apart With: Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands-on experience Knowledge of data governance processes (security, lineage, catalog) and tools like Collibra, Alation, etc Knowledge of distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace, search & indexing, and Microservices architectures Performance tuning and optimization of data pipelines Cloud data specialty and other related Big data technology certifications A Tip from the Hiring Manager: Join the team to sharpen your skills and expand your collaborative methods. Make an impact on our clients and their businesses directly through your work. Additional Information Gender-Neutral Policy 18 paid holidays throughout the year Generous parental leave and new parent transition program Flexible work arrangements Employee Assistance Programs to help you in wellness and well being   Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across truly value.

Publicis Sapient Logo

Senior Associate L1 DE-Big Data GCP

Publicis Sapient

Bangalore Urban, Karnataka, India

Posted: a year ago

Job Description The Senior Associate People Senior Associate L1 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution  Your Impact: Data Ingestion, Integration and Transformation Data Storage and Computation Frameworks, Performance Optimizations Analytics & Visualizations Infrastructure & Cloud Computing Data Management Platforms Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time Build functionality for data analytics, search and aggregation Qualifications Your Skills & Experience: Minimum 2 years of experience in Big Data technologies Hands-on experience with the Hadoop stack – HDFS, sqoop, kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink, Storm, hive, oozie, airflow and other components required in building end-to-end data pipelines. Working knowledge of real-time data pipelines is added advantage. Strong experience in at least the programming language Java, Scala, and Python. Java preferable Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDB, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery, etc. Well-versed and working knowledge with data platform-related services on AWS Bachelor’s degree and year of work experience of 4 to 6 years or any combination of education, training, and/or experience that demonstrates the ability to perform the duties of the position Set Yourself Apart With: Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands-on experience Knowledge of data governance processes (security, lineage, catalog) and tools like Collibra, Alation, etc Knowledge of distributed messaging frameworks like ActiveMQ / RabbiMQ / Solace, search & indexing, and Microservices architectures Performance tuning and optimization of data pipelines Cloud data specialty and other related Big data technology certifications A Tip from the Hiring Manager: Join the team to sharpen your skills and expand your collaborative methods. Make an impact on our clients and their businesses directly through your work. Additional Information Gender-Neutral Policy 18 paid holidays throughout the year Generous parental leave and new parent transition program Flexible work arrangements Employee Assistance Programs to help you in wellness and well being   Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers.We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity.United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across truly value.

Publicis Sapient Logo

Manager - Experience Engineering

Publicis Sapient

Bengaluru, Karnataka, India

Posted: a year ago

Job Description Manager-Experience Engineering leads and mentors teams within and across projects, architects front-end applications as well as provides guidance on Experience technologies and delivery best practices. The person also manages clients and represents Sapient’s expertise and thought leadership in Experience technologies and applications. Would also drive and enhance Sapient development methodologies (SA3).  Your Impact: . Understand Clients’ business problems and engage in Client servicing to manage peer-level Client relationships  Develop an accurate and realistic design plan along with risk mitigation solutions for the project  Liaison with Information Architects and Designers to finalize the usability and feasibility of interface designs  Effectively communicate responsibilities to the track leads and mentor a collaborative team to deliver Client expectations  #LI-REMOTE  Qualifications Your Skills & Experience: 10+ years exp with Bachelor in Computer Science or equivalent education covering Math, Algorithms, Data Structures, Networking, Databases, Operating Systems, and Graphics.  Excellent knowledge of hand-coded HTML5, CSS3, JavaScript/ OOJS Experience working with Front End Architecture – Monolithic, Micro-Frontend. Hands-on experience working with Object Oriented JavaScript (OOJS), JavaScript libraries, and their practical uses in building complex interactive experiences  Experience building React Applications.  Experience with a State-management framework like Redux (with middlewares – Thunk/Saga) or MobX.  Hands-on experience working with Node.js along with setting up frontend build systems and automating the same using Grunt / Gulp.  Excellent Knowledge of common JavaScript design patterns  Hands-on experience working with TDD in JS with the help of frameworks like Jest, React testing library, Jasmine, Mocha, Karma, etc.  Hands-on experience with Performance/ Security tools. Experience using fluid grids, and building responsive/adaptive websites using Bootstrap, etc.  Understanding of SEO and accessibility issues and how they relate to the development  Sound Knowledge of accessibility standards and usage of Aria labels. Hands-on experience working with client-side templating languages like Handlebars, Mustache, etc Familiarity with MV* frameworks (AngularJS, Backbone.js, or similar) and knowledge of common JavaScript design patterns  Experience working with large branded websites, content management systems, E-commerce platforms, and backend frameworks (Java, .NET) is a plus  Set Yourself Apart With: Strong, innovative, and initiative-seeking approach to problem-solving and finding solutions   Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution   Strong communication skills with sound articulation and comprehension   The ardent desire to explore and learn emerging interactive technologies  A distinct point of view and ability to demonstrate leadership skills  Stay abreast with the latest technologies and regularly guide integration and implementation of Front-End Interfaces on multiple platforms  Experience leading development teams and architecting elegant solutions    Additional Information Health and Wellness Benefits like Leaves, Insurance, Employee Assistance Statutory benefits Lifestyle and Financial Planning Benefits Learning, Upskilling & Growth Opportunities Flexi Work Policy Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value

Publicis Sapient Logo

Senior Manager Data Engineering

Publicis Sapient

Gurgaon, Haryana, India

Posted: a year ago

Job Description Publicis Sapient is looking for a Senior manager of data engineering to join our team of bright thinkers and doers. You’ll use your problem-solving creativity to design, architect, and develop high-end technology solutions that solve our clients’ most complex and challenging problems across different industries. We are on a mission to transform the world, and you will be instrumental in shaping how we do it with your ideas, thoughts, and solutions. Your Impact: Provide inputs to define and execute a strategic roadmap for enterprise data architecture by identifying the current landscape and future business goals Provide technical leadership and hands-on implementation role in the areas of data techniques including data access, integration, modeling, visualization, mining, design, and implementation Lead a globally distributed team to deliver high-quality solutions. Manage functional & non-functional scope and quality Help establish standard data practices like governance and address other non-functional issues like data security, privacy, and quality drive key transformational programs like customer 360-degree view for the clients Functional understanding related to digital marketing & customer experience solution blocks, Master data Management (MDM), Customer Relationship Management (CRM), Campaign Management, Tag Management, Media Buying, Optimizations, Recommendations & Targeting, DMP, and DSP. Understanding Digital data sources such as Open source data (ex: Facebook, Twitter, LinkedIn, etc.), Weblog Data (SiteCatalyst, Google Analytics), 3rd party paid data (ex: Acxiom, ACNielsen, etc.), and business application data (CRM, eCommerce, etc.) Run workshops with clients and align client stakeholders to optimal solutions Qualifications Skills & Experience: 12+ years of experience within the field of data engineering Excellent understanding of data technologies landscape Well-versed with the pros and cons of various database technologies like Relational, NO SQL, MPP, and Columnar databases Well-versed with Software as a service, Platform as a service, and Infrastructure as a service concept and can drive clients to a decision Expert in programming languages like Java, Scala and/or JavaScript Expert in multi-dimensional modeling like start schema, snowflakes, normalized and de-normalized models Expert in one or more ETL, BI, Analytics, and advanced visualization technologies Expert in Hadoop eco-system with one or more distributions like Cloudera and HortonWorks Expert in agile development with CI / CD pipeline with data projects Knowledge of computation frameworks like Storm and Spark Set Yourself Apart With: Multi-geo experience and distributed delivery experience in large programs Business Knowledge  Data-driven marketing experience would be a plus A Tip from the Hiring Manager: To make this transformative journey a reality in these exciting times, we seek Rockstars who will: brave it out to go do the next; “what will be” from “what is” exhibit the optimism that says there is no limit to what we can achieve deeply-skilled, bold, collaborative, flexible Reimagine the way the world works to help businesses improve the daily lives of people and the world. Additional Information Gender Neutral Policy 18 paid holidays throughout the year Generous parental leave and new parent transition program Flexible work arrangements  Employee Assistance Programs to help you in wellness and well being Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting, and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of the next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.

Publicis Sapient Logo

Manager Technology - Java Microservices

Publicis Sapient

Bengaluru, Karnataka, India

Posted: a year ago

Job Description Publicis Sapient is looking for Manager / Specialist Technology (Java/Microservices) to join our team of bright thinkers and doers. You’ll use your problem-solving creativity to design, architect, and develop high-end technology solutions that solve our clients’ most complex and challenging problems across different industries. We are on a mission to transform the world, and you will be instrumental in shaping how we do it with your ideas, thoughts, and solutions. Your Impact:   A hands-on solution architect who has delivered at least 3-4 large-scale projects from ground zero and holding experience in building large-scale, high-volume, low latency, high availability, and complex distributed services. #LI-REMOTE Qualifications Your Experience & Skills: Experience: 10- 14 years Proposal and engineering Initiatives Worked on various client-specific proposals Manage and grow client accounts Managed a large sized team Architecture and Design Ability to identify, showcase potential solutions, and recommend the best solution based on requirements. Manage stakeholders to drive key decisions on tools, technologies, user journeys, and overall governance Experience in object-oriented, SOLID, and DRY principles, reactive programming models, Microservices, and event-driven solutions Delivered solutions on alternative architecture patterns to meet business requirement Understands enterprise security, compliance, and data security at the network and Application layer Language & frameworks and Database Worked extensively on Java language Java 8 and above, having used concurrency, multithreaded models, blocking/non-blocking IO, lambdas, streams, generics, advanced libraries, algorithms, and data structures. Executed database DDL, DML, modeling, managed transactional scenarios & Isolation levels, and experience with NoSQL and SQL-based DBs in the past. Extensively used Springboot/ Spring cloud or similar frameworks to deliver a complex scalable solution Worked extensively on API-based digital journeys and enabled DBT and alternatives technologies to achieve the desired outcomes Tools Used build and Automation tools, Code Quality Plugins, CI/CD Pipelines, and Containerization platforms (Docker/Kubernetes) Used logging and Monitoring solutions like Splunk, ELK, Grafana, etc., and implement technical KPIs. Extensively used application profiling tools like profiler, Yourkit, Visual VM, etc. Platforms & Cloud Services Successfully delivered solutions using one of the cloud platforms e.g. AWS/GCP/Azure/ PCF Integrated with messaging platforms e.g. RabbitMQ/ Kafka/ cloud messaging/ enterprise messaging Applied distributed caching solutions like Redis, Memcache, etc. Testing & Performance engineering Memory management, GC, and GC tuning. Writing JUnit test cases, mocking e.g. Mockito, PowerMockito, EasyMock, etc. BDD automation tools like Cucumber, JBehave, etc. Execute performance and security tests addressing non-functional requirements. Set Yourself Apart With:    Any Cloud certification, Modern Technology exposure (AI/ML, IoT, Blockchain, etc.) A Tip from the Hiring Manager: We at Publicis Sapient, enable our clients to Thrive in Next and to create business value through expert strategies, customer-centric experience design, and world class product engineering. The future of business is disruptive; transformative; and becoming digital to the core. We seek the (Passionate Technologists) who are Deeply skilled, bold, collaborative, flexible Reimagine the way the world works to help businesses improve the daily lives of people, and the world Additional Information Gender-Neutral Policy 18 paid holidays throughout the year. Generous parental leave and new parent transition program Flexible work arrangements Employee Assistance Programs to help you in wellness and well being   Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000+ people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value.