The Job logo

What

Where

Software Engineer - Big Data Engineer (Java/Python.)

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi
As a Software Engineer - Big Data Engineer, you will be part of a Scrum/DevOps team developing and supporting complex Big Data applications. Your role involves ensuring project goals are met, collaborating with teams, testing, and implementing quality software using Agile methodologies.

Job description 

As a  Software Developer, you will be a contributor of a Scrum/DevOps team focusing on analyzing, developing, testing, and supporting highly complex application software build on Big Data Your primary objective is to ensure project goals are achieved and are aligned with business objectives.  You will also work closely with your Scrum team and program team to test, develop, refine and implement quality software in production via standard Agile methodologies.

Responsibilities:

Build and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud with an emphasis on quality, best-practice coding standards, and cost-effectiveness.

 Build platform reusable code and components that could be used by multiple project teams. Provide cloud integration development support to various project teams. Leverage modern design patterns and architectural principles to build platform reusable code and components that can be used across projects and teams.

Write both unit and integration tests, and develop automation tools for daily tasks

Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives

Build rapid technical prototypes for early customer validation of new technologies

Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals

Expertise and Skills

  • Domain Expertise
  • Must have strong cloud Implementation expertise in cloud architecture.
  • Must have very good knowledge of storage, network, compute services.
  • Have sound knowledge in multi-zone, region-based designs .
  • Must have the ability to provide solutions utilizing best practices for resilience, scalability, cloud optimization and security. 
  • A quick learner, who can pick up new technologies, program languages and frameworks in a short span of time
  • Technical Skills
  • Experience in software development using programming languages & tools/services: Java or Python or Scala and strong in SQL.
  • Experience in big data processing tools/languages and distributed computing  using Spark Scala or similar. Experience with orchestration tools: Apache Airflow or similar tools.
  • Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
  • Agile scrum experience in application development is required. Strong knowledge  in AWS S3, PostgreSQL or MySQL.
  • Deployment and automation: Terraform, Cloud Formation would be a plus.
  • Strong knowledge  in  Compute: EC2, EMR, AWS Lambda.
  • Strong knowledge in Gitlab /Bitbucket.AWS Certification is a plus

Responsibilities

  • Build and test Cloud-based applications for new and existing backend systems to help facilitate development teams to migrate to the cloud with an emphasis on quality, best-practice coding standards, and cost-effectiveness.
  •  Build platform reusable code and components that could be used by multiple project teams. Provide cloud integration development support to various project teams. Leverage modern design patterns and architectural principles to build platform reusable code and components that can be used across projects and teams.
  • Write both unit and integration tests, and develop automation tools for daily tasks
  • Support product owner in defining future stories and tech lead in defining technical requirements for new initiatives
  • Build rapid technical prototypes for early customer validation of new technologies
  • Collaborate effectively with Data Science to understand, translate, and integrate methodologies into engineering build pipelines Collaborate with cross-functional teams and stakeholders to align development objectives with broader business goals
Set alert for similar jobsSoftware Engineer - Big Data Engineer (Java/Python.) role in Bengaluru, India
Nielsen Logo

Company

Nielsen

Job Posted

7 months ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 Years

Category

Data & Analytics

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor or Master

Applicants

Be an early applicant

Related Jobs

Infosys Logo

Big Data Developer

Infosys

Bengaluru, Karnataka, India

Posted: a year ago

Responsibilities A day in the life of an Infoscion  • As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.  • You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain.  • You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews.  • You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to the organizational guidelines and processes.  • You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you! If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you!   Educational Requirements Bachelor of Engineering   Service Line Data & Analytics Unit   Additional Responsibilities: Knowledge of more than one technology  • Basics of Architecture and Design fundamentals  • Knowledge of Testing tools  • Knowledge of agile methodologies  • Understanding of Project life cycle activities on development and maintenance projects  • Understanding of one or more Estimation methodologies, Knowledge of Quality processes  • Basics of business domain to understand the business requirements  • Analytical abilities, Strong Technical Skills, Good communication skills  • Good understanding of the technology and domain  • Ability to demonstrate a sound understanding of software quality assurance principles, SOLID design principles and modelling methods  • Awareness of latest technologies and trends  • Excellent problem solving, analytical and debugging skills   Technical and Professional Requirements: Primary skills:Bigdata,Bigdata->Hadoop,Bigdata->Hive,Bigdata->Pyspark,Bigdata->Python,Bigdata->Scala,Bigdata->Spark,Opensource->Apache Kafka   Preferred Skills: Bigdata->Hive Opensource->Apache Kafka Bigdata->Hadoop Bigdata->Pyspark Bigdata->Scala Bigdata->Spark Bigdata