The Job logo

What

Where

Pyspark Big Data Engineer

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

JOB DESCRIPTION

About KPMG in India

KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara and Vijayawada.

KPMG entities in India offer services to national and international clients in India across sectors. We strive to provide rapid, performance-based, industry-focused and technology-enabled services, which reflect a shared knowledge of global and local industries and our experience of the Indian business environment.

EOE KI

KPMG India has a policy of providing equal opportunity for all applicants and employees regardless of their color, caste, religion, age, sex/gender, national origin, citizenship, sexual orientation, gender identity or expression, disability, or other legally protected status. KPMG India values diversity and we request you to submit the details below to support us in our endeavor for diversity. Providing the below information is voluntary and refusal to submit such information will not be prejudicial to you.

OVERVIEW

Lighthouse, KPMG’s Big Data, AI & Analytics practice has deep industry specialization and focuses on solution delivery for Data Engineering, Data Science, Data Visualization, and Process Analytics. We are looking for entrepreneurial leaders to drive growth and build strategic relationships.

We are looking for Pyspark data engineers. The primary skills are hands on experience in pyspark, python programming and experience in Data Cleaning, Feature Engineering, Transformations
 

RESPONSIBILITIES

  • Mandatory development experience in Pyspark.
  • Designing, developing, and maintaining data processing pipelines using Pyspark and other Big Data technologies.
  • Building and optimizing data ingestion and integration processes for structured and unstructured data from various sources.
  • Expertise in SQL.
  • Expertise in Python programming and experience in Data Cleaning, Feature Engineering, Transformations
  • Expertise in Dataframe, RDD, tuples, lists.
  • Expertise in optimization using broadcast variables, Dataframe and RDD APIs, methods, partition control etc. 
  • Good understanding of Spark configurations.
  • Experience with cloud platforms like AWS, GCP, or Azure for data engineering tasks (depending on the employer's infrastructure).
  • Knowledge of big data ecosystem with knowledge of Hadoop, Hive & GitHub version management.
  • Exposure to working on data pertaining to banking and financial services domain.
  • Highly adaptable in quickly changing technical environments with strong organizational and analytical skills.

QUALIFICATIONS

  • BE/BTech/MCA.
  • 6 years of strong experience in 3-4 of the above-mentioned skills. 
  • Hands on experience on any cloud is mandatory.
  • Education 60% above throughout academics.
  • One 3 years (at least) regular course is must either Diploma or Graduation.
  • Any cloud certification is an added advantage.
Set alert for similar jobsPyspark Big Data Engineer role in Bengaluru, India
KPMG Logo

Company

KPMG

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 years

Category

Technology

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

Hexaware Technologies Logo

Big Data Engineer

Hexaware Technologies

Chennai, Tamil Nadu, India

Posted: a year ago

Description   Skill: Azure-ADF,Synapse, SQL,PySpark and any ETL Informatica/SSIS/Datastage Must Have •5+ years of IT experience in Datawarehouse  •Hands-on data experience on Cloud Technologies on Azure, Synapse, ADF, DataBricks, PySpark •Prior Experience on any of the ETL Technologies like Informatica Power Centre, SSIS, DataStage •Ability to understand Design, Source to target mapping (STTM) and create specifications documents •Flexibility & willingness to work on non-cloud ETL technologies as per the project requirements, though main focus of this role is to work on cloud related projects •Flexibility to operate from office location •Able to mentor and guide junior resources, as needed •Banking experience on RISK & Regulatory OR Commercial OR Credit Cards/Retail Nice to Have •Any relevant certifications

Societe Generale Logo

Big Data Production Support Engineer

Societe Generale

Bengaluru, Karnataka, India

Posted: a year ago

RESPONSIBILITIES As a senior support engineer you will be working as a consultative team member. You will work closely with the development teams, dive into ongoing and post deployment issues along with developing a good understanding of the ecosystem to identify opportunities for improvements, troubleshooting tools and automation. Our ideal candidate is highly autonomous, possess strong verbal and interpersonal skills, adapts quickly to new technologies and has strong problem-solving skills PROFILE REQUIRED 1.       Experience in scripting languages [shell scripting, ansible scripting is a must]. 2.       Experience in troubleshooting and debugging technical systems. 3.       Experience in big data technologies is must. 4.     Strong interpersonal skills, highly adaptable. 5.    Should be able to automate the Processes on manual activities and gain efficiency 6.    Should be aware of DevOps concepts [Kafka, GIT, CI/CD, Kibana, HBase is a must]. 7.       Bachelor’s in co As a senior support engineer you will be working as a consultative team member. You will work closely with the development teams, dive into ongoing and post deployment issues along with developing a good understanding of the ecosystem to identify opportunities for improvements, troubleshooting tools and automation. Our ideal candidate is highly autonomous, possess strong verbal and interpersonal skills, adapts quickly to new technologies and has strong problem-solving skillsmputer science/Information Science is good to have.