The Job logo

What

Where

Data Engineer II

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi
Design, develop & maintain data platform services and ETLs for varied use cases. Implement and operate the analytical data warehouse. Execute data architecture solutions and troubleshooting in a startup environment.

What is the Job like?

  • Design, develop & maintain data platform services and ETLs for varied use cases such as data extraction, processing, observability and analytics.
  • Develop solutions with compliance and security as highest priorities. 
  • Design, implement and operate the analytical data warehouse/data lake in support of the business objectives.
  • Enable performance monitoring and failure detection of the platform services.
  • Contribute to establishing and enforcing coding & operational best practices for the team.
  • Execute data architecture solutions and technical troubleshooting with ability to propose new approaches in a fast-paced startup environment.

 

Who should apply?

  • 3-5 years of experience in data engineering.
  • Experienced in data modeling and building scalable data/delta lake and data warehouse.
  • Strong PySpark and SQL work experience with distributed data processing frameworks.
  • Strong knowledge of architecture & internals of Apache Spark with multiple years of hands-on experience.
  • Design and implement production grade and complex ETL pipelines on core principles of reliability, scalability and maintainability.
  • Understand relational database systems and modeling.
  • Familiar with the AWS and Kubernetes environment and resources.
  • Knowledge of Airflow and Nifi.
  • Experience working with distributed SQL engines like Athena/Trino/Redshift
Set alert for similar jobsData Engineer II role in Bengaluru, India
Zeta Logo

Company

Zeta

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 Years

Category

Engineering

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

Zeta Logo

Data Engineer II

Zeta

Hyderabad, Telangana, India

Posted: a year ago

Design, develop, and maintain data platform services for various use cases. Own and operate the analytical data warehouse/data lake. Manage deployment across multiple data centers. Enable performance monitoring and auto-scaling. Establish coding and operational best practices. Experience in data engineering, BI engineering, and data warehouse development required.

Uber Logo

Data Engineer II

Uber

Bengaluru, Karnataka, India

Posted: 2 months ago

What the Candidate Will Need / Bonus Points ---- What the Candidate Will Do ---- Code : Writes high-quality code (i.e., reliable, readable, efficient, testable), provides quality code reviews, and creates comprehensive tests and quality documentation using software engineering principles. This includes knowledge of data structures, algorithms, programming and associated programming languages and frameworks, and major phases/activities of the software research and development life cycle (e.g., requirements, design, build, experiment, test, debug, deploy, monitor). Identifies, reports, and solves technical problems according to standards and best practices. Design : Uses software design principles and methods, knowledge of the capabilities and limitations of existing software solutions at Uber, and an understanding of own work's impact on other areas to reuse, extend, or, when needed, build effective architectures that are integrated with existing solutions and in alignment with needs and goals across areas. Learns and anticipates current and future design requirements and evaluates trade-off decisions to design systems that meet current needs and can be extended for future needs Execute : Executes work with drive and appropriate sense of urgency to deliver technical and business impact. Plans, organizes, and manages tasks, resources, and relationships to accomplish work accurately and on time. Defines and diagnoses problems and determines an appropriate solution, recommendation, or decision while logically evaluating alternatives and factors (e.g., resources, costs, tradeoffs). Accepts responsibility and accounts for own actions and work. Collaborate : Builds trusting and collaborative relationships and rapport with different types of people and teams. Respects the unique backgrounds and contributions of others. Recognizes conflict or disputes among people and situations, learns and works to understand different points of view. Resolves and aligns discrepancies across teams and organizations to accomplish team-, organization-, or Uberwide goals. Provides constructive feedback to others in a tactful and impactful manner. ---- Basic Qualifications ---- Bachelor's degree in Computer Science or related technical field or equivalent practical experience Experience coding using general purpose programming language (eg. Java, Python, Go, Javascript, Fusion) Understanding and exposure to data tech stack eg: Spark, Hive. ---- Preferred Qualifications ---- Coding chops, clean, elegant, bug-free code in languages like JS, React, nodejs, open to new stack as needed Provide technical direction and hands-on solving of technical problems in the area of distributed systems Strong desire to learn and grow, while building the outstanding systems Work in close collaboration with other specialists, product managers, designers, and operations to ship useful and fabulous experiences to our customers Passionate about helping teams grow by inspiring and mentoring engineers. Ability to Identify and resolve performance and scalability issues