The Job logo

What

Where

Senior Data Engineer

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

DESCRIPTION

North America Consumer is one of Amazon’s largest businesses, including North America retail and third party sellers, as well as an array of innovative new programs including Alexa Shopping and Amazon Business. The NA Consumer Finance organization is looking for an outstanding Data Engineer to build a robust and scalable data platform to support analytical and data capability for the team.

As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments using the latest suite of AWS toolsets. You should have deep expertise in the design, creation, management, and business use of extremely large datasets. You should be expert at designing, implementing, and maintaining stable, scalable, low cost data infrastructure. In this role, you will build datasets that analysts and BIE use to generate actionable insights. You should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change.

The successful candidate will be an expert with SQL, ETL (and general data wrangling) and have exemplary communication skills. The candidate will need to be a self-starter, comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail.

Responsibilities

You know and love working with data engineering tools, can model multidimensional datasets, and can understand how to make appropriate data trade-offs. You will also have the opportunity to display your skills in the following areas:
· Design, implement, and support a platform providing access to large datasets
· Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL
· Own, maintain and scale a Redshift cluster and manage other AWS Resources
· Model data and metadata for ad hoc and pre-built reporting
· Collaborate with Business Intelligence Engineers and Analysts to deliver high quality data architecture and pipelines
· Recognize and adopt best practices in engineering and operational excellence: data integrity, validation, automation and documentation
· Create coherent Logical Data Models that drive physical design

We are open to hiring candidates to work out of one of the following locations:

Bangalore, KA, IND

BASIC QUALIFICATIONS

- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices

PREFERRED QUALIFICATIONS

- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience operating large data warehouses

Set alert for similar jobsSenior Data Engineer role in Bengaluru, India
Amazon Logo

Company

Amazon

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 years

Category

Software Engineering

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

Amazon Logo

Senior Data Engineer

Amazon

Bengaluru, Karnataka, India

Posted: a year ago

DESCRIPTION North America Consumer is one of Amazon’s largest businesses, including North America retail and third party sellers, as well as an array of innovative new programs including Alexa Shopping and Amazon Business. The NA Consumer Finance organization is looking for an outstanding Data Engineer to build a robust and scalable data platform to support analytical and data capability for the team. As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments using the latest suite of AWS toolsets. You should have deep expertise in the design, creation, management, and business use of extremely large datasets. You should be expert at designing, implementing, and maintaining stable, scalable, low cost data infrastructure. In this role, you will build datasets that analysts and BIE use to generate actionable insights. You should be passionate about working with huge data sets and someone who loves to bring datasets together to answer business questions and drive change. The successful candidate will be an expert with SQL, ETL (and general data wrangling) and have exemplary communication skills. The candidate will need to be a self-starter, comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail. Responsibilities You know and love working with data engineering tools, can model multidimensional datasets, and can understand how to make appropriate data trade-offs. You will also have the opportunity to display your skills in the following areas: · Design, implement, and support a platform providing access to large datasets · Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL · Own, maintain and scale a Redshift cluster and manage other AWS Resources · Model data and metadata for ad hoc and pre-built reporting · Collaborate with Business Intelligence Engineers and Analysts to deliver high quality data architecture and pipelines · Recognize and adopt best practices in engineering and operational excellence: data integrity, validation, automation and documentation · Create coherent Logical Data Models that drive physical design We are open to hiring candidates to work out of one of the following locations: Bangalore, KA, IND BASIC QUALIFICATIONS - 5+ years of data engineering experience - Experience with data modeling, warehousing and building ETL pipelines - Experience with SQL - Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS - Experience mentoring team members on best practices PREFERRED QUALIFICATIONS - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR - Experience operating large data warehouses

Hewlett Packard Enterprise Logo

Senior Data Engineer

Hewlett Packard Enterprise

Bengaluru, Karnataka, India

Posted: 3 months ago

Job description  What you’ll do : •    Participates as a senior member of data development team or cross functional teams; and may lead a project/ program development team; Performs analysis of functional and business requirements. •    Completes data analysis, and develops batch, real-time, and real time streaming data integration codes to implement solutions. •    Develops data transformation codes across data lake layers independently. •    Participates in code reviews and may lead code reviews.  •    Works with business and system teams to design, prepare and automate test cases.  •    Applies in-depth or broad technical knowledge to maintain data engineering. Performs solution design. Applies the company, open source, and 3rd party technologies to highly complex infrastructure and software solutions. Education and Experience Required:  •    Technical bachelor’s degree and a minimum of 7+ years related experience or a master’s degree and a minimum of 5 years of IT experience. Knowledge and Skills:  •    3+ or more years of experience in exploratory data analysis and integration •    3+ or more years of experience writing SQL, and at least one programming language including Python, Scala •    Knowledge of workflow tools such as Oozie, and Airflow •    Proficiency in big data technologies including Hive, Spark, Scala, and No SQL •    Knowledge of data structures, algorithms  •    Root cause analysis, identifying opportunities for continuous improvement. •    Experience of multiple full release cycles. •    Understanding of Software Test methodologies, and testing tools.   What you need to bring : Education and Experience Required: Typically a technical Bachelor's degree or equivalent experience and a minimum of 10 years of related experience or a Master's degree and a minimum of 8 years of experience. Knowledge and Skills: 5 or more years of experience writing code (such as, and not limited to, Java, C, C++, C#, VB.Net; databases like SqlServer/ Oracle; and Testing tools Experience of multiple full release cycles. Must have 5 years of SQL programming skills with database schema design, modeling and SQL programming, Tuning expertise. Advanced understanding of modern software development methodologies.such as Agile, Iterative development as well as DevOps proactices., Familiarity with Data Ops practices and too Advanced understanding of modern software development tools and SCM. Advanced understanding of Software Test methodologies, and an expert in testing tools. Expert in Database Administration. General Project Management. Customer/ Vendor Management. Business Analysis. Advanced Web technologies. Good verbal and written communication skills; influencing skills and ability to work effectively in a geographically dispersed team. Demonstrated technical leadership skills.   Additional Skills: Accountability, Accountability, Action Planning, Active Learning, Active Listening, Agile Methodology, Bias, Business, Coaching, Creativity, Critical Thinking, Cybersecurity, Data Analysis Management, Data Collection Management, Data Controls, Design Thinking, Development Methodologies, Empathy, Follow-Through, Growth Mindset, Implementation Methodologies, Infrastructure Design, Intellectual Curiosity, Long Term Planning, Managing Ambiguity {+ 4 more}