Data Engineer

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi

Join Magna Powertrain as a Data Engineer to design, build, and maintain data pipelines using Databricks. Collaborate with teams to ensure data availability and scalability. Troubleshoot data-related issues and recommend improvements. Full-time On-site role in Bengaluru, Karnataka.

About us

We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people.

Forward. For all.

Group Summary

Transforming mobility. Making automotive technology that is smarter, cleaner, safer and lighter. That’s what we’re passionate about at Magna Powertrain, and we do it by creating world-class powertrain systems. We are a premier supplier for the global automotive industry with full capabilities in design, development, testing and manufacturing of complex powertrain systems. Our name stands for quality, environmental consciousness, and safety. Innovation is what drives us and we drive innovation. Dream big and create the future of mobility at Magna Powertrain.

About the Role

We are seeking a highly skilled and motivated Data Engineer with expertise in Databricks to join our team. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure and systems using Databricks. This role will involve working closely with cross-functional teams to ensure the availability, reliability, and scalability of our data pipelines and analytics platforms

Your Responsibilities

•   Design, build, and maintain scalable data pipelines and ETL processes using Databricks to collect, transform, and load data from various sources into our data warehouse.
•   Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and implement solutions to meet their needs using Databricks.
•   Prepare data for the advanced analysis e.g. ML modeling
•   Optimize and tune data pipelines and ETL processes in Databricks for performance and efficiency.
•   Develop and maintain data models, schemas, and data dictionaries in Databricks.
•   Implement data quality checks and monitoring in Databricks to ensure data accuracy and integrity.
•   Troubleshoot and resolve data-related issues and incidents in Databricks.
•   Stay up-to-date with the latest trends and technologies in data engineering, specifically related to Databricks, and recommend improvements to our data infrastructure and systems

Who we are looking for

•   Bachelor's degree in Computer Science, Engineering, or a related field.
•   Proven experience as a Data Engineer or similar role, with expertise in Databricks.
•   Technical expertise with data models, data mining, and segmentation techniques
•   Strong programming skills in languages such as Python.
•   Experience with big data technologies such as Hadoop, Spark, or Kafka.
•   Proficiency in SQL and database technologies (e.g., MySQL, PostgreSQL, or Oracle).
•   Familiarity with cloud platforms (e.g., AWS, Azure, or GCP) and their data services.
•   Knowledge of data warehousing concepts and dimensional modeling.
•   Excellent problem-solving and analytical skills.
•   Strong communication and collaboration skills.
•   Data engineering certification (Databricks Data Engineer Associate) is a plus

Set alert for similar jobsData Engineer role in Bengaluru, India

Company

Magna International

Job Posted

2 months ago

Job Type

Full-time

WorkMode

On-site

Experience Level

0-2 Years

Related Jobs

Data Engineer

Advarra

Bengaluru, Karnataka, India

Posted: a month ago

Description   Company Information At Advarra, we are passionate about making a difference in the world of clinical research and advancing human health. With a rich history rooted in ethical review services combined with innovative technology solutions and deep industry expertise, we are at the forefront of industry change. A market leader and pioneer, Advarra breaks the silos that impede clinical research, aligning patients, sites, sponsors, and CROs in a connected ecosystem to accelerate trials.   Company Culture Our employees are the heart of Advarra. They are the key to our success and the driving force behind our mission and vision. Our values (Patient-Centric, Ethical, Quality Focused, Collaborative) guide our actions and decisions. Knowing the impact of our work on trial participants and patients, we act with urgency and purpose to advance clinical research so that people can live happier, healthier lives.   At Advarra, we seek to foster an inclusive and collaborative environment where everyone is treated with respect and diverse perspectives are embraced. Treating one another, our clients, and clinical trial participants with empathy and care are key tenets of our culture at Advarra; we are committed to creating a workplace where each employee is not only valued but empowered to thrive and make a meaningful impact. Job Duties & Responsibilities   Develop and optimize complex SQL queries, stored procedures, and user-defined functions within Snowflake. Develop efficient data transformation pipelines using Snowflake's native SQL capabilities and CTEs. Leverage Snowflake's unique features, such as Time Travel, Zero-Copy Cloning, and Data Sharing to build scalable and robust data solutions. Develop and maintain data models using dbt, ensuring they are scalable, reliable, and optimized for performance. Monitor and manage Fivetran connections to ensure data is being extracted and loaded into Snowflake accurately and on schedule. Troubleshoot and resolve issues related to SQL queries, data syncs, connection errors, and performance bottlenecks. Design, develop, and deploy AWS Lambda functions to support data processing, ETL workflows, and real-time data streaming.     Location This role is open to candidates working in Bengaluru, Ind (hybrid).   Basic Qualifications   Bachelor’s degree or equivalent combination of education and related work experience 0 - 1 year plus of experience in writing and optimizing complex SQL queries, stored procedures, and user-defined functions. Experience designing and implementing efficient data transformation pipelines Experience in writing data transformation with tools such as dbt & Matillion Experience in building and managing data pipeline Experience in writing data transformation test automation scripts Working experience with version control platforms, e.g. GitHub and Agile methodologies and supporting tools JIRA   Preferred Qualifications   Snowflake certifications are a plus Dbt certifications are a plus AWS certifications are a plus     Physical and Mental Requirements   Sit or stand for extended periods of time at stationary workstation Regularly carry, raise, and lower objects of up to 10 Lbs. Learn and comprehend basic instructions Focus and attention to tasks and responsibilities Verbal communication; listening and understanding, responding, and speaking  

Data Engineer

Capgemini

Bengaluru, Karnataka, India

Posted: 5 days ago

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same. Job Description:                Expert knowledge in Python                Expert knowledge in popular machine learning libraries and frameworks, such as TensorFlow, Keras, scikit-learn.                Proficient understanding and application of clustering algorithms (e.g., K-means, hierarchical clustering) for grouping similar data points.                Expertise in classification algorithms (e.g., decision trees, support vector machines, random forests) for tasks such as image recognition                Natural language Processing and recommendation systems.                Proficiency in working with databases, both relational and non-relational like MySQL with experience in designing database schemas                And optimizing queries for Efficient data retrieval.                Strong knowledge in areas like Object Oriented Analysis and Design, Multi-threading, Multi process handling and Memory management.                Good knowledge model evaluation metrics and techniques.                Experience in deploying machine learning models to production environments.                Currently working in an Agile scrum team and proficient in using version control systems (e.g., Git) for collaborative development.  Primary Skill:              Excellent in Python Coding              Excellent in Communication Skills              Good in Data modelling, popular machine learning libraries and framework

Data Engineer

KPMG

Bengaluru, Karnataka, India

Posted: 2 months ago

KPMG in India is seeking a Data Engineer with experience in Data and Analytics, implementing data pipelines on cloud-based platforms, programming in Python, Pyspark, SQL, and working with stream-processing applications. The role involves maintaining CI/CD pipelines, handling large datasets, debugging systems, and ensuring code quality. Full-time, On-site opportunity in Bengaluru, Karnataka, India.

Associate Engineer - AI Data and Analytics

HARMAN International

Bengaluru, Karnataka, India

Posted: 3 months ago

Join our team as an Associate Engineer specializing in AI Data and Analytics in Bangalore, Pune, Gurgaon, or Coimbatore. This full-time role is perfect for ML enthusiasts with 0-2 years of experience. Collaborate with experts to develop ML models and algorithms, preprocess datasets, conduct experiments, and deploy models into production. Stay updated on the latest ML technologies.

Data Engineer

Capgemini

Bengaluru, Karnataka, India

Posted: 15 days ago

Data Engineer II

Uber

Bengaluru, Karnataka, India

Posted: 7 days ago

What the Candidate Will Need / Bonus Points ---- What the Candidate Will Do ---- Code : Writes high-quality code (i.e., reliable, readable, efficient, testable), provides quality code reviews, and creates comprehensive tests and quality documentation using software engineering principles. This includes knowledge of data structures, algorithms, programming and associated programming languages and frameworks, and major phases/activities of the software research and development life cycle (e.g., requirements, design, build, experiment, test, debug, deploy, monitor). Identifies, reports, and solves technical problems according to standards and best practices. Design : Uses software design principles and methods, knowledge of the capabilities and limitations of existing software solutions at Uber, and an understanding of own work's impact on other areas to reuse, extend, or, when needed, build effective architectures that are integrated with existing solutions and in alignment with needs and goals across areas. Learns and anticipates current and future design requirements and evaluates trade-off decisions to design systems that meet current needs and can be extended for future needs Execute : Executes work with drive and appropriate sense of urgency to deliver technical and business impact. Plans, organizes, and manages tasks, resources, and relationships to accomplish work accurately and on time. Defines and diagnoses problems and determines an appropriate solution, recommendation, or decision while logically evaluating alternatives and factors (e.g., resources, costs, tradeoffs). Accepts responsibility and accounts for own actions and work. Collaborate : Builds trusting and collaborative relationships and rapport with different types of people and teams. Respects the unique backgrounds and contributions of others. Recognizes conflict or disputes among people and situations, learns and works to understand different points of view. Resolves and aligns discrepancies across teams and organizations to accomplish team-, organization-, or Uberwide goals. Provides constructive feedback to others in a tactful and impactful manner. ---- Basic Qualifications ---- Bachelor's degree in Computer Science or related technical field or equivalent practical experience Experience coding using general purpose programming language (eg. Java, Python, Go, Javascript, Fusion) Understanding and exposure to data tech stack eg: Spark, Hive. ---- Preferred Qualifications ---- Coding chops, clean, elegant, bug-free code in languages like JS, React, nodejs, open to new stack as needed Provide technical direction and hands-on solving of technical problems in the area of distributed systems Strong desire to learn and grow, while building the outstanding systems Work in close collaboration with other specialists, product managers, designers, and operations to ship useful and fabulous experiences to our customers Passionate about helping teams grow by inspiring and mentoring engineers. Ability to Identify and resolve performance and scalability issues