Data Engineer

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi

Join Magna Powertrain as a Data Engineer to design, build, and maintain data pipelines using Databricks. Collaborate with teams to ensure data availability and scalability. Troubleshoot data-related issues and recommend improvements. Full-time On-site role in Bengaluru, Karnataka.

About us

We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people.

Forward. For all.

Group Summary

Transforming mobility. Making automotive technology that is smarter, cleaner, safer and lighter. That’s what we’re passionate about at Magna Powertrain, and we do it by creating world-class powertrain systems. We are a premier supplier for the global automotive industry with full capabilities in design, development, testing and manufacturing of complex powertrain systems. Our name stands for quality, environmental consciousness, and safety. Innovation is what drives us and we drive innovation. Dream big and create the future of mobility at Magna Powertrain.

About the Role

We are seeking a highly skilled and motivated Data Engineer with expertise in Databricks to join our team. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure and systems using Databricks. This role will involve working closely with cross-functional teams to ensure the availability, reliability, and scalability of our data pipelines and analytics platforms

Your Responsibilities

•   Design, build, and maintain scalable data pipelines and ETL processes using Databricks to collect, transform, and load data from various sources into our data warehouse.
•   Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and implement solutions to meet their needs using Databricks.
•   Prepare data for the advanced analysis e.g. ML modeling
•   Optimize and tune data pipelines and ETL processes in Databricks for performance and efficiency.
•   Develop and maintain data models, schemas, and data dictionaries in Databricks.
•   Implement data quality checks and monitoring in Databricks to ensure data accuracy and integrity.
•   Troubleshoot and resolve data-related issues and incidents in Databricks.
•   Stay up-to-date with the latest trends and technologies in data engineering, specifically related to Databricks, and recommend improvements to our data infrastructure and systems

Who we are looking for

•   Bachelor's degree in Computer Science, Engineering, or a related field.
•   Proven experience as a Data Engineer or similar role, with expertise in Databricks.
•   Technical expertise with data models, data mining, and segmentation techniques
•   Strong programming skills in languages such as Python.
•   Experience with big data technologies such as Hadoop, Spark, or Kafka.
•   Proficiency in SQL and database technologies (e.g., MySQL, PostgreSQL, or Oracle).
•   Familiarity with cloud platforms (e.g., AWS, Azure, or GCP) and their data services.
•   Knowledge of data warehousing concepts and dimensional modeling.
•   Excellent problem-solving and analytical skills.
•   Strong communication and collaboration skills.
•   Data engineering certification (Databricks Data Engineer Associate) is a plus

Set alert for similar jobsData Engineer role in Bengaluru, India

Company

Magna International

Job Posted

8 months ago

Job Type

Full-time

WorkMode

On-site

Experience Level

0-2 Years

Related Jobs

Data Engineer

Advarra

Bengaluru, Karnataka, India

Posted: 7 months ago

Description   Company Information At Advarra, we are passionate about making a difference in the world of clinical research and advancing human health. With a rich history rooted in ethical review services combined with innovative technology solutions and deep industry expertise, we are at the forefront of industry change. A market leader and pioneer, Advarra breaks the silos that impede clinical research, aligning patients, sites, sponsors, and CROs in a connected ecosystem to accelerate trials.   Company Culture Our employees are the heart of Advarra. They are the key to our success and the driving force behind our mission and vision. Our values (Patient-Centric, Ethical, Quality Focused, Collaborative) guide our actions and decisions. Knowing the impact of our work on trial participants and patients, we act with urgency and purpose to advance clinical research so that people can live happier, healthier lives.   At Advarra, we seek to foster an inclusive and collaborative environment where everyone is treated with respect and diverse perspectives are embraced. Treating one another, our clients, and clinical trial participants with empathy and care are key tenets of our culture at Advarra; we are committed to creating a workplace where each employee is not only valued but empowered to thrive and make a meaningful impact. Job Duties & Responsibilities   Develop and optimize complex SQL queries, stored procedures, and user-defined functions within Snowflake. Develop efficient data transformation pipelines using Snowflake's native SQL capabilities and CTEs. Leverage Snowflake's unique features, such as Time Travel, Zero-Copy Cloning, and Data Sharing to build scalable and robust data solutions. Develop and maintain data models using dbt, ensuring they are scalable, reliable, and optimized for performance. Monitor and manage Fivetran connections to ensure data is being extracted and loaded into Snowflake accurately and on schedule. Troubleshoot and resolve issues related to SQL queries, data syncs, connection errors, and performance bottlenecks. Design, develop, and deploy AWS Lambda functions to support data processing, ETL workflows, and real-time data streaming.     Location This role is open to candidates working in Bengaluru, Ind (hybrid).   Basic Qualifications   Bachelor’s degree or equivalent combination of education and related work experience 0 - 1 year plus of experience in writing and optimizing complex SQL queries, stored procedures, and user-defined functions. Experience designing and implementing efficient data transformation pipelines Experience in writing data transformation with tools such as dbt & Matillion Experience in building and managing data pipeline Experience in writing data transformation test automation scripts Working experience with version control platforms, e.g. GitHub and Agile methodologies and supporting tools JIRA   Preferred Qualifications   Snowflake certifications are a plus Dbt certifications are a plus AWS certifications are a plus     Physical and Mental Requirements   Sit or stand for extended periods of time at stationary workstation Regularly carry, raise, and lower objects of up to 10 Lbs. Learn and comprehend basic instructions Focus and attention to tasks and responsibilities Verbal communication; listening and understanding, responding, and speaking  

Data Engineer

Capgemini

Bengaluru, Karnataka, India

Posted: 6 months ago

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same. Job Description:                Expert knowledge in Python                Expert knowledge in popular machine learning libraries and frameworks, such as TensorFlow, Keras, scikit-learn.                Proficient understanding and application of clustering algorithms (e.g., K-means, hierarchical clustering) for grouping similar data points.                Expertise in classification algorithms (e.g., decision trees, support vector machines, random forests) for tasks such as image recognition                Natural language Processing and recommendation systems.                Proficiency in working with databases, both relational and non-relational like MySQL with experience in designing database schemas                And optimizing queries for Efficient data retrieval.                Strong knowledge in areas like Object Oriented Analysis and Design, Multi-threading, Multi process handling and Memory management.                Good knowledge model evaluation metrics and techniques.                Experience in deploying machine learning models to production environments.                Currently working in an Agile scrum team and proficient in using version control systems (e.g., Git) for collaborative development.  Primary Skill:              Excellent in Python Coding              Excellent in Communication Skills              Good in Data modelling, popular machine learning libraries and framework

Data Engineer

KPMG

Bengaluru, Karnataka, India

Posted: 8 months ago

KPMG in India is seeking a Data Engineer with experience in Data and Analytics, implementing data pipelines on cloud-based platforms, programming in Python, Pyspark, SQL, and working with stream-processing applications. The role involves maintaining CI/CD pipelines, handling large datasets, debugging systems, and ensuring code quality. Full-time, On-site opportunity in Bengaluru, Karnataka, India.

Associate Engineer - AI Data and Analytics

HARMAN International

Bengaluru, Karnataka, India

Posted: 8 months ago

Join our team as a Machine Learning Engineer in Bangalore, Pune, Gurgaon, or Coimbatore. Ideal for those passionate about machine learning, data science, and AI. Responsibilities include developing and optimizing ML models, analyzing large datasets, and deploying models into production.

Data Engineer

Capgemini

Bengaluru, Karnataka, India

Posted: 6 months ago

Data Engineer

Thomson Reuters

Hyderabad, Telangana, India

+1 more

Posted: a month ago

Software Development Engineers are entry/mid-level professionals that design, build, develop and deploy software applications, tools, platforms and services that enable current and future needs of our customers. A Software Development Engineer may assist their colleagues and more junior Software Development Engineer team members by solving problems, providing technical guidance, training and mentoring others. Exceptional attention to detail, strong analytical skills, excellent communication skills, an innovative mindset, the ability to solve complex problems and deep technical ability in software development programming within an agile environment will be key for success.   About the Role In this opportunity, As a Data Analys you will: • Ability to understand low-complexity business requirements and translate them into coding • Actively participates and collaborates in meetings, processes, agile ceremonies and interaction with other technology groups. • Ability to interpret code and solve problems based on existing good practices and standards •Participates in the code review process for learning purposes • Acts on the correction of incidents identified by the continuous code quality inspection tool • Need for moderate guidance and review in carrying out activities • Executes on provided design • May provide technical support to operations or other development teams • Creates and maintains all required technical documentation / manual related to assigned components to ensure supportability. • Makes suggestions for problem solutions or software enhancements, which will typically be reviewed by a more senior developer. • Implements solutions as directed within standards • Participates in project planning sessions with team members to analyze development requirements, provide design options, and provide work breakdown and estimates of work. • Provides status updates for own scope of work within projects. • Participates in internal team and status meetings. • Develops software using disciplined software development processes, adhering to team/company standards and software best practice guidelines, and corporate policies.  • Explains difficult issues and obtains agreement as needed • Support the support team in resolving customer issues and remote access   About you: You will be fit for the role, if your background includes: • Establishes and maintains ongoing relationships with customers  • Understands the markets we serve, our products and customers along with their needs and priorities • Knowledge of business rules related to the company's products • Able to review and understand business, functional, technical and/or project requirements • Business knowledge related to the products in which we operate • Performs root cause analysis of problems with some complexity • Understands product strategy & objectives. Aligns Software Development Engineering work accordingly. • Addresses routine objections and concerns with limited support; knows when escalation is needed  • Creates operating mechanisms to ensure all voices are heard within the project team; commits to team decisions once made. • Identifies opportunities to improve business and technology processes  • Shares information clearly and articulately via all mediums to all audiences • Actively participates and collaborates in meetings, processes, agile ceremonies, and interaction with other technology groups • Learns and adapts; bounces back from setbacks.