The Job logo

What

Where

Technology Leader (Data Platform) - Individual Contributor

ApplyJoin for More Updates

You must Sign In before continuing to the company website to apply.

Smart SummaryPowered by Roshi
Apply first principles to solve technological problems and design data pipelines, models, and ETL processes. Build and maintain data infrastructure while ensuring reliability, consistency, and accuracy. Work closely with stakeholders to understand requirements and deliver data solutions. Stay updated with latest technologies, mentor junior engineers, and contribute to product security, availability, scalability, and resilience.

what will you do?

 

  • apply first principles and elegantly solve technological problems
  • design and develop data pipelines, data models, and ETL processes to support data integration, transformation, and warehousing
  • build and maintain data infrastructure and systems, ensuring data reliability, consistency, and accuracy
  • work closely with Data Scientists, Analysts, Product and other stakeholders to understand data requirements and deliver data solutions to meet business needs
  • collaborate with the Software Engineering team to integrate data pipelines with applications and services
  • implement data governance and data quality frameworks to maintain data integrity and security
  • monitor data pipelines and troubleshoot data-related issues to ensure smooth data flow and timely resolution
  • identify opportunities for automation and process improvements to streamline data engineering workflows
  • stay up-to-date with the latest technologies and best practices in data engineering, contributing to the continuous improvement of data processes
  • mentor and provide technical guidance to junior data engineers, promoting knowledge sharing and skill development within the team
  • be a key contributor to ensure the product is highly secure, available, scalable, resilient, and cloud-ready
  • communicate effectively and keep internal and external stakeholders updated on the progress of key initiatives
  • be the ambassador for CRED in the tech community and create a strong brand value


you should apply if you :
 

  • proven experience as a Data Engineer or similar role, with a minimum of 7 years in building and maintaining data pipelines and ETL processes
  • strong proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks like Apache Spark
  • in-depth knowledge of SQL, database management systems, and data warehousing concepts
  • experience with cloud-based data platforms like AWS, Google Cloud, or Azure, and familiarity with big data technologies
  • hands-on experience with data integration tools, data modeling, and data visualization tools (e.g., Airflow, Snowflake, Tableau)
  • familiarity with Agile methodologies and working in cross-functional teams
  • excellent problem-solving and analytical skills, with a keen attention to detail
  • strong communication skills, both written and verbal, with the ability to explain complex technical concepts to non-technical stakeholders
  • ability to work independently and as part of a collaborative team in a fast-paced and dynamic environment
  • experience in working with real-time data streaming technologies (Kafka, Apache Flink, etc.)
  • knowledge of machine learning concepts and data science workflows
  • understanding of data security and privacy regulations (GDPR, CCPA, etc.)
  • relevant certifications in data engineering or cloud platforms
Set alert for similar jobsTechnology Leader (Data Platform) - Individual Contributor role in Bengaluru, India
CRED Logo

Company

CRED

Job Posted

a year ago

Job Type

Full-time

WorkMode

On-site

Experience Level

3-7 Years

Category

Engineering

Locations

Bengaluru, Karnataka, India

Qualification

Bachelor

Applicants

Be an early applicant

Related Jobs

CRED Logo

Technology Leader - Individual Contributor - Core Platform

CRED

Bengaluru, Karnataka, India

Posted: a year ago

We are looking for a highly skilled and experienced engineer who can apply first principles to solve technological problems. You will be responsible for translating business requirements into scalable and extensible designs. Additionally, you will be choosing the right technology stack, writing high-quality code, and mentoring junior engineers. Strong competencies in software design and architecture, as well as experience with distributed systems and data, are required. The ability to collaborate, communicate effectively, and make tough technical decisions is essential. If you have a strong track record in building scalable, secure, and cloud-ready systems, we encourage you to apply. Join us and be a part of our tech community, where you will help create a strong brand value for our company.

Quest Global Logo

Project Leader

Quest Global

Bengaluru, Karnataka, India

Posted: a year ago

Job Description   Quest Global is an organization at the forefront of innovation and one of the world’s fastest growing engineering services firms with deep domain knowledge and recognized expertise in the top OEMs across seven industries. We are a twenty-five-year-old company on a journey to becoming a centenary one, driven by aspiration, hunger and humility. We are looking for humble geniuses, who believe that engineering has the potential to make the impossible, possible; innovators, who are not only inspired by technology and innovation, but also perpetually driven to design, develop, and test as a trusted partner for Fortune 500 customers. As a team of remarkably diverse engineers, we recognize that what we are really engineering is a brighter future for us all. If you want to contribute to meaningful work and be part of an organization that truly believes when you win, we all win, and when you fail, we all learn, then we’re eager to hear from you. The achievers and courageous challenge-crushers we seek, have the following characteristics and skills:   Roles & Responsibilities: Work in a cross functional team as a SME for giving technical advice on procurement of equipment spares. Resolving vendor/buyer’s Queries which hinder the material procurement process. Evaluation of drawings, technical documents and other certificates offered by vendor. Analyzing the past consumption of materials, Accounting data, Equipment tags, and coming up with a constructive conclusion to accept/reject Vendor’s offer or to provide more information. Interact with different stakeholders from the Buyer team/Expedition team/Material Coordination team/Maintenance Team and Planning team to close the technical Queries and do necessary follow up to fill the Gaps. Perform Supply Market Analysis across different continents as per the BU location and requirement. Communication with Manufacturers from different Time zones across APAC, EMEA and US to cater the BUs requirement. Maintain good relation with different manufacturers and Vendors. Submission of Material Master changes. Close the Requests/Tickets received from different Business units on time as per the defined SLA. Materials and service coordination against open Work orders. Multiple stakeholder management as per requirement. Responsible for follow up with Expeditors/Buyers/Vendors against delivery dates lapsed POs, open PRs and ETA discrepancies respectively. Reviewing different conditions in SAP to verify the materials availability. Interact with different stakeholders from the Buyer team/Expedition team/Material Coordination team/Maintenance Team and Planning team to make sure that the components requires against a Work orders are ready as per the basic start date. Running Adhoc analysis and per the business requirement. Required Skills (Technical Competency): Engineering degree (Mechanical/Instrumentation) 8-10 years of experience in Equipment repair and  maintenance (Static & Rotary) in Oil &Gas/Petrochemical industries. Exposure on Spare parts procurement in oil and gas industry Exposure towards Upstream operations is plus Hands on Experience in SAP MM and PM modules (End user) Good Knowledge in CMMS. Good Expertise in MS Excel and Office Desired Skills: Fluent English (Written and oral communication skills.) Good Interpersonal Skills and with proactive attitude and Positive thinking Can do attitude Problem Solving and decision making skills Self-motivated and excellent work ethics.   Education Type B.E/B.Tech/BS-Mechanical Engineering Job Type Full Time-Regular Experience Level Mid Level Total Years of Exp 5 - 8