Software Development Engineer III
Flipkart
Bengaluru, Karnataka, India
Job Description: Software Development Engineer III GenAI Engineering: MLP Team is responsible to ensure that at Flipkart , Data Scientists are able to train and host Large Language Models (LLM) and Large Image Models (LIM) at scale. This is a vastly exciting and rapidly evolving domain within Data Science: As of Aug-2023, MLP Team has enabled Data Scientist to go Live with Flipkart’s first use case using Azure OpenAI ChatGPT 3.5. Current ongoing focus and research topics under GenAI Engineering: An LLM/LIM model training framework over CPU/GPU, both in FCP, Azure ,GCP and other commercial partners. An LLM inferencing framework to host large models on multiple-GPUs and multi-node GPUs. LLM Monitoring and observability. Job Description Department : CDS Team Name : Jarvis/MLP Role : SDE III Who are you? You are a team player who wants to solve complex engineering problems around the rapidly changing Data Science domain with no blueprints. You are proficient in programming on either Python or Java. You have experience developing REST APIs, SDKs using Python or Java. You are proficient at developing containerized applications leveraging Docker, Kubernetes or related container stack. You are a champion of SDLC practices. You understand concepts of application development, infrastructure management, data engineering and platform constructs. You are aware of the Machine Learning/Deep Learning development life cycle covering aspects of EDA, Model development, (re) training, training and inference pipelines. You have experience with Deep Learning tools and libraries such as TensorFlow, Keras, and PyTorch. You have exposure to Data Preparation needs for different use cases. Data preparation involves tasks such as data cleaning, data transformation, feature engineering, and data integration. You have knowledge of storage systems and different Database systems. You are a hustler, tinkerer with open source frameworks. What will you do ? As a Machine Learning Engineer, you will play a crucial role in the development and implementation of cutting-edge artificial intelligence products. Your responsibilities will involve designing and constructing sophisticated machine learning models, as well as refining and updating existing systems. Build platform solutions to drive greater productivity for Data Scientists at Flipkart. Build tools to support adoption and quick productization of Data Science solutions build on recent advancements in the area of Generative AI, LLMs. Build frameworks to support distributed training, large model training within Flipkart on Hybrid compute. Develop services on top of Computer Vision and Natural Language capabilities developed by Flipkart Data Scientists. Develop self serve platform to allow Data Scientists to manage training, retraining, deployment, scheduling, monitoring, and improvement of ML models. Work on problems such as Data Version Controller, Experiment Tracking, Data Labeling, Active Learning, training large language models, building a cluster of GPUs optimized for inferring and training needs, both. Explore and conduct PoC using open source frameworks , AZURE and GCP offerings on Data Science. Bonus Points if you have: Experience with distributed data processing such as MR, Apache Spark, Apache Beam Understanding of common ML algorithms, Deep Learning, familiarity with NLP or computer vision domain , usage of GPUs in ML lifecycle. Exposure to CUDA programming. Experience with Google Cloud Platform or any other public cloud. Working knowledge of Kubernetes or any container orchestration technology/framework. Educational Qualifications Bachelors in Computer Science or related field. Must have taken up courses on Machine Learning/Deep Learning/ MLOps or possess a Masters in Data Science or related field. Demonstrable industry or academic experience with Machine Learning/Deep Learning domain. A GitHub repository showcasing portfolio of work on ML/DL Engineering. Open Positions: 1 Skills Required: Software Engineering, python, Low Level Design, Data Structures Location: Bangalore,Karnataka Education/Qualification: B Tech, Mtech Desirable Skills: Machine Learning, docker,Kubernetes Years Of Exp: 4.5 to 7 Years
