Software Engineer II
Walmart
Bengaluru, Karnataka, India
Position Summary... Demonstrates up-to-date expertise and applies this to the development, execution, and improvement of action plans by providing expert advice and guidance to others in the application of information and best practices; supporting and aligning efforts to meet customer and business needs; and building commitment for perspectives and rationales. Provides and supports the implementation of business solutions by building relationships and partnerships with key stakeholders; identifying business needs; determining and carrying out necessary processes and practices; monitoring progress and results; recognizing and capitalizing on improvement opportunities; and adapting to competing demands, organizational changes, and new responsibilities. Models compliance with company policies and procedures and supports company standards of ethics and integrity by incorporating these into the development and implementation of business plans; using the Open Door Policy; and demonstrating and assisting others with how to apply these in executing business processes and practices. What you'll do... About the Team : Enterprise Business Services is invested in building a compact, robust organization that includes service operations and technology solutions for Finance, People, Associate Digital Experience. Our team is responsible for design, development, and operations of large-scale data systems operating at petabytes scale. We focus on creating pipelines, curating and aggregating huge data, distributed spark infrastructure. We interact with multiple teams across the company to provide scalable robust technical solutions. This role will focus on Data engineering and ETL development. A strong understanding of creating workflow is needed. This role will assist in ETL design leveraging standard Data Warehousing techniques and functional programming techniques. What you'll do: Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide drive value from data at Walmart Scale Develop high performance and scalable solutions that extract, transform, and load Spark/big data. Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement. Experience building and optimizing ‘spark/big data’ data pipelines, architectures and data sets involving petabyte and terabyte of data. Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the tech community. Engage with Product Management and Business to drive the agenda, set your priorities and deliver awesome product features to keep platform ahead of market scenarios. Closely interact with Data Engineers from within Walmart to identify right open-source tools to deliver product features by performing research, POC/Pilot. Engage with Product Management and Business to support and build data solutions and develop expertise w.r.t data thereby being known as the true data analyst. You also get to collaborate with team members to develop best practices and client requirements for the software. You will show your skills in analyzing and testing programs/products before formal launch to ensure flawless performance. Software security is of prime importance and by developing programs that monitor sharing of private information, you will be able to add tremendous credibility to your work. You will also be required to seek ways to improve the software and its effectiveness. You will be called upon to support the coaching and training of other team members to ensure all employees are confident in the use of software applications. What you'll bring: Minimum qualifications: Bachelor’s or master’s degree in computer science or related technical field. Over all 1-3 years of programming experience in Spark-Scala. 1-3 years of experience in building of large-scale data pipelines using big data technologies (i.e., Spark/Kafka/Hadoop/Hive/Presto/Airflow/BiqQuery/SQL). Good Knowledge on Big Data, Apache Spark Scala Development Good understanding of on-premises big data technology. Good/Strong understanding of ETL & Data Warehousing concepts Strong in connecting to and ingesting from multiple source types to Google Cloud Storage Additional Qualifications: Large scale distributed systems experience, including scalability and fault tolerance. Exposure to cloud infrastructure, such as Open Stack, GCP A continuous drive to explore, improve, enhance, automate and optimize systems and tools. Strong computer science fundamentals in data structures and algorithms Exposure to information retrieval, statistics, and machine learning. Excellent oral and written communication skills. Good understanding of metadata driven development Excellent problem solving, Critical and Analytical thinking skills.
