Job description
The Senior Datastage Developer will be responsible to design, develop and maintain ETL/ELT solutions. You will be responsible for coordinating data requests from the various teams, reviewing requirements, design and develop mapping rules documents extract, transform and load data. In addition, you will be responsible to mentor fellow team members to enhance their skills. You’ll be working in a fast-paced and high-volume processing environment, where quality and attention to detail are vital.
PRIMARY RESPONSIBILITIES
• Develop and maintain scalable ETL/ELT jobs in Datastage with various sources and targets like SQL, Oracle, DB2, SAP HANA, Hadoop, Cloud, S3, ftp, sftp, etc.
• Develop incremental data load jobs by using source/target CDC mechanism.
• Develop big data spark jobs using Datastage to process mass volume of data
• Provide technical assistance to team and evaluate jobs
• Rotation basis 24/7 on call support within ETL team
• Ability to work independently with minimal supervision
• Develop mapping document and maintain sufficient documentation on mapping rules.
• Perform unit testing, volume testing and end-to-end integration testing.
• Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements
• Work closely with our QA Team to ensure data integrity and overall system quality
KNOWLEDGE AND SKILL REQUIREMENTS
• BS/BA degree in Computer Science, Information Systems or related field
• Must have at least 5 years of experience in Datastage
• Must have AWS integration experience to read and write data into S3, Redshift, DynamoDB
• Strong knowledge in end-to-end solution design skills.
• Strong analytical and organizational skills
• Must have technical team lead experience
• Passion to learn new tools and technologies like cloud integration solutions.
• Must have agile development experience
• Understanding of Data architecture, replication, and administration
• Experience in working with real-time data feeds
• Strong debugging skills to troubleshoot production issues
• Comfortable working in a team environment
• Ability to identify problems, and effectively communicate solutions to peers and management
• Excellent verbal and written communication skills