The Data Engineer will be an integral part of the R&D Data Transformation initiative. Your responsibilities will include building data products, developing data pipelines, and implementing best practice solutions. You should have experience with structured, semi-structured, and unstructured data. Strong SQL skills and knowledge of data warehouse architectures are required. Proficiency in Snowflake, Neo4j, and AWS data services is a plus. Experience with Agile and DevOps methodologies is preferred. A Bachelor's degree in computer science or a related field is required.
JOB DESCRIPTION
The Data Engineer will be an integral of the R&D Data Transformation initiative to
- Build a data product that support managing our overall product configuration information
- Establish and develop data pipelines for consolidation of the R&D Data-sets
- Operationalization of data pipelines
- Establish patterns and recommend best practice solutions
- Implement CICD pipelines for seamless delivery
- Having a programmer mind-set with a strong urge to upskill in other technologies
- Ability to work with structured, semi-structed and unstructured data
- Participate in architecture discussions and willing to explore new data technologies
- Ownership in recommending solutions best-fit for the larger program objective
- Build custom parsers to ingest files based on specific formats like yang
Responsibilities:
- Delivery of data pipelines leveraging various platforms (Snowflake , GraphDB , postgres)
- Ensure best practices are followed for the overall data architecture
- Performance tuning of pipeline workloads
- Supports ad hoc requests to support the business needs
- Work closely with architecture teams & cross functional teams to ensure solution alignment
- Willingness to adapt to technology shift
- Support migration of the legacy spreadsheet process into a seamless data pipeline
- Service Operation and end to end delivery responsible
- Convert complex excel structures into data structures that can be managed
- Ensure data security within the data eco-system
Key Skills:
- Strong understanding of Sql & No-Sql databases
- Experience in building data ingestion pipeline using native AWS data services. Experience in multi-cloud architecture is a big plus
- Experience working with Json , Parquet , XML templates
- Knowledge of Snowflake , Neo4j is a plus
- Good experience in building pipelines for text extraction from unstructured data
- Previous experience with end-to-end implementation of a data app / product
- Experience working in an Agile team.
- Experience in DevOps and Familiar with Jenkins, docker , Github , Git Actions
- Having a programmer mind-set
Minimum Requirement:
- Bachelor's degree in computer science, MIS, Business, or IT related field (or minimum 5 years of hands-on, relevant, technical work experience).
- Strong experience in implementing data management solutions using snowflake
- Prior Working knowledge of Data Integration Tool is a must
- Proficient in SQL
- Proficient in unstructured data processing
- Experience with data warehouse technical architectures, ETL/ELT, reporting/analytic tools, and scripting
- Experience in Agile / Scrum delivery model & strong communications skills
- Ability to work across time-zones especially with the North America counterparts is a must
The Ciena Experience:
Rewarding experience. Meaningful outcomes.
Make no mistake that we’re committed to developing leading network technology. But our path to innovation stems from our culture and outstanding people. We embrace diversity, celebrate inclusion, and champion ideas—across the table and around the world. This is the Ciena network. You won’t find complex organization charts and stiff protocols here! Innovation travels faster in an atmosphere where ideas can be freely discussed and brainstormed on the fly. A big part of work is about enjoying more satisfying outcomes—both personal and professional.
Becoming a Ciena employee: What you can expect from us
- You will receive notification of your successful application Successful applicants will be contacted by Talent Acquisition for an initial discussion. If suitable you will be considered for the short list and our formal interview process
- Ciena values the diversity of our workforce and respects its employees as individuals, regardless of race, nationality, religion, sexual orientation, gender and age.
- Ciena is also committed to developing inclusive, barrier-free selection processes and work environments. If contacted in relation to a job opportunity, you should advise Ciena in a timely fashion of the specific needs / accommodation measures which must be taken to enable you to be assessed in a fair and equitable manner. Information received relating to any specific needs / accommodation measures will be addressed confidentially.
Rewarding experience. Meaningful outcomes.
Making a difference in people's lives through design and implementation of leading network technologies. That's what motivates us.
A distinct way to work
Free thinking, free discussion, and collaboration are the norm. Expect more satisfying outcomes - both personal and professional.