Expertise & Experience for best results. Building Africa’s economy through innovative technology solutions.
Overview
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring its scalability, reliability, and performance on-premises. You'll collaborate closely with cross-functional teams to understand data requirements, implement robust pipelines, and contribute to the optimization of our data architecture.
Roles & Responsibilities
- Design, build, and maintain scalable and efficient data pipelines and architectures for both batch and real-time processing.
- Collaborate with data scientists, analysts, and stakeholders to understand data needs and translate them into technical requirements.
- Develop and implement data models, schemas, and database designs to support business objectives.
- Ensure data quality, integrity, and security throughout the entire data lifecycle.
- Optimize and tune existing data infrastructure for performance and reliability.
- Evaluate and implement new tools and technologies to enhance data processing and analysis capabilities.
- Troubleshoot and resolve data-related issues in a timely manner.
- Document processes, procedures, and solutions for future reference and knowledge sharing.
- Ensure compliance with data governance and security policies
- Collaborate with data scientists, data architects and ML engineers on several projects
- Collaborate with management to understand and execute company objectives
Skills
- Previous experience as a data engineer or in a similar role.
- Technical expertise with database technologies, ETL (extract, transform, load) processes, data models, data mining, data warehousing, data lake, big data, data integration, data web-scrape and segmentation techniques.
- Knowledge of programming languages (e.g., Java, Python and Scala)
- Data Pipelines: Understands how to build data pipelines using tools like Apache Spark, Apache Kafka, Hadoop and Apache Airflow.
- Hands-on experience with SQL database design and know about NoSQL databases such as Cassandra, MongoDB, and HBase.
- Great numerical and analytical skills
- Data engineering certification (e.g., IBM Certified Data Engineer) is a plus
- Soft Skills: Good communication skills, problem-solving skills, and a willingness to learn are essential to succeed as a data engineer.
Method of Application
Signup to view application details.
Signup Now
