Data Engineer

Key Responsibilities

• Assist in designing, developing, and maintaining data pipelines for collecting, transforming, and processing structured and unstructured data.
• Write SQL queries to extract, manipulate, validate, and analyze data from relational databases.
• Develop Python scripts for data cleaning, transformation, and automation.
• Support ETL/ELT workflows to integrate data from multiple sources.
• Assist in building and maintaining data warehouses and data lakes.
• Perform data quality checks to ensure data accuracy, consistency, and completeness.
• Work with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Collaborate with data analysts, data scientists, and software engineers to meet data requirements.
• Monitor pipeline performance, troubleshoot failures, and help optimize processing efficiency.
• Maintain technical documentation for data workflows, schemas, and pipeline processes. Required Skills
• Basic to intermediate knowledge of Python programming.
• Good understanding of SQL and relational databases.
• Knowledge of ETL/ELT concepts and data transformation techniques.
• Understanding of database design, data modelling, and data warehousing.
• Familiarity with Git and version control.
• Basic knowledge of Linux commands and scripting.
• Strong analytical, problem-solving, and communication skills.