Data Integration Engineer

Responsibilities

• Data Pipeline Development: Build and maintain scalable data pipelines that support data transformation, integration, and loading across the data platform.
• Data Integrity & Quality: Ensure the integrity, quality, and security of data across the platform by implementing and developing appropriate data validation, monitoring, and error handling mechanisms.
• Performance Optimization: Optimize data workflows for performance, reliability, and scalability to meet business and technical requirements.
• Collaboration: Collaborate with data scientists, analysts, and other stakeholders to ensure data flows meet their processing and analytical needs.
• Continuous Improvement: Stay updated with the latest big data technologies and best practices, and implement improvements in data processing pipelines.
• Expertise in building and maintaining scalable data pipelines and architectures.