Senior Database Engineer

The Role

We are working with a leading technology organization in Abu Dhabi focused on building advanced data and AI-driven platforms used by enterprises and government entities across the UAE. This role offers the chance to work on large-scale data environments, supporting real-time insights a...

The Role
We are working with a leading technology organization in Abu Dhabi focused on building advanced data and AI-driven platforms used by enterprises and government entities across the UAE. This role offers the chance to work on large-scale data environments, supporting real-time insights and business-critical decision-making through modern cloud and data technologies. Role Overview As a Senior Data Engineer, you will play a key role in designing and managing data systems that handle high volumes of information. You will be responsible for building reliable data pipelines, improving data quality, and ensuring systems are optimized for performance and scalability. You will also collaborate with data scientists, engineers, and product teams to support analytics and AI use cases. Key Responsibilities Data Pipeline & Integration Build and maintain scalable data pipelines for structured and unstructured data Manage data flows across multiple systems ensuring accuracy and consistency Support both batch and real-time data processing Data Processing & Performance Optimize data systems for speed and efficiency (partitioning, caching, parallel processing) Handle large datasets and streaming data using modern tools Improve performance of data workflows across environments Cloud & Platform Engineering Develop and deploy data solutions on cloud platforms (AWS, Azure, or GCP) Work with containerized environments using Docker and Kubernetes Ensure systems are stable, scalable, and production-ready Database & Analytics Support Design and optimize queries across SQL and NoSQL databases Support data platforms used for reporting, analytics, and AI applications Work with logging and monitoring tools for data tracking Data Governance & Quality Ensure data accuracy, security, and compliance across systems Implement validation checks and data quality standards Maintain proper documentation and data lineage Collaboration & Continuous Improvement Work closely with cross-functional teams including data science and engineering Continuously improve data architecture and tools Support AI and machine learning use cases through data preparation

Requirements
To be considered for this role, you need to meet the following criteria: UAE National (with Family Book) Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field Minimum 8 years of experience in data engineering or similar roles Strong programming skills in Python and scripting (Linux/Unix environment) Advanced experience with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB) Hands-on experience with data pipelines and large-scale data processing Experience working with cloud platforms (AWS, Azure, or GCP) Knowledge of Docker and Kubernetes Experience with real-time data streaming tools (e.g., Kafka) Strong problem-solving and analytical skills Preferred Skills (Advantageous) Experience with data governance, data quality, and lineage tools Familiarity with data lakes or lakehouse architectures Exposure to AI/ML data environments or feature engineering Knowledge of CI/CD pipelines and automation tools Experience with monitoring and logging platforms (e.g., ELK stack) To learn more about other roles we have, please visit our website - www.blackpearlconsult.com

About the company
About Us Helping professionals grow. Supporting businesses thrive. Black Pearl is a HR consultancy and recruitment firm based in the UAE. We connect skilled professionals with leading organizations across the Gulf region, offering a personalized and thoughtful approach to hiring. Our team specializes in recruiting for roles across key industries, including but not limited to: - Healthcare and Life Sciences - Engineering and Construction - Technology and Digital - Finance and Accounting - Hospitality and Retail - Government and Emiratization Whether youre searching for your next opportunity or looking to hire, we work closely with you to understand your goals and find the right fit.