Data Engineer Offline

We are building a next-generation AI-powered platform designed for comprehensive observability of digital infrastructure, including mobile networks and data centers. By leveraging advanced analytics, automation, and real-time monitoring, we empower businesses to optimize performance, enhance reliability, and prevent failures before they happen.

Our platform delivers deep insights, anomaly detection, and predictive intelligence, enabling telecom operators, cloud providers, and enterprises to maintain seamless connectivity, operational efficiency, and infrastructure resilience in an increasingly complex digital landscape.

We have offices in Doha, Qatar and Muscat, Oman. This position requires relocation to one of these offices.

Job Summary
As a Senior Data Engineer, you will be responsible for building and maintaining end-to-end data infrastructure that powers our AI-driven observability platform. You will work with large-scale datasets, both structured and unstructured, and design scalable pipelines that enable real-time monitoring, analytics, and machine learning. This is a hands-on engineering role requiring deep expertise in data architecture, cloud technologies, and performance optimization.
Key Responsibilities

Data Pipeline Development
 

• Design, develop, and maintain scalable ETL/ELT pipelines from scratch using modern data engineering tools
• Ingest and transform high-volume data from multiple sources, including APIs, telemetry, and internal systems
• Write high-performance code to parse and process large files (JSON, XML, CSV, etc.)
• Ensure robust data delivery for downstream systems, dashboards, and ML models

Infrastructure & Optimization
 

• Build and manage containerized workflows using Docker and Kubernetes
• Optimize infrastructure for performance, availability, and cost-efficiency
• Implement monitoring, alerting, and data quality checks across the data pipeline stack

Collaboration & Best Practices
 

• Work closely with AI/ML, backend, and platform teams to define and deliver on data requirements
• Enforce best practices in data modeling, governance, and engineering
• Participate in CI/CD processes, infrastructure automation, and documentation

Required Qualifications

Experience
 

• 4+ years of hands-on experience in data engineering or similar backend roles
• Proven experience designing and deploying production-grade data pipelines from scratch

Technical Skills
 

• Proficiency in Python or Scala for data processing
• Deep knowledge of SQL and noSQL systems (e.g., MongoDB, DynamoDB, Cassandra, Firebase)
• Hands-on experience with cloud platforms (AWS, GCP, or Azure)
• Familiarity with data tools like Apache Spark, Airflow, Kafka, and distributed systems
• Experience with CI/CD practices and DevOps for data workflows

Soft Skills
 

• Excellent communication skills and the ability to work independently in a fast-paced environment
• Strong analytical mindset and attention to performance, scalability, and system reliability

Preferred Qualifications
 

• Background in the telecom or IoT industry
• Certifications in cloud platforms or data technologies
• Experience with real-time streaming, event-driven architectures, or ML/Ops
• Familiarity with big data ecosystems (e.g., Hadoop, Cloudera)
• Knowledge of API development or experience with Flask/Django
• Experience setting up A/B test infrastructure and experimentation pipelines

Nice to have 
 

Experience with the integration and maintenance of vector databases (e.g., Pinecone, Weaviate, Milvus, Qdrant) to support LLM workflows including embedding search, RAG, and semantic retrieval.

 
 What We Offer
 

• Performance-Based Compensation: Tied to achieving and exceeding performance targets, with accelerators for surpassing goals
• Shares and Equity: Participation in our Employee Stock Option Plan (ESOP)
• Growth Opportunities: Sponsored courses, certifications, and continuous learning programs
• Comprehensive Benefits: Health insurance, pension contributions, and professional development support
• Annual Vacation: Generous paid annual leave
• Dynamic Work Environment: A culture of innovation, collaboration, and creative freedom
• Impact and Ownership: Shape the future of digital infrastructure and leave your mark
• Flexible Work Arrangements: Options to work remotely or from our offices
• A Mission-Driven Team: Join a diverse, passionate group committed to meaningful change