Senior Data Engineer
Tasks
- Apply encryption at rest and in transit
- Build and support analytics and machine learning datasets
- Build batch and real-time data pipelines
- Collaborate on datasets and data products
- Design scalable data architectures
- Detect data anomalies
- Develop data products with APIs dashboards and timelines
- Document architectures and runbooks
- Enforce data access controls
- Implement CI/CD
- Implement automated testing and validation
- Manage data compliance HIPAA GDPR
- Mask or anonymize PII
- Mentor junior engineers
- Monitor data systems
- Perform data modeling and cataloguing
- Provision cloud infrastructure with IaC
- Respond to data incidents
- Standardize coding conventions
- Support machine learning data pipelines
- Tune performance for data processing
Perks/Benefits
- Annual bonus programme
- Birthday day off
- Flexible working hours
- Generous annual leave
- Professional development stipend
- Summer Fridays
- Well-being days
Skills/Tech-stack
AWS | Airflow | Anomaly Detection | Athena | Aurora | CI/CD | DBT | Data Cataloging | Data Governance | Data Modeling | Databricks | EMR | Encryption | Glue | GraphQL | Great Expectations | Incident Response | Lambda | PII masking | Postgres | Presto | Python | REST | S3 | SQL | Snowflake | Spark | Terraform
Education
Roles
Related jobs
-
Data Cataloging | Data Cleansing | Data Governance | Data Lineage | Data ModelingSenior-level Full TimeBeirut, Lebanon1d ago
-
AI Engineer - Valsoft USD 135K-197KAudit Logging | CI/CD | Chart.js | D3 | GitHub ActionsDirect user feedback | No ticket queue | Teams collaboration | Weekly syncSenior-level Full TimeBeirut, Beirut Governorate, Lebanon8d ago
-
Data Scientist - AMP USD 174K-225KAWS ECS | AWS ECS Fargate | Alembic | Anthropic Claude | Bayesian MethodsSenior-level Full TimeBeirut, Beirut Governorate, Lebanon21d ago
-
AI Developer - POLY INR 2000K-5000KAPI Design | Anthropic API | Cost Latency Monitoring | Evals | Function CallingSenior-level Full TimeBeirut, Beirut Governorate, Lebanon21d ago
-
AI Automation Engineer - EXEE USD 109K-175KAnthropic API | Data Privacy | Dynamics 365 | Dynamics 365 for Sales | JSONSenior-level Full TimeBeirut, Beirut Governorate, Lebanon21d ago
-
Senior-level Full TimeBeirut, Beirut Governorate, Lebanon27d ago
-
Intermediate Software Developer - FAI USD 135K-191K.NET | ASP.NET Web | ASP.NET Web API | Ansible | Apache SparkSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Engineer - FSA USD 140K-184KAPI Design | CI/CD | CloudTrail | Container Orchestration | Dependency ScanningSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Engineer - EFIN CAD 175K-225KAPI Design | CI/CD | CloudTrail | Container Orchestration | Dependency ScanningSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Engineer - KLPTK USD 135K-200KAPI Design | CI/CD | CloudTrail | Container Orchestration | Dependency ScanningSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
Senior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Automation Specialist - KLPTK CAD 95K-115KAPI Integrations | Artificial Intelligence | Billing automation | CRM | ChatGPTSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
Senior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Engineer - Cheryll Beumer USD 135K-190KAI Evaluation | API Design | CI/CD | CloudTrail | Container OrchestrationSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Automation Specialist - Cheryll Beumer USD 140K-190KAPI Integration | Billing | CRM | ChatGPT | Churn PredictionSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago