Senior Data Engineer
Tasks
- Apply encryption at rest and in transit
- Build and support analytics and machine learning datasets
- Build batch and real-time data pipelines
- Collaborate on datasets and data products
- Design scalable data architectures
- Detect data anomalies
- Develop data products with APIs dashboards and timelines
- Document architectures and runbooks
- Enforce data access controls
- Implement CI/CD
- Implement automated testing and validation
- Manage data compliance HIPAA GDPR
- Mask or anonymize PII
- Mentor junior engineers
- Monitor data systems
- Perform data modeling and cataloguing
- Provision cloud infrastructure with IaC
- Respond to data incidents
- Standardize coding conventions
- Support machine learning data pipelines
- Tune performance for data processing
Perks/Benefits
- Annual bonus programme
- Birthday day off
- Flexible working hours
- Generous annual leave
- Professional development stipend
- Summer Fridays
- Well-being days
Skills/Tech-stack
AWS | Airflow | Anomaly Detection | Athena | Aurora | CI/CD | DBT | Data Cataloging | Data Governance | Data Modeling | Databricks | EMR | Encryption | Glue | GraphQL | Great Expectations | Incident Response | Lambda | PII masking | Postgres | Presto | Python | REST | S3 | SQL | Snowflake | Spark | Terraform
Education
Roles
Related jobs
-
AI Developer - SAD con CAD 105K-145KAWS | Azure | CI/CD | Cloud Platforms | Database DesignAI-assisted development toolsSenior-level Full TimeBeirut, Beirut Governorate, Lebanon4d ago
-
AI Engineer - CARR USD 137K-170KAI-assisted coding | API Gateway | AWS Lambda | Amazon API | Amazon API GatewaySenior-level Full TimeBeirut, Beirut Governorate, Lebanon8d ago
-
Senior-level Full TimeBeirut, Lebanon19d ago
-
AI Engineer - Valsoft USD 135K-197KAudit Logging | CI/CD | Chart.js | D3 | GitHub ActionsDirect user feedback | No ticket queue | Teams collaboration | Weekly syncSenior-level Full TimeBeirut, Beirut Governorate, Lebanon29d ago
-
Data Scientist - AMP USD 174K-225KAWS ECS | AWS ECS Fargate | Alembic | Anthropic Claude | Bayesian MethodsSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago
-
AI Developer - POLY INR 2000K-5000KAPI Design | Anthropic API | Cost Latency Monitoring | Evals | Function CallingSenior-level Full TimeBeirut, Beirut Governorate, Lebanon1mo ago