Data Platform Engineer
GBP 76K-100K (estimate) Senior-level Full Time
Tasks
- Build streaming and batch ETL or ELT jobs
- Containerize and orchestrate workloads with Docker and Kubernetes
- Create and manage infrastructure as code with Terraform and Ansible
- Design and optimize end-to-end data pipelines
- Design, implement, and manage CI/CD pipelines
- Develop automation scripts to reduce operational toil
- Handle Kafka incident response and root cause analysis
- Implement data security encryption secrets and least privilege access
- Manage AWS cloud infrastructure and monitoring
- Migrate streaming services to Kubernetes
- Operate Kafka clusters and related components
- Operate and support database platforms in production
- Participate in on-call incident response and troubleshooting
- Perform Kafka operations offset lag and consumer group management
- Set up observability metrics logs and tracing
- Support data warehouse operations and integrations
- Tune database performance and manage replication and HA DR
Perks/Benefits
- Certification study budget
- Course and conference budget
- Funded certification paths
- Hybrid/Remote flexibility
- On-call rotation
Skills/Tech-stack
AWS EC2 | AWS Glue | AWS IAM | AWS Secrets | AWS Secrets Manager | Amazon Athena | Amazon CloudWatch | Amazon ElastiCache | Amazon MSK | Amazon Redshift | Amazon S3 | Amazon VPC | Ansible | Apache Iceberg | Apache Kafka | Bash | CI/CD | Delta Lake | Distributed tracing | Docker | ELT | ETL | Encryption | HashiCorp Vault | Helm | Incident Response | KSQL | Kafka Connect | Kubernetes | Logging | Metrics | MongoDB | MySQL | Observability | Parquet | PostgreSQL | Python | Redis | SQL | Secrets Manager | Secrets management | Snowflake | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Platform | Data Platform Engineer | Engineer | Platform | Platform Engineer
Regions
Countries
India | Ireland | Latvia | Romania | United Kingdom
States
England, GB | Leinster, IE | Karnataka, IN | Riga, LV | București, RO
Related jobs
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R3h ago
-
Alerting | Batch Processing | Big Table | Data Modeling | Data ObservabilityFully remote | Inclusion and collaboration culture | Professional growth opportunities | Well-being support | Work-life balance initiativesMid-level Full TimeIndia R4h ago
-
Senior Engineer - Platform & Data Infrastructure INR 3000K-5000KAWS IoT | AWS IoT Core | ClickHouse | ECS | GoSenior-level Full TimeHyderbad7h ago
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R9h ago
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …12h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …12h ago
-
Senior Data Engineer EUR 71K-87KApache Spark | Caching | Cluster optimization | Databricks | Execution PlansBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full Time InternshipDublin, County Dublin, Ireland15h ago
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra15h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 1300K-2000KAmazon Aurora | Amazon S3 | Amazon Web Services | Backup and Recovery | CDCMid-level Full TimeMumbai, MH15h ago
-
DevOps / AWS Data Platform Engineer (Databricks, Snowflake, Aurora, S3, DBT) - Mumbai, MH - AS A INR 1500K-2500KAWS S3 | Alerting | Amazon Aurora | Amazon RDS | Amazon Web ServicesMid-level Full TimeMumbai, MH15h ago
-
Apache Spark | Data Pipelines | Data Validation | Databricks | Feature EngineeringMid-level Full TimeMumbai, MH15h ago
-
Lead MySQL Database Engineer INR 2500K-3100KAWS Aurora | AWS RDS | Amazon Web Services | Ansible | Backup and RecoveryCareer development | In-office work culture | Non-salary benefitsSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Kafka Administrator INR 3000K-4200KAWS | AWS Glue | AWS IAM | AWS Secrets | AWS Secrets ManagerBudget for courses and technical conferences | Funded certification paths | Hybrid/Remote flexibility | In-office work culture | Mentorship and career progressionSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
AI Governance | Apps Script | Artificial Intelligence | Automation | CRMRemote work | Social events | Training and developmentSenior-level Full TimeDublin, Dublin15h ago
-
Cloud / Infrastructure Engineer GBP 50K-70KAmazon EKS | Amazon Web Services | CI/CD | Docker | GitLab CIMid-level Full TimeWhiteley17h ago
-
Lead Software Engineer - Machine Learning INR 5000K-6612KCross-validation | Data Pipelines | Distributed Systems | Low Latency | Low-Latency SystemsSenior-level Full TimeHyderabad, India18h ago
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde18h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India18h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India19h ago
-
Senior-level Full TimeIN-KA-Bangalore19h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai19h ago
-
Expert Data Engineer INR 3500K-4200KAPI Integration | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingHybrid workSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Senior Analytics Engineer - Cyber Data Platform GBP 43K-54KApache Airflow | Azure | CI/CD | DBT | Data GovernanceAnnual bonus scheme | Bank holidays | Employee assistance programme | Flexible working | Free virtual GP serviceSenior-level Full TimeWelwyn Garden City, United Kingdom of …19h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India20h ago