Data Engineer
Tasks
- Apply data governance quality control and compliance
- Build and integrate Kafka Connect real time data pipelines
- Build and manage APIs and microservices
- Configure and manage Apache Kafka brokers
- Coordinate and mentor data engineering teams
- Design and implement Kafka Streams pipelines
- Develop event-driven architectures
- Develop real time data pipelines for enterprise systems
- Implement publish subscribe patterns
- Integrate and optimize streaming architectures using Kafka and Confluent
- Migrate monolithic systems to Kafka Streams based architectures
- Process real time data using Spark Streaming or Flink
- Solve data processing bottlenecks and performance issues
- Translate business requirements into technical solutions
- Use Confluent Schema Registry and KSQL
Perks/Benefits
- Career progression
- Free psychologist consultations
- Health insurance
- Shareholder option
- Technology course scholarships
- Work-life balance
Skills/Tech-stack
API Development | Amazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Apache Spark Streaming | Azure | CI/CD | Cassandra | Cloud platform | Confluent Schema Registry | Data Governance | Data Quality | Docker | Event Driven | Event-driven architecture | GDPR | Git | Google Cloud | Google Cloud Platform | Java | Jenkins | KSQL | Kafka Connect | Kafka Streams | Kubernetes | Microservices | MongoDB | PostgreSQL | Publish/Subscribe | Python | Scala | Schema Registry | Spark Streaming | Web Services
Education
N/A
Roles
Related jobs
-
AI | API Development | Database Design | Deployment Pipelines | Next.jsFlexible hours | Freelance | Long-term engagement | Remote work | Tooling creditsEntry-level FreelanceRemote (Germany) R20d ago
-
Senior AI Engineer USD 140K-220KAPI Integration | AWS | Anthropic API | Azure | Azure OpenAIConference and course support | Flexible working hours | Indefinite contract | Knowledge sharing sessions | MentoringSenior-level Full TimeRemote, Serbia (Remote) R4h ago
-
Senior Software Engineer – AI (Full time) (Remote) PHP 100K-160KAPI Development | Backend Development | Data extraction | Document processing | LLM orchestrationFlexible hours | Fully remoteSenior-level Full TimeQuezon City, Philippines R7h ago
-
Software Engineer (Leadership) - Machine Learning GBP 112K-130KApache Spark | Artificial Intelligence | Bias Mitigation | Bigtable | Data AnalysisSenior-level Full TimeZurich, Switzerland | Remote, UK | … R10h ago
-
Software Engineer (GenAI) GBP 48K-58KAWS | Agile | CI/CD | Docker | GPTBike loan scheme | Buy As You Earn Scheme | Death in Service scheme | Dental plan | Employee assistance programEntry-level Full TimeManchester / Hybrid, England, United Kingdom R11h ago
-
Cloudflare | Docker | Event Processing | Go | JavaScriptHigh ownership culture | Remote work flexibility | Startup environmentSenior-level Full TimeRemote, US R15h ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R17h ago
-
Senior Developer Experience Advocate USD 141K-190KAI Agents | Benchmarking | DBT | Documentation | GitHub401k with guaranteed contribution | Healthcare | Home office stipend | Paid parental leave | Unlimited vacationSenior-level Full TimeUS - Remote R19h ago
-
Emerging Talent - Working Student/Intern - Computational Imaging (PyTorch) 2026 (Garching) EUR 26K-30KC++ | Differentiable Rendering | Inverse problems | Neural Networks | OptimizationFlexible part-time schedule | Remote work flexibility | Thesis collaborationEntry-level Full Time Internship Part TimeDE-BY-GARCHING-SCHLEISSHEIMER STRABE 92, Germany R21h ago
-
Data Platform Engineer USD 124K-201KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache FlinkFamily leave | Flexible paid time off | Free food and snacks | Health care plan | Life insuranceSenior-level Full TimeOrlando, Florida, United States - Remote R21h ago
-
Data & AI Engineer GBP 47K-65KAWS | Docker | Drupal | Git | Google CloudAnnual leave | Birthday day off | Cycle to work scheme | Dental insurance | Employee assistance programmeMid-level Full TimeLondon, England, United Kingdom - Remote R21h ago
-
Senior Data Engineer PLN 232K-384KAzure Data | Azure Data Factory | Azure Databricks | Cloud Data | Cloud Data PlatformsCollaborative team culture | Flexible work arrangements | Non operational allowance | Supportive HR and management teamSenior-level Full TimePoland - Remote R21h ago
-
Data Engineer USD 110K-126KAWS CloudFormation | Amazon EC2 | Amazon S3 | Apache Airflow | Apache Iceberg401k match | Dental insurance | Employee stock purchase plan | Flexible time off | Medical insuranceSenior-level Full TimeHybrid - Denver, United States R21h ago
-
Audio Understanding | Automation | Computer Vision | Content Moderation | Deep learningEquity packages | Flexible leave options | Inclusive parental leave | Remote work in Australia | Wellbeing allowanceSenior-level Full TimeAdelaide, SA, Australia R22h ago
-
Automation | Experimentation | Generative AI | MLOps | Machine LearningEquity compensation | Flexible leave options | Parental leave | Wellbeing allowanceSenior-level Full TimeMelbourne, VIC, Australia R22h ago
-
Staff Analytics Engineer - CANADA (Remote) CAD 140K-200KAI Agents | Airflow | DBT | Data Architecture | Data ModelingRemote work | Team collaboration | Unlimited learning budgetSenior-level Full TimeCanada R22h ago
-
Staff Analytics Engineer - US (Remote) USD 158K-232KAirflow | DBT | Data Modeling | Data Monitoring | Data QualityRemote work | Unlimited learning budgetSenior-level Full TimeUnited States R22h ago
-
AWS | Agent Orchestration | Agent systems | Amazon SQS | Anthropic ClaudeHigh-growth environment | Ownership culture | Remote work | Unlimited AI token budgetSenior-level Full TimeCanada R22h ago
-
AWS | Agent Orchestration | Amazon SQS | Distributed Systems | Event DrivenRemote work | Unlimited learning and development budgetSenior-level Full TimeUnited States R22h ago
-
Staff Software Engineer, Combinatorial Optimization USD 155K-213KC# | C++ | CI/CD | Cloud Native | Cloud Native ArchitectureCompany holidays | Health insurance | Learning and development reimbursement | Life insurance | Long-term disabilitySenior-level Full TimeTorrance, California, United States; US - … R22h ago
-
Staff AI Engineer - Applied AI (Remote) USD 206K-243KAIOps | Agents | Amazon Bedrock | Anthropic | Distributed Systems401k plan | Community and employee resource groups | Dental insurance | Department stipend | Disability insuranceSenior-level Full TimeRemote - United States R1d ago
-
Analytics Engineer USD 92K-147KAirflow | Business Intelligence | DBT | Data Modeling | Data WarehousingHybrid work model | Remote work optionSenior-level Full TimeRemote, USA R1d ago
-
API Gateway | AWS | AWS Lambda | Amazon Aurora | Amazon DynamoDBAnnual performance bonus | Bereavement leave | Dental insurance | Education reimbursement | Family bondingSenior-level Full TimeSantiago, SANTIAGO, Chile R1d ago
-
Senior Software Engineer, Data Infrastructure USD 191K-225KAWS EMR | Apache Airflow | Apache Iceberg | Apache Spark | Data ETLEmployee travel credits | Remote eligibleSenior-level Full TimeUSA - Remote R1d ago
-
Airflow | BigQuery | CI/CD | Cause analysis | Cloud ComposerContinuous improvement | Fast-paced environment | Ownership culture | Remote-first collaborationSenior-level Full TimeLATAM R1d ago