Distributed Systems Engineer - Data Platform (Delivery, Database, Retrieval)
Tasks
- Build data delivery pipeline components
- Build log delivery solutions and integrations
- Collaborate with teams on data needs
- Contribute to ClickHouse open source
- Design scalable distributed systems
- Develop ClickHouse analytical platform features
- Develop GraphQL APIs for data access
- Develop alerting solutions based on logs and metrics
- Identify remove performance bottlenecks
- Maintain data integrity and low latency delivery
- Optimize data ingestion processes
- Optimize query performance
- Research and evaluate new technologies for data platforms
- Scale monitor and maintain database clusters
Perks/Benefits
Skills/Tech-stack
ClickHouse | Concurrency | Database tuning | Distributed Systems | Docker | Flink | Go | Grafana | GraphQL | High Throughput | High-Throughput Systems | Kafka | Kubernetes | Linux | Observability | Prometheus | SQL | Terraform
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Senior Data Engineer USD 120K-160KApache Airflow | BigQuery | Cloud Composer | Cloud Storage | Cloud platform401k employer match | Bereavement leave | Comprehensive health insurance | Employee referral bonuses | Paid HolidaysSenior-level Full TimeRemote R7h ago
-
Contractor: Lead Analytics Engineer USD 126K-150KAWS | Airflow | Automated testing | Cloud infrastructure | Continuous integrationBackground check requiredSenior-level ContractRemote - Argentina; Brazil;Chile; Costa Rica R14h ago
-
Senior AI Engineer USD 180K-257KAgent Orchestration | Artificial Intelligence | CI/CD | Caching | Cost OptimizationSenior-level Full TimeRemote R15h ago
-
Senior Systems Administrator / Data Platform SME USD 125K-180KCompliance | Cybersecurity reporting | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeRemote R16h ago
-
AWS | Airflow | Data Governance | Data Lake | Data ModelingAgile collaboration | Partial remote work | SAFe participationSenior-level Full TimeParis, IDF, France R18h ago
-
Working Students in Data Engineering (m, w, d) EUR 32K-32KApache NiFi | ETL | NoSQL | Pandas | PySparkCertifications and training | Continuous support for development | Flexible working hours | Friendly work environment | One office day per weekEntry-level Contract Full Time Part TimeUlm, Germany R20h ago
-
Axolotl | Data Curation | Data Preprocessing | Deep learning | Direct Preference OptimizationFully remote | Impactful projects | Inclusive workplace | International team collaboration | Open source exposureMid-level Full TimeFinland R21h ago
-
Axolotl | Deep learning | Direct Preference Optimization | Distributed Systems | Efficient Fine TuningContinuous learning | Fully remote | International team collaboration | Professional developmentMid-level Full TimeChile R21h ago
-
Axolotl | Deep learning | Direct Preference Optimization | Distributed Systems | Efficient Fine TuningContinuous learning | Exposure to Open Source AI | Fully remote work | International collaboration | Professional developmentMid-level Full TimeTurkey R21h ago
-
Axolotl | Direct Preference Optimization | Distributed Systems | Efficient Fine Tuning | Fine TuningContinuous learning opportunities | Fully remote work | Inclusive workplace | International collaboration | Open source exposureMid-level Full TimeAustralia R21h ago
-
Axolotl | Data Curation | Data Preprocessing | Direct Preference Optimization | Distributed SystemsContinuous learning | Fully remote | Inclusive workplace | International team collaboration | Open source exposureMid-level Full TimeSouth Africa R21h ago
-
Axolotl | Deep learning | Direct Preference Optimization | Distributed Systems | Efficient Fine TuningContinuous learning | Fully remote work | Inclusive workplace | International team collaboration | Open source exposureMid-level Full TimeFrance R21h ago
-
Axolotl | Deep learning | Direct Preference Optimization | Distributed Systems | Efficient Fine TuningContinuous learning | Fully remote | Inclusive workplace | Open source exposure | Professional developmentMid-level Full TimeGermany R21h ago
-
API Design | Apache Airflow | Apache Spark | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R21h ago
-
Data Engineer confirmé(e) - Assurance - Lille EUR 45K-48KAWS | Azure | CI/CD | Data virtualization | DataOpsBonus plan | Cooptation bonus | Employee Committee | Health insurance | Meal vouchersMid-level Full TimeVilleneuve-d'Ascq, Hauts-de-France, France R22h ago
-
Amazon Web Services | Apache Airflow | Apache Flink | Apache Spark | Cloud ComputingContinuous learning | Fully remoteSenior-level Full TimeBrazil R1d ago
-
Product Engineer – Enterprise Analytics Services INR 3264K-5876KAI-assisted engineering | APIs | Agile | Cloud Native | Cloud-native developmentSenior-level Full TimeBengaluru North, Karnataka, India R1d ago
-
AWS Bedrock | Amazon Web Services | CI/CD | Cloud Computing | Data AnalysisCourse discounts | Dental insurance | Discounts and exclusive offers | Fully remote work | Health insuranceMid-level Full TimeBrazil R1d ago
-
AWS | Airflow | Amazon EKS | Amazon Redshift | Amazon S3Collaborative team | Continuous learning | Fully remote | Inclusive workplace | Occasional office visitsEntry-level Full TimeBrazil R1d ago
-
API Design | Agent workflows | Alerting | Batching | CachingContinuous learning | Flexible work schedule | Fully remote | Ownership culture | Professional growthSenior-level Full TimeSpain R1d ago
-
Alerting | Batching | Caching | Distributed Systems | DockerAutonomy | Continuous learning | Flexible work options | Fully remote | Ownership cultureSenior-level Full TimeGermany R1d ago
-
Batch Processing | Caching | Distributed Systems | Docker | EmbeddingsAutonomy | Continuous learning | Equity opportunities | Flexibility | Fully remoteSenior-level Full TimeFrance R1d ago
-
Alerting | Batching | Caching | Distributed Systems | DockerAutonomy | Continuous learning | Professional growth | Remote work flexibilitySenior-level Full TimeIreland R1d ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R1d ago