Software Engineer, Distributed Data Systems
Tasks
- Architect lakehouse data platforms
- Build distributed data-processing pipelines
- Design real time indexing data flows
- Develop streaming data pipelines
- Operate and monitor data systems
- Optimize ClickHouse for large scale analytics
- Scale vector databases and data layers
- Support embedding training infrastructure
Perks/Benefits
- Dental insurance
- Fertility benefits
- Parental leave
- Premium healthcare
- Vision insurance
- Wellness stipend
Skills/Tech-stack
Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | ClickHouse | Data Engineering | Delta Lake | Ray
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Senior Databricks Platform Engineer USD 140K-165KAWS | Active Directory | Apache Hive | Apache Spark | Audit LoggingSenior-level Full TimeArlington, VA, United States3h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R3h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R7h ago
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA9h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino14h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States18h ago
-
Lead Software Engineer (Data)-7999 USD 129K-203KAmazon CloudWatch | Amazon EC2 | Amazon EMR | Amazon IAM | Amazon S3Comprehensive health benefits | Emotional wellbeing support | Financial support benefits | Personalized benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R20h ago
-
Sr. Software Engineer (Data)-0336 USD 132K-203KAWS | Apache Spark | ClickHouse | Databricks | GitHubEmotional support | Financial benefits | Health benefits | Remote work days per weekSenior-level Full TimeVA - Reston, 11951 Freedom Dr … R20h ago
-
Amazon SageMaker | Azure Machine Learning | CI/CD | Cloud ML | Cloud ML platformsOn-site work | TS SCI CI polygraph clearanceSenior-level Full TimeWashington, DC20h ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R20h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States21h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA22h ago
-
AI R&D Engineer Co-op USD 168K-232KApache Cassandra | Apache Kafka | Apache Spark | Deep learning | Machine LearningNone Full TimeUnited States23h ago
-
AI R&D Engineer Co-op USD 168K-232KAnomaly Detection | Apache Kafka | Cassandra | Cause analysis | Deep learningNone Full TimeUnited States23h ago
-
AI R&D Engineer Co-op USD 168K-232KApache Kafka | Apache Spark | Cassandra | Deep learning | Machine LearningNone Full TimeUnited States23h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R23h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R23h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle23h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA1d ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas1d ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R1d ago
-
LA Kings - Sr. Data Engineer USD 111K-135KAlerting | Apache Spark | Batch Processing | Cost Optimization | Data GovernanceSenior-level Full TimeEl Segundo, CA1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Principal AI Engineer USD 130K-196KAI Safety | AWS | Agentic Workflows | Data Engineering | Evaluation401k match | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeDenver, CO1d ago
-
Staff Software Engineer (Data Engineer) USD 140K-165KAWS Lake | AWS Lake Formation | Amazon Athena | Apache Airflow | Apache Flink401k match | Dental insurance | Health insurance | Life insurance | Vision insuranceSenior-level Full TimeUnited States1d ago