Software Engineer, Distributed Data Systems
Tasks
- Architect lakehouse data platforms
- Build distributed data-processing pipelines
- Design real time indexing data flows
- Develop streaming data pipelines
- Operate and monitor data systems
- Optimize ClickHouse for large scale analytics
- Scale vector databases and data layers
- Support embedding training infrastructure
Perks/Benefits
- Dental insurance
- Fertility benefits
- Parental leave
- Premium healthcare
- Vision insurance
- Wellness stipend
Skills/Tech-stack
Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | ClickHouse | Data Engineering | Delta Lake | Ray
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Customer Engineer, Data/Analytics, Google Public Sector USD 152K-222KApache Spark | Batch Processing | Big Data | Cloud Architecture | Data GovernanceBonus target | Equity | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeReston, VA, USA; Atlanta, GA, USA6h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino12h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States15h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States19h ago
-
Software Engineer, ML Platform (ML Training) USD 175K-265KAWS | Computer Vision | DeepSpeed | Distributed Training | JAXMid-level Full TimeFoster City, CA19h ago
-
AI R&D Engineer Co-op USD 168K-232KApache Cassandra | Apache Kafka | Apache Spark | Deep learning | Machine LearningNone Full TimeUnited States20h ago
-
AI R&D Engineer Co-op USD 168K-232KAnomaly Detection | Apache Kafka | Cassandra | Cause analysis | Deep learningNone Full TimeUnited States20h ago
-
AI R&D Engineer Co-op USD 168K-232KApache Kafka | Apache Spark | Cassandra | Deep learning | Machine LearningNone Full TimeUnited States20h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R21h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R21h ago
-
Machine Learning Research Engineer, App Store Search USD 185K-313KA/B | A/B Testing | Apache Spark | B testing | Fine TuningMid-level Full TimeSeattle21h ago
-
Software Engineer (Data Engineer) USD 90K-135KAPI | AWS | Apache Airflow | Apache Spark | Azure401k plan | Employer health insurance | Employer life and disability insurance | Paid government holidays | Paid time offMid-level Full TimeHerndon, VA22h ago
-
Senior Data Engineer USD 144K-187KAWS Lambda | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon S3401k employer contribution | Dental insurance | Flexible Remote Friendly Work Options | Health Savings Account employer contribution | Health insuranceSenior-level Full TimeAustin, Texas22h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R22h ago
-
LA Kings - Sr. Data Engineer USD 111K-135KAlerting | Apache Spark | Batch Processing | Cost Optimization | Data GovernanceSenior-level Full TimeEl Segundo, CA22h ago
-
Senior-level Full TimeRemote - United States R22h ago
-
Principal AI Engineer USD 130K-196KAI Safety | AWS | Agentic Workflows | Data Engineering | Evaluation401k match | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeDenver, CO22h ago
-
Staff Software Engineer (Data Engineer) USD 140K-165KAWS Lake | AWS Lake Formation | Amazon Athena | Apache Airflow | Apache Flink401k match | Dental insurance | Health insurance | Life insurance | Vision insuranceSenior-level Full TimeUnited States23h ago
-
Staff Data Engineer - Data Engineering USD 207K-275KAccess Control | Apache Fluss | Apache Hudi | Apache Iceberg | Apache Paimon401k matching | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTOSenior-level Full TimeLivingston, NJ / New York, NY …23h ago
-
Staff Software Engineer, Data Products USD 171K-224KAWS | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k retirement savings plan | Flexible time off | Generous parental leave | Health, dental, and vision insurance | Lifestyle spending account mental health support solutionsSenior-level Full TimeRemote, USA R23h ago
-
Sr. Data Engineer USD 119K-180KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage401k | Dental insurance | Medical insurance | Mentorship | Onsite workSenior-level Full TimeIrving, TX23h ago
-
Senior Software Engineer (Data Engineer) USD 138K-162KAWS | Akka | Algorithms | Apache Spark | Cloud Native401k plan company match | Basic life insurance | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeUnited States R23h ago
-
Airflow | Amazon Kinesis | Amazon Web Services | Apache Flink | Apache SparkRemote workMid-level Full TimeColumbia - Maryland1d ago
-
Machine Learning Engineer USD 156K-281KAirflow | Apache Spark | Data Drift | Data drift monitoring | Delta LakeSenior-level Full TimeMiami, FL; Toronto, Canada; Seattle, WA1d ago
-
Machine Learning Engineer USD 140K-190KApache Flink | Apache Kafka | Apache Spark | Bigtable | CI/CDMid-level Full TimeSan Francisco, California1d ago