Software Engineer, Distributed Data Systems
Tasks
- Architect lakehouse data platforms
- Build distributed data-processing pipelines
- Design real time indexing data flows
- Develop streaming data pipelines
- Operate and monitor data systems
- Optimize ClickHouse for large scale analytics
- Scale vector databases and data layers
- Support embedding training infrastructure
Perks/Benefits
- Dental insurance
- Fertility benefits
- Parental leave
- Premium healthcare
- Vision insurance
- Wellness stipend
Skills/Tech-stack
Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | ClickHouse | Data Engineering | Delta Lake | Ray
Education
N/A
Roles
Regions
Countries
States
Related jobs
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R16h ago
-
Senior Data Engineer - Databricks USD 180K-248KAWS | Access Control | Amazon Web Services | Apache Spark | Automated testing401k match | Corporate Benefit Program | Discounted pet insurance | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeUS - Remote R19h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon20h ago
-
AI Architect USD 134K-237KAI Search | AI Security | API Gateway | API Integration | AWS BedrockAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountsSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …21h ago
-
AWS | Alerting | Amazon Kinesis | Apache Airflow | Cloud Pub/SubCareer growth | Collaborative culture | Fast-scaling environment | High-impact projects | Inclusive workplace cultureSenior-level Full TimeCanada1d ago
-
Machine Learning Engineer USD 120K-140KAI Pipelines | AI Workbench | AI endpoints | Apache Kafka | Automated testingEntry-level Full TimeDenver, Colorado, United States1d ago
-
Principal AI Architect Engineer USD 118K-195KAWS | AWS Lambda | Amazon Bedrock | Amazon EC2 | Amazon EKSSenior-level Full TimeNew York, United States1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code review100 percent remote | Career growth | Full-time employment | H1B transfer support | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data Modeling100 percent remote | Career growthMid-level Full TimeUnited States - Remote R1d ago
-
Data Engineer - 2373625 USD 98K-172KAzure Databricks | Data Modeling | Data Pipeline Awareness | Data Visualization | Data Warehousing401k matching | Employee stock purchase plan | Medical, dental, and vision | TelecommutingEntry-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
AWS | Airflow | Apache Spark | Azure Event | Azure Event Hubs401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Investigative Data Scientist/AI Engineer USD 95K-166KAgentic Workflows | Cloud Computing | Data Engineering | Data Visualization | Deep learning401k match | Bereavement leave | Education assistance | Employee resource groups | Employee stock purchase programMid-level Full TimeWashington DC, United States1d ago
-
Data Engineer USD 97K-172KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | Azure DataDiscounts on Lease Vehicles | Hybrid work environment | Medical benefits | Mental health benefits | Parental leaveSenior-level Full TimeFranklin, Tennessee - United States of …1d ago
-
Principal Engineer - Data Ingestion & AI Pipeline USD 122K-173KAccess Control | Apache Airflow | Apache Spark | Apache Spark SQL | Azure DataCareer development | Flexible benefits | In-office collaboration | Inclusive workplace | Wellness supportSenior-level Full TimeCharlotte, United States1d ago
-
Data Engineer (Python/PySpark) (Puerto Rico) USD 107K-204KAWS EMR | AWS Glue | Amazon Redshift | Apache Airflow | Apache Hudi401k match | Disability coverage | Employee assistance program | Employee scholar program | Hybrid workSenior-level Full TimeUS-PR-SANTA ISABEL-B1 ~ Felicia Industrial Park …1d ago
-
Principal Engineer - Data Ingestion & AI Pipeline USD 122K-173KAI Document Intelligence | Access Control | Apache Airflow | Apache Kafka | Apache SparkFlexible benefitsSenior-level Full TimeCharlotte, United States1d ago
-
Mid-level Full TimeHome Office: Tysons, VA, United States1d ago
-
Agile | Apache Spark | Cloud Computing | Data Modeling | Database Design401k match | Dental insurance | Flexible spending accounts | Health insurance | Life insuranceSenior-level Full TimeUnited States1d ago
-
Databricks Engineer USD 160K-200KApache Kafka | Databricks | Delta Lake | Delta Lake Connector | Delta Share401k plan | Flexible benefits | Health benefits | Vacation planMid-level TemporaryNew York, NY, United States1d ago
-
Research Scientist - Distributed Machine Learning USD 180K-287KBF16 | CUDA | CUDA kernels | DeepSpeed | Distributed Training401k | Dental insurance | Disability insurance | Employee assistance program | Health insuranceMid-level Full TimeSunnyvale, CA2d ago
-
Machine Learning Infrastructure Engineer USD 216K-330KCUDA | DeepSpeed | Distributed Systems | Distributed Training | FSDPMid-level Full TimeSunnyvale, CA2d ago
-
Data Engineer USD 120K-175KAPIs | AWS | Apache Spark | Data Pipelines | Data Processing401k plan | Dental insurance | Disability insurance | Employee assistance program | HolidaysMid-level Full TimeSunnyvale, CA2d ago
-
Sr Data Engineer USD 130K-164KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | CI/CDSenior-level Full TimeDes Moines, IA, United States2d ago