Sr. Software Engineer - Data Infrastructure
Tasks
- Build and manage distributed data processing systems
- Build cluster health dashboards
- Deploy DevOps tools and CI CD pipelines
- Design and own APIs and automation
- Enable engineers and data scientists to run jobs
- Ensure availability reliability and security for distributed systems
- Own Flink and Spark infrastructure on Kubernetes
- Use Jupyter Notebooks for data analysis
- Work with Trino and Presto for queries
Perks/Benefits
- 401k
- Employee networks
- Paid adoption leave
- Paid parental leave
- Professional development opportunities
- Remote work
- Vacation and holidays
- Volunteer opportunities
- Wellness programs
Skills/Tech-stack
AWS | Amazon S3 | Ansible | Apache Flink | Apache Hive | Apache Iceberg | Apache Kafka | Apache Pinot | Apache Spark | CI/CD | Chef | Distributed Systems | Docker | Go | Java | Kotlin | Kubernetes | Minio | Presto | Ray | Scala | Terraform | Trino
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R12h ago
-
Senior AI/ML Engineer USD 192K-240KAWS | Agentic Orchestration | Automated Labeling | Automated Labeling Pipelines | AzureHybrid work scheduleSenior-level Full TimeRedwood City, CA (Hybrid); San Francisco, … R16h ago
-
Senior Software Engineer, Data Platform USD 146K-230KAPI Gateway | API Versioning | AWS Lambda | AWS RDS | AWS S3401k match | Catered lunch | Commuter benefit | Dental insurance | Fully paid parental leaveSenior-level Full TimeNew York, New York, United States R17h ago
-
Senior Forward Deployed AI Engineer USD 160K-226KData Pipelines | DevOps | Distributed Systems | Edge Computing | JAX401k match | Continuing education support | Function health subscription | Health & wellness stipend | Health, dental, vision benefitsSenior-level Full TimeAustin, TX R17h ago
-
Data Engineer USD 150K-200KAWS | Apollo | ClickHouse | Data Pipelines | Data Warehousing401k | Dental insurance | Equity compensation | FSA | HSAMid-level Full TimeRemote - US R19h ago
-
Data Scientist III - AI & Machine Learning USD 126K-149KAI Pipelines | Airflow | Apache Spark | Bayesian Inference | Bias Variance401k matching | Equity options grant | Flexible time off | Get Out Get Active funds | Health benefitsSenior-level Full TimeMissoula, Montana, United States R19h ago
-
Senior Staff Data Engineer USD 127K-158KAI machine learning | API Integration | AWS | Amazon ECR | Amazon S311 company-paid holidays | 401k match | Employee assistance program | Employee ownership program | Life and AD and D insuranceSenior-level Full TimeRemote United States R21h ago
-
Data Engineer USD 120K-160KAWS | Airflow | DBT | Data Warehousing | ELT401k plan | Commuter benefits | Employee Meals Snacks | FSA | Flexible time offSenior-level Full TimeLos Angeles; New York; Remote; San … R23h ago
-
Agile | Backend Development | Code review | Data Science | DebuggingFully remote | Mentorship | Paid apprenticeshipEntry-level Apprenticeship ContractRemote (United States) R1d ago
-
Machine Learning Engineer USD 130K-194KAI machine learning | AWS AI | AWS AI Machine Learning | Amazon DynamoDB | Amazon EC2Professional development | Work from homeMid-level Full TimeRemote, NY, US R1d ago
-
Senior Optimization Engineer USD 140K-180KAPIs | Asynchronous orchestration | Auditability | CP-SAT | Combinatorial OptimizationRemote workSenior-level Full TimeSchenectady, New York, United States, Remote R1d ago
-
Machine Learning Engineer/Data Scientist USD 130K-150KAWS | Azure | Data Preprocessing | Deep learning | Feature EngineeringMentorship | Personal development budget | Remote workMid-level Full TimeChicago, IL R1d ago
-
Machine Learning Engineer/Data Scientist USD 130K-150KAWS | Azure | Google Cloud | Matplotlib | NumPyAccess to mentors | Daily meals in office | Diverse team | Personal development time | Remote work weeksMid-level Full TimeChicago, IL R1d ago
-
Data Engineer USD 89K-141KAWS Glue | AWS Lambda | Access Control | Amazon Kinesis | Amazon QuickSightMid-level Full TimeUnited States R1d ago
-
Blockchain, Data Analytics (Remote) USD 125K-175KA/B | A/B Testing | AWS | Amazon Redshift | Apache Airflow401k | Health insurance | Maternity & paternity leave | Remote work environmentMid-level Full TimeNew York R1d ago
-
AWS | Amazon VPC | Azure | Azure VNet | Cloud SecurityConference speaking opportunities | Flexible schedule | Paid training | Research and publish opportunities | Unlimited vacationMid-level Full TimeLos Angeles, California, United States R1d ago
-
Lead Analytics Engineer - 10855 USD 149K-198KCI/CD | DBT | Data Governance | Data Modeling | Data QualitySenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
AI Ops | API Development | Azure | Bash | C#401k | Dental insurance | Life insurance | Medical insurance | Paid time offMid-level Full TimeIrvine, CA, United States R1d ago
-
Adaptive Control | Apache Spark | Azure DevOps | C++ | CI/CDFlexible hybrid work model | Flexible vacation policy | Paid Holidays | Paid time off | Personal and family careSenior-level Full TimeNew York, NY, US, 10001-8604 R1d ago
-
Adaptive Control | Agile | Audio Processing | Azure DevOps | C++Flexible vacation policy | Hybrid work model | Paid Holidays | Travel opportunitiesMid-level Full TimeNew York, NY, US, 10001-8604 R1d ago
-
AWS | Benchmarking | Code Quality | Code review | Data Pipelines401k matching | Dining | Flexible spending accounts | Healthcare | Onsite gymSenior-level Full TimeRemote - US R1d ago
-
Software Engineer III (AI/ML) USD 113K-169KAPI Design | AWS | CrewAI | Docker | DynamoDBCompany sponsored retirement plan | Flexible work environment | Health and wellness benefits | Hybrid work options | In person orientation processSenior-level Full TimeRemote (USA), United States R1d ago
-
Data Engineer - Data Warehouse Architect USD 74K-125KApache Spark | CI/CD | Containerization | Data Governance | Data ModelingSenior-level Full TimeNationwide Remote Office (US99), United States R1d ago
-
Sr. Data Engineer USD 139K-257KAWS | Apache Airflow | Continuous integration | Data Pipelines | DockerSenior-level Full TimeSan Jose, United States R1d ago
-
Azure Synapse | Big Data | Canonical Data | Canonical Data Model | Cassandra401k matching | Dental coverage | Domestic and regional travel | Hybrid work model | Medical coverageMid-level Full TimeHoboken, NJ, US, 07030 R1d ago