Sr. Software Engineer - Data Infrastructure
Tasks
- Build and manage distributed data processing systems
- Build cluster health dashboards
- Deploy DevOps tools and CI CD pipelines
- Design and own APIs and automation
- Enable engineers and data scientists to run jobs
- Ensure availability reliability and security for distributed systems
- Own Flink and Spark infrastructure on Kubernetes
- Use Jupyter Notebooks for data analysis
- Work with Trino and Presto for queries
Perks/Benefits
- 401k
- Employee networks
- Paid adoption leave
- Paid parental leave
- Professional development opportunities
- Remote work
- Vacation and holidays
- Volunteer opportunities
- Wellness programs
Skills/Tech-stack
AWS | Amazon S3 | Ansible | Apache Flink | Apache Hive | Apache Iceberg | Apache Kafka | Apache Pinot | Apache Spark | CI/CD | Chef | Distributed Systems | Docker | Go | Java | Kotlin | Kubernetes | Minio | Presto | Ray | Scala | Terraform | Trino
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Senior Data Engineer USD 129K-165KAWS | Airflow | CI/CD | Data Modeling | Django401k | Half-day Fridays | Medical/Dental/Vision insurance | Paid Holidays | Remote workSenior-level Full TimeChicago, IL, US R1d ago
-
Solutions Engineer USD 150K-180KAI | Apache Flink | Apache NiFi | Apache Spark | Applied ScienceContinued Career Development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeMid-level Full TimeUS-California-Remote, United States R1d ago
-
Mid-level Full TimeReston, VA (VA30), United States R1d ago
-
API | AWS | Agile | Automation | AzureRemote work | Security Clearance Initiated Upon HireSenior-level Full TimeNationwide Remote Office (US99), United States R1d ago
-
Agile | Cloud infrastructure | DBT | Data Lakes | Data Modeling401k match | Dental insurance | Flexible work schedules | Holidays | Life insuranceSenior-level Full TimeUS-IN-REMOTE, United States R1d ago
-
Senior Embedded Software Engineer - Audio USD 115K-150KAIDL | ALSA | AOSP | ASoC | AndroidAdoption support | Adoption/support reimbursement | Child care assistance | Dental insurance | Employee resource groupsSenior-level Full TimeDearborn, MI, United States R1d ago
-
Senior Software Engineer, Storage USD 166K-210KAmazon CloudWatch | Amazon EC2 | Datadog | Go | MemcachedAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R1d ago
-
AI Solutions Engineer, East USD 125K-175KAWS | Azure | Cloud platform | Dspy | Generative AI401k plan | Dental insurance | Medical insurance | Mental wellness support | Parental leaveMid-level Full TimeRemote (New York) R1d ago
-
Senior Data Engineer, Sentinel (Pacific Time Zone) USD 153K-210KAWS | Airflow | Alerting | CI/CD | DatabricksSenior-level Full TimeUnited States R1d ago
-
Mid-level Full TimeAnywhere USA, United States R1d ago
-
Machine Learning Engineer USD 104K-131KAWS | Active Learning | Airflow | Argo | Azure401k match | Corporate discounts | Education assistance | Flexible work options | Maternity leaveSenior-level Full TimeRemote, REMOTE, United States R1d ago
-
AWS EKS | Access Control | Apache Iceberg | Apache S3 | CI/CDDental and vision coverage | ESPP | Flexible spending wallets | Remote-first work | Subsidized medical coverageSenior-level Full TimeRemote US R1d ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | DBTSenior-level Full TimeUnited States of America R1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental insurance | Flexible remote working options | Health insurance | Professional development and training opportunitiesSenior-level Full TimeWashington R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental benefits | Health benefits | Impactful national security projects | Professional development and trainingSenior-level Full TimeVirginia R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental benefits | Health benefits | Impactful projects | Professional development and trainingMid-level Full TimePennsylvania R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsSenior-level Full TimeTexas R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental benefits | Health benefits | Professional development and training | Remote work flexibility | Retirement benefitsSenior-level Full TimeNorth Carolina R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeNew York R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsMid-level Full TimeNew Jersey R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeMaine R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development | Remote work flexibility | Retirement benefitsSenior-level Full TimeMaryland R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative and innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeMichigan R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and trainingSenior-level Full TimeMassachusetts R1d ago