Senior Big Data Engineer
Tasks
- Author solution design documents
- Automate infrastructure on Kubernetes
- Build and optimize batch and real time data pipelines
- Champion engineering best practices with CI CD and testing
- Collaborate with security and application stakeholders
- Design scalable data processing pipelines
- Ensure SLA availability performance and data quality
- Evaluate new technologies and build proofs of concept
- Implement monitoring, alerting, and runbooks
- Lead big data infrastructure delivery
- Maintain end to end observability with Grafana
- Manage on-call incident response
- Onboard and mentor vendor teams and partners
- Provision and manage cloud infrastructure with Terraform
- Triaging and resolve production incidents
Perks/Benefits
- 401k matching
- Employee assistance program
- Flexible paid time off
- Medical, dental, vision, life, and disability insurance
- Paid Holidays
- Paid parental leave
- Paid sick time
- Work from home
Skills/Tech-stack
AWS | Access Control | Airflow | Alerting | Apache Spark | Azure | CI/CD | Data Auditing | Data Governance | Dataproc | Encryption | GCP | Git | Go | Grafana | Incident Management | Infrastructure as Code | Java | Kafka | Kubernetes | Linux | Machine Learning | Monitoring | NLP | Observability | On-Call | On-call incident management | Python | Redpanda | Reliability | Runbooks | Scala | Scalability | Subversion | Systems Design | Temporal | Terraform | “as-code”
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
AI/ML Systems Engineer USD 135K-210KAI Assurance | AI Governance | AI machine learning | Agentic Workflows | Anomaly DetectionSenior-level Full TimeDayton, OH, USA5h ago
-
Data Engineer USD 114K-160KCribl | Data Modeling | Data Warehouse | Data analytics | Data pipeline401k match | Holiday pay | Medical, dental & vision coverage | Paid time offMid-level Full TimeHuntsville, AL, United States6h ago
-
20454 - Analytics Engineer x 2 GBP 40K-42KAzure Data | Azure Data Factory | Azure Synapse | Data Factory | Data ModelingFlexible working | Hybrid working | Training and coachingEntry-level Full TimeNational, National7h ago
-
AI Agents | AI-assisted coding | Amazon Web Services | Artificial Intelligence | Assisted codingBackground Screening E Verify | CJIS CertificationSenior-level ContractColumbia, United States8h ago
-
Airflow | Apache Spark | CI/CD | Data Governance | Data LakehouseSenior-level ContractAustin, United States8h ago
-
Causal Inference | Cross-modal fusion | DPO | Data Modeling | Fraud DetectionEntry-level Full TimeSan Jose, California, United States9h ago
-
Container Runtime | Kubernetes | Microservices | Observability | Performance TuningSenior-level Full TimeSan Jose, California, United States9h ago
-
CV/NLP/Multimodal LLM Machine Learning Engineer Graduate (TikTok Trust and Safety) - 2026 Start (BS/MS) USD 119K-177KActive Learning | Computer Vision | Data Pipelines | Language Models | Language ProcessingGrowth opportunities | Onboarding programEntry-level Full TimeSan Jose, California, United States9h ago
-
Charm Security-Forward Deployed AI Engineer USD 140K-200KAI Agents | API | Agentic Workflows | Automation | Backend DevelopmentCustomer Site Workshops | Travel opportunitiesMid-level Full TimeRemote, OR, US R9h ago
-
Member of Technical Staff - Simulation Engineer USD 180K-300KBenchmarking | C++ | Calibration | Data Generation | Distributed SystemsOn-site work in San FranciscoSenior-level Full TimeSan Francisco Bay Area15h ago
-
Senior Software Engineer II, Storage (File & Block) USD 165K-242KBlock Storage | CSI | ClickHouse | Data durability | Distributed Storage401k match | Flexible PTO | Flexible spending account | Health savings account | Medical, dental, and vision insuranceSenior-level Full TimeSunnyvale, California17h ago
-
Senior Software Engineer II, Storage (File & Block) USD 165K-242KBlock Storage | CRD | CSI | ClickHouse | Control Plane401k employer match | Catered lunch | Childcare support | Flexible PTO | Flexible spending accountSenior-level Full TimeNew York, NY17h ago
-
Staff Software Engineer, Storage USD 188K-275KC++ | CSI | Ceph | Crash Consistency | Distributed Systems401k match | Dental insurance | Flexible PTO | Health insurance | Life insuranceSenior-level Full TimeNew York, NY17h ago
-
Staff Software Engineer, Storage USD 188K-275KC++ | CRDs | CSI | Ceph | Crash Consistency401k employer match | Employee stock purchase program ESPP | Flexible PTO | Flexible spending account | Health savings accountSenior-level Full TimeSunnyvale, California17h ago
-
Staff Software Engineer, Storage USD 188K-275KBlock Storage | C++ | CSI | Caching | Ceph401k employer match | Casual work environment | Catered lunch | Employee stock purchase program ESPP | Flexible PTOSenior-level Full TimeBellevue, Washington17h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KC++ | CSI | ClickHouse | Database | Debugging401k match | Childcare support | Dental insurance | Disability insurance | Employee stock purchase programSenior-level Full TimeNewYork, NY17h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KC++ | CSI | ClickHouse | CockroachDB | Consistency401k employer match | Catered lunch | Childcare support | Company paid life insurance | Employee stock purchase programSenior-level Full TimeBellevue, Washington17h ago
-
Senior Software Engineer, Storage (File & Block) USD 153K-224KBlock Storage | C++ | CSI | ClickHouse | Distributed Systems401k match | Disability insurance | Flexible PTO | Health insurance | Life insuranceSenior-level Full TimeSunnyvale, California17h ago
-
Senior AI/ML Engineer - Agentic AI USD 148K-306KAPI Design | AWQ | Agent systems | Annotation Workflows | Application developmentSenior-level Full TimePalo Alto, CA, US, 9430421h ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R21h ago
-
Adobe Analytics | Git | GitLab | JQuery | Java401k matching | Adoption Assistance | Disability insurance | Healthcare benefits | Life insuranceMid-level Full TimeIrving, TX, United States21h ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KAccess Control | Change Data Capture | Cost Management | Data Capture | Data Governance401k eligibility | Medical benefits | Paid time off | Parental leave | Remote work not available for U S visa sponsorshipSenior-level Full TimeRemote Oregon, United States R21h ago
-
Senior Data Engineer USD 140K-180KAPI Development | AWS | Airflow | Autogen | Azure401k plan with matching company contributionsSenior-level Full TimeUSA-CORP Westmont IL-Westmont - 700 Oakmont, …21h ago
-
AI/ML Developer USD 160K-210KCI/CD | Databricks | Fine Tuning | LLM Fine-tuning | Machine Learning401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeMorrisville NC, 3015 Carrington Mill Blvd, …21h ago