Kubernetes Platform Engineer – Big Data Infrastructure
Tasks
- Automate CI CD workflows and engine upgrades
- Build infrastructure automation using IaC
- Collaborate with data ML and SRE teams on platform improvements
- Configure RBAC and secure access patterns
- Debug distributed jobs across Spark Flink and Trino
- Design Kubernetes infrastructure for distributed compute engines
- Implement multi-tenant isolation
- Integrate data ingestion and object storage data lakes
- Manage table compaction retention and partitioning
- Monitor engine and cluster performance
- Operate engine runtimes and control plane components on EKS
Perks/Benefits
- Employee Community Support
- Health and wellness benefits
- Hybrid work environment
- Remote work options
- Work-life balance support
Skills/Tech-stack
AWS EKS | CI/CD | Cause analysis | Data Lakes | Debugging | Distributed Systems | Flink | GitOps | Helm | Kubernetes | Monitoring | Object storage | Observability | RBAC | Root Cause Analysis | Root cause | Spark | Table Partitioning | Terraform | Trino
Education
N/A
Related jobs
-
Mid-level Full TimeKing George, VA, United States10h ago
-
Data Engineer USD 130K-145KApache Spark | CI/CD | Cloud platform | Containerization | Data GovernancePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R10h ago
-
Senior Software Engineer, Generative AI, Ads Safety USD 174K-252KAI Agents | Algorithms | C++ | Computer Vision | Context learningSenior-level Full TimeMountain View, CA, USA14h ago
-
Senior Staff Software Engineer, AI/ML, Security USD 262K-365KAdversarial Machine Learning | Artificial Intelligence | Cloud Architecture | Cloud Computing | Data PrivacySenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA14h ago
-
Senior Software Engineer, Google.org, Data Analytics USD 174K-252KArtificial Intelligence | Data Structures | Data Structures and Algorithms | Distributed Systems | Integration TestingSenior-level Full TimeSeattle, WA, USA14h ago
-
Software Engineer III, Storage for Analytics USD 147K-211KC++ | Data analytics | Databases | Distributed Systems | ExperimentationSenior-level Full TimeKirkland, WA, USA14h ago
-
Software Engineer, ML Fleet Intelligence USD 207K-300KAnomaly Detection | Artificial Intelligence | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA14h ago
-
Forward Deployed Engineer II, Applied AI, Cloud USD 127K-183KAPIs | Agent systems | Agentic Workflows | Conversational AI | DebuggingTravel 50% timeSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …14h ago
-
Data Engineer, Geo 3P and Developer Data Operations USD 106K-151KArtificial Intelligence | BigQuery | C++ | Cloud Dataflow | Data MiningEntry-level Full TimeMountain View, CA, USA14h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KC++ | Data Structures | Data Structures and Algorithms | Distributed Systems | File systemsSenior-level Full TimeSeattle, WA, USA15h ago
-
Staff Engineer, Datacenter Server Lifecycle USD 320K-405KAWS | Asset tracking | Coreboot | Decommissioning | Firmware verificationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York …21h ago
-
Mid-level Full TimeTysons, VA, United States22h ago
-
Mid-level Full TimeRemote, United States R22h ago
-
Senior AI Infrastructure Engineer - Training Platform USD 216K-270KAWS | Admission controllers | C++ | CUDA | Custom ResourcesCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; Seattle, WA; New …22h ago
-
Software Engineer USD 100K-150KAmazon Simple Queue Service | Amazon Web Services | Bedrock | Data Pipelines | Distributed Systems401k retirement plan | Dental insurance | Health insurance | Unlimited vacation | Vision insuranceSenior-level Full TimeLos Angeles, CA, US1d ago
-
Data Engineer / Azure Fabric Engineer Consultant USD 119K-193KAI Search | Access Control | Automated Monitoring | Azure AI | Azure AI SearchSenior-level Full TimeMason, OH, US1d ago
-
Mid-level Full TimeScottsdale, AZ1d ago
-
Principal Engineer, Data & ML Platform USD 120K-180KAPIs | Automated testing | Batch Processing | Cloud platform | Data ModelingSenior-level Full TimeScottsdale, AZ1d ago
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R1d ago
-
Agent Frameworks | Deterministic systems | Distributed Systems | GraphQL | LLMDirect collaboration with executive leadership | High-ownership environment | Hybrid schedule | Relocation assistance | Remote flexibilitySenior-level Full TimeRemote; San Francisco, CA; United States R1d ago
-
Data Engineer – SRE USD 100K-131KAmazon Web Services | Azure | BigQuery | CI/CD | Cloud MLEmployee referral program benefits incentives | Telecommuting 4 days per weekMid-level Full TimeUSA FL Boca Raton Congress Ave, …1d ago
-
Technology Analyst Program - Data Engineer USD 71K-114KApache Spark | Azure Data | Azure Data Factory | CI/CD | Cloud DataflowDental insurance | Disability insurance | Employee resource groups | Employee stock purchase plan | Internal mobilityMid-level Full TimeAlpharetta, Georgia, United States1d ago
-
Summer Intern - Data Engineer USD 45K-62KApache Spark | Azure Data | Azure Data Factory | CI/CD | Cloud DataflowDental insurance | Disability insurance | Employee assistance program mental health support | Employee resource groups | Employee stock purchase planEntry-level Full Time InternshipAlpharetta, Georgia, United States1d ago
-
Apache Airflow | AtScale | BigQuery | CI/CD | Cloud DataSenior-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago
-
Airflow | BigQuery | CI/CD | Data Modeling | Data WarehousingRemoteMid-level Full TimeGEORGIA - VIRTUAL - GA01, United … R1d ago