Kubernetes Platform Engineer – Big Data Infrastructure
Tasks
- Automate CI CD workflows and engine upgrades
- Build automation and Infrastructure-as-Code modules
- Collaborate on platform reliability and scalability
- Debug distributed jobs
- Design Kubernetes infrastructure for distributed compute engines
- Implement multi tenant resource isolation and RBAC
- Integrate data ingestion and object storage data lakes
- Manage table compaction retention and partitioning
- Monitor engine and cluster performance
- Operate engine runtimes and control plane components
Perks/Benefits
Skills/Tech-stack
AWS EKS | CI/CD | Cloud Computing | Distributed Systems | Flink | GitOps | Helm | Kubernetes | Object storage | Observability | RBAC | Spark | Terraform | Trino
Education
N/A
Related jobs
-
Senior Software Engineer, AI/ML, Google Public Sector USD 174K-252KAlgorithms | C++ | Cloud Object Storage | Data Structures | Distributed ComputingSenior-level Full TimeReston, VA, USA3h ago
-
Staff Software Engineer, Intelligent Database Management USD 207K-300KAI | API Design | AlloyDB | Audit Logging | BigtableSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA3h ago
-
Forward Deployed Engineer I, GenAI, Google Cloud USD 102K-145KAPI Development | Agent Framework | Agent systems | Cloud Computing | CrewAISenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …3h ago
-
Senior Staff Data Engineer USD 123K-185KAPI | Automated testing | Cloud platform | Data Analysis | Data GovernanceDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US6h ago
-
Data Engineer USD 105K-115KBig Data | Cloud Computing | Data Modeling | Data Pipelines | Data StorageActive secret clearanceMid-level Full TimeSan Diego, CA, US11h ago
-
Principal Data Engineer USD 200K-240KAWS | Agentic Workflows | Anomaly Detection | Batch pipelines | CCPA401k plan | Commuter benefits | Flexible vacation | Life insurance | Long-term disabilitySenior-level Full TimeBoulder, Colorado or New York City, … R11h ago
-
Associate AI - Data Scientist / ML Engineer (Azure) USD 46K-110KAzure Container | Azure Container Instances | Azure Data | Azure Data Factory | Azure Data LakeDental insurance | Disability insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeNashville, TN, US13h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | C plus plus | CI/CD | Cloud infrastructure | Cluster managementSenior-level Full TimeNew York City, New York; San …14h ago
-
Staff Software Engineer - AI Research Infrastructure USD 190K-270KBackend Services | CI testing | Cluster scheduling | Data Pipelines | Distributed SystemsSenior-level Full TimeNew York City, New York14h ago
-
Principal, AI Platform Engineer USD 125K-187KAWS | Azure | CI/CD | Data leakage | Deterministic executionSenior-level Full TimeAtlanta, Georgia, US United States, 3034015h ago
-
Generative AI Consultant USD 105K-105KAWS | Azure | CI/CD | Deep learning | Docker401k matching | Health insurance | Paid time off | Parental leave | Professional developmentMid-level Full TimeSan Francisco, CA, United States16h ago
-
Internal Systems Engineer (Applied AI) USD 140K-160KAgentic Workflows | CI/CD | DAG | Freshdesk | Gitbook401k | Catered lunch | Flexible PTO | Flexible spending accounts | Great coffeeEntry-level Full TimeColumbus17h ago
-
Senior Data Engineer USD 150K-165KAPIs | AWS | Automation | CI/CD | Data Pipelines401k matching | Birthday day off | Fitness stipend | Floating holidays | Health benefitsSenior-level Full TimeUnited States R18h ago
-
Sr Software Engineer II, Storage USD 148K-237KArchitecture | Design by Contract | Distributed Systems | Error Handling | Incident ResponseDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeWashington, United States R19h ago
-
Embedded Device Firmware Engineer USD 90K-128KAutomated testing | C# | C++ | CI/CD | Computer ArchitectureMid-level Full TimeSanta Clara, CA19h ago
-
Senior Data Engineer, Data Foundations & AI Platform USD 153K-207KAPIs | Alerting | Apache Spark | CI/CD | Data Lineage401k with company match | Disability insurance | Flexible time off | Health, dental, and vision insurance | Leave of absenceSenior-level Full TimeUnited States (Remote) R19h ago
-
Staff Software Engineer, Data Engineering USD 130K-285KAirflow | Apache Flink | Data Modeling | Data pipeline | Distributed Computing401k matching | Basic life insurance | Commuter benefits | Dental insurance | Disability insuranceSenior-level Full TimeSan Francisco, CA; Sunnyvale, CA; Seattle, …19h ago
-
Robotics Software Engineer - Manufacturing Automation USD 140K-153KAI | Bazel | C++ | GRPC | KubernetesBonus | Equity | Health insurance | Paid time off | Performance bonusSenior-level Full TimeMountain View, California20h ago
-
AI Engineering Lead USD 220KAgent systems | Amazon Web Services | Azure | CI/CD | Cloud platform5 days a week | Collaborative work culture | Flexible working hours | Supportive work environment | Work with top talentSenior-level Full TimeNew York, New York, United States21h ago
-
Staff Data Engineer- Ads reporting USD 178K-267KApache Airflow | Apache Flink | Apache Kafka | Apache Spark | BackpressureCommute subsidy | Disability insurance | Employee resource groups | Employee stock ownership | Generous vacationSenior-level Full TimeSan Francisco, CA, USA21h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeChicago, IL R21h ago
-
Senior Data Engineer USD 95K-135KAWS | Airflow | C++ | Cassandra | Cloud platform401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDenver, CO R21h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | Azure | C++401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeHouston, TX R21h ago
-
Senior AI Data Engineer - Cloud and Marketing Analytics USD 130K-140KData Modeling | Data Pipelines | DataOps | DevOps | Machine LearningSenior-level Full TimeRedmond, WA21h ago
-
Senior Data Engineer USD 137K-170KAWS | Airflow | Apache Spark | C plus plus | Cassandra401k matching | Community service days | Dental insurance | Disability benefits | Fertility and adoption benefitsSenior-level Full TimeDallas, TX R21h ago