Kubernetes Platform Engineer – Big Data Infrastructure
Tasks
- Automate CI CD workflows and engine upgrades
- Build automation and Infrastructure-as-Code modules
- Collaborate on platform reliability and scalability
- Debug distributed jobs
- Design Kubernetes infrastructure for distributed compute engines
- Implement multi tenant resource isolation and RBAC
- Integrate data ingestion and object storage data lakes
- Manage table compaction retention and partitioning
- Monitor engine and cluster performance
- Operate engine runtimes and control plane components
Perks/Benefits
Skills/Tech-stack
AWS EKS | CI/CD | Cloud Computing | Distributed Systems | Flink | GitOps | Helm | Kubernetes | Object storage | Observability | RBAC | Spark | Terraform | Trino
Education
N/A
Related jobs
-
Data Engineer ID50062 USD 148K-164KAWS | AWS SageMaker | AWS SageMaker Studio | Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States2h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States4h ago
-
Software Engineer, Machine Learning USD 185K-200KClassification | Computer Vision | Data Mining | Data Regression | Deep learningMid-level Full TimeMenlo Park, CA5h ago
-
Product Software Modernization Engineer, Quantum AI USD 147K-211KBazel | Cloud Spanner | Cloud Storage | Cloud platform | Distributed cloudMid-level Full TimeSeattle, WA, USA; Goleta, CA, USA6h ago
-
Software Engineer III, Infrastructure, GDC AI Storage USD 147K-211KCSI | Data Structures | Data Structures and Algorithms | Distributed Systems | GoSenior-level Full TimeKirkland, WA, USA6h ago
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R13h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA13h ago
-
Applied AI ML Engineer-Senior Associate USD 175K-210KAWS | Amazon Bedrock | Amazon EKS | Amazon SageMaker | Data ShardingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States15h ago
-
Machine Learning Engineer, Growth USD 130K-500KElasticsearch | Embeddings | Fine Tuning | Go | KafkaEquity grant | Free gym membership | Health insurance | Housing bonus | Meals stipendMid-level Full TimeSan Francisco16h ago
-
Senior Geospatial Data Engineer USD 90K-189KAgile | ArcGIS Enterprise | ArcGIS Server | CI/CD | FionaFlexible time off | Learning resourcesSenior-level Full Time437 DENVER CO, United States17h ago
-
Lead Machine Learning Engineer USD 157K-237KA/B | A/B Testing | Airflow | B testing | Data PipelinesSenior-level Full TimeUS TX Austin19h ago
-
Senior Machine Learning Engineer USD 170K-237KA/B | A/B Testing | Apache Airflow | B testing | Deep learningSenior-level Full TimeUS TX Austin19h ago
-
AWS Batch | AWS EC2 | AWS IAM | AWS Lambda | AWS S3Annual bonus | Company paid benefits | Equity | Paid time offSenior-level Full TimeLos Angeles, California19h ago
-
AI/ML Engineer USD 130K-223KAgentic AI | Deep learning | Distributed Training | Docker | EmbeddingsMid-level Full TimeScottsdale, AZ19h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ19h ago
-
Principal Machine Learning Engineer USD 245K-393KCloud infrastructure | Data Science | Distributed Systems | Infrastructure as Code | ML pipelinesSenior-level Full TimeChicago, Illinois, USA R19h ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R20h ago
-
Mid-level Full TimeLondon, New York City20h ago
-
AI Engineer USD 53K-119KAPI Design | Cost Optimization | Embeddings | Evaluation | JSONDental insurance | Gym stipend | Health insurance | Medical membership | Offsite retreatsSenior-level Full TimeRemote, US R20h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI | Batch Processing | Data Infrastructure | Data Privacy | Data ProcessingExecutive-level Full TimeMountain View, CA, United States20h ago
-
Android Development | C Sharp | C plus plus | C# | Command LineMid-level Full TimeMountain View, CA, US; Redmond, WA, … R20h ago
-
Senior AI/ML Engineer USD 99K-192KA/B | A/B Testing | Agentic Workflows | Anomaly Detection | Artificial IntelligenceAdoption and surrogacy expense reimbursement | Employee resource groups | Fertility treatments | Flexible family care days | Medical, dental & vision coverageSenior-level Full TimeUnited States21h ago
-
Senior Customer Solutions Engineer - US USD 111K-176KAPI Scripting | Access Tokens | Active Directory | Airflow | Azure Active Directory401k plan | Flexible stipends | Health and wellness stipend | Healthcare coverage | Home office setup stipendSenior-level Full TimeUS - Remote R21h ago
-
Machine Learning Engineer USD 217K-260KAWS | Cloud platform | Dash | Database Management | Docker401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeSan Francisco, CA22h ago
-
Senior Data Engineer - Snowflake USD 165K-216KAWS | Azure | Cloud platform | Data Governance | Data IntegrityFlexible work arrangements | Onsite collaboration in Manhattan New York | Professional development opportunitiesSenior-level Full TimeNew York, New York, United States22h ago