Kubernetes Platform Engineer – Big Data Infrastructure
Tasks
- Automate CI CD workflows and engine upgrades
- Build automation and Infrastructure-as-Code modules
- Collaborate on platform reliability and scalability
- Debug distributed jobs
- Design Kubernetes infrastructure for distributed compute engines
- Implement multi tenant resource isolation and RBAC
- Integrate data ingestion and object storage data lakes
- Manage table compaction retention and partitioning
- Monitor engine and cluster performance
- Operate engine runtimes and control plane components
Perks/Benefits
Skills/Tech-stack
AWS EKS | CI/CD | Cloud Computing | Distributed Systems | Flink | GitOps | Helm | Kubernetes | Object storage | Observability | RBAC | Spark | Terraform | Trino
Education
N/A
Related jobs
-
Software Engineer II - Abnormal Data Platform USD 149K-214KAerospike | Amazon DynamoDB | Apache Spark | Data Storage | DatabricksDistributed team collaboration | Remote work | Technical mentorshipMid-level Full TimeRemote - USA R7h ago
-
Robotics Application & Product Security Engineer USD 90K-300KAPI Security | Adversarial analysis | Application Security | Artifact signing | AuthenticationHybrid or remote optionSenior-level Full TimeIrvine, CA7h ago
-
Machine Learning Engineer, Growth USD 130K-500KElasticsearch | Embeddings | Fine Tuning | Go | KafkaEquity grant | Free gym membership | Health insurance | Housing bonus | Meals stipendMid-level Full TimeSan Francisco9h ago
-
Lead Machine Learning Engineer USD 157K-237KA/B | A/B Testing | Airflow | B testing | Data PipelinesSenior-level Full TimeUS TX Austin12h ago
-
Senior Machine Learning Engineer USD 170K-237KA/B | A/B Testing | Apache Airflow | B testing | Deep learningSenior-level Full TimeUS TX Austin12h ago
-
AWS Batch | AWS EC2 | AWS IAM | AWS Lambda | AWS S3Annual bonus | Company paid benefits | Equity | Paid time offSenior-level Full TimeLos Angeles, California12h ago
-
AI/ML Engineer USD 130K-223KAgentic AI | Deep learning | Distributed Training | Docker | EmbeddingsMid-level Full TimeScottsdale, AZ13h ago
-
Principal Engineer, Data & ML Platform USD 119K-180KAPIs | Automated testing | Cloud Native | Cloud platform | Continuous DeploymentSenior-level Full TimeScottsdale, AZ13h ago
-
Sr Sales Engineer, West USD 160K-196KAnalytics | Apache Spark | Artificial Intelligence | Dataiku | Kubernetes401k match | Dental insurance | Employer paid disability coverage | Flexible spending accounts | Medical insuranceSenior-level Full TimeUnited States, Remote R13h ago
-
Mid-level Full TimeLondon, New York City14h ago
-
AI Engineer USD 53K-119KAPI Design | Cost Optimization | Embeddings | Evaluation | JSONDental insurance | Gym stipend | Health insurance | Medical membership | Offsite retreatsSenior-level Full TimeRemote, US R14h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI | Batch Processing | Data Infrastructure | Data Privacy | Data ProcessingExecutive-level Full TimeMountain View, CA, United States14h ago
-
Machine Learning Engineer USD 217K-260KAWS | Cloud platform | Dash | Database Management | Docker401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeSan Francisco, CA15h ago
-
Senior Data Engineer - Snowflake USD 165K-216KAWS | Azure | Cloud platform | Data Governance | Data IntegrityFlexible work arrangements | Onsite collaboration in Manhattan New York | Professional development opportunitiesSenior-level Full TimeNew York, New York, United States15h ago
-
Data & Analytics Engineer USD 115K-150KCI/CD | CTE | Clustering | DBT | Data Lineage401k matching | Birthday time off | Cell phone reimbursement | Childcare expense reimbursement | Company-Paid HolidaysMid-level Full TimeUnited States16h ago
-
Sr. Staff Software Engineer, Data Product Platform USD 208K-429KAI coding | AI coding tools | AI-assisted analytics | Apache Airflow | Apache SupersetEquity | Flexible work modelSenior-level Full TimeSan Francisco, CA, US; Remote, US R16h ago
-
Storage Engineer USD 100K-120KAI code assistants | Ansible | Azure Blob | Azure Blob Storage | Azure Files401k matching | Bereavement | Employee assistance program | Employee discount program | Health and Dental/Vision CareMid-level Full TimeSt. Louis, MO, United States17h ago
-
Staff Analytics Engineer USD 138K-221KBigQuery | CI/CD | DBT | Data Governance | Data ModelingHybrid work modelSenior-level Full TimeBoston, MA17h ago
-
Staff Data Engineer USD 138K-221KAmazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | BigQueryHybrid work modelSenior-level Full TimeBoston, MA17h ago
-
Principal Machine Learning & Data Engineer USD 184K-271KA/B | A/B Testing | AWS | Autoscaling | B testing401k | Healthcare | Paid parental leave | Paid sick time | Paid time offSenior-level Full TimeRemote - US R18h ago
-
Staff Site Reliability Engineer, Data Platform USD 131K-210KAccess Management | Automation | Azure | Azure Kubernetes | Azure Kubernetes ServiceSenior-level Full TimeAustin, TX, United States18h ago
-
Quantitative Technologist (C++ Intern) USD 175K-250KAlgorithms | C# | C++ | Data Structures | Distributed SystemsEntry-level InternshipChicago18h ago
-
AI Safety | AWS | Azure | C++ | Cloud Computing401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeAnn Arbor, MI18h ago
-
Senior-level Full TimeHill AFB, UT19h ago
-
Data Engineer USD 125K-163KAWS | Apache Airflow | Azure | CI/CD | DBT401k match | Commuter benefits | Dental insurance | Disability insurance | Family planning benefitsSenior-level Full TimeNew York City19h ago