Principal Engineer I - Principal Data Platform Engineer
Tasks
- Create and maintain platform documentation operational runbooks and architecture standards
- Define platform standards for availability performance capacity planning disaster recovery backup monitoring and security
- Establish cluster provisioning configuration management patching upgrades and decommissioning best practices
- Evaluate and guide cloud data platform migration and hybrid architecture strategies
- Lead Hadoop ecosystem administration
- Maintain data views data exports and automated data processing
- Mentor engineers and administrators
- Optimize storage compute workload management and job scheduling infrastructure
- Own enterprise Hadoop cluster architecture design and lifecycle management
- Partner with data engineering analytics security and infrastructure teams for ingestion processing governance and access patterns
- Perform root cause analysis and implement preventive measures
- Troubleshoot complex distributed system platform performance and stability issues
Perks/Benefits
- N/A
Skills/Tech-stack
Container Technologies | DevOps | Django | Docker | FastAPI | Flask | HBase | HDFS | Hadoop | Hive | Impala | Kafka | Kubernetes | MySQL | Network Automation | OSI Model | Oozie | PEP8 | PostgreSQL | Python | REST API | Shell Scripting | Spark | Splunk | TCPIP | TypeScript | YARN | Zookeeper
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | DockerCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workEntry-level Full TimeColorado, United States10h ago
-
Senior Data Engineer - Modern Data & AI Platforms USD 156K-204KAI machine learning | AWS | Cortex | DBT | Data GovernanceRemote work | Weekend and after hours release supportSenior-level Full TimeKansas City, MO, United States11h ago
-
A/B | A/B Testing | Access Control | B testing | ExperimentationSenior-level Full TimeChicago, IL, United States12h ago
-
Senior Databricks Platform Engineer USD 140K-165KAWS | Active Directory | Apache Hive | Apache Spark | Audit LoggingSenior-level Full TimeArlington, VA, United States12h ago
-
Senior Data Engineer-JT0224 USD 115K-175K.Net Core | .Net Framework | AWS CloudFormation | Apache Airflow | Azure401k match | Career growth opportunities | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R12h ago
-
Senior Machine Learning Engineer USD 140K-224KAIOps | AWS | Apache Spark | Cloud platform | Data Analysis401k match | Dental insurance | Flexible paid time off | Life insurance | Medical insuranceSenior-level Full TimeRemote, United States R12h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL14h ago
-
Senior-level Full TimeColumbia, MD, United States15h ago
-
Senior-level ContractRaleigh, United States15h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES - 032726-2 A USD 136K-140KAI/ML | Agile | Confluence | Jira | LLM401k retirement plan | Dental insurance | Disability insurance | Federal Holidays | Floating holidaysMid-level Full TimeFort George G Meade, United States15h ago
-
AI Platform Engineer USD 108K-215KAutogen | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Key VaultMid-level Full TimeBelmont, NC, United States16h ago
-
AI Platform Engineer USD 108K-215KAI Agents | Agent Frameworks | Autogen | Azure Data | Azure Data LakeMid-level Full TimeBelmont, NC, United States16h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York16h ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R16h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R18h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …18h ago
-
AI/HPC Network Performance Engineer USD 147K-226KAI Training | Alerting | Auto-remediation | C++ | Configuration ManagementOncall rotationSenior-level Full TimeMenlo Park, CA18h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …18h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA18h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA18h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA18h ago
-
Software Engineer, Product USD 208K-269KAgentic Frameworks | Anthropic | Claude Code | Cursor | DocumentationDental insurance | Health insurance | Paid time off | Retirement plan | Vision insuranceMid-level Full TimeSan Francisco, CA23h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino1d ago
-
Machine Learning Engineer USD 136K-215KBayesian Inference | Code review | Deep learning | Git | Machine LearningMid-level Full TimeSanta Barbara, CA, US1d ago