Principal Engineer I - Principal Data Platform Engineer
Tasks
- Conduct root cause analysis and resiliency improvements
- Define availability performance and security standards
- Drive infrastructure optimization
- Establish cluster provisioning and configuration management
- Evaluate cloud hybrid data migration strategies
- Lead Hadoop administration
- Maintain platform documentation and runbooks
- Manage Hadoop ecosystem components
- Mentor engineers and administrators
- Own enterprise Hadoop cluster architecture
- Perform patching upgrades and decommissioning
- Support data ingestion processing governance and access patterns
- Troubleshoot distributed platform performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
Backup | Best practices | Bridging | Capacity Planning | Disaster Recovery | Django | Docker | Ethernet | FastAPI | Flask | HBase | HDFS | Hadoop | Hive | Impala | Kafka | Kubernetes | Linux | Monitoring | Network Topology | Network design | OSI Model | Oozie | Python | Routing | Security best practices | Shell Scripting | Spark | Switching | TCPIP | Transport Protocols | TypeScript | YARN | Zookeeper
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R24d ago
-
Applied AI Engineer (Customer Facing) USD 200K-300KAPI Integration | AWS | Authentication | Cloud Computing | Cloud platformCommuter reimbursement | Dental insurance | Health insurance | Internet reimbursement | Phone bill reimbursementEntry-level Full TimeSan Francisco Bay Area6h ago
-
Infrastructure Engineer, Applied AI USD 250K-400KAI Models | API Integration | Alerting | Authentication | DockerMid-level Full TimeSan Francisco, CA7h ago
-
Senior Database Engineer USD 140K-200KAccess Management | Amazon Neptune | Auditing | Automation | Backup and RecoverySenior-level Full TimeHerndon, VA11h ago
-
Senior AI Engineer USD 193K-240KAPIs | Access Control | Audit Logging | CI/CD | Cloud platform401k match | Dependent care FSA | Employer paid commuter benefit | Flexible time off | Health Savings Account (HSA)Senior-level Full TimeDallas, Texas, United States12h ago
-
Senior Robotics Software Engineer USD 220K-292KAgent systems | Autonomy | Behavior Trees | C++ | Computer VisionSenior-level Full TimeCosta Mesa, California, United States1d ago
-
Analytics engineering | Anomaly Detection | Change Data Capture | Data Capture | Data GovernanceSenior-level Full TimeEast Rutherford, NJ1d ago
-
Computer Vision & Machine Learning, Staff USD 110K-206KC plus plus | Camera integration | Classification | Computer Vision | Embedded SystemsEngineering-first culture | Mentorship opportunitiesSenior-level Full TimeAustin, TX1d ago
-
Embedded Firmware Engineer - PC Audio USD 108K-160KC# | Continuous integration | DSP firmware | DSP firmware development | Firmware DevelopmentMid-level Full TimeChandler, Arizona1d ago
-
Sr. Energy Storage Engineer USD 100K-140KANSI | Arc Flash | Arc flash analysis | AutoCAD | BESS401k match | Company-paid medical, dental & vision | Device purchase support | FSA contributions | Flexible work arrangementsSenior-level Full TimeSan Diego,CA, Denver, CO or San …1d ago
-
Data Engineer - Research and Development USD 90K-120KAWS | Apache Airflow | Apache Spark | CI/CD | DBTMid-level Full TimePittsburgh, Pennsylvania, United States1d ago
-
Senior Machine Learning Engineer (Remote) USD 176K-251KAPI Development | Amazon Web Services | Cloud Computing | DSP | DevOpsMinimal mentorship | Remote workSenior-level Full TimeNew York Office R1d ago
-
Staff Software Engineer, Product USD 220K-250KArchitecture | Distributed Systems | High Performance | High-Performance Computing | KafkaIn office 4 days per week | Optional work from homeSenior-level Full TimeSF Bay Area1d ago
-
Machine Learning Data Engineer USD 120K-190KAmazon SageMaker | Anomaly Detection | Apache Beam | Apache Spark | Cloud platformMid-level Full TimeNew York City1d ago
-
Senior-level Full TimeCampbell, CA1d ago
-
Senior AI Software Engineer USD 163K-246KAWS | Claude | Codex | Experimentation | FlaskEmployee benefits program | Hybrid work | Remote work option | Well-being programsSenior-level Full TimeSan Francisco Office1d ago
-
Forward Deployed Engineer (FDE) - SF USD 162K-280KBack-end | Back-end development | Front-end | Front-end Development | Full StackHybrid work | Relocation assistance | Travel opportunitiesMid-level Full TimeSan Francisco1d ago
-
Senior Machine Learning Engineer II USD 124K-171KAPIs | Agile | Data Pipelines | Deep learning | KubernetesDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeAustin, TX1d ago
-
3D Geometry | 3d kinematics | C++ | Extrinsics | Inertial Measurement UnitFlexible hours | Hybrid or remote option | Onsite workSenior-level Full TimeIrvine, CA1d ago
-
Forward Deployed Engineer USD 70K-300KC++ | Cloud infrastructure | Containerization | Debugging | DockerHybrid work option | On-site collaboration | Remote option | Travel requiredMid-level Full TimeIrvine, CA1d ago
-
Forward Deployed Senior AI Engineer USD 131K-271KAPI | AWS | Azure | CI/CD | Cloud platformHealth and wellbeing benefits | Hybrid work environment | Professional developmentSenior-level Full TimeNew York, NY, US, 100011d ago
-
Forward Deployed AI Engineer (Associate) USD 55K-127KAI Core | Agent Frameworks | Agent Orchestration | Algorithms | CI/CDFlexible working models | Health and wellbeing benefits | Hybrid work | Learning opportunitiesEntry-level Full TimeNew York, NY, US, 100011d ago
-
Forward Deployed AI Engineer USD 90K-198KAI Core | AWS | Agent Orchestration | Agentic AI | AutogenSenior-level Full TimeNew York, NY, US, 100011d ago
-
Forward Deployed Data Engineer USD 90K-198KAPI Development | AWS | Apache Airflow | Apache Spark | AzureCompetitive benefits | Continuous learning | Flexible working models | Health and wellbeing support | Hybrid work modelSenior-level Full TimeNew York, NY, US, 100011d ago
-
Forward Deployed Application/ ML Engineering Expert USD 198K-420KAgentic AI | Architecture | Cloud Native | Data Pipelines | Language ModelsSenior-level Full TimeNew York, NY, US, 100011d ago