Principal Data Engineer
Tasks
- Build containerized applications with Kubernetes
- Build event driven streaming solutions
- Build reusable data frameworks and processing components
- Design batch and streaming data pipelines
- Design cloud-native infrastructure and automation
- Design relational and analytical data models
- Develop microservices and REST APIs
- Ensure data quality, validation, and reconciliation
- Implement CI/CD pipelines and deployment automation
- Implement observability monitoring logging and alerting
- Lead design and development of real time data platforms
- Modernize data platforms and conduct technical design reviews
- Provide technical leadership and mentor engineering teams
- Troubleshoot production issues and perform root cause analysis
- Tune database performance and optimize queries
Perks/Benefits
- 401k match
- Medical, dental & vision coverage
- Paid Holidays
- Paid time off
- Parental leave
- Professional development reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS MSK | Amazon Aurora | Amazon CloudWatch | Amazon ECS | Amazon EKS | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Flink | Apache Kafka | CI/CD | Checkpointing | CloudFormation | Data Modeling | Database performance | Database performance tuning | Docker | ELK Stack | Event time | Event-time processing | Fault Tolerance | GitHub Actions | GitLab CI | GitLab CI/CD | Gradle | Grafana | Indexing | Java | Jenkins | Kafka Connect | Kafka Streams | Kubernetes | Logging | Maven | Microservices Architecture | Monitoring | Node.js | Observability | Oracle | Performance Tuning | PostgreSQL | Prometheus | Python | Query Optimization | REST API | SonarQube | Spring Boot | Stateful processing | Terraform | Time processing | Windowing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R3h ago
-
Senior AI Operations Engineer USD 170K-180KAI infrastructure | Azure | CI/CD | Cloud infrastructure | Container Engine for Kubernetes401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountSenior-level Full TimeWork From Home, United States R3h ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States5h ago
-
Adversarial Machine Learning | Anomaly Detection | Cloud Security | Machine Learning | PythonSecurity clearance premiumsMid-level Full TimeNaples, United States5h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States6h ago
-
Mid-level Full TimeUS-Kansas-Wichita6h ago
-
Senior-level Full TimeCincinnati, OH, United States7h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …7h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States7h ago
-
Software Engineer Level 1 -FFNN-8889 USD 78K-250KAccumulo | BSON | Bigtable | Distributed Systems | HBase401k match | Employee referral programs | FSA | Flexible work arrangements | Mental health supportMid-level Full TimeHanover, MD7h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA8h ago
-
Staff Software Engineer, Agentic AI, Trust and Safety USD 207K-301KAgentic AI | Anti-abuse | Anti-abuse systems | Architecture ownership | Artificial IntelligenceSenior-level Full TimeKirkland, WA, USA8h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KBigtable | C++ | Cloud Databases | Cloud SQL | Cloud platformTravel up to 30%Mid-level Full TimeReston, VA, USA8h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-253KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA8h ago
-
Customer Engineer II, Applied AI, Google Cloud USD 148K-216KC++ | Cloud Architecture | Conversational AI | Document AI | Generative AITravel opportunitiesSenior-level Full TimeSunnyvale, CA, USA; Chicago, IL, USA8h ago
-
Software Engineer III, AI/ML GenAI, Google Ads USD 147K-211KC plus plus | Data Processing | Debugging | Generative AI | Language ProcessingSenior-level Full TimeMountain View, CA, USA8h ago
-
Research Engineer, Benchmarking, Robotics, DeepMind USD 147K-211KBenchmarking | Data Pipelines | Deep learning | Docker | Embedded deploymentMid-level Full TimeMountain View, CA, USA8h ago
-
Software Engineer USD 149K-211KAlgorithms | Angular | C# | C++ | Cause analysisBonus | Equity | Health insurance | Paid time off | Professional developmentMid-level Full TimeMountain View, CA, USA8h ago
-
Data Engineer USD 123K-151KC++ | Cloud platform | Data Migration | Data Modeling | Data PartitioningBenefits | Hybrid scheduleMid-level Full TimeAustin, TX, USA R8h ago
-
AI accelerators | C++ | CPU | Diffusion Models | Edge ComputingSenior-level Full TimeMountain View, CA, USA8h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States15h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KContinuous Improvement | Deep learning | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeNew York, New York15h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Deep learning | Distributed Systems | Experimentation | Feature EngineeringCommuter benefits | Dental insurance | Disability benefits | Equity awards | Health insuranceSenior-level Full TimeBoston, Massachusetts15h ago
-
Software Engineer, Embedded Agentic AI USD 195K-345KAgent Orchestration | Agent systems | C# | C++ | ContainerizationFinancial wellness support | Hybrid work schedule | Mental health support | Paid time off | Remote work optionsEntry-level Full TimeAustin, Texas15h ago