Principal Data Engineer
Tasks
- Build containerized applications with Kubernetes
- Build event driven streaming solutions
- Build reusable data frameworks and processing components
- Design batch and streaming data pipelines
- Design cloud-native infrastructure and automation
- Design relational and analytical data models
- Develop microservices and REST APIs
- Ensure data quality, validation, and reconciliation
- Implement CI/CD pipelines and deployment automation
- Implement observability monitoring logging and alerting
- Lead design and development of real time data platforms
- Modernize data platforms and conduct technical design reviews
- Provide technical leadership and mentor engineering teams
- Troubleshoot production issues and perform root cause analysis
- Tune database performance and optimize queries
Perks/Benefits
- 401k match
- Medical, dental & vision coverage
- Paid Holidays
- Paid time off
- Parental leave
- Professional development reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS MSK | Amazon Aurora | Amazon CloudWatch | Amazon ECS | Amazon EKS | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Flink | Apache Kafka | CI/CD | Checkpointing | CloudFormation | Data Modeling | Database performance | Database performance tuning | Docker | ELK Stack | Event time | Event-time processing | Fault Tolerance | GitHub Actions | GitLab CI | GitLab CI/CD | Gradle | Grafana | Indexing | Java | Jenkins | Kafka Connect | Kafka Streams | Kubernetes | Logging | Maven | Microservices Architecture | Monitoring | Node.js | Observability | Oracle | Performance Tuning | PostgreSQL | Prometheus | Python | Query Optimization | REST API | SonarQube | Spring Boot | Stateful processing | Terraform | Time processing | Windowing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Revenue AI Solutions Analyst USD 140K-216KAI integration | CRM | Data platforms | ERP | LLM Agents401k | Employee assistance program | Medical, dental, and vision insurance | Paid sick leave | Paid vacationSenior-level Full TimeMilpitas, CA, United States8h ago
-
Senior Software Engineer, AI Solutions USD 120K-142KAI Agents | API Integration | AWS Bedrock | Airflow | Amazon SageMakerDental insurance | Dependent Care Account | Employer match | Flexible spending account | Health insuranceSenior-level Full TimeNew York, NY, United States11h ago
-
Senior Data Engineer USD 120K-142KAPIs | Apache Airflow | DBT | Data Governance | Data Modeling401b retirement savings program | Employer match | Flexible spending accounts | Health, dental, vision insurance | Mental health counseling supportSenior-level Full TimeNew York, NY, United States11h ago
-
Senior AI Engineer USD 120K-180KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance checks401k match | Career growth | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R12h ago
-
Data Visualization Engineer USD 130K-140KAWS | Agile | Amazon QuickSight | Azure | DAXPublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States R13h ago
-
Customer Analytics | Customer decisioning | Data Engineering | Data Modeling | Data Standardization401k | Accident insurance | Dental insurance | Disability insurance | Health insuranceSenior-level ContractVienna, United States15h ago
-
Senior Insurance Data Science Consultant USD 180K-204KActuarial modeling | Data Validation | Decisioning Platforms | Insurance analytics | Machine LearningSenior-level Full TimeBoston, MA, US16h ago
-
AI Architect USD 130K-230KAgentic AI | Amazon Web Services | Azure | Bagging | CI/CDMentorship opportunities | Remote work environmentSenior-level Full TimeUnited States16h ago
-
Agios AI Foundation Software Engineer USD 165K-261KAgent Frameworks | Audio Processing | Autogen | Bias Mitigation | Computer VisionSenior-level Full TimeRedmond, WA18h ago
-
Senior Software Engineer, ML Infrastructure, Core Infra USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA18h ago
-
Senior Software Engineer, AI/ML, Youtube Ads USD 174K-252KData Processing | Data Storage | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA19h ago
-
C++ | CSS | Database Development | HTML | HTTPMid-level Full TimeAnn Arbor, MI, USA19h ago
-
Automated Monitoring | C++ | Cloud platform | Dashboards | Data ModelingEntry-level Full TimeSunnyvale, CA, USA19h ago
-
Data Engineer, AI Solutions, Global Affairs USD 130K-187KData Modeling | Data Pipelines | ETL | LLM APIs | PythonMid-level Full TimeNew York, NY, USA; Chicago, IL, …19h ago
-
ATA | C# | C++ | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA19h ago
-
Agentic Workflows | Computational Biology | Data Visualization | Human-in-the-loop | Machine LearningCross-functional collaboration | Hybrid work modelSenior-level Full TimeNew York, NY, US R22h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Evaluation | Experiment design401k matching | Health coverage | Paid time off | Parental leaveMid-level Full TimeSunnyvale, CA, United States1d ago
-
Senior Staff Machine Learning Engineer, Infrastructure USD 248K-310KA/B | A/B Testing | Agentic AI | Apache Airflow | Apache KafkaDisability accommodation support | Employee travel credits | Inclusion focused hiring | Remote eligibleSenior-level Full TimeUnited States1d ago
-
Software Engineer, Robotics & Autonomous Systems USD 180K-225K3D data | 3D data processing | AWS | Airflow | C++Commuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA1d ago
-
Senior Software Engineer (AI/ML) USD 150K-222KAPI Gateway | API Management | Cloud Native | Containers | Data Warehousing401k match | Dental insurance | Federal Holidays | Flexible PTO | Flexible spending accountSenior-level Full TimePatrick SFB, FL1d ago
-
Anomaly Detection | Automated testing | Benchmarking | Computer Vision | Data Preparation401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R1d ago
-
Senior Data Analyst USD 150K-175KAWS S3 | Amazon Athena | Amazon Aurora | Anomaly Detection | CTEDental insurance | Flexible PTO | Health insurance | Professional development budget | Vision insuranceSenior-level Full TimeUnited States1d ago
-
Senior Data Engineer USD 150K-175KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3Continuing education support | Dental insurance | Flexible PTO | Health insurance | Professional development budgetSenior-level Full TimeUnited States1d ago
-
Full Stack AI Engineer USD 220K-270KAI Agents | Cloud Storage | Cloud platform | Django | Google CloudSenior-level Full TimeMountain View1d ago
-
Forward Deployment AI Engineer USD 120K-150KAgent systems | Autogen | Chroma | Cloud services | Embedding pipelinesClient site travel | Commuting within reasonable distanceMid-level Full TimeCleveland | Tampa | San Diego …1d ago