Principal Data Engineer
Tasks
- Build containerized applications with Kubernetes
- Build event driven streaming solutions
- Build reusable data frameworks and processing components
- Design batch and streaming data pipelines
- Design cloud-native infrastructure and automation
- Design relational and analytical data models
- Develop microservices and REST APIs
- Ensure data quality, validation, and reconciliation
- Implement CI/CD pipelines and deployment automation
- Implement observability monitoring logging and alerting
- Lead design and development of real time data platforms
- Modernize data platforms and conduct technical design reviews
- Provide technical leadership and mentor engineering teams
- Troubleshoot production issues and perform root cause analysis
- Tune database performance and optimize queries
Perks/Benefits
- 401k match
- Medical, dental & vision coverage
- Paid Holidays
- Paid time off
- Parental leave
- Professional development reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS MSK | Amazon Aurora | Amazon CloudWatch | Amazon ECS | Amazon EKS | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Flink | Apache Kafka | CI/CD | Checkpointing | CloudFormation | Data Modeling | Database performance | Database performance tuning | Docker | ELK Stack | Event time | Event-time processing | Fault Tolerance | GitHub Actions | GitLab CI | GitLab CI/CD | Gradle | Grafana | Indexing | Java | Jenkins | Kafka Connect | Kafka Streams | Kubernetes | Logging | Maven | Microservices Architecture | Monitoring | Node.js | Observability | Oracle | Performance Tuning | PostgreSQL | Prometheus | Python | Query Optimization | REST API | SonarQube | Spring Boot | Stateful processing | Terraform | Time processing | Windowing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R1h ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States4h ago
-
Adversarial Machine Learning | Anomaly Detection | Cloud Security | Machine Learning | PythonSecurity clearance premiumsMid-level Full TimeNaples, United States4h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States5h ago
-
Mid-level Full TimeUS-Kansas-Wichita5h ago
-
Senior-level Full TimeCincinnati, OH, United States5h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …6h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States6h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA7h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States13h ago
-
Lead Analytics Engineer USD 123K-175KCI/CD | DBT | Data Governance | Data Modeling | NetsuiteFull-time telecommuting | Remote work optionSenior-level Full TimePalo Alto, California14h ago
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R16h ago
-
BEV | Bayesian Methods | CUDA | Machine Learning | Metrics OptimizationSenior-level Full TimeFoster City, CA17h ago
-
Continual Learning | Data Processing | Deep learning | JAX | Language ModelsBonus program | Company benefits program | Equity incentive planEntry-level Full TimeMountain View, CA USA; San Francisco, …18h ago
-
Staff Machine Learning Engineer, Multi-Modal Perception USD 251K-310KC plus plus | Computer Vision | Data Analysis | Deep learning | JAXSenior-level Full TimeMountain View, CA USA; San Francisco, …18h ago
-
Sr. Software Development Engineer, MLOPs USD 168K-227KAlerting | Amazon EKS | CI/CD | Checkpointing | Data IngestionSenior-level Full TimeBellevue, Washington, USA18h ago
-
Software Development Engineer, Aurora Storage USD 143K-194KAWS | Amazon Aurora | Distributed Systems | High Availability | MySQLCareer growth | Flexible work schedule | Mentorship | Work-life balanceMid-level Full TimeRedmond, Washington, USA18h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R18h ago
-
Senior-level Full TimeInnovation Point, United States18h ago
-
Hugging Face | LLM orchestration | Langchain | Language Models | Large Language ModelsCareer growth potential | Early stage technical hire | Equity compensation | High ownership role | Hybrid workMid-level Full TimeSan Francisco, CA; Hybrid R18h ago
-
CI/CD | Data Analysis | Database | Git | PythonCareer development | Comprehensive benefits | Educational initiatives | Family benefitsMid-level Full TimeCharlotte, United States18h ago
-
Mid-level Full TimePENNANT PARK, ATLANTA - 9141, United …18h ago
-
Manager Data Engineering USD 102K-177KAWS | Airflow | Automated testing | Azure | Azure DataInclusive work environment | Remote work possibility | Travel up to 20 percentMid-level Full TimeUS014 MA Raynham - 325 Paramount …18h ago
-
Senior Data Engineer, Cat Digital USD 112K-183KAWS | BigQuery | Cloud Data | Cloud Data Pipelines | Cloud platform401k savings plan | Adoption benefits | Career development | Employee assistance program | Employee discountsSenior-level Full TimeChicago, Illinois, United States18h ago