Principal Data Engineer
Tasks
- Build containerized applications with Kubernetes
- Build event driven streaming solutions
- Build reusable data frameworks and processing components
- Design batch and streaming data pipelines
- Design cloud-native infrastructure and automation
- Design relational and analytical data models
- Develop microservices and REST APIs
- Ensure data quality, validation, and reconciliation
- Implement CI/CD pipelines and deployment automation
- Implement observability monitoring logging and alerting
- Lead design and development of real time data platforms
- Modernize data platforms and conduct technical design reviews
- Provide technical leadership and mentor engineering teams
- Troubleshoot production issues and perform root cause analysis
- Tune database performance and optimize queries
Perks/Benefits
- 401k match
- Medical, dental & vision coverage
- Paid Holidays
- Paid time off
- Parental leave
- Professional development reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS MSK | Amazon Aurora | Amazon CloudWatch | Amazon ECS | Amazon EKS | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Flink | Apache Kafka | CI/CD | Checkpointing | CloudFormation | Data Modeling | Database performance | Database performance tuning | Docker | ELK Stack | Event time | Event-time processing | Fault Tolerance | GitHub Actions | GitLab CI | GitLab CI/CD | Gradle | Grafana | Indexing | Java | Jenkins | Kafka Connect | Kafka Streams | Kubernetes | Logging | Maven | Microservices Architecture | Monitoring | Node.js | Observability | Oracle | Performance Tuning | PostgreSQL | Prometheus | Python | Query Optimization | REST API | SonarQube | Spring Boot | Stateful processing | Terraform | Time processing | Windowing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Staff Machine Learning Engineer 2, Ads USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud Platforms401k plan company match | Disability insurance | Electric Car Charging Station | Employee assistance program | Flexible spending accountSenior-level Full TimeMountain View, USA6h ago
-
Staff Machine Learning Engineer 2, Ads USD 164K-282KAWS | Airflow | Amazon SageMaker | Apache Spark | BigQuery401k plan with company match | Dental insurance | Disability insurance | Electric car charging | Employee assistance programSenior-level Full TimeMountain View, USA6h ago
-
Staff Software Engineer, Embedded Finance USD 151K-309KDistributed Systems | Enterprise Messaging | GraphQL | Java | KotlinFlexible benefits | Hybrid work modelSenior-level Full TimeRemote, USA R8h ago
-
Lead Software Engineer - Data Platform USD 150K-175KAPIs | AWS | CI/CD | Data Governance | Data Modeling401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeUnited States R9h ago
-
Revenue AI Solutions Analyst USD 140K-216KAI integration | CRM | Data platforms | ERP | LLM Agents401k | Employee assistance program | Medical, dental, and vision insurance | Paid sick leave | Paid vacationSenior-level Full TimeMilpitas, CA, United States9h ago
-
Data Engineer USD 144K-223KAgile | Change Data Capture | Data Capture | Data Modeling | Data NormalizationMid-level Full TimeChicago, IL9h ago
-
Data Analytics - Associate USD 110K-150KA/B | A/B Testing | B testing | DBT | Data ModelingEmployer-Matched Retirement Plan | Paid dental vision telemedicine | Parental leave | Remote work Friday flexibility | Subsidized healthcareSenior-level Full TimeNew York, New York, United States R10h ago
-
Senior Software Engineer, AI Solutions USD 120K-142KAI Agents | API Integration | AWS Bedrock | Airflow | Amazon SageMakerDental insurance | Dependent Care Account | Employer match | Flexible spending account | Health insuranceSenior-level Full TimeNew York, NY, United States12h ago
-
Senior Data Engineer USD 120K-142KAPIs | Apache Airflow | DBT | Data Governance | Data Modeling401b retirement savings program | Employer match | Flexible spending accounts | Health, dental, vision insurance | Mental health counseling supportSenior-level Full TimeNew York, NY, United States12h ago
-
AWS | Agile | Airflow | Alteryx | AzureSenior-level Contract Full TimeChicago, Illinois, United States13h ago
-
Senior AI Engineer USD 120K-180KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance checks401k match | Career growth | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R13h ago
-
Data Visualization Engineer USD 130K-140KAWS | Agile | Amazon QuickSight | Azure | DAXPublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior Cloud Database Engineer USD 144K-180KAWS | AWS Step Functions | Amazon Aurora | CI/CD | Database AdministrationFinancial coaching | Flexible time off | Free therapy sessions | Legal advice | Parental leaveSenior-level Full TimeRemote, USA R14h ago
-
Senior Machine Learning Engineer USD 135K-170KData Visualization | Deep learning | Experimental Design | Generative AI | Language Processing401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeUnited States R14h ago
-
Staff Data Engineer, Analytics USD 248K-279KAlerting | Anomaly Detection | BI reporting | BigQuery | CI/CDSenior-level Full TimeSan Francisco Bay Area15h ago
-
Artificial Intelligence Engineer - Associate USD 100K-140KAWS | Artificial Intelligence | CI/CD | Data Analysis | Dataset versioningEmployer-Matched Retirement Plan | Parental leave | Remote work flexibility | Subsidized healthcare | TelemedicineMid-level Full TimeGreenwich, Connecticut, United States; New York, … R15h ago
-
Robotic Software Engineer (Drone Stack) USD 135K-175KAgile | Agile Development | ArduPilot | Autopilot | BashOccasional remote work | On-site flexibility | Paid time off | Travel for integration and demonstrationsMid-level Full TimeWashington, District of Columbia, United States16h ago
-
Customer Analytics | Customer decisioning | Data Engineering | Data Modeling | Data Standardization401k | Accident insurance | Dental insurance | Disability insurance | Health insuranceSenior-level ContractVienna, United States16h ago
-
Senior Machine Learning Engineer USD 146K-180KAWS | AWS Lambda | Agile | Amazon Athena | Amazon BedrockMentorship | Onboarding support | Remote workSenior-level Full TimeUnited States17h ago
-
Apache Iceberg | Apache OpenLineage | Apache Spark | Columnar file formats | DuckDBSenior-level Full TimeNew York, New York, USA17h ago
-
Senior Insurance Data Science Consultant USD 180K-204KActuarial modeling | Data Validation | Decisioning Platforms | Insurance analytics | Machine LearningSenior-level Full TimeBoston, MA, US17h ago
-
AI Architect USD 130K-230KAgentic AI | Amazon Web Services | Azure | Bagging | CI/CDMentorship opportunities | Remote work environmentSenior-level Full TimeUnited States17h ago
-
Data Engineer USD 159K-200KAWS DMS | AWS Glue | Amazon ECR | Amazon ECS | Amazon RedshiftFlexible remote weeks around holidays | Generous perks | In-office collaborationSenior-level Full TimePhiladelphia, Pennsylvania, United States18h ago
-
Agios AI Foundation Software Engineer USD 165K-261KAgent Frameworks | Audio Processing | Autogen | Bias Mitigation | Computer VisionSenior-level Full TimeRedmond, WA19h ago
-
Senior Software Engineer, ML Infrastructure, Core Infra USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA19h ago