Principal Java Data Engineer
Tasks
- Automate data freshness completeness and accuracy checks
- Conduct peer reviews and provide feedback
- Define SLAs and SLOs for latency and throughput
- Define schema contracts and transformation tests for data quality
- Develop batch and real time data solutions
- Drive modernization with event driven and cloud native architectures
- Enforce backward compatible schema evolution
- Engineer and optimize data pipelines
- Implement data governance and observability best practices
- Implement metrics logging distributed tracing for streaming jobs
- Integrate alerting and dashboards for proactive monitoring
- Lead design and implementation of scalable distributed systems with Java microservices
- Mentor data engineering team members
Perks/Benefits
- Allyship and inclusion communities
- Caregiver leave
- Continuous development support program
- Employee assistance program
- Employee recognition
- Fertility and adoption support
- Flexible paid time off
- Parental leave
- Retirement plan matching
- Wellness support programs
Skills/Tech-stack
ADLS Gen2 | AWS | Alerting | Apache Hudi | Apache Spark | Apache Trino | Azure | Azure ADLS | Azure ADLS Gen2 | Azure Data | Azure Data Lake | Azure Data Lake Storage | Batch Processing | CI/CD | Containerization | DBT | Data Governance | Data Lake Storage | Data Quality | Databricks | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | GCP | Great Expectations | HDFS | Java | Kubernetes | Lakehouse | Logging | Metrics | Microservices | Observability | Performance Tuning | Schema Contracts | Schema evolution | Streaming | Trino
Education
N/A
Related jobs
-
Senior Software Engineer, Data Engineering USD 243K-295KAWS | Apache Airflow | Apache Spark | Azure | Cloud ComposerSenior-level Full TimeSan Mateo, CA, United States R6h ago
-
AWS | Automated testing | Cloud Native | Cloud-native development | Columnar DatabasesCompany stock plan | Educational reimbursement | Unlimited vacation | Wellness reimbursementSenior-level Full TimeReno, NV; San Ramon, CA; New … R10h ago
-
Senior Backend Engineer, Experimentation USD 182K-263KA/B | A/B Testing | APIs | Alerting | B testingDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R11h ago
-
AWS | Alibaba Cloud | Apache Doris | Apache Iceberg | Apache MilvusMid-level Full TimeSunnyvale R12h ago
-
Software Engineer - Backend Platform USD 140K-205KAPI Design | AWS | Cloud platform | Databases | Distributed SystemsComprehensive health coverage | Coworking stipend | Equity | Flexible savings accounts | Remote workMid-level Full TimePalo Alto, California, United States R12h ago
-
AWS | Alibaba Cloud | Apache Doris | Apache Iceberg | BackupMid-level Full TimeSunnyvale R12h ago
-
AI Engineer USD 180K-220KAPI Design | Agentic Workflows | Authorization | Avro | CI/CDCareer Development Discussions and Check ins | Caregiver support | Company sponsored professional development | Flexible vacation | Health, dental, vision insuranceMid-level Full TimeChicago, IL (Hybrid) R12h ago
-
Machine Learning Engineer USD 210K-240KA/B | A/B Testing | B testing | Data Pipelines | Data Processing401k plan | Commuter benefits | E Bike Transportation | Generous PTO | Learning and development stipendMid-level Full TimeSan Francisco, CA (Hybrid) R15h ago
-
Data Engineer USD 130K-150KApache Spark | Azure | Azure DevOps | CI/CD | Data ContractsFree dog walking services | Free on-site gym | Free parking | Hybrid remote work | Medical/Dental/Vision insuranceMid-level Full TimeSeattle, United States R15h ago
-
Staff Data Engineer, Market Data USD 207K-244KAeron | Backend Engineering | C++ | FIX | High Throughput401k | Dental insurance | Medical insurance | Vision insuranceSenior-level Full TimeRemote - USA R15h ago
-
Data Engineer USD 119K-202KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Hybrid work arrangementMid-level Full TimeAlexandria, Virginia, United States R15h ago
-
Research Software Engineer, AI/ML USD 110K-130KCI/CD | Docker | GPU Computing | Grafana | KubernetesHybrid work arrangement | On-site workEntry-level Full TimeBlacksburg, Virginia, Hybrid R15h ago
-
Data Engineer II USD 130K-150KAWS | Airflow | CI/CD | CloudWatch | Containerization401k matching | Employee equity plan | Fertility and adoption reimbursement | Flexible time off | Health insuranceMid-level Full TimeUnited States R16h ago
-
Senior Algorithms and Simulation Software Engineer USD 95K-145KC++ | CI/CD | Control Systems | Git | Hardware-in-the-loopSenior-level Full TimeDevens, MA R16h ago
-
Data Engineer USD 204K-259KAccess Control | Access Control Lists | BigQuery | C plus plus | Data GovernanceAnnual bonus | Company benefits program | Equity incentive planSenior-level Full TimeMountain View, California, USA R17h ago
-
Senior Machine Learning Engineer, Digital Twin Platform USD 240K-253KAWS | Azure | Computer Vision | Data Pipelines | GCPFlex First work policy | Remote workSenior-level Full TimeUnited States - Remote R17h ago
-
APIs | Anomaly Detection | Classification Pipeline | Evaluation | HuggingFace Transformers100 percent remote | BYOD | Eastern Time overlap | USD paymentSenior-level Full TimeRemote R17h ago
-
Staff Software Engineer (L4) Data Platform USD 171K-213KAWS | Apache Hadoop | Apache Hudi | Apache Kafka | Apache Spark401k retirement account | Health care insurance | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R18h ago
-
Collibra Engineer / Data Governance USD 140K-155KBPMN | Collibra | Data Catalog | Data Governance | Data Monitoring401k | Dental | Disability insurance | Employee assistance program | Employee discountsMid-level Full TimeWashington, D.C., DC, US R18h ago
-
Staff Machine Learning Engineer USD 176K-308KA2A | Asyncio | Embeddings | FastAPI | Java401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States R18h ago
-
Associate AI Engineer, Finance Transformation USD 145K-167KAPI Integration | Agent Frameworks | Data dashboards | LLM APIs | Language ModelsMid-level Full TimeSan Francisco - CA; New York … R19h ago
-
Forward Deployed AI Solutions Engineer USD 105K-132KAPIs | Auditability | Authentication | Cloud Computing | Command Line401k matching | Commuter benefits | Dental insurance | Disability insurance | Employee referral programMid-level Full TimeUS Remote R19h ago
-
Principal, Data Analytics USD 96K-140KAWS | Applied statistics | Azure | Data Architecture | Data Governance401(k) plan matching | Healthcare, Dental and Vision coverage | PTO | Paid Company Holidays | Parental leaveSenior-level Full TimeNY, US, CA, US, IL, US … R19h ago
-
Senior-level Full TimeRemote or VA, VA, United States R19h ago
-
Distinguished Software Engineer, Data Infrastructure USD 253K-416KCaching | Data Infrastructure | Data Processing | Databases | Distributed SystemsExecutive-level Full TimeMountain View, CA, United States R19h ago