Principal Java Data Engineer
Tasks
- Automate data freshness completeness and accuracy checks
- Conduct peer reviews and provide feedback
- Define SLAs and SLOs for latency and throughput
- Define schema contracts and transformation tests for data quality
- Develop batch and real time data solutions
- Drive modernization with event driven and cloud native architectures
- Enforce backward compatible schema evolution
- Engineer and optimize data pipelines
- Implement data governance and observability best practices
- Implement metrics logging distributed tracing for streaming jobs
- Integrate alerting and dashboards for proactive monitoring
- Lead design and implementation of scalable distributed systems with Java microservices
- Mentor data engineering team members
Perks/Benefits
- Allyship and inclusion communities
- Caregiver leave
- Continuous development support program
- Employee assistance program
- Employee recognition
- Fertility and adoption support
- Flexible paid time off
- Parental leave
- Retirement plan matching
- Wellness support programs
Skills/Tech-stack
ADLS Gen2 | AWS | Alerting | Apache Hudi | Apache Spark | Apache Trino | Azure | Azure ADLS | Azure ADLS Gen2 | Azure Data | Azure Data Lake | Azure Data Lake Storage | Batch Processing | CI/CD | Containerization | DBT | Data Governance | Data Lake Storage | Data Quality | Databricks | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | GCP | Great Expectations | HDFS | Java | Kubernetes | Lakehouse | Logging | Metrics | Microservices | Observability | Performance Tuning | Schema Contracts | Schema evolution | Streaming | Trino
Education
N/A
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R2h ago
-
AWS | Agile | Apache Hive | Apache Spark | Cloudera Data PlatformRemote workSenior-level ContractLincoln, United States R2h ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R17h ago
-
Staff Software Engineer (Tech Lead) USD 180K-230KBigQuery | Cloud Run | Cloud platform | Distributed Systems | Docker401k company match | Flexible PTO | GitHub | Health savings account | Hybrid workSenior-level Full TimeUnited States - Remote R17h ago
-
Senior Analytics Engineer USD 157K-185KAirflow | Anonymization | BigQuery | Compliance | DBT401k match | Cellphone stipend | Commuter benefits | Company-Paid Holidays | Family planning benefitsSenior-level Full TimeRemote U.S. R18h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R18h ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agent systems | Agentic AI | Agile | AlgorithmsHybrid work environment | Remote work flexibilitySenior-level Full TimeArlington, VA R18h ago
-
C++ | Data Movement | Data movement optimization | Distributed Systems | HPC job schedulingHigh-impact research projects | Hybrid work environmentMid-level Full TimeUS Broomfield, CO R19h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid environment | Remote work option | Security clearance supportSenior-level Full TimeDayton, OH R20h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid remote work | Security clearance supportSenior-level Full TimeArlington, VA R20h ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work options | Security clearance supportSenior-level Full TimeWoburn, MA R20h ago
-
Principal, AI Research Engineering USD 171K-245KAPI Design | Artificial Intelligence | Data Governance | GPU Computing | LLM InferenceEducation reimbursement | Hybrid work | Parental leave options | Retirement options | Time off plansSenior-level Full TimeRemote - USA; San Jose, California, … R21h ago
-
Senior Software Engineer, Data Engineering USD 243K-295KAWS | Airflow | Azure | Batch Processing | CI/CDSenior-level Full TimeSan Mateo, CA, United States R21h ago
-
Data Engineer I IS - Remote USD 122K-208KAPI Integration | Alerting | Audit runbooks | Automation | BashDisability insurance | Health and wellness resources | Health care benefits | Life insurance | MentorshipEntry-level Full TimeRenton, WA, United States R22h ago
-
Senior AI/ML Data Engineer USD 162K-226KAWS | Apache Airflow | BigQuery | CI/CD | Cloud ComposerCareer growth | Flexible remote days | In office five days per weekSenior-level Full TimeFrisco, TX, United States R22h ago
-
Principal, Data Analyst/BI Engineer USD 108K-145KAWS | BigQuery | Cloud platform | Data Governance | Data Modeling401k matching | Dental coverage | Healthcare coverage | Paid Holidays | Paid time offSenior-level Full TimeUnited States R22h ago
-
Mid-level Full TimeScott AFB, IL R22h ago
-
Sr. Data Engineer USD 401KAWS | CI/CD | DBT | Data Engineering | Data Governance401k match | Disability insurance | Employee assistance program | Generous paid time off | Health insuranceSenior-level Full TimeUtah | Hybrid R1d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Containerization | Docker | Drift DetectionCollaborative culture | Flexible hours | Learning budget | Mentorship | Remote workMid-level Full TimeCarrollton, United States R1d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftAnnual learning budget | Flexible hours | Local well being programs | Mentorship | Remote workMid-level Full TimeRichardson, United States R1d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment tracking100 percent remote work | Annual learning budget | Flexible hours | Internal TechTalks | MentorshipMid-level Full TimeLewisville, United States R1d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimePlano, United States R1d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipMid-level Full TimeArlington, United States R1d ago
-
MLOps Engineer ID72409 USD 125K-193KCI/CD | Cloud Platforms | Docker | Drift Detection | Experiment trackingAnnual learning budget | Flexible hours | Internal TechTalks | Mentorship | People focused supportMid-level Full TimeMcKinney, United States R1d ago