Data Engineer
Tasks
- Build automated validation testing and observability for pipelines
- Design build optimize data pipelines for telemetry logs events
- Develop and maintain data lineage documentation and codebooks
- Implement data retention partitioning and storage optimization
- Implement schemas mappings ETL ELT data models
- Integrate new data sources and normalize enrichment
- Mentor junior engineers and improve data engineering practices
- Monitor data quality latency completeness and reliability
- Troubleshoot production incidents and support evidentiary exports
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch Processing | CI/CD | Cloud Data | Cloud Data Warehouse | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Warehouse | ELT | ETL | Elasticsearch | Infrastructure as Code | Java | Kafka | Logging | Metrics | Observability | Python | Scala | Schema Design | Splunk | Stream processing | Tracing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
Related jobs
-
ML Engineer, Surrogate Modeling (Vehicle Engineering) USD 125K-175KActive Learning | Adaptive Sampling | CFD | Continuous integration | Data Pipelines401k retirement plan | Employee stock purchase plan | Life insurance | Long-term disability insurance | Long-term incentivesEntry-level Full TimeHawthorne, CA2h ago
-
Lead ML Inference Engineer, Advertising USD 246K-486KCo-design | Distributed Systems | GPU Acceleration | Hardware-Software Co-design | Hardware/softwareDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California2h ago
-
Senior Machine Learning Engineer, Computer Vision USD 150K-200KAWS | Agile | Airflow | Azure | CI/CD401-k plan | Healthcare benefits | Life insurance | Long-term disability | On-site collaborationSenior-level Full TimeSeattle, Washington, United States7h ago
-
Staff AI Engineer USD 170K-220KAPI Development | API Integration | Anthropic API | Artificial Intelligence | Backend Development401k match | Commuter benefits | Employee assistance program | Flexible spending accounts | Gym Fitness Discount ProgramSenior-level Full TimeRemote- US R9h ago
-
Senior Engineer, Developer Platforms - GenAI USD 140K-160KAWS | Agentic Workflows | Amazon Web Services | Datadog | DockerSenior-level Full TimeNew York, NY9h ago
-
Business Analytics Lead - Predictive Modeling USD 130K-140KA/B | A/B Testing | B testing | Business Intelligence | Dashboard Development401k retirement savings plan | Dental coverage | Equity participation | Flexible spending account | Health savings accountSenior-level Full TimeNew York, NY9h ago
-
Quantitative Engineer USD 140K-155KAI Assistant | API Design | AWS | CI/CD | Credit facility401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundSenior-level Full TimeRemote - USA R9h ago
-
C# | C++ | Digital Twin | HMI/SCADA | Industrial AutomationTravel 15 to 30 percentSenior-level Full TimeMiddleton, MA, United States11h ago
-
Software Engineer II, Computational Platform USD 124K-154KAPIs | AWS | Cloud Networking | Data Modeling | Docker401k plan | Commuter support | Company-provided laptop | Flexible paid time off | Holiday payMid-level Full TimeRemote; Watertown, Massachusetts, United States R12h ago
-
Data Platform Engineer USD 130K-175KAccess Control | Alerting | CI/CD | Cloud services | Data LineageMid-level Full TimeMilwaukee, WI12h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous work culture | Bonus | Equity | Friendly work environment | Remote-friendly cultureMid-level Full TimeNew York, NY, USA15h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed team | Opportunity for product impact | Supportive management cultureMid-level Full TimeBoston, MA, USA15h ago
-
Perception Engineer USD 166K-220K3D Reconstruction | C++ | Camera Calibration | Camera systems | Computer VisionSenior-level Full TimeSeattle, Washington, United States16h ago
-
Computer Vision Engineer USD 166K-220K3D Reconstruction | C++ | Camera Calibration | Camera systems | Computer VisionSenior-level Full TimeSeattle, Washington, United States16h ago
-
Bash | Data Processing | Docker | GCP | LinuxMid-level Full TimeAustin, TX, USA16h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Opportunity for high impact | Remote-friendlyMid-level Full TimeAtlanta, GA, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerFriendly atmosphere | Opportunities for high impact | Professional growth | Remote friendly asynchronous cultureMid-level Full TimeSan Diego, CA, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Bonus | Equity | Laid back environment | Remote-friendlyMid-level Full TimePhoenix, AZ, USA16h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeMenlo Park, CA, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeSanta Clara, CA, USA16h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Competitive compensation | Equity | Friendly work environmentMid-level Full TimeBoulder, CO, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management style | Portfolio and LinkedIn submissionMid-level Full TimeCharlotte, NC, USA16h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Competitive bonus | Equity compensation | Flexible remote distributionMid-level Full TimeAnn Arbor, MI, USA16h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Bonus | Equity | Flexible remote distributed setting | Friendly laid-back atmosphereMid-level Full TimeColumbus, OH, USA16h ago
-
Bash | Cloud infrastructure | Cloud infrastructure as code | Cloud platform | Data ProcessingAsynchronous culture | Distributed team | Portfolio support | Remote workMid-level Full TimeMiami, FL, USA16h ago