Data Engineer
Tasks
- Build automated validation testing and observability for pipelines
- Design build optimize data pipelines for telemetry logs events
- Develop and maintain data lineage documentation and codebooks
- Implement data retention partitioning and storage optimization
- Implement schemas mappings ETL ELT data models
- Integrate new data sources and normalize enrichment
- Mentor junior engineers and improve data engineering practices
- Monitor data quality latency completeness and reliability
- Troubleshoot production incidents and support evidentiary exports
Perks/Benefits
Skills/Tech-stack
Apache Flink | Apache Spark | Batch Processing | CI/CD | Cloud Data | Cloud Data Warehouse | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Warehouse | ELT | ETL | Elasticsearch | Infrastructure as Code | Java | Kafka | Logging | Metrics | Observability | Python | Scala | Schema Design | Splunk | Stream processing | Tracing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Engineering | Master of Science | PhD
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R17d ago
-
Data Engineer, Analytics USD 191K-235KA/B | A/B Testing | B testing | Big Data | ClusteringTelecommuting allowedSenior-level Full TimeMenlo Park, CA | Remote, US R1h ago
-
Data Engineer, Analytics USD 209K-235KBig Data | Data Governance | Data Modeling | Data Quality | Data SecurityTelecommutingSenior-level Full TimeMenlo Park, CA | Remote, US R1h ago
-
Data Engineer, Analytics USD 205K-235KBig Data | Data Governance | Data Modeling | Data Quality | Data SecurityTelecommutingEntry-level Full TimeMenlo Park, CA | Remote, US R1h ago
-
Data Scientist, Analytics USD 193K-196KA/B | A/B Testing | B testing | Clustering | Descriptive StatisticsMid-level Full TimeBellevue, WA1h ago
-
Data Engineer, Analytics USD 185K-200KAmazon EC2 | Amazon Redshift | Amazon S3 | Apache Druid | Apache SparkTelecommuting from anywhere in the United States allowedMid-level Full TimeMenlo Park, CA | Remote, US R1h ago
-
Data Engineer USD 183K-196KBusiness Intelligence | Data Governance | Data Instrumentation | Data Modeling | Data PrivacyMid-level Full TimeMenlo Park, CA1h ago
-
Data Engineer USD 185K-196KCSS | Data Modeling | Data Warehousing | Dimensional data | Dimensional data modelingMid-level Full TimeMenlo Park, CA1h ago
-
Machine Learning Engineer, Computer Vision USD 174K-252KC++ | Computer Vision | Data Processing | Debugging | Deep learningMid-level Full TimeMountain View, CA, USA1h ago
-
Senior Software Engineer, Gen AI, GCP Data Analytics USD 174K-252KBigQuery | Data analytics | Generative AI | Google Cloud | JavaSenior-level Full TimeKirkland, WA, USA1h ago
-
Senior Software Engineer, Applied AI (Food) USD 174K-252KData Processing | Debugging | Distributed Computing | Go | JavaSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1h ago
-
Snowflake (Data Engineer) USD 128K-154KAWS | Analysis Services | Data Modeling | Data Warehousing | Data integration401k plan | Accident insurance | Critical illness insurance | Daycare FSA | Dental insuranceMid-level Full TimeNashville, TN9h ago
-
Agentic AI | C# | C++ | Client-Server | Client-server systemsEntry-level InternshipSan Mateo, CA, United States12h ago
-
Senior Software Engineer - Data Lake & BI USD 162K-242KApache Iceberg | Apache Spark | Avro | C++ | CI/CD401k match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending accountSenior-level Full TimeSunnyvale, CA / Bellevue, WA12h ago
-
Machine Learning Engineer, Foundation Model USD 129K-247KAutonomous Driving | Autoregressive modeling | Behavior Prediction | C plus plus | Data PipelinesSenior-level Full TimeSan Jose12h ago
-
Software Engineer, Database Migration Service USD 143K-194KC++ | Data Structures | Distributed Systems | Hibernate | JavaCode review feedback | Knowledge sharing | Learning opportunities | Mentorship | Work-life balanceMid-level Full TimeBoston, Massachusetts, USA12h ago
-
Engineering Manager, Machine Learning (Caper) USD 201K-253KBigQuery | CI/CD | Computer Vision | Deep learning | DockerRemote workSenior-level Full TimeUnited States - Remote R13h ago
-
API | Data Modeling | Data Visualization | ETL | Power BIRemote workEntry-level Full Time InternshipRancho Cordova, CA, United States13h ago
-
Senior Generative AI Consultant USD 136K-136KAWS | Azure | CI/CD | Cloud platform | Deep learning401k matching | Dental insurance | Flexible spending account | Gym reimbursement | HealthcareSenior-level Full TimeSan Francisco, CA, United States13h ago
-
3D Embeddings | Adversarial ML | Apache Spark | Computer Vision | Data EngineeringEquity compensation | Onsite collaborationSenior-level Full TimeSan Mateo, CA, United States13h ago
-
Mid-level Full TimeMiami, Florida, United States14h ago
-
Senior Software Engineer (San Francisco, CA) USD 157K-222KAWS EC2 | AWS ECS | AWS EMR | AWS Fargate | AWS GlueSenior-level Full TimeSan Francisco, CA14h ago
-
Mid-level Full TimeAshburn15h ago
-
Senior Data Engineer USD 160K-195KAWS Lambda | AWS Step Functions | Alerting | Amazon EMR | Amazon KinesisSenior-level Full TimeRemote - US R15h ago
-
Senior-level Full TimeTampa, FL15h ago