Senior Data Engineer
Tasks
- Build and optimize BigQuery transformations
- Build deploy and maintain ML pipeline components
- Collaborate with ML Engineers and Platform Engineers
- Design event store architecture
- Design event-driven data pipelines
- Develop Python data engineering workloads
- Document architecture decisions and engineering standards
- Implement Parquet partitioning and join optimization
- Manage event schema for mixed event types
- Operate streaming data pipelines
- Package and deploy services with Docker
- Tune SQL query performance
Perks/Benefits
Skills/Tech-stack
Apache Flink | BigQuery | Cloud platform | Data Transformations | Docker | Event store | Event store design | Google Cloud | Google Cloud Platform | Kafka | Kubeflow Pipelines | Pandas | Parquet | Polars | Python | Query Optimization | SQL | Schema management | Store Design | Vertex AI
Education
N/A
Roles
Related jobs
-
Forward Deployed Machine Learning Engineer USD 180K-300KAPI Design | Cloud Computing | Deep learning | Diffusion Models | Fine TuningIn-person collaboration days | Remote work flexibility | Travel cost coverageSenior-level Full TimeSan Francisco (USA) R15h ago
-
Senior Software Engineer - Platform & MLOps USD 152K-230KAWS | Azure | CI/CD | Datadog | DockerDiscretionary incentive plan | Flexible work policy | Learning and development access | Medical benefitsSenior-level Full TimeSeattle, Washington, United States - Remote R16h ago
-
Senior Data Engineer IS - Remote USD 122K-208KAI/ML | APIs | AWS Glue | Apache Airflow | Azure Data401k matching | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimePortland, OR, United States R17h ago
-
Principal AI Platform Engineer USD 167K-220KAgent Orchestration | Backend Development | Braintrust | Cost Optimization | Data PipelinesEquity | Flexible Token Limits | Health, dental, vision coverage | Unlimited paid time offSenior-level Full TimeSan Francisco, California R18h ago
-
21 CFR | 21 CFR Part 11 | CDISC | CFR Part 11 | Cloud platformFlexible work environment | Health benefits | Hybrid work schedule | Paid bonus eligibilityMid-level Full TimeWaltham, MA, United States R20h ago
-
Cloud Data | Cloud Data Platforms | Data Governance | Data Modeling | Data QualityDental insurance | Employer-matched 401k | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRedmond, WA, United States R21h ago
-
Senior Data Engineer II USD 125K-188KAWS | Amazon Redshift | Big Data | CI/CD | Cloud ComputingFlexible work options | Volunteer time offSenior-level Full TimeKansas City, MO, 64114, USA R21h ago
-
Cloud Data | Cloud Data Platforms | Data Governance | Data Modeling | Data QualityDental insurance | Employer-matched 401k | Health insurance | Life insurance | Paid HolidaysMid-level Full TimeRedmond, WA, United States R21h ago
-
Full Stack Software Engineer - Robotics USD 125K-200KAWS | Datadog | Distributed Systems | Edge Computing | Grafana401k | Cell phone reimbursement | DC FSA | Employee assistance program | EquityMid-level Full TimeSan Francisco || Oakland, CA R23h ago
-
IT Platform Engineer-Analytics Services USD 74K-166KAgile | Alteryx | Azure | CI/CD | Cloud platformAdoption reimbursement | Back-up child care | Dental insurance | Employee resource groups | Fertility treatment supportSenior-level Full TimeMI, United States R23h ago
-
AI Developer - Model Creation & Full Stack USD 150K-175KAWS | Angular | Azure | CI/CD | D3.jsRemote work | USPS Public Trust Clearance eligibleMid-level Full TimeWork from home, VA, United States R23h ago
-
AI Developer USD 149K-190KChain-of-Thought | Continuous Deployment | Continuous integration | Deep learning | FHIRFlexible work schedule | Remote work opportunitySenior-level Full TimeUnited States R1d ago
-
Sales Engineer USD 125K-160KAPI | AWS EKS | Amazon Web Services | Apache Spark | Cloud platformWork from anywhereMid-level Full TimeUnited States R1d ago
-
API Integration | AWS | AWS Glue | Batch Processing | Code reviewSenior-level Full TimeIndianapolis, IN, United States R1d ago
-
Data Transport Engineer USD 97K-139KAlerting | Data Integrity | Data Lake | Distributed Systems | ELTMid-level Full TimeHerndon, VA and/or Columbia, MD R1d ago
-
Applied AI Engineer, Agentic Systems USD 115K-192K.NET | APIs | Anthropic | CrewAI | Evaluation FrameworksAI and productivity tools access | Remote work accessSenior-level Full TimeRemote - United States R1d ago
-
Senior-level Full TimeSan Francisco - Remote, CA, United … R1d ago
-
Senior Industrial Engineer, Process Optimization USD 100K-120K5S | AutoCAD | Cause analysis | Cost modeling | Excel401k | Dental insurance | Disability insurance | Flexible spending account | Health savings accountSenior-level Full TimeBethlehem, PA, United States R1d ago
-
Senior Data Engineer USD 119K-165KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure FunctionsCareer growth | Healthcare industry experience | MentorshipSenior-level Full TimeUS - Remote, United States R1d ago
-
Machine Learning Engineer II GBP 124K-186KAWS | Anomaly Detection | Athena | Bedrock | C++Formal learning opportunities | Hybrid work | On-the-job learningMid-level Full TimeUSA – MN – Minneapolis, United … R1d ago
-
Edge AI Engineer USD 130K-200KBenchmarking | C++ | Core ML | Edge Computing | Embedded SystemsCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer (Applied AI) USD 150K-222KAccelerator hardware | Agentic Systems | Data Quality | Data quality monitoring | Deep learningCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Distinguished Engineer, Applied AI USD 150K-300KAWS | Agentic AI | Algorithms | Artificial Intelligence | Auto-failover401k match | Adoption Assistance | Career mentorship | Certification assistance | Employee trainingSenior-level Full TimeCA Palo Alto Office, United States R1d ago
-
AI Data Infrastructure Engineer USD 146K-189KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingBenefits package | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 146K-189KActive Learning | Apache Beam | CI/CD | Caching | Code reviewMid-level Full TimeUnited States - Remote R1d ago