Sr Data Engineer
USA - CA - 1200 Grand Central Ave, United States
USD 138K-203K Senior-level Full Time
Tasks
- Add metrics logging and alerts
- Build reusable ingestion and transformation components
- Build streaming and batch ingestion systems
- Collaborate with ML engineering and product teams
- Design data pipelines
- Develop AI optimized data models
- Enforce schema evolution safeguards
- Implement data observability
- Implement embedding generation workflows
- Integrate vector stores and retrieval pipelines
- Mentor junior engineers
- Own development lifecycle from prototype to deployment
- Perform data quality validation
- Support data governance and compliance
- Write design documentation
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS S3 | Airflow | Apache Spark | Dagster | Data Modeling | Data Quality | Databricks | Datadog | Faiss | Flink | Java | Kafka | Kinesis | Langchain | Langgraph | MWAA | Monitoring | Observability | PGVector | Pinecone | Prometheus | Python | RAG | Retrieval-Augmented Generation | SQL | Schema evolution | Structured Logging | Vector Stores | Weaviate
Education
Roles
Related jobs
-
Associate Director, AI Enablement & Machine Learning USD 212K-318KCloud Computing | Data Engineering | Data Governance | Deep learning | Generative AIAnnual incentive program | Healthcare coverage | Retirement benefitsMid-level Full TimeCambridge, MA9h ago
-
Software Engineer, Data (L1) USD 75K-130KAI Platform | APIs | Apache Airflow | Apache Iceberg | Apache Spark401k match | Calm subscription | Career growth and learning opportunities | Commuter benefits options | Dental insuranceMid-level Full TimeAustin, TX10h ago
-
Solutions Engineer – Robotics & Autonomous Driving USD 152K-500K2D Imaging | 3D Imaging | Autonomous Driving | C++ | CameraCommuter stipend | Generous PTO | Global travel | Health, dental, vision coverage | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY12h ago
-
AI Developer and Data Lead USD 91K-184K.NET | AI Security | API Development | AWS Lambda | Amazon AuroraSenior-level Full TimeWashington, DC14h ago
-
Machine Learning Research Engineer USD 161K-189KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | C++Flexible hybrid work model | Mental health counseling | Mentorship programs | Paid parental leave | Paid volunteer time offMid-level Full TimeNew York, US, New York14h ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Governance | Data Security401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …15h ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Cost Optimization | Column-Level Security | Cost Optimization | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …15h ago
-
Sr. Application Software Engineer, Data Analytics USD 160K-225KAngular | C# | CI/CD | Computer Vision | Continuous integrationExtended hours | Travel | Weekend workSenior-level Full TimeBastrop, TX15h ago
-
AI Engineer - Automation/Robotics USD 104K-110KAlgorithms | Azure Machine Learning | Computer Vision | Data Structures | DebuggingOnsite workEntry-level Full TimeRedmond, WA16h ago
-
Mid-level Full TimeEl Segundo16h ago
-
Senior-level Full TimeSan Francisco, California16h ago
-
Foundation Model Data, Software Engineer USD 213K-263KApache Beam | Apache Flume | C++ | CI/CD | Distributed Systems401k match | Baby bonding leave | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeMountain View, CA, USA; San Francisco, …17h ago
-
Senior-level Full TimeOnsite - Austin, TX17h ago
-
Data parallelism | Diffusion Models | Efficient Attention | Expert parallelism | FlaxSenior-level Full TimeMountain View, California, United States, New …17h ago
-
Lead Cyber Risk & Analytics Engineer USD 130K-160KAgile | Data Visualization | Database querying | Econometrics | ExcelDependent care assistance | Flexible hours | Hybrid work | Learning and development | Mentorship programsSenior-level Full TimeNew York Office17h ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R17h ago
-
Senior Data Engineer USD 90K-110KAWS | Agile | Apache NiFi | Data Architecture | Data ModelingAutonomy | Flexible working hours | Global employee assistance programme | Online training videos | Teambuilding eventsSenior-level Full TimeNew York, United States18h ago
-
Data Platform Engineer USD 85K-120KAlembic | App Service | Azure | Azure App | Azure App Service401k match | Annual discretionary bonus program | Bereavement leave | Commuter spending accounts | Dental insuranceMid-level Full TimeChicago, IL (Downtown)18h ago
-
Robotics Test Engineer USD 100K-150KASan | Bitbucket Pipelines | C++ | CI/CD | DebuggingDirect hire | Mentorship | Ownership of test suitesMid-level Full TimeOnsite - Austin, TX19h ago
-
AI Feedback | Checkpointing | Cost Performance | Cost-performance tradeoffs | Data Decontamination401k matching | Country specific visa support | Flexible work arrangements | Medical, dental, and vision options | Parental leaveSenior-level Full TimePalo Alto, California, United States19h ago
-
AI Engineer 1 - Compliance, Quality & Testing USD 80K-150KAI-assisted testing | CI/CD | Code review | Cypress | Defect Tracking401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC19h ago
-
Machine Learning Engineer, ML Flywheel USD 136K-173KC++ | Data Pipelines | Distributed Systems | ML Ops | Machine LearningAnnual bonus program | Company benefits program | Equity incentive plan | Hybrid workMid-level Full TimeMountain View, CA, USA19h ago
-
Software Engineer, Applied AI USD 190K-280KContext engineering | Data Processing | Data Storage | Debugging | Docker401k match | Dental insurance | Health insurance | Hybrid work model | Professional developmentSenior-level Full TimeNew York City R19h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R19h ago
-
AI Data Engineer USD 133K-185KAmazon Redshift | BigQuery | CI/CD | CRM Integration | Clay401(k) self contribution | BetterUp coaching | Company holidays observed | Development plan | Flexible paid time offSenior-level Full TimeAustin, TX20h ago