Sr Data Engineer
USA - CA - Market St, United States
USD 138K-203K Senior-level Full Time
Tasks
- Add observability metrics and structured logging
- Build ingestion and transformation components
- Build streaming and batch data pipelines
- Collaborate with infrastructure and ML engineering teams
- Design scalable storage and retrieval patterns
- Document and support system architecture reviews
- Ensure reliability recoverability and auditability
- Implement AI optimized data models
- Implement automated alerts and drift detection
- Implement embedding generation workflows
- Integrate agent frameworks and feature stores
- Integrate vector stores and retrieval pipelines
- Mentor junior team members
- Own development lifecycle prototyping implementation testing deployment
- Validate data quality and enforce schema evolution safeguards
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS S3 | Amazon Kinesis | Amazon MWAA | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark | Dagster | Data Governance | Data Lineage | Data Quality | Data Quality Validation | Data Security | Databricks | Datadog | Faiss | Java | Langchain | Langgraph | Monitoring | Observability | PGVector | Pinecone | Prometheus | Python | Quality validation | SQL | Schema evolution | Vector Databases | Weaviate
Education
Roles
Regions
Countries
States
Related jobs
-
Network Engineer, Deployment & Support USD 101K-156K400G | 800G | AI | Automation | Coherent opticsMid-level Full TimeMenlo Park, CA | Eagle Mountain, …1h ago
-
Senior Software Engineer, Database Internals, AlloyDB USD 174K-252KC# | C++ | Code optimization | Concurrency Control | Database InternalsEntry-level Full TimeSunnyvale, CA, USA1h ago
-
Artificial Intelligence | Data Analysis | Data Structures | Data structures algorithms | Human-in-the-loopSenior-level Full TimeMountain View, CA, USA1h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
AI Data Engineer USD 120K-220KAgent memory | Amazon Web Services | Audio Processing | Batch Processing | Cloud infrastructureAccess to AI tools | Equity | Remote opportunitiesMid-level Full TimeSan Francisco Bay Area12h ago
-
Senior-level Full TimeRaleigh, NC, US12h ago
-
AI Innovation Analyst - Internal USD 65K-80KAI Governance | AI Services | Authentication | Automation | AzureEntry-level Full TimeMiami, FL12h ago
-
C plus plus | C# | CAD | Dynamics | FDA Compliance401k | Company holidays | Dental insurance | Health insurance | Paid maternity/paternity leaveSenior-level Full TimeLos Angeles, California R13h ago
-
AI Engineer, Generative AI Agents USD 130K-188KAWS | Agile | Amazon Bedrock | Context engineering | Cost OptimizationOn-site work requiredSenior-level Full TimeDenver, CO13h ago
-
Lead Data Engineer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakesLearning and development programs | Mentorship | Remote workSenior-level Full TimeChicago, Illinois, USA R14h ago
-
Principal Agentic AI Engineer USD 274K-338KAgent Orchestration | Auditability | Benchmarking | Confidence scoring | Distributed SystemsContinuing education support | Dental insurance | Flexible vacation policy | Health insurance | Paid parental leaveSenior-level Full Timesan francisconew york R14h ago
-
Mid-level Full TimeIrvine, CA15h ago
-
Senior Data Engineer USD 117K-162KAWS | Azure | BigQuery | DBT | Data Architecture401k | Annual wellness stipend | Cell phone reimbursement | Coaches and therapists access | Collective Pause DaysSenior-level Full TimeRemote - US R15h ago
-
Software Engineer, Enterprise AI Platform USD 230K-385KAPI Design | Agent systems | Applied AI | Auditability | AuthenticationMid-level Full TimeSan Francisco15h ago
-
Staff Machine Learning Engineer, Programmatic Ads USD 222K-389KA/B | A/B Testing | Ad Ranking | B testing | Data AnalysisSenior-level Full TimeSan Francisco, CA, US; Palo Alto, …15h ago
-
Embedded Software Engineer II USD 115K-140KBash | C plus plus | C# | CI/CD | D-busERGs | Family Caregiver Support | Flexible PTO | HSA match | Health benefitsMid-level Full TimeRemote - USA R15h ago
-
Senior-level Full TimeBoston, Massachusetts15h ago
-
VP, Quantitative Developer - Risk Engineering USD 225K-280KAI | Automation | Generative AI | Model Risk Management | Model risk401k company contribution | Flexible Time Off Paid | Free Coaching Counseling | Health benefits | Hybrid & flexible workingExecutive-level Full TimeNew York, NY16h ago
-
Data Analyst, Data Cloud Intelligence USD 85K-95KAWS | Attribution | Business Intelligence | Data Modeling | Data pipelineEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Stock purchase planMid-level Full TimeRemote - US R16h ago
-
Senior Embedded Software Engineer USD 145K-220KAgile | Buildroot | C# | C++ | CI/CD401k match | Casual dress code | Dental benefits | FSA | Free daily lunchSenior-level Full TimeSan Diego, California, United States16h ago
-
AI Engineer USD 131K-185KAnthropic API | Apps Script | Autogen | Cloud deployment | CrewAIAsync first collaboration | Conversion to employment based on performance | Direct access to leadership | Fast feedback loops | Fully remoteMid-level Full TimeUnited R16h ago
-
Data Engineer, Marketing Data Operations USD 95K-130KAPI | AWS EC2 | AWS Redshift | AWS S3 | BigQueryMid-level Full TimeOrlando16h ago
-
Senior Solution Engineer USD 165K-216KAnalytics | Cloud Computing | Data Architecture | Data Lake | Data WarehouseSenior-level Full TimeUS-CA-Bay Area-Remote R17h ago
-
Senior Software Engineer USD 140K-185KAWS | Automated testing | Azure | C++ | Git401K company matching | Dental insurance | Dependent care benefits | Flexible spending account | Health insuranceSenior-level Full TimeBoulder, CO R18h ago
-
AI Full Stack Developer & Architect USD 130K-180KCloud Run | Containerization | JavaScript | Kubernetes | MLOpsSenior-level Contract Full TimeSan Jose, CA, United States18h ago