Senior Engineer - Ingestion & Streaming Frameworks
Tasks
- Build API ingestion patterns
- Build ingestion pipelines
- Design ingestion frameworks
- Develop self service onboarding tooling
- Enforce engineering quality and cost discipline
- Implement Change Data Capture
- Improve observability and security
- Ingest data into Iceberg
- Ingest data into Snowflake
- Ingest data into databricks
- Lead incident response
- Manage AWS networking and IAM
- Mentor engineers
- Operate ingestion stack
- Own ingestion architecture
- Write terraform infrastructure modules
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airbyte | Airflow | Amazon DMS | CDC | CI/CD | Databricks | Debezium | Fivetran | GitHub | IAM | Iceberg | Kubernetes | MWAA | PrivateLink | Python | Routing | SQL | Snowflake | Spark | Subnets | Terraform | VPC
Education
N/A
Related jobs
-
Principal Research Data Engineer USD 142K-185KAirflow | Analytical processing | ArcGIS | Avro | CI/CDDental | Health care | PTO | Retirement | Sick leaveSenior-level Full TimeSt. Louis, Missouri, US R2h ago
-
Machine Learning Engineer (Active Secret Clearance) USD 160K-190KAgile | Asynchronous programming | CI/CD | Data Engineering | Docker401k plan | FSA | Fully remote work | HSA | Hybrid onsite optionMid-level Full TimeRemote; Tacoma, WA R7h ago
-
Data Software Engineer USD 90K-170KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | Azure401k plan | Dental insurance | Life insurance | Medical insurance | Remote work hybridSenior-level Full TimeUnited States; United States; United States; … R1d ago
-
Senior AI/Machine Learning Engineer USD 140K-170KAWS | Azure | Bias Variance | CI/CD | Cloud platform401k matching | Dental insurance | Flexible spending account | Growth opportunities | Health savings accountSenior-level Full TimeDenver, CO, United States R1d ago
-
AI Solutions Architect Engineer USD 130K-197K.NET | API | Azure | Backend Development | C#Contract-to-hire | Hybrid work model | Onsite schedule flexibility | Remote work on selected daysSenior-level Full TimeHouston, United States R1d ago
-
Staff Software Engineer, Applied AI USD 200K-230KFastAPI | Golden datasets | LLM orchestration | Langchain | Langgraph401k retirement plan | Dental insurance | Equity incentive plan | Flexible vacation policy | Flexible work hours stipendSenior-level Full TimeU.S. (Remote) R2d ago
-
Senior Staff Research Scientist, Speech Technologies USD 180K-240KASR | Accuracy Optimization | C++ | CUDA | Data PipelinesFully remote | Quarterly travelSenior-level Full TimeBellevue, WA R2d ago
-
Senior Business Intelligence Analyst USD 107K-150KA/B | A/B Testing | B testing | Causal Inference | Cohort AnalysisEmployee assistance program | Flexible hours | Flexible vacation policy | Fully remote setup | Long-term disabilitySenior-level Full TimeRemote (United States) R2d ago
-
Sr. Embedded Software Engineer USD 100K-130KARM Cortex | ARM Cortex A | Assembly | Bash | Buildroot401k match | Career growth and professional development opportunities | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeRemote (United States) R2d ago
-
AI Software Engineer USD 150K-165KAPI Development | AWS | Alerting | Asynchronous programming | Data pipeline401k plan | Commuter benefits | Dental insurance | Hybrid work | Medical insuranceSenior-level Full TimeLos Angeles, CA, US R2d ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R2d ago
-
Sr Data Engineer USD 100K-120KAPIs | AWS | AWS Glue | Airflow | Amazon RedshiftFully remote | Mentorship | On-call supportSenior-level Full TimeOrlando, FL, United States R2d ago
-
Lead AI Engineer (Hybrid) USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningInclusive collaborative culture | Interactive learning tools | Professional development programs | Workplace accommodationsSenior-level Full TimeSeattle, Washington, USA R2d ago
-
Senior AI Engineer (Hybrid) USD 173K-275KAWS | Autogen | Azure | CI/CD | Clean CodeHybrid work | Mentorship | Professional developmentSenior-level Full TimeSeattle, Washington, USA R2d ago
-
Senior-level Full TimeUSA, USA R2d ago
-
Staff Machine Learning Systems Engineer (MLOps) USD 210K-250KAWS EKS | Alerting | Autoscaling | CI/CD | ClickHouseFlexible remote work | Healthcare industry domain experienceSenior-level Full TimeUS Remote R2d ago
-
Sr. Data & AI Engineer USD 160K-185KAWS | Agile | Azure | Big Data | Data ArchitecturePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R2d ago
-
Senior Data Engineer USD 140K-170KData Governance | Data Management | Data Modeling | Data Quality | Data sharesComprehensive benefits package | Flexible hybrid schedule | Opportunities for promotion | Supportive work community | Training and developmentSenior-level Full TimeNew York, New York, United States; … R2d ago
-
Staff AI Engineer USD 145K-220KAgentic AI | Backend Services | LLM | Observability | Performance Engineering401k match | ClassPass membership | Employer paid medical/dental/vision | Flexible spending account | Paid parental leaveSenior-level Full TimeUnited States (Remote) R2d ago
-
Senior-level Full TimeRemote - US R2d ago
-
Machine Learning Engineer USD 135K-230KAWS | Data Pipelines | Data labeling | DevOps | EHR401k | Dental insurance | Disability coverage | Flexible return-to-work | Medical insuranceSenior-level Full TimeRemote R2d ago
-
AWS | AWS Glue | AWS Glue Data Catalog | AWS Lake Formation | AWS LambdaAutonomy and ownership | Career growth | Collaborative global team | Flexible work culture | Fully remote workSenior-level Full TimeCanada R2d ago
-
Principal Data Engineer, Data Platform USD 170K-195KAI Governance | Apache Spark | Data Governance | Data Lineage | Data Observability401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimeRemote-US R2d ago
-
AI Agents | AWS | Access Management | Alerting | BashFlexible PTO | Fully remote friendly | Learning and development budget | Medical, dental & vision coverage | Mental health and wellness supportSenior-level Full TimeCanada R3d ago
-
API Integration | Agentic Workflows | Conversational AI | Distributed Systems | End to EndFast iteration cycles | Flexible schedule | Fully remote | Global work location | High ownershipSenior-level Full TimeCanada R3d ago