Senior Engineer - Ingestion & Streaming Frameworks
Tasks
- Build self service onboarding tooling
- Choose ingestion patterns and deploy end to end
- Design build and operate ingestion frameworks
- Implement and use AWS networking and IAM
- Improve engineering quality observability cost security
- Lead production troubleshooting and incident response
- Mentor engineers through code reviews and pairing
- Own evolve ingestion stack and tooling
- Pull data into Snowflake Iceberg and Databricks
- Write Terraform for ingestion infrastructure
Perks/Benefits
- N/A
Skills/Tech-stack
AWS DMS | Airbyte | Amazon Web Services | Apache Airflow | Apache Spark | Batch Processing | CDC | CI/CD | Change Data Capture | Data Capture | Databricks | Debezium | Docker | Fivetran | GitHub Actions | IAM | Iceberg | Kubernetes | Observability | PrivateLink | Python | REST API | SQL | Security | Snowflake | Terraform | VPC | Web Services
Education
N/A
Related jobs
-
Senior Machine Learning Engineer USD 198K-287KData Engineering | Fine Tuning | Foundation Models | GenAI | Incident ResponseOn-call rotationSenior-level Full TimeRemote - US R8h ago
-
Senior Machine Learning Engineer, Vector Bidding Science USD 148K-229KA/B | A/B Testing | B testing | BigQuery | Control TheoryCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipSenior-level Full TimeRemote, Washington, USA R10h ago
-
Staff Machine Learning Engineer, Vector Bidding Science USD 172K-266KA/B | A/B Testing | B testing | BigQuery | Control TheoryCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation | Global employee assistance programSenior-level Full TimeRemote, Washington, USA R10h ago
-
Senior ML Engineer USD 152K-228KAmazon SageMaker | Baseten | Batching | CI/CD | Google Vertex401k matching | Dental insurance | Fertility assistance | Flexible time off | Health insuranceSenior-level Full TimeRemote - US & Canada (see … R11h ago
-
Full-Stack Engineer, AI Data Platform USD 130K-200KAWS DynamoDB | Cassandra | Cloud platform | GCS | Google CloudHybrid workMid-level Full TimeSan Francisco Bay Area R13h ago
-
Azure | Azure AI | Azure Data | Azure Data Factory | Azure DevOpsEU remote work days | Employee assistance program | Employer pension plan | Flexible working hours | JobradSenior-level Full TimeHomeoffice R14h ago
-
Junior AI Engineer (Open to remote) USD 110K-135KAPI Development | Language Model | Language Model Evaluation | Language Models | Language Processing401k | Dental insurance | Health savings account | Medical insurance | Paid time offEntry-level Full TimeNew York, NY, US, NY 10019 R1d ago
-
Senior Healthcare Data Engineer USD 85K-125KAPI Integration | Access Control | Agile | Amazon Web Services | AzureCareer development | Employee benefits | Flexible work across time zones | Remote work option | Wellbeing supportSenior-level Full TimeRemote, United States R1d ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R1d ago
-
Prompt Engineering Architect USD 100K-150KAgentic Workflows | Embeddings | Evaluation Frameworks | Fine Tuning | Language ModelsSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backup | CRUSH maps | CSI | Capacity PlanningBenefits | Long term multi year engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent Systems | Embedded Systems | Fault detectionRemote workMid-level Full TimeUnited States - Remote R1d ago
-
Agentic Workflows | Caching Strategies | ES6 | Evaluation Pipelines | Hallucination detectionSenior-level Full TimeSan Francisco, United States R1d ago
-
Senior Data Engineer - Remote - Multiple Levels USD 85K-141KAWS Data | AWS Data Migration | AWS Data Migration Service | AWS Lambda | Airflow401k retirement plan | Dental insurance | Health insurance | Paid Holidays | Parental leaveSenior-level Full TimeHome Office: Tysons, VA, United States R1d ago
-
Staff Data Infrastructure Engineer USD 149K-318KAWS | AWS CloudTrail | AWS CloudWatch | AWS IAM | AWS KMS401k retirement plan | Health and well-being benefits | On-call rotation | Paid time offSenior-level Full TimeRemote - Michigan, United States R1d ago
-
Databricks Administrator / Platform Engineer USD 113K-154KABAC | AWS | Apache Spark | Audit Logs | CI/CD401k match | Paid Holidays | Paid parental leave | Paid time off | Remote workMid-level Full TimeUSA MD Home Office (MDHOME), United … R1d ago
-
Senior Machine Learning Engineer, GenAI Data USD 243K-295KAmazon S3 | Batch Processing | C plus plus | Data Pipelines | Data PreprocessingSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
AI Engineer USD 105K-132KAWS | CAP | CLIA | Electronic Health Records | FDA401k benefits | Baby bonding leave | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeUS Remote R1d ago
-
Senior Software Engineer, Machine Learning USD 190K-220KAWS | Airflow | DBT | Kubernetes | MLflow401k match | Medical/Dental/Vision insurance | Paid Holidays | Paid parental leave | Remote-first teamSenior-level Full TimeRemote (United States) R1d ago
-
Member of Technical Staff - Principal ML Engineer USD 200K-300KAPI Design | Access Management | Auth0 | Cloud Architecture | Entra ID401k | Equity incentives | FSA | Health insurance | Mental health benefitsSenior-level Full TimeRemote (USA) R1d ago
-
Site Reliability Engineer - Storage Engineer USD 98K-192KAWS | Ansible | Bash | CI/CD | Ceph401k retirement plan | Dental insurance | Employee Assistance Program (EAP) | Employee Health Insurance | Hybrid work optionsSenior-level Full TimeAustin, Texas, United States R1d ago
-
Sr. Data Engineer USD 152K-223KAWS | Access Control | CI/CD | Change Data Capture | DBT401k match | Disability insurance | EAP | Health insurance | Hybrid work flexibilitySenior-level Full TimeUtah | Hybrid R1d ago
-
Enterprise Sales Engineer - FED USD 118K-157K.NET | CRM | Go | Java | Node.js401k match | Community guilds | Dental | Employee stock purchase plan | Fitness reimbursementSenior-level Full TimeDistrict of Columbia, USA, Remote; Virginia, … R1d ago
-
Senior Staff Data Engineer - Platform Data and Analytics USD 268K-368KAWS | Airflow | Alerting | Apache Spark | Compute OptimizationComprehensive benefits | Equity | Hybrid/Remote flexibilitySenior-level Full TimeSan Francisco, CA R1d ago