Senior Software Engineer, Data Platform, AI Labs
USA-New York-NY-1166 Avenue of Americas, United States
USD 180K-240K Senior-level Full Time
Tasks
- Build asynchronous processing frameworks with fault tolerance and retries
- Design scalable data pipelines for document ingestion
- Design storage and indexing architecture for search and vector stores
- Establish pipeline observability and service level objectives
- Implement multi tenant data architectures with isolation and resource controls
- Plan modernization and migration strategies with zero downtime
- Produce technical design documentation and support testing and CI standards
Perks/Benefits
- N/A
Skills/Tech-stack
Asynchronous processing | Azure | Data Partitioning | Dead Letter | Dead-letter queues | Docker | Grafana | Idempotency | Indexing | Kubernetes | Message Queues | OAuth2 | Observability | OpenID Connect | OpenTelemetry | PostgreSQL | Prometheus | Python | Qdrant | Query Optimization | RabbitMQ | SAML | Search Indexing | Solr | System Architecture | System design | Terraform | Vector Databases
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Associate Consultant, Generative AI USD 84K-122KAWS | Azure | CI/CD | Cloud platform | Compliance401k match | Employee assistance program | Flexible spending account | Health savings account | Paid parental leaveMid-level Full TimeSan Francisco, CA, United States6h ago
-
Sr AI Engineer USD 84K-105KAudio signal processing | C Embedded Systems | C embedded | C# | Data Preprocessing100% onsite | ADND Insurance | Accrued Paid Vacation | Company paid life insurance | Dental insuranceSenior-level Full TimeColumbia, MARYLAND, United States9h ago
-
Data Engineer USD 100K-160KAirflow | Amazon Redshift | Apache Spark | Azure | Azure Data401k retirement plan | Employee assistance program | Health savings account | Life insurance | Long-term disabilityMid-level ContractCoppell, Texas, USA9h ago
-
AI Engineer (Remote) USD 169K-230KAWS | Agent systems | Application development | Automation | Azure401k plan | Accident insurance | Dental insurance | Disability insurance | Flexible spending accountExecutive-level Full TimeFort Washington, PA, United States R11h ago
-
Mid-Level Data Engineer USD 130K-140KAPI first | API-first design | AWS | Agile | Amazon RedshiftRemote workMid-level Full TimeWork from home, VA, United States11h ago
-
Sr. Data Engineer USD 150K-160KAWS | Agile | Automated testing | Big Data | Continuous integrationRemote workSenior-level Full TimeWork from home, VA, United States11h ago
-
Data Visualization Engineer USD 102K-127KAI | Access Control | Data Governance | Data Modeling | Data StudioBereavement | Dental insurance | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States12h ago
-
Data Engineer IV USD 110K-155KAWS | Azure | Azure Data | Azure Data Factory | CI/CD401k | Accident insurance | Continuing education assistance | Critical illness insurance | Employee assistance programSenior-level Full TimeNorthern Virginia, VA; Northern Virginia, VA; …12h ago
-
Data Engineer III USD 95K-130KAWS | Azure | Azure Data | Azure Data Factory | CI/CD401k | Accident insurance | Continuing education assistance | Critical illness insurance | Employee assistance programSenior-level Full TimeNorthern Virginia, VA; Northern Virginia, VA12h ago
-
Data Engineer II USD 75K-105KData Pipelines | Data Quality | Data Validation | Data Warehousing | Data integration401k | Accident insurance | Continuing education support | Critical illness insurance | Employee assistance programEntry-level Full TimeNorthern Virginia, VA; Northern Virginia, VA; …12h ago
-
Azure Data | Azure Data Factory | Azure DevOps | Azure Machine Learning | CI/CDRemote | USC OnlySenior-level Full TimeDallas, TX. R13h ago
-
Data Scientist / Machine Learning Engineer USD 110K-150KAPIs | Agile | CI/CD | Computer Vision | Continuous Deployment401k | Dental insurance | Flexible spending account | Health insurance | Life and AD&D insuranceMid-level Full TimeSan Diego, California; San Diego, CA; …13h ago
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R13h ago
-
Sr. AI Developer, Engineering USD 150K-189K.NET | AI Evaluations | APIs | Adobe Experience | Adobe Experience CloudSenior-level Full TimeChicago, IL, United States13h ago
-
AI Agents | AI Workflow Orchestration | AI workflow | AWS | AWS LambdaDental | Medical | Paid time off (PTO) | Remote work | RetirementSenior-level Full TimeLos Angeles, CA, United States13h ago
-
AWS Lambda | AWS Step Functions | Amazon Web Services | Anthropic | Cloud IntegrationsDental insurance | Medical insurance | Paid time off | Remote work | Retirement benefitsMid-level Full TimeIrvine, CA, United States13h ago
-
AUTOSAR | C++ | CAN | DaVinci Developer | Hardware-in-the-loopSenior-level Full TimeDearborn, United States15h ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R16h ago
-
Artificial Intelligence Machine Learning Engineer USD 98K-163KArtificial Intelligence | CI/CD | Docker | Elasticsearch | FastAPIHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn16h ago
-
AI Software Engineer USD 260K-260KAI Search | API Integration | Agent Orchestration | Azure AI | Azure AI SearchCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysSenior-level Full TimeTexas-Dallas-5323 Harry Hines Blvd16h ago
-
Compression | Data Engineering | Data Pipelines | Distributed Systems | High AvailabilitySenior-level Full TimeSan Jose, California, United States16h ago
-
Senior Production Engineer - Applied Machine Learning USD 218K-480KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDSenior-level Full TimeSan Jose, California, United States16h ago
-
Data Scientist Graduate (Multimedia) - 2027 Start USD 128K-177KA/B | A/B Testing | B testing | Causal Inference | Data MiningEntry-level Full TimeSan Jose, California, United States16h ago
-
DPO | DeepSpeed | Distributed Training | Evaluation Pipelines | Human preference learningEntry-level Full TimeSan Jose, California, United States16h ago
-
Senior Data Engineer (Multiple Positions) USD 220K-387KApache Flink | Apache Spark | Architecture Design | Data Governance | Data ModelingSenior-level Full TimeSan Jose, California, United States16h ago