Staff Data Engineer (Scala, Spark, & Gen AI)
Tasks
- Architect and lead scalable fault tolerant data pipelines
- Implement vector database and embeddings pipelines
- Improve data quality observability and system health
- Integrate generative AI and LLMs into data products
- Mentor engineers and lead technical design reviews
- Optimize ETL and ELT workflows using Spark
Perks/Benefits
- 24 7 counseling services
- 401k
- Catered lunch
- Commuter FSA
- Disability insurance
- Flexible-hybrid work
- Generous PTO
- Health FSA
- Life insurance
- Paid maternity/paternity leave
- Social events
- Stock options
- Team offsites
- Travel assistance program
Skills/Tech-stack
AWS | AWS Glue | Amazon Athena | Amazon Bedrock | Amazon S3 | Apache Airflow | Apache Spark | Data Modeling | ELT | ETL | Embeddings | LLMs | OpenAI API | Python | Query Optimization | RAG | Retrieval-Augmented Generation | SQL | Scala | Vector Databases
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Software Engineer USD 107K-150KAWS | Agile | Datadog | GitHub | GitHub ActionsOn-call rotation | Remote workSenior-level Full TimeCosta Mesa, CA, United States R11h ago
-
AI Engineer USD 109K-140KAgent Orchestration | Computer Vision | Data Validation | Data extraction | Document ClassificationMid-level Full TimeMorristown, NJ, United States11h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeExposure to real-world projects | Learning and development opportunities | MentorshipEntry-level InternshipBoston, MA, United States11h ago
-
Summer 2026 Data Engineer USD 41K-50KAPIs | Agile | Azure Data | Azure Data Factory | Azure Data LakeMentorshipEntry-level InternshipBoston, MA, United States11h ago
-
Early-Career Network Engineer (RAN Optimization) USD 85K-130K4G | 5G | Automation | C Band | CBRS401k match | Dental insurance | Disability insurance | Educational assistance | Financial wellness programsMid-level Full TimePlano,Texas,United States R11h ago
-
Senior Embedded Software Engineer USD 146K-196KARM Cortex | C# | Digital Signal | Digital Signal Processing | Embedded Linux401k match | Dental insurance | Employee assistance program | FSA | Flexible scheduleSenior-level Full TimeCamarillo, CA, United States11h ago
-
Data Engineer USD 126K-208KAPI Integration | Airflow | Amazon Web Services | BigQuery | CCPADEI initiatives | Dental benefits | Employee rewards program | Medical benefits | Mental health supportMid-level Full TimeRemote, United States R11h ago
-
Lead Data Engineer USD 115K-125KAI Automation | Agile | Cloud Data | Cloud Data Platforms | Data Modeling401k | Commuter benefits | Dental insurance | Disability coverage | EAPSenior-level Full TimeColumbia, MD, United States13h ago
-
Alerting | Ansible | Bash | CI/CD | CephRemote workSenior-level Full TimeUnited States, United States R13h ago
-
Ansible | Bash | CI/CD | CentOS | CephContract-to-hire | No sponsorship | Remote workSenior-level Full TimeUnited States, United States R13h ago
-
HPG Big Data Engineer / Senior-Level USD 119K-164KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure FunctionsSenior-level Full TimeNashville, TN, United States13h ago
-
kdb+ Contractor (Capital Markets) USD 150K-200KAWS | Azure | Electronic Trading | GCP | Kdb PlusContract opportunities | On site work 5 days per week | Permanent opportunitiesSenior-level ContractNew York, NY, United States14h ago
-
Senior kdb+ Engineer USD 150K-200KAI Tooling | AWS | Azure | Capital Markets | Electronic TradingFlexible holiday allowance | Healthcare and wellbeing | Hybrid working | Leadership development | Paid certificationsSenior-level Full TimeNew York, NY, United States14h ago
-
Platform and Integrations Engineer USD 100K-200KAnthropic | GraphQL | Next.js | Node.js | OpenAIIn-person work | Medical/Dental/Vision | Significant equity upsideEntry-level Full TimeSan Francisco, CA, US14h ago
-
Machine Learning Engineer USD 131K-178KAWS | Cassandra | Convolutional Neural Networks | Data Lakes | Data PipelinesMid-level Full TimeRemote, NY, US R14h ago
-
Senior Data Engineer (TS/SCI Clearance) USD 130K-220KData Visualization | Database performance | Database performance tuning | ETL | High PerformanceEmployee development | High employee morale | RetentionSenior-level Full TimeHuntsville, United States15h ago
-
Case design | Data Integrity | Database Testing | Database optimization | Defect ReportingSenior-level Full TimeAustin, TX R15h ago
-
Amazon S3 | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeNew York16h ago
-
Amazon S3 | Automation | Data Engineering | Data Modeling | Data Pipelines401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton16h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 119K-198KAPI Integration | AWS | Airflow | Azure | CI/CDTravelSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …16h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 189K-372KAPI Integration | AWS | Airflow | Apache Spark | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …16h ago
-
Lead AI and Data Solutions Engineer II USD 137K-229KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Cloud ComputingSenior-level Full TimeSacramento, California, United States; Tempe, Arizona, …16h ago
-
Data Engineer | TS/SCI Required USD 93K-155KApplication Security | Cloud Engineering | Data Management | Data Security | Full StackMid-level Full TimeTampa, Florida, United States16h ago
-
Databricks Senior Consultant USD 113K-188KAWS | Azure | Business Intelligence | Cloud platform | Data EngineeringSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …16h ago
-
AI & Data Supply Chain Engineer USD 116K-229KCapacity modeling | Data Modeling | Demand Planning | Enterprise Resource Planning | Inventory PlanningTravel 50%Mid-level Full TimeSeattle, Washington, United States16h ago