Lead Software Engineer - Databricks/PySpark/AI
Wilmington, DE, United States
USD 170K-185K (estimate) Senior-level Full Time
Tasks
- Build and maintain tool use infrastructure
- Build and optimize data pipelines and workflows
- Build orchestration and state management for agent workflows
- Collaborate with product owners and data scientists to deliver AI solutions
- Conduct code reviews and raise engineering standards
- Deploy production code using CI CD pipelines
- Develop data retrieval and indexing layers
- Evaluate and adopt agentic AI frameworks and data engineering practices
- Implement data management best practices
- Mentor junior engineers through pairing and coaching
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS Glue | AWS Lambda | Agile | Amazon S3 | Amazon SNS | Amazon SQS | Automated testing | CI/CD | Cost Optimization | Data Compliance | Data Governance | Data Observability | Data Quality | Data Security | Data Services | Databricks | Delta Lake | Embeddings | LLM | Monitoring | Observability | Orchestration | PySpark | Python | Query Optimization | Retrieval-Augmented Generation | SQL | Snowflake | Spark | State management | Terraform | Vector Databases | Vector Search
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
AI Solutions Specialist USD 113K-197KAI Search | API Development | Azure AI | Azure AI Search | Azure FunctionsHybrid work scheduleMid-level Full TimeKansas City, MO, United States2h ago
-
Software Development Engineer-AI/LLM Network-Global Frontier Tech Recruitment Program-2027 Start (PhD) USD 212K-450KAI | C++ | Cause analysis | Fault Localization | High PerformanceEntry-level Full TimeSan Jose, California, United States6h ago
-
Senior-level Full TimeUSA-VA-Chantilly6h ago
-
Senior-level Full TimeUSA-VA-Chantilly6h ago
-
Data Science Intern - Machine Learning USD 51K-85KA/B | A/B Testing | Artificial Intelligence | B testing | Computer VisionHybrid workEntry-level InternshipUSA-VA-Herndon6h ago
-
Data Science Intern - AI Focus USD 53K-89KAgents | Artificial Intelligence | Data Modeling | ETL | EmbeddingsEntry-level InternshipUSA-VA-Herndon6h ago
-
Architectural components | C plus plus | CSS | Convolutional Neural Networks | Generative AISenior-level Full TimeSan Francisco, CA, USA; Sunnyvale, CA, …8h ago
-
C++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …8h ago
-
BigQuery | Cloud platform | Data Processing | Data Warehousing | DebuggingSenior-level Full TimeKirkland, WA, USA8h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 174K-252KC++ | Code review | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeKirkland, WA, USA8h ago
-
Azure Data | Azure Data Factory | Cloud Data | Cloud Data Architecture | Data ArchitectureCross-functional collaboration | Remote workMid-level Full TimeSan Francisco, United States of America R17h ago
-
Senior Software Engineer - Production Control Plane USD 200K-287KAmazon Web Services | Azure | C++ | CI/CD | Cloud platformSenior-level Full TimeUS-CA-Menlo Park17h ago
-
Staff Systems Analyst – Robotic Algorithms and Control USD 147K-201KC# | C++ | Classical control | Control System | Control system designSenior-level Full TimeSunnyvale, CA, United States17h ago
-
AI/Machine Learning Engineer Intern USD 50K-52KAPIs | Artificial Intelligence | Benchmarking | Cybersecurity | Data evaluationFun events | Leadership speaker series | Mentorship | Professional networking | Training and developmentEntry-level InternshipUnited States - Remote R17h ago
-
Associate AI/ML Engineer USD 100K-215KAzure Data | Azure Data Lake | Azure Machine Learning | Azure Synapse | Azure Synapse AnalyticsHealthcare benefits | Hybrid work environmentMid-level Full TimeColumbia, MD, US18h ago
-
ETL Developer (SR-5269058-DEV) USD 102K-160KAPI Integration | AWS Glue | Agile | Audit Logging | Azure DataAgile Scrum team environment | Remote work | Technical documentation and trainingEntry-level Full TimeBaton Rouge, LA, US18h ago
-
Software Development Engineer (SASE) USD 123K-151KC# | C++ | CASB | Cloud Computing | Continuous Delivery401k | Dental insurance | Disability insurance | Health insurance | Leave ProgramSenior-level Full TimeSanta Clara, CA, United States18h ago
-
Mid-level Full TimeMentor, OH, US18h ago
-
Sr. Principle Global Industrial Analytics Engineer USD 114K-171KAWS | Artificial Intelligence | Azure | Closed Loop | Closed loop controlCareer development opportunities | Flexible time off | Health insurance | Life insurance | Retirement planSenior-level Full TimeFort Worth - Main, United States19h ago
-
Tableau Developer Lead USD 107K-195KAgile | DAX | Dashboard Optimization | Data Governance | Data ModelingRemote workSenior-level Full Time6314 Remote/Teleworker US, United States R19h ago
-
AI Search | AWS | Azure | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States19h ago
-
Machine Learning Engineer, Discovery Recommendations USD 157K-230KA/B | A/B Testing | AWS | Apache Spark | B testing401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States19h ago
-
Data Science -Application Development in Production Management (Tableau Developer) - Irving USD 36K-126KAPI Development | Big Data | Data Aggregation | Data Blending | Data Cleansing401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States20h ago
-
Data Science - Senior Engineer in Production Management (Big Data - Snowflake Focused) - Irving USD 36K-126KAWS | Algorithms | Amazon CloudFormation | CI/CD | Cloud infrastructure401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States20h ago
-
Staff Software Engineer, Data Platform USD 248K-279KArchitectural Design | Cost Optimization | Data Governance | Data Infrastructure | Data TransformationSenior-level Full TimeSan Francisco, CA21h ago