Senior Lead Data & AI Engineer
Malvern, PA, United States
USD 159K-210K (estimate) Senior-level Full Time
Tasks
- Architect data and AI engineering frameworks
- Automate AI workflow deployment
- Deploy Delta Live Tables pipelines
- Develop RAG based AI agents
- Enable reusable data products and modular pipelines
- Implement data governance and metadata management
- Implement event driven real time inference and deployment
- Integrate real time data streams with AI agents
- Monitor scale and manage AI agent lifecycles
- Orchestrate AI agent workflows
- Provide AI observability
- Schedule and monitor AI agent jobs
- Standardize ingestion transformation and feature engineering
Perks/Benefits
Skills/Tech-stack
AI Observability | AWS EventBridge | AWS Glue | AWS SageMaker | AWS Step Functions | Amazon Bedrock | Data Governance | Data Modeling | Databricks | Databricks Workflows | Declarative Pipelines | Delta Live Tables | Delta Live) | Event Driven | Event-driven architecture | Graph RAG | Lakeflow | Lakehouse Architecture | Langgraph | MWAA | Metadata Management | RAG | Step Functions | Unity Catalog
Education
N/A
Roles
AI | AI Engineer | Data Engineering | Engineer | Engineering | Learning Engineer | Machine Learning Engineer
Regions
Countries
States
Cities
Related jobs
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Data Management401k match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeSanta Clara, CALIFORNIA, United States5h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R9h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R10h ago
-
Senior-level Full TimeCanada R10h ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R12h ago
-
Senior Applied AI Engineer CAD 144K-165KAI SDK | AWS ECS | AWS ECS Fargate | AWS Key Management Service | AWS LambdaSenior-level Full TimeCanada12h ago
-
Analytics Engineer USD 150K-190KDBT | Data Governance | Data Modeling | Data Monitoring | Data Pipelines401k | Catered lunches | Dental insurance | Equity | Free coffee snacksMid-level Full TimeNYC Office12h ago
-
Sr. Software Engineer - Analytics USD 160K-215KAPI Design | Computational Linguistics | Data Modeling | Elasticsearch | Java401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSomerville, MA13h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R14h ago
-
Practice Manager - AI & Data USD 160K-190KAWS | Agent systems | Amazon SageMaker | Apache Spark | AzureCareer growth opportunities | Comprehensive benefits | MentorshipSenior-level Full TimeBroomfield, CO. Greensboro, NC. Troy, Michigan15h ago
-
Senior-level Full TimeIrving, TX15h ago
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R16h ago
-
Senior Healthcare Data Engineer USD 104K-199KConditional Aggregation | Data Modeling | Data Quality | Data Reconciliation | Data Validation401k matching | Employee assistance program | Family building benefits | Flexible spending accounts | HolidaysSenior-level Full TimeSeattle, Washington, United States R17h ago
-
Data Engineer USD 130K-165KAPI Development | Airflow | Amazon Redshift | Amazon S3 | AvroCollaborative work environment | Dental insurance | Equity | Health insurance | Retirement benefitsMid-level Full TimeWilmington, MA18h ago
-
AI Engineer (GenAI & Integration) USD 130K-181KAI Agents | AI Governance | API Integration | Automation workflows | DeploymentMid-level Full TimeCenter, Center District, IL19h ago
-
Data Engineer USD 105K-130KAPIs | Data Governance | Data Modeling | Data Monitoring | Data Quality401k employer matching | Childcare reimbursement | Company events social hours | Company paid parking or MTS pass | Fertility treatment coverageSenior-level Full TimeSan Diego, CA, United States19h ago
-
Senior-level Full TimeCedar Falls, IA, US20h ago
-
Lead Data Engineer – Snowflake USD 170K-216KAmazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited States20h ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k retirement plan | Disability coverage | Employee assistance program | Flexible spending account | Medical/Dental/Vision insuranceMid-level Full TimeUS - Remote R21h ago
-
Data Engineer III USD 134K-161KAccess Control | Analytics Cloud | Data Governance | Data Marts | Data Quality401k | Adoption Assistance | Dental insurance | Education reimbursement | FSASenior-level Full TimeIrvine, CA21h ago
-
Databricks Data Engineering Manager USD 151K-252KAgent Bricks | Business Intelligence | Data Architecture | Data Governance | DatabricksTravel up to 25 percent | US government security clearance processMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …21h ago
-
Generative AI Data Engineer III USD 131K-218KAlgorithm Development | Artificial Intelligence | Data Analysis | Data Modeling | Data PipelinesMentorship | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; New York, …21h ago
-
Sr. Data Engineer - Data Engineer III USD 125K-198KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimePhiladelphia, Pennsylvania, United States21h ago
-
APIs | CI/CD | Cloud platform | Compliance | ContainersAnnual leave | Dental coverage | Health coverage | High autonomy | Home office setup supportSenior-level Full TimeCanada R22h ago
-
A/B | A/B Testing | Asynchronous programming | B testing | Canary ReleasesEngineering autonomy | Inclusive work environment | Mentorship | Remote-first flexibility | Technical leadership developmentSenior-level Full TimeCanada22h ago