Lead Data Engineer, Applied AI Data Ingestion & Integration (DII)
Tasks
- Communicate technical risks and recommendations to stakeholders
- Design scalable data ingestion pipelines for structured semi structured unstructured and multimodal data
- Develop analytical frameworks and KPIs for data platform effectiveness
- Develop production grade Python services for AI and RAG
- Drive automation operational efficiency and scalability improvements
- Ensure data governance access control and security standards
- Establish and monitor data quality standards controls and metrics
- Evaluate chunking indexing retrieval and data preparation strategies for RAG
- Lead cross functional initiatives from discovery through production
- Lead data ingestion and integration pipelines
- Mentor engineers and provide technical guidance
- Monitor pipeline performance troubleshoot failures and optimize cost and throughput
- Prepare validate and optimize datasets for machine learning and generative AI
- Support data lineage metadata management and data cataloging
- Translate business needs into data requirements and integration strategies
Perks/Benefits
Skills/Tech-stack
AI Search | Agile | Azure AI | Azure AI Search | Azure Data | Azure Data Factory | CI/CD | Data Cataloging | Data Factory | Data Governance | Data Ingestion | Data Lineage | Data Quality | Data Warehousing | Data integration | ELT | ETL | Generative AI | JSON | MLOps | Machine Learning | Metadata Management | Power BI | Python | RAG | REST API | SQL | Tableau | Vector Databases | XML
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Visualization Engineer - Advanced Engineering USD 86K-106KAccess Control | Change Management | Client-Server | Cybersecurity | Data GovernanceMid-level Full TimeHeath, OH, United States4h ago
-
Senior Software Engineer, Data Engineering USD 243K-295KAWS | Apache Airflow | Apache Spark | Azure | Cloud ComposerSenior-level Full TimeSan Mateo, CA, United States R5h ago
-
Lead AI Engineer-Machine Learning USD 100K-115KAWS | Agile | Azure | CI/CD | Computer Vision401k match | Dental insurance | Disability insurance | Growth opportunities | HolidaysSenior-level Full TimeParsippany, NJ, United States5h ago
-
Senior Embedded Software Engineer USD 125K-160KAMD Xilinx | ARM Cortex | C# | Digital Signal | Digital Signal Processing401k match | Dental insurance | Employee assistance program | Every other Friday off | HSA/FSASenior-level Full TimeCamarillo, CA, United States6h ago
-
Mechanical Robotics Engineer USD 99K-149KAutoCAD | Cause analysis | Condition Monitoring | Current Signature Analysis | DeviceNet401k company match | Health care benefits | Paid Holidays | Paid sick leave | Paid vacationMid-level Full TimeLincolnton, NC, United States6h ago
-
Data Engineer Stf - E4 USD 131K-243KAccess Control | Apache NiFi | Apache Spark | Data Modeling | Data Processing401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeFort Worth, TX, US6h ago
-
Enterprise Analytics Lead USD 119K-222KABAP | Access Control | Analysis Services | Analytics Cloud | Azure SynapseExtra day off every other week | Flexible 9/80 schedule | In office with flexible scheduleSenior-level Full TimePortsmouth, NH, United States8h ago
-
Data Engineer USD 126K-208KAPI Integration | AWS | Airflow | Azure | BigQueryDEI initiatives | Dental insurance | Employee rewards and recognition | Medical insurance | Mental health supportMid-level Full TimeRemote, United States8h ago
-
Data Analytics Engineer USD 126K-208KAmazon Web Services | Azure Data | Azure Data Factory | Azure Data Lake | Cloud platformDEI initiatives | Mental health support | Retirement plans | Rewards and recognition | Sustainability initiativesSenior-level Full TimeRemote, United States8h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401K Profit Share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States8h ago
-
AWS | Automated testing | Cloud Native | Cloud-native development | Columnar DatabasesCompany stock plan | Educational reimbursement | Unlimited vacation | Wellness reimbursementSenior-level Full TimeReno, NV; San Ramon, CA; New … R9h ago
-
AWS | Amazon Web Services | Argo CD | Docker | ElasticsearchFlexible work schedule | Referral bonusesMid-levelLaurel, Maryland9h ago
-
AI Agents | Data Pipelines | Docker | Elasticsearch | KubernetesFlexible work schedule | Referral bonusesSenior-levelColumbia, Maryland9h ago
-
Computer Scientist II USD 85K-100KAgile | Angular | Azure DevOps | C Sharp | CI/CD401k match | Dental insurance | Disability insurance | Health savings account | Life insuranceMid-level Full TimeLas Vegas, NV, United States10h ago
-
Computer Scientist - openMCT USD 135K-165KBrowser Developer Tools | CSS3 | Data Visualization | Developer tools | Git401k matching | Dental insurance | Disability insurance | Flexible spending account | Health savings accountMid-level Full TimeEdwards AFB, CA, United States10h ago
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Computing401k match | Disability insurance | Health benefits on day 1 | Health savings account | Life insuranceSenior-level Full TimeEdwards AFB, CA, United States10h ago
-
Entry-level Full TimeLas Vegas, NV, United States10h ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 148K-205KAI Foundry | AWS | AWS Bedrock | Artificial Intelligence | AutogenSenior-level Full TimeMiami Lakes, FL, United States10h ago
-
Data Analytics Engineer USD 98K-124KAWS | AWS Glue | Adobe Analytics | Amazon Athena | Amazon CloudWatchMid-level Full TimeMiami Lakes, FL, United States10h ago
-
Cloud Data Engineer II USD 107K-150KAPI Integration | AWS | AWS Glue | AWS Step Functions | Apache AirflowMid-level Full TimeMiami Lakes, FL, United States10h ago
-
Bearer tokens | Build Packaging | CSRF Protection | Composition API | Dependency managementEmployee stock purchase plan | Equity compensation plan | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, United States R10h ago
-
Senior Backend Engineer, Experimentation USD 182K-263KA/B | A/B Testing | APIs | Alerting | B testingDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R10h ago
-
Biometrics | C++ | Computer Vision | Machine Learning | Multimodal LearningOffice three days per week | Relocation assistanceMid-level Full TimeSan Francisco R11h ago
-
Software Engineer - Backend Platform USD 140K-205KAPI Design | AWS | Cloud platform | Databases | Distributed SystemsComprehensive health coverage | Coworking stipend | Equity | Flexible savings accounts | Remote workMid-level Full TimePalo Alto, California, United States R11h ago
-
AWS | AWS Glue | AWS Lambda | Alerting | Amazon AthenaCareer growth | Flexible work arrangements | Inclusive team culture | Mentorship opportunities | Work-life balanceSenior-level Full TimeAustin, Texas, USA12h ago