Lead Data Engineer
Tasks
- Define and enforce data engineering best practices
- Evaluate Fabric roadmap features for adoption
- Implement CI CD strategy for Fabric artifacts
- Lead end to end design and development of data pipelines
- Mentor data engineers and conduct code reviews
- Monitor and optimize pipeline performance cost and capacity
- Orchestrate ETL and ELT pipelines
- Translate business requirements into technical designs
Perks/Benefits
Skills/Tech-stack
Azure DevOps | Azure RBAC | Azure Synapse | Azure Synapse Pipelines | CI/CD | Data Factory | Data Governance | Data Lakehouse | Data Quality | Data Warehouse | DataOps | Dimensional Modeling | Git | Infrastructure as Code | Microsoft Fabric | Power BI | PySpark | Python | SQL | Spark | Synapse Pipelines | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Senior-level Full TimeMcLean, VA; McLean, VIRGINIA; McLean, VIRGINIA; …7h ago
-
Senior-level Full TimeMcLean, VIRGINIA7h ago
-
Data Engineer (Expert) WA07 USD 133K-238KData Mapping | Data Modeling | Data Quality | Data Testing | ETLSenior-level Full TimeChantilly, Virginia7h ago
-
Data Engineer (Subject Matter Expert) WA28 USD 133K-238KApache NiFi | CSS | Data Modeling | Data Quality | ETLSenior-level Full TimeChantilly, VA7h ago
-
Data Engineer (Expert) WA12 USD 133K-238KApache NiFi | Data Mapping | Data Modeling | Data Quality | Data TestingSenior-level Full TimeMcLean, VIRGINIA7h ago
-
Data Engineer (Subject Matter Expert) CK16 USD 133K-238KApache NiFi | C# | C++ | Cloud Computing | Data MappingCompetitive benefits packageSenior-level Full TimeMcLean, VIRGINIA7h ago
-
System Engineer- Storage (Expert) TI28 USD 100K-150KActive Directory | Auditing | Backup and Recovery | Bash | Capacity PlanningSenior-level Full TimeMcLean, VIRGINIA7h ago
-
Mid-level Full TimeMcLean, VIRGINIA7h ago
-
Data Compliance | Database Design | Database performance | Database performance tuning | Database securityDental insurance | Health insurance | Professional development opportunities | Retirement savings plan | Vision insuranceSenior-level Full TimeChantilly, VA; Springfield, VA; Springfield, VA; …7h ago
-
API Integration | Cloud Computing | Dashboards | Data Architecture | Data GovernanceMid-level Full TimeFalls Church, VA; Falls Church, VA7h ago
-
Data Engineering | ETL | MongoDB | Object-Oriented | Object-oriented programmingSenior-level Full TimeChantilly, VA; Reston, VA; Chantilly, VA7h ago
-
AI Engineer II - Active TS/SCI w/poly clearance USD 113K-190KC# | Data Engineering | Data Governance | Data Modeling | Data StructuresDental insurance | Disability insurance | Educational assistance | Employee assistance program | Health insuranceMid-level Full TimeAnnapolis Junction, Maryland7h ago
-
Software Engineer 3 – AI/ML USD 113K-279KAWS | Artificial Intelligence | Azure | Docker | ElasticsearchAgile environment collaboration | Partial teleworkSenior-level Full TimeAnnapolis Junction, MD7h ago
-
Senior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …7h ago
-
Software Engineer USD 113K-279KApache Pig | Apache Spark | Continuous Monitoring | Data Ingestion | Data QualitySenior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …7h ago
-
Database Engineer II USD 124K-208KAWS | Agile | Confluence | Django | Docker401k match | Dental insurance | Health insurance | Immediate 401k vesting | Paid time offSenior-level Full TimeLinthicum, MD7h ago
-
Database Engineer III USD 124K-208KCloud Computing | Continuous Monitoring | Data Modeling | Data Storage | Database ArchitectureActive TS SCI clearance with polygraph | Benefits packageSenior-level Full TimeLinthicum, MD; Linthicum Heights, MD7h ago
-
Mid-level Full TimeSuitland, MD; Annapolis Junction, Maryland; Crystal …8h ago
-
Systems Engineer - Modeling and Algorithms USD 112K-160KC# | C++ | Data Analysis | Digital System | Digital system modelingSenior-level Full TimeHuntsville, Alabama; Annapolis Junction, Maryland8h ago
-
Apache Tika | Data Visualization | Language Processing | Machine Learning | MbseMid-level Full TimeAnnapolis Junction, Maryland8h ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R8h ago
-
Aerospike | Ansible | Capacity Planning | Ceph | Configuration ManagementSenior-level Full TimeRemote, Canada; Toronto, Ontario; San Francisco, … R8h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R8h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R8h ago