Lead Data Engineer
USA DC Home Office (DCHOME), United States
R
USD 128K-173K Senior-level Full Time
Tasks
- Build reusable analytics data services
- Deploy pipelines using CI CD tooling
- Design build test maintain data pipelines
- Develop data ingestion and transformation logic near real time and batch
- Develop scalable secure cloud data platform
- Engineer data integration patterns
- Execute data migration archival and disaster recovery strategy
- Implement ETL/ELT pipelines
- Implement data quality controls
- Implement infrastructure as code for data provisioning
- Integrate pipelines with messaging and storage components
- Lead data engineers review designs ensure standards
- Maintain technical documentation runbooks
- Monitor & optimize database performance
- Support failover testing and DR drills
- Support incident resolution and root cause analysis
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | CI/CD | Data Analysis | Data Governance | Data Lake | Data Quality | Data Warehousing | Data analytics | Data orchestration | Database performance | Database performance tuning | Databricks | ELT | ETL | Indexing | Infrastructure as Code | Metadata Management | Performance Tuning | Python | Query Optimization | SQL | Scrum | Snowflake | Streaming Data | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R29d ago
-
Data Engineer USD 81K-105KAPIs | AWS | Azure | Cloud Data | Cloud Data Platforms401k match | Full-flex work week | Health and wellness benefits | Hybrid work schedule | Life insuranceMid-level Full TimeUSA VA Falls Church - 3150 … R9h ago
-
AI Engineer I USD 90K-119KAPI Integration | Azure | CI/CD | Chroma | Docker401k match | Dental insurance | Holidays | Medical insurance | Personal Time OffEntry-level Full TimeRemote, CA, USA R11h ago
-
Sr. Software Engineer, Data Products USD 105K-175KAPI Design | Apache Airflow | Asynchronous processing | Backend Development | Backward Compatibility401k retirement savings plan | Adoption Assistance | Charitable gift program | Company holidays | Dental insuranceSenior-level Full TimeChicago, Illinois, United States R12h ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R14h ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R14h ago
-
Fullstack Engineer, Embedded Wallet USD 177K-230KAPI Design | Backward Compatibility | Blockchain Signing | Blockchain Transactions | Blockchain integrationDistributed team collaboration | Flexible, distributed work environment | Remote work optionSenior-level Full TimeUnited States R16h ago
-
Data Architect (Hybrid - St. Paul, MN) USD 130K-174KAccess Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | W2 employmentSenior-level Full TimeSt Paul, Minnesota R16h ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R17h ago
-
Staff Engineer, Query Optimization USD 151K-297KAlgorithms | Backend Engineering | C++ | Code Quality | Compilers401k plan | Employee stock purchase program | Fertility and adoption assistance | Flexible paid time off | Health benefitsSenior-level Full TimeUnited States R18h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeBaltimore, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeHouston, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Kafka | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeWest Palm Beach, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJersey City, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Amazon SageMaker | Amazon SageMaker Studio | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | Airflow | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeFort Lauderdale, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeChicago, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBoston, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeAustin, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Professional growth | Remote and office optionsSenior-level Full TimePort Charlotte, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | Big DataFlexible schedule | Mentorship | Remote work options | TechtalksSenior-level Full TimeSan Francisco, United States R19h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Advanced SQL | Advanced SQL optimization | AirflowFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Remote work optionSenior-level Full TimeAtlanta, United States R19h ago