Lead Data Engineer
Atlanta Support Center, United States
USD 136K-185K (estimate) Senior-level Full Time
Tasks
- Build automated testing
- Collaborate with architects and data modelers
- Collaborate with product to gather business needs
- Define data quality rules
- Design build maintain data pipelines
- Develop data ingestion transformation storage and data management
- Develop deploy document AI solutions
- Document technical artifacts
- Enforce coding standards and produce production code
- Establish data engineering best practices
- Implement infrastructure-as-code
- Integrate AI trends to improve performance
- Lead data engineering team
- Manage data ingestion transformation distribution
- Mentor engineers and provide technical leadership
- Set up observability/monitoring
Perks/Benefits
Skills/Tech-stack
ADLS | AI Search | Agile | Apache Airflow | Automated testing | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure OpenAI | Blob Storage | CI/CD | Data Factory | Generative AI | Guardrails | Informatica | Infrastructure as Code | LLM Evaluation | LLMs | Observability | Prompt engineering | Pydantic AI | Python | RAG | SQL | Snowflake | Tableau | Talend | Temporal | Vector Search | “as-code”
Education
N/A
Roles
AI Engineer | Data Engineer | Data and AI Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Lead Data and AI Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R16d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R29d ago
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Platforms401k match | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeEdwards AFB, CA, United States6h ago
-
Senior-level Full TimeOrlando, FL, United States7h ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R9h ago
-
Senior-level Full TimeAtlanta, Georgia11h ago
-
.NET | AWS | Agile | Angular | AzureSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …11h ago
-
Agent Development | Agent Orchestration | Air-gapped | Air-gapped systems | Cloud ComputingOn-site work | Travel opportunitySenior-level Full TimeWashington D.C., DC, USA; Fort Meade, …12h ago
-
2D Games | 3D Games | Algorithms | Context Assembly | Data StructuresSenior-level Full TimeMountain View, CA, USA12h ago
-
Data Modeling | Database querying | Deep learning | Incrementality testing | Language ProcessingMid-level Full TimeNew York, NY, USA; Mountain View, …12h ago
-
Benchmarking | Computer Vision | Data Mining | Deep learning | Evaluation protocolsSenior-level Full TimeMountain View, CA, USA12h ago
-
Staff Software Engineer USD 110K-165KAWS | Airflow | Automated testing | Bedrock | CI/CDHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-235517h ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R23h ago
-
Senior Machine Learning Engineer, ML Efficiency USD 216K-303KBenchmarking | Cost Optimization | Distributed Training | GPU Training | Knowledge DistillationCaregiving support | Employer 401k match | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R23h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | Data Modeling | Data Pipelines | Database technologiesSenior-level Full TimeCupertino; San Diego23h ago
-
Software Engineer, SDLC Analytics USD 175K-300KApache Airflow | Apache Spark | CI/CD | Data Ingestion | Data ModelingSenior-level Full TimeCupertino; San Diego23h ago
-
Applied AI Engineer, GTM Growth Engineering USD 230K-385KAPIs | Data Modeling | Data Pipelines | Evaluation | ExperimentationMid-level Full TimeSan Francisco23h ago
-
Staff Software Engineer, Code RL USD 405K-625KAPI Design | Async Programming | Client Libraries | Concurrency | ContainerizationSenior-level Full TimeSan Francisco, CA | New York …23h ago
-
Edge Computing AI Engineer USD 100K-150KC++ | DSP Toolchains | Device optimization | Device security | Edge inferenceMid-level Full TimeUnited States - Remote R23h ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAutoscaling | Batching | C++ | Caching | Capacity PlanningSenior-level Full TimeUnited States - Remote R23h ago
-
Robotics Engineer USD 100K-150KC++ | Concurrent programming | Control | Gazebo | Isaac SimCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R23h ago