Lead Data Engineer
South Carolina, South Carolina, United States
A USD 148K-200K (estimate) Senior-level Full Time
Tasks
- Build CI/CD pipelines and infrastructure as code
- Build data lakes and warehouses
- Define data engineering best practices and governance
- Design data pipelines
- Develop AWS data solutions
- Drive data quality lineage and observability
- Ensure security and compliance
- Implement real-time and batch processing
- Lead data engineering team
- Optimize data models for analytics reporting and machine learning
- Provide technical guidance and code reviews
- Support investment analytics risk and regulatory reporting
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Airflow | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | CI/CD | CloudFormation | Data Governance | Data Lineage | Data Modeling | Data Quality | ELT | ETL | FINRA | KYC | Kafka | Observability | Pandas | Prefect | PySpark | Python | SEC | SQL | Snowflake | Terraform
Education
N/A
Roles
Architect | Data Architect | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Architectural components | C plus plus | CSS | Convolutional Neural Networks | Generative AISenior-level Full TimeSan Francisco, CA, USA; Sunnyvale, CA, …1h ago
-
C++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …1h ago
-
BigQuery | Cloud platform | Data Processing | Data Warehousing | DebuggingSenior-level Full TimeKirkland, WA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 174K-252KC++ | Code review | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeKirkland, WA, USA1h ago
-
Senior AI Solutions Architect (Azure) USD 120K-150KAI Search | API Integration | Access Management | Azure AI | Azure AI Search401k savings plan | Health and income protection benefits | Paid vacationSenior-level Full TimeWadsworth, TX, US, 774835h ago
-
Lead Data Architect USD 180K-209KAmazon Kinesis | Apache Beam | Apache Flink | Apache Kafka | Apache SparkChallenging projects | Collegial culture | Flex work | Flexible work | Health benefitsSenior-level Full TimeAtlanta, US5h ago
-
Senior Software Engineer - Production Control Plane USD 200K-287KAmazon Web Services | Azure | C++ | CI/CD | Cloud platformSenior-level Full TimeUS-CA-Menlo Park10h ago
-
Staff Systems Analyst – Robotic Algorithms and Control USD 147K-201KC# | C++ | Classical control | Control System | Control system designSenior-level Full TimeSunnyvale, CA, United States10h ago
-
Associate AI/ML Engineer USD 100K-215KAzure Data | Azure Data Lake | Azure Machine Learning | Azure Synapse | Azure Synapse AnalyticsHealthcare benefits | Hybrid work environmentMid-level Full TimeColumbia, MD, US11h ago
-
Mid-level Full TimeMentor, OH, US12h ago
-
AI Search | AWS | Azure | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Machine Learning Engineer, Discovery Recommendations USD 157K-230KA/B | A/B Testing | AWS | Apache Spark | B testing401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States13h ago
-
Senior Staff Data Platform Architect USD 233K-350KAI/ML | CCPA | Cloud Computing | Cost Optimization | DBT401k matching | Dental insurance | Employee recognition programs | Flexible time off | Healthcare benefitsSenior-level Full TimeSan Francisco, CA14h ago
-
Staff Software Engineer, Data Platform USD 248K-279KArchitectural Design | Cost Optimization | Data Governance | Data Infrastructure | Data TransformationSenior-level Full TimeSan Francisco, CA14h ago
-
API | Angular | C# | C++ | Celery401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA14h ago
-
Data Modeling | Deep learning | Ecommerce | Fine Tuning | Human-in-the-loopEquity | Health benefits | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA R14h ago
-
Deployment Engineer - Commercial Site Team USD 120K-180KConfluence | Industrial Automation | Jira | Linux | Project ManagementCustomer site work experience | Travel opportunitiesMid-level Full TimeReno, NV14h ago
-
Software Engineer – Surgical Robot Manufacturing USD 125K-192KHTML | JSON | JavaScript | Linux | MATLABMid-level Full TimeSunnyvale, CA, United States15h ago
-
Senior Data Engineer USD 115K-145KAWS S3 | Airflow | Azure Blob | Azure Blob Storage | Blob Storage401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R15h ago
-
Senior Software Engineer, GenAI Platform USD 164K-259KAgent Engineering | Architectural Design | Backend Development | Code review | Language Models401k match | Backup child elder and pet care | Community time off stipend | Company-paid days off | Dental insuranceSenior-level Full TimeSan Francisco, CA, USA15h ago
-
Solutions Architect, Applied AI (Commercial) USD 240K-315KClaude API | Cloud Architecture | Data Science | Enterprise systems | Evaluation FrameworksSenior-level Full TimeSan Francisco, CA | New York …15h ago
-
Robotics ML Expert, AI USD 60K-60KControl Systems | Dm_control | Domain Randomization | Gymnasium Robotics | JAXAsync collaboration | Flexible schedule | Remote workSenior-level Full TimeMiami R15h ago
-
BI Data Engineer (Remote WA, OR, ID & CA) USD 88K-116KAzure Synapse | C# | DAX | Data Governance | Data Modeling401k match | Health insurance | Paid Holidays | Paid vacation | Sick timeMid-level Full TimeBellevue, Washington R15h ago
-
Director of Safety Data Analysis USD 182K-219KCI/CD | Code review | Data Visualization | Experimental Design | Machine Learning401k employer match | Disability insurance | Flexible schedule | Holiday office closures | Life insuranceExecutive-level Full TimeRemote - US, Ann Arbor, MI R15h ago
-
Senior ML Engineer USD 198K-291K3D Vision | AWS | Agile | Cloud ML | Computer Vision401k | Dental insurance | Health insurance | Mental health program | Paid breaksSenior-level Full TimeCary,North Carolina,United States15h ago