Lead Data Engineer
Tasks
- Collaborate with stakeholders to deliver analytics solutions
- Deploy and monitor data processing jobs
- Design machine learning pipelines batch and real time
- Develop data ingestion and transformation workflows
- Ensure data governance, security, and privacy compliance
- Implement data modeling feature engineering data quality validation
- Mentor junior engineers best practices
- Perform performance tuning on large scale pipelines
- Research and recommend emerging AI cloud and data technologies
- Troubleshoot and resolve production defects
Perks/Benefits
Skills/Tech-stack
AWS Athena | AWS Data | AWS Data Pipeline | AWS EMR | AWS Glue | AWS Redshift | Apache Spark | CI/CD | Data Modeling | Data Quality | Data pipeline | Deployment | DevOps | Feature Engineering | Hadoop | Hadoop MapReduce | Hive | Machine Learning | Microsoft SQL | Microsoft SQL Server | Monitoring | MySQL | NoSQL | Python | REST API | SQL | SQL Server | Scala | Testing | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R27d ago
-
Data Analytics Engineer USD 139K-230KAWS | Azure | Azure Data | Azure Data Lake | Cloud platformDEI initiatives | Dental insurance | Medical insurance | Mental health support | Remote workSenior-level Full TimeRemote, United States R1h ago
-
Data Engineer USD 126K-208KAPI Integration | APIs | AWS | Amazon Redshift | Apache AirflowDEI initiatives | Dental insurance | Employee recognition program | Medical insurance | Mental health supportMid-level Full TimeRemote, United States R1h ago
-
Data Engineer (Healthcare) USD 105K-130KAWS | AWS Redshift | Apache Airflow | Azure | Azure DataKnowledge sharing | Mentoring | Quarterly travel | Remote workMid-level Full TimeUSA, Remote; USA, Remote; USA, Remote R2h ago
-
ETL | Elasticsearch | JSON | Jupyter Notebooks | Kibana401k match | Paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R2h ago
-
Applied AI Intern USD 70K-80KArtificial Intelligence | C++ | Data-driven | Data-driven analysis | PythonCommuting Stipend | Team mealsEntry-level InternshipMountain View, CA, US4h ago
-
Applied AI Engineer USD 140K-220KAWS SageMaker | Agentic Workflows | C++ | Fine Tuning | Foundation Models401k | Dental insurance | Health insurance | Team meals | Vision insuranceEntry-level Full TimeMountain View, CA, US / San …4h ago
-
First ML engineer USD 150K-250KAudio Processing | Latency optimization | Machine Learning | PyTorch | Real TimeEquity | Ownership mindsetMid-level Full TimeFoster City, CA, US4h ago
-
Senior Engineer, Data Management USD 140K-150KAPI Development | AWS | Agile | Azure | Cloud platform401k | Dental insurance | Disability insurance | Employee assistance program | Life insuranceSenior-level Full TimeNew York, NY, United States4h ago
-
AI Model Deployment | AI model | Deep learning | Distributed Systems | GPU ComputingEntry-level Full TimeSan Jose, California, United States5h ago
-
Data Engineer III USD 97K-163KApache Spark | Data Modeling | Data Quality | Data integration | DatabricksAbility to work independently | Mentorship | Professional development | Travel opportunitiesSenior-level Full TimeBaltimore, Maryland, United States5h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …5h ago
-
Senior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …5h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL6h ago
-
Algorithms | C++ | Data Mining | Data Pipelines | Data StructuresDevelopment workshops | Learning programs | Mentorship | Social eventsEntry-level InternshipSeattle, Washington, United States6h ago
-
Machine Learning Engineer (Ads Core) - User Experience USD 137K-237KBidding | Deep learning | LLM | Language Processing | Machine LearningMid-level Full TimeSan Jose, California, United States6h ago
-
Security Engineer, Investigator - GenAI USD 143K-208KAI detection | Agent Orchestration | Bias Mitigation | Big Data | Cyber ThreatsMid-level Full TimeMenlo Park, CA | Seattle, WA …7h ago
-
ABAQUS | ANSYS | Bearings | Bolted Joints | CADSenior-level Full TimeRedmond, WA7h ago
-
Research Software Engineer, Foundational ML Research USD 207K-300KAlgorithm Prototyping | Audio Processing | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeKirkland, WA, USA; New York, NY, …7h ago
-
Software Engineer, AI/ML, Google Lens USD 147K-210KA/B | A/B Testing | API Design | Accessibility | B testingMid-level Full TimeMountain View, CA, USA7h ago
-
Partner Forward Deployed Engineer V, GenAI, Google Cloud USD 262K-364KAgent systems | Cloud platform | CrewAI | Evaluation Pipelines | Google CloudSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …7h ago
-
Senior Staff Software Engineer, Cloud AI, Full Stack USD 262K-364KC++ | CSS | Data Storage | Distributed Computing | GoBonus | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Software Engineer III, AI/ML, Search USD 147K-210KData Processing | Debugging | Distributed Computing | Information Retrieval | Language ProcessingBonus | Equity | Health insurance | Learning and development | Paid time offSenior-level Full TimeMountain View, CA, USA7h ago
-
Agentic AI | C++ | Cloud Security | Computer Vision | Data PreparationSenior-level Full TimeSan Francisco, CA, USA7h ago
-
Staff ML Engineer, Search AI Generated Content Quality USD 207K-300KContext engineering | DPO | Dense retrieval | Distributed Computing | Information RetrievalSenior-level Full TimeMountain View, CA, USA7h ago