Lead Data Engineer
Tasks
- Build reusable data engineering components and frameworks
- Conduct code reviews and collaborate cross functionally
- Design scalable data pipelines and architectures
- Develop and deploy data products for analytics and AI
- Establish data governance and performance optimization
- Implement CI CD pipelines for deployment and testing
- Mentor junior data engineers and set coding standards
- Monitor troubleshoot and optimize data pipelines
- Translate requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
AWS S3 | Amazon Kinesis | Amazon RDS | Apache Spark | CI/CD | Data Governance | Data Modeling | Data Processing | Databricks | Databricks Lakehouse | Databricks Lakehouse Platform | Delta Lake | ELT | ETL | Git | Kafka | Lakehouse platform | PySpark | Real Time | Real-time Data | Real-time Data Processing | SQL
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AI Systems & ML Engineering Industry Expert USD 140K-209KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible schedule | Fully remote | Hourly payment | International teamSenior-level Part TimeNew York City, NY, US R8h ago
-
ALM | Agile | Azure Functions | Business Rules | Calculated ColumnsHybrid work model | Professional developmentMid-level Full TimeGilbert, Arizona, United States; Lake Mary, …8h ago
-
Data Engineer USD 109K-160KAccess Control | Agile | Amazon Web Services | Apache Airflow | Azure401k savings plan | Company holidays | Employee assistance program | Healthcare coverage | Paid time offMid-level Full TimeWoburn, MA, United States9h ago
-
Principal Engineer - Supply Chain AI Solutions USD 125K-183KAWS | Agentic Workflows | Airflow | Authentication | AuthorizationSenior-level Full TimeNovi - Michigan, USA - Cabot …10h ago
-
Principal Engineer - Partner with Customers AI Solutions USD 125K-183KAWS | AWS Bedrock | Anthropic | Azure | Azure OpenAISenior-level Full TimeNovi - Michigan, USA - Cabot …10h ago
-
Principal Engineer - HR AI Solutions USD 125K-183KAWS | AWS Bedrock | Anthropic | Azure | Azure OpenAIBackground investigation and drug screen required | Employee discounts | Hybrid work | Training opportunitiesSenior-level Full TimeNovi - Michigan, USA - Cabot …10h ago
-
Principal Engineer - Finance AI Solutions USD 125K-183KAWS | Access Control | Airflow | Auditability | AzureEmployee discounts | Training opportunities | Wellness benefitsSenior-level Full TimeNovi - Michigan, USA - Cabot …10h ago
-
Embedded Software Engineer USD 97K-143KAgile | Agile Software Development | Agile software | Bash | Bug trackingEmployee discounts | Paid sick leave | Paid vacation and holidays | Training opportunities | Tuition reimbursementMid-level Full TimeCarlsbad – California, USA10h ago
-
Machine Learning Engineer USD 100K-120KAWS | Apache Spark | Classification | Data Quality | Data Quality ChecksHybrid work model | Onsite 1 to 2 days per week | Opportunities for growthMid-level Full TimeOakbrook Terrace, IL, US R10h ago
-
ClickHouse | Data Ingestion | Data Modeling | Data integration | ETLEntry-level Full TimeSan Jose, California, United States10h ago
-
Big Data | Data Modeling | Data Pipelines | Data Warehousing | PythonEntry-level Full TimeSan Jose, California, United States10h ago
-
C++ | Data Processing | Debugging | Entity Extraction | Fine TuningSenior-level Full TimeMountain View, CA, USA11h ago
-
BLE | C# | C++ | CSI2 | Convolutional Neural NetworksSenior-level Full TimeSan Jose, CA, USA11h ago
-
Autonomous Agents | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA11h ago
-
Practice Customer Engineer, Data Analytics, Google Cloud USD 152K-221KAlooma | Apache Spark | Architecture Design | Batch Processing | Big DataSenior-level Full TimeMountain View, CA, USA; Boulder, CO, …11h ago
-
Staff Software Engineer, Data Protection USD 207K-300KArtificial Intelligence | C++ | Data Governance | Data Privacy | Data StorageBonus | Equity | Health insurance | Paid time offSenior-level Full TimeSan Jose, CA, USA11h ago
-
Software Engineer, Generative AI, Maps USD 147K-210KComputer Geometry | Computer Vision | Convex Optimization | Data Processing | Data StructuresMid-level Full TimeMountain View, CA, USA11h ago
-
Dev and AI Infra Software Engineer, Releases, XR USD 207K-300KAI Software Engineering | AI software | Automation frameworks | Bug detection | Build AutomationSenior-level Full TimeSan Jose, CA, USA11h ago
-
Staff Software Engineer, Workspace Editors, Documents AI USD 207K-300KComputer Vision | Data Processing | Deep learning | Fine Tuning | Generative AISenior-level Full TimeNew York, NY, USA11h ago
-
Azure | Azure Data | Azure Data Lake | Azure Data Lake Storage | CI/CDCollaborative team environment | Learning & Mentorship | On-the-job training | Onsite work opportunityEntry-level Full TimeIrvine, CA, US13h ago
-
Data Engineering Summer Intern (May-Aug '27) USD 52K-96KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageEntry-level InternshipIrvine, CA, US13h ago
-
Cyber Software Engineer Staff (Embedded) USD 120K-224KBlue Team | C++ | CISSP | Code Analysis | Cybersecurity401k match | Education assistance | Employee assistance program | Flexible spending accounts | Flexible work schedulesSenior-level Full TimeOrlando, FL, US17h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R20h ago
-
Senior Data Engineer USD 119K-250KApache Spark | Automation | Azure | Azure Data | Azure Data Factory401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Dental insuranceSenior-level Full TimeAnn Arbor, MI, United States21h ago
-
Lead Software Engineer - Data and Payments Data Platform USD 170K-201KAWS Glue | AWS S3 | Amazon Athena | Amazon EMR | Amazon RedshiftBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeAustin, TX, United States21h ago