Lead Data Engineer
Tasks
- Build CI/CD pipelines and automated testing
- Build and maintain lakehouse solutions
- Create infrastructure as code for AWS deployments
- Design and develop data products
- Develop reusable data engineering frameworks
- Establish data quality monitoring and lineage practices
- Implement data governance and metadata management
- Implement data ingestion transformation and orchestration patterns
- Optimize Spark and Iceberg workloads
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon CloudWatch | Amazon ECS | Amazon EKS | Amazon EMR | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Spark | CI/CD | Data Governance | Data Lineage | Data Processing | Data Quality | Distributed data | Distributed data processing | Infrastructure as Code | Lakehouse | Metadata Management | PySpark | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States9h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA11h ago
-
AWS | Cloud Computing | Columnar Storage | Dataframe optimization | JavaEquity | Full benefits | Hybrid work in office component required | Performance-focused culture | Startup environmentSenior-level Full TimeLos Angeles, CA, United States11h ago
-
Senior-level Full TimeJersey City, NJ, United States13h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States13h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton14h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton14h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R14h ago
-
Sr. Robotics Engineer USD 124K-186KAgile | Bash | Build Servers | C# | C++401k | Adoption Assistance | Charitable contribution match | Defined contribution plan | Discount programsSenior-level Full TimeSanta Clara,California,United States14h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …15h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US17h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935519h ago
-
PIIM Analytics Engineer USD 86K-132KAPIs | Access Control | Azure Databricks | Data Architecture | Data GovernanceDental insurance | Medical insurance | Optional Disability Insurance | Paid time off | Supplemental insuranceMid-level Full TimeClay, NY, US21h ago
-
PIIM Analytics Lead USD 105K-160KBI Report Server | BigQuery | DAX | Data Governance | ETLDental insurance | Disability insurance | Medical insurance | Paid time off | Supplemental insuranceSenior-level Full TimeClay, NY, US21h ago
-
PIIM Analytics Engineer USD 105K-160KAI/ML | APIs | Access Control | Azure Databricks | Code AutomationFull time office or project telework | Relocation assistanceMid-level Full TimeHouston, TX, US21h ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R22h ago
-
Machine Learning Operations Engineer USD 140K-240KAWS | Alerting | Cloud GPU | Compression | Data Quality401k | Dental insurance | Health insurance | Office food and beverages | Stock option planMid-level Full TimeRWC HQ1d ago
-
Data Analytics Engineer - Techno functional USD 103K-128KAWS | Azure | Business Intelligence | Dashboarding | Data Governance401k | Employee share ownership plan | Flexible work | Healthcare | Paid parental leaveSenior-level Full TimeNew York, US1d ago
-
Staff Data Analytics Engineer USD 159K-220KApache Airflow | Apache Spark | BigQuery | DBT | Data ContractsFlexible working hours | Remote work flexibilitySenior-level Full TimeAmericas - Remote, US - Remote, … R1d ago
-
Sr. Validation & Tools Engineer - Embedded Firmware USD 160K-190KAppium | Bug tracking | C plus plus | C# | CAN401k match | Dental insurance | FSA | Family building benefits | Fertility benefitsSenior-level Full TimePalo Alto1d ago
-
Lead Software Engineer, Data Cloud USD 172K-260KAWS | Azure | Big Data | Big data processing | Containers401k | Employee stock purchasing program | Life and disability insurance | Medical, dental, and vision insurance | Mental health supportSenior-level Full TimeWashington - Bellevue, United States1d ago
-
Data Engineer USD 120K-160KAmazon Web Services | Azure | C# | Continuous Delivery | Continuous integration401k | Flexible spending | Flexible work options | Health benefits | Leadership opportunitiesMid-level Full TimeUS - NY - Home Office, …1d ago
-
Principal AI Engineer USD 140K-150KAI Search | AWS | Amazon Bedrock | Azure | Azure AICommuter benefits | Dental insurance | Flexible workplace arrangements | Health insurance | Learning opportunitiesSenior-level Full TimeDallas, TX, United States1d ago