Lead Data Engineer
112265-NJ-MetroPark, Iselin, United States
R
USD 224K Senior-level Full Time
Tasks
- Apply security and governance controls with IAM and encryption
- Build reusable data ingestion transformation and orchestration frameworks
- Build shared transformation libraries with Python SQL and Beam
- Define batch and streaming ingestion transformation and serving patterns
- Design and implement scalable secure data platforms on Google Cloud
- Develop data ingestion frameworks with error handling and schema handling
- Enable self service data consumption and governance
- Enforce data quality lineage and observability
- Implement orchestration with reusable DAGs templates and CI CD integration
- Optimize cost performance and reliability for GCP data workloads
- Partner with data engineers analytics and ML teams to onboard use cases
- Provide documentation runbooks and enablement workshops
Perks/Benefits
- 401k plan
- Commuter benefits
- Disability benefits
- Discounts and savings
- Hybrid schedule
- Life insurance
- Paid time off
- Parental leave
- Tuition reimbursement
Skills/Tech-stack
Airflow | Apache Beam | BigQuery | CI/CD | CMEK | Canonical Data | Canonical Data Modeling | Cloud Build | Cloud Composer | Cloud Monitoring | Cloud Storage | Cloud TPU | Cloud TPU N/A | Cloud Workflows | Cloud logging | Cloud platform | Column-Level Security | Data Lineage | Data Modeling | Data Quality | Data Vault | Data Vault Modeling | Dataflow | Dataproc | Dimensional Modeling | Google Cloud | Google Cloud Platform | IAM | Java | N A | Observability | PubSub | Python | Row Level Security | SCD | SQL | Service Controls | Spark SQL | VPC Service Controls | Vault modeling
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Computational Designer USD 95K-118KC# | C++ | Computational Geometry | Computer Graphics | Data Pipelines401k plan | Dental insurance | Education assistance | Fertility support | Flexible time offMid-level Full TimePortland, OR, US R23h ago
-
Senior Software Engineer, Data Foundation USD 189K-256KDjango | Go | High Volume | High-volume APIs | Python401k | Enhanced parental leave | Generous vacation | Holiday Breaks | Medical, dental & vision coverageSenior-level Full TimeSan Francisco, US (Hybrid) R1d ago
-
AWS S3 | Benchmarking | Debugging | Document AI | Document processingDirect collaboration with founding teams | Rapid Career Growth Opportunities | Remote work | Visa sponsorship availableSenior-level Full TimeSan Francisco, CA; Onsite R1d ago
-
A/B | A/B Testing | Agentic Workflows | B testing | BatchingEmployee resource groups | Inclusive culture | Professional development | Social events | Work-life balanceSenior-level Full TimeWork from Home, United States, United … R1d ago
-
AWS | Azure | CI/CD | Data Modeling | Data QualitySenior-level Full TimeTwo Destiny Way, Westlake TX, United … R1d ago
-
Senior Data Engineer USD 91K-163KAKS | Alerting | Azure Data | Azure Data Factory | Azure Databricks401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimePrimary location: Eden Prairie, MN R1d ago
-
Senior-level Full TimeOne Destiny Way, Westlake TX, United … R1d ago
-
Data Engineer (PostgreSQL DBA) USD 72K-130KAccess Control | Automation | Data loading | Database performance | Database performance tuningMid-level Full TimePrimary location: Hartford, CT R1d ago
-
Senior Software Engineer/Developer USD 141K-181KAWS DMS | AWS Glue | AWS Lambda | AWS Step Functions | Acceptance TestingSenior-level Full Time300 New Millennium Way, Durham NC, … R1d ago
-
Data Engineer - Temporary Worker USD 80K-96KAdobe Campaign | Agile | Amazon Redshift | Apache Airflow | Apache KafkaPaid Holidays | Safe Time | Sick timeSenior-level Full Time TemporaryUSA - Remote - Maryland, United … R1d ago
-
Sr AI Data Engineer USD 131K-180KAWS CDK | AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena401k match | Disability insurance | Employee assistance program | Life insurance | Paid parental leaveSenior-level Full TimeRemote, United States R1d ago
-
Senior Java/AI Engineer (Vice President) USD 162K-215KAI Agents | AI Observability | AI orchestration | Agile | Cloud NativeFlexible time off | Healthcare | Hybrid work model | Leave benefits | Retirement benefitsSenior-level Full TimeNY7 - 50 Hudson Yards, New … R1d ago
-
Robotics Automation Project Engineer USD 90K-120KASRS | AutoCAD | Automated testing | Azure | Control SystemsCustomer training support | Travel for implementationsMid-level Full TimeMASSACHUSETTS - VIRTUAL - MA01, United … R1d ago
-
Senior-level Full TimeRemote, WA, US R1d ago
-
Software Engineer II - Data Platform USD 116K-162KAirflow | BigQuery | DBT | Docker | GoFlexible time off | In-office workspace | LinkedIn Learning access | Medical insurance | Paid HolidaysMid-level Full TimeUnited States (Remote) R1d ago
-
APIs | AWS Glue | AWS Redshift | Amazon Web Services | Apache AirflowFully remote | Health insurance | On call production support | Paid time off | Retirement plansSenior-level Full TimeOrlando, FL, United States R1d ago
-
Data Governance & Metadata Scientist - WO-006 USD 98K-163KApache Atlas | Data Catalog | Data Governance | Data Lineage | Data Management PoliciesRemote workMid-level Full TimeRemote, FL, United States R1d ago
-
Lead Data Analyst USD 120K-158KClaims data | Data Marts | Data Modeling | Databricks | Excel401k match | Dental insurance | Holidays | Medical insurance | Paid time offSenior-level Full TimeRemote, CA, USA R1d ago
-
Lead Data Engineer - Refer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakeLearning and development programs | Remote workSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Lead Data Engineer USD 316K-506KContinuous Delivery | Data Architecture | Data Engineering | Data Governance | Data LakesLearning and development programs | Mentoring and coaching | Remote workSenior-level Full TimeChicago, Illinois, USA R1d ago
-
Staff, Analytics Engineer, GTM Data Science & Analytics USD 155K-228KAutomated reconciliation | CI/CD | DBT | Data Modeling | Data ObservabilitySenior-level Full TimeRemote - US R1d ago
-
Analytics Lead USD 160K-240KA/B | A/B Testing | Agent architecture | Airtable | B testing401k | Dental insurance | Medical insurance | Vision insuranceSenior-level Full TimeRedwood City, CA (Hybrid) R1d ago
-
Machine Learning / Data Science Engineer USD 90K-200KAgent Frameworks | Agent Orchestration | Agentic AI | Amazon RDS | Automation1 1 care | 401k matching | Carrot Fertility | Company paid stipend program | Disability insuranceSenior-level Full TimeReston, VA, United States R1d ago
-
Machine Learning / Data Science Engineer USD 90K-200KAgent Orchestration | Agentic AI | Amazon RDS | Apache Spark | AutomationDisability insurance | Employer 401K matching | Fertility coverage | Flexible work environment | Generous PTOSenior-level Full TimeRichmond, VA, United States R1d ago
-
Lead Machine Learning / Data Science Engineer USD 90K-200KAgent Orchestration | Agentic AI | Amazon RDS | Apache Spark | Azure SQL401k matching | Carrot fertility benefits | Disability insurance | Employee resource groups | Flexible work environmentSenior-level Full TimeReston, VA, United States R1d ago