Lead Data Engineer
112265-NJ-MetroPark, Iselin, United States
R
USD 224K Senior-level Full Time
Tasks
- Apply security and governance controls
- Build reusable ingestion transformation quality and orchestration frameworks
- Build shared transformation libraries in Python and SQL and Apache Beam
- Define logical and physical data platform architectures
- Design scalable secure data platforms on Google Cloud
- Develop config driven data ingestion pipelines connectors schema handling error handling
- Document patterns runbooks and best practices
- Enable self service data consumption and governance
- Enforce data quality lineage and observability
- Implement data modeling and semantic layers in BigQuery
- Implement standardized batch and streaming ingestion transformation and serving patterns
- Optimize cost performance and reliability of data workloads
- Partner with domain data engineers analytics and ML teams to onboard use cases
- Provide orchestration with Cloud Composer or Cloud Workflows reusable DAGs and templates
Perks/Benefits
- 401k plan
- Commuter benefits
- Health benefits
- Hybrid work schedule
- Paid time off
- Parental leave
- Tuition reimbursement
Skills/Tech-stack
Agile | Airflow | Apache Beam | BigQuery | CI/CD | Canonical Data | Canonical Data Models | Cloud Build | Cloud Composer | Cloud Error Reporting | Cloud Key Management Service | Cloud Monitoring | Cloud Storage | Cloud Workflows | Cloud key management | Cloud logging | Cloud platform | Data Lineage | Data Quality | Data Vault | Data models | Dataflow | Dataproc | Dimensional Modeling | Error Reporting | Google Cloud | Google Cloud Platform | IAM | Java | Key Management Service | Observability | PubSub | Python | SQL | Service Controls | Spark SQL | VPC Service Controls
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Research Engineer, SysML - FAIR USD 141K-208KAgent Orchestration | Bias Mitigation | C# | C++ | CUBLASMid-level Full TimeMenlo Park, CA | Remote, US R10h ago
-
AI Foundry | AWS Bedrock | Agent Frameworks | Agent Orchestration | AnthropicMid-level Full TimeHouston, TX, United States R16h ago
-
Embedded Semiconductor Engineer USD 120K-150KAutomation | BSP | C# | C++ | CloudCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R21h ago
-
Data Analytics Manager USD 95K-150KAPI Design | Agile | Azure | Azure Data | Azure Data FactoryComprehensive benefits package | Professional development programs | Remote work optionMid-level Full TimeDallas, Texas, United States R1d ago
-
Staff Data Engineer, Corporate Engineering USD 180K-252KAWS S3 | Automated reconciliation | CI/CD | Cloud Data | Cloud Data Warehouse401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsSenior-level Full TimeRemote - United States R1d ago
-
Senior AI Systems Engineer USD 130K-195KAlerting | Bash | CI/CD | CMMC | Configuration ManagementHybrid work option | Remote work optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R1d ago
-
Senior AI Technologist USD 145K-208KAI Agents | AI Foundry | AWS Bedrock | Apache Airflow | Apache SparkCross-functional collaboration | Fully remote or hybrid or onsite optionSenior-level Full TimeRaleigh, North Carolina, United States; Albuquerque, … R1d ago
-
Senior Analytics Engineer USD 73K-165KAgile | Apache Airflow | DBT | Data Governance | Data Mining401k plan | Flexible time off | Mental health resources | Remote work optionsSenior-level Full TimeRemote, US R1d ago
-
Data Intelligence Lead USD 114K-140KAdvanced Analytics | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeRemote, United States R1d ago
-
Data Engineer USD 120K-150KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CDSenior-level Full TimeRemote, United States R1d ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | Mentorship opportunities | On-call supportSenior-level Full TimeOrlando, FL, United States R1d ago
-
Senior Data Engineer – Hardware & Supply Chain USD 147K-203KAWS | Apache Iceberg | DBT | Data Governance | Data ModelingFlexible wellness time off | Paid Holidays | Paid sick leave | Paid time off | Parental leaveSenior-level Full TimeHybrid - San Francisco, California R1d ago
-
Principal Database Engineer USD 102K-203KASH | AWR | AWS IAM | AWS KMS | AWS RDSFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R1d ago
-
Computational Scientist USD 90K-105KC++ | Documentation | Fortran | HPC clusters | LinuxConference attendance | Open source contributions | Professional development opportunities | Student mentoringEntry-level Full TimeBlacksburg, Virginia, Hybrid R1d ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 140K-205KAI Foundry | AWS | AWS Bedrock | Agentic AI | Architecture ReviewHybrid work modelSenior-level Full TimeMiami Lakes, FL, United States R1d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k plan | Charity programs | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeUnited States R1d ago
-
Software Developer Sr USD 95K-169K.NET | ARM | Apache Spark | Automated testing | Azure401k | Charity support | Dental insurance | Global Employee Stock Purchase Plan | Life insuranceSenior-level Full TimeUnited States R1d ago
-
Senior Machine Learning Engineer II USD 156K-250KAWS | Azure | Batch Processing | Container Orchestration | Data PipelinesDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
AI orchestration | Alerting | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Savings plan options | Vision insuranceSenior-level Full TimeSan Francisco, CA, United States R1d ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Alerting | Batching | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Remote work | Savings planMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Security Operations AI Engineer, Contract USD 151K-225KAI Governance | AI RMF | AI Security | Adversarial Attacks | Adversarial Machine LearningMid-level Full TimeRemote, United States R1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksCollaborative cross-functional team | Exposure to large scale insurance analytics | Fully remote work | High-impact leadership role | Long term contract with extension potentialSenior-level Contract Full TimeCanada R1d ago
-
Data Engineer USD 97K-122K.NET | API Development | API Gateway | AWS | AWS Glue401k match | Commuter benefits | Dental insurance | Dependent Care Savings Account | Education assistanceMid-level Full TimeRemote, United States R1d ago
-
AWS | Alerting | Azure | BigQuery | CI/CDEquity opportunities | Fully remote within Canada | Health, dental, vision coverage | Paid parental leave | Performance-Based IncentivesSenior-level Full TimeCanada R1d ago