Lead Data Engineer
112265-NJ-MetroPark, Iselin, United States
R
USD 224K Senior-level Full Time
Tasks
- Apply security and governance controls with IAM and VPC SC
- Build reusable ingestion transformation and orchestration frameworks
- Build shared transformation libraries using Python SQL and Apache Beam
- Contribute to platform roadmap and tool evaluation
- Design scalable secure data platforms on Google Cloud
- Develop data ingestion frameworks with error handling and schema handling
- Document patterns runbooks and best practices
- Enable self service data consumption with governance by design
- Enforce data quality lineage and observability
- Implement batch and streaming ingestion transformation and serving patterns
- Implement data modeling and semantic layers in BigQuery
- Optimize cost performance and reliability of data workloads
- Partner with analytics and ML teams to onboard use cases
- Provide orchestration with reusable DAGs and templates
Perks/Benefits
- 401k plan
- Adoption reimbursement
- Commuter benefits
- Disability benefits
- Discounts and savings
- Health benefits
- Hybrid work schedule
- Life insurance
- Paid time off
- Parental leave
- Tuition reimbursement
- Tuition reimbursement scholarships for dependent children
Skills/Tech-stack
Airflow | Apache Beam | Apache Dataflow | Auto Scaling | BigQuery | CI/CD | CMEK | Canonical Data | Canonical Data Model | Cloud Build | Cloud Composer | Cloud Storage | Cloud Workflows | Cloud platform | Clustering | Column-Level Security | Cost Optimization | Data Governance | Data Lineage | Data Model | Data Quality | Data Vault | Data Vault Modeling | Dataproc | Dimensional Modeling | Error Reporting | Google Cloud | Google Cloud Platform | IAM | Java | Logging | Monitoring | Observability | Partitioning | PubSub | Python | Row Level Security | SQL | Schema handling | Secure Data | Secure data governance | Service Controls | Spark SQL | Storage classes | VPC Service Controls | Vault modeling
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Data Engineer USD 129K-165KAWS | Airflow | CI/CD | Data Modeling | Django401k | Half-day Fridays | Medical/Dental/Vision insurance | Paid Holidays | Remote workSenior-level Full TimeChicago, IL, US R19h ago
-
Solutions Engineer USD 150K-180KAI | Apache Flink | Apache NiFi | Apache Spark | Applied ScienceContinued Career Development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeMid-level Full TimeUS-California-Remote, United States R21h ago
-
Lead Data Analyst, Payments Platform USD 155K-170KACH | Alerting | Anomaly Detection | Card networks | Collection strategies401k plan | Cell Phone Bill Reimbursement | Dental insurance | Flexible PTO | Headspace Therapy SessionsSenior-level Full TimeNew York City (Hybrid) R22h ago
-
Senior Embedded Software Engineer - Audio USD 115K-150KAIDL | ALSA | AOSP | ASoC | AndroidAdoption support | Adoption/support reimbursement | Child care assistance | Dental insurance | Employee resource groupsSenior-level Full TimeDearborn, MI, United States R22h ago
-
Senior Software Engineer, Storage USD 166K-210KAmazon CloudWatch | Amazon EC2 | Datadog | Go | MemcachedAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R23h ago
-
AI Solutions Engineer, East USD 125K-175KAWS | Azure | Cloud platform | Dspy | Generative AI401k plan | Dental insurance | Medical insurance | Mental wellness support | Parental leaveMid-level Full TimeRemote (New York) R1d ago
-
Senior Data Engineer, Sentinel (Pacific Time Zone) USD 153K-210KAWS | Airflow | Alerting | CI/CD | DatabricksSenior-level Full TimeUnited States R1d ago
-
Mid-level Full TimeAnywhere USA, United States R1d ago
-
Machine Learning Engineer USD 104K-131KAWS | Active Learning | Airflow | Argo | Azure401k match | Corporate discounts | Education assistance | Flexible work options | Maternity leaveSenior-level Full TimeRemote, REMOTE, United States R1d ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Data loading | Distributed Training | Gradient Computation | Kernel Fusion401k match | Dental insurance | Health Accounts | Health insurance | Health savings accountSenior-level Full TimeBoston, Massachusetts, United States R1d ago
-
AWS EKS | Access Control | Apache Iceberg | Apache S3 | CI/CDDental and vision coverage | ESPP | Flexible spending wallets | Remote-first work | Subsidized medical coverageSenior-level Full TimeRemote US R1d ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | DBTSenior-level Full TimeUnited States of America R1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Lead Risk Analytics Data Scientist USD 125K-155KAI Automation | Actuarial pricing | Claims analytics | DBT | Data Modeling401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeRemote, US R1d ago
-
Software / Computer Science Intern USD 42K-52KData Parsing | Data Pipelines | Debugging | Networking | PythonHybrid work flexibility | Professional developmentEntry-level InternshipMonroeville, PA R1d ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Kernel Fusion | NVIDIA Nsight | PyTorch | PyTorch Profiler401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeRemote U.S. R1d ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Data loading | Distributed Training | Kernel Fusion | NsightMedical Dental Vision 401k with company match Health Savings Account Life Insurance Pet InsuranceSenior-level Full TimeLas Vegas, Nevada, United States R1d ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | Kernel Fusion | Nsight | Profiling tools | PyTorch401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimePittsburgh, Pennsylvania, United States R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental insurance | Flexible remote working options | Health insurance | Professional development and training opportunitiesSenior-level Full TimeWashington R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental benefits | Health benefits | Impactful national security projects | Professional development and trainingSenior-level Full TimeVirginia R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative work environment | Dental benefits | Health benefits | Impactful projects | Professional development and trainingMid-level Full TimePennsylvania R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsSenior-level Full TimeTexas R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental benefits | Health benefits | Professional development and training | Remote work flexibility | Retirement benefitsSenior-level Full TimeNorth Carolina R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative innovative work environment | Flexible remote working options | Health dental and retirement benefits | Professional development and training opportunitiesSenior-level Full TimeNew York R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsMid-level Full TimeNew Jersey R1d ago