Lead Data Engineer
112265-NJ-MetroPark, Iselin, United States
R
USD 224K Senior-level Full Time
Tasks
- Apply security and governance controls using IAM VPC SC and CMEK
- Build reusable ingestion transformation quality and orchestration frameworks
- Build semantic layers and data modeling frameworks in BigQuery
- Define data platform architectures using BigQuery Dataflow and Dataproc
- Design and implement scalable secure data platforms on Google Cloud
- Develop shared transformation libraries using Python SQL and Beam
- Document patterns runbooks and best practices
- Enable self service data consumption and governance
- Enforce data quality lineage and observability
- Implement standardized batch and streaming ingestion and transformation blueprints
- Optimize cost performance and reliability of GCP data workloads
- Provide reusable orchestration with reusable DAGs templates
Perks/Benefits
- Commuter benefits
- Disability benefits
- Life insurance
- Paid time off
- Parental leave
- Tuition reimbursement
Skills/Tech-stack
Apache Beam | Autoscaling | BigQuery | CI/CD | CMEK | Canonical Data | Canonical Data Modeling | Cloud Build | Cloud Composer | Cloud Storage | Cloud Workflows | Cloud platform | Column-Level Security | Data Modeling | Data Vault | Data Vault Modeling | Dataflow | Dataproc | Dimensional Modeling | Git | Google Cloud | Google Cloud Platform | IAM | Java | PubSub | Python | Row Level Security | SQL | Spark SQL | VPC SC | Vault modeling
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1d ago
-
Web Data Engineer USD 110K-130KAWS | Apache Airflow | Azure | DBT | Google Cloud401k | Expense reimbursement | Insurance benefits | Paid time off | Remote workSenior-level Full TimeRemote, USA, United States R11h ago
-
Alerting | BigQuery | Buildkite | CI/CD | Container OrchestrationDental and vision coverage | ESPP | Employee stock purchase plan | Flexible spending wallets | Health care coverageSenior-level Full TimeRemote US R12h ago
-
Ansible | C# | C++ | CMake | CUDAMentorship | Remote work | Training workshopsMid-level Full TimeBaltimore, MD, United States R17h ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R1d ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R1d ago
-
AI Engineer - AI/ML USD 98K-176KAWS | Access Control | Agentic Workflows | Agile | AuditabilityCareer development | Comprehensive benefits | Inclusion culture | TelecommuteMid-level Full TimeMinnetonka, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hudi | Apache Spark | Data GovernanceBenefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Attention Optimization | Dataset curation | Direct Preference Optimization | Evaluation methodology100% remote | Benefits package | Full-time W2 employment | Long term multi year engagementMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgentic Workflows | Chunking | Embeddings | Evaluation | IndexingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent programming | Critical softwareMid-level Full TimeUnited States - Remote R1d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Automated rollback | Autoscaling | C++ | CachingCareer growth | Direct W2 employment | H1B transfer support | Long-term employment | Remote workSenior-level Full TimeJersey City, NJ R1d ago
-
Cloud Data DevOps Engineer USD 109K-149KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Apache Spark401k match | Employee discounts | Floating holidays | Health coverage | Paid parental leaveMid-level Full TimeWork From Home - Coppell - … R1d ago
-
Senior Data Engineer USD 135K-170KAWS Fargate | AWS Glue | AWS Lambda | AWS S3 | AWS Secrets401k company match | Commuter savings | Dental insurance | Disability insurance | Employee resource groupsSenior-level Full TimeNew Jersey, United States R1d ago
-
Senior Machine Learning Operations Engineer USD 135K-170KAWS SageMaker | Amazon Bedrock | Anthropic API | Batch Transform | CI/CD401k match | Commuter savings | Dental insurance | Disability insurance | Employee resource groupsSenior-level Full TimeNew Jersey, United States R1d ago
-
Applied AI Engineer - Federal (TS Required) USD 170K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25 percent | Federal clearance supportMid-level Full TimeUnited States (Remote); Washington, D.C. (Remote) R1d ago
-
Senior Software Engineer, Data Platforms USD 185K-215KAWS | BigQuery | Data Ingestion | Data Processing | Distributed Systems401k matching | Annual company offsite event | Career growth opportunities | Commuter benefits | Health benefits optionsSenior-level Full TimePalo Alto, CA R1d ago
-
Business Intelligence Engineer USD 105K-144KCloud Data | Cloud Data Platforms | DAX | Data Modeling | Data performanceFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesMid-level Full TimeJersey City, NJ, United States R1d ago
-
Agentic AI Engineer – Google ADK/GCP USD 130K-191KAPI Development | Agent memory | Agent systems | CI/CD | Cloud RunFinancial and income protection benefits | Medical/Dental/Vision | Paid time off (PTO) | Tax-advantaged health care accounts | Wellness time offSenior-level Full TimeAustin, TX R1d ago
-
Associate Software Engineer – Full Stack (AI First) USD 150K-210KAPI Integration | Angular | CD pipelines | CI/CD | CI/CD pipelinesCareer development | Distributed work culture | Learning opportunities | Work from anywhereMid-level Full TimePhoenix, Arizona R1d ago