Lead Data Engineer
112265-NJ-MetroPark, Iselin, United States
R
USD 224K Senior-level Full Time
Tasks
- Apply security and governance controls with IAM and encryption
- Build reusable ingestion transformation quality and orchestration frameworks
- Define ingestion transformation and serving patterns for batch and streaming
- Design scalable secure data platforms on Google Cloud
- Develop shared transformation libraries in Python SQL and Beam
- Document patterns runbooks and best practices
- Enable self service data consumption with governance by design
- Enforce data quality lineage and observability
- Implement data ingestion frameworks with error handling and schema management
- Implement data modeling and semantic layers in BigQuery
- Optimize cost performance and reliability of data workloads
- Provide orchestration with reusable DAGs and templates
Perks/Benefits
Skills/Tech-stack
Airflow | Apache Beam | Autoscaling | BigQuery | CI/CD | Canonical Data | Canonical Data Model | Cloud Build | Cloud Storage | Cloud Workflows | Cloud platform | Clustering | Column-Level Security | Composer | Customer-managed encryption keys | Data Lineage | Data Model | Data Modeling | Data Quality | Data Vault | Data Vault Modeling | Dataflow | Dataproc | Dimensional Modeling | Encryption Keys | Google Cloud | Google Cloud Platform | IAM | Java | Metrics dashboards | Monitoring | Observability | Partitioning | PubSub | Python | Row Level Security | SQL | Service Controls | Spark SQL | VPC Service Controls | Vault modeling
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R1d ago
-
Ansible | C# | C++ | CMake | CUDAMentorship | Remote work | Training workshopsMid-level Full TimeBaltimore, MD, United States R12h ago
-
Senior Software Engineer, Data Insights USD 196K-243KAWS VPC | Amazon EKS | Analytics infrastructure | Apache Superset | Data EngineeringSenior-level Full TimeSan Mateo, CA, United States R19h ago
-
Senior Software Engineer, Unsecured Installments USD 160K-223KA/B | A/B Testing | Accessibility | B testing | CI/CD401k match | Dental insurance | Disability insurance | Health insurance | Health savings accountSenior-level Full TimeUnited States | Remote R21h ago
-
Software Engineer, Unsecured Installments USD 136K-196KCI/CD | Cypress | GraphQL | Java | JavaScript401k | Company holidays | Dental insurance | Employee assistance program | Health insuranceSenior-level Full TimeUnited States | Remote R21h ago
-
Machine Learning Engineer USD 120K-150KBERT | CI/CD | Document parsing | Embeddings | Fine Tuning401k matching | Dental insurance | Employee assistance program | Flexible spending account | Health savings accountMid-level Full TimeRemote (United States) R23h ago
-
AI Engineer - AI/ML USD 98K-176KAWS | Access Control | Agentic Workflows | Agile | AuditabilityCareer development | Comprehensive benefits | Inclusion culture | TelecommuteMid-level Full TimeMinnetonka, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Computer Vision | Data Quality | Data labelingMid-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Flink | Apache Hudi | Apache Spark | Data GovernanceBenefits | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KAdapter-Tuning | Attention Optimization | Dataset curation | Direct Preference Optimization | Evaluation methodology100% remote | Benefits package | Full-time W2 employment | Long term multi year engagementMid-level Full TimeUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgentic Workflows | Chunking | Embeddings | Evaluation | IndexingBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Computer Vision | Concurrent programming | Critical softwareMid-level Full TimeUnited States - Remote R1d ago
-
ML Platform Engineer USD 100K-150KAPI Gateway | Automated rollback | Autoscaling | C++ | CachingCareer growth | Direct W2 employment | H1B transfer support | Long-term employment | Remote workSenior-level Full TimeJersey City, NJ R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Applied AI Engineer - Federal (TS Required) USD 170K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25 percent | Federal clearance supportMid-level Full TimeUnited States (Remote); Washington, D.C. (Remote) R1d ago
-
Senior Software Engineer, Data Platforms USD 185K-215KAWS | BigQuery | Data Ingestion | Data Processing | Distributed Systems401k matching | Annual company offsite event | Career growth opportunities | Commuter benefits | Health benefits optionsSenior-level Full TimePalo Alto, CA R1d ago
-
Business Intelligence Engineer USD 105K-144KCloud Data | Cloud Data Platforms | DAX | Data Modeling | Data performanceFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesMid-level Full TimeJersey City, NJ, United States R1d ago
-
Agentic AI Engineer – Google ADK/GCP USD 130K-191KAPI Development | Agent memory | Agent systems | CI/CD | Cloud RunFinancial and income protection benefits | Medical/Dental/Vision | Paid time off (PTO) | Tax-advantaged health care accounts | Wellness time offSenior-level Full TimeAustin, TX R1d ago
-
Associate Software Engineer – Full Stack (AI First) USD 150K-210KAPI Integration | Angular | CD pipelines | CI/CD | CI/CD pipelinesCareer development | Distributed work culture | Learning opportunities | Work from anywhereMid-level Full TimePhoenix, Arizona R1d ago
-
Associate Software Engineer – Frontend (AI First) USD 130K-190KAccessibility | Accessibility Standards | Angular | Browser Compatibility | CI/CDCareer development | Community building | Distributed work environment | Learning opportunities | Work from anywhereMid-level Full TimePhoenix, Arizona R1d ago
-
Staff Software Engineer - Data Platform USD 166K-232KAirflow | Automated testing | BigQuery | CI/CD | Cloud platformDental insurance | Flexible time off | In-office workspace | LinkedIn Learning access | Medical insuranceSenior-level Full TimeUnited States (Remote) R1d ago
-
Data Engineer USD 77K-90KAPI Integration | Automation | Batch Processing | CI/CD | CSV401k | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeRemote, USA, United States R1d ago
-
Software Engineer, AI Developer Experience USD 160K-200KAutomation | Cloud automation | Command Line | Command-line Interface | Data Analysis401k | In-home office setup | Internet stipend | Learning & development support | Medical, dental & vision coverageSenior-level Full TimeUnited States - Remote Opportunity R1d ago