Data Engineer
Tasks
- Build CI/CD workflows
- Define data platform architectures and migration roadmaps
- Design enterprise Lakehouse architectures using Databricks
- Develop PySpark jobs and pipelines
- Develop reference architectures reusable frameworks and accelerator solutions
- Establish data governance security and operational standards
- Implement Unity Catalog for secure sharing classification lineage and auditability
- Implement role-based access controls and data masking
- Integrate real time and streaming data
- Orchestrate workflows using Airflow
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
Access Control | Apache Airflow | CI/CD | Data Classification | Data Governance | Data Lineage | Data Security | Data masking | Databricks | Delta Lake | Delta Sharing | Lakehouse | PySpark | Real Time | Real-time Data | Role-Based Access | Role-Based Access Control | Streaming | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Angular | Azure Databricks | CI/CD | Cloud platformRemote workMid-level Full TimeWork from home, VA, United States R1h ago
-
AI Software Engineer USD 107K-195KAWS CloudFormation | AWS Lambda | Amazon Web Services | CI/CD | Cloud Computing401k match | Dental insurance | Holiday pay | Medical insurance | Paid time offSenior-level Full TimeChantilly, VA, United States3h ago
-
AI and Data Science Engineer III USD 131K-218KAgile | Amazon Web Services | Anomaly Detection | CI/CD | Causal analysisMentorship | Travel opportunitiesSenior-level Full TimeArlington/Rosslyn, Virginia, United States5h ago
-
Model Operations Engineer USD 107K-179KALiBi | AWS SageMaker | Amazon Lambda | Apache Airflow | AzureHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn5h ago
-
Access Control | Customer 360 | Data integration | Data pipeline | Data pipeline orchestrationOnsite workMid-level ContractOrlando, United States5h ago
-
Production Engineer - Applied Machine Learning USD 156K-387KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDEntry-level Full TimeSan Jose, California, United States6h ago
-
Data Engineer, Analytics (Ranking, AI) USD 182K-204KAgent Orchestration | C# | C++ | Dashboards | Data GovernanceCareer growth opportunitiesSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …7h ago
-
Principal Engineer, AI and Business Intelligence, Looker USD 307K-427KBusiness Intelligence | Data Governance | Data Modeling | ETL | Embedded AnalyticsCareer growth | Mentorship | Risk managementSenior-level Full TimeKirkland, WA, USA7h ago
-
Senior Software Engineer, AI/ML, Ads and Commerce USD 174K-252KCloud platform | Data Pipelines | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeMountain View, CA, USA7h ago
-
Senior Software Engineer USD 226K-252KAlgorithms | Audio Processing | C++ | Cause analysis | Code reviewHybrid scheduleSenior-level Full TimeMountain View, CA, USA R7h ago
-
Software Engineer III, AI/ML Machine Learning, Core USD 147K-210KAI/ML | AI/ML Model Deployment | AI/ML model development | Artificial Intelligence | C++Senior-level Full TimeAustin, TX, USA7h ago
-
Staff Software Engineer, App Hub USD 207K-300KData Ingestion | Data Integrity | Data Structures | Data Structures and Algorithms | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Lead Data Engineer USD 133K-171KAWS | Airflow | Athena | Aurora | CI/CD401k matching | Distance based relocation assistance | Employee business networks | Flexible work hours | Free coffeeSenior-level Full TimeHolyoke, MA, 01040, USA8h ago
-
Machine Learning Engineer USD 120K-140KAI Pipelines | AI Workbench | AI endpoints | API Development | Apache KafkaEntry-level Full TimeDenver, Colorado, United States9h ago
-
Data Engineer/ Analyst- LookML USD 90K-118KBigQuery | CD pipelines | CI/CD | CI/CD pipelines | Data GovernanceSenior-level Full TimeMadrid, MD, Spain10h ago
-
Data Engineer, Senior (Oracle ERP) USD 128K-174KADFDI | Agile | Automation | CI/CD | Cloud ERP401k match | Employee assistance program | Family and caregiving support | Flexible spending accounts | Health savings accountSenior-level Full TimeColumbus, OH, US14h ago
-
Data Engineer II USD 123K-190KAWS Glue | Apache Airflow | Apache NiFi | Azure Data | Azure Data FactoryVisa sponsorshipSenior-level Full TimePhoenix, AZ, United States14h ago
-
Senior Product Engineer, Fullstack USD 165K-250KAPI Design | Amplitude | CI/CD | Data Modeling | GoHealth insurance | Startup equitySenior-level Full TimeSan Francisco14h ago
-
Senior / Staff Robotics Engineer, Motion Planning USD 170K-240KBody Dynamics | C++ | C++17 | C++20 | CUDA401k plan | Dental insurance | Fully stocked kitchen | Green card support | Health insuranceSenior-level Full TimeMilpitas, CA14h ago
-
C++ | DDS | Debugging | Hypervisor | Kernel Modules401k plan | Dental insurance | Equity programs | Green card support | Health insuranceSenior-level Full TimeMilpitas, CA14h ago
-
Sr. Data Engineer - Services Special Project USD 170K-230KAWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftSenior-level Full TimeCupertino15h ago
-
Embedded Autonomy Engineer USD 130K-220KBash | Board Support | Board Support Package | Bootloader | C#Health insurance | Professional development opportunities | Retirement planSenior-level Full TimeHuntington Beach, CA17h ago
-
Senior ML Ops Engineer (Machine Learning Infrastructure) USD 150K-250KAWS | Amazon SageMaker | Apache Airflow | Azure | CI/CDHybrid work | Onsite in Los Angeles at least 1 week per monthSenior-level Full TimeLos Angeles, CA17h ago
-
Senior, Data Engineer USD 140K-160KAPI Integration | Azure | Azure Data | Azure Data Factory | Business Intelligence401k match | Charitable contribution | Educational reimbursement | Employee referral bonuses | Fitness discountsSenior-level Full TimeUnited States18h ago