Data Engineer
Tasks
- Build CI/CD workflows
- Define data platform architectures and migration roadmaps
- Design enterprise Lakehouse architectures using Databricks
- Develop PySpark jobs and pipelines
- Develop reference architectures reusable frameworks and accelerator solutions
- Establish data governance security and operational standards
- Implement Unity Catalog for secure sharing classification lineage and auditability
- Implement role-based access controls and data masking
- Integrate real time and streaming data
- Orchestrate workflows using Airflow
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision coverage
- Paid time off
- Personal days
- Retirement savings plan
- Sick leave
Skills/Tech-stack
Access Control | Apache Airflow | CI/CD | Data Classification | Data Governance | Data Lineage | Data Security | Data masking | Databricks | Delta Lake | Delta Sharing | Lakehouse | PySpark | Real Time | Real-time Data | Role-Based Access | Role-Based Access Control | Streaming | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
C# | C++ | Code review | Debugging | Embedded Operating SystemSenior-level Full TimeSan Jose, CA, USA1d ago
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States1d ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois2d ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA2d ago
-
AWS | AWS RDS | Access Control | Auditing | AzureOnsite work days 1 onsiteSenior-level ContractPhoenix, AZ, AZ2d ago
-
Senior Spacecraft Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k match | Dental insurance | EV charging | FSA | Flexible PTOSenior-level Full TimeEl Segundo, California, United States2d ago
-
Lead Machine Learning Engineer USD 183K-215KAmazon ECS | Apache Airflow | Apache Spark | CUDA | Cloud ComputingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeNew York, NY, United States2d ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R2d ago
-
Senior Quantum Applications Engineer USD 125K-187KArtificial Intelligence | CI/CD | CUDA Quantum | Code review | CryptographySenior-level Full TimeNew Haven, CT2d ago
-
Senior Analytics Engineer USD 111K-160KAirflow | Business Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Dental insurance | Fitness Center | Health insurance | Paid time offSenior-level Full TimeLehi, Utah2d ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI Integration | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeRichmond2d ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeDallas2d ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-196KAPIs | AWS | AWS Glue | Amazon Redshift | Apache AirflowSenior-level Full TimeMinneapolis2d ago
-
AI Engineer/Scientist, Staff USD 185K-250KAPIs | Agent Frameworks | Argo CD | Attribution methods | CI/CD401k match | Comprehensive health coverage | Hybrid work environment | Paid Company Holidays | Parental leaveSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R2d ago
-
Principal AI Engineer USD 182K-242KAPI | Access Control | Access Management | Air Gapped Computing | Air-gapped401k match | Dental insurance | Flexible-hybrid work | Health insurance | Life insuranceSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R2d ago
-
Sr Engineer, Data Engineering USD 30K-46KAmazon Web Services | Apache Spark | Azure | Data Lake | Data WarehouseSenior-level Full TimeRoswell, GA, United States2d ago
-
Data Scientist USD 132K-202KDBT | Data Engineering | Data pipeline | Databricks | Feature Engineering401k | Medical/Dental/Vision insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeWorcester, MA, United States R2d ago
-
Algorithm Engineer USD 150K-170KCI/CD | Deep learning | Digital Signal | Digital Signal Processing | DockerPTO | Remote workMid-level Full TimeBoston, MA / Remote R2d ago
-
Data Engineer USD 144K-153KAirflow | BigQuery | CI/CD | Code Reviews | DBT401k match | Half-day Fridays | Home Tickets | Medical, dental, vision benefits | Paid time offMid-level Full TimeSan Francisco, CA2d ago
-
Senior AI & Platforms Engineer USD 30K-84KAIOps | Asyncio | Autogen | CI/CD | CrewAIContract position | Local candidates required | Onsite work 3 days per weekSenior-level Contract Full TimeBrooklyn, NY, United States2d ago