Data Engineer (Databricks)
Tasks
- Build CI/CD pipelines
- Define data platform architecture
- Design Lakehouse architectures
- Develop PySpark jobs
- Develop migration roadmaps
- Develop models with Unity Catalog
- Enable Delta sharing
- Establish data governance standards
- Implement Databricks Apps
- Implement data masking
- Implement role-based access controls
- Integrate real-time streaming data
- Orchestrate data workflows with Airflow
Perks/Benefits
- Company holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision insurance
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Access Control | Airflow | CI/CD | Data Governance | Data masking | Databricks | Databricks Apps | Delta Sharing | Lakehouse | PySpark | Role-Based Access | Role-Based Access Control | Streaming integration | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
AWS Glue | AWS IAM | AWS Kinesis | AWS Lambda | AWS Step Functions100 percent on siteSenior-level ContractMc Lean, United States6h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R15h ago
-
Senior-level Full TimeMountain View, CA17h ago
-
Principal / Sr Principal Data Analytics Engineer USD 98K-184KAgile | CI/CD | Data Governance | Data Modeling | Data MonitoringCompany-Paid Holidays | Disability insurance | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeFLME229, United States20h ago
-
Sr. Data Engineer USD 109K-145KAWS | Agile | CI/CD | Compliance | Data Governance401k matching | Employee assistance program | Flexible working hours | Learning platform access | Medical, dental, and vision insuranceSenior-level Full TimeRemote, TX, United States R20h ago
-
Senior Machine Learning Engineer USD 134K-168KData Drift | Databricks | Ethical AI | Feature Engineering | KubernetesSenior-level Full TimeNew York, NY, United States20h ago
-
AWS | AWS CloudFormation | Amazon ECS | Automation | CI/CD401-k plan | Company match | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeAtlanta, GA, United States1d ago
-
Machine Learning Engineer USD 124K-170KAWS Bedrock | AWS Fargate | AWS Lambda | AWS Step Functions | Amazon ECSCareer development opportunities | Equal employment opportunityMid-level Full TimePlano, Texas, United States1d ago
-
Software Engineer (AI/ML) USD 170K-240KAPI Integration | Access Control | CSS | Information security | JavaScript401k contribution | Career counseling | Career development and training | Health, dental and vision coverage | Holiday paySenior-level Full TimeFort Meade, MD1d ago
-
Staff AI Engineer USD 140K-210KAPI Development | AWS | Access Management | Bedrock AgentCore | CI/CD401k | All-hands meetings | Dental insurance | Employee equity program | Health insuranceSenior-level Full TimeNew York City1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | AMD Xilinx toolchain | AMD/Xilinx SoC | BashHybrid work options | Remote work optionsSenior-level Full TimeNew Haven, CT1d ago
-
Senior Analyst, Business Strategy and Analytics USD 95K-135KData Governance | Data Integrity | Data Mining | Data Validation | Microsoft Access401k match | Education assistance | Employee discounts | Family & fertility benefits | Free virtual health careSenior-level Full TimeColumbus, OH, United States2d ago
-
Big Data Engineer / Sr. Level - GCP USD 88K-174KAPI Development | API Versioning | Apigee | Avro | Big DataContract-to-hireSenior-level Full TimeNashville, TN, United States2d ago
-
Senior Python AI/ML Developer USD 140K-170KAsynchronous programming | CI/CD | Django | DynamoDB | FastAPISenior-level Full TimeUS-NJ-Jersey City2d ago
-
Mid-level Full TimeUS-NJ-Jersey City2d ago
-
C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learningSenior-level Full TimeBurlingame, CA2d ago
-
Senior Staff Software Engineer, Knowledge Catalog For AI USD 262K-365KBig Data | C++ | Computer Vision | Data Governance | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA2d ago
-
Principal Data Engineer USD 180K-220KAWS | Apache Airflow | Artificial Intelligence | CI/CD | Confluence401k | Autonomy | Company paid life insurance | Disability coverage | FSASenior-level Full TimeRemote - US, Canada and Poland R2d ago
-
Data Engineer USD 132K-165KAWS | Azure | Cassandra | Data Governance | Data Lakes401k match | Dental insurance | Employee assistance program | Life insurance | Medical insuranceSenior-level Full TimePlano, TX, US2d ago
-
Data Platform Engineer, Infrastructure USD 70K-300KAWS | Alerting | Audit Logging | CI/CD | Capacity PlanningFlexible hours | Onsite work | Work-life balanceMid-level Full TimeIrvine, CA2d ago
-
AWS | Azure | CI/CD | Cloud Native | Distributed SystemsCareer development support | Flexible working models | Health and wellbeing benefits | Hybrid work | MentoringEntry-level InternshipSan Ramon, CA, US, 945 832d ago
-
Secure Data Pipeline Data Engineer USD 139K-209KAccess Control | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsMid-level Full TimeIN-INDIANAPOLIS, 220 VIRGINIA AVE, United States2d ago
-
Data Platform Engineer, Autonomy Analytics USD 110K-144KAirbyte | Airflow | BigQuery | CDC | Cloud Object StorageMid-level Full TimeIrvine, CA2d ago
-
Data Platform Engineer, Data Pipelines USD 70K-300KAirbyte | Airflow | BigQuery | CDC | DBTFlexible hours | Fully onsite collaboration | Work-life balanceMid-level Full TimeIrvine, CA2d ago