Databricks Engineer
Tasks
- Define data platform architectures and migration roadmaps
- Design lakehouse architecture with Databricks
- Develop and implement PySpark jobs
- Develop models using Unity Catalog for classification lineage and auditability
- Develop reference architectures and reusable frameworks
- Enable secure data sharing with Databricks Apps and Delta Sharing
- Establish data governance security and operational standards
- Implement role based access control and data masking
- Integrate real time and streaming data
- Orchestrate workflows with Airflow
- Set up CI CD methods
Perks/Benefits
- Company-Paid Holidays
- Employee assistance program
- Life and disability insurance
- Medical, dental, and vision insurance
- Paid time off
- Retirement savings plan
Skills/Tech-stack
Access Control | Airflow | Auditability | CI/CD | Data Classification | Data Governance | Data Lineage | Data Security | Data integration | Data masking | Databricks | Databricks Apps | Delta Sharing | ETL | Lakehouse | PySpark | Real Time | Real-Time Data Integration | Real-time Data | Role-Based Access | Role-Based Access Control | Streaming | Time data integration | Unity Catalog
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R1d ago
-
API Integration | AWS Bedrock | Auditing | Authentication | AuthorizationMentoring | MentorshipMid-level Full TimeMenlo Park, CA, United States1d ago
-
Lead Palantir AI and Data Science Engineer II USD 159K-265KAI workflows | Analytics | Cloud Computing | Dashboards | Data GovernanceProfessional development | Travel opportunitiesSenior-level Full TimeRosslyn, Virginia, United States1d ago
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States1d ago
-
3D Rendering | A/B | A/B Testing | Agentic AI | AlgorithmsSenior-level Full TimeSan Jose, California, United States1d ago
-
Lead Firmware Engineer, Robotics USD 207K-300KBrushless DC | C# | C++ | Closed Loop | Closed loop controlSenior-level Full TimeMountain View, CA, USA1d ago
-
Analytics Data Engineer USD 94K-130KAzure Data | Azure Data Factory | CI/CD | Data Analysis | Data FactoryRemote workMid-level Full TimeFlagstaff, AZ, US1d ago
-
AI Application & Cloud Operations Engineer (Mid level) USD 108K-117KAWS | AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLinkMid-level Contract Full TimePlano, TX, United States1d ago
-
Staff Data Engineer USD 147K-184KAmazon Kinesis | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache SparkDental insurance coverage | Health insurance coverage | Paid parental leave | Paid vacation | Relocation assistanceSenior-level Full TimeBerkeley, CA1d ago
-
Associate, Client Intelligence (Data Scientist) USD 98K-132KAWS | Apache Spark | Azure | Big Data | Cloud platformEmployee resource groups | Matching gift program | Professional development | Sustainability and Climate Change Initiatives | Volunteerism programMid-level Full TimeNew York, NY, US, 100011d ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Aiohttp | Angular | Asyncio | Azure DatabricksRemote work | USPS Public Trust Clearance supportMid-level Full TimeWork from home, VA, United States1d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R1d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R1d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R1d ago
-
Senior Embedded Software Engineer, Linux USD 154K-230KC# | C++ | CI/CD | Cross-compilation | Device DriversLearning and development stipend | PTO | Parental leave | Sick leaveSenior-level Full TimeLong Beach, California, United States1d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R1d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R1d ago
-
AI Engineer USD 143K-210KAPI Integration | Audit trails | Authentication | CI/CD | Cost Optimization401k match | Casual work environment | Catered lunch | Comprehensive health insurance | Disability insuranceMid-level Full TimeLivingston, NJ / New York, NY …1d ago
-
Data Engineer USD 150K-250KAWS | Business Intelligence | DBT | Data Governance | Data LineageGrowth opportunities | Ownership | Startup environmentMid-level Full TimeSan Francisco1d ago
-
AWS | Agentic Workflows | CI/CD | Concurrency | DevOpsSenior-level Full TimeSunnyvale1d ago
-
Senior AI Data Science Engineer USD 142K-200KAirflow | Annotation Workflow | Anomaly Detection | Cloud Data | Cloud Data PlatformsSenior-level Full TimeSunnyvale, CA, United States1d ago
-
AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLink | Bash401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceMid-level Contract Full TimePlano, TX, United States1d ago
-
Software Engineer, Database Reliability & Performance USD 100K-168KAI tools | Automated testing | C++ | CI/CD | CircleCI401k | Annual professional development budget | Financial planning and legal advice | Flexible time off | Life insuranceMid-level Full TimeRemote US R1d ago
-
Embedded Firmware Engineer, Connected Warfare USD 166K-220KBare Metal | Board Bring-up | Bring-up | C# | CANEmployee assistance programs | Health benefits | Recovery support | Technology exposureEntry-level Full TimeCosta Mesa, California, United States1d ago
-
AI Architect USD 120K-197KAI orchestration | Automation | Cloud Computing | Data Governance | Distributed SystemsWeekly earned wage access optionSenior-level Full TimeDurant, OK, United States R1d ago