Databricks Architect
United States - Remote
R
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Architect develop and debug PySpark jobs and data models
- Design and implement scalable end to end data solutions for ETL real time streaming and machine learning workloads
- Implement and enforce data governance security and access control policies
- Integrate Databricks with AWS services
- Provide technical leadership for Databricks adoption
- Tune Spark jobs and optimize data pipelines for performance
Perks/Benefits
Skills/Tech-stack
AWS | AWS Lambda | Access Control | Amazon EMR | Amazon S3 | Apache Spark | Auditing | Data Governance | DataOps | Databricks | ETL | Encryption | Machine Learning | Monitoring | PySpark | Real Time | Real-time Streaming | Security | Unity Catalog
Education
N/A
Related jobs
-
API Development | AWS | Azure | Data Lake | Data Modelling401k plan | Certification sponsorship | Dental insurance | Diversity and inclusion initiatives | Learning opportunitiesSenior-level Full TimeNew York R1d ago
-
Technology Partner - Data & Insights Solutions. USD 120K-150KAzure | Big Data | Business Intelligence | Columnar | Data CatalogCareer development opportunities | High responsibilityMid-level Full TimeDallas, Texas, United States - Remote R1d ago
-
Sr Cloud Data Architect USD 120K-160KAWS | AWS Glue | AWS Lambda | Airflow | Amazon CloudWatchLearning budget | Medical and dental | Mental health support | Professional development | Retirement planningSenior-level Full TimeRemote, United States R1d ago
-
Senior Director, Data & AI Platform Engineering USD 136K-230KAI personalization | Bash | BigQuery | CI/CD | Cloud DataSenior-level Full TimeFlorida Remote Worker, United States R1d ago
-
Director, Data & Analytics Engineering USD 159K-159KApache Hive | Apache Spark | Data Modeling | Data profiling | Database performanceTelecommuting up to 3 days per weekExecutive-level Full TimeAlpharetta GA 1 Edison, United States R1d ago
-
Security Data Engineer and Governance, VP USD 140K-140KAI analytics | AWS | AWS CloudTrail | Amazon CloudWatch | Amazon S3Executive-level Full TimeTampa - 4050 West Boy Scout … R1d ago
-
Data Architect - Interfell (Remote) USD 110K-174KAWS | Access Control | CI/CD | Data Governance | Data ModelingRemote work | Technical guidance supportSenior-level Full TimeSan Francisco, United States of America R1d ago
-
Data Engineering Manager USD 190K-230KAirflow | Data Modeling | Databricks | Distributed Systems | ETL401k match | Flexible vacation | Flexible work hours | Learning reimbursement | Parental leaveMid-level Full TimeUS Remote R1d ago
-
Amazon Connect & GenAI Solutions Architect USD 153K-204KAPI Gateway | AWS | AWS Lambda | AWS Well Architected | AWS Well-Architected FrameworkCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeUnited States, Canada R2d ago
-
Manager, Data & Intelligence (Remote) USD 140K-150KAttribution Modeling | Azure Data | Azure Data Lake | Azure DevOps | Customer lifecyclePeople management development | Professional development support | Remote workMid-level Full TimeTwinsburg, OH, United States R2d ago
-
Staff Security Engineer USD 123K-200KABAC | API Design | Access Management | Active Directory | AuditingSenior-level Full TimeRemote, United States R2d ago
-
Business Systems Data Architect USD 132K-150KData Governance | Data Lineage | Data Model | Data Modeling | Data Quality401k match | Dental insurance | Education benefits | Flexible spending accounts | Health insuranceSenior-level Full TimeUnited States - Remote R2d ago
-
Data Engineer I USD 30K-36KACID | Apache Spark | Azure | Azure DevOps | Batch Data Processing401k match | Community giveback paid time off | Employee assistance program | Employee discounts | FSAEntry-level Full TimeUnited States - Remote R2d ago
-
Lead Data Engineer USD 150K-191KAccess Control | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeHealth insurance | Paid time off | Remote work optionSenior-level Full TimeUnited States, United States R2d ago
-
Data Engineering Manager USD 110K-130KAgile | Azure DevOps | CI/CD | Cause analysis | Databricks401k company match | Commuter benefits | Dental insurance | Flexible PTO | Gym discountsMid-level Full TimeUnited States - Remote R2d ago
-
Sr Principal Data Architect USD 142K-214K3NF | AWS | Data Governance | Data Modeling | Data Sharing401k | Accident insurance | Dental insurance | Employee assistance program | Employee stock purchase programSenior-level Full TimeRemote Idaho, United States R2d ago
-
Data Architect-Cloud Architect USD 150K-220KAWS Redshift | Apache Spark | Azure Synapse | C# | Data Modeling401k match | Paid Holidays | Paid time off | Professional development fund | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Director, Data Engineering, ML & AI USD 166K-215KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Artificial Intelligence401k matching | Bonus potential | Flexible PTO | Flexible work hours | Fully remoteExecutive-level Full TimeRemote (United States) R2d ago
-
Technical Solutions Architect I - Storage USD 110K-138KAccess Control | Amazon S3 | Architectural Diagrams | Case Development | Cloud401k matching | Bereavement leave | Dental care | Disability insurance | Employee assistance programSenior-level Full TimeRemote - Nationwide, United States R2d ago
-
GenAI Architect - Agentic USD 156K-202KAPI Gateway | AWS | AWS Bedrock | AWS Lambda | AWS Step FunctionsLearning and growth | Remote workSenior-level Full TimeUSA - Remote, United States R3d ago
-
Data Engineer - Data Warehouse Architect USD 74K-125KApache Spark | CI/CD | Containerization | Data Governance | Data ModelingSenior-level Full TimeNationwide Remote Office (US99), United States R3d ago
-
AVP, Data Engineering USD 163K-245KAI-Ready Data | ANSI SQL | Apache Spark | Azure | Code reviewHealth benefits | Professional development | Remote work | Retirement benefits | Time offExecutive-level Full TimeWork at Home - Fort Smith … R3d ago
-
Alerting | BigQuery | CI/CD | Cloud Computing | Cloud platformRemote workMid-level Full TimeGEORGIA - VIRTUAL - GA01, United … R3d ago
-
DSCA Data Architect Senior - 28235 USD 135K-155KAWS Glue | AWS S3 | Azure Databricks | Cloud Computing | Data Architecture401k savings plan | Employee assistance program | Life insurance | Medical/Dental/Vision insurance | Paid HolidaysSenior-level Full TimeArlington, VA, Remote, United States R4d ago
-
Data Analyst - TC - Data and Analytics - DAE - FSO - Manager - Multiple Positions - 1700919 USD 215KAmazon Web Services | Cassandra | Cloud Data | Cloud Data Modernization | Cloud platform401k | Continuous learning | Dental insurance | Health insurance | Hybrid work modelMid-level Full TimeChicago, IL, US, 60606 R4d ago