Databricks Architect
United States - Remote
R
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Architect develop and debug PySpark jobs and data models
- Design and implement scalable end to end data solutions for ETL real time streaming and machine learning workloads
- Implement and enforce data governance security and access control policies
- Integrate Databricks with AWS services
- Provide technical leadership for Databricks adoption
- Tune Spark jobs and optimize data pipelines for performance
Perks/Benefits
Skills/Tech-stack
AWS | AWS Lambda | Access Control | Amazon EMR | Amazon S3 | Apache Spark | Auditing | Data Governance | DataOps | Databricks | ETL | Encryption | Machine Learning | Monitoring | PySpark | Real Time | Real-time Streaming | Security | Unity Catalog
Education
N/A
Related jobs
-
Senior Data Architect USD 184K-215KAWS | Azure | Cloud Computing | Data Architecture | Data CatalogingTelecommuting permittedSenior-level Full TimeCambridge, Massachusetts R17h ago
-
Data Engineering Manager USD 150K-185KAccess Control | CI/CD | Data Classification | Data Governance | Data Lineage401k match | Company funded HSA contributions | Flexible PTO | Life insurance | Medical, dental, and vision insuranceSenior-level Full TimeRemote (United States) R17h ago
-
Data Architect USD 120K-195KAPI Design | AWS GovCloud | AWS RDS | Amazon Aurora | Cloud ArchitectureFully remoteSenior-level Full TimeUnited States R1d ago
-
Senior-level Full TimeUS, CA, Remote, United States R1d ago
-
Data Platform Architect USD 100K-150KAWS | Alation | Amazon Redshift | Apache Hudi | Apache IcebergBenefits package | Career growth | Long-term engagement | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Staff AI Architect, Remote USD 139K-222KADRs | API Gateway | AWS | AWS CDK | AWS Secrets401k matching | Dental insurance | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
AI Governance | AWS | Analytics architecture | BI | Data Architecture401k match | Dental insurance | Employee assistance program | Employer HSA Options | Flexible work scheduleExecutive-level Full TimeTamarac, Florida, United States R1d ago
-
Senior Solutions Engineer, AI Infrastructure USD 184K-287KApache Slurm | Apache Spark | BeeGFS | Ceph | CheckpointingSenior-level Full TimeRemote, NY, US R1d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Data Platform Architect USD 100K-150KAccess Management | Alation | Amazon Redshift | Apache Flink | Apache HudiSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Data Architect USD 67K-96KAgile | Amazon Web Services | Change Management | Code review | Data ModelingSenior-level Full TimeVirtual, United States R2d ago
-
Engineer III - Data Analytics (Hybrid) USD 120K-180KAWS | Azure | Billing APIs | CI/CD | Cloud billing401k | Hybrid work schedule | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeUSA NY Remote, United States R2d ago
-
VP, Forward Deployed Data Engineering USD 239K-359KAWS Glue | AWS S3 | Access Control | Airflow | Amazon Redshift401k match | Career development | Dental insurance | Disability insurance | Education benefitExecutive-level Full TimeWash, 213 Washington St., Newark, NJ, … R2d ago
-
Analytics Architect USD 77K-123KCloud services | Data Governance | Data Modeling | Data Warehousing | Data integrationSenior-level Full TimeVirtual US OH, United States R2d ago
-
Senior Manager, Data Engineering USD 140K-165KApache Spark | Azure | Azure DevOps | CI/CD | Configuration Driven PipelinesDental insurance | Disability insurance | Flexible spending accounts | Health insurance | Health savings accountsSenior-level Full TimeRemote CW Site - USA - … R2d ago
-
Senior Manager, Data Engineering USD 93K-153KAWS | Azure | Batch data | Batch data pipelines | Cloud Platforms401k | Dental insurance | Disability insurance | Employee discounts | Employee stock purchase planSenior-level Full TimeTowson MD USA - 701 E … R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago
-
Manager, Data Engineering USD 129K-177KAgile | Change Management | Cloud Cost Optimization | Cost Optimization | Cybersecurity401k retirement savings | Life insurance | Long-term disability | Medical/Dental/Vision insurance | Occasional travel for meetingsMid-level Full TimeWork at Home - Kentucky, United … R4d ago
-
Staff Data Architect USD 181K-260KAWS | Apache Airflow | Auto Scaling | Automation | Azure401k match | Disability insurance | Flexible time off | Health, dental, and vision insurance | HolidaysSenior-level Full TimeUnited States R4d ago
-
Senior Data Architect USD 130K-205KAPI | AWS | Amazon SageMaker | Apache Spark | CI/CDAgile environment | Flexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R4d ago
-
Sr. Solutions Engineer - AI Natives Business USD 152K-209KAWS | Apache Spark | Azure | Data Engineering | Data ScienceAnnual performance bonus | Equity | Remote work | Travel requiredSenior-level Full TimeRemote - California; Remote - Colorado; … R4d ago
-
AI tools | CI/CD | Cloud services | Dimensional Modeling | ETLHybrid workSenior-level ContractAustin, United States R4d ago
-
Senior AI Engineer USD 160K-200KAPI Gateway | AWS ECS | AWS Fargate | AWS IAM | Amazon APIHealth care benefitsSenior-level Full TimeUnited States R5d ago
-
Senior-level Full TimeSystem Services-Telecommuter, United States R5d ago