Databricks Architect
United States - Remote
R
USD 180K-248K (estimate) Senior-level Full Time
Tasks
- Architect develop and debug PySpark jobs and data models
- Design and implement scalable end to end data solutions for ETL real time streaming and machine learning workloads
- Implement and enforce data governance security and access control policies
- Integrate Databricks with AWS services
- Provide technical leadership for Databricks adoption
- Tune Spark jobs and optimize data pipelines for performance
Perks/Benefits
Skills/Tech-stack
AWS | AWS Lambda | Access Control | Amazon EMR | Amazon S3 | Apache Spark | Auditing | Data Governance | DataOps | Databricks | ETL | Encryption | Machine Learning | Monitoring | PySpark | Real Time | Real-time Streaming | Security | Unity Catalog
Education
N/A
Related jobs
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsSenior-level Full TimeIdaho R1d ago
-
Technical Delivery Lead USD 94K-164KAgentic AI | Apache Kafka | CI/CD | Cloud Native | Cloud Native ArchitectureBonus eligibility tied to performance | Comprehensive total rewards packageSenior-level Full TimeDayton WFH, United States R2d ago
-
Data & Semantic Model Architect USD 140K-199KAPIs | Allotrope | CDISC | Common Data Model | Data GovernanceSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeBethesda, MD R2d ago
-
AWS | Airflow | Apache Spark | Data Governance | Data Quality401k matching | Bonus program | Equity plans | Medical, dental, and vision coverage | Merit-based salary increasesSenior-level Full TimeColumbia R2d ago
-
Power BI Architect USD 117K-238KAggregations | Azure | Azure Data | Azure Data Lake | Azure DatabricksCareer development opportunities | Entrepreneurial environment | High degree of individual responsibilitySenior-level Full TimeHouston, Texas, United States - Remote R2d ago
-
Manager, Data Engineering - Hybrid Schedule USD 75K-94KAWS | Agile | Apache Airflow | CI/CD | Data Architecture401k match | Company holidays | Discounts with preferred vendors | Employee assistance program | FSAMid-level Full TimeCharlotte, NC, US R4d ago
-
Data Engineer - Clearance Required USD 101K-174KDashboarding | Data Governance | Data Modeling | Data integration | Digital EngineeringSenior-level Full TimeRemote, United States R4d ago
-
Senior-level Full TimeUnited States - Remote R5d ago
-
Data Engineering Manager - Remote USD 116K-216KAccess Management | Azure Data | Azure Data Lake | Azure Data Lake Storage | Batch Processing401k match | Certification reimbursement | Disability insurance | Emergency backup care | Free access to CEUsSenior-level Full TimeSentara Park 1330, United States R5d ago
-
Data Architect (Hybrid - Cloud and On-Prem) USD 113K-188KAWS | Data Governance | Data Ingestion | Data Lineage | Data Modeling401k retirement plan | Adoption Assistance | Basic Life and Supplemental Life | Company-Paid Holidays | Dental and vision flexible spending accountSenior-level Full TimeGH Office: Tysons Corner, VA (Headquarters), … R5d ago
-
AI Solution Architect I USD 123K-190KAPI | Artificial Intelligence | Azure AI | Classification | Data Modeling401k match | Dental insurance | Employee assistance program | FSA plans | HSA contributionSenior-level Full TimeVirtual Office, United States R5d ago
-
Airflow | Apache Hadoop | Apache Kafka | Apache Spark | AvroMid-level Full TimePittsburgh, PA, United States R5d ago
-
Senior Consultant - Data Engineering / Data Architect USD 147K-253KAWS | Analytics | Azure | Cloud Computing | Dashboards401k match | Disability insurance | Hybrid work options after 90 days | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimePhoenix, AZ, US R5d ago
-
Sr. Principal Machine Learning Revenue Architect USD 192K-450KAnalytics | Big Data | Business Process | Business Process Architecture | Data MiningSenior-level Full TimeVirtual, United States R6d ago
-
Data Analyst-Tech Con-Data & Analytics-Data Arch & Eng-FSO-Manager-Multiple Positions-1707768 USD 181K-181KAWS | Big Data | Cassandra | Cloud Computing | Cloud platform401k plan | Dental insurance | Flexible vacation policy | Hybrid work model | Medical insuranceMid-level Full TimeHartford, CT, US, 06103 R6d ago
-
AI Integration Specialist - Customer Office USD 102K-193KAccess Control | Agent architecture | Amazon Quick | Amazon Redshift | Cause analysisAnnual wellness and community outreach days | Flexible time off | Flexible work environment | Global collaboration and networking opportunities | Recognition programSenior-level Full TimeArizona, United States R6d ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 130K-200KAI Foundry | AWS | AWS Bedrock | Architecture Review | Architecture Review BoardSenior-level Full TimeMiami Lakes, FL, United States R6d ago
-
Access control RBAC | Airflow | Apache Hadoop | Apache Kafka | Apache SparkMid-level Full TimePittsburgh, PA, United States R6d ago
-
Staff AI Architect, Family AI Lab USD 197K-290KAccess Control | Audit Logging | Batching | Caching | Cloud services401k company matching or RRSP DPSP plan | Employee assistance program | Equipment and tools reimbursement | Flexible PTO | Learning and development programsSenior-level Full TimeRemote, USA R6d ago
-
Director, Knowledge Graph & Semantics - HYBRID ROLE USD 216K-324KCypher | DBT | Data Lineage | Data Management | Data Modeling401k matching | Annual bonus | Annual equity awards | Commuting subsidy | Educational assistanceExecutive-level Full Time5000 - Vertex US - Fan … R7d ago
-
Senior Data Engineer - Hybrid USD 87K-124KAgile | Analytics | Cloud Data | Cloud data warehousing | DBT401k | Basic life insurance | Dental insurance | Disability insurance | EAPSenior-level Full TimeIselin, NJ, US R7d ago
-
Senior Data Architect - Hybrid USD 87K-124KAgile | Auditability | DBT | Data Architecture | Data Governance401k retirement plan | Basic life insurance | Disability insurance | Employee assistance program | Health savings accountsSenior-level Full TimeIselin, NJ, US R7d ago
-
Senior Data Architect USD 140K-205KAPIs | Amazon Web Services | CI/CD | Containers | Data GovernanceFlexible work arrangements | Professional development opportunitiesSenior-level Full TimeRemote - United States R7d ago