Databricks Architect
Dublin, OH, United States
A USD 150K-247K (estimate) Senior-level Full Time
Tasks
- Coordinate Agile Scrum delivery teams
- Develop ETL pipelines using Databricks
- Implement standardized pipelines with automated testing
- Integrate data across systems
- Integrate data with REST APIs
- Lead data engineering projects
- Manage scrum ceremonies and backlog
- Monitor systems with Splunk
- Optimize ETL pipelines for performance and cost
- Process real time data with Spark Structured Streaming
- Provision infrastructure with Terraform
- Schedule pipelines with Airflow
- Set up CI CD with Azure DevOps
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Apache Spark | Azure | Azure DevOps | CI/CD | Databricks | Delta Lake | ETL | GCP | Git | Infrastructure as Code | Kubernetes | Power BI | PySpark | Python | REST APIs | SQL | Scrum | Spark SQL | Spark Structured Streaming | Splunk | Structured Streaming | Terraform | “as-code”
Education
Related jobs
-
AWS Database Architect - Cleared USD 138K-197KAWS CDK | AWS DMS | AWS KMS | AWS SCT | Amazon AuroraActive security clearanceSenior-level Full TimeWashington, DC, US14h ago
-
Associate Technical Architect - DE - Databricks USD 121K-202KAWS S3 | AWS Secrets | AWS Secrets Manager | AWS Step Functions | AirflowCareer development | Innovation-focused culture | Learning and growth | Work-life balanceMid-level Full TimeUSA - Remote, United States R14h ago
-
Global Analytics Lead / Architect USD 128K-173KAI insights | Azure Analytics | Azure Data | Azure Data Factory | Composite ModelsSenior-level Full TimeUnited States16h ago
-
Specialist Solutions Architect - AI & ML (Communications, Media, Entertainment & Games) USD 180K-247KAI guardrails | AWS | Agent Orchestration | Agentic Systems | Artificial IntelligenceMentorship | Remote work | Travel up to 30 percentSenior-level Full TimeUnited States16h ago
-
Manager, Data Engineering USD 112K-150KApache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure DataMid-level Full TimeAtlanta, Georgia19h ago
-
Manager, Data Engineering USD 160K-190KApache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure DataMid-level Full TimeChicago, Illinois19h ago
-
Staff Software Engineer, Data Engineering USD 193K-253KAWS | Airflow | Amplitude | BigQuery | CI/CD401k plan | Annual cash bonus | Dental insurance | Equity grants | Flexible time offSenior-level Full TimeRemote, USA R19h ago
-
Senior Data Architect USD 93K-202KAPI Integration | Access Control | Azure | Cloud Native | Cloud Storage401k matching | Adoption Assistance | Birthday off | Career development | Child care assistanceSenior-level Full TimeOakland, CA, United States20h ago
-
Analytics & AI Architect USD 143K-161KAzure AI | Azure Synapse | BI semantic models | BigQuery | Business Metrics401k | Dental insurance | Dog-friendly office | Health insurance | Life insuranceSenior-level Full TimeChanhassen, Minnesota, United States20h ago
-
Director, Data Platform & Analytics USD 173K-184KBigQuery | DBT | Dagster | Data Catalog | Data Governance401k match | Adoption support | Calm app access | Company holidays | Fertility supportExecutive-level Full TimeRemote - US R21h ago
-
Senior Lead Architect USD 120K-205KAWS Lambda | Amazon Web Services | Bash | Bitbucket | C#Career growth | Inclusive work environment | Philanthropic foundation support | Professional development | Team collaborationSenior-level Full TimeAlpharetta, GA, United States21h ago
-
Manager of Data Engineering USD 140K-160KARM Templates | Access Control | Active Directory | Apache Kafka | Apache Spark401k match | Accidental death and dismemberment insurance | Certification support | Dental insurance | Employee assistance programMid-level Full TimeVancouver, WA, United States22h ago
-
Enterprise AI Engineering Architect USD 180K-195KArtificial Intelligence | Azure | Cloud Architecture | Data Privacy | Data access401k company match | Dental insurance | Disability insurance | Employee stock purchase plan | Flexible schedulingSenior-level Full TimeWork From Home, United States R22h ago
-
AI & Data Solution Architect USD 140K-216KAccess Control | BigQuery | CI/CD | Data Lakehouse | Data LineageSenior-level Full TimeGeorgia, United States22h ago
-
Business Intel Architect - Power BI USD 68K-68KDAX | Data Lineage | Data Warehouse | Dataflow | Deployment PipelinesPaid sick leave | Paid vacation | Remote work within IowaSenior-level Full TimeIowa City1d ago
-
AWS | AWS Glue | AWS Lake Formation | Access Control | Amazon AuroraSenior-level Full TimeNewark, New Jersey, United States1d ago
-
Airflow | DBT | Data Engineering | Data Governance | Data QualityMid-level Full TimePiscataway, NJ, United States1d ago
-
AI Engineering | AI/ML | AI/ML frameworks | Agile | AzureRemote work | Travel up to 10 percentSenior-level Full TimeSan Jose, California, United States1d ago
-
AWS AppSync | AWS CloudFormation | AWS Elasticache | AWS EventBridge | AWS GlueSenior-level Full TimeJersey City, NJ, United States1d ago
-
Data Architecture | Data Governance | Data Privacy | Data Security | Data integrationAgile team | Remote workSenior-level Full TimeNew York, New York, United States1d ago
-
BI Desktop | Data Modeling | Data Visualization | Dimensional Modeling | Power BISenior-level Full TimeJersey City, NJ, United States1d ago
-
Alation | Azure DevOps | Cloud technologies | Collibra | DB2Senior-level Full TimeNew York, New York, United States1d ago
-
AWS | Agentic RAG | Agile | Automated testing | AzureCollaborative work environment | Hybrid work | Supportive teamSenior-level Full TimeNew York, New York, United States1d ago
-
Senior-level Full TimePhoenix, Arizona, United States1d ago
-
AWS | Agile | Data Modeling | Data Warehousing | DatabricksSenior-level Full TimeNew Brunswick, NJ, United States1d ago