Databricks Architect
Dublin, OH, United States
A USD 150K-247K (estimate) Senior-level Full Time
Tasks
- Coordinate Agile Scrum delivery teams
- Develop ETL pipelines using Databricks
- Implement standardized pipelines with automated testing
- Integrate data across systems
- Integrate data with REST APIs
- Lead data engineering projects
- Manage scrum ceremonies and backlog
- Monitor systems with Splunk
- Optimize ETL pipelines for performance and cost
- Process real time data with Spark Structured Streaming
- Provision infrastructure with Terraform
- Schedule pipelines with Airflow
- Set up CI CD with Azure DevOps
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Apache Spark | Azure | Azure DevOps | CI/CD | Databricks | Delta Lake | ETL | GCP | Git | Infrastructure as Code | Kubernetes | Power BI | PySpark | Python | REST APIs | SQL | Scrum | Spark SQL | Spark Structured Streaming | Splunk | Structured Streaming | Terraform | “as-code”
Education
Related jobs
-
Data Engineer USD 86K-128KData Modeling | Data Pipelines | Data Warehouse | Data integration | Desktop Development401k matching | Disability insurance | Holiday pay | Life insurance | Medical, dental & vision coverageEntry-level Full TimeHuntsville, AL, United States11h ago
-
Google AI Architect USD 150K-241KAdversarial Attacks | BigQuery | CI/CD | Cloud Build | Cloud RunTravel up to 50%Senior-level Full TimeDallas, Texas, United States; Houston, Texas, …14h ago
-
Data Architect with Snowflake & AI Platforms USD 105K-169KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureCompany-Paid Holidays | Dental insurance | Employee assistance program | Health insurance | Life and disability insuranceSenior-level Full TimeNew York, NY, US1d ago
-
Senior-level Full TimeWaterside Bldg, United States1d ago
-
Applications Development Technology Lead Analyst USD 142K-213KApache Hive | Apache Iceberg | Apache Spark | Automated testing | Autosys401k matching | Health, dental, vision insurance | Paid time off | Wellness programsSenior-level Full Time480 WASHINGTON BOULEVARD JERSEY CITY, United …1d ago
-
Data Solutions Architect USD 170K-196KApache Spark | Databricks | Microsoft Azure | Python | R401k company match | Health and wellness benefits | Paid time off | Remote workSenior-level Full TimeUSA MD Home Office (MDHOME), United …1d ago
-
Surveillance Data Engineering Manager USD 77K-133KAgile | Big Data | Cloud Native | Cloud-native computing | Contract testingMid-level Full Time142019-NC-300 South Brevard, Charlotte, United States1d ago
-
Advanced AI Architect USD 136K-177KAI Foundry | AWS Bedrock | ArgoCD | Artificial Intelligence | Audit LoggingSenior-level Full TimeAEP Headquarters, United States1d ago
-
Data Architect Sr USD 92K-171KBusiness Intelligence | Data Architecture | Data Modeling | Data Warehousing | Data integration401k match | Dental insurance | Disability insurance | Educational assistance | Health insuranceSenior-level Full TimeDenver - 12345 W Colfax (CO147), …1d ago
-
Senior Director, Data & AI Platform Engineering USD 136K-230KAI personalization | Bash | BigQuery | CI/CD | Cloud DataSenior-level Full TimeFlorida Remote Worker, United States R1d ago
-
Director, Data & Analytics Engineering USD 159K-159KApache Hive | Apache Spark | Data Modeling | Data profiling | Database performanceTelecommuting up to 3 days per weekExecutive-level Full TimeAlpharetta GA 1 Edison, United States R1d ago
-
AI Data Architect USD 160K-200KAWS | Azure | Data Engineering | Docker | GCPMental health services | Paid parental leave | Paid time off for vacation sick and personal daysSenior-level Full TimeCarmel - Indiana, United States1d ago
-
Director of Data Engineering USD 132K-165KADLS Gen2 | Access Control | Alerting | Azure | Azure DataMental health services | Paid parental leave | Paid time off | Paid vacation | Personal daysExecutive-level Full TimeChicago - Illinois - Wacker, United …1d ago
-
Enterprise Analytics BID USD 99K-149KAPI Integration | Artificial Intelligence | Azure Data | Azure Data Factory | Azure SQLCareer advancement | Free access to fitness center | Healthcare benefits | Onsite childcare | Retirement plansMid-level Full TimeEvansville, Indiana, United States1d ago
-
Data Architect - Interfell (Remote) USD 110K-174KAWS | Access Control | CI/CD | Data Governance | Data ModelingRemote work | Technical guidance supportSenior-level Full TimeSan Francisco, United States of America R1d ago
-
Data Engineering Manager USD 190K-230KAirflow | Data Modeling | Databricks | Distributed Systems | ETL401k match | Flexible vacation | Flexible work hours | Learning reimbursement | Parental leaveMid-level Full TimeUS Remote R1d ago
-
AI Architect, Partner Co-Innovation, Google Cloud USD 183K-265KAlloyDB | Ansible | BigQuery | C plus plus | ContainerizationSenior-level Full TimeSunnyvale, CA, USA; Atlanta, GA, USA1d ago
-
Senior Data Architect USD 118K-160KAPI Integration | Analytics Cloud | Azure | Azure Dataverse | Azure SynapseRemote work up to 2 days per weekSenior-level Full TimeNew York, NY, United States1d ago
-
Amazon Connect & GenAI Solutions Architect USD 153K-204KAPI Gateway | AWS | AWS Lambda | AWS Well Architected | AWS Well-Architected FrameworkCertification programs | Health insurance | Internal mobility | Language courses | MentorshipSenior-level Full TimeUnited States, Canada R1d ago
-
Manager, Data & Intelligence (Remote) USD 140K-150KAttribution Modeling | Azure Data | Azure Data Lake | Azure DevOps | Customer lifecyclePeople management development | Professional development support | Remote workMid-level Full TimeTwinsburg, OH, United States R1d ago
-
Data Architect USD 106K-150KAPI Integration | Airflow | CCPA | Cost Optimization | DBT401k matching | Dental insurance | Disability coverage | Life insurance | Long-term incentivesSenior-level Full TimePiscataway, NJ, US1d ago
-
BIBA Practice - Cloud Senior Data Warehouse Architect USD 148K-220KBatch Processing | Big Data | Cloud Architecture | Cost Optimization | Data ProcessingSenior-level Full TimeUnited States1d ago
-
AIOps | API Design | APM | AWS GovCloud | Application Performance ManagementSenior-level Full TimeHerndon, VA, United States1d ago
-
Staff Partner Engineer, Azure USD 150K-206KAI Platform | AI Platform Integration | API Integration | Apache Spark | Architecture DiagramsAnnual performance bonus | EquitySenior-level Full TimeNew York City, New York; San …1d ago
-
Data Engineer - Production Support USD 74K-99KADLS | Azure | Azure Data | Azure Data Factory | Azure Databricks401k match | Employee assistance program | Employee stock purchase plan | Health and wellness allowance | Hybrid work environmentMid-level Full TimeIrving - 6011 Connection, United States2d ago