Databricks Architect
Dublin, OH, United States
A USD 150K-247K (estimate) Senior-level Full Time
Tasks
- Coordinate Agile Scrum delivery teams
- Develop ETL pipelines using Databricks
- Implement standardized pipelines with automated testing
- Integrate data across systems
- Integrate data with REST APIs
- Lead data engineering projects
- Manage scrum ceremonies and backlog
- Monitor systems with Splunk
- Optimize ETL pipelines for performance and cost
- Process real time data with Spark Structured Streaming
- Provision infrastructure with Terraform
- Schedule pipelines with Airflow
- Set up CI CD with Azure DevOps
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Apache Spark | Azure | Azure DevOps | CI/CD | Databricks | Delta Lake | ETL | GCP | Git | Infrastructure as Code | Kubernetes | Power BI | PySpark | Python | REST APIs | SQL | Scrum | Spark SQL | Spark Structured Streaming | Splunk | Structured Streaming | Terraform | “as-code”
Education
Related jobs
-
Data Engineering Analyst Lead/Scientist - Remote USD 90K-150KAWS | Data Compliance | Data Engineering | Data Privacy | PythonSenior-level Full TimeUnited States, UNITED STATES, United States R9h ago
-
Director, AI Solutions Architect USD 139K-225KAPI Gateway | Agent Orchestration | BigQuery | CI/CD | Cloud MicroservicesAfter-hours support | Occasional overtime | Occasional travelSenior-level Full TimeOak Brook, IL, United States14h ago
-
BigQuery | Curriculum Development | Data Governance | Data Lakehouse | Data ModelingAsynchronous hiring process | Part-time hoursSenior-level Part TimeBoston, US16h ago
-
Technical Architect – AI, ML & Generative AI USD 142K-240KAWS Bedrock | AWS SageMaker | Agentic AI | Apache Spark | Artificial Intelligence401k | Critical Illness Accident Hospital Indemnity Identity Theft Protection | Dental plans | Life and Accidental Death and Dismemberment | Long-term disabilitySenior-level Full TimeFrisco, United States17h ago
-
Solution Architect (AI & Data Applications) USD 180K-247KAutogen | CI/CD | Databricks | Docker | FastAPIMentoring system | Professional development | Supportive work environmentSenior-level Full TimeJersey City, NJ, United States21h ago
-
Principal Data Architect USD 160K-160KApache Spark | Azure | CI/CD | Data Governance | Data Lineage401k match | Employee wellness programs | Life insurance | Medical/Dental/Vision | Paid time offSenior-level Full TimeHouston, TX1d ago
-
Lead Director - Solution Engineering (AI/ML - GenAI) USD 144K-288KAPI Design | Agile | Amazon Web Services | Apache Kafka | Artificial IntelligenceDental insurance | Medical insurance | Paid time off | Retirement savings | Vision insuranceSenior-level Full TimeBuffalo Grove-2100 E Lake Cook, United …1d ago
-
Assistant Vice President, Legal Data Engineering USD 70K-130KAccess Control | Alerting | Batch Processing | Data Governance | Data ModelingEmployee assistance program | Employee networks | Flexible work/life support | Paid time off | Paid volunteer daysExecutive-level Full TimeBOSTON, United States1d ago
-
Data Domain Architect Lead USD 171K-205KArtificial Intelligence | Business Intelligence | Data Annotation | Data Modeling | Data ProcessingBackup childcare | Financial coaching | Health care coverage | Mental health support | On Site Health Wellness CentersSenior-level Full TimeWilmington, DE, United States1d ago
-
Solutions Architect, Strategic Retail - Central USD 180K-247KAccount Management | Apache Spark | Artificial Intelligence | Big Data | Cloud ComputingSenior-level Full TimeUnited States1d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R1d ago
-
Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDDental insurance | Health insurance | Professional development and training | Remote work flexibility | Retirement benefitsSenior-level Full TimeIdaho R1d ago
-
AI Foundry | APIs | Access Management | Azure AI | Azure AI FoundryEast Coast location flexibility | NYC based candidate salary transparency | Remote work opportunityMid-level Full TimeNew York City, NY, United States1d ago
-
Senior-level ContractATLANTA, GA1d ago
-
Senior-level Full TimeDallas, Texas, United States1d ago
-
Practice Lead, Data & Analytics USD 155K-200KAWS | Agile | Amazon Redshift | Azure | Azure Data401k matching | Flexible vacation | Medical/Dental/Vision | Training SponsorshipSenior-level Full TimeLos Angeles, CA2d ago
-
Senior Solutions Architect, Generative AI USD 184K-287KC# | C++ | Deep learning | Distributed Computing | GPUComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara, United States2d ago
-
Technical Delivery Lead USD 94K-164KAgentic AI | Apache Kafka | CI/CD | Cloud Native | Cloud Native ArchitectureBonus eligibility tied to performance | Comprehensive total rewards packageSenior-level Full TimeDayton WFH, United States R2d ago
-
Data and Analytics Technical Lead USD 142K-189KAPI Gateway | AWS | Business Intelligence | CloudFormation | Code Management401k match | Employee discounts | Floating holidays | Health coverage | Paid parental leaveSenior-level Full TimeCoppell - 0760, United States2d ago
-
VP, Remediation Analytics & Standards USD 170K-290KAgile | Audit Trail | Auditability | Automation | Controls DesignEmployee resource groups | Flexible location requirements | Relocation not specified | Work from home optionExecutive-level Full TimeCincinnati West Chester Site, United States2d ago
-
Teradata GCP Lead Data Engineer USD 76K-187KBatch scheduling | Capacity Planning | Cause analysis | Cloud platform | Data PipelinesCompany-Paid Holidays | Disability insurance | Employee assistance programs | Life insurance | Paid time offSenior-level Full TimeBridgewater, NJ, US2d ago
-
AWS | Artificial Intelligence | Cloud Computing | Data analytics | Foundation ModelsCareer growth resources | Mentorship | Work-life balanceSenior-level Full TimeSan Francisco, California, USA2d ago
-
Data Science Lead, Data Architect USD 152K-244KAgentic AI | Anomaly Detection | CRM Integration | Contract analytics | Data EngineeringAnnual bonus | Discretionary LTI bonus | Reimbursement of phone use | Reimbursement of vehicle useSenior-level Full TimeUSA NJ - Franklin Lakes, United …2d ago
-
Data Architect Senior - Retail Architecture USD 80K-194KApache Avro | Apache Kafka | Business Intelligence | Data Architecture | Data Modeling401k match | Dental insurance | Educational assistance | Health insurance | Life insuranceSenior-level Full TimeTwo PNC Plaza (PA374), United States2d ago
-
Embedded Software Engineering Specialist USD 128K-192KBash | C# | C++ | CI/CD | Debugging401k matching | Adoption benefits | Career development | Dental insurance | Disability benefitsSenior-level Full TimeMossville, Illinois, United States2d ago