Databricks Architect
New York, New York, United States
R
A USD 175K-248K (estimate) Senior-level Full Time
Tasks
- Automate pipeline testing
- Coordinate agile delivery
- Develop ETL pipelines
- Handle escalations
- Implement standardized data pipelines
- Improve performance
- Integrate data across platforms
- Integrate data with REST APIs
- Lead data engineering projects
- Manage backlog items
- Monitor systems with Splunk
- Optimize ETL pipelines
- Process real time data with Spark Structured Streaming
- Provision infrastructure with Terraform
- Reduce compute and storage cost
- Run Scrum ceremonies
- Schedule workflows with Airflow
- Set up CI CD with Azure DevOps
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Apache Airflow | Apache Spark | Azure | Azure DevOps | CI/CD | Databricks | Delta Lake | ETL | GCP | Git | Infrastructure as Code | Kubernetes | Power BI | PySpark | Python | REST API | SQL | Scrum | Spark SQL | Spark Structured Streaming | Splunk | Structured Streaming | Terraform | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Airflow | Apache HBase | Azure | Cloud platform401k matching | Company stipend benefits | Digital On Demand Learning | Disability insurance | Employee resource groupsSenior-level Full TimeColumbus, OH, United States R2d ago
-
Senior Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Apache Airflow | Azure | Azure Cosmos | Azure Cosmos DB401k matching | Disability insurance | Employee resource groups | Fertility coverage | Flexible work environmentSenior-level Full TimePhiladelphia, PA, United States R2d ago
-
Senior Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon DynamoDB | Amazon Kinesis | Apache Airflow | Apache HBase401k matching | Company stipend benefits | Disability insurance | Employee resource groups | Fertility coverageSenior-level Full TimeCharlotte, NC, United States R2d ago
-
Senior Data Architect (AWS, Azure, GCP) USD 115K-200KAWS | Amazon DynamoDB | Amazon Kinesis | Apache Airflow | Azure401k matching | Certification support | Disability insurance | Employee resource groups | Employer Paid StipendSenior-level Full TimeAtlanta, GA, United States R2d ago
-
Senior Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon Kinesis | Apache Airflow | Azure | Cloud platform401k matching | Disability insurance | Health coverage | Learning and development programs | Mental health supportSenior-level Full TimeReston, VA, United States R2d ago
-
Senior Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon DynamoDB | Amazon Kinesis | Apache Airflow | Apache HBase401k matching | Disability insurance | Employee Stipend Program | Employee resource groups | Fertility coverageSenior-level Full TimeRichmond, VA, United States R2d ago
-
Teradata Architect USD 100K-200KArchitecture | Data Mover | Data Warehousing | ETL | Informatica401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level ContractNorth Chicago, Illinois, USA R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Airflow | Azure | CosmosDB | Data GovernanceCompany stipend | Digital learning courses | Disability insurance | Employee resource groups | Employer Sponsored FundsSenior-level Full TimeAtlanta, GA, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon DynamoDB | Amazon Kinesis | Apache Airflow | Apache HBaseCertification support | Company Paid Stipend | Disability insurance | Employee resource groups | Flexible work environmentSenior-level Full TimeDenver, CO, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon DynamoDB | Amazon Kinesis | Apache Airflow | AzureDisability insurance | Employee Stipend Program | Employee resource groups | Fertility coverage | Generous PTOSenior-level Full TimeChicago, IL, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformDisability insurance | Employee resource groups | Fertility coverage | Flexible work environment | Health coverageSenior-level Full TimeColumbus, OH, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon Kinesis | Apache Airflow | Azure | CosmosDBDigital learning courses | Disability insurance | Employee Stipend Program | Employee resource groups | Fertility coverageSenior-level Full TimeCharlotte, NC, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Apache Airflow | Apache Spark | Azure | Azure CosmosDigital learning courses | Disability insurance | Employee resource groups | Employer Sponsored Funds | Fertility coverageSenior-level Full TimePhiladelphia, PA, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Amazon Kinesis | Apache Airflow | Azure | Cloud platform401k matching | Company Stipend Program | Disability insurance | Employee resource groups | Employer Sponsored Fertility CoverageSenior-level Full TimeReston, VA, United States R2d ago
-
Data Architect (AWS, Azure, GCP) USD 120K-200KAWS | Airflow | Azure | CosmosDB | Data Governance401k matching | Disability insurance | Employee resource groups | Employee stipend | Fertility coverageSenior-level Full TimeRichmond, VA, United States R2d ago
-
Java | Proof of Concept | Public Cloud | Python | ScalaSenior-level Full TimeUnited States R2d ago
-
AI SME - Applied AI & Machine Learning USD 176K-264KAI Assisted Development | API Design | Agile | Architecture Frameworks | Artificial IntelligenceSenior-level Full TimeRemote - US R2d ago
-
Data Architect USD 170K-200K3NF | AWS | Airflow | CI/CD | DBTDental insurance | Employee assistance program | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeNew York, New York, USA R3d ago
-
Applied AI Specialist USD 171K-200KAPIs | Anomaly Detection | Cloud Native | Cloud Native Architecture | ComplianceCareer development | Employee resource groups | Flexible work from home | Generous PTO | Internet reimbursementSenior-level Full TimeUS-Washington-Remote, United States R3d ago
-
Lead Data Architect (Healthcare) USD 147K-246KABAC | AI | Analytics | Azure | CI/CDHybrid work | On site work two days per week | Remote work optionSenior-level Full TimeIrving, TX, USA - 6555 North … R3d ago
-
Lead Data Engineer - GCP AI Architect USD 144K-190KAgent | Agent systems | Agentic AI | Automated Deployment | BigQueryPaid time offSenior-level Full TimeChicago, US R3d ago
-
Data Solutions Architect USD 127K-175KApache Spark | Automated testing | Azure | Azure Data | Azure Data Factory401k match | ADandD insurance | Company store | Dental insurance | Employee assistance programSenior-level Full TimeUSA - Remote, United States R3d ago
-
Enterprise Architect, Data & Analytics (REMOTE) USD 121K-219KAPI Design | Agile | Agile Framework | Architecture Strategy | Architecture governance401k matching | Career growth opportunities | Flexibility | Health insurance | Paid time offSenior-level Full TimeHUNT VALLEY, MD, US, 21031 R3d ago
-
Applied AI Strategist - Senior Manager - Location OPEN USD 150K-343KAI Governance | Access Control | Agent systems | Amazon Web Services | Artificial Intelligence401k plan | Flexible vacation | Hybrid work | Medical and dental coverage | Paid HolidaysSenior-level Full TimeChicago, IL, US, 60606 R3d ago
-
Big Data Architect USD 100K-150KAmazon Redshift | Apache Kafka | Apache Spark | BigQuery | Cloud PlatformsRemote workSenior-level Full TimeUnited States - Remote R3d ago