Databricks Engineer and Architect
Tasks
- Apply infrastructure as code
- Architect cloud data solutions
- Build CI/CD pipelines
- Build production grade analytics systems
- Champion SDLC best practices
- Conduct code reviews
- Configure access controls
- Design scalable data pipelines
- Develop production code using DevOps practices
- Enable lineage tracking
- Implement data cataloging
- Implement data governance frameworks
- Implement observability practices
- Integrate structured and unstructured data
- Lead design and implementation of risk technology solutions
- Mentor and influence technical standards
- Migrate legacy systems to cloud
- Monitor and troubleshoot production systems
- Monitor data quality
- Optimize relational database performance
- Own technical roadmaps
- Perform automated testing
- Tune system performance
Perks/Benefits
- Employee assistance program
- Employee benefits
- Free financial counseling
- Health coaching
- Hybrid work schedule
- Leadership development
- Paid time off
- Parental leave
- Tuition assistance
- Workplace training
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Access Control | Amazon Athena | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon EMR | Amazon Redshift | Amazon S3 | Application Resiliency | Aurora PostgreSQL | Automated testing | Bash | CI/CD | Code review | Data Cataloging | Data Governance | Data Lineage | Data Quality | Databricks | Databricks Workflows | DevOps | Infrastructure as Code | MLflow | MySQL | Observability | Performance Tuning | PostgreSQL | PySpark | Python | Relational databases | SDLC | SQL | Unity Catalog | YAML | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
AI Engineer USD 103K-140KAI Agents | AI Studio | Access Control | Anthropic Claude | AuthenticationBonus eligibleSenior-level Full TimeDenver, CO, United States8h ago
-
Director, Data Governance & Observability USD 165K-190KAPI Design | Alerting | Automated testing | CI/CD | DashboardsExecutive-level Full TimeNew York, NEW YORK, United States9h ago
-
Senior-level Full TimeCincinnati, OH, United States10h ago
-
Bill of Materials | Change Management | Data Cleansing | Data Governance | Data Migration401k | Collaborative team environment | Cross training | Dental insurance | Medical insuranceMid-level Full TimeWichita, KS, United States10h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States12h ago
-
Data Architecture SME USD 95K-109KBPMN | DODAF | Data Warehousing | Database Architecture | Dimensional Modeling401k plan with company matching | Bereavement | Dental and vision care | Employee assistance program | Employee discount programSenior-level Full TimeScott Air Force Base, IL, United …13h ago
-
Director, AI Solutions Architect USD 139K-225KAPI Gateway | Agent Orchestration | BigQuery | CI/CD | Cloud MicroservicesAfter-hours support | Occasional overtime | Occasional travelSenior-level Full TimeOak Brook, IL, United States13h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R13h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R13h ago
-
Senior DevOps Engineer ID63545 USD 135K-185KAWS | Apache Airflow | ArgoCD | Azure | BigQueryFlextime | Growth roadmaps | Mentorship | Office work options | Remote work optionsSenior-level Full TimeMiami, United States15h ago
-
BigQuery | Curriculum Development | Data Governance | Data Lakehouse | Data ModelingAsynchronous hiring process | Part-time hoursSenior-level Part TimeBoston, US16h ago
-
Evergreen - Mathematics for Machine Learning USD 80K-300KAutodiff | JAX | Linear Algebra | Matrix Operations | NumPyAsynchronous hiring process | Flexible collaboration | Part-time hoursMid-level Full TimeBoston, US16h ago
-
Technical Architect – AI, ML & Generative AI USD 142K-240KAWS Bedrock | AWS SageMaker | Agentic AI | Apache Spark | Artificial Intelligence401k | Critical Illness Accident Hospital Indemnity Identity Theft Protection | Dental plans | Life and Accidental Death and Dismemberment | Long-term disabilitySenior-level Full TimeFrisco, United States16h ago
-
Senior Director, AI / Machine Learning Software Engineer USD 136K-300KApache Flink | Apache Spark | CI/CD | Data Lineage | Data PrivacyHealth benefits | Paid leave | Paid volunteer timeSenior-level Full TimeNew York, NY, United States16h ago
-
Data Engineering | Machine Learning | Machine Learning Pipelines | Python | Recommendation SystemsSenior-level Full TimeSan Jose, California, United States17h ago
-
Data Pipelines | Full Stack | Full-Stack Development | Machine Learning | PythonSenior-level Full TimeSan Jose, California, United States17h ago
-
C++ | Data Analysis | Data Manipulation | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA18h ago
-
Software Engineer, Machine Learning USD 207K-300KC++ | Data Processing | Experimentation | Information Retrieval | Just-in-TimeSenior-level Full TimeNew York, NY, USA; Mountain View, …18h ago
-
Software Engineer Manager II, Embedded Systems, Firmware USD 207K-300KAgile project management | Automated testing | C++ | Direct memory access | Embedded operating systemsSenior-level Full TimeSunnyvale, CA, USA18h ago
-
Artificial Intelligence | C++ | CSS | Data Storage | Distributed ComputingSenior-level Full TimeNew York, NY, USA18h ago
-
Associate Principal, Trust and Safety, GenAI USD 142K-205KAbuse prevention | Cybersecurity | Dashboards | Data Transformation | Data VisualizationMid-level Full TimeWashington D.C., DC, USA; Seattle, WA, …18h ago
-
Customer Engineer, Data Analytics, Google Cloud USD 153K-222KBatch Processing | Big Data | Cloud Architecture | Cloud platform | Customer RequirementsSenior-level Full TimeSunnyvale, CA, USA18h ago
-
C++ | Data Processing | Debugging | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA18h ago
-
Silicon Design Verification Engineer, Quantum AI USD 138K-198KARM | C-based testing | Chip verification | Constrained random | Constrained random verificationMid-level Full TimeMountain View, CA, USA; Goleta, CA, …18h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KC++ | Capacity Planning | Cloud Databases | Data Migration | Data PipelinesTravel up to 30 percentMid-level Full TimeReston, VA, USA18h ago