Databricks Pipeline Architect
Work from home, VA, United States
R
USD 150K-180K Senior-level Full Time
Tasks
- Advise stakeholders on data engineering
- Build AWS based ETL pipelines
- Create guidance and documentation for internal teams
- Design Databricks architecture for enterprise governance
- Develop Databricks use case applications
- Integrate Databricks with analytics platforms
- Integrate Databricks with metadata solutions
- Lead Databricks pipeline development
- Operate Databricks long term
- Standardize and migrate data to unified data platform
- Unify enterprise data capabilities
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web Services | Apache Spark | Data Engineering | Data Governance | Databricks | Delta Lake | Delta Sharing | ETL | Lakehouse Architecture | Medallion Architecture | Python | Web Services
Education
N/A
Roles
Architect | Data Engineer | Databricks Pipeline Architect | Engineer
Related jobs
-
Data and AI Engineer USD 120K-165KAWS | Agile | Azure | Big Data | Data ArchitecturePublic trust clearance required | Remote workMid-level Full TimeWork from home, VA, United States R9h ago
-
Sr. Data and AI Engineer USD 180K-200KAgile | Amazon Web Services | Azure | Big Data | Data ArchitecturePublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R9h ago
-
Principal Machine Learning Researcher (Physical AI) USD 200K-400KAnomaly Detection | C++ | Computational Geometry | Computer Vision | Deep learning401k | Casual dress | Company holidays | Employer paid Medical Dental Vision Insurance | Flexible work hoursSenior-level Full TimeLos Angeles, CA (On-site) R1d ago
-
C# | Combinatorics | Graph theory | Linear Algebra | MATLABFlexible hours | Part-time project-based workSenior-level FreelanceUnited States - Remote R1d ago
-
Senior Forward Deployed AI Engineer USD 106K-180KAWS | Automation | CI/CD | Distributed Systems | EmbeddingsBenefits | Bonus eligibility | Remote work optionSenior-level Full TimeUnited States - Remote R1d ago
-
Lead Engineer – Reactor Thermal-Hydraulics and Computational Methods (Remote Eligible, U.S.) USD 98K-188KComputational Methods | Fortran | Numerical analysis | Python | Quality AssuranceAdoption Assistance | Disability benefits | Employee assistance program | Health Coach | Life insuranceSenior-level Full TimeWilmington NC USA, United States R1d ago
-
EverCommerce - Data Engineer II USD 120K-140KAWS | Amazon Athena | Amazon EC2 | Apache Airflow | Apache Iceberg401k match | Employee stock purchase plan | Flexible time off | Health and wellness benefits | Professional developmentMid-level Full TimeRemote- US, United States R1d ago
-
Infrastructure Engineer USD 160KAWS | Alerting | Ansible | Bash | CI/CDEquity participation | Health and wellness benefits | Hybrid work option | Paid time off | Professional development opportunitiesMid-level Full TimeFremont (Hybrid), CA R1d ago
-
Senior Customer Solutions Resident Architect USD 146K-200KAmazon Redshift | Analytics engineering | Apache Airflow | DBT Cloud | Databricks401k plan | Flexible office space stipend | Health and wellness stipend | Healthcare coverage | Home office stipendSenior-level Full TimeUS - Remote R1d ago
-
API Security | AWS Lambda | Anthropic MCP) | Authentication | BigQuery100% remote | Annual leave | Company funded usage budget | Developer productivity budget | Equity RSUsSenior-level Full TimeUnited States (Remote) R1d ago
-
Senior Machine Learning Engineer - Camera Model USD 177K-212K3D Perception | BEV | CNN | Camera Calibration | Computer Vision100 percent paid medical dental and vision premiums | 401k employer match | Accidental death and dismemberment insurance | Company paid holiday office closures | Flexible scheduleSenior-level Full TimeRemote - U.S, Ann Arbor, MI R1d ago
-
Data Analytics Engineer I USD 100K-110KApache Airflow | Apache Spark | BigQuery | Cloud Run | Cloud platform401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundMid-level Full TimeRemote - USA R1d ago
-
Software Engineer, Data Infrastructure USD 153K-376KAI systems | Access Control | Apache Airflow | Apache Flink | Apache KafkaCell phone reimbursement | Company recharge days | Generous PTO | Learning and development stipend | Mental health and wellness benefitsMid-level Full TimeSan Francisco, CA • New York, … R1d ago
-
Sr. Staff Embedded AI Engineer USD 145K-185KBare Metal | C# | C++ | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Hybrid work model | Remote work optionSenior-level Full TimeColumbia, MARYLAND, United States R1d ago
-
Senior Software Engineer - Robotics USD 134K-184KAgent systems | Agentic AI | Agile | Algorithms | C++Remote work hybrid environment | Security clearance supportSenior-level Full TimeWoburn, MA R1d ago
-
AI Engineer (Hybrid) USD 130K-270KAmazon Web Services | Cloud Computing | Data Analysis | Data Modeling | Data Quality401k contribution | AD&D insurance | Health Savings Account contribution | Hybrid work | Life insuranceSenior-level Full TimeAnnapolis Junction, MD R1d ago
-
Senior-level Full TimeRemote US R1d ago
-
Data Architect USD 135K-195KAWS | Azure | Cloud Data | Cloud Data Platforms | Data Architecture401k | Day care reimbursement | Dental insurance | Health insurance | Life insuranceSenior-level Full TimePlymouth, MA, United States R1d ago
-
Data Engineer (remote) USD 110K-130KAWS | Airflow | Azure | Cloud infrastructure | Data Governance401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountMid-level Full TimeWork From Home, United States R1d ago
-
Principal Software Engineer, Data Platforms USD 170K-210KAPI Design | Automated testing | CI/CD | Data Governance | Data Lineage401k | Dental insurance | Employee discounts | Fully remote | Medical insuranceExecutive-level Full TimeOrlando, FL, United States R1d ago
-
Senior AI Engineer USD 150K-210KAPI Integration | Cloud Native | Cloud Native Services | Container Orchestration | EmbeddingsBenefits | Equity | High-trust work environment | MentorshipSenior-level Full TimeSF Bay Area (Hybrid) R1d ago
-
Senior Software Engineer, LLM Performance USD 180K-339KC++ | CUDA | Cutlass | FlashAttention | FlashInferSenior-level Full TimeSF Bay Area (Hybrid) R1d ago
-
Head of AI Sales USD 200K-300KAgent Orchestration | Agent systems | Anthropic | Apollo | Artificial Intelligence401k match | Dental | Disability insurance | EAP | ESPPExecutive-level Full TimeChicago (35 W. Wacker Dr.); Remote … R1d ago
-
Responsible AI Data Scientist USD 160K-175KAlgorithmic Fairness | Audit trails | Bias detection | Data Lineage | Data VisualizationBonuses | Hybrid work | Remote flexibility | Supportive collaborative environmentMid-level Full TimeChicago; New York R1d ago
-
Senior Data Engineer USD 100K-150KAPI Integration | DBT | Data Pipeline Development | Data pipeline | GDAL401k | Commuter benefits | Dental insurance | Employee stock option plan | Health insuranceSenior-level Full TimeNew York City R1d ago