Senior Data Engineer/Architect - Databricks
Remote South Carolina, Remote South Carolina, SC, United States
R
USD 150K-170K Senior-level Full Time
Tasks
- Analyze complex data and document findings
- Build real time streaming and batch ingestions
- Create ADF and Databricks Workflows pipelines
- Design AI-ready data structures
- Design Medallion Architecture
- Develop data and AI pipeline code
- Govern Databricks using Unity Catalog
- Integrate and support ML model outputs into data products
- Maintain databases and Databricks environments
- Optimize Delta Lake tables
- Own Databricks ingestion and output pipelines
- Perform code reviews
- Prepare data for predictive and prescriptive modeling
Perks/Benefits
- 401k match
- Employee assistance program
- Medical/Dental/Vision insurance
- Paid Holidays
- Paid parental leave
- Paid time off
- Remote flexibility
- Sabbatical
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure OpenAI | Azure SQL | CI/CD | Cosmos DB | Data Factory | Data Governance | Data Lakes | Data Lakes Gen 2 | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | Dimensional Modeling | ETL | Event Hub | Machine Learning | Power BI | Python | SQL Server | SQL Server stored procedures | Stored Procedures | Structured data | T-SQL | Unity Catalog | Unstructured Data
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Information Technology | Bachelor of Science
Roles
Related jobs
-
Senior-level Full TimeRemote Northeast (Fitzgerald), United States R10h ago
-
Azure Data | Azure Data Factory | Cloud Data | Cloud Data Architecture | Data ArchitectureCross-functional collaboration | Remote workMid-level Full TimeSan Francisco, United States of America R22h ago
-
Data Modeling | Deep learning | Ecommerce | Fine Tuning | Human-in-the-loopEquity | Health benefits | Hybrid work flexibility | Remote work up to 4 weeks per yearSenior-level Full TimeSan Francisco, CA R1d ago
-
Senior Data Engineer USD 115K-145KAWS S3 | Airflow | Azure Blob | Azure Blob Storage | Blob Storage401k | Dental insurance | Discounts | Medical insurance | Paid leaveSenior-level Full TimeNew York, NEW YORK, United States R1d ago
-
Robotics ML Expert, AI USD 60K-60KControl Systems | Dm_control | Domain Randomization | Gymnasium Robotics | JAXAsync collaboration | Flexible schedule | Remote workSenior-level Full TimeMiami R1d ago
-
BI Data Engineer (Remote WA, OR, ID & CA) USD 88K-116KAzure Synapse | C# | DAX | Data Governance | Data Modeling401k match | Health insurance | Paid Holidays | Paid vacation | Sick timeMid-level Full TimeBellevue, Washington R1d ago
-
Machine Learning Engineer USD 185K-260KAdvertising Auctions | Airflow | BigQuery | Convolutional Neural Networks | Data Pipelines401k employer match | Caregiving support programs | Comprehensive healthcare benefits | Family planning support | Flexible vacationMid-level Full TimeRemote - United States R1d ago
-
Senior Data Engineer USD 119K-161KAnalysis Services Tabular | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeDenver, CO, United States R1d ago
-
Senior Data Engineer USD 119K-161KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship opportunities | Remote workSenior-level Full TimeKansas City, MO, United States R1d ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAgentic Workflows | Azure | Azure Data | Azure Data Services | Bicep401k | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R1d ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAzure | Bicep | CI/CD | Docker | Kubernetes401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeEdison, NJ, United States R1d ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KApache Kafka | Azure | Azure Data | Azure Data Factory | Azure Databricks401k | Dental insurance | Employee stock purchase plan | Life insurance | Long-term disability insuranceSenior-level Full TimeEllenwood, GA, United States R1d ago
-
Data Engineer III/Senior (AI and Gen AI) USD 130K-150KAzure | CI/CD | Compliance | Data Lineage | Data Quality401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeRomulus, MI, United States R1d ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Docker | Git401k match | Annual tech and gadget budget | Education and training benefits | Healthcare dental vision insurance | Paid HolidaysSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R1d ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Container hardening | Docker401k match | Annual tech budget | Education & training benefits | Flexible work options | Health, dental, vision coverageSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R1d ago
-
Principal MLOps Engineer USD 150K-200KAWS | Azure | CI/CD | Docker | Git401k match | Annual snacks budget | Education and training benefits | Fully covered healthcare dental and vision | Paid HolidaysSenior-level Full TimeRemote, US; DMV; McLean, VA; Boston, … R1d ago
-
Staff Data Engineer, tvScientific USD 177K-364KAWS | AWS Glue | Access Control | Amazon Redshift | Amazon S3Senior-level Full TimeSan Francisco, CA, US; Remote, US R1d ago
-
Data Engineer-Secret Clearance Required USD 100K-150KAWS | AWS Glue | AWS Lambda | AWS Redshift | Access patterns401k plan with company matching | Bereavement leave | Disability insurance | Employee assistance program | Health, dental, vision insuranceSenior-level Full TimeRemote - Nationwide, United States R1d ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Travel as neededSenior-level Full TimeWork from home, VA, United States R1d ago
-
Staff Applied AI Engineer (Observability) USD 238K-322KAgent safety | Agent systems | Bias Mitigation | Crew AI | Explainability401k match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeNew York, NY R1d ago
-
Staff Applied AI Engineer USD 238K-322KAI platforms | Agent safety | Agent systems | Bias Mitigation | Build vs Buy401k with company match | Comprehensive health insurance | Dental insurance | Disability insurance | Flexible time offSenior-level Full TimeNew York, NY R1d ago
-
Senior Applied AI Engineer USD 200K-270KA/B | A/B Testing | Agent Orchestration | Agent systems | Automated Monitoring401k match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeNew York, NY R1d ago
-
Applied AI Engineer USD 166K-224KAgentic AI | Chat Completions API | CrewAI | Databricks | Distributed Computing401k match | Dental insurance | Disability insurance | Flexible time off | Health insuranceSenior-level Full TimeSan Francisco, CA R1d ago
-
Associate, Quantitative Front Office Engineer (AQR Capital Management, LLC, Greenwich, CT) USD 131K-185KAWS | Asset classes | Back Testing | Continuous integration | Distributed ComputingTelecommuting 2 days per weekMid-level Full TimeGreenwich, CT R1d ago
-
Apache Spark | Data Quality | Embeddings | Entity Extraction | Graph ModelingDental insurance | Health insurance | Paid time off | Retirement contributions | Vision insuranceMid-level Full TimeBoston, MA R1d ago