Databricks Architect
Jersey City, NJ, United States
A USD 161K-247K (estimate) Senior-level Full Time
Tasks
- Coordinate delivery using Scrum ceremonies
- Develop and optimize ETL pipelines
- Implement standardized pipelines with automated testing
- Improve performance and reduce compute and storage cost
- Integrate data with REST APIs
- Lead data engineering projects
- Manage Agile backlog items and escalations
- Manage infrastructure as code using Terraform
- Monitor systems using Splunk
- Process real time data using Spark Structured Streaming
- Schedule pipelines using Airflow
- Set up CI CD using Azure DevOps
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Azure | Azure DevOps | CI/CD | Databricks | Delta Lake | GCP | Git | Kubernetes | PySpark | Python | REST APIs | SQL | Scrum | Spark SQL | Spark Structured Streaming | Splunk | Structured Streaming | Terraform
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Cloud Computing | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeKirkland, WA, USA; Seattle, WA, USA1h ago
-
AI Solution Architect, YouTube Marketing USD 149K-216KAI Studio | API Integration | Data Governance | Data Pipelines | GeminiSenior-level Full TimeSan Bruno, CA, USA; New York, …1h ago
-
Artificial Intelligence | Audio generation | C++ | Computer Vision | Data PreparationSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA1h ago
-
Data Engineer II USD 106K-151KApache Spark | Data Analysis | Data Modeling | Data Pipelines | Data ProcessingSenior-level Full TimeBoulder, CO, USA; Atlanta, GA, USA1h ago
-
Senior Machine Learning Engineer, Search Assistant USD 361K-510KA/B | A/B Testing | Airflow | B testing | Bandit AlgorithmsDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeSan Jose, California8h ago
-
Lead Data Engineer (Sr. Palantir Engineer) USD 110K-160KAccess Control | Data Cleansing | Data Governance | Data Modeling | Data TransformationCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical/Dental/Vision insurance | Paid time offSenior-level Full TimeChicago, IL, US10h ago
-
Senior Robot Infrastructure Engineer USD 100K-300KAWS | Alerting | C plus plus | Cloud pipelines | EC2Senior-level Full TimeSan Francisco10h ago
-
Sr AI Engineer USD 124K-171KAPIs | Cause analysis | Code review | JavaScript | JiraCompany year end break | Flexible time off | Learning and development stipend | Medical/Dental/Vision insurance | Mental wellbeing resourcesSenior-level Full TimeRemote - United States R10h ago
-
Senior Forward Deployed AI Engineer, Enterprise USD 216K-270KA/B | A/B Testing | AWS | Agent systems | Artificial IntelligenceCommuter stipend | Health, dental, vision insurance | Learning and development stipend | Paid time off | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY10h ago
-
Forward Deployed AI Engineer, Enterprise USD 180K-225KA/B | A/B Testing | AWS | Agent systems | AzureCommuter stipend | Health, dental, vision coverage | Learning and development stipend | Paid time off | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY10h ago
-
Forward Deployed AI Engineer USD 110K-160KAI Agents | APIs | Artificial Intelligence | Cloud infrastructure | LLM401k employer match | Family building benefits | Flexible time off | Free OneMedical memberships | Healthcare plansEntry-level Full TimeNew York, NY, United States11h ago
-
Forward Deployed AI Engineer II USD 180K-230KAI Agents | APIs | Cloud infrastructure | Data Privacy | Evaluation401k match | Family building benefits fertility adoption surrogacy support | Flexible time off | Free OneMedical memberships | Healthcare plansMid-level Full TimeNew York, NY, United States11h ago
-
Sr. Delivery Acceleration AI Architect USD 168K-295KA/B | A/B Testing | AI Agent | AI Agent Development | AI agent orchestrationSenior-level Full TimeAustin , Texas, United States11h ago
-
Sr. Delivery Acceleration AI Architect USD 168K-295KA/B | A/B Testing | AI Agent | AI Agent Development | API DesignSenior-level Full TimeBoston , Massachusetts, United States11h ago
-
Sr. Delivery Acceleration AI Architect USD 168K-295KA/B | A/B Testing | AI Agent | AI Agent Development | AI agent orchestrationSenior-level Full TimeAtlanta, Georgia , United States11h ago
-
Sr. Delivery Acceleration AI Architect USD 168K-295KA/B | A/B Testing | AI Agent | AI Agent Development | AI agent orchestrationSenior-level Full TimeDallas, Texas, United States11h ago
-
Senior Data Engineer USD 140K-210KAirbyte | Apache Airflow | Apache Hudi | Apache Iceberg | BigEyeCommuter benefits | FSA | Flexible PTO | HSA | Healthy lunchesSenior-level Full TimeSan Mateo, CA United States12h ago
-
Sr. Embedded Software Engineer (Platforms) USD 90K-135KArtifactory | Atlassian Bamboo | BSP | Bash | BitbucketSenior-level Full TimeLafayette, CO12h ago
-
Full Stack Software Engineer, Data USD 160K-225KAngular | Build Automation | C# | CI/CD | Continuous integrationExtended hours | Travel | Weekend availabilitySenior-level Full TimeStarbase, TX12h ago
-
Embedded Software Engineer USD 150K-186K*nix | Authentication | Bash | Bazel | Build AutomationOn site work 4 day schedule | Proof of vaccination requiredSenior-level Full TimeSunnyvale, CA, United States12h ago
-
Senior Staff Forward Deployed AI Engineer, Enterprise USD 288K-360KA/B | A/B Testing | AWS | Agent systems | AlgorithmsCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsSenior-level Full TimeSan Francisco, CA; New York, NY12h ago
-
Staff Forward Deployed AI Engineer, Enterprise USD 252K-315KA/B | A/B Testing | AWS | Agent systems | AzureCommuter stipend | Comprehensive health coverage | Dental and vision coverage | Generous PTO | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY12h ago
-
API Design | AWS | AWS Lambda | Agentic AI | Amazon EC2Senior-level Full TimeOffice Location or Remote - USA R12h ago
-
API Design | AWS | Agentic AI | Cypher | Data ArchitectureSenior-level Full TimeOffice Location or Remote - USA R12h ago
-
Senior Computational Engineer USD 155K-200KBash | Boundary conditions | C++ | CAD to Mesh to Solve to Post Processing | CFD ValidationDental insurance | Equity | Flexible paid time off | Health insurance | Occasional weekend workSenior-level Full TimePortland, OR12h ago