Databricks / PySpark Data Engineer
Tasks
- Build analytics data models
- Build reusable data engineering frameworks
- Deliver user facing data solutions
- Design data pipelines
- Develop Databricks dashboards
- Develop PySpark transformations
- Develop Python data applications
- Implement Slowly Changing Dimensions
- Integrate pipelines with APIs
- Migrate legacy ETL workloads
- Optimize Spark workloads
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | CI/CD | Data Modeling | Databricks | Databricks SQL | Dimensional Modeling | ELT | ETL | FastAPI | GCP | LLM integration | Microservices | PySpark | Python | REST API | SCD | Slowly Changing Dimensions | Spark | Unity Catalog
Education
N/A
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Robotics Test & Data Engineer, Mapping USD 70K-300K3D Point Cloud Processing | 3D point cloud | Bash | Cloud processing | Cloud validationMid-level Full TimeIrvine, CA4h ago
-
Senior AI Software Engineer USD 160K-198KA2A | ADK | API | Containers | EnvoyNo visa sponsorship | Remote workSenior-level Full TimeRemote US R9h ago
-
Senior Developer, Data & IT - AI Solutions USD 120K-142KAI Agents | API Integration | AWS | AWS Bedrock | AWS SageMakerDental insurance | Dependent Care Account | Health insurance | Health savings account | Mental health counseling supportSenior-level Full TimeNew York, NY, United States10h ago
-
Senior Data Engineer USD 120K-142KApache Airflow | C# | Continuous integration | DBT | Data Modeling401b retirement savings program | Dental insurance | Dependent Care Account | Employer match | Flexible spending accountsSenior-level Full TimeNew York, NY, United States11h ago
-
Technical Support Engineer USD 90K-125KBusiness Intelligence | CTE | Data Modeling | Data Visualization | Database401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA11h ago
-
Technical Support Engineer USD 90K-125KAWS | Amazon Redshift | Business Intelligence | CTE | Cloud Computing401k | Annual bonus | Commuter benefits | Dog-friendly office | EquitySenior-level Full TimeNew York City, NY11h ago
-
AI Research Engineer USD 190K-280KAgentic AI | Clinical data | Data Pipelines | Data integration | Deep learningDiversity and inclusion initiatives | Flexible work environment | Friendly work environment | Professional developmentMid-level Full TimeSeattle, Washington, United States; South San …12h ago
-
Principal AI Engineer - Nexus Black USD 135K-160KCI/CD | Cloud Native | Cloud Native Architecture | Distributed Systems | EvaluationHybrid workSenior-level Full TimeItasca, United States12h ago
-
Generative AI Inference Engineer USD 152K-287KAWS | CUDA | Cloud platform | Diffusion Models | DockerSenior-level Full TimeUnited States13h ago
-
Senior-level Full TimeMorristown, NJ, United States14h ago
-
Staff AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA14h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY14h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud Computing | Cloud platform | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeNew York City, NY14h ago
-
Data Engineer I USD 85K-100KAWS Glue | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k match | Direct student loan payment program | Employee recognition rewards | Flexible vacation | HRAMid-level Full TimeUnited States14h ago
-
Senior AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA14h ago
-
Staff Data Engineer - Information Security USD 152K-248KAzure | Big Data | C# | C++ | Data PipelinesHealth and wellness programs | Time away from workSenior-level Full TimeSunnyvale, CA, United States14h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R15h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
AWS S3 | Access Control | Active IQ | Ansible | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States15h ago
-
Senior Data Engineer (Remote, US) USD 140K-211KAirflow | Aiven | Apache Spark | BigQuery | CI/CD401k company contribution | Annual professional development fund | Be Well program | Paid volunteer service hours | Parental leaveSenior-level Full TimeRemote - United States R16h ago
-
Machine Learning Engineer USD 155K-228KAirflow | Amazon SageMaker | Apache Spark | Argo CD | Artificial IntelligenceHealthcare insurance | Paid parental leave | Paid personal time off | Paid sick time | Paid time offMid-level Full TimeRemote - US R17h ago
-
Communication optimization | Data parallelism | Deep learning | Distributed Training | GPU AccelerationMid-level Full TimeSeattle, Washington, United States18h ago
-
Robotics/UAS Engineer II/III USD 89K-176KArduPilot | Autopilot | C++ | CAD | Embedded SystemsCareer Development Training Opportunities | Education assistance | Fitness reimbursement | Flexible work schedules | Paid Time Off N/ASenior-level Full TimeUS-Massachusetts-Wilmington19h ago
-
Product Engineering, Full Sack Engineer USD 85K-142K.NET | .Net Core | AWS | Agile | AngularMentorship | Professional development | Travel opportunitiesNone Full TimeNew York, New York, United States19h ago