Databricks / PySpark Data Engineer
Tasks
- Build analytics data models
- Build reusable data engineering frameworks
- Deliver user facing data solutions
- Design data pipelines
- Develop Databricks dashboards
- Develop PySpark transformations
- Develop Python data applications
- Implement Slowly Changing Dimensions
- Integrate pipelines with APIs
- Migrate legacy ETL workloads
- Optimize Spark workloads
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | CI/CD | Data Modeling | Databricks | Databricks SQL | Dimensional Modeling | ELT | ETL | FastAPI | GCP | LLM integration | Microservices | PySpark | Python | REST API | SCD | Slowly Changing Dimensions | Spark | Unity Catalog
Education
N/A
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior AI Software Engineer USD 160K-198KA2A | ADK | API | Containers | EnvoyNo visa sponsorship | Remote workSenior-level Full TimeRemote US R8h ago
-
Senior Developer, Data & IT - AI Solutions USD 120K-142KAI Agents | API Integration | AWS | AWS Bedrock | AWS SageMakerDental insurance | Dependent Care Account | Health insurance | Health savings account | Mental health counseling supportSenior-level Full TimeNew York, NY, United States9h ago
-
Senior Data Engineer USD 120K-142KApache Airflow | C# | Continuous integration | DBT | Data Modeling401b retirement savings program | Dental insurance | Dependent Care Account | Employer match | Flexible spending accountsSenior-level Full TimeNew York, NY, United States10h ago
-
Principal AI Engineer - Nexus Black USD 135K-160KCI/CD | Cloud Native | Cloud Native Architecture | Distributed Systems | EvaluationHybrid workSenior-level Full TimeItasca, United States11h ago
-
Senior-level Full TimeMorristown, NJ, United States12h ago
-
Staff AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA13h ago
-
Staff AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeNew York City, NY13h ago
-
Senior AI/ML Engineer USD 240K-270KAWS | Agentic Workflows | Cloud Computing | Cloud platform | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | Flexible spending accountSenior-level Full TimeNew York City, NY13h ago
-
Senior AI/ML Engineer USD 240K-270KAI Agents | AWS | Azure | Cloud infrastructure | Data Curation401k | Commuter benefits | Dog-friendly office | Equity | FSA benefitsSenior-level Full TimeSan Francisco, CA13h ago
-
Staff Data Engineer - Information Security USD 152K-248KAzure | Big Data | C# | C++ | Data PipelinesHealth and wellness programs | Time away from workSenior-level Full TimeSunnyvale, CA, United States13h ago
-
Manager, Data Engineering USD 130K-166KAWS | Access Controls | Apache Airflow | Audit Logging | AzureCollaborative team culture | Remote work | Work-life balanceSenior-level Full TimeRemote, United States R14h ago
-
AI Search | API Development | AWS | AWS Bedrock | Azure401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States14h ago
-
AWS S3 | Access Control | Active IQ | Ansible | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States14h ago
-
Communication optimization | Data parallelism | Deep learning | Distributed Training | GPU AccelerationMid-level Full TimeSeattle, Washington, United States17h ago
-
Robotics/UAS Engineer II/III USD 89K-176KArduPilot | Autopilot | C++ | CAD | Embedded SystemsCareer Development Training Opportunities | Education assistance | Fitness reimbursement | Flexible work schedules | Paid Time Off N/ASenior-level Full TimeUS-Massachusetts-Wilmington17h ago
-
Product Engineering, Full Sack Engineer USD 85K-142K.NET | .Net Core | AWS | Agile | AngularMentorship | Professional development | Travel opportunitiesNone Full TimeNew York, New York, United States18h ago
-
Mid-level Full TimeGreenwich, CT18h ago
-
Content Safety | Data Modeling | Feature Engineering | Graph Databases | Information RetrievalSenior-level Full TimeSan Jose, California, United States18h ago
-
Partner Engineering GenAI - US USD 133K-203KAPIs | Artificial Intelligence | C plus plus | Claude | Cloud ComputingSenior-level Full TimeMenlo Park, CA | Seattle, WA …18h ago
-
Machine Learning Performance Modeling Architect USD 173K-249KC# | C++ | Data Visualization | Heterogeneous computing | Image qualitySenior-level Full TimeSunnyvale, CA18h ago
-
Mid-level Full TimeSunnyvale, CA | Burlingame, CA18h ago
-
Robotics Engineer - Logistics and Material Flow USD 170K-240KAGV | Automation | Branching | C++ | Computer ScienceSenior-level Full TimeFremont, CA18h ago
-
Software Developer, Scaled Ops AI Acceleration Team USD 147K-203KAI infrastructure | Data Mining | Fine Tuning | Hack | JavaScriptSenior-level Full TimeSunnyvale, CA | Austin, TX | …18h ago
-
Automated testing | C++ | CSS | Debugging | GraphQLSenior-level Full TimeMenlo Park, CA18h ago