Data Engineer II, PySpark/Databricks
Tasks
- Build and maintain PySpark data pipelines
- Create and maintain technical documentation
- Debug and resolve defects
- Design, develop, and maintain backend services
- Develop proof of concepts
- Estimate prioritize and plan development tasks
- Evaluate and recommend data technology
- Implement and maintain security compliance and governance
- Optimize Spark jobs performance
- Participate in agile ceremonies
- Perform code reviews
- Provide professional development
- Write clean, maintainable code
Perks/Benefits
- 401k employer match
- Dental insurance
- Employee assistance program
- Flexible PTO
- Health insurance
- Paid parental leave
- Vision insurance
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Agile | Algorithms | Apache Spark | Data Governance | Data Modeling | Data Pipelines | Data Structures | Data Warehousing | Databricks | Design Patterns | Distributed Computing | EC2 | ETL | PySpark | Python | S3 | Security Compliance | Software Design | Software Design Patterns | Spark optimization
Education
Roles
Related jobs
-
Principal Machine Learning Researcher (Physical AI) USD 200K-400KAnomaly Detection | C++ | Computational Geometry | Computer Vision | Deep learning401k | Casual dress | Company holidays | Employer paid Medical Dental Vision Insurance | Flexible work hoursSenior-level Full TimeLos Angeles, CA (On-site) R12h ago
-
C# | Combinatorics | Graph theory | Linear Algebra | MATLABFlexible hours | Part-time project-based workSenior-level FreelanceUnited States - Remote R12h ago
-
API Security | AWS Lambda | Anthropic MCP) | Authentication | BigQuery100% remote | Annual leave | Company funded usage budget | Developer productivity budget | Equity RSUsSenior-level Full TimeUnited States (Remote) R14h ago
-
Senior Machine Learning Engineer - Camera Model USD 177K-212K3D Perception | BEV | CNN | Camera Calibration | Computer Vision100 percent paid medical dental and vision premiums | 401k employer match | Accidental death and dismemberment insurance | Company paid holiday office closures | Flexible scheduleSenior-level Full TimeRemote - U.S, Ann Arbor, MI R15h ago
-
Data Analytics Engineer I USD 100K-110KApache Airflow | Apache Spark | BigQuery | Cloud Run | Cloud platform401k | Dental insurance | Fitness fund | Health insurance | Learning and development fundMid-level Full TimeRemote - USA R16h ago
-
Software Engineer, Data Infrastructure USD 153K-376KAI systems | Access Control | Apache Airflow | Apache Flink | Apache KafkaCell phone reimbursement | Company recharge days | Generous PTO | Learning and development stipend | Mental health and wellness benefitsMid-level Full TimeSan Francisco, CA • New York, … R17h ago
-
Sr. Staff Embedded AI Engineer USD 145K-185KBare Metal | C# | C++ | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Hybrid work model | Remote work optionSenior-level Full TimeColumbia, MARYLAND, United States R18h ago
-
Senior Software Engineer - Robotics USD 134K-184KAgent systems | Agentic AI | Agile | Algorithms | C++Remote work hybrid environment | Security clearance supportSenior-level Full TimeWoburn, MA R19h ago
-
Finance Analytics Engineer USD 76K-95KAcceptance Testing | Dashboards | Data Modeling | Data Pipelines | Data Quality401k match | Bereavement leave | Employee assistance program | Employee discount program | Health dental vision careSenior-level Full TimeRemote - Nationwide, United States R19h ago
-
AI Engineer (Hybrid) USD 130K-270KAmazon Web Services | Cloud Computing | Data Analysis | Data Modeling | Data Quality401k contribution | AD&D insurance | Health Savings Account contribution | Hybrid work | Life insuranceSenior-level Full TimeAnnapolis Junction, MD R19h ago
-
Senior-level Full TimeRemote US R20h ago
-
Data Engineer (remote) USD 110K-130KAWS | Airflow | Azure | Cloud infrastructure | Data Governance401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountMid-level Full TimeWork From Home, United States R20h ago
-
Principal Software Engineer, Data Platforms USD 170K-210KAPI Design | Automated testing | CI/CD | Data Governance | Data Lineage401k | Dental insurance | Employee discounts | Fully remote | Medical insuranceExecutive-level Full TimeOrlando, FL, United States R20h ago
-
Senior AI Engineer USD 150K-210KAPI Integration | Cloud Native | Cloud Native Services | Container Orchestration | EmbeddingsBenefits | Equity | High-trust work environment | MentorshipSenior-level Full TimeSF Bay Area (Hybrid) R20h ago
-
Senior Software Engineer, LLM Performance USD 180K-339KC++ | CUDA | Cutlass | FlashAttention | FlashInferSenior-level Full TimeSF Bay Area (Hybrid) R20h ago
-
Head of AI Sales USD 200K-300KAgent Orchestration | Agent systems | Anthropic | Apollo | Artificial Intelligence401k match | Dental | Disability insurance | EAP | ESPPExecutive-level Full TimeChicago (35 W. Wacker Dr.); Remote … R21h ago
-
Responsible AI Data Scientist USD 160K-175KAlgorithmic Fairness | Audit trails | Bias detection | Data Lineage | Data VisualizationBonuses | Hybrid work | Remote flexibility | Supportive collaborative environmentMid-level Full TimeChicago; New York R21h ago
-
Senior Data Engineer USD 100K-150KAPI Integration | DBT | Data Pipeline Development | Data pipeline | GDAL401k | Commuter benefits | Dental insurance | Employee stock option plan | Health insuranceSenior-level Full TimeNew York City R21h ago
-
Software Engineer, Perception and Prediction Evaluation USD 155K-213KAWS | Airflow | Batch | Data Analysis | Distributed SystemsDental insurance | Flexible hours | Health insurance | Social events | Team-building activitiesMid-level Full TimeRemote US & Canada R1d ago
-
Technology System / Platform Engineer (Databricks) USD 118K-138KCI/CD | Databricks | ETL | Git | Python401k matching | Dental insurance | Free telehealth | Health savings account | Hybrid work modelMid-level Full TimeDenver, CO, United States R1d ago
-
Senior Platform Engineer, Alteryx/Tableau USD 120K-172KAWS | Alerting | Alteryx | Azure | Azure Data401k plan | Company holidays | Employee assistance program | Health savings account | Paid sick timeSenior-level Full TimeRemote, United States R1d ago
-
Alerting | Apache Airflow | CI/CD | Cost Optimization | DBTEmployee benefits including medical dental vision and 401k | Hybrid work model | Office offsites and team offsites | Remote-friendlySenior-level Full TimeRemote - USA R1d ago
-
Middle Data Engineer USD 135K-160KAWS | DBT | Data Governance | Data Lineage | Data ModelingFitness allowance | Local holidays | Mental health programs | Paid sick leave | Paid training opportunitiesSenior-level Full TimeCyprus - Remote R1d ago
-
SPAM Data Engineer USD 112K-214KAutomation | Email header analysis | Header Analysis | Linux | PerlFlexible work environment | Volunteer days | Wellbeing days | Work from anywhereMid-level Full TimeSunnyvale, CA, United States R1d ago
-
BigQuery | CI/CD | Containerization | Data Modeling | DatabricksSenior-level ContractNew York, NY (Hybrid) R1d ago