Data Engineer II, PySpark/Databricks
Mc Lean, VA
R
USD 90K-110K Senior-level Full Time
Tasks
- Build and maintain PySpark data pipelines
- Create and maintain technical documentation
- Debug and resolve defects
- Design, develop, and maintain backend services
- Develop proof of concepts
- Estimate prioritize and plan development tasks
- Evaluate and recommend data technology
- Implement and maintain security compliance and governance
- Optimize Spark jobs performance
- Participate in agile ceremonies
- Perform code reviews
- Provide professional development
- Write clean, maintainable code
Perks/Benefits
- 401k employer match
- Dental insurance
- Employee assistance program
- Flexible PTO
- Health insurance
- Paid parental leave
- Vision insurance
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Agile | Algorithms | Apache Spark | Data Governance | Data Modeling | Data Pipelines | Data Structures | Data Warehousing | Databricks | Design Patterns | Distributed Computing | EC2 | ETL | PySpark | Python | S3 | Security Compliance | Software Design | Software Design Patterns | Spark optimization
Education
Roles
Language: en
Views:
0
Clicks:
1
Saves: 0
Related jobs
-
Media Software Engineer, Speech (All Levels) USD 120K-180KAndroid | Artificial Intelligence | Audio Processing | C# | C++401k retirement savings plan | Company holidays | Complimentary lunch and snacks | Fertility support | Medical, dental, and vision insuranceEntry-level Full TimeSunnyvale R1d ago
-
Principal Data Engineer (streaming) USD 118K-134KAWS | Alerting | Apache Flink | Apache Hudi | Apache KafkaAllyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance program | Employee recognitionSenior-level Full TimeRemote, USA R1d ago
-
Mid-level Full TimeUnited States R1d ago
-
Principal Machine Learning Engineer USD 180K-368KAWS Lambda | Amazon SQS | Amazon SageMaker | Automated testing | Backend EngineeringHybrid workSenior-level Full TimeRemote, USA R1d ago
-
Senior Machine Learning Engineer USD 198K-287KData Engineering | Fine Tuning | Foundation Models | GenAI | Incident ResponseOn-call rotationSenior-level Full TimeRemote - US R2d ago
-
Senior-level Full TimeRemote, US R2d ago
-
Sr. Staff Machine Learning Engineer, Content Ecosystem USD 227K-469KCausal Inference | Data Quality | Experimentation | Game theory | Language ModelsSenior-level Full TimeSan Francisco, CA, US; Remote, US R2d ago
-
Senior Data Platform Engineer USD 133K-197KAWS | Amazon IAM | Amazon Redshift | Ansible | Apache IcebergDental benefits | Free 1Password account | Generous paid time off | Health benefits | Maternity and Parental Leave Top-UpSenior-level Full TimeRemote (United States | Canada) R2d ago
-
AI Engineer I - Hybrid USD 125K-135KAI Services | API Development | Agentic Workflows | Azure | Azure AIHealth insurance | Hybrid work | Paid time off | Remote work options | Retirement planSenior-level Full TimeWindsor, Colorado, United States R2d ago
-
Senior Machine Learning Engineer, Vector Bidding Science USD 148K-229KA/B | A/B Testing | B testing | BigQuery | Control TheoryCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipSenior-level Full TimeRemote, Washington, USA R2d ago
-
Staff Machine Learning Engineer, Vector Bidding Science USD 172K-266KA/B | A/B Testing | B testing | BigQuery | Control TheoryCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation | Global employee assistance programSenior-level Full TimeRemote, Washington, USA R2d ago
-
Senior ML Engineer USD 152K-228KAmazon SageMaker | Baseten | Batching | CI/CD | Google Vertex401k matching | Dental insurance | Fertility assistance | Flexible time off | Health insuranceSenior-level Full TimeRemote - US & Canada (see … R2d ago
-
Data Engineer - Assistant Vice President USD 100K-135KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureEmployer-Matched Retirement Plan | Parental leave | Remote work Friday flexibility | Subsidized healthcare | Unlimited paid time offExecutive-level Full TimeSalt Lake City, Utah, United States R2d ago
-
Sr AI Engineer USD 124K-171KAPIs | Agentic Workflows | Event Driven | Event-driven architecture | JavaScriptFlexible time off | Learning and development stipend | Medical, dental, and vision insurance | Mental wellbeing resources | Paid HolidaysSenior-level Full TimeRemote - United States R2d ago
-
Lead Data Engineer - Data Platform Engineering (Hybrid) USD 128K-168KApache Airflow | Apache Hadoop | Apache Spark | BigQuery | Cloud Healthcare APISenior-level Full TimeMelville, Suffolk, United States R2d ago
-
Staff Machine Learning Engineer, Ads Conversion USD 222K-389KA/B | A/B Testing | B testing | Computer Vision | Data MiningSenior-level Full TimeSan Francisco, CA, US; Palo Alto, … R2d ago
-
Senior Solution Engineer Optimization USD 109K-150KAI machine learning | APIs | Advanced Analytics | Algorithms | Analytical problem-solvingHybrid option | Remote work | Travel for customer engagementsSenior-level Full TimeRemote (United States) R2d ago
-
Senior Analytics Engineer USD 145K-180KAnomaly Detection | DBT | Data Documentation | Data Modeling | Data TestingFull remote option | Hybrid scheduleSenior-level Full TimeAustin, Texas, United States R2d ago
-
Senior Analytics Engineer USD 135KAnomaly Detection | DBT | Data Documentation | Data Modeling | Data TestingFinancial benefits | Fully remote option | Hybrid schedule | Medical benefits | Stock optionsSenior-level Full TimeDenver, Colorado, United States R2d ago
-
Director I, Data Science, Enterprise Data & Data Science USD 132K-210KData Modeling | Generative AI | Knowledge graphs | MLOps | Machine LearningExecutive-level Full TimeBoston, Massachusetts, United States R2d ago
-
Senior Analytics Engineer USD 135KAmazon Redshift | Anomaly Detection | DBT | Data Modeling | LLMFinancial benefits | Full remote options | Hybrid schedule | Medical benefits | Stock optionsSenior-level Full TimeNew York, New York, United States R2d ago
-
Full-Stack Engineer, AI Data Platform USD 130K-200KAWS DynamoDB | Cassandra | Cloud platform | GCS | Google CloudHybrid workMid-level Full TimeSan Francisco Bay Area R2d ago
-
AWS RDS | Agile | Amazon S3 | Jira | MongoDBPST time zone requirement | Remote workMid-level Full TimeRemote, California R2d ago
-
Azure | Azure AI | Azure Data | Azure Data Factory | Azure DevOpsEU remote work days | Employee assistance program | Employer pension plan | Flexible working hours | JobradSenior-level Full TimeHomeoffice R2d ago
-
Senior Data Engineer II (Hybrid) USD 106K-171KAutomation | CI/CD | DBT | Data Governance | Data ModelingEmployee resource groups | Fitness programs | Learning and development programs | Medical/Dental/Vision | Paid parental leaveMid-level Full TimeScottsdale, Arizona, United States R2d ago