Data Engineer (Python/PySpark/AWS)
Tasks
- Automate testing and deployment
- Design batch processing workflows
- Design data architecture solutions
- Design streaming workflows
- Develop Python and PySpark data processing
- Develop data models and schema
- Ensure data quality and integrity
- Implement ETL pipelines
- Integrate data from multiple sources
- Maintain CI/CD pipelines
Perks/Benefits
Skills/Tech-stack
AWS | Batch Processing | CI/CD | Data Modeling | Data Security | Data Warehousing | Docker | ETL | Git | GitHub Actions | Jenkins | Kubernetes | PySpark | Python | Streaming Data | Version control
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R10d ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R9h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Visualization | Experiment design | Machine Learning | Model DeploymentSenior-level Full TimeSan Jose, California, United States10h ago
-
Computer Vision | Fraud Detection | Language Processing | Machine Learning | Natural LanguageSenior-level Full TimeSeattle, Washington, United States10h ago
-
A/B | A/B Testing | B testing | Data Mining | Distributed ComputingMid-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer, Pricing - TikTok E-commerce Global Supply Chain and Logistics USD 129K-194KCausal Inference | Data Mining | Forecasting | Graph Databases | Knowledge graphsMid-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KA/B | A/B Testing | B testing | Data Visualization | Deep learningSenior-level Full TimeSeattle, Washington, United States10h ago
-
Mid-level Full TimeSan Jose, California, United States10h ago
-
Data Engineer, Global Live USD 145K-250KData Modeling | Data Warehousing | Data discovery | Data integration | Data pipelineMid-level Full TimeSan Jose, California, United States10h ago
-
Big Data | Click Through Rate | Click Through Rate Optimization | Conversion Rate | Conversion rate optimizationSenior-level Full TimeSeattle, Washington, United States10h ago
-
Senior Site Reliability Engineer - Data Infrastructure USD 187K-252KAI Agents | Alerting | Automation | Capacity Planning | Change ManagementCross-team collaboration | Mentorship | Rotational on-callSenior-level Full TimeSeattle, Washington, United States10h ago
-
Machine Learning Engineer, Ecommerce Risk Control USD 175K-266KData Analysis | Data Pipelines | Data Visualization | Deep learning | Experiment designSenior-level Full TimeSeattle, Washington, United States10h ago
-
Site Reliability Engineer - Data Infrastructure USD 100K-215KAlerting | Bash | Change Management | Go | Incident ResponseRotational on-callEntry-level Full TimeSeattle, Washington, United States10h ago
-
Applied Scientist, Search, E-Commerce Alliance USD 136K-205KData Analysis | Language Processing | Machine Learning | Model Deployment | Natural LanguageMid-level Full TimeSan Jose, California, United States10h ago
-
Site Reliability Engineer - Data Infrastructure USD 100K-215KAlert Tuning | Automation | Bash | Change Management | DatabasesRotational on-callEntry-level Full TimeSan Jose, California, United States10h ago
-
Behavior Modeling | Data Analysis | Information Retrieval | Language Processing | Machine LearningMid-level Full TimeSeattle, Washington, United States10h ago
-
Senior Data Engineer USD 115K-150KAWS | AWS Glue | Airflow | Amazon Redshift | Amazon S3401k contribution | Health insurance | Life insuranceSenior-level Full TimeWashington, DC17h ago
-
Business Analysis | Customer Requirements | Data Modeling | Language Models | Language ProcessingHealth insurance | Mentorship | Paid time offMid-level Full TimeNew York, US, New York19h ago
-
Cost of ownership | Customer Success | Data Modeling | Data analytics | LLMCoaching | Flexible-hybrid work | Mental health counseling | Mentorship | Paid volunteer time offMid-level Full TimeRaleigh, US, North Carolina20h ago
-
Analytics | Cloud infrastructure | Data Architecture | Data Governance | Data ManagementDisability insurance | Employee assistance program | Flexible time off | Global shutdown | Paid time offSenior-level Full TimePrinceton LVL - NJ, United States22h ago
-
AI Engineer USD 92K-138KAPI Design | Agent Frameworks | Anomaly Detection | Artificial Intelligence | Computer VisionSenior-level Full TimeOK PLAZA PL, United States22h ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R22h ago
-
Mid-level Full TimeUnited States - Remote R22h ago
-
Senior Machine Learning Engineer USD 112K-183KAWS | Data Ingestion | Data Modeling | Data Quality | Data Visualization401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeMossville, Illinois, United States22h ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R22h ago