Senior Data Engineer (Python/PySpark/AWS)
Tasks
- Automate testing and deployment
- Build PySpark batch workflows
- Build PySpark streaming workflows
- Build Python data processing scripts
- Design data architecture solutions
- Develop CI/CD pipelines
- Develop data models and schemas
- Ensure data quality and integrity
- Implement ETL pipelines
- Integrate data from multiple systems
- Monitor data pipeline reliability
- Optimize code for performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | Batch Processing | CI/CD | Data Integrity | Data Modeling | Data Privacy | Data Quality | Data Security | Data Warehousing | Data integration | Docker | ETL | Git | GitHub Actions | Google Cloud | Jenkins | Kubernetes | PySpark | Python | Streaming
Education
N/A
Roles
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)28d ago
-
eCommerce Analytics Principal USD 120K-145KAttribution Modeling | BigQuery | Client side | Client-side tracking | Commerce analytics401k | Dental insurance | Disability insurance | Employee discounts | Learning and developmentSenior-level Full TimeNashville, TN, United States4h ago
-
Mid-level Full TimeSioux Falls, SD, United States5h ago
-
API | Artificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integrationHybrid workSenior-level Full TimeDearborn, United States8h ago
-
AI Solutions Architect Engineer USD 130K-197K.NET | API | Azure | Backend Development | C#Contract-to-hire | Hybrid work model | Onsite schedule flexibility | Remote work on selected daysSenior-level Full TimeHouston, United States R8h ago
-
AI Integration - Backend Services USD 207K-300KC++ | Cloud platform | Distributed Systems | Docker | GoCross-functional collaboration | Mentorship | On-call rotationSenior-level Full TimeUS-CA-San Jose9h ago
-
AI and Data Science Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerDiscretionary annual incentive program | Mentorship programs | Professional development opportunities | US travel opportunitiesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …9h ago
-
AWS | Agile | Airtable | Anthropic | Artificial IntelligenceMentorship | Professional development | Travel opportunitySenior-level Full TimePittsburgh, Pennsylvania, United States9h ago
-
Software Engineer, Systems ML USD 146K-208KAI infrastructure | Benchmarking | Bias Mitigation | C# | C++Senior-level Full TimeMenlo Park, CA | Boston, MA …10h ago
-
Data Engineer, Product Analytics (University Grad) USD 171K-196KAI tools | Compliance | Data Modeling | Data Pipelines | Data PrivacyCareer Growth & Development | Work authorization supportNone Full TimeBellevue, WA | Menlo Park, CA …10h ago
-
Research Engineer Robotics (Operations) USD 113K-230KC++ | Docker | Force-torque sensors | Linux | ML OpsSenior-level Full TimeRedmond, WA10h ago
-
ASIC | C plus plus | C# | EDA Tools | EmulationSenior-level Full TimeSunnyvale, CA10h ago
-
Staff Software Engineer, Roads Data Quality, Geo USD 207K-301K3D Mapping | C# | C++ | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA11h ago
-
Software Engineer III, AI/ML, YouTube Ads Bidding USD 147K-211KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA11h ago
-
Data Engineer USD 76K-107KAmazon Web Services | Apache Airflow | Apache Kafka | Cause analysis | Cloud Composer401k match | Basic life insurance | Dental insurance | Disability coverage | Life insuranceMid-level Full TimePiscataway, NJ, US14h ago
-
Data Engineer USD 76K-121KAWS | Airflow | Apache Airflow | Cloud Data | Cloud Data Warehouse401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimePiscataway, NJ, US14h ago
-
Advanced Analytics - Vet USD 109K-155KAutomation | Cloud Storage | Data Engineering | Data Governance | Data ModelingMid-level Full TimeOverland Park, KS, US14h ago
-
Advanced Analytics - Retail USD 109K-155KAWS | Cloud Computing | Cloud Storage | Data Governance | Data Pipelines401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeOverland Park, KS, US14h ago
-
AWS | Alerting | CI/CD | Databricks | DatadogSenior-level Full TimeJersey City, NJ, United States20h ago
-
Data Engineer, Infrastructure FinOps USD 146K-194KAPI Design | BigQuery | CI/CD | CloudFormation | DBTMid-level Full TimeCosta Mesa, California, United States21h ago
-
Senior Software Engineer, Data Platform USD 166K-220KAWS | Amazon Athena | Apache Iceberg | Apache Spark | AzureSenior-level Full TimeCosta Mesa, California, United States21h ago
-
Senior-level Full TimeCosta Mesa, California, United States21h ago
-
Staff Data Scientist (Pricing) USD 179K-269KBehavioral Modeling | Causal Inference | Causal measurement | Choice Modeling | Contextual Bandits401k matching | Dental insurance | Employee learning development programs | Employee recognition programs | Financial assistance for hybrid workSenior-level Full TimeSan Francisco, CA21h ago
-
Senior Data Engineer USD 135K-168KAWS | Airflow | Amazon Redshift | Data Modeling | Data Warehousing401k | Flexible work arrangement | Health insurance | Mentorship program | Paid time offSenior-level Full TimePlano, TX1d ago
-
Sr. Embedded Software Engineer USD 100K-130KARM Cortex | ARM Cortex A | Assembly | Bash | Buildroot401k match | Career growth and professional development opportunities | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeRemote (United States) R1d ago