Data Engineer II - AWS/PySpark/ETL
Tasks
- Automate remediation for operational stability
- Build trusted data access and analytics
- Communicate technical concepts to stakeholders
- Create system design and application development artifacts
- Design data collection and storage solutions
- Detect and address data anomalies
- Develop and debug data transformation logic
- Develop production data pipelines
- Implement secure data engineering best practices
- Monitor data quality checks
- Optimize data processing workflows
- Perform ETL processes
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS | Airflow | Automation | CI/CD | Continuous Delivery | Data Lake | Data Quality | Databricks | ETL | PySpark | Python | SQL | Snowflake
Education
N/A
Roles
Related jobs
-
API Integration | Cloud services | Customer 360 | Data Management | Data Management CloudSenior-level ContractAustin, United States3h ago
-
Senior-level Full TimeUS-IN-Indianapolis4h ago
-
Algorithms | C++ | Computational lithography | Data Structures | Image ProcessingAnnual bonus eligibility | Equity eligibility | Financial benefits | Health insurance | Wellness programsSenior-level Full TimeCalifornia, Sunnyvale4h ago
-
Data Analysis | Dataset Processing | Direct Preference Optimization | Evaluation Pipelines | Fine TuningEntry-level InternshipSan Jose, California, United States4h ago
-
Data Scientist - Platform Infrastructure USD 127K-202KDashboarding | Data Governance | Data Modeling | Data Quality | Data ValidationMid-level Full TimeSan Jose, California, United States4h ago
-
Software Engineer, Systems USD 203K-240KArtificial Intelligence | C# | C++ | Computer Graphics | Data ProcessingEntry-level Full TimeNew York, NY5h ago
-
Data Engineer USD 209K-235KDashboards | Data Governance | Data Modeling | Data Quality | Data VisualizationSenior-level Full TimeAustin, TX5h ago
-
Data Engineer, Analytics USD 199K-235KData Warehousing | Data integration | Dimensional Modeling | ETL | MPPEntry-level Full TimeNew York, NY5h ago
-
Mid-level Full TimeNew York, NY5h ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-211KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSan Jose, CA, USA5h ago
-
Senior ML Ops Engineer - Dallas, TX USD 48K-168KApache Spark | Big Data | CI/CD | Containerization | Data analytics401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States14h ago
-
Data Engineer USD 113K-160KAzure Data | Azure Data Factory | Azure Synapse | CI/CD | DBT99.5 percent pipeline uptime focus | HIPAA training | Hybrid work | Mentorship | Remote work optionsMid-level Full TimeChesterfield, MO, US14h ago
-
Lead ML Ops - Dallas, TX, United States USD 48K-168KAWS | Apache Spark | Azure | CI/CD | Cloud platform401k retirement plan | Dental benefits | Medical benefits | Paid Holidays | Paid time offSenior-level Full TimeUnited States14h ago
-
Data Engineer (Starlink Growth) USD 125K-175KAnomaly Detection | Clustering | Data Modeling | Data Visualization | Geospatial analysisWork extended hours as needed | Work weekends as neededEntry-level Full TimeBastrop, TX16h ago
-
Sr. Software Development Engineer, Aurora Storage USD 168K-227KAWS | Amazon Aurora | Amazon RDS | Automation | DebuggingCareer growth | Flexible work options | Knowledge sharing | Mentorship | Work-life balanceSenior-level Full TimeRedmond, Washington, USA16h ago
-
Data Engineer / Senior Data Engineer USD 90K-119KAPI | Apache Airflow | BigQuery | Cloud Data | Cloud Data Warehouse401k matching | Cost of living adjustment | Fully remote | Health, dental, and vision benefits | Remote-first cultureSenior-level Full TimeUnited States - Remote R16h ago
-
Senior Software Engineer - AI Frameworks USD 119K-258KAttention Mechanism | C# | C++ | CUDA | CUDA kernelsSenior-level Full TimeRedmond, WA, US; Mountain View, CA, …17h ago
-
Sr. Data Engineer (Starlink Grwoth) USD 160K-220KAnomaly Detection | Clustering | Data Visualization | Geospatial Data | Machine LearningExtended hours | Weekend work as neededSenior-level Full TimeBastrop, TX17h ago
-
Senior Data Engineer USD 114K-140KAgile | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIrving, Texas, United States17h ago
-
Staff Software Engineer, AI Engineer USD 210K-260KAI Safety | Agentic AI | Cost Optimization | Evaluation | LLM OperationsSenior-level Full TimeHybrid - SF Bay Area R17h ago
-
Senior Software Engineer, AI Engineer USD 170K-210KAgent Orchestration | Caching | Cost Optimization | Evaluation | Language ModelsSenior-level Full TimeHybrid - SF Bay Area R17h ago
-
Data Engineer USD 240K-280KAnomaly Detection | Clustering | Data Pipelines | Data Quality | Data Transformation401k | Dental insurance | Health insurance | Insurance | Life insuranceEntry-level Full TimePalo Alto, CA18h ago
-
Senior Data Engineer USD 114K-140KAgile | Ataccama ONE | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePomona, California, United States18h ago
-
Data Systems Engineer, Battle Road USD 150K-185KAPI Development | AWS | Apache Spark | Azure | Batch ProcessingSenior-level Full TimeUnited States | Remote R18h ago
-
Staff AI Engineer - Search & Discovery USD 184K-376KAgentic design | Generative AI | LLM orchestration | Langchain | Language Models401k match | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeMountain View, USA18h ago