AWS Lead Software Engineer-Python/PySpark
Wilmington, DE, United States
USD 176K-200K (estimate) Senior-level Full Time
Tasks
- Apply SDLC toolchain automation capabilities
- Automate remediation of recurring issues
- Build reliable batch and streaming data pipelines
- Design reusable data processing and data quality frameworks
- Develop data models and transformations with SQL and dbt
- Develop secure production code
- Establish validation standards secure coding peer review automated testing
- Execute software solutions design development troubleshooting
- Improve engineering practices with AI assisted development
- Lead software engineering communities of practice
- Lead vendor and architecture evaluation sessions
- Orchestrate and troubleshoot data workflows
- Provision and manage platform infrastructure with infrastructure as code
- Review debug production code
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | AWS | AWS Lambda | Amazon API | Amazon API Gateway | Amazon CloudTrail | Amazon CloudWatch | Amazon DynamoDB | Amazon ECS | Amazon EKS | Amazon IAM | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Amazon VPC | Apache Airflow | Apache Flink | Apache Kafka | Automated testing | Batch Processing | CI/CD | Cause analysis | Code review | DBT | Data Modeling | Data Quality | Delta Lake | Distributed Systems | Docker | ETL | Google BigQuery | Hudi | Iceberg | Incident Management | Kubernetes | Performance Tuning | PySpark | Python | Root Cause Analysis | Root cause | SQL | Secure Coding | Snowflake | Spark Structured Streaming | Streaming processing | Structured Streaming | Terraform | Trino
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R19d ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States3h ago
-
Lead Data Engineer USD 114K-160KBusiness Objects | Business Process | Business Process Redesign | Case Development | Compliance AuditingSenior-level Full TimeColumbus, GA, United States3h ago
-
AI Cloud Engineer USD 127K-180KAutomation | Cause analysis | Cloud Architecture | Cloud Security | Cost OptimizationSenior-level Full TimeColumbus, GA, United States3h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA5h ago
-
AWS | Cloud Computing | Columnar Storage | Dataframe optimization | JavaEquity | Full benefits | Hybrid work in office component required | Performance-focused culture | Startup environmentSenior-level Full TimeLos Angeles, CA, United States5h ago
-
Mid-level Full TimeNew York, NY, US5h ago
-
Senior-level Full TimeJersey City, NJ, United States6h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States7h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton7h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton7h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R7h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Software Engineer, Machine Learning, Travel Ads USD 147K-211KA/B | A/B Testing | Adbrain | B testing | C++Mid-level Full TimeMountain View, CA, USA9h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA9h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA9h ago
-
Algorithms | Backend software | C++ | Control Plane | Data StructuresSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Algorithms | C++ | Cloud Storage | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Research Engineer, Humanoids, DeepMind USD 147K-211KC++ | Debugging | Foundation Models | JAX | Language ProcessingMid-level Full TimeMountain View, CA, USA9h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …9h ago
-
Senior Staff Engineer, GDC AI Inference Platform USD 262K-365KAgent coordination | C++ | Cloud infrastructure | Containerization | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA9h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US11h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935513h ago
-
PIIM Analytics Lead USD 105K-160KBI Report Server | BigQuery | DAX | Data Visualization | ETLFull Time Office Project Telework | Relocation assistance | Robust benefits | Training and developmentSenior-level Full TimeHouston, TX, US15h ago