Data Lead Software Engineer – Python, Pyspark and AWS
New York, NY, United States
USD 177K-186K (estimate) Senior-level Full Time
Tasks
- Assess architectural designs for existing systems
- Automate recurring remediation tasks
- Build AWS based data workflows
- Design batch and streaming data pipelines
- Develop secure production code
- Drive AI-assisted engineering practices
- Establish automated testing standards
- Evaluate vendor and startup solutions
- Execute software design and development
- Improve code quality and delivery speed
- Review and debug code
- Support incident root cause analysis
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon S3 | Apache Airflow | Apache Spark | Automated testing | CI/CD | Data Migration | Data Modeling | Data Warehousing | Databricks | Distributed Systems | Driven systems | Event Driven | Event Driven Systems | Git | Incident Management | Jenkins | Maven | NoSQL | Object-Oriented | Object-oriented programming | Peer review | PySpark | Python | Real Time | Real-time Data | Redshift | SQL | Secure Coding | Snowflake | Step Functions
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
Software Engineer III - Senior Java Spark Developer USD 113K-188KAgile | Apache Spark | CI/CD | Concurrency | Distributed SystemsSenior-level Full TimeJersey City, New Jersey, United States5h ago
-
Data Engineer USD 97K-163KBTEQ | Data Partitioning | Database Administration | Performance Tuning | Query OptimizationSenior-level Full TimeSacramento, California, United States5h ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R13h ago
-
Manager, Enterprise Data Engineering USD 180K-247KADLS | Active Directory | Agile | Apache Spark | Automated testing401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States14h ago
-
Associate Director, Data Analytics Delivery & Operations USD 215K-261KAWS | Agile | Amazon Web Services | Analytics | Business Intelligence401 K | Dental insurance | Holidays | Medical insurance | Paid time offMid-level Full TimeMettawa, IL, United States14h ago
-
AI Solutions Engineer, Talent Acquisition USD 129K-171KAPIs | Access Control | Agentic Workflows | Audit trails | AuthenticationMid-level Full TimeSeattle, Washington, United States15h ago
-
Data Engineer USD 123K-273KAWS Glue | Azure Synapse | Cloud Dataflow | DB2 | Data MiningCompany volunteering | Employee referral program | Learning opportunitiesMid-level Full TimeCIO KPop-Dallas (US152527), United States18h ago
-
Vice President, Data Platform Engineering USD 145K-175KAmazon Elastic Container Service | Amazon Elastic Kubernetes Service | Amazon Web Services | CCPA | CDPAExecutive-level Full Time200 South College Street, Charlotte, NC, …18h ago
-
Backend Engineer - Applied AI USD 175K-240KCRDT | Caching | Circuit Breakers | Database Query | Database Query OptimizationMid-level Full TimeNew York City18h ago
-
Lead Principal Machine Learning Engineer USD 169K-355KAccess Control | Agent systems | AgentOps | Auditability | Autogen401k match | Life insurance | Paid Holidays | Paid parental leave | Paid sick leaveSenior-level Full TimeSan Francisco, CA, United States19h ago
-
Senior Data Engineer USD 126K-142KAzure Cloud | Azure Cloud Platform | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeUnited States19h ago
-
2026 Fall Health AI Scholar, Digital Health Algorithms USD 124K-150KAWS SageMaker | Amazon Redshift | Android | Artificial Intelligence | C++Entry-level Full Time665 Clyde Avenue, Mountain View, CA, …19h ago
-
Senior Software Engineer - Infrastructure Storage USD 266K-395KAPI Design | Block Storage | Ceph | Distributed Systems | Fibre Channel401k match | Commuter stipend | Flexible paid time off | Health, dental, vision coverage | Wellness stipendSenior-level Full TimeSan Francisco Office (Fremont St)19h ago
-
Senior-level Full TimeCosta Mesa, California, United States19h ago
-
Sr. Data Engineer (Remote) USD 163K-192KAccess Control | Amazon Web Services | Apache Iceberg | Apache Kafka | Apache Spark401k plan | Dental insurance | Disability insurance | Employee assistance program | FSA/HSASenior-level Full TimeRemote - United States R19h ago
-
Machine Learning Engineer - Simulation Framework USD 160K-234K3D Graphics | C++ | CUDA | Deep learning | Deterministic systemsEntry-level Full TimeFoster City, CA19h ago
-
Reliability Engineer, Supercomputing USD 350K-475KBMC | Container Orchestration | DCGM | Debugging | Firmware ManagementDental benefits | Health benefits | Paid parental leave | Relocation support | Unlimited PTOMid-level Full TimeSan Francisco20h ago
-
AWS | Agent Orchestration | CI/CD | Cloud platform | Databricks401k match | Counseling membership | Employer subsidized medical dental and vision | Flexible time away program | Life insuranceMid-level Full Time-REMOTE, USA- R20h ago
-
Software Engineer III - Big Data & AWS USD 175K-186KAPI Gateway | AWS Glue | AWS Lambda | AWS Step Functions | Amazon APISenior-level Full TimePlano, TX, United States20h ago
-
APIs | Agile | Cloud Computing | Data Visualization | Databricks401k program | Flexible spending account | Medical, dental & vision coverage | Paid time off | Parental leaveEntry-level Full TimeCamp Springs, MD R20h ago
-
APIs | Agile | Application development | Cloud Computing | Data Lakes401k program | Dental insurance | Flexible PTO | Flexible spending account | Medical insuranceEntry-level Full TimeCamp Springs, MD R20h ago
-
AI Solutions Engineer, Talent Acquisition USD 129K-171KAPI Integration | APIs | Access Control | Agentic Workflows | Audit trailsMid-level Full TimeBoston, Massachusetts, United States20h ago
-
AI Solutions Engineer, Talent Acquisition USD 129K-171KAPIs | Access Control | Agentic Workflows | Audit Logs | AuthenticationHealth insurance | Paid time off | Wellness programsMid-level Full TimeCosta Mesa, California, United States20h ago
-
AI Engineer, Ecosystem USD 171K-240KAPI Integration | Access Management | Audit Logging | Authentication | AuthorizationHybrid work | Remote work up to 4 weeks per yearMid-level Full TimeSan Francisco, California, United States R20h ago
-
Data Scientist / Risk Modeling Lead USD 106K-158KPython | R | Tableau | VBAEqual employment opportunity | Remote workSenior-level Full TimeWashington, District of Columbia, United States20h ago