Lead Software Engineer - Python/PySpark/Databricks/AWS
Delaware, OH, United States
USD 170K-195K (estimate) Senior-level Full Time
Tasks
- Apply testing data quality checks and contract testing
- Architect Databricks lakehouse solutions
- Build and operate Delta Lake solutions
- Build batch and streaming data pipelines
- Conduct technical troubleshooting
- Debug code written by others
- Define replay and backfill procedures
- Develop and review secure production code
- Drive adoption of AI assisted engineering practices
- Eliminate recurring remediation through automation
- Ensure production readiness with retries checkpointing and idempotency
- Execute software design and development
- Implement Delta Live Tables or Databricks Jobs workflows
- Implement Infrastructure as Code and version control
- Implement data governance and security controls
- Implement secure software development life cycle toolchain
- Lead communities of practice for software engineering
- Lead design and code reviews and mentor engineers
- Lead evaluation of vendor and architecture options
- Monitor systems and manage incident response
- Optimize Spark and Delta performance and cost
- Perform CI CD for Databricks and AWS
- Perform root cause analysis and SLO SLA management
- Set validation standards for correctness performance and security
Perks/Benefits
- N/A
Skills/Tech-stack
Access Management | Amazon S3 | Amazon Web Services | Apache Spark | CI/CD | Cause analysis | Contract testing | Data Quality | Databricks | Databricks Jobs | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Identity and Access Management | Identity and access | Incident Response | Infrastructure as Code | Integration Testing | Key Management | Key Management Service | Monitoring | Private Cloud | PySpark | Python | Root Cause Analysis | Root cause | S3 | SLA | SLO | Secure Coding | Structured Streaming | Unit Testing | Unity Catalog | Virtual Private Cloud | Web Services | “as-code”
Education
N/A
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Access Control | Approval Workflows | Audit Readiness | Azure | ComplianceHybrid scheduleSenior-level Full TimeHorsham, PA, United States R4h ago
-
Azure DevOps | Data Modeling | Data integration | ETL | GitHubSenior-level ContractSaint Paul, United States5h ago
-
Senior Machine Learning Engineer USD 150K-200KAPI Development | AWS SageMaker | Data Pipelines | FastAPI | Feature EngineeringSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarking | Cloud Computing | Computer Vision | Data Annotation | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsEntry-level Full TimeAddison, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Image Processing | Machine Learning | Model EvaluationFlexible schedule | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsEntry-level Full TimeRichardson, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KAnnotation Workflows | Cloud Computing | Computer Vision | Data Quality | Image ProcessingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsEntry-level Full TimeGarland, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KAnnotation tools | Cloud Computing | Computer Vision | Data Quality | Image ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimeFort Worth, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarking | Cloud Computing | Computer Vision | Data labeling | Experiment trackingEducation budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipEntry-level Full TimePlano, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Image Processing | Machine Learning | Object DetectionFlexible schedule | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsEntry-level Full TimeArlington, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Data labeling | Image Processing | Machine LearningFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksEntry-level Full TimeCarrollton, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Quality | Edge ComputingFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeMcKinney, United States5h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeGarland, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Cameras | Clustering | Computer Vision | Computer vision hardwareFlexible schedule | Flextime | Mentorship | Personalized growth roadmaps | Professional growthSenior-level Full TimeAllen, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Cameras | Clustering | Computer Vision | Data AnalysisFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeAddison, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Cameras | Clustering | Computer Vision | Edge DevicesEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsSenior-level Full TimeFort Worth, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Computer vision hardware | Data ScienceFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeCarrollton, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Deployment | Edge ComputingFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeFrisco, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingFlexible schedule | Flextime | Personalized growth roadmaps | Professional growth | Remote work optionsSenior-level Full TimeArlington, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeLewisville, United States5h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarks | Cloud Computing | Computer Vision | Data Quality | Data labelingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimeDallas, United States5h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment trackingEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthMid-level Full TimeCarrollton, United States5h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Science | Edge ComputingEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimePlano, United States5h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Concept drift | Concept drift detection | ContainerizationFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Professional growthMid-level Full TimeAddison, United States5h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Containerization | Docker | Drift DetectionEducation budget | Exciting projects | Fitness budget | Flextime | MentorshipMid-level Full TimeAllen, United States5h ago