Lead Data Platform Engineer - Enterprise Scheduler (AWS)
Plano North, United States
R
USD 117K-192K (estimate) Senior-level Full Time
Tasks
- Build reusable scheduling patterns for multi tenant workloads
- Configure API Gateway security routing and throttling
- Create onboarding mechanisms and reusable templates
- Define platform standards and governance controls
- Design and implement multi account AWS architecture
- Design scheduler platform architecture on AWS MWAA
- Develop RESTful APIs with Python
- Document APIs with OpenAPI Swagger
- Implement IAM SSO OAuth2 and JWT security controls
- Implement Infrastructure as Code with Terraform or CloudFormation
- Implement centralized logging and metrics
- Integrate scheduler services with enterprise applications
- Lead migration planning and dependency analysis
- Lead technical direction and architecture reviews
- Manage secrets and perform dependency scanning
- Mentor engineers and establish engineering standards
- Migrate AutoSys workflows to AWS MWAA
- Perform load and stress testing and analyze metrics
- Set up CI CD pipelines for build test deploy
- Set up alerting with SLIs and SLOs
- Troubleshoot incidents using logs traces and metrics
- Write unit integration and end to end tests with pytest
Perks/Benefits
- 401k company match
- Comprehensive health care and wellness plans
- Hybrid work environment
- Lease vehicle program
- Paid Holidays
- Paid time off
- Relocation assistance
- Tax advantaged accounts
- Tuition reimbursement
- Vehicle purchase discount
Skills/Tech-stack
API Gateway | AWS CloudFormation | AWS CodePipeline | AWS IAM | AWS Lambda | AWS MWAA | Amazon API | Amazon API Gateway | Amazon CloudWatch | Amazon DynamoDB | Amazon ECS | Amazon ECS Fargate | Amazon EKS | Amazon S3 | Artifactory | Dynatrace | ECS Fargate | Elasticsearch | FastAPI | GitHub | GitHub Actions | GitLab | Infrastructure as Code | JWT | Jenkins | OAuth2 | OpenAPI | OpenSearch | Pytest | Python | SSO | Swagger | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
AI Governance | AI guardrails | API Integration | Agent systems | AutoGPTLocal onsite days | Remote work 3 daysMid-level Full TimeAustin, TX R7h ago
-
AI Evaluation | AI Governance | AI guardrails | Agent systems | Agent workflowsSenior-level Full TimeAustin, TX R7h ago
-
Mid-level Full TimeAustin, TX R7h ago
-
Mid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R9h ago
-
Senior Research Engineer / Scientist -AI for Databases USD 207K-368KAWS | Architecture Search | Artificial Intelligence | Automated Model Tuning | C++401k match | Dental insurance | Disability coverage | Health insurance | Life insuranceSenior-level Full TimeSeattle, Washington, United States R9h ago
-
Research Engineer / Scientist -AI for Databases USD 153K-300KArchitecture Search | Artificial Intelligence | Automated Database Tuning | C++ | Database Internals401k match | Life insurance | Long-Term Disability coverage | Medical/Dental/Vision insurance | Paid HolidaysMid-level Full TimeSeattle, Washington, United States R10h ago
-
A/B | A/B Testing | Apache Airflow | Apache Kafka | Apache Spark401k match | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeSan Jose, California, United States R10h ago
-
Quant Analytics [Multiple Positions Available] USD 158K-201KAWS | Alteryx | Association Rule Mining | Association rule | Behavioral analyticsBackup childcare | Comprehensive health care coverage | Domestic travel | Financial coaching | Mental health supportSenior-level Full TimeColumbus, OH, United States R10h ago
-
Research Engineer / Scientist -AI for Databases USD 162K-387KAWS | Architecture Search | Artificial Intelligence | Automated Database Tuning | Azure401k match | Conference attendance | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeSan Jose, California, United States R11h ago
-
C# | C++ | Computer Graphics | Computer Vision | Data PipelinesEquity compensation | Health benefits | Onsite work schedule Tuesday Wednesday ThursdaySenior-level Full TimeSan Mateo, CA, United States R16h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-510KA/B | A/B Testing | B testing | Continuous Improvement | Feature EngineeringCommuter benefits | Disability benefits | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeNew York, New York R19h ago
-
Staff Machine Learning Engineer, Ad Serving USD 195K-435KDistributed Systems | Experimentation | Feature Engineering | Java | Machine LearningDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts R19h ago
-
AI Agents | AI monitoring | API Integration | Amazon Web Services | Anthropic401k retirement plan | Medical, dental, and vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesSenior-level Full TimeUnited States R20h ago
-
Senior Manager, Commercial Analytics (Immunology - HLH) USD 140K-175KClaims data | Competitive Intelligence | Dashboard Design | Data Mart | Data VisualizationCompetitive 401k match | Conference attendance | Generous time-off policy | Hybrid remote work | Medical, dental, and vision coverageSenior-level Full TimeWaltham, MA, United States R20h ago
-
Team Lead, AI Engineering USD 157K-254KAI Search | AKS | Agent workflows | Async Programming | AuthenticationRemote work hybrid flexibilitySenior-level Full TimeUSA - Atlanta, GA; USA - … R23h ago
-
Lead Data Engineer USD 164K-200KAPIs | AWS | Agentic AI | Azure | Batch dataDisability and life insurance | Employee assistance program | Fertility and family forming benefits | Flexible spending account | Healthcare conciergeSenior-level Full TimeHeadquarters, United States R23h ago
-
Data Engineer USD 114K-126KAPI Integration | AWS | AWS Glue | AWS Lambda | AWS Step Functions401k company match | Free flights | Health insurance for dependents | Profit sharing | Remote workMid-level Full TimeTX-Headquarters-HDQ, United States R23h ago
-
Forward Deployed Engineer (FDE) Data42 USD 160K-297KApplication development | Artificial Intelligence | Auditability | Data Governance | Data IngestionSenior-level Full TimeCambridge (USA), United States R23h ago
-
Forward Deployed Engineer (FDE) Data42 USD 160K-297KArtificial Intelligence | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeCambridge (USA), United States R23h ago
-
Data Engineer USD 73K-99KAzure Data | Azure Data Factory | Azure Synapse | CI/CD | Data Factory401k with profit sharing | Career growth opportunities | Dress for your day policy | Employee resource groups | Flexible working hoursMid-level Full TimeCleveland, United States R23h ago
-
Associate Data and AI Engineer USD 74K-111KAWS | AWS Lambda | Agile | Airflow | Artificial IntelligenceHybrid work arrangement | Remote work optionMid-level Full TimeHartford CT- Home Office, United States R23h ago
-
Unified Data Platform Technical Development Lead USD 107K-195KAPIs | AWS | Agile | Ansible | Apache KafkaSenior-level Full Time6314 Remote/Teleworker US, United States R23h ago
-
Principal AI Software Engineer, GTM USD 194K-263KAWS | AWS CDK | AWS Lambda | Airflow | Amazon BedrockSenior-level Full TimeUnited States R1d ago
-
Sr. Analytics Engineer USD 160K-185KAirflow | CI/CD | DBT | Dagster | Data ModelingCross-functional collaboration | High autonomy | US Pacific overlapSenior-level Full TimeRemote - US R1d ago
-
AWS | Cloud infrastructure | Compute | Data Curation | Distributed Systems401k match | Daily lunches and snacks | Health insurance covered | Hybrid work schedule | Learning and development stipendSenior-level Full TimeRedwood City R1d ago