Senior Software Engineer II, Cloud Data Pipeline
Tasks
- Build and maintain production ETL systems
- Define data quality metrics
- Design data pipelines and ETLs
- Implement CI/CD pipelines
- Implement scalable data infrastructure
- Improve cloud system architecture
- Improve system security
- Manage APIs and database schemas
- Manage cloud deployments
- Optimize AWS costs
- Use infrastructure as code
Perks/Benefits
Skills/Tech-stack
API Design | AWS | AWS CDK | AWS Step Functions | Apache Airflow | CI/CD | Data Observability | Data Quality | Database Schema | Database Schema Design | Docker | ECS | ETL | Infrastructure as Code | Kubernetes | Nextflow | NoSQL | Pipeline monitoring | Prefect | Python | Relational databases | Schema Design | Step Functions | Terraform | “as-code”
Education
Related jobs
-
AI Solutions Specialist USD 113K-197KAI Search | API Development | Azure AI | Azure AI Search | Azure FunctionsHybrid work scheduleMid-level Full TimeKansas City, MO, United States17h ago
-
Software Development Engineer-AI/LLM Network-Global Frontier Tech Recruitment Program-2027 Start (PhD) USD 212K-450KAI | C++ | Cause analysis | Fault Localization | High PerformanceEntry-level Full TimeSan Jose, California, United States22h ago
-
Senior-level Full TimeUSA-VA-Chantilly22h ago
-
Senior-level Full TimeUSA-VA-Chantilly22h ago
-
Data Science Intern - Machine Learning USD 51K-85KA/B | A/B Testing | Artificial Intelligence | B testing | Computer VisionHybrid workEntry-level InternshipUSA-VA-Herndon22h ago
-
Data Science Intern - AI Focus USD 53K-89KAgents | Artificial Intelligence | Data Modeling | ETL | EmbeddingsEntry-level InternshipUSA-VA-Herndon22h ago
-
Architectural components | C plus plus | CSS | Convolutional Neural Networks | Generative AISenior-level Full TimeSan Francisco, CA, USA; Sunnyvale, CA, …23h ago
-
C++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA; Pittsburgh, PA, …23h ago
-
BigQuery | Cloud platform | Data Processing | Data Warehousing | DebuggingSenior-level Full TimeKirkland, WA, USA23h ago
-
Senior Software Engineer, AI/ML, Google Cloud USD 174K-252KC++ | Code review | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeKirkland, WA, USA23h ago
-
Azure Data | Azure Data Factory | Cloud Data | Cloud Data Architecture | Data ArchitectureCross-functional collaboration | Remote workMid-level Full TimeSan Francisco, United States of America R1d ago
-
Senior Software Engineer - Production Control Plane USD 200K-287KAmazon Web Services | Azure | C++ | CI/CD | Cloud platformSenior-level Full TimeUS-CA-Menlo Park1d ago
-
Staff Systems Analyst – Robotic Algorithms and Control USD 147K-201KC# | C++ | Classical control | Control System | Control system designSenior-level Full TimeSunnyvale, CA, United States1d ago
-
AI/Machine Learning Engineer Intern USD 50K-52KAPIs | Artificial Intelligence | Benchmarking | Cybersecurity | Data evaluationFun events | Leadership speaker series | Mentorship | Professional networking | Training and developmentEntry-level InternshipUnited States - Remote R1d ago
-
Associate AI/ML Engineer USD 100K-215KAzure Data | Azure Data Lake | Azure Machine Learning | Azure Synapse | Azure Synapse AnalyticsHealthcare benefits | Hybrid work environmentMid-level Full TimeColumbia, MD, US1d ago
-
ETL Developer (SR-5269058-DEV) USD 102K-160KAPI Integration | AWS Glue | Agile | Audit Logging | Azure DataAgile Scrum team environment | Remote work | Technical documentation and trainingEntry-level Full TimeBaton Rouge, LA, US1d ago
-
Software Development Engineer (SASE) USD 123K-151KC# | C++ | CASB | Cloud Computing | Continuous Delivery401k | Dental insurance | Disability insurance | Health insurance | Leave ProgramSenior-level Full TimeSanta Clara, CA, United States1d ago
-
Mid-level Full TimeMentor, OH, US1d ago
-
Sr. Principle Global Industrial Analytics Engineer USD 114K-171KAWS | Artificial Intelligence | Azure | Closed Loop | Closed loop controlCareer development opportunities | Flexible time off | Health insurance | Life insurance | Retirement planSenior-level Full TimeFort Worth - Main, United States1d ago
-
AI Search | AWS | Azure | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States1d ago
-
Machine Learning Engineer, Discovery Recommendations USD 157K-230KA/B | A/B Testing | AWS | Apache Spark | B testing401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States1d ago
-
Data Science -Application Development in Production Management (Tableau Developer) - Irving USD 36K-126KAPI Development | Big Data | Data Aggregation | Data Blending | Data Cleansing401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States1d ago
-
Data Science - Senior Engineer in Production Management (Big Data - Snowflake Focused) - Irving USD 36K-126KAWS | Algorithms | Amazon CloudFormation | CI/CD | Cloud infrastructure401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States1d ago
-
API | Angular | C# | C++ | Celery401k retirement plan | Company shuttles | Dental insurance | Employee stock purchase plan | Life insuranceSenior-level Full TimeRedmond, WA1d ago
-
Deployment Engineer - Commercial Site Team USD 120K-180KConfluence | Industrial Automation | Jira | Linux | Project ManagementCustomer site work experience | Travel opportunitiesMid-level Full TimeReno, NV1d ago