Senior Data Engineer - Anywhere Cloud
US-California-San Jose, United States
R
USD 152K-195K (estimate) Senior-level Full Time
Tasks
- Build test automation for data pipelines
- Debug Kubernetes deployments
- Design test plans for end to end data pipeline validation
- Detect statistical anomalies in pipelines
- Develop Python and Shell scripting for automation
- Enforce tag based ABAC column masking row level filters
- Ensure zero downtime upgrades for stateful data engines
- Execute custom blueprint pipeline testing
- Implement automated data quality checks
- Integrate data governance policies into pipelines
- Perform schema drift monitoring and handling
- Validate Helm chart deployments and dependencies
- Verify cross cluster service discovery
Perks/Benefits
- Continued Career Development
- Employee resource groups
- Flexible WFH policy
- Generous PTO policy
- Mental and physical wellness programs
- Paid volunteer time
- Phone and internet reimbursement
- Work-life balance programs
Skills/Tech-stack
ABAC | Access Control | Anomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Attribute-Based Access Control | Attribute-based access | CRDs | Column Masking | Controllers | Data Modeling | Data Quality | Helm | Kubernetes | Namespaces | Octopai | Operators | Python | Row level filtering | Schema drift | Service Mesh | Shell | Trino | Zero code lineage
Education
Related jobs
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R10h ago
-
Data Engineer USD 100K-128KData Governance | Data Modeling | Data Security | Databricks | ELT401k match | Adoption Assistance | Community volunteer opportunities | Continuing education support | Dental insuranceMid-level Full TimeSouth Sioux City, NE, United States R15h ago
-
Data Engineer USD 148K-263KAPI | Apache Kafka | Apache Spark | Cassandra | Distributed SystemsDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceMid-level Full TimeUSA-Remote Work R16h ago
-
Staff Software Engineer - Core Ingest USD 191K-224KAgile Development | Apache Kafka | Distributed Systems | Docker | Fault ToleranceHealth insurance | Paid time off | Remote work optionsSenior-level Full TimeUnited States, Remote R1d ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Data Reliability Engineer/Software Engineer USD 110K-177KAmazon S3 | BigQuery | CI/CD | Cause analysis | Data Catalog401k match | Flexible spending account | Health savings account | Paid parental leave | Paid time off and holidaysMid-level Full TimeLowell, United States R1d ago
-
Senior Machine Learning Engineering (Remote) USD 108K-270KAWS | Agile | Azure | Bias detection | CI/CDConference and journal article opportunities | Mentorship culture | Remote workSenior-level Full TimeDurham, North Carolina, United States of … R1d ago
-
AI Engineer - Application Development USD 75K-158KAWS | AWS Bedrock | AWS GovCloud | Agno | Amazon BedrockFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Senior Data Engineer- Data Science & AI USD 165K-216KAWS Glue | AWS Lambda | AWS S3 | Airflow | Azure DataGreat place to work | Work-life balanceSenior-level Full TimeTelecommuter TN, United States R1d ago
-
Senior Software Engineer USD 186K-220KAWS | Azure | Cloud platform | Docker | Fine TuningContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago
-
AI Solutions Architect USD 126K-225KAir gapped deployment | Air-gapped | Apache Kafka | Apache NiFi | Data PipelinesCareer development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeSenior-level Full TimeUS-Washington DC-Remote, United States R1d ago
-
Actuarial Data Scientist (Hybrid) USD 99K-163KData Analysis | Data Mining | Data Modeling | Data Wrangling | Git401k contribution | Dental insurance | Medical insurance | Non Disclosure Agreement | Paid HolidaysMid-level Full TimeAF-MA Boston Office Congress St, United … R1d ago
-
Software Engineer Intern – AI Applications USD 54K-69KAI Agent | AI agent orchestration | APIs | AWS | Agent OrchestrationEntry-level Full Time InternshipRemote, United States R1d ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
Senior Data Engineer (Health Research Team) USD 104K-199KAWS EC2 | AWS S3 | Apache Spark | Azure | Data Governance401k plan | Employee Assistance Program (EAP) | Family building benefits | Flexible Spending Accounts FSA | Flexible work arrangementsSenior-level Full TimeChicago, Illinois, United States R1d ago
-
Senior Snowflake / data platform engineer USD 120K-155KAWS | Agile | Alerting | Automation | Backend ServicesFlexible remote days | Health insurance | Hybrid work model | Life insurance | Onsite days fixed scheduleSenior-level Full TimeTampa, FL, United States R1d ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R1d ago
-
Senior Software Engineer - Data Infrastructure, Safety USD 196K-243KA/B | A/B Testing | AI | Automation | B testingSenior-level Full TimeSan Mateo, CA, United States R1d ago
-
Senior Machine Learning Platform Engineer USD 160K-210KAutomated retraining | C plus plus | CI/CD | Docker | Elasticsearch401k match | Annual bonus | Company equipment provided | Company in person events | Company medical dental vision plansSenior-level Full TimeAtlanta, GA preferred, Remote R1d ago
-
Data Engineer USD 133K-159KBigQuery | Cloud platform | DBT | Data Governance | Data Modeling401k matching | Employee assistance program | Employee stock purchase program | Flexible vacation | Hybrid work modelMid-level Full TimeSan Francisco, CA R1d ago
-
Machine Learning Engineer USD 180K-250KAWS | Azure | CUDA | DDP | Distributed Training401k employer match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R1d ago
-
Apache Airflow | Data Architecture | Data Engineering | Data Governance | Data ModelingCollaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMassachusetts R1d ago
-
AI Tooling | Apache Airflow | Data Architecture | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeMinnesota R1d ago
-
Apache Airflow | Data Architecture | Data Compliance | Data Governance | Data ModelingCollaborative work environment | Continuous learning | Flexible work hours | Health and wellness programs | Work from homeSenior-level Full TimeIllinois R1d ago
-
Airflow | Analytics engineering | Data Architecture | Data Compliance | Data GovernanceAccess to cutting-edge technologies | Collaborative work environment | Continuous learning and development | Flexible work hours | Health and wellness programsSenior-level Full TimeIdaho R1d ago