Senior Data Engineer (Python/Scala)
Nationwide Remote Office (US99), United States
R
USD 98K-167K Senior-level Full Time
Tasks
- Automate metadata processes
- Collaborate with architects on engineering standards
- Conduct data profiling and compliance requirements
- Create AWS QuickSight dashboards
- Define and track data quality KPIs
- Design Spark data ingestion pipelines
- Develop data model templates and self service solutions
- Enforce data contracts and schema versioning
- Handle PII data governance
- Lead incident triage and root cause analysis
- Log audit and measure data quality results
- Optimize distributed compute resources
- Orchestrate batch and event driven workflows
- Partner with domain owners to deliver data products
- Perform data quality checks
- Work in SAFe scaled agile framework
Perks/Benefits
Skills/Tech-stack
AWS | AWS QuickSight | AWS Step Functions | Apache Airflow | Apache NiFi | Apache Spark | Cloud Native | Data Catalog | Data Contracts | Data Governance | Data Lineage | Data Quality | Data Retention | Data Validation | Data Warehousing | Data orchestration | Data profiling | Metadata Management | Observability | PII | Python | Referential Integrity | Relational databases | SAFe | Scala | Schema Validation | Schema versioning | Serverless | Step Functions
Education
Roles
Related jobs
-
Senior Data Engineer USD 135K-165KApache Airflow | Apache Spark | Argo | Cloud Dataproc | Context engineering401k match | Beverages | Dental insurance | Health insurance | Hybrid work availabilitySenior-level Full TimeDenver, CO, US R13h ago
-
Security Data Engineer USD 136K-270KAPIs | Access Control | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeUS, CA, Remote, United States R1d ago
-
AI Agent | AI agent workflows | AI systems | API Integration | Agent workflowsBonus | Equity | Hybrid work | Leadership growthSenior-level Full TimeNew York, New York; Hybrid R1d ago
-
API Gateway | C++ | Cilium | Distributed tracing | EnvoyMedical/Dental/Vision insurance | Paid parental leave | Paid time off | Retirement 401k matchSenior-level Full TimeBoston, United States R1d ago
-
ANSI | Ampacity Calculations | Arc Flash | Arc flash analysis | Automation Scripting401k matching | Donation matching | Employee stock purchase plan | Flexible schedule | Fully remoteSenior-level Full TimeNationwide Remote Office (US99), United States R1d ago
-
Data Engineer II USD 63K-114KBusiness Intelligence | Data Ingestion | Data Pipelines | Data Processing | Data Quality401k | Health insurance | Hybrid work options | Paid Holidays | Paid time offMid-level Full TimeRemote-MI, United States R1d ago
-
1483466 Principal AI Platform Engineer/ AI Infrastructure Engineer(LLMOps / MLOps)- Remote A USD 150K-170KAI Search | AWS | Airflow | Arize Phoenix | AzureFirst shift hours | Fully remote | Monday to Friday scheduleSenior-level Full TimeUnited States R1d ago
-
Senior Forward Deployed Engineer (AI/ML) USD 140K-174KBenchmarking | CUDA | Continuous batching | CrewAI | DatabasesConference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee MeetupsSenior-level Full TimeSeattle R1d ago
-
Senior Forward Deployed Engineer (AI/ML) USD 140K-174KArtificial Intelligence | CUDA | Continuous batching | CrewAI | DatabasesConference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Remote workSenior-level Full TimeSan Francisco R1d ago
-
Data Engineer USD 127K-175KAWS | Airbyte | Airflow | Alerting | CI/CD401k contribution | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeUnited States - Remote R1d ago
-
Staff Engineer - AI Engineer USD 155K-175KERP | Hugging Face | Langchain | MES | ModbusContract extension possible | Remote workSenior-level Full TimeRemote, REMOTE, United States R1d ago
-
Staff Embedded Controls Engineer, Body Controls USD 129K-244KActuator control | Automation frameworks | Automotive Ethernet | Batteries | BazelEmployee resource groups | Flexible family care days | Medical, dental & vision coverage | Paid Holidays | Paid community serviceSenior-level Full TimePalo Alto, CA, United States R1d ago
-
Intern, AI/ML USD 70K-120KAlgorithm deployment | C++ | Computer Vision | Deep learning | GPU ComputingAccess to LinkedIn Learning | Commuter benefits | Internet reimbursement | Paid time offEntry-level InternshipUnited States, Remote R1d ago
-
Senior Staff Engineer, Computer Vision/AI USD 270K-342KAWS | Active Learning | Airflow | Alerting | AzureAnnual refresh grants | Equity grant | Remote work flexibilitySenior-level Full TimeUnited States - Remote R1d ago
-
Staff Machine Learning Engineer, GenAI Platform USD 253K-354KCUDA | DeepSpeed | Distributed Systems | Docker | FSDP401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefitsSenior-level Full TimeRemote - United States R1d ago
-
Senior Staff Machine Learning Engineer, GenAI Platform USD 292K-409KAWS | Agentic AI | CI/CD | Cloud Storage | Generative AI401k employer match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R1d ago
-
Data Engineer II USD 82K-130KAirflow | Amazon Web Services | DBT | Data Ingestion | Data Pipeline MonitoringFixed term 12 month position | Possibility of renewal | Remote within United States | Wellbeing focused benefitsMid-level Full TimeUnited States R1d ago
-
Sr. Data Engineer USD 180K-220KBusiness Intelligence | DBT | Dashboards | Data Modeling | Data Transformation401k plan | Health coverage | Life and disability insurance | Mental health days | Paid parental leaveSenior-level Full TimeRemote - United States Only R1d ago
-
Senior Data Engineer USD 148K-214KAWS | Amazon DynamoDB | Amazon EMR | Amazon S3 | Apache Airflow401k matching | Bonus program | Equity plans | Medical, dental & vision coverage | Unlimited PTOSenior-level Full TimePasadena, United States R1d ago
-
Staff Data Engineer | Luma USD 142K-163KAWS | Agile | Apache Kafka | Asynchronous processing | CI/CD401k retirement plan | Dental insurance | Disability insurance | Fitness perks | Flexible time offSenior-level Full TimeRemote - USA R1d ago
-
Machine Learning Engineer USD 140K-200KAWS Lambda | Amazon ECS | Amazon EKS | Amazon Web Services | Apache SparkMid-level Full TimeUnited States - Remote R1d ago
-
Cloudflare | Docker | Event Processing | Go | JavaScriptHigh ownership culture | Remote work flexibility | Startup environmentSenior-level Full TimeRemote, US R1d ago
-
Senior Data/ML Engineer USD 151K-205KDBT | Data Architecture | Data Governance | Data Observability | Data Quality401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R2d ago
-
Senior Developer Experience Advocate USD 141K-190KAI Agents | Benchmarking | DBT | Documentation | GitHub401k with guaranteed contribution | Healthcare | Home office stipend | Paid parental leave | Unlimited vacationSenior-level Full TimeUS - Remote R2d ago
-
Sr. Enterprise Security Engineer USD 176K-260KAPI Security | Access Control | Application Security | Audit Logging | AuthenticationSenior-level Full TimeRemote - California R2d ago