Senior Data Engineer
Tasks
- Build and run Spark pipelines on AWS Glue
- Build reusable Airflow templates
- Design data onboarding pipelines for new sources
- Enforce pipeline standards and testing
- Improve data models and data lineage
- Maintain internal Python package for data team
- Own Airflow codebase end to end
- Serve as pipeline architecture and troubleshooting lead
- Support migration of Spark workloads to Databricks
Perks/Benefits
- Charitable giving program
- Company-Paid Holidays
- Dental insurance
- Flexible PTO
- Life insurance
- Medical insurance
- Retirement programs
- Vision insurance
Skills/Tech-stack
AWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS MWAA | AWS Secrets | AWS Secrets Manager | Amazon ECS | Amazon S3 | Apache Airflow | Apache Spark | Databricks | Python | SQL | Secrets Manager
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R22d ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R9h ago
-
Staff Machine Learning Engineer, Applied Research USD 189K-389KC++ | Graph Neural Networks | Information Retrieval | Java | Language ProcessingSenior-level Full TimeSan Francisco, CA, US; Remote, US R10h ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R10h ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R11h ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI strategy | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Paid leave | RetirementSenior-level Full TimeHanover, MD R17h ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R17h ago
-
Principal Data Engineer USD 190K-210KAmazon Kinesis | Containerization | Helm | Infrastructure as Code | JuliaEquity | In person office hubs | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R17h ago
-
Principal Software Engineer, Data USD 190K-210KAmazon Kinesis | Containerization | Data Engineering | Event Processing | HelmEquity | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R17h ago
-
AWS | Agile | Apache Hive | Apache Spark | Cloudera Data PlatformRemote workSenior-level ContractLincoln, United States R18h ago
-
Middle Data Engineer (Azure Databricks) USD 160K-223KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCertification programs | Health insurance | Mentorship | Professional development opportunities | Relocation programMid-level Full TimeMadrid, MD, Spain R19h ago
-
Senior Applied AI Engineer USD 205K-238KAgentic Methodologies | Agentic Workflows | Deep learning | Fine Tuning | Generative AIFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R1d ago
-
Senior Data Engineer, Platform USD 116K-146KAWS | AWS DMS | Airflow | CI/CD | CloudFormationBonus | Equity | Health benefitsSenior-level Full TimeRemote - US, United States R1d ago
-
AI Engineer (Data Intelligence Analyst) - Remote USD 110K-160KAnomaly Detection | Automation | Azure | Azure Fabric | Data GovernanceRemote workMid-level Full TimeLocation Los Angeles, California, United States R1d ago
-
Architect MLE USD 160K-201KAKS | AWS | Arize AI | Asynchronous programming | AzureCareer development | Flexible work environment | Learning and growthSenior-level Full TimeUSA - Remote, United States R1d ago
-
Software Engineer, AI/ML USD 102K-160KAWS | AWS Bedrock | Azure | Azure OpenAI | C#401k matching | Disability insurance | Employee ownership | Growth opportunities | Health insuranceSenior-level Full TimeUSA-GA-Office-Atlanta, United States R1d ago
-
Senior MLOps & Generative AI Engineer - Remote USD 91K-152KAI Evaluation | APIs | AWS | Alerting | AzureAdoption reimbursement | Emergency backup care | Family caregiver leave | Fertility reimbursement | Medical, dental, vision plansSenior-level Full TimeCorp Facilities MPB - 350 Centre … R1d ago
-
Snowflake Data Engineer USD 80K-115KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage401k retirement plan | Dental insurance | Employee stock purchase plan | Learning opportunities | Long-term disabilityMid-level Full TimeRemote - USA, United States R1d ago
-
Senior AI/LLM Engineer USD 179K-201KAPI Development | CI/CD | Embeddings | Fine Tuning | Guardrails401k match | Dental insurance | Health insurance | Remote work | Vision insuranceSenior-level Full TimeRemote (US/Canada) R1d ago
-
Staff Software Engineer (Tech Lead) USD 180K-230KBigQuery | Cloud Run | Cloud platform | Distributed Systems | Docker401k company match | Flexible PTO | GitHub | Health savings account | Hybrid workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Analytics Engineer USD 157K-185KAirflow | Anonymization | BigQuery | Compliance | DBT401k match | Cellphone stipend | Commuter benefits | Company-Paid Holidays | Family planning benefitsSenior-level Full TimeRemote U.S. R1d ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agile | Algorithms | C++ | CI/CDHybrid remote workSenior-level Full TimeWoburn, MA R1d ago
-
Autonomy Algorithms Lead Software Engineer USD 173K-216KAgent coordination | Agent systems | Agentic AI | Agile | AlgorithmsHybrid work environment | Remote work flexibilitySenior-level Full TimeArlington, VA R1d ago
-
C++ | Data Movement | Data movement optimization | Distributed Systems | HPC job schedulingHigh-impact research projects | Hybrid work environmentMid-level Full TimeUS Broomfield, CO R1d ago
-
Autonomy Algorithms Senior Software Engineer USD 134K-184KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid environment | Remote work option | Security clearance supportSenior-level Full TimeDayton, OH R1d ago