Data Engineer - AWS/Databricks - Mid Level
Reston, VA, United States
R
USD 113K-169K (estimate) Mid-level Full Time
Tasks
- Build scalable PySpark data pipelines
- Conduct technical discovery and mapping
- Deploy and version data engineering assets
- Design Delta Lake tables
- Develop ETL and ELT workflows
- Implement Spark SQL business rules
- Implement data governance and lineage
- Integrate data sources into Data Warehouse
- Monitor pipeline health and job execution
- Optimize pipeline performance
- Support data access requests and reusable assets
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Amazon IAM | Amazon RDS | Apache Spark | CI/CD | CloudWatch | Databricks | Dataframe API | Delta Lake | Development workflows | ELT | ETL | Git | Git-integrated development workflows | GitLab | Jenkins | PySpark | S3 | Spark SQL
Education
Roles
Related jobs
-
Principle Data Engineer USD 220K-235KAWS | Airflow | BigQuery | Capacity Planning | Compliance401k | Equity | Essential equipment | Flexible PTO | Fully remoteSenior-level Full TimeCleveland, OH R9h ago
-
Software Engineer, Data Platform USD 105K-132KAPI | AWS | CI/CD | Code review | DBT401k | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R11h ago
-
Senior Software Engineer, Data Platform USD 125K-156KAPI Development | AWS | Automation | CI/CD | Data Engineering401k benefits | Baby bonding leave | Commuter benefits | Disability insurance | Employee referral programSenior-level Full TimeUS Remote R11h ago
-
Finance Analytics Engineer USD 185K-221KAnomaly Detection | Apache Airflow | Business Intelligence | Data Modeling | Data MonitoringEquity compensation | Health benefitsMid-level Full TimeSan Mateo, CA, United States R12h ago
-
Data Engineer II USD 101K-153KAmazon RDS | Amazon Redshift | Apache Spark | DBT | Data GovernanceComprehensive health plans | Parental leave | Professional development stipend | Remote workMid-level Full TimeRemote - US R13h ago
-
Full-Stack Analytics Engineer II USD 95K-118KAirflow | BigQuery | CI/CD | DBT | Dagster401k match | Dental insurance | Educational reimbursement | Flexible schedule | Health insuranceMid-level Full TimeWashington DC R14h ago
-
A/B | A/B Testing | AWS | Adversarial Testing | Amazon SQSHybrid work | W2 employmentSenior-level Contract Full TimeIrvine, CA, United States R14h ago
-
Senior Machine Learning Engineer, Roblox Assistant USD 196K-243KData Processing | Distributed data | Distributed data processing | Fine Tuning | Language ModelSenior-level Full TimeSan Mateo, CA, United States R17h ago
-
Data Engineer USD 100K-128KData Governance | Data Modeling | Data Security | Databricks | ELT401k match | Adoption Assistance | Community volunteer opportunities | Continuing education support | Dental insuranceMid-level Full TimeSouth Sioux City, NE, United States R18h ago
-
Data Engineer USD 148K-263KAPI | Apache Kafka | Apache Spark | Cassandra | Distributed SystemsDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceMid-level Full TimeUSA-Remote Work R20h ago
-
Senior-level Full TimeRemote - United States R1d ago
-
Data Reliability Engineer/Software Engineer USD 110K-177KAmazon S3 | BigQuery | CI/CD | Cause analysis | Data Catalog401k match | Flexible spending account | Health savings account | Paid parental leave | Paid time off and holidaysMid-level Full TimeLowell, United States R1d ago
-
Senior Machine Learning Engineering (Remote) USD 108K-270KAWS | Agile | Azure | Bias detection | CI/CDConference and journal article opportunities | Mentorship culture | Remote workSenior-level Full TimeDurham, North Carolina, United States of … R1d ago
-
AI Engineer - Application Development USD 75K-158KAWS | AWS Bedrock | AWS GovCloud | Agno | Amazon BedrockFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Senior Data Engineer- Data Science & AI USD 165K-216KAWS Glue | AWS Lambda | AWS S3 | Airflow | Azure DataGreat place to work | Work-life balanceSenior-level Full TimeTelecommuter TN, United States R1d ago
-
Senior Software Engineer USD 186K-220KAWS | Azure | Cloud platform | Docker | Fine TuningContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago
-
AI Solutions Architect USD 126K-225KAir gapped deployment | Air-gapped | Apache Kafka | Apache NiFi | Data PipelinesCareer development | Employee resource groups | Flexible work from home | Generous paid time off | Paid volunteer timeSenior-level Full TimeUS-Washington DC-Remote, United States R1d ago
-
Senior Data Engineer - Anywhere Cloud USD 152K-195KABAC | Access Control | Anomaly Detection | Apache Airflow | Apache KafkaContinued Career Development | Employee resource groups | Flexible WFH policy | Generous PTO policy | Mental and physical wellness programsSenior-level Full TimeUS-California-San Jose, United States R1d ago
-
Actuarial Data Scientist (Hybrid) USD 99K-163KData Analysis | Data Mining | Data Modeling | Data Wrangling | Git401k contribution | Dental insurance | Medical insurance | Non Disclosure Agreement | Paid HolidaysMid-level Full TimeAF-MA Boston Office Congress St, United … R1d ago
-
AWS | Agile | Azure | CI/CD | Data Modeling401k match | Adoption Assistance | Fertility assistance | GEICO Flex program | Hybrid workSenior-level Full TimeMD Bethesda (Office) - JPS, United … R1d ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
Senior Data Engineer (Health Research Team) USD 104K-199KAWS EC2 | AWS S3 | Apache Spark | Azure | Data Governance401k plan | Employee Assistance Program (EAP) | Family building benefits | Flexible Spending Accounts FSA | Flexible work arrangementsSenior-level Full TimeChicago, Illinois, United States R1d ago
-
Senior Snowflake / data platform engineer USD 120K-155KAWS | Agile | Alerting | Automation | Backend ServicesFlexible remote days | Health insurance | Hybrid work model | Life insurance | Onsite days fixed scheduleSenior-level Full TimeTampa, FL, United States R1d ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R1d ago
-
Senior Machine Learning Platform Engineer USD 160K-210KAutomated retraining | C plus plus | CI/CD | Docker | Elasticsearch401k match | Annual bonus | Company equipment provided | Company in person events | Company medical dental vision plansSenior-level Full TimeAtlanta, GA preferred, Remote R1d ago