Data Engineer - AWS/Databricks
Reston, VA, United States
R
USD 122K-210K (estimate) Entry-level Full Time
Tasks
- Automate deployments with CI/CD tools
- Build data pipelines in Databricks
- Deploy and version data assets with Git
- Design Delta Lake tables
- Develop ETL and ELT workflows
- Implement business rules with Spark SQL
- Implement data governance and lineage
- Integrate source systems into data warehouse
- Monitor pipeline health and job execution
- Optimize pipeline performance
- Perform technical discovery of legacy systems
- Support reusable data assets and shared notebooks
- Validate data quality and audit logging
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Adaptive Query | Adaptive query execution | Amazon RDS | Amazon S3 | Apache Spark | Audit Logging | Broadcast Join | CI/CD | Caching | CloudWatch | Data Governance | Data Quality | DataFrame | Databricks | Delta Lake | Delta Lake ACID | ELT | ETL | Git | GitLab | IAM | Jenkins | Lineage | Metadata tagging | Partition Pruning | PySpark | Query Execution | Schema Enforcement | Spark Partitioning | Spark SQL
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Sr. Engineer, Firmware & Embedded Software USD 79K-158KAgile | Azure DevOps | BDM | Bare Metal | BootloaderOccasional travel for onboarding | Remote work within the United StatesSenior-level Full TimeFlorida, United States R19h ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-160KAPI Development | Agile | Backend Development | Cloud Native | Code review401k | Employee discount program | Employee referral program | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, MD, US R19h ago
-
Data Engineer / Data Architect (Mid to Senior) (Top Secret Clearance Required) (Hybrid) USD 140K-170KAPI Development | Agile | Backend Development | Cloud Computing | Data Architecture401k | Employee discount program | Employee referral rewards | Flexible spending accounts | Flexible work scheduleMid-level Full TimeQuantico, VA, US R19h ago
-
Data Solutions Engineer - HYBRID/NC RESIDENTS ONLY USD 119K-164KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k match | Dental insurance | Employee referral program | Flexible spending account | Health insuranceEntry-level Full TimeDurham, North Carolina, United States R20h ago
-
Senior Data Engineer - Digital Pathology (Hybrid) USD 98K-163KAPI Integration | Agile | Apache Airflow | Apache Spark | Batch ProcessingSenior-level Full TimeRochester, MN, United States R20h ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R21h ago
-
Senior-level Full TimeRemote - United States R21h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R22h ago
-
Staff Software Engineer, Data Products USD 171K-224KAWS | AWS Lambda | Amazon Athena | Amazon Redshift | Amazon S3401k retirement savings plan | Flexible time off | Generous parental leave | Health, dental, and vision insurance | Lifestyle spending account mental health support solutionsSenior-level Full TimeRemote, USA R22h ago
-
Senior Software Engineer (Data Engineer) USD 138K-162KAWS | Akka | Algorithms | Apache Spark | Cloud Native401k plan company match | Basic life insurance | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeUnited States R22h ago
-
Senior Data Engineer - Agentic AI Engineering USD 138K-173KAWS | Access Control | Airflow | Azure | Batch dataRemote-friendlySenior-level Full TimeUnited States of America R23h ago
-
AWS | AWS CDK | AWS CodeBuild | AWS CodePipeline | AWS Secrets401k | Healthcare coverage | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R23h ago
-
Data Engineer USD 90K-151KAPIs | Amazon Redshift | CI/CD | Cloud Computing | Cloud platform401k match | Dental insurance | Equipment provided | Health insurance | PTOMid-level Full TimeRemote, US R23h ago
-
Algorithms | Concurrency | Data Structures | Database systems | Distributed SystemsCompany-matched 401k | Flexible schedule | Health coverage | Parental leave | Remote work flexibilitySenior-level Full TimeUnited States R1d ago
-
Algorithms | Concurrent programming | Data Structures | Distributed Systems | ESQL401k match | Flexible schedule | Generous vacation days | Health coverage | Parental leaveSenior-level Full TimeUnited States R1d ago
-
Senior Solution Engineer, HCLS USD 165K-216KAnalytics | Cloud Computing | Data Lake | Data Warehouse | Data fabricTravel opportunitiesSenior-level Full TimeUS-IN-Remote R1d ago
-
Senior AI Engineer, Contract To Hire USD 130K-195KAWS | Agentic AI | Cloud Native | Cloud platform | Cloud-native developmentSenior-level Full TimeRemote, United States R1d ago
-
AWS Data Engineer (Associate) USD 111K-180KAmazon Athena | Amazon Glue | Amazon Redshift | Apache Spark | Dataframe APIMid-level Full TimeSeattle, WA R1d ago
-
Principal Data Engineer USD 129K-180KAdobe Analytics | Adobe XD | Amazon Web Services | Bitbucket | CI/CDRelocation Support N/A | Remote work permittedSenior-level Full TimeUnited States R1d ago
-
Sr. AI Platform Engineer USD 105K-180KAWS | Airflow | Automation | Dagster | DockerDental insurance | Health insurance | Holidays | Paid time off | Professional development opportunitiesSenior-level Full TimeRichardson, TX, United States R1d ago
-
AI/ML Software Engineer USD 95K-140KAWS | Agent systems | Agentic Workflows | Autogen | AzureDisability insurance | Life insurance | Paid parental leave | Paid time off | Retirement plan matchSenior-level Full TimeEvendale, United States R1d ago
-
Applied AI Engineer USD 100K-150KAblation Studies | Computer Vision | Data Quality | Data quality monitoring | Deep learningSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerator hardware | Agentic Systems | Computer Vision | Data QualitySenior-level Full TimeUnited States - Remote R1d ago