Data Engineer - AWS/Databricks
Reston, VA, United States
R
USD 122K-202K (estimate) Entry-level Full Time
Tasks
- Build AWS cloud data solutions using S3 Glue RDS and IAM
- Build scalable PySpark data pipelines in Databricks
- Deploy and version data engineering assets with CI CD
- Design Delta Lake tables for ACID and performance
- Develop ETL and ELT workflows
- Implement Spark SQL and DataFrame business rules
- Implement data governance metadata validation and lineage
- Map legacy systems and design end to end data flows
- Monitor pipeline health and cluster utilization with CloudWatch
- Optimize pipeline performance with partitioning caching and joins
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Adaptive Query | Adaptive query execution | Amazon RDS | Apache Spark | Audit Logging | Broadcast joins | CI/CD | CloudWatch | Data Lineage | Data Modeling | Data Quality | Data Validation | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Git | GitLab | IAM | Jenkins | Metadata tagging | Partition Pruning | PySpark | Query Execution | S3 | Schema Enforcement | Spark SQL
Education
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Access Control | Agile | Data Governance | Data Modeling | Data SecurityFlexible core business hours | Remote workEntry-level Full TimeArlington, VA, Remote, United States R14h ago
-
Agile | Data Architecture | Data Governance | Data Integrity | Data Modeling401k | Employee assistance program | Employee discounts | Health, dental, and vision plans | Life insuranceSenior-level Full TimeArlington, VA, Remote, United States R14h ago
-
Machine Learning Engineer, Ops USD 125K-165KCI/CD | GPU Acceleration | Go | Inference Optimization | Inference Server401k matching | Company equity | Dental insurance | Fertility support | Health insuranceMid-level Full TimeRemote (U.S. or Europe) R15h ago
-
Staff Data Engineer USD 170K-200KAccess Controls | Airflow | Alerting | Amazon Web Services | Anomaly Detection401k employer matching | Comprehensive health benefits | Employee stock purchase program | Offsite team retreats | Parental leaveSenior-level Full TimeUS Remote R15h ago
-
Analytics Engineer USD 150K-200KAmazon S3 | Analytics | BigQuery | Data Instrumentation | Data Modeling401k | Flexible PTO | Flexible hours | Home office stipend | Long-term disabilitySenior-level Full TimeRemote (United States) R15h ago
-
Data Engineer USD 128K-145KApache Airflow | Apache Kafka | Apache Spark | CI/CD | Data GovernanceChildcare subsidy | Dell discount | Education discount | Employee assistance program | GympassMid-level Full TimeUnited States - Remote R16h ago
-
Principal Data Engineer (GCP & Big Query) USD 140K-190KBigQuery | Cloud platform | Clustering | Cost Management | Data Modeling401k matching | Employee awards | Industry certifications | Mentorship | Paid time offSenior-level Full TimeUnited States R16h ago
-
Machine Learning Engineer, Underwriting USD 166K-210KAWS | Calibration | Credit Risk | Credit risk modeling | Decision SystemsSenior-level Full TimeRemote R19h ago
-
Analyst, Underwriting Analytics USD 75K-100KAnalytics | DAX | Dashboards | Data Analysis | Data Integrity401k match | Dental insurance | Disability insurance | HSA | Health insuranceMid-level Full TimeRemote (United States) R19h ago
-
AWS | AWS Athena | AWS Bedrock | AWS CDK | AWS CodeBuild401k | Health insurance | Paid Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R20h ago
-
Staff Analytics Engineer USD 159K-187KClaude | Claude Code | DBT | Data Modeling | Data mesh401k match | Accident insurance | Company funded HSA | Critical illness insurance | Dental insuranceSenior-level Full TimeRemote (United States) R22h ago
-
Generative AI Leader/Architect USD 125K-200KAPI Development | AWS | Agent systems | Agentic AI | Agentic SDKSenior-level Full TimeDallas, Texas, United States - Remote R1d ago
-
Principal Data & Analytics Engineer USD 140K-192KAWS | Agile | Azure | Cloud Computing | Cloud platform401k match | Dental insurance | Employee discounts | Hybrid work | Medical insuranceSenior-level Full TimeChandler, AZ, United States R1d ago
-
Senior AI Full Stack Engineer USD 66K-84KAPI Gateway | Agentic Workflows | Anthropic | Azure OpenAI | CI/CDSenior-level Full TimeIndianapolis, IN - Remote/Hybrid R1d ago
-
Principal AI Platform Engineer [Hybrid] USD 163K-190KAWS Bedrock | AWS CDK | Agents | Anthropic Claude | Architecture Review401k matching | Health coverage | Learning and career development | Mentorship and buddy programs | Paid parental leaveSenior-level Full TimeSan Diego, CA, United States R1d ago
-
Principal Data Engineer AI USD 175K-205KAWS | Apache Airflow | Apache Spark | Audit Logging | Audit trails401k | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R1d ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R1d ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Azure Data and MLOps Engineer USD 116K-222KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data Lake401k match | Company paid life insurance | Company paid vision plan | Company-paid disability insurance | PTOSenior-level ContractUnited States - Remote R1d ago