AWS Lakehouse Data Engineer
Home Office: Tysons, VA, United States
USD 113K-188K Mid-level Full Time
Tasks
- Build CI CD for data pipelines
- Build ETL/ELT pipelines
- Collaborate with cross-functional teams
- Create lakehouse on Amazon S3 with Apache Iceberg
- Design batch and streaming ingestion
- Develop IaC provisioning and secure environments
- Document architecture and data models
- Implement incremental processing and CDC
- Implement metadata catalog lineage and data quality checks
- Implement observability and incident response
- Optimize querying with Athena EMR Glue and Redshift
- Set up data governance and access control
Perks/Benefits
- 401k retirement plan
- Care Com Membership
- Commuter benefits
- Dental insurance
- Employee assistance program
- Employee referral program
- Flexible spending accounts
- Group term life insurance
- Health insurance
- Health savings account
- Learning opportunities
- Long-term disability
- Paid Holidays
- Parental leave
- Personal and Family Sick Time
- Short-term disability
- Transit and parking benefits
- Travel assistance
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
ACID | AWS CloudFormation | AWS CodePipeline | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lake | AWS Lake Formation | Access Management | Amazon Athena | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web Services | Apache Iceberg | Apache Parquet | CDC | CI/CD | Change Data Capture | Column-Level Security | Data Capture | Data Catalog | Data Governance | Data Quality | Docker | ELT | ETL | GitHub Actions | IAM | Identity and Access Management | Infrastructure as Code | Jenkins | KMS | Lake Formation | Metadata Management | Partitioning | PySpark | Python | Row Level Security | SQL | Schema evolution | Terraform | Time Travel | Web Services | “as-code”
Related jobs
-
Data Platform Software Engineer USD 125K-194KCI/CD | Cloud Computing | Data Lakes | Data Modeling | Data Structures401k match | ESPP | Family leave programs | Flexible time off | Health plansEntry-level Full TimeSan Diego, CALIFORNIA, United States R4h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R5h ago
-
Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R6h ago
-
API | AWS | Automated testing | Cloud Computing | Code generation401k | Dental insurance | Discounts and perks | Fully remote | Medical insuranceSenior-level Full TimeUniversal City, CALIFORNIA, United States R7h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R8h ago
-
API Development | Agent systems | BigQuery | Data integration | Databricks401k matching | Cell phone stipend | College Savings Assistance | Counseling services | Dental insuranceSenior-level Full TimeNew York, NY, United States9h ago
-
AI Model Engineer USD 125K-150KAWS Glue | Agentic Workflow | Apache Airflow | Apache Spark | BashHybrid Remote Onsite | Public Trust requiredSenior-level Full TimeFAIRFAX, VA, United States11h ago
-
Senior-level Full TimeRemote, USA, United States R12h ago
-
Azure Data Lead USD 130K-150KApache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactorySenior-level Full TimeJersey City, NJ, United States12h ago
-
Software Engineer 1 - (Python, PySpark, AWS) USD 164K-201KAWS Glue | AWS Lambda | Amazon DynamoDB | PySpark | Python401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland12h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R12h ago
-
Agent systems | Agentic Workflows | Amazon Web Services | Azure | C#Customer site travel | Remote workSenior-level Contract Full TimeJersey City, NJ, United States R13h ago
-
Artificial Intelligence | C plus plus | C# | Embedded Systems | Firmware DevelopmentEntry-level Full TimeMoon Township, Pennsylvania, USA, 1510813h ago
-
Lead AI Engineer USD 125K-180KAPIs | AWS | AWS Bedrock | Agentic Workflows | Azure401k | Commuter benefits | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeColumbia, MD, United States13h ago
-
Data Engineer, Transplant/DOS USD 75K-102KAgile | Azure Data | Azure Data Factory | Change Data Capture | Crystal Reports401k matching | Loan forgiveness | Tuition reimbursementMid-level Full TimeChicago, IL, United States14h ago
-
Eagle Developer USD 148K-166KAgile | C# | Data Integrator | Database Programming | Development Life CycleSenior-level Full TimePittsburgh, United States14h ago
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R14h ago
-
AI Architect & RAG Data Science Engineer USD 147K-206KAccess Management | Azure | Azure DevOps | BM25 | C#Onsite collaboration | Security clearance support | Telework optionsSenior-level Full TimeHuntsville, AL, USA14h ago
-
Data Solutions Engineer USD 95K-120KData Governance | Data Lakes | Data Modeling | Data Pipelines | Data Quality401k company match | Continuous training | Health plan | Mentoring opportunities | Paid HolidaysMid-level Full TimeMaple Shade, NJ, United States14h ago
-
Staff Officer (Data Science) USD 128K-128KData Preprocessing | Data Visualization | Data integration | Deep learning | Feature EngineeringSenior-level Full TimeUnited States of America-Norfolk15h ago
-
Deep learning | Entity recognition | Flink | Graph Embedding | HadoopEntry-level InternshipSeattle, Washington, United States16h ago
-
Apache Spark | Deep learning | Entity recognition | Flink | Graph EmbeddingCommunity building events | Industry expert collaboration | Professional development eventsEntry-level InternshipSan Jose, California, United States16h ago
-
BERT | C++ | Deep learning | Distributed Training | Domain AdaptationMid-level Full TimeSan Jose, California, United States16h ago
-
C++ | Computer Vision | Deep learning | Distributed Training | Domain AdaptationMid-level Full TimeSan Jose, California, United States16h ago
-
Entry-level Full TimeSan Jose, California, United States16h ago