Data Infrastructure Engineer
Home Office: Tysons, VA, United States
USD 98K-163K Mid-level Full Time
Tasks
- Automate AWS provisioning with Infrastructure as Code
- Build and manage lakehouse on AWS
- Build and operate data ingestion pipelines
- Collaborate with engineering and security teams
- Design incremental processing patterns and CDC
- Develop ETL ELT pipelines for curated datasets
- Enable end to end data lineage
- Implement CI CD for data pipelines with testing and validation
- Implement batch and streaming data ingestion
- Implement dataset cataloging and metadata management
- Implement governance controls for access and retention
- Improve observability with metrics logs alerts
- Maintain engineering documentation and SOPs
- Optimize lakehouse performance and cost
- Perform data quality checks and publish SLAs SLOs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS CodePipeline | Access Controls | Amazon S3 | Batch Processing | CI/CD | Change Data Capture | Data Capture | Data Catalog | Data Contracts | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Pipeline Testing | Data Quality | Data pipeline | Delta Lake | Docker | ELT | ETL | Encryption | Git | IAM | Infrastructure as Code | Jenkins | Lakehouse | Least Privilege | Metadata Management | Pipeline testing | Python | SQL | Secrets management | Streaming | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior AI Engineer USD 149K-200KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R2h ago
-
Data Platform Engineer USD 120K-165KAWS | Apache Spark | CI/CD | Databricks | DevSecOpsHybrid work schedule | Onsite support in Fairfax VA and Springfield VA | Security clearance support for TS SCI with CI PolyMid-level Full TimeFAIRFAX, VA, United States3h ago
-
Senior Cloud Data Ops Engineer USD 97K-199KAWS RDS | Amazon Aurora | Amazon Web Services | Bash | BigQuery401k match | Childcare benefits | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeQuincy, MA, United States3h ago
-
Senior-level Full TimeHouston, TX, United States4h ago
-
C++ | Data Compression | Data Ingestion | Data Pipelines | Distributed SystemsSenior-level Full TimeSan Jose, California, United States6h ago
-
Senior Forward Deployed Engineer – AWS USD 109K-188KAWS Bedrock | Amazon Bedrock | Amazon Bedrock Agents | Amazon Web Services | Bedrock AgentsDiscretionary annual incentive program | Mentorship | Professional development programs | Travel opportunitiesSenior-level Full TimeBoise, Idaho, United States6h ago
-
Databricks Forward Deployed Engineer - GPS USD 107K-171KAI gateway | API | Airflow | Apache Spark | CI/CDMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Anthropic Forward Deployed Engineer - GPS USD 102K-171KAPI Integration | AWS | Anthropic API | Apache Airflow | Apache SparkTravelMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Snowflake Forward Deployed Engineer - GPS USD 107K-179KAPI Integration | Apache Airflow | Apache Spark | Arctic Embed | CI/CDTravel 50 PercentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Senior Databricks Forward Deployed Engineer - GPS USD 113K-188KAI gateway | APIs | AWS | Apache Airflow | Apache SparkTravel 50 PercentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Senior Snowflake Forward Deployed Engineer - GPS USD 109K-181KAPI Integration | AWS | Agentic Platforms | Airflow | Arctic EmbedTravel 50 PercentSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Lead Databricks Forward Deployed Engineer - GPS USD 113K-188KAI gateway | APIs | AWS | Airflow | AzureSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …6h ago
-
Senior Software Engineer, Data Platform – USDS USD 167K-312KCI/CD | Data platform | Language Processing | Machine Learning | MeegoSenior-level Full TimeSeattle, Washington, United States7h ago
-
Computer Vision | Deep learning | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States7h ago
-
Senior Software Engineer, Applied AI, Commerce AI USD 174K-252KAPI Design | Application Programming | Application Programming Interfaces | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
AI | Adversarial Machine Learning | Data Integrity | Data Quality | Data loggingMid-level Full TimeMountain View, CA, USA8h ago
-
Manufacturing Test Development Engineer, Data Center USD 120K-172KAutomated testing | Cause analysis | Electronics testing | Functional testing | Manufacturing testCollaborate with international teams | International travel as needed | Work with global manufacturing partnersMid-level Full TimeSunnyvale, CA, USA8h ago
-
Software Engineer, Applied AI, Commerce AI USD 147K-211KAPI Design | Agile | Data Processing | Deep learning | Distributed ComputingMid-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Staff Software Engineer, DevIntel Data Warehouse USD 207K-300KC++ | Data Analysis | Data Structures | Data Warehouse | Data Warehouse DesignSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA8h ago
-
A/B | A/B Testing | Agentic Workflows | B testing | Context engineeringMid-level Full TimeMountain View, CA, USA8h ago
-
Associate Data Engineer USD 46K-111KAutomated testing | Azure DevOps | BigQuery | CI/CD | Cloud StorageCompany-Paid Holidays | Employee assistance program | Life and disability insurance | Medical, dental, and vision coverage | Paid time offMid-level Full TimeNashville, TN, US17h ago
-
C++ | Control Systems | Depth cameras | GPS | IMUHybrid remote option | Onsite collaborationMid-level Full TimeIrvine, CA18h ago
-
Data Ops Engineer USD 128K-170KApache Airflow | Cloud platform | Data Warehouse | DevOps | ETLDental insurance | Life insurance | Long-term disability insurance | Medical insurance | Paid time offSenior-level Full TimeMiami, Florida19h ago
-
Senior-level Full TimeSanta Ana, CA, US19h ago
-
AI Inference Engineer - Model Optimization & Deployment USD 205K-303KAccuracy evaluation | BF16 | C++ | CUDA | CUDA kernelsSenior-level Full TimeFoster City, CA19h ago