Data Infrastructure Engineer
Home Office: Tysons, VA, United States
USD 113K-188K Senior-level Full Time
Tasks
- Automate AWS provisioning with Infrastructure as Code
- Build CI/CD pipelines for data workflows
- Build ETL ELT pipelines for analytics datasets
- Build and manage AWS lakehouse using delta lake patterns
- Build data ingestion pipelines batch and streaming
- Collaborate with security networking and application teams
- Enable data lineage for auditability
- Establish dev test prod environment standards
- Implement dataset metadata catalog and tagging
- Implement governance access controls classification and retention
- Implement incremental processing and change data capture
- Implement operational data quality checks and SLAs SLOs
- Improve data pipeline observability with metrics logs alerts
- Maintain engineering documentation and secure configuration baselines
- Optimize lakehouse performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CodePipeline | AWS S3 | CDC | CI/CD | Change Data Capture | Data Capture | Data Catalog | Data Governance | Data Lakehouse | Data Lineage | Data Quality | Delta Lake | Docker | ELT | ETL | Encryption | Git | IAM | Infrastructure as Code | Java | Jenkins | Least Privilege | Metadata Management | Policy enforcement | Python | SQL | Scala | Secrets management | Terraform | “as-code”
Related jobs
-
Software Engineer 3 - (Python, LLMs, RAG) USD 232K-283KAI Agents | Backend Development | Distributed Systems | Docker | Elasticsearch401k contribution | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland7h ago
-
Anomaly Detection | Clustering | Data Analysis | Elasticsearch | Exploratory Data Analysis11 federal holidays | 24 days PTO | 401k match | Educational assistance | Healthcare coverageSenior-level Full TimeFort Meade, Maryland7h ago
-
Software Engineer 1 - (Python, LLMs, UI/UX) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k matching | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland7h ago
-
Systems Engineer 3 - (AI, Terraform, LLMs) USD 233K-284KArtificial Intelligence | Cloudflare | Confluence | Content Delivery Network | Content delivery401k 100 Percent Vested | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland7h ago
-
Senior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R8h ago
-
C++ | Caffe | Deep and Wide | Deep learning | GBDTMid-level Full TimeSeattle, Washington, United States11h ago
-
C++ | Computer Vision | Data Mining | Deep learning | GoEntry-level Full TimeSan Jose, California, United States11h ago
-
Big Data | Data Modeling | Data Processing | Data Warehousing | Data analyticsDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States11h ago
-
Algorithms | C++ | Computer Vision | Data Mining | Data StructuresEntry-level Full TimeSeattle, Washington, United States11h ago
-
Low Power Design Methodology and Optimization Engineer USD 192K-278KANSYS | C# | C++ | CPU Benchmarking | CPU microarchitectureSenior-level Full TimeAustin, TX, USA12h ago
-
Senior Full Stack Engineer, Gen AI USD 232K-258KAWS | AWS Bedrock | AWS CDK | Angular | CI/CDHybrid work | Remote work flexibility | Work-life balanceSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL13h ago
-
AWS Data Engineer USD 91K-155KAgile | Amazon Elastic Container Service | Amazon Web Services | Apache Airflow | Apache SparkRemote workSenior-level Full TimeMadrid, MD, Spain13h ago
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R13h ago
-
MLOps Engineer USD 140K-175KApache Airflow | Dagster | Data Engineering | Distributed Computing | DockerMid-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL13h ago
-
Senior DevOps Engineer USD 124K-170KAWS | AWS CDK | AWS CloudFormation | Amazon CloudWatch | ArgoCDSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL16h ago
-
Senior Data Engineer, Databricks USD 119K-145KApache Spark | Asset bundles | Auto Loader | Azure Data | Azure Data Factory401k company match | Accrued vacation time off | Dental insurance | Long-term disability | Medical insuranceSenior-level Full TimeDENVER, CO, US18h ago
-
C# | C++ | CVS | Communication Protocols | Confluence401k match | Disability insurance | Education reimbursement | Health insurance | Health savings accountMid-level Full TimeSaint Paul, MN, United States19h ago
-
Lead Infrastructure Engineer - Public Cloud Storage USD 119K-196KAccess Management | Block Storage | Cloud Compliance | Cloud Governance | Cloud Networking401k plan | Adoption reimbursement | Commuter benefits | Critical caregiving leave | Critical illness insuranceSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …23h ago
-
APIs | Agent Orchestration | Chunking | Cloud infrastructure | Context AssemblyDirect collaboration with founders | High ownership | In-office Flexibility | In-office collaboration | Remote workSenior-level Full TimeSan Francisco, CA; New York, New …23h ago
-
Mid-level Full TimeCoral Springs, Florida, United States23h ago
-
AI Engineering Specialist USD 110K-182KAPI Development | CI/CD | Cloud | Containers | Generative AISenior-level Full TimeCoral Springs, Florida, United States23h ago
-
Insights & Analytics Senior Specialist USD 93K-140KAPI Integration | AWS | Attention Mechanisms | Automated testing | Bias MitigationDental insurance | Health insurance | Paid time off | Retirement programs | Vision insuranceSenior-level Full TimeUS - Gaithersburg - MD, United …23h ago
-
Senior Data Analytics Engineer USD 145K-206KAWS | CRM | DBT | Data Model | Data Modeling401k match | Disability insurance | Employee assistance program | Flexible spending account | Health Savings Account contributionSenior-level Full TimeBRIC, United States R23h ago
-
Data Engineer – Python/AI USD 122K-179KArtifactory | CI/CD | Data Modeling | Data Quality | Data TransformationCareer development | Flexible benefits | Inclusive workplaceSenior-level Full TimeCharlotte, United States23h ago
-
Data Scientist III - FCRM USD 96K-155KAML | Agentic AI | Azure | Cloud Data | Cloud Data PlatformsContinuous improvement initiatives | Growth opportunities | Mentorship | Skill developmentSenior-level Full Time11325 North Community House Road, Suite …23h ago