Data Infrastructure Engineer
Home Office: Tysons, VA, United States
USD 98K-163K Mid-level Full Time
Tasks
- Build and maintain CI CD pipelines for data
- Build batch and streaming data ingestion pipelines
- Collaborate across engineering security and application teams
- Design incremental processing and CDC patterns
- Develop and operate AWS lakehouse
- Enable end to end data lineage
- Implement ETL and ELT workflows
- Implement data governance and access controls
- Implement dataset cataloging and metadata management
- Implement observability with logs, metrics, alerts
- Maintain engineering documentation and SOPs
- Optimize lakehouse performance and cost
- Provision AWS environments using infrastructure-as-code
- Run data quality checks and publish SLAs SLOs
Perks/Benefits
- 401k retirement plan
- Dental insurance
- Employee assistance program
- Employee referral program
- Health insurance
- Health savings account
- Life and disability insurance
- Parental leave
- Transit and Parking Commuter Benefits
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AWS | AWS CodePipeline | Access Controls | Alerting | Apache Spark | CDC | CI/CD | Change Data Capture | Data Capture | Data Catalog | Data Governance | Data Ingestion | Data Lake | Data Lineage | Data Modeling | Data Quality | Data pipeline | Databricks | Delta Lake | Docker | ELT | ETL | Encryption | Git | IAM | IaC | Incremental processing | Infrastructure as Code | Jenkins | Lakehouse | Logging | Metadata Management | Monitoring | Python | S3 | SQL | Secrets management | Terraform | “as-code”
Related jobs
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseMid-level Full TimeMiami, FL, United States5h ago
-
Azure Data Engineer (Telecommunications) USD 135K-165KAzure | CI/CD | DBT | Data Quality | DatabricksSenior-level ContractFrisco, United States6h ago
-
AWS | Alteryx | Amazon SageMaker | Azure | Azure DataMid-level Full TimeNew York, NY, United States7h ago
-
Machine Learning Engineer USD 128K-214KAWS | Agile | Azure | Cloud platform | GitHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilityMid-level Full TimeUSA-Remote Work R7h ago
-
Strategic Intelligence & Advanced Analytics Engineer USD 108K-136KAnomaly Detection | Artificial Intelligence | Azure | Data Pipelines | Data QualityPaid parental leave | Paid time off | Public service loan forgiveness | Tuition reimbursement | Wellness programsMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd7h ago
-
Network Engineer, Deployment & Support USD 101K-156K400G | 800G | AI | Automation | Coherent opticsMid-level Full TimeMenlo Park, CA | Eagle Mountain, …8h ago
-
Senior Software Engineer, Database Internals, AlloyDB USD 174K-252KC# | C++ | Code optimization | Concurrency Control | Database InternalsEntry-level Full TimeSunnyvale, CA, USA8h ago
-
Artificial Intelligence | Data Analysis | Data Structures | Data structures algorithms | Human-in-the-loopSenior-level Full TimeMountain View, CA, USA8h ago
-
Agent tooling | Artificial Intelligence | C++ | Cloud Architecture | Conversational AISecret clearance | TravelSenior-level Full TimeAtlanta, GA, USA; Austin, TX, USA8h ago
-
Software Engineer III, AI/ML GenAI, Google Cloud Compute USD 147K-211KAudio generation | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Senior Software Engineer, Applied AI Commerce USD 174K-252KAutomated Evaluation | C++ | Cloud | Evaluation datasets | GeminiSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA8h ago
-
Corporate Engineering Technical Sales DBA USD 200K-225KAIX | Backup and Restore | Bash | DB2 | Database Replication TechnologiesHybrid work | Travel opportunitiesMid-level Full TimeWaltham, MA, US13h ago
-
Applied AI ML Lead - LLM SUITE ENGINEERING USD 176K-215KAPI Design | AWS | Agentic AI | Caching | Cloud NativeBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeWilmington, DE, United States16h ago
-
AI Data Engineer USD 120K-220KAgent memory | Amazon Web Services | Audio Processing | Batch Processing | Cloud infrastructureAccess to AI tools | Equity | Remote opportunitiesMid-level Full TimeSan Francisco Bay Area18h ago
-
Senior-level Full TimeRaleigh, NC, US19h ago
-
AI Innovation Analyst - Internal USD 65K-80KAI Governance | AI Services | Authentication | Automation | AzureEntry-level Full TimeMiami, FL19h ago
-
Senior AI Engineer USD 107K-199KAKS | API Design | Alerts | Anomaly Detection | Apache SparkHybrid work environment | Inclusion support | Learning opportunities | Well-being supportSenior-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …19h ago
-
Associate AI Engineer USD 80K-134KAPI Development | Azure | Cloud Platforms | Data Preparation | DocumentationFlexible work environment | Hybrid work arrangement | Inclusion programs | Paid time off | Wellness benefitsMid-level Full TimeUSA, Massachusetts, Boston, 200 Berkeley Street, …19h ago
-
Entry-level Full TimeUnited States - Remote R19h ago
-
CI/CD | Docker | Drift Detection | Embeddings | Experiment trackingMentorship | Remote workSenior-level Full TimeUnited States - Remote R19h ago
-
Data Engineer USD 85K-141KAPI Gateways | CI/CD | Cloud Databases | Data Governance | Data Lakes401k retirement plan | Adoption Assistance | Flexible spending accounts | Health savings account | Parental leaveMid-level Full TimeClient Office: Aberdeen, MD, United States19h ago
-
Marketing Intelligence Engineer USD 150K-175KAPIs | Analytics | Automation | Azure | Dashboarding401k matching | Dental insurance | Health insurance | Hybrid work flexibility | Paid parental leaveSenior-level Full TimeMadison, WI19h ago
-
Principal Software Engineer - Spark USD 320KAmazon Web Services | Apache Airflow | Apache Iceberg | Apache Spark | Cloud NativeContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-Texas-Austin, United States19h ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure StorageMid-level Full TimeCincinnati, OH19h ago
-
Senior Data Engineer USD 82K-172KAWS | Apache Spark | Artificial Intelligence | BERT | BitbucketContinuing education | Family support benefits | Flexible time off | Healthcare benefits | Learning resourcesSenior-level Full Time606 KING OF PRUSSIA PA, United …19h ago