Data Engineer (Bid Role starting in 10 weeks) - TS/SCI w/ Poly
McLean, Virginia, United States
USD 135K-220K (estimate) Senior-level Full Time
Tasks
- Assess data pipelines and data flows
- Build cloud data infrastructure with infrastructure as code
- Build logging observability and failure recovery
- Create dimensional models and data warehouses
- Design, build, and maintain data pipelines
- Evaluate data architecture and identify improvements
- Implement CI/CD and automated testing
- Implement ETL and ELT processes
- Implement Slowly Changing Dimensions
- Implement data quality checks and monitoring
- Implement security access controls and compliance
- Integrate with APIs using authentication and error handling
- Optimize pipelines for performance cost and resources
- Process semi structured data
- Provide technical guidance for data availability and usage
- Refactor legacy pipelines for reliability
- Troubleshoot pipeline failures and data discrepancies
- Tune database performance and indexing
Perks/Benefits
- 11 paid holidays
- 6 Percent 401K contribution
- Annual training
- Fully paid medical/dental/vision
- Generous PTO
- Professional growth
- Tuition reimbursement
- Work-life balance
Skills/Tech-stack
API Key | API key authentication | Alerting | Amazon Web Services | Apache Airflow | Apache Spark | Avro | CI/CD | CSV | CloudFormation | Data Marts | Data Modeling | Data Warehousing | Dimensional Modeling | EMR | Error Handling | Git | Hive | Iceberg | Infrastructure as Code | JSON | Java | Linux | Logging | Monitoring | MySQL | Nifi | OAuth | OAuth 2 | OAuth 2 0 | Observability | Oracle | Pagination | Parquet | PostgreSQL | Python | Rate Limiting | SQL | Scala | Shell Scripting | Single Sign-On | Slowly Changing Dimensions | Terraform | Unit Testing | Web Services | XML | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States3h ago
-
Adversarial Machine Learning | Anomaly Detection | Cloud Security | Machine Learning | PythonSecurity clearance premiumsMid-level Full TimeNaples, United States3h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States4h ago
-
Mid-level Full TimeUS-Kansas-Wichita4h ago
-
Senior-level Full TimeCincinnati, OH, United States4h ago
-
Acceptance Testing | Data Analysis | Data Visualization | Data reporting | ExcelOn site work authorizationSenior-level Full TimeArlington/Rosslyn, Virginia, United States4h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …4h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States4h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA6h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States12h ago
-
Lead Analytics Engineer USD 123K-175KCI/CD | DBT | Data Governance | Data Modeling | NetsuiteFull-time telecommuting | Remote work optionSenior-level Full TimePalo Alto, California13h ago
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R15h ago
-
BEV | Bayesian Methods | CUDA | Machine Learning | Metrics OptimizationSenior-level Full TimeFoster City, CA16h ago
-
Continual Learning | Data Processing | Deep learning | JAX | Language ModelsBonus program | Company benefits program | Equity incentive planEntry-level Full TimeMountain View, CA USA; San Francisco, …17h ago
-
Staff Machine Learning Engineer, Multi-Modal Perception USD 251K-310KC plus plus | Computer Vision | Data Analysis | Deep learning | JAXSenior-level Full TimeMountain View, CA USA; San Francisco, …17h ago
-
Sr. Software Development Engineer, MLOPs USD 168K-227KAlerting | Amazon EKS | CI/CD | Checkpointing | Data IngestionSenior-level Full TimeBellevue, Washington, USA17h ago
-
Software Development Engineer, Aurora Storage USD 143K-194KAWS | Amazon Aurora | Distributed Systems | High Availability | MySQLCareer growth | Flexible work schedule | Mentorship | Work-life balanceMid-level Full TimeRedmond, Washington, USA17h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R17h ago
-
Senior-level Full TimeInnovation Point, United States17h ago
-
Hugging Face | LLM orchestration | Langchain | Language Models | Large Language ModelsCareer growth potential | Early stage technical hire | Equity compensation | High ownership role | Hybrid workMid-level Full TimeSan Francisco, CA; Hybrid R17h ago
-
Senior Data Engineer IS - Remote USD 122K-208KAPI | API Integration | Access Control | Alerting | BashRemote work | Rotational on-call supportSenior-level Full TimeRenton, WA, United States R17h ago
-
Software Engineer, Compute Infrastructure USD 140K-220KAWS | Autoscaling | Azure | Cost Optimization | Distributed Systems401k contribution | Dental insurance | Education stipend | Healthy lunches | Home office improvement stipendSenior-level Full TimeMountain View, CA18h ago
-
Staff Systems Engineer - Perception USD 170K-223KComputer Vision | DOORS | Field of view | Functional Safety | Hazard AnalysisSenior-level Full TimeAustin, TX or Sunnyvale, CA18h ago
-
Data Engineer USD 85K-107KAWS Glue | AWS Lambda | AWS S3 | Access Control | DBT401k match | Career growth | DashPass membership | Gym reimbursement | Medical/Dental/VisionMid-level Full TimeProvo, UT18h ago