Data Engineer (Bid Role starting in 10 weeks) - TS/SCI w/ Poly
McLean, Virginia, United States
USD 135K-220K (estimate) Senior-level Full Time
Tasks
- Assess data pipelines and data flows
- Build cloud data infrastructure with infrastructure as code
- Build logging observability and failure recovery
- Create dimensional models and data warehouses
- Design, build, and maintain data pipelines
- Evaluate data architecture and identify improvements
- Implement CI/CD and automated testing
- Implement ETL and ELT processes
- Implement Slowly Changing Dimensions
- Implement data quality checks and monitoring
- Implement security access controls and compliance
- Integrate with APIs using authentication and error handling
- Optimize pipelines for performance cost and resources
- Process semi structured data
- Provide technical guidance for data availability and usage
- Refactor legacy pipelines for reliability
- Troubleshoot pipeline failures and data discrepancies
- Tune database performance and indexing
Perks/Benefits
- 11 paid holidays
- 6 Percent 401K contribution
- Annual training
- Fully paid medical/dental/vision
- Generous PTO
- Professional growth
- Tuition reimbursement
- Work-life balance
Skills/Tech-stack
API Key | API key authentication | Alerting | Amazon Web Services | Apache Airflow | Apache Spark | Avro | CI/CD | CSV | CloudFormation | Data Marts | Data Modeling | Data Warehousing | Dimensional Modeling | EMR | Error Handling | Git | Hive | Iceberg | Infrastructure as Code | JSON | Java | Linux | Logging | Monitoring | MySQL | Nifi | OAuth | OAuth 2 | OAuth 2 0 | Observability | Oracle | Pagination | Parquet | PostgreSQL | Python | Rate Limiting | SQL | Scala | Shell Scripting | Single Sign-On | Slowly Changing Dimensions | Terraform | Unit Testing | Web Services | XML | “as-code”
Education
N/A
Roles
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R2h ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States4h ago
-
Adversarial Machine Learning | Anomaly Detection | Cloud Security | Machine Learning | PythonSecurity clearance premiumsMid-level Full TimeNaples, United States4h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States5h ago
-
Mid-level Full TimeUS-Kansas-Wichita6h ago
-
Senior-level Full TimeCincinnati, OH, United States6h ago
-
Acceptance Testing | Data Analysis | Data Visualization | Data reporting | ExcelOn site work authorizationSenior-level Full TimeArlington/Rosslyn, Virginia, United States6h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …6h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States6h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA7h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States14h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KContinuous Improvement | Deep learning | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeNew York, New York14h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Deep learning | Distributed Systems | Experimentation | Feature EngineeringCommuter benefits | Dental insurance | Disability benefits | Equity awards | Health insuranceSenior-level Full TimeBoston, Massachusetts14h ago
-
Software Engineer, Embedded Agentic AI USD 195K-345KAgent Orchestration | Agent systems | C# | C++ | ContainerizationFinancial wellness support | Hybrid work schedule | Mental health support | Paid time off | Remote work optionsEntry-level Full TimeAustin, Texas14h ago
-
Lead Analytics Engineer USD 123K-175KCI/CD | DBT | Data Governance | Data Modeling | NetsuiteFull-time telecommuting | Remote work optionSenior-level Full TimePalo Alto, California15h ago
-
Staff Software Engineer, AI Data Platform USD 250K-280KCloud platform | Google Cloud | Google Cloud Platform | GraphQL | KafkaSenior-level Full TimeSan Francisco Bay Area R17h ago
-
BEV | Bayesian Methods | CUDA | Machine Learning | Metrics OptimizationSenior-level Full TimeFoster City, CA17h ago
-
Software Engineer, Robotics USD 191K-253KAlgorithms | Anomaly Detection | Autonomy | C++ | Code optimizationHealth benefits | Recovery supportMid-level Full TimeIrvine, California, United States17h ago
-
Continual Learning | Data Processing | Deep learning | JAX | Language ModelsBonus program | Company benefits program | Equity incentive planEntry-level Full TimeMountain View, CA USA; San Francisco, …18h ago
-
Staff Machine Learning Engineer, Multi-Modal Perception USD 251K-310KC plus plus | Computer Vision | Data Analysis | Deep learning | JAXSenior-level Full TimeMountain View, CA USA; San Francisco, …18h ago
-
Sr. Software Development Engineer, MLOPs USD 168K-227KAlerting | Amazon EKS | CI/CD | Checkpointing | Data IngestionSenior-level Full TimeBellevue, Washington, USA18h ago
-
Software Development Engineer, Aurora Storage USD 143K-194KAWS | Amazon Aurora | Distributed Systems | High Availability | MySQLCareer growth | Flexible work schedule | Mentorship | Work-life balanceMid-level Full TimeRedmond, Washington, USA18h ago
-
Data Platform Engineer USD 182K-240KAWS | Amazon Kinesis | Apache Airflow | Apache Flink | Apache Kafka401k | Dental insurance | Family leave | Flexible paid time off | Free food and snacksSenior-level Full TimeOrlando, Florida, United States - Remote R18h ago
-
Senior-level Full TimeInnovation Point, United States18h ago