Data Engineer (Bid Role starting in 10 weeks) - TS/SCI w/ Poly
McLean, Virginia, United States
USD 135K-220K (estimate) Senior-level Full Time
Tasks
- Assess data pipelines and data flows
- Build cloud data infrastructure with infrastructure as code
- Build logging observability and failure recovery
- Create dimensional models and data warehouses
- Design, build, and maintain data pipelines
- Evaluate data architecture and identify improvements
- Implement CI/CD and automated testing
- Implement ETL and ELT processes
- Implement Slowly Changing Dimensions
- Implement data quality checks and monitoring
- Implement security access controls and compliance
- Integrate with APIs using authentication and error handling
- Optimize pipelines for performance cost and resources
- Process semi structured data
- Provide technical guidance for data availability and usage
- Refactor legacy pipelines for reliability
- Troubleshoot pipeline failures and data discrepancies
- Tune database performance and indexing
Perks/Benefits
- 11 paid holidays
- 6 Percent 401K contribution
- Annual training
- Fully paid medical/dental/vision
- Generous PTO
- Professional growth
- Tuition reimbursement
- Work-life balance
Skills/Tech-stack
API Key | API key authentication | Alerting | Amazon Web Services | Apache Airflow | Apache Spark | Avro | CI/CD | CSV | CloudFormation | Data Marts | Data Modeling | Data Warehousing | Dimensional Modeling | EMR | Error Handling | Git | Hive | Iceberg | Infrastructure as Code | JSON | Java | Linux | Logging | Monitoring | MySQL | Nifi | OAuth | OAuth 2 | OAuth 2 0 | Observability | Oracle | Pagination | Parquet | PostgreSQL | Python | Rate Limiting | SQL | Scala | Shell Scripting | Single Sign-On | Slowly Changing Dimensions | Terraform | Unit Testing | Web Services | XML | “as-code”
Education
N/A
Roles
Related jobs
-
Software Engineer, Data (L1) USD 75K-130KAI Platform | APIs | Apache Airflow | Apache Iceberg | Apache Spark401k match | Calm subscription | Career growth and learning opportunities | Commuter benefits options | Dental insuranceMid-level Full TimeAustin, TX7h ago
-
Solutions Engineer – Robotics & Autonomous Driving USD 152K-500K2D Imaging | 3D Imaging | Autonomous Driving | C++ | CameraCommuter stipend | Generous PTO | Global travel | Health, dental, vision coverage | Learning and development stipendSenior-level Full TimeSan Francisco, CA; New York, NY9h ago
-
Machine Learning Research Engineer USD 161K-189KAWS | Azure | Bias Variance | Bias-Variance Tradeoff | C++Flexible hybrid work model | Mental health counseling | Mentorship programs | Paid parental leave | Paid volunteer time offMid-level Full TimeNew York, US, New York11h ago
-
Sr. Application Software Engineer, Data Analytics USD 160K-225KAngular | C# | CI/CD | Computer Vision | Continuous integrationExtended hours | Travel | Weekend workSenior-level Full TimeBastrop, TX12h ago
-
Mid-level Full TimeEl Segundo13h ago
-
Senior-level Full TimeSan Francisco, California13h ago
-
Senior-level Full TimeOnsite - Austin, TX13h ago
-
AWS Bedrock | Agent systems | Anthropic API | Autogen | Azure401k matching program | Adoption Assistance | Development and career growth opportunities | Fertility treatments | Flexible work schedulesSenior-level Contract Full TimeRemote, OR, United States R14h ago
-
Senior Data Engineer USD 90K-110KAWS | Agile | Apache NiFi | Data Architecture | Data ModelingAutonomy | Flexible working hours | Global employee assistance programme | Online training videos | Teambuilding eventsSenior-level Full TimeNew York, United States14h ago
-
Data Platform Engineer USD 85K-120KAlembic | App Service | Azure | Azure App | Azure App Service401k match | Annual discretionary bonus program | Bereavement leave | Commuter spending accounts | Dental insuranceMid-level Full TimeChicago, IL (Downtown)15h ago
-
Robotics Test Engineer USD 100K-150KASan | Bitbucket Pipelines | C++ | CI/CD | DebuggingDirect hire | Mentorship | Ownership of test suitesMid-level Full TimeOnsite - Austin, TX16h ago
-
AI Engineer 1 - Compliance, Quality & Testing USD 80K-150KAI-assisted testing | CI/CD | Code review | Cypress | Defect Tracking401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC16h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | BigQuery | Cloud Composer | Cloud Data401k retirement plan | Dental insurance | Disability insurance | Flexible time off | Health insuranceMid-level Full TimeLisle, IL, United States R16h ago
-
Staff Data Engineer USD 185K-220KAWS | Apache Airflow | Apache Kafka | Benthos | Big DataDental insurance | Disability insurance | Flexible work hours | Health insurance | Health savings accountSenior-level Full TimeRosslyn, VA or Remote R17h ago
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R18h ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R19h ago
-
AI Engineer 1 - Platform Integration & AI/Data USD 80K-150KAWS | Agentic Systems | Backend Development | Backend Services | CI/CD401k match | Dental insurance | Holidays | Medical insurance | Paid time offEntry-level Full TimeWashington, DC19h ago
-
IT Infrastructure Engineer II USD 139K-178KAWS Organizations | Access Management | Amazon Web Services | Ansible | Application FirewallHealth and wellness resources | Remote work | Wellness FridaysSenior-level Full TimeRemote - United States R19h ago
-
Senior Machine Learning Engineer, Agentic AI USD 163K-245KAI Observability | Agent systems | Autonomous Agents | Benchmark Datasets | Distributed SystemsHealth insurance | Life and disability insurance | Lifestyle Benefits Account | Mental health benefits | Paid time offSenior-level Full TimeBellevue, WA; Menlo Park, CA; New …19h ago
-
Blob Storage | C# | C++ | Distributed Caches | Distributed Caching401k | Dental insurance | Flexible time off | Health insurance | Paid parental leaveSenior-level Full TimeAliso Viejo, California, United States19h ago
-
Access layers | Blob Storage | C# | Caching Strategies | Data access401k | Dental insurance | Health insurance | Paid parental leave | Unlimited Flex Time OffSenior-level Full TimeLos Angeles, California, United States19h ago
-
Access layers | Blob Storage | C# | C++ | Caching Strategies401k | Dental insurance | Health insurance | Unlimited Flex Time Off | Vision insuranceSenior-level Full TimeNew York, New York, United States19h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States20h ago
-
Senior Data Engineer - Databricks USD 180K-248KAWS | Access Control | Amazon Web Services | Apache Spark | Automated testing401k match | Corporate Benefit Program | Discounted pet insurance | Educational resources | Employee Referral Bonus ProgramSenior-level Full TimeUS - Remote R21h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD22h ago