Data & Software Engineer
Chantilly, Virginia, United States
A USD 104K-144K (estimate) Mid-level Full Time
Tasks
- Automate data processing with Bash
- Build end to end data pipelines with Python
- Collaborate with stakeholders to define data requirements
- Configure and update Spark jobs
- Containerize and deploy applications on AWS
- Debug pipeline failures and performance bottlenecks
- Document data engineering best practices and design patterns
- Handle geospatial data formats with PostGIS
- Implement data lineage and data catalogs
- Integrate AI and ML services and models
- Manage infrastructure with Terraform or CloudFormation
- Optimize schema design for analytical workloads
- Orchestrate and deploy data pipelines
- Tune MySQL and PostgreSQL queries
- Use Git for code control
Perks/Benefits
- Disability coverage
- Employee assistance program
- Health care plan
- Life insurance
- Paid time off
- Retirement plan
- Training and development
Skills/Tech-stack
AWS CloudFormation | AWS Lambda | AWS Step Functions | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache Polaris | Apache Spark | Apache Superset | Bash | Docker | Docker Compose | Geospatial | Git | H3 | Java | MySQL | NoSQL | NumPy | OpenLineage | Pandas | Podman | PostGIS | PostgreSQL | PySpark | Python | SQL | Step Functions | Terraform | Trino | Unity Catalog | Web Services
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R14d ago
-
Data Visualization Engineer - Advanced Engineering USD 74K-125KAccess Control | Alarm Prioritization | Change Management | Client-Server | CybersecurityMid-level Full TimeHeath, OH, United States8h ago
-
Associate AI Software Engineer USD 65K-100KAgile | Confluence | Data Analysis | Data Modeling | Data Visualization401k company match | Adoption Assistance | DailyPay | Dental insurance | Disability insuranceMid-level Full TimeSt. Louis Park, MN, United States8h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageContract award contingent | Remote workMid-level Full TimeWork from home, VA, United States R10h ago
-
Senior-level Full TimeWork from home, VA, United States R10h ago
-
Data Engineer USD 145K-160KAWS | AWS Glue | Apache Airflow | Apache Spark | Data QualityContract award contingent | Hybrid work | Public trust clearance support | Technical documentation updates | Travel 15 percent or lessMid-level Full TimeFAIRFAX, VA, United States10h ago
-
Sr. Databricks Consultant USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDRemote work | Secret clearance | Travel as neededSenior-level Full TimeWork from home, VA, United States R10h ago
-
Mid-level Full TimeFAIRFAX, VA, United States10h ago
-
Senior Databricks Migration Engineer USD 130K-158KActive Directory | Apache Spark | Azure Active Directory | Data Quality | Data SkippingOnsite work | Public Trust background investigationSenior-level Full TimeArlington, VA, United States10h ago
-
Senior-level Full TimeWork from home, VA, United States R10h ago
-
Data Engineer USD 110K-165KCause analysis | Data Formats | Data Pipelines | Data Processing | Data TransformationCompetitive benefits | Hybrid remote onsite work | TS SCI clearance with poly eligibilitySenior-level Full TimeFAIRFAX, VA, United States10h ago
-
Jr Data Engineer USD 104K-125KData Mining | Data Parsing | Data Transformation | Geospatial Data | JSONHybrid remote work | Onsite coordinationEntry-level Full TimeFAIRFAX, VA, United States10h ago
-
AI Engineer USD 125K-161KAPI Integration | Agile Development | Artificial Intelligence | Best practices | Cloud PlatformsMid-level Full TimeChesterfield, MO, United States10h ago
-
Data Engineer – Microsoft D365 F&O USD 119K-200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Platform | Azure DevOpsMid-level Full TimeSaint Louis, MO, United States10h ago
-
AI Engineer USD 150K-210KEvaluation systems | LLM APIs | Language Models | Large Language Models | PostgreSQL401k plan | Flexible time off | Flexible work schedules | Health and wellness benefits | In-person offsitesMid-level Full TimeSan Francisco, CA / Remote (US) R11h ago
-
Strategy & AI Consulting USD 129K-172KAWS | Artificial Intelligence | Azure | Cloud Computing | Cloud platformMid-level Full TimeAtlanta, United States12h ago
-
Process and Analytics Engineer USD 100K-130KAdvanced Pattern Recognition | Agile | Anomaly Detection | Asset Framework | Cause analysisAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeWichita, Kansas12h ago
-
Embedded Firmware Engineer USD 64K-76KARM Cortex | ARM Cortex-M | Agile | C# | C++Educational assistance | Flexible spending accounts | Health insurance | Health savings accounts | Paid parental leaveEntry-level Full TimeNeenah, Wisconsin12h ago
-
Agent Development Kit | Agent systems | Angular | Artificial Intelligence | ClassificationW2 employmentSenior-level Full TimeDearborn, United States12h ago
-
Senior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL14h ago
-
Software Engineer, Systems ML (Technical Leadership) USD 160K-210KBias Mitigation | C++ | CUDA | Co-design | Distributed SystemsSenior-level Full TimeBellevue, WA14h ago
-
Data Engineer, gUP Engineering USD 106K-151KApache Flume | Apache Spark | Cloud Dataflow | Data Analysis | Data ModelingMid-level Full TimeBoulder, CO, USA15h ago
-
Data Engineer, GCS Data Science USD 106K-151KBig Data | C plus plus | Data Documentation | Data Modeling | Data ValidationEntry-level Full TimeNew York, NY, USA; Mountain View, …15h ago
-
Agent Engine | Agentic Development Kit | Agentic development | Cloud platform | Computer VisionSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-253KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA15h ago