Data & Software Engineer
Chantilly, Virginia, United States
A USD 104K-144K (estimate) Mid-level Full Time
Tasks
- Automate data processing with Bash
- Build end to end data pipelines with Python
- Collaborate with stakeholders to define data requirements
- Configure and update Spark jobs
- Containerize and deploy applications on AWS
- Debug pipeline failures and performance bottlenecks
- Document data engineering best practices and design patterns
- Handle geospatial data formats with PostGIS
- Implement data lineage and data catalogs
- Integrate AI and ML services and models
- Manage infrastructure with Terraform or CloudFormation
- Optimize schema design for analytical workloads
- Orchestrate and deploy data pipelines
- Tune MySQL and PostgreSQL queries
- Use Git for code control
Perks/Benefits
- Disability coverage
- Employee assistance program
- Health care plan
- Life insurance
- Paid time off
- Retirement plan
- Training and development
Skills/Tech-stack
AWS CloudFormation | AWS Lambda | AWS Step Functions | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache Polaris | Apache Spark | Apache Superset | Bash | Docker | Docker Compose | Geospatial | Git | H3 | Java | MySQL | NoSQL | NumPy | OpenLineage | Pandas | Podman | PostGIS | PostgreSQL | PySpark | Python | SQL | Step Functions | Terraform | Trino | Unity Catalog | Web Services
Education
N/A
Roles
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)27d ago
-
Staff Software Engineer, Roads Data Quality, Geo USD 207K-301K3D Mapping | C# | C++ | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA3h ago
-
Software Engineer III, AI/ML, YouTube Ads Bidding USD 147K-211KAlgorithms | C++ | Data Processing | Data Structures | DebuggingSenior-level Full TimeMountain View, CA, USA3h ago
-
C++ | Cloud infrastructure | Computer Networking | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA3h ago
-
Data Engineer USD 76K-107KAmazon Web Services | Apache Airflow | Apache Kafka | Cause analysis | Cloud Composer401k match | Basic life insurance | Dental insurance | Disability coverage | Life insuranceMid-level Full TimePiscataway, NJ, US7h ago
-
Data Engineer USD 76K-121KAWS | Airflow | Apache Airflow | Cloud Data | Cloud Data Warehouse401k matching | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimePiscataway, NJ, US7h ago
-
Advanced Analytics - Vet USD 109K-155KAutomation | Cloud Storage | Data Engineering | Data Governance | Data ModelingMid-level Full TimeOverland Park, KS, US7h ago
-
Advanced Analytics - Retail USD 109K-155KAWS | Cloud Computing | Cloud Storage | Data Governance | Data Pipelines401k matching | Dental insurance | Disability insurance | Life insurance | Medical insuranceMid-level Full TimeOverland Park, KS, US7h ago
-
Data Engineer, Infrastructure FinOps USD 146K-194KAPI Design | BigQuery | CI/CD | CloudFormation | DBTMid-level Full TimeCosta Mesa, California, United States13h ago
-
Senior Software Engineer, Data Platform USD 166K-220KAWS | Amazon Athena | Apache Iceberg | Apache Spark | AzureSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Senior-level Full TimeCosta Mesa, California, United States13h ago
-
Staff Data Scientist (Pricing) USD 179K-269KBehavioral Modeling | Causal Inference | Causal measurement | Choice Modeling | Contextual Bandits401k matching | Dental insurance | Employee learning development programs | Employee recognition programs | Financial assistance for hybrid workSenior-level Full TimeSan Francisco, CA14h ago
-
Senior Data Engineer USD 135K-168KAWS | Airflow | Amazon Redshift | Data Modeling | Data Warehousing401k | Flexible work arrangement | Health insurance | Mentorship program | Paid time offSenior-level Full TimePlano, TX16h ago
-
Sr. Embedded Software Engineer USD 100K-130KARM Cortex | ARM Cortex A | Assembly | Bash | Buildroot401k match | Career growth and professional development opportunities | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimeRemote (United States) R17h ago
-
AI Full Stack Developer & Architect USD 140K-161KCloud Run | Kubernetes | MLOps | Machine Learning | Next.jsSenior-level Contract Full TimeSan Jose, CA, United States19h ago
-
Data & AI Platform Engineer USD 95K-155KAI Search | APIs | AWS | Airflow | ArcGIS401k matching | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeRemote, United States R19h ago
-
Senior Data Engineer USD 140K-160KApache Airflow | CI/CD | Change Data Capture | Cluster Sizing | Data Capture401k | Dental insurance | Health insurance | Hybrid work | Paid leaveSenior-level Full TimeNorth Hollywood, CA, United States19h ago
-
Senior Data Engineer USD 140K-160KAirflow | Auto Loader | CI/CD | Change Data Capture | Data CaptureSenior-level Full TimeNew York, NEW YORK, United States19h ago
-
Sr Data Engineer USD 100K-120KAPIs | AWS | AWS Glue | Airflow | Amazon RedshiftFully remote | Mentorship | On-call supportSenior-level Full TimeOrlando, FL, United States R20h ago
-
Embedded Software Verification & UI Programmer USD 90K-120KC# | DO-178B | DO-178C | LDRA | MCDC401k match | Certification assistance | Dental insurance | Disability insurance | Flexible workplaceSenior-level Full TimeWilmington, NC20h ago
-
Equities Data Engineer USD 175K-200KApache Iceberg | Apache Kafka | Apache Spark | CI/CD | Linux401k employer match | Dental insurance | Flexible spending account | Health insurance | Health savings accountMid-level Full TimeChicago, New York20h ago
-
Mid-level Full TimeNew York21h ago
-
Machine Learning Engineer USD 72K-131KCI/CD | Data Fusion | Data Pipelines | Data analytics | Deep learningHybrid work environment | MentorshipSenior-level Full TimeMelbourne, Florida, United States21h ago
-
Forward Deployment AI Engineer USD 120K-150KAgent Orchestration | Anthropic API | Autogen | Chroma | Cloud servicesClient facing work environment | Client site travel | Professional development opportunitiesMid-level Full TimeCleveland | Tampa | San Diego …21h ago
-
Junior Machine Learning Engineer USD 64K-106KCI/CD | Data Fusion | Data analytics | Data sets | Deep learningComprehensive benefits package | Hybrid work environment | Supportive work environment | US security clearance supportedEntry-level Full TimeMelbourne, Florida, United States21h ago