Data Engineer Software Developer
6971 DISA Scott Air Force Base IL, United States
R
USD 87K-157K Mid-level Full Time
Tasks
- Automate ETL data validation monitoring and cleansing
- Create Kafka and Elasticsearch pipelines
- Design build maintain data pipelines
- Develop data lakes and data warehouses
- Document data architecture and integration procedures
- Implement CI CD processes for build test and deployment
- Implement data integration solutions using ETL and ELT
- Ingest process transform network data for analytics
- Integrate data from multiple sources into Elastic and Kafka
- Optimize ingestion throughput query performance indexing and storage
- Support Kibana dashboards and visualizations
- Troubleshoot data ingestion processing and cluster performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Redshift | Access Controls | Agile | Amazon S3 | Ansible | Apache Kafka | Bitbucket | CI/CD | Confluence | Confluent Kafka | DISA | DOD | Data Cleansing | Data Governance | Data Security | Data Validation | Docker | ELT | ETL | Elastic Stack | Elasticsearch | Git | Grafana | HTML | Hadoop | Infrastructure as Code | JavaScript | Jira | Kibana | Kubernetes | Linux | Logstash | Observability | Prometheus | Python | RMF | React | Red Hat | Red Hat OpenShift | SQL | STIGs | Scrum | Security Compliance | Shell Scripting | Snowflake | Unix | “as-code”
Roles
Related jobs
-
API Integration | APIs | Agent systems | Apache Spark | AutomationInternal talks | Learning platform | Remote days | Sports classes | Wellness benefitsEntry-level Full TimeBrooklyn, United States R8h ago
-
Common table expressions | Compiled SQL Table Functions | DB2 SQL | Db2 Table Functions | Deterministic SQLHybrid work location flexibilitySenior-level Full TimeSeattle, Washington, United States R1d ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) | A USD 147K-170KAWS RDS | Airflow | Amazon EMR | Amazon Redshift | Amazon Web ServicesContract-to-hire | Hybrid work | Mentorship opportunitiesSenior-level Full TimeIrvine, CA R2d ago
-
Senior Semantic Model Developer/Programmer Analyst IV (Power BI / Fabric / Tabular) - Workforce Operations USD 101K-150KAnalysis Services | Azure DevOps | Azure SQL | BI Premium | CI/CDSenior-level Full TimeUnited States-Texas-Galveston R2d ago
-
Data Engineer USD 99K-146KAirflow | Amazon Redshift | Amazon Web Services | Apache Kafka | Atlassian JiraMid-level Full TimeDearborn, MI, United States R2d ago
-
Technical Lead, Machine Learning USD 172K-220KBias Evaluation | DPO | Data Pipelines | Evaluation | GPU OptimizationSenior-level Full TimeUnited States R2d ago
-
Staff Machine Learning Engineer USD 130K-200KBias Evaluation | DPO | Data Pipelines | GPU Optimization | Inference architectureSenior-level Full TimeUnited States R2d ago
-
Staff Machine Learning Engineer USD 165K-236KClass imbalance | Docker | Error Analysis | Feature Engineering | Feature Labeling401k | Bonus | Equity | Generous vacation time | Medical/Dental/Vision insuranceSenior-level Full TimeRemote USA R2d ago
-
Staff Data Engineer USD 135K-180KAI coding | AI coding tools | AWS EKS | Alerting | Amazon EC2401k match | Career development | Parental leaveSenior-level Full TimeTempe, Arizona R2d ago
-
Staff Machine Learning Engineer, Shopping Ads USD 230K-322KConversion modeling | Data Pipelines | Feature Engineering | Graph Neural Networks | Latency optimization401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefits programsSenior-level Full TimeRemote - United States R2d ago
-
AWS | Azure | CI/CD | Container Networking | Container networking interface401k company match | ESPP | Family leave programs | Flexible spending accounts | Flexible time away planSenior-level Full TimeSan Diego, CALIFORNIA, United States R2d ago
-
AWS | Azure | CI/CD | Container Networking | Containers401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R2d ago
-
Software Engineer - AIM Virtualization USD 157K-230KData Ingestion | Data egress | Database Internals | Functional Programming | Query OptimizationSenior-level Full TimeUS-CA-Menlo Park R2d ago
-
Senior-level Full TimeDenver, CO - Hybrid; New York, … R2d ago
-
Staff+ Software Engineer, Safeguards Data USD 320K-485KAWS | Access Control | Cloud platform | Data Governance | Data LineageFlexible working hours | Generous vacation | Hybrid office policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R2d ago
-
Software Engineer, Applied AI USD 170K-300KAWS | Agents | Benchmarking | Datadog | ECSFree coachingSenior-level Full TimeNew York R2d ago
-
Senior Solution Engineer USD 138K-181KAnalytics | Cloud Computing | Data Lake | Data Warehousing | Data fabricTravel opportunitiesSenior-level Full TimeUS-GA-Remote R2d ago
-
Senior Database Engineer USD 130K-150KAWS | AWS CDK | AWS CloudFormation | Access Control | Amazon AuroraSenior-level Full TimeLas Vegas, Nevada, United States; Seattle, … R2d ago
-
Software Engineer, Data Products & Platform USD 170K-300KAWS Glue | AWS Lambda | Amazon Athena | Amazon CloudWatch | Amazon S3Work with coachesSenior-level Full TimeNew York R2d ago
-
Senior Machine Learning Engineer, Trust USD 200K-235KA/B | A/B Testing | Account integrity | Agentic Frameworks | Anomaly DetectionEmployee travel credits | Remote eligibleSenior-level Full TimeSan Francisco, CA R2d ago
-
Machine Learning Engineer USD 150K-250KLanguage Processing | Machine Learning | Natural Language | Natural Language Processing | PyTorchOpen source portfolio | Publications in ML venues | Startup experience | Understanding model failures in the wild | Visa sponsorshipMid-level Full TimeToronto Hybrid R2d ago
-
Data Analyst/BI Engineer USD 85K-110KAmazon S3 | Apps Script | Azure | BigQuery | Data Lineage401k match | Dental insurance | Health insurance | Paid Holidays | Paid time offSenior-level Full TimeUnited States R2d ago
-
Software Engineer, Fulfillment Core Services USD 128K-160KAPI Integration | AWS | Buildkite | CI/CD | CircleCI401k company match | Childcare benefits | Commuter benefits | Dental insurance | Family building benefitsEntry-level Full TimeSeattle, WA R2d ago
-
Senior Analytics Engineer USD 113K-125KChurn analysis | Customer Lifetime Value | DBT | Data Architecture | Data Modeling401k matching | Dental insurance | Employee assistance program | Employer Paid Short-term Disability | Flexible time offSenior-level Full TimeDallas-Fort Worth Metroplex; Denver Metropolitan Area R2d ago