Data Engineer Software Developer
USD 87K-157K Mid-level Full Time
Tasks
- Automate ETL data validation monitoring and cleansing
- Create Kafka and Elasticsearch pipelines
- Design build maintain data pipelines
- Develop data lakes and data warehouses
- Document data architecture and integration procedures
- Implement CI CD processes for build test and deployment
- Implement data integration solutions using ETL and ELT
- Ingest process transform network data for analytics
- Integrate data from multiple sources into Elastic and Kafka
- Optimize ingestion throughput query performance indexing and storage
- Support Kibana dashboards and visualizations
- Troubleshoot data ingestion processing and cluster performance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Redshift | Access Controls | Agile | Amazon S3 | Ansible | Apache Kafka | Bitbucket | CI/CD | Confluence | Confluent Kafka | DISA | DOD | Data Cleansing | Data Governance | Data Security | Data Validation | Docker | ELT | ETL | Elastic Stack | Elasticsearch | Git | Grafana | HTML | Hadoop | Infrastructure as Code | JavaScript | Jira | Kibana | Kubernetes | Linux | Logstash | Observability | Prometheus | Python | RMF | React | Red Hat | Red Hat OpenShift | SQL | STIGs | Scrum | Security Compliance | Shell Scripting | Snowflake | Unix | “as-code”
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Charm Security-Forward Deployed AI Engineer USD 140K-200KAI Agents | API | Agentic Workflows | Automation | Backend DevelopmentCustomer Site Workshops | Travel opportunitiesMid-level Full TimeRemote, OR, US R17h ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R1d ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KAccess Control | Change Data Capture | Cost Management | Data Capture | Data Governance401k eligibility | Medical benefits | Paid time off | Parental leave | Remote work not available for U S visa sponsorshipSenior-level Full TimeRemote Oregon, United States R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
AI Interaction Designer USD 140K-155KAgent Frameworks | Deterministic systems | Embeddings | Evaluation | LLM APIsRemote workMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAccelerators | Computer Vision | Data labeling | Deep learning | Distributed TrainingSenior-level Full TimeUnited States - Remote R1d ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R1d ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | CUDA | Capacity Planning | Distributed SystemsCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Embedded Robotics Engineer USD 125K-145KC++ | Concurrent programming | Control Systems | Critical software | DebuggingCareer growth | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
LLM Engineer USD 100K-150KDPO | Dataset curation | DeepSpeed | Evaluation | FSDPCareer growth | Remote work opportunitySenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Engineer – RL USD 155K-180KDeep learning | GPU Computing | Hierarchical reinforcement learning | Multi-Agent | Multi-Agent Reinforcement LearningCareer growth potential | Full time direct employment | H1B transfer support | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Azure Data and MLOps Engineer USD 116K-222KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data Lake401k match | Company paid life insurance | Company paid vision plan | Company-paid disability insurance | PTOSenior-level ContractUnited States - Remote R1d ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Embeddings | Evaluation Pipelines | Fine Tuning | LLM APIsSenior-level Full TimeUnited States - Remote R1d ago
-
Associate, Quantitative Developer, Model Portfolio Solutions (MPS), Multi-Asset Strategies & Solutions (MASS) USD 116K-155KAPIs | Backtesting | Cause analysis | Code Reviews | Data ArchitectureComprehensive healthcare | Flexible time off | Hybrid work model | Leave benefits | Retirement benefitsMid-level Full TimeSF4-San Francisco - 400 Howard Street, … R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent programming | Control Systems | Embedded SystemsCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Robotics Solutions Engineer USD 100K-150KC++ | Concurrent Systems | Control | Debugging | GazeboCareer growth | Mentorship | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Operations Engineer USD 150K-165KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeWestford, MA R1d ago
-
ML Systems Engineer USD 145K-165KAPI Integration | Autoscaling | C++ | Capacity Planning | Distributed SystemsSenior-level Full TimeUnited States - Remote R1d ago