Data Engineer SME - PRIME, Hybrid - TS/SCI
Tasks
- Build testing for data ingestion software
- Configure Kafka data flow solutions
- Configure YAML schemas
- Deploy services with Kubernetes and Docker
- Develop ETL data pipelines
- Develop and manage Maven builds
- Establish monitoring for data pipelines
- Implement Linux bash scripts
- Implement data extraction translation and loading
- Ingest mission critical data into big data environment
- Manage data storage and messaging in AWS S3 and SQS
- Troubleshoot Apache NiFi flows
- Use GitLab for version control
Perks/Benefits
Skills/Tech-stack
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash | Docker | ETL | GitLab | Integration Testing | Java | Kafka | Kubernetes | Linux | Maven | Python | SQL | Unit Testing | YAML
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
API | Amazon Web Services | Amazon Web Services (AWS) | Apache HDFS | Apache SparkRemote workMid-level Full TimeRemote, US; Sunnyvale, CA; Dallas, TX R1h ago
-
ARM | AUTOSAR | Agile | Android | Application SecuritySenior-level Full TimeMichigan, Remote USA R1h ago
-
Senior Data Engineer (Remote) USD 108K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data VisualizationRemote workSenior-level Full TimeUnited States R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiHybrid work model | Remote work | US government clearanceSenior-level Full TimeAnnapolis Junction, MD; San Antonio, TX R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data EngineeringHybrid work model | Onsite Days Per Week | Remote work option | US government clearance requirementsSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work schedule | Onsite work 1 to 2 days per week | Remote work 3 to 4 days per weekSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data pipelineHybrid workSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid schedule | US government clearance supportSenior-level Full TimeHerndon, VA; San Antonio, TX R3h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data pipeline | ETLHybrid work model | Onsite work 1 to 2 days per week | Remote workSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid work model | Remote work flexibilitySenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Data Engineering | ETL | Integration TestingHybrid work model | Onsite Days Per Week | Remote workSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data PipelinesCoding challenge during interview process | Hybrid work model | US federal security clearance supportSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data Ingestion | Data pipelineHybrid work model | US government clearance sponsorshipSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
AWS S3 | AWS SQS | Data Pipelines | ETL | JavaHybrid work model | Onsite 1 to 2 days per week | Remote work option | US government clearance supportSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | ETL | Integration TestingHybrid work | US government security clearance supportSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionCoding challenge interview process | Hybrid work | US government security clearance processingSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Apache NiFi | Data Pipelines | ETLHybrid work model | Onsite 1 to 2 days per week | Remote work daysSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work | Onsite 1 to 2 days per week | Remote workSenior-level Full TimeHerndon, VA R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | Data IngestionHybrid work model | Onsite 1 to 2 days per week | Remote work | Secret clearance supportSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiActive secret clearance | Hybrid work model | Top Secret clearance requirementSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data IngestionHybrid work model | Onsite 1 to 2 days per week | Remote workSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon SQS | Amazon Web Services | Apache NiFi | Apache S3 | Data PipelinesHybrid work | Onsite days 1 to 2 per week | Remote work | US government clearance supportSenior-level Full TimeAnnapolis Junction, MD R3h ago
-
Amazon S3 | Amazon SQS | Apache Kafka | Apache NiFi | ETLHybrid workSenior-level Full TimeHerndon, VA R3h ago