Data Engineer - Top Secret Clearance
DC Metro Area / Hybrid Flexibility
R
USD 140K-170K Senior-level Full Time
Tasks
- Build Debezium pipelines from MySQL to Kafka
- Conduct root cause analysis for data pipeline issues
- Configure Vector pipelines for Kafka to OpenSearch
- Create index templates
- Deploy and manage data infrastructure on OpenShift using GitOps
- Design CDC pipelines
- Develop Flink stream processing applications
- Ensure high availability and fault tolerance
- Implement OpenSearch ingest pipelines
- Implement vector semantic search in OpenSearch
- Maintain technical documentation for data systems
- Manage OpenSearch lifecycle policies
- Monitor data streaming pipeline health
- Optimize OpenSearch indexes for querying
- Perform multi table joins for denormalized records
- Tune Kafka Flink and OpenSearch performance
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Apache Flink | Apache Kafka | ArgoCD | Availability Zones | Change Data Capture | Data Capture | Datadog | Debezium | Elasticsearch | GitOps | Helm | Index templates | Infrastructure as Code | Ingest pipelines | Kubernetes | Lifecycle Policies | MySQL | NestJS | Node.js | OpenSearch | OpenSearch kNN | OpenShift | SAFe | Scrum | Vector | “as-code”
Education
Roles
Regions
Countries
States
Related jobs
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R5h ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R8h ago
-
(US) Principal ML System Engineer USD 139K-304KAWS | Access Control | Alerting | Audit Logging | AuthenticationSenior-level Full TimeRemote, USA R17h ago
-
Sr. Platform Engineer, Kubernetes USD 117K-200KAWS EKS | Alluxio | Amazon S3 | Ansible | Apache FlyteEmployee benefits | Onsite collaboration flexible remote optionSenior-level Full TimePA - West Chester, 1354 Boot … R21h ago
-
Sr. Data Engineer - GM Motorsports USD 138K-211KAWS | Agile | Azure | Confluent | DatabricksHybrid work | Relocation benefitsSenior-level Full TimeAustin Technical Center - Austin Technical … R21h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R21h ago
-
Senior DevOps Engineer (Storage) - remote in the US USD 200K-290KAir-gapped | ArgoCD | CAPI | CSI | Cluster APICompany outings | Conference attendance | Hackathons | Happy hours | Professional development and trainingExecutive-level Full TimeRemote, USA, United States R1d ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-170KArgoCD | CSI | Cluster API | Flux | GitOpsCompany outings and happy hours | Conferences and working groups | Hackathons and tech talks | Professional development and trainingSenior-level Full TimeRemote, USA, United States R1d ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDHybrid work environment | Remote work optionMid-level Full TimeArlington, VA R1d ago
-
Autonomy Algorithms Software Engineer USD 115K-145KAgent systems | Agile | Algorithms | C++ | CI/CDFlexible work schedule | Hybrid work environment | Remote work availableMid-level Full TimeWoburn, MA R1d ago
-
AWS | Agile | Application Security | Azure | Azure DevOps401k match | Educational assistance | Employee assistance program | Employer subsidized medical dental vision and life insurance | Flexible spending accountsMid-level Full TimePhoenix, AZ, United States R1d ago
-
Senior Software Development Engineer - Iris AI USD 130K-162K.NET | API Design | Amazon Bedrock | Anthropic API | Asynchronous ArchitectureEmployee assistance program | Health insurance | Life insurance | Paid Company Holidays | Paid time offSenior-level Full TimeU.S. Remote R1d ago
-
Specialist Solutions Architect - Data Engineering & Warehousing (Digital Native Business) USD 180K-247KAWS | Anomaly Detection | Apache Spark | Cloud platform | Data ModelingContinuous learning | Mentorship | Remote work | Travel up to 30 percentSenior-level Full TimeUnited States R1d ago
-
AWS | AWS EKS | Azure | Azure AKS | CI/CD401k match | ESPP | Family leave programs | Flexible time off | Flexible-hybrid workSenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago
-
Argo CD | Big Data | Concurrency | Distributed Systems | Fine TuningEntry-level Full TimeAustin R1d ago
-
AWS | Azure | CI/CD | Cloud platform | Containers401k matching | Company matching donations | ESPP | Family leave programs | Flexible hybrid work scheduleSenior-level Full TimeSan Diego, CALIFORNIA, United States R1d ago
-
AI Engineer- Agentic AI Solutions USD 85K-192KAgentic AI | Cloud platform | GCP | Generative AI | Google CloudChild care and new parent programs | Employee resource groups | Flexible family care days | Medical, dental & vision coverage | Paid HolidaysSenior-level Full TimeDearborn, MI, United States R1d ago
-
Senior Data Engineer USD 190K-224KAWS | Airflow | BigQuery | CDC | DBT401k matching | Cellphone stipend | Commuter benefits | Company-Paid Holidays | Comprehensive medical, dental and vision coverageSenior-level Full TimeRemote U.S. R1d ago
-
Applied AI Engineer USD 171K-257KAMD | Agentic Systems | Alignment Frameworks | CRM | ContainerizationCompany-sponsored team events | Flexible time off | Travel opportunities | Wellness resourcesSenior-level Full TimeRemote, United States R1d ago
-
Senior Database Engineer USD 140K-160KAWS | AWS RDS | Amazon Aurora | Amazon Redshift | CI/CD401k | Employee assistance program | HSA | Life insurance | Long-term disabilitySenior-level ContractFoster City, California, USA R1d ago
-
Senior AI Engineer – AI Platform USD 140K-160KAWS | Agentic AI | Alerting | Alignment | Distributed SystemsDaily meal specials | Dry cleaning | Free shuttle transportation | Gourmet cafeteria | Group fitness classesSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R1d ago
-
Senior Software Engineer, Data Platform USD 220K-265KAWS | Airflow | DBT | Databricks | Datadog401k | Commuter benefits | Dental insurance | Employee assistance program | Free LunchesSenior-level Full TimeSan Francisco, CA R1d ago
-
Principal AI Engineer USD 208K-260KAWS | Amazon SageMaker | Autogen | Cloud platform | CrewAI401k savings plan | Dental insurance | Disability insurance | Discretionary bonus eligibility | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Databricks Platform Engineer USD 115K-135KAWS | Asset bundles | Audit Logs | Azure Databricks | CI/CD401k match | Employee assistance resources | Medical/Dental/Vision insurance | Paid time off | Professional development supportMid-level Full TimeRemote, United States R1d ago
-
Machine Learning Lead Engineer USD 134K-224KAI Governance | AWS | AWS Lambda | AWS Strands | Agentic WorkflowsBereavement leave | Hybrid work option | Jury duty leave | Military Leave | Paid HolidaysSenior-level Full TimeAtlanta, GA - 6305 Peachtree Dunwoody … R1d ago