Senior Data Engineer, AI & Data Platform
Remote South Carolina, Remote South Carolina, SC, United States
R
USD 115K-135K Senior-level Full Time
Tasks
- Build MCP server integrations for LLM tools and agents
- Build data models with keys and referential integrity
- Build observability monitoring alerting and SLA tracking
- Build scalable self healing data pipelines
- Create feature stores embedding pipelines and real time serving layers
- Design APIs and data interfaces for real time querying
- Develop and operate data marketplace on Databricks
- Document data models pipeline architectures and integration patterns
- Implement data governance access controls and PII handling
- Implement data quality frameworks
- Ingest transform and serve data from source systems
- Operationalize ML models with training evaluation deployment and monitoring
- Own data engineering initiatives end to end
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Amazon Web Services | Anomaly Detection | Apache Airflow | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure ML | Azure Synapse | Azure Synapse Analytics | Cloud platform | Dagster | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Quality | Data serving | Databricks | Databricks Workflows | Embeddings | Feature Store | Google Cloud | Google Cloud Platform | LLM integration | Model Context Protocol | PII handling | PostgreSQL | Python | RAG | Real Time | Real-time Data | Real-time data serving | Regression testing | SQL | Synapse Analytics | Vector Database | Web Services
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Senior Data Engineer (Remote) USD 108K-150KData Architecture | Data Lake | Data Modeling | Data Quality | Data VisualizationRemote workSenior-level Full TimeUnited States R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiHybrid work model | Remote work | US government clearanceSenior-level Full TimeAnnapolis Junction, MD; San Antonio, TX R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data EngineeringHybrid work model | Onsite Days Per Week | Remote work option | US government clearance requirementsSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid schedule | US government clearance supportSenior-level Full TimeHerndon, VA; San Antonio, TX R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesHybrid work model | Remote work flexibilitySenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiActive secret clearance | Hybrid work model | Top Secret clearance requirementSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data IngestionHybrid work model | Onsite 1 to 2 days per week | Remote workSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon SQS | Amazon Web Services | Apache NiFi | Apache S3 | Data PipelinesHybrid work | Onsite days 1 to 2 per week | Remote work | US government clearance supportSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache Kafka | Apache NiFiGovernment clearance support | Hybrid work model | US citizen requirementsSenior-level Full TimeHerndon, VA R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data PipelinesCoding challenge during interview | Hybrid work | Top-Secret Clearance supportSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | Data IngestionHybrid work model | Onsite work 1 to 2 days per week | Remote work flexibility | US government clearance requirementsSenior-level Full TimeAnnapolis Junction, MD R2h ago
-
Amazon S3 | Amazon SQS | Amazon Web Services | Apache NiFi | ETLHybrid work | Onsite Days Per Week | Remote workSenior-level Full TimeHerndon, VA; Annapolis Junction, MD R2h ago
-
Amazon EKS | Amazon EMR | Amazon Redshift | Amazon S3 | Amazon Web ServicesComprehensive insurance | Diversity and inclusion | Flexible work arrangements | Hybrid remote workMid-level Full TimeReston, VA R2h ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | CI/CD | CTEComprehensive insurance | Diversity and inclusion | Flexible work arrangementsMid-level Full TimeReston, VA; Reston, VA R2h ago
-
Big Data | ETL | Elasticsearch | JSON | Jupyter401k match | PTO | Paid medical | Training supportSenior-level Full TimeSterling, VA R2h ago
-
Big Data | Continuous Monitoring | Cybersecurity | Data Translation | Data extraction401k match | Full paid medical | Paid time off | Training supportSenior-level Full TimeSterling, VA R2h ago
-
Big Data | EML | ETL | Elasticsearch | JSON401k match | Full paid medical | Paid time off | Training fundingSenior-level Full TimeSterling, VA; Annapolis Junction, MD R2h ago
-
AWS | AWS S3 | Amazon SQS | Apache Airflow | Apache Kafka401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R2h ago
-
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash401k match | Fully paid medical | PTO | Training supportSenior-level Full TimeSan Antonio, TX R2h ago
-
Agile | Amazon S3 | Amazon SQS | Apache NiFi | Bash401k match | Fully paid medical | Hybrid work | Onsite clearance support | Paid time offSenior-level Full TimeColumbia, MD R2h ago
-
Data Governance | Data Modeling | Docker | ETL | JSON401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeColumbia, MD R2h ago
-
Data Governance | Data Modeling | Data Quality | Data schemas | Docker401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeSan Antonio, TX R2h ago
-
Continuous Monitoring | Data Translation | Data labeling | ETL | Elasticsearch401k match | Fully paid medical | Paid time off | Training supportSenior-level Full TimeSan Antonio, TX R2h ago