Sr Data Engineer
Tasks
- Build data pipelines from legacy systems
- Design data schemas for LLM consumption
- Develop knowledge graphs for AI agents
- Enforce data masking and PII redaction
- Implement and maintain vector databases
- Implement fine grained access control
- Implement semantic caching
- Manage API gateway authorization flows
- Optimize embedding and retrieval workflows
- Orchestrate OpenAPI and MCP metadata
- Support retrieval-augmented generation pipelines
Perks/Benefits
Skills/Tech-stack
.NET | API Gateway | API Management | Access Control | BigQuery | C# | DBT | Data Governance | Data masking | Databricks | Embedding Models | Gravitee API Gateway | Knowledge graphs | Milvus | Model Context Protocol | NoSQL | Observability | OpenAPI | PII Redaction | Pandas | Pinecone | PySpark | Python | Retrieval-Augmented Generation | SQL | SQLAlchemy | Semantic Caching | Snowflake | Vector Database | Weaviate
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R3d ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R6h ago
-
AWS Glue | Apache Airflow | Apache Kafka | Apache Spark | BigQueryCollaborative environment | Continuous learning | Fully remote work | Professional growth opportunitiesMid-level Full TimeBrazil R6h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R7h ago
-
Senior-level Full TimeUS - Remote; Canada - Remote R8h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R12h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R12h ago
-
Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CDDental insurance | Employee assistance program | Flexible work hours | Gympass | Life insuranceMid-level Full TimeSão Paulo, BR R18h ago
-
Senior Software Engineer Remote/Travel- Active Secret -Top Secret clearance(SCI-eligibility) USD 145K-204KAPI Testing | Cypher | Data Processing | DataOps | DevOpsCompetitive benefits | Growth opportunity | Remote work | TravelSenior-level Full TimeReston, VA, United States R19h ago
-
AI Engineer - FDE (Forward Deployed Engineer) GBP 80K-110KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference presentations | Remote work | Travel opportunitiesSenior-level Full TimeRemote - United Kingdom R21h ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Airflow | Amazon SageMaker | Apache Beam | Argo Workflows | Attention MechanismSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Senior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
AWS | Apache Kafka | Capacity Planning | Consistency | Distributed SystemsGlobal customer impact | Hybrid work location | Modern technology stackSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Mid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Azure | Azure Data | Azure Data Explorer | Azure Event | Azure Event HubsMid-level Full TimeTel Aviv/ Hybrid (Israel), Israel R21h ago
-
Senior-level Full TimeUkraine - Remote R1d ago
-
Data Engineer, Platform EUR 42K-55KAmazon Web Services | Apache Spark | Databricks | Git | KubernetesAdditional paid leave | Career growth | Employee stock options | Paid volunteering opportunities | Performance bonusMid-level Full TimeRemote R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
AI Research Engineer USD 205K-344KCryptography | Distributed Systems | Federated Learning | Fine Tuning | GoEntry-level Full TimeAnywhere R1d ago
-
Deployment Strategist - North America USD 150K-245KAI Agent | AI Agent Frameworks | API Integration | Agent Frameworks | Agent OrchestrationAnnual company offsite | Annual travel stipend | Co-working stipend | Professional development stipendMid-level Full TimeUnited States R1d ago
-
Senior Applied Scientist - Search USD 200K-200KData Science | Embedding | Fine Tuning | Hybrid search | Information Retrieval401k retirement | Annual leave | Equity package | Health coverage | Hybrid scheduleSenior-level Full TimeNew York City R1d ago
-
Experienced Data Engineer - Streaming Platform EUR 55K-95KAWS Kinesis | Amazon Web Services | Apache Beam | Apache Flink | Apache KafkaChild day care support | Gym membership | Lunch vouchers | Premium healthcare coverage | Relocation supportMid-level Full TimeParis R1d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | Cloud platformBenefits package | Flexible work schedule | Remote work one day per weekMid-level Full TimeLondon R1d ago
-
AI Lead (Brazil) BRL 144K-146KAI Platform | Analytics | Data Analysis | Language Processing | Machine LearningCareer growth opportunities | Remote-first companySenior-level Full TimeRemote/Brazil R1d ago