Senior Data Engineer
Tasks
- Architect Apache Flink streaming analytics
- Architect confidential compute processing
- Architect feature store integration
- Architect federated data collection
- Define cross client aggregated data models
- Design aggregated analytical warehouse architecture
- Design federated ML architecture
- Design regulatory and consent architecture
- Establish data modelling standards and governance processes
- Evaluate confidential compute vendors
- Implement differential privacy output
- Manage privacy budget framework
Perks/Benefits
- N/A
Skills/Tech-stack
AMD SEV-SNP | AMD-SEV | Apache Flink | Apache Kafka | Azure Confidential Clean Rooms | Azure Synapse | BCBS 239 | Clean rooms | Confidential Computing | DORA | Data Governance | Delta Lake | Differential Privacy | FATE | Feast | Feature Store | Federated Learning | Flink SQL | GDPR | Hopsworks | Intel SGX | Kafka Schema Registry | Kubernetes | Microsoft Fabric | OneLake | OpenDP | PySyft | SEV-SNP | Schema Registry | SmartNoise | Zero Trust
Roles
Architect | Data Architect | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Cloud platformContract employment | Hybrid work | VIRTUAL interviewSenior-level ContractBangalore North, India2h ago
-
Senior-level Full TimePune, Maharashtra, India4h ago
-
Senior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2400KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Group Lead - Data Quality Engineer INR 1500K-2500KADLS Gen2 | Anomaly Detection | Apache Spark | Automated alerting | CI/CDSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior Software Engineer (Data Engineering, Python, SQL, Snowflake, Cloud and Devops) INR 2500K-3380KAWS | AWS Step Functions | Airbyte | Airflow | Apache HudiCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimeChennai, TN, India8h ago
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India8h ago
-
Lead Software Engineer INR 1800K-2400KAWS | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Key Management ServiceSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Assistant Manager - SA2 (AI Hub - GDC) INR 1400K-2200KAWS | Agent Development | Apache Kafka | Autogen | AzureMid-level Full TimeHyderabad, Telangana, India10h ago
-
Sr Data Engineer I INR 3000K-4000KAWS | Automation | Big Data | Cloud Computing | Data ArchitectureSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Data Engineer Azure - Senior INR 3000K-4000KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeGlobal scale | Inclusive culture | Learning culture | Supportive teamSenior-level Full TimePune, MH, IN, 41101414h ago
-
Data Engineer 2 INR 1000K-2000KAWS | Acceptance Testing | Amazon Redshift | CI/CD | Cloud ComputingMid-level Full TimeIND-CORP Bengaluru-TDIM - PTT, India16h ago
-
Data Engineer (Azure + Databricks) INR 800K-1500KAirflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Data Engineer (Azure + Databricks) INR 1200K-2000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Associate, Data Engineer (Test Automation) INR 1524K-2156KAPI Testing | AWS | Azure | CI/CD | Cause analysisComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsMid-level Full TimeBL4 - KNG Tower 1, Indiqube … R16h ago
-
Senior Lead, Data Science - Agentic AI Developer INR 3000K-4000KAI Agent | AI agent orchestration | AWS | Agent Orchestration | Agent ServiceAccess to certifications | Coaching | Hybrid work environment | Learning opportunities | Training and knowledge-sharingSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India16h ago
-
Business Intelligence | CI/CD | Data Governance | Data Lineage | Data ModelingMid-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India16h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure Cloud | Azure Databricks | Data WarehousingFlexible work/life support | Hybrid work | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India16h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingFlexible work/life support | Hybrid work | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksSenior-level Full TimeBangalore, India16h ago
-
Senior Data Engineer INR 2000K-3000KApache Cassandra | Apache Kafka | Apache Spark | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Senior Lead, Data Science INR 3000K-4000KAzure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure OpenAI | CI/CDHybrid work flexibility | Wellbeing programsSenior-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India16h ago
-
Intermediate Applications Developer Python, ML Frameworks, MLOps, Containerization, Terraform, GCP, Vertex AI, IBM Watsonx INR 1600K-2500KAI Pipelines | Apache Airflow | Big Data | CI/CD | Cloud platformMid-level Full TimeIN - TDC 1 (IN110), India16h ago
-
Engineer Data INR 1500K-2400KAPIs | Agile | Amazon Web Services | Azure | Cloud ComputingFlexible work environment | Internal mobility | Volunteering opportunities | Work-life balance | Workplace well-beingSenior-level Full TimeKA Bangalore, India16h ago
-
Senior Engineer Data INR 1500K-2400KAPIs | AWS | Agile | Azure | Data CleansingFlexible work environment | Internal mobility | Volunteering opportunities | Well-being support | Work-life balanceSenior-level Full TimeKA Bangalore, India16h ago
-
Senior Engineer Data INR 1500K-2400KAPIs | AWS | Agile | Azure | Cloud ComputingFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India16h ago