Sr Cloud Data Engineer, SMAI
Hyderabad - Phoenix Aquila, India
INR 2000K-2443K (estimate) Senior-level Full Time
Tasks
- Architect AI ready data management systems
- Build governed scalable data pipelines
- Build vector embedding pipelines
- Create training validation inference datasets
- Define data quality lineage observability
- Design batch streaming real time pipelines
- Design data pipelines for AI workloads
- Develop data models for feature engineering
- Evaluate and adopt emerging data engineering technologies
- Implement ETL and ELT transformation pipelines
- Implement automation, monitoring, alerting
- Implement metadata management access controls
- Implement retrieval augmented generation RAG workflows
- Ingest and process unstructured data
- Mentor engineers on AI data patterns
- Optimize pipeline performance scalability cost
- Secure compliant access to enterprise data
- Support Responsible AI governance
- Support data versioning reproducibility auditability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache NiFi | Apache Spark | Auditability | Azure | Batch Processing | Cloud platform | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Versioning | Distributed Systems | ELT | ETL | Embeddings | Feature Engineering | Generative AI | Google Cloud | Google Cloud Platform | Language Models | Large Language Models | Linux | Machine Learning | Metadata Management | NoSQL | Oracle | RAG | Real Time | Real-time Inference | Reproducibility | Retrieval-Augmented Generation | SQL | SQL Server | Snowflake | Stream processing | Vector Databases
Education
N/A
Related jobs
-
AI Engineer – Python & Snowflake INR 1800K-2700KAPI Development | AWS | Airflow | Azure | Data ModelingMid-level Full TimeHyderabad, Hyderabad, IN4h ago
-
Senior AI Engineer (Full-Stack) (Remote) INR 2500K-5000KAWS | Active Directory | Anthropic | ArcGIS REST | ArcGIS REST APIClient facing ownership | Remote workSenior-level Full TimeMaharashtra, Pune, India R4h ago
-
Senior Database Engineer - #3180 (Remote) INR 1500K-2700KAWS CDK | AWS IAM | AWS KMS | Amazon Aurora | Amazon CloudFormationSenior-level Full TimeChennai, India R4h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India4h ago
-
Senior-level Full TimeHyderabad, India5h ago
-
Senior-level Full TimeIN-HR-Gurgaon5h ago
-
Senior-level Full TimeIN-KA-Bangalore5h ago
-
Database Track Sr.Engineer INR 2000K-3000KData Architecture | Database Schemas | Database performance | Database performance tuning | Disaster RecoverySenior-level Full TimeIndia8h ago
-
Big Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Factory | Data Factory | Data IngestionSenior-level Full TimeIndia8h ago
-
Amaze - Cloud Data Architect INR 1200K-2000KApache Airflow | Azure | Integration Services | Java | Power BISenior-level Full TimeIndia8h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia8h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Search | AI Services | Anthropic | Azure AI | Azure AI ServicesExecutive-level Full TimeIndia8h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia8h ago
-
Gen AI Developer Specialist INR 1500K-6000KAI Services | Anthropic | Azure AI | Azure AI Services | CI/CDExecutive-level Full TimeIndia8h ago
-
Lead-Affluent BIU & Analytics-AFFLUENT-Program & MIS INR 2000K-3500KA/B | A/B Testing | B testing | Clustering | Data WarehousingSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Big Data Lead INR 1500K-2000KAzure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud StorageSenior-level Full TimeIndia8h ago
-
Amaze - Cloud Data Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia8h ago
-
Data Engineer INR 1500K-2500KBacklog Management | Business Process | Business Process Mapping | Business glossary | Data ModelingMid-level Full TimeChennai, Tamil Nadu, India8h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure | Azure Databricks | Data Engineering | Data Factory | Data MigrationSenior-level Full TimeIndia8h ago
-
CLOUD AMAZE - DW Lead (Practice) INR 1500K-2500KAzure | Azure Databricks | Cloud Computing | Data Architecture | Data EngineeringSenior-level Full TimeIndia8h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Databricks | Data Engineering | Data Factory | Data Migration | Data ModelingSenior-level Full TimeIndia8h ago
-
Big Data Lead INR 2000K-3000KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud ComposerSenior-level Full TimeIndia8h ago
-
Big Data Engineer INR 1500K-2000KApache Airflow | Apache Beam | Apache Spark | BigQuery | Cloud ComposerMid-level Full TimeIndia8h ago
-
Big Data Lead INR 1500K-2500KApp Service | Application Monitoring | Azure | Azure App | Azure App ServiceSenior-level Full TimeIndia8h ago
-
Deputy Manager - Fraud Analytics & Monitoring (Detection) INR 950K-1500KAnomaly Detection | DPSC | Data Visualization | Decisioning | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development programMid-level Full TimeGurugram, India10h ago