Sr Cloud Data Engineer, SMAI
Hyderabad - Phoenix Aquila, India
INR 2000K-2443K (estimate) Senior-level Full Time
Tasks
- Architect AI ready data management systems
- Build governed scalable data pipelines
- Build vector embedding pipelines
- Create training validation inference datasets
- Define data quality lineage observability
- Design batch streaming real time pipelines
- Design data pipelines for AI workloads
- Develop data models for feature engineering
- Evaluate and adopt emerging data engineering technologies
- Implement ETL and ELT transformation pipelines
- Implement automation, monitoring, alerting
- Implement metadata management access controls
- Implement retrieval augmented generation RAG workflows
- Ingest and process unstructured data
- Mentor engineers on AI data patterns
- Optimize pipeline performance scalability cost
- Secure compliant access to enterprise data
- Support Responsible AI governance
- Support data versioning reproducibility auditability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache NiFi | Apache Spark | Auditability | Azure | Batch Processing | Cloud platform | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Versioning | Distributed Systems | ELT | ETL | Embeddings | Feature Engineering | Generative AI | Google Cloud | Google Cloud Platform | Language Models | Large Language Models | Linux | Machine Learning | Metadata Management | NoSQL | Oracle | RAG | Real Time | Real-time Inference | Reproducibility | Retrieval-Augmented Generation | SQL | SQL Server | Snowflake | Stream processing | Vector Databases
Education
N/A
Related jobs
-
Senior-level Full TimeIN-TN-Chennai8h ago
-
Adobe Analytics Developer INR 2040K-3356KAdobe Analytics | Adobe Client Data Layer | Adobe Experience | Adobe Experience Platform | Adobe Experience Platform Data collectionSenior-level Full TimeIN-MH-Pune8h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai8h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai8h ago
-
Senior-level Full TimeIN-AP-Hyderabad8h ago
-
Technical Delivery Manager INR 1317K-2280KAgile | Data Management | Data Warehousing | Data masking | Data subsettingMid-level Full TimeIN-KA-Bangalore8h ago
-
Lead ML Engineer INR 2000K-3800KAgile | Autogen | Automl | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, TN, India9h ago
-
Forward Deployed Engineer, GenAI, Google Cloud INR 2500K-5000KAlgorithms | Apache Beam | Apache Hadoop | Apache Spark | C++Embedded customer development | Technical feedback to product roadmap | White glove deploymentSenior-level Full TimeBengaluru, Karnataka, India; Gurugram, Haryana, India9h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-4725KAudio generation | Data Processing | Generative AI | Image Generation | Language ModelsSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Forward Deployed Engineer, GenAI, Google Cloud INR 1800K-2500KAPI Integration | Agent systems | CrewAI | Data Pipelines | Deep learningMid-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India9h ago
-
Software Engineer III, Google Cloud Bigtable INR 1500K-3000KAgile | Algorithms | Automated testing | C++ | CI/CDSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Software Engineer, Applied AI, Vertex AI Search INR 2500K-4500KC++ | Data Structures | Data Structures and Algorithms | Debugging | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN10h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R10h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Amazon OpenSearch | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R10h ago
-
Junior GenAI Developer INR 600K-900KAWS | Agentic Workflows | Chroma | Embeddings | FaissCompany events | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R10h ago
-
Senior-level Full Timehosur road bangalore, India10h ago
-
Senior-level Full Timehosur road bangalore, India10h ago
-
AI Engineer - Acon - BLR INR 2500K-4500KAI Search | AI Studio | Agentic Workflows | Application Security | Arize PhoenixSenior-level Full TimeIndia11h ago
-
AI Engineer INR 1500K-2400KAgentic AI | Agile | Apache Spark | Artificial Intelligence | AutomationAccidental insurance | Life insurance | Meal arrangements | Medical insurance | Professional development opportunitiesMid-level Full TimeGurugram, HR, IN11h ago
-
DE&A - Core - Big Data Engineering - DBT INR 2800K-4000KApache Maven | Apache Spark | Functional Programming | Higher-order functions | ImmutabilitySenior-level Full TimeIndia11h ago
-
Data Engineer with AI developer INR 2000K-2800KAPIs | AWS SageMaker | Azure Data | Azure Data Factory | Azure Machine LearningSenior-level Full Timebangalore, India12h ago
-
Member of Technical Staff INR 2500K-4500KAutomated testing | Batching | CI/CD | Caching | Cloud infrastructureSenior-level Full TimeBengaluru, KA, IN13h ago
-
Senior - Data and App Modernization INR 2500K-3500KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationSenior-level Full TimeGurgaon, Haryana, India13h ago
-
Data Engineer INR 1500K-2000KAWS | Ab Initio | Apache Flink | Apache Spark | Apache Spark StreamingMid-level Full TimeBengaluru, Karnataka, India14h ago