Sr Cloud Data Engineer, SMAI
Hyderabad - Phoenix Aquila, India
INR 2000K-2443K (estimate) Senior-level Full Time
Tasks
- Architect AI ready data management systems
- Build governed scalable data pipelines
- Build vector embedding pipelines
- Create training validation inference datasets
- Define data quality lineage observability
- Design batch streaming real time pipelines
- Design data pipelines for AI workloads
- Develop data models for feature engineering
- Evaluate and adopt emerging data engineering technologies
- Implement ETL and ELT transformation pipelines
- Implement automation, monitoring, alerting
- Implement metadata management access controls
- Implement retrieval augmented generation RAG workflows
- Ingest and process unstructured data
- Mentor engineers on AI data patterns
- Optimize pipeline performance scalability cost
- Secure compliant access to enterprise data
- Support Responsible AI governance
- Support data versioning reproducibility auditability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache NiFi | Apache Spark | Auditability | Azure | Batch Processing | Cloud platform | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Versioning | Distributed Systems | ELT | ETL | Embeddings | Feature Engineering | Generative AI | Google Cloud | Google Cloud Platform | Language Models | Large Language Models | Linux | Machine Learning | Metadata Management | NoSQL | Oracle | RAG | Real Time | Real-time Inference | Reproducibility | Retrieval-Augmented Generation | SQL | SQL Server | Snowflake | Stream processing | Vector Databases
Education
N/A
Related jobs
-
Software Engineer Manager II, Embedded Systems/Firmware, Silicon INR 2800K-4500KC++ | Compiler optimization | Embedded operating systems | Graphics Processing | Graphics Processing UnitsSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Associate 2 - Engineer (AI Hub - GDC) INR 1800K-2500KCNN | Decision Tree | Deep learning | Huggingface | LSTMMentoring | Work reviewMid-level Full TimeHyderabad, Telangana, India6h ago
-
Executive-level Full TimeHyderabad, Telangana, India6h ago
-
Senior-level Full TimeIndia - Bengaluru; India - Hyderabad8h ago
-
GCP Data Engineer INR 2000K-3000KApache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud DataflowSenior-level Full TimeIndia - Bengaluru; India - Hyderabad8h ago
-
Senior Data Engineer INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactoryFlexible work environment | Hybrid work model | Learning and development supportSenior-level Full TimeIndia R8h ago
-
AWS | Agentic AI | Apache Spark | Databricks | Generative AICollaborative global engineering culture | Continuous learning | Flexible work environment | Opportunity to work on cutting edge GenAI | Remote-friendly work environmentSenior-level Full TimeIndia8h ago
-
Senior Data Engineer INR 3000K-4200KAWS | Access Management | Amazon Neptune | Apache Airflow | Apache KafkaCareer advancement | Hybrid work options | Professional development programs | Remote work options | Training programsSenior-level Full TimeBengaluru8h ago
-
Data Engineer INR 1500K-2000KAWS Glue | Access Control | Amazon EMR | Amazon Snowflake | Apache AirflowMid-level Full TimeIndia9h ago
-
API | Agile | Apache Airflow | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India9h ago
-
Senior-level Full TimeIndia10h ago
-
Lead Software Engineer INR 3000K-4500KAWS | CI/CD | DevOps | Docker | EMRCareer development opportunities | Comprehensive benefits | Continuous learning | Flexible working hours | Work-life balanceSenior-level Full TimeMumbai, India10h ago
-
Staff Software Engineer - Data INR 3200K-4600KAWS Lambda | Airflow | Ansible | Apache Flink | Apache SparkSenior-level Full TimeBengaluru, INDIA, India11h ago
-
.NET | APIs | AWS | Alerting | AzureAdoption leave | Employee assistance program | Health care benefits | Maternity leave | Mental wellness programsSenior-level Full TimeIndia11h ago
-
Engineering Expert - AI & Data Products, Runtime Platform INR 3000K-4000KAI Agents | Apache Spark | Argo CD | CI/CD | Data ContractsSenior-level Full TimeBangalore, KA, IN, 56006612h ago
-
AI Data Engineer INR 2000K-3300KAWS | Agent memory | Audio Processing | Batch Processing | Cloud ComputingEquityMid-level Full TimeNew Delhi13h ago
-
Data Engineer, Analytics Engineering, VP INR 1500K-6000KAWS Data | AWS Data Catalog | AWS Glue | AWS Glue Catalog | AWS Glue Data GovernanceExecutive-level Full TimeBengaluru, India14h ago
-
AI Engineer - Full Stack INR 1200K-2500KAI output validation | AI tools | Agile | C++ | Code reviewEthical AI Guidelines | Learning opportunities | Onsite interview optionMid-level Full TimeIND-Pune-Smartworks, India14h ago
-
AI Engineer - Full Stack INR 1200K-2500KAgile | Code Management | Relational databases | SQL | Source CodeMid-level Full TimeIND-Pune-Smartworks, India14h ago
-
Data Engineer With Data Observability INR 1500K-2000KAWS | Agile | Airflow | CI/CD | Cloud OperationsMid-level Full TimeBangalore, IN14h ago
-
Principal Data Engineer INR 3000K-4000KAWS | Agile | Amazon EC2 | Amazon S3 | Automated testingBereavement leave | Diversity, equity, & inclusion programs | Employee assistance program | Employee referral program | Healthcare insuranceSenior-level Full TimeIND - Bengaluru, India14h ago
-
AI Research Engineer - Applied AI INR 2000K-3000KAPI Design | AWS SageMaker | Anomaly Detection | Azure Machine Learning | Bias auditingAsynchronous culture | Distributed team | Remote workMid-level Full TimeRemote - REMOTE, India, India R14h ago
-
Senior Data Engineer INR 2000K-2250KApache Airflow | CI/CD | Cloud Composer | Cloud Dataflow | Cloud StorageSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …14h ago
-
Principal Engineer - Java with Gen AI INR 2000K-3465KAgent Frameworks | Azure | Cloud Native | Concurrency | EmbeddingsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago
-
Mid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India14h ago