Sr Data Engineer – AI Ops
Tasks
- Automate manual processes
- Build data pipelines for production AI workloads
- Build retraining pipelines
- Collaborate with stakeholders on data technical issues
- Design reliable observable scalable data infrastructure
- Develop analytics tools for business metrics
- Implement ETL data extraction transformation loading
- Implement data quality checks and lineage
- Monitor troubleshoot and tune pipeline performance
- Redesign infrastructure for scalability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Athena | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Spark | CI/CD | DBT | Data Lineage | Data Quality | Databricks | Google BigQuery | Great Expectations | JSON | Kafka | Monte Carlo | Observability | OpenLineage | Python | SQL | Snowflake | Terraform | Unit Testing | XML
Education
Roles
Related jobs
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore7h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad7h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad7h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India8h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India8h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India8h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India9h ago
-
Product Engineering Specialist INR 2500K-5000KAI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platformsSenior-level Full TimePune, Maharashtra, India10h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior-level Full TimeMumbai, India11h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R12h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India12h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN12h ago
-
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000KAWS | AWS Data | AWS Data Governance | AWS EC2 | Data GovernanceSenior-level Full TimePune, Maharashtra, India13h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R13h ago
-
Senior-level Full TimeBengaluru, Karnataka, India13h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India13h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India14h ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R14h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN19h ago
-
Senior-level Full TimeBangalore, KA, IN19h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India19h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R19h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R19h ago