Specialist, Data Engineering
IND - Telangana - Hyderabad (Hitec City Raidurg), India
R
INR 1000K-1848K (estimate) Mid-level Full Time
Tasks
- Build and extend PySpark loaders transformers and writers
- Design and improve CI CD automation
- Develop and maintain data ingestion pipelines
- Implement AWS IAM key rotation service
- Implement and maintain configuration and support bot
- Integrate Microsoft Teams bot with LLM
- Manage release versioning and artifact promotion
- Provide L3 technical support
- Provision and maintain AWS resources
- Provision and maintain Azure resources
- Troubleshoot pipelines and support internal consumers
- Validate data schemas and enforce data quality rules
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | Access Control | Amazon ECR | Amazon ECS | Amazon S3 | Apache Airflow | Apache Kafka | Azure | CI/CD | Databricks | Delta Lake | Docker | Docker containers | GitHub Actions | IAM policies | JFrog Artifactory | Java | Java JDBC | LLM integration | Microsoft Graph | Microsoft Teams | OAuth2 | Parquet | Private Endpoints | Prompt engineering | PySpark | Python | REST APIs | Role-Based Access | Role-Based Access Control | SFTP | SMB | Scala | Secrets Manager | Spark SQL | Terraform | VNet | VPC
Education
N/A
Related jobs
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R1d ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R1d ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R1d ago
-
Data Engineer INR 1500K-2100KAWS | Agile | Apache Airflow | CI/CD | Data GovernanceHybrid work environment | Work-life flexibilityMid-level Full TimeBengaluru, India R1d ago
-
Software Development Advisor INR 1000K-1700KAPI Gateway | AWS | Agile | Amazon Connect | Amazon EKSMid-level Full TimeBangalore, KA, IN R1d ago
-
Offshore ETL Engineer (DBT SME) INR 1500K-2040KAnalytics modeling | CI | CI/CD | DBT | Data ModelingMid-level Full TimeBangalore, KA, IN R1d ago
-
AI/MLOps SRE Lead Engineer INR 3000K-4680KAKS | AWS CDK | Amazon SageMaker | Anomaly Detection | Automated remediationHybrid work environmentSenior-level Full TimeHyderabad, India R1d ago
-
Senior-level Full TimeBangalore, KA, IN R1d ago
-
Technical & Solution Architect INR 2771K-4300KAWS | Agile | Airflow | Angular | Angular MaterialCareer growth | Healthcare benefits | Hybrid work environment | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R1d ago
-
India - Senior Data Engineer ( Contractual Remote Opportunity) INR 3000K-4300KAWS | Azure | Azure Event | Azure Event Hubs | CDCSenior-level ContractRemote , India R1d ago
-
AWS | ArgoCD | Auto Scaling | Autogen | AzureHybrid work | In office days per hiring manager confirmation | Mentorship and career growthSenior-level Full TimeBengaluru, India R1d ago
-
Senior Python Data Engineer INR 3000K-4000KAWS | Apache Airflow | Automated testing | Azure | CI/CDCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R1d ago
-
Staff Enterprise Engineer (Storage) INR 3000K-4000KAnsible | Azure Backup | CI/CD | Capacity Planning | Disaster RecoveryHybrid workSenior-level Full TimeBengaluru, KA, India R1d ago
-
Senior Technical Specialist, AI Solutions : Delhi INR 2500K-4800KAWS | Agent Orchestration | Authentication | Azure | CI/CDHybrid work | Onsite client workSenior-level Full TimeIndia Remote R1d ago
-
Agentic Engineer Level II/III INR 2000K-5000KAPI Integration | Authentication | Debugging | Error Handling | IdempotencySenior-level Full TimeRemote - India R1d ago
-
AI/ML Engineer INR 2000K-3500KAzure | Data Pretraining | Data Structures | DeepSpeed | Distributed SystemsCar lease benefits | Career advancement programs | Certification programs | Continuous learning opportunities | Corporate NPSMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure | Azure AppCertification programs | Corporate NPS | Dental insurance | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R1d ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R1d ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAsynchronous programming | Authentication | Authorization | CI/CD | CachingContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R1d ago
-
Mid-level Full TimeBangalore, KA, IN R2d ago
-
Engineers (Agentic / Automation) INR 2475K-4680K.Net Core | API Security | AWS Lambda | Agile | Amazon RDSSenior-level Full TimeGurgaon, HR, IN R2d ago
-
Applied AI Engineer INR 3000K-4500KAI Foundry | AI Governance | AIOps | Azure AI | Azure AI FoundrySenior-level Full TimeIndia - Remote R2d ago
-
Senior-level Full TimeIndia - Remote R2d ago
-
Senior Data Engineer INR 3000K-4200KData Migration | Data Quality | Data Reconciliation | Data Validation | EHI ExportCollaborative workspaces | Commuter support | Employee assistance program | Employee resource groups | Remote work flexibilitySenior-level Full TimeChennai India R2d ago
-
Sr Engr Cslt-Data Science INR 2817K-4995KBigQuery | Chatbot | Conversational Analytics | Data Modeling | Data ValidationHybrid work | Work from homeSenior-level Full TimeVDSI, OLYMPIA TECH PARK BLOCK-B 1, … R2d ago