Specialist, Data Engineering
IND - Telangana - Hyderabad (Hitec City Raidurg), India
R
INR 1000K-2000K (estimate) Mid-level Full Time
Tasks
- Automate AWS IAM key rotation
- Build and extend ETL loaders transformers writers
- Develop data pipeline engine
- Implement and extend CI CD workflows
- Implement data quality rule engine
- Integrate Microsoft Teams bot adapter and Microsoft Graph
- Maintain configuration support bot
- Manage data ingestion, transformation, and delivery
- Manage release versioning and artifact promotion
- Provide L3 technical support
- Provision and maintain cloud infrastructure
- Support dataset teams onboarding and pipeline troubleshooting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Secrets | AWS Secrets Manager | Access Control | Active Directory | Amazon ECR | Amazon ECS | Amazon IAM | Amazon S3 | Apache Airflow | Apache Spark | Azure | Azure Active Directory | Azure Container | Azure Container Registry | Change Data Capture | Cloud Networking | Container Registry | Data Capture | Data Lake | Data Quality | Databricks | Delta Lake | Docker | GitHub Actions | IAM | Injection Defense | JDBC | JFrog Artifactory | Java | LLM API | Langchain | OAuth2 | Parquet | Prompt injection | Prompt injection defense | PySpark | Python | REST APIs | Regular Expressions | Role-Based Access | Role-Based Access Control | SFTP | SMB | Scala | Schema Validation | Secrets Manager | Semantic Kernel | Service principals | Spark SQL | Terraform | VNet | VPC
Education
N/A
Related jobs
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R16h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R20h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R22h ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R22h ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R22h ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R22h ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R22h ago
-
Databricks Data Engineer - Manager INR 1500K-2100KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryEducational support | Employee networks | Flexible work programs | Hybrid work environment | InsuranceMid-level Full TimeBangalore, India R22h ago
-
Databricks Data Engineer - Senior Manager INR 2771K-4064KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid work environment | Paid volunteer daysSenior-level Full TimeHyderabad, India R22h ago
-
Principal Data Engineer- Databricks & AI platform INR 3715K-5400KAWS | Airflow | Apache Spark | Asset bundles | AzureEmployee assistance program | Employee resource groups | Health benefits | Learning programs | No meeting daysSenior-level Full Time3010 - Bangalore Office, India R22h ago
-
Audit Analytics Specialist INR 1500K-2600KACL | AI | Automation | Dashboards | Data CleansingHybrid workMid-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India R22h ago
-
AWS | ArgoCD | Autogen | Azure | CI/CDHybrid workSenior-level Full TimeBengaluru, India R22h ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R2d ago
-
Senior Embedded Software Engineer INR 1716K-2500KAUTOSAR | Artifactory | Automotive SPICE | C plus plus | C#BusinessBike bicycle leasing | Continuing education programs | Corporate volunteering | End-of-year bonuses | Flexible working hoursSenior-level Full TimePune, MH, IN, 411057 R2d ago
-
Mid-level Full TimeHaryana, India R3d ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R3d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R3d ago
-
Senior Software Engineer INR 1492K-3000KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | Azure Machine LearningGrowth mindset culture | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R3d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Development programs | Learning and development programs | Remote work flexibility | Work from office or client siteSenior-level Full TimeBangalore, India R3d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Databricks | Distributed SystemsCareer Development Programs | Learning and development programs | Mentoring and coaching | Remote work flexibilitySenior-level Full TimeBangalore, India R3d ago
-
Java Big Data Developer - Experienced INR 1500K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R3d ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R3d ago
-
Mid-level Full TimePune, Maharashtra, India R3d ago
-
Java Big Data Developer - Senior INR 1200K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R3d ago