Azure Data Engineer
Bangalore - RGA Tech Park, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Automate data workflows
- Build ETL and ELT pipelines
- Deploy data infrastructure with Terraform
- Design database schemas
- Design real-time data ingestion
- Develop large-scale data processing jobs
- Implement data quality checks
- Implement streaming data processing
- Maintain CI/CD pipelines with GitHub Actions
- Manage cloud data lake storage
- Optimize data lakehouse transactions
- Transform data using dbt
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Athena | AWS CloudFormation | AWS Glue | AWS Lambda | Agile | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Synapse | Azure Synapse Analytics | Cassandra | Confluent Kafka | DBT | Data Factory | Data Lake Storage Gen2 | Databricks | Datadog | Delta Lake | Docker | DynamoDB | GitHub Actions | GitLab CI | Google BigQuery | Grafana | Great Expectations | Hadoop | Java | Kubernetes | MongoDB | MySQL | PostgreSQL | Prometheus | PySpark | Python | SQL | Scala | Snowflake | Soda | Synapse Analytics | Terraform
Education
Roles
Related jobs
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R7h ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible working hours | Flextime policy | Hybrid work model | International collaboration | Technical growth opportunitiesSenior-level Full TimeIndia7h ago
-
Manager Software Engineer- ML + NLP+ ppl management INR 3200K-4800KAPIs | BERT | Data Mining | Data Science | Deep learningFlexible work arrangements | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India11h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3200K-4590KAIOps | Anomaly Detection | Apache Spark | C# | C++Career Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India11h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3000K-3900KAIOps | Agentic Workflows | Anomaly Detection | C# | C++Senior-level Full TimeBengaluru, Karnātaka, India11h ago
-
AWS | Airflow | DBT | Fine Tuning | Language ModelsBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R17h ago
-
AI/ML engineer - Associate Research Scientist INR 1500K-2500KAIOps | API Development | AWS | Anomaly Detection | AutomationContinuous learning and professional development | Employee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India17h ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101318h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India18h ago
-
Planview Administration 169576 INR 1500K-2500KAlerting | Data Governance | Data Modeling | Data Validation | Data cleaningSenior-level Full TimeHyderabad, IND-TG, India18h ago
-
Senior Database Engineer - #3190 (Remote) INR 1500K-2700KAWS IAM | AWS KMS | AWS RDS | Amazon Aurora | BashOn-call rotation | Remote workSenior-level Full TimeChennai, India R21h ago
-
Software Engineer SRE (Site Reliability Engineer) INR 1600K-3000KAWS | Ansible | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India Office (BANGALORE) R21h ago
-
Mid-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-MH-Pune22h ago
-
Snr AI INR 2500K-5000KAI Search | Amazon SageMaker | Azure AI | Azure AI Search | Azure Machine LearningSenior-level Full TimeIN-HR-Gurgaon22h ago
-
Senior-level Full TimeBengaluru, Karnataka23h ago
-
GCP BigQuery,DevOps,Credit Card Domain/Associate Director, Data and Analytics Specialist INR 650K-900KApache Airflow | Apache Kafka | BigQuery | CI/CD | Cloud ComposerMid-level Full TimeHyderabad, Telangana, India R1d ago
-
API Design | AWS Bedrock | AWS Lambda | Amazon Web Services | AzureEmployee wellness programs | Flexible work arrangements | Health insurance | Inclusive global work culture | Learning and certification supportSenior-level Full TimeIndia1d ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseSenior-level Full TimePune, Maharashtra, India1d ago
-
AI Agents | AWS | AWS Glue | Apache Druid | Apache HudiCareer growth potential | Collaborative engineering culture | Flexible work from anywhere in India | Fully remote | Technical strategy influenceSenior-level Full TimeIndia R1d ago
-
Lead Software Engineer - Python Full Stack, AI/ML INR 4000K-5000KAWS | Agile | Angular | Application Resiliency | Automated testingSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Staff Software Engineer, AI/ML INR 2475K-3800KAPIs | Access Control | Audit Logging | CI/CD | Event DrivenSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Senior-level Full Timecoimbatore, India1d ago
-
Digital Marketing Analyst INR 2500K-3380KAWS | Azure | Cloud platform | Customer Analytics | Data GovernanceSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 3000K-4401KAlgorithm Design | Code Tuning | Data Structures | Data Structures and Algorithms | Design PatternsFlexible work schedule | Health benefits | Paid time off | Remote work optionSenior-level Full TimeBangalore, Karnataka, India1d ago