Azure Big Data Engineer
Bengaluru, KA, India
INR 1500K-2250K (estimate) Senior-level Full Time
Tasks
- Apply unit testing methodologies and frameworks
- Build Azure data pipelines
- Design and manage Azure storage for data processing
- Develop Spark jobs with PySpark Scala and SparkSQL
- Implement end-to-end Hadoop projects
- Perform ad-hoc analysis and present results
- Process data using Azure Databricks and HDInsight
- Use Azure Data Factory to orchestrate workflows
- Work with Hive and HBase
Perks/Benefits
- N/A
Skills/Tech-stack
Apache HBase | Apache Hadoop | Apache Hive | Apache Spark | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure HDInsight | Azure SQL | Blob Storage | Cosmos DB | Data Factory | Data Lake Storage | Microsoft Azure | NoSQL | PostgreSQL | PySpark | Scala | SparkSQL | T-SQL | Unit Testing
Related jobs
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R8h ago
-
Azure Databricks INR 1500K-2000KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeIN-AP-Hyderabad10h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAI | AWS | Airflow | Apache Spark | BazelCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Teams Telephony – Operations Automation & AI Engineer INR 2000K-3500KAI orchestration | Azure Functions | Azure Key Vault | Azure Relay | Azure StorageMid-level Full Timebangalore, India11h ago
-
Senior Data Engineer INR 3000K-4000KADLS Gen2 | Audit Logging | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune, Maharashtra, India11h ago
-
Senior Database Engineer INR 2520K-3380KAerospike | Azure | Azure Cosmos | Azure Cosmos DB | Azure DataOn-call support | Relocation assistance | Rotational shifts 24x7Senior-level Full TimeBengaluru, KA, IN13h ago
-
Lead Software Engineer - Data Engineer INR 1500K-2400KABAC | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Entry-level Full TimePune, Maharashtra, India14h ago
-
Entry-level Full TimePune, Maharashtra, India14h ago
-
Data Engineer - Senior INR 3000K-3500KAnomaly Detection | Application Insights | Azure | Azure Application Insights | Azure SQLSenior-level Full TimePune, Maharashtra, India14h ago
-
Software Engineer INR 1100K-1500KAirflow | Azure Data | Azure Data Factory | Control-M | Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India16h ago
-
Germany (FS- D&A)- Executive-BLR INR 500K-500KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid workExecutive-level Full TimeBangalore, Karnataka, India16h ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 938K-1500KAWS | Backup and Disaster Recovery | Cloud Computing | Cloud Storage | DatabasesMid-level Full TimeBangalore, India16h ago
-
Software Engineer INR 1000K-2700KAWS Cloud | Amazon Aurora | Amazon ECS | Amazon EMR | Amazon S3Reward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India17h ago
-
Software Engineer - Associate INR 1170K-2000KAWS S3 | Agentic AI | Amazon ECS | Amazon EMR | Amazon SNSDevelopment opportunities | Reward and recognition | Volunteering opportunities | Wellness | Work-life balanceMid-level Full TimeHyderabad, India17h ago
-
Sr Python / GCP / Functional Testing INR 3000K-4000KAgile | Alerting | BigQuery | Business Rules | CI/CDSenior-level Full TimeGurgaon, Haryana, India17h ago
-
AI | API Testing | Airflow | Automation frameworks | AzureEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India17h ago
-
Data Engineer- Microsoft Fabrics INR 2000K-3000KAzure Data | Azure Data Lake | Azure Data Lake Storage | Azure Event | Azure Event HubsAnnual team offsites | Flexible hybrid work model | Internal tech talks | Knowledge sharing sessions | MentorshipSenior-level Full TimeBangalore North, India22h ago
-
Senior Data Engineer - GenAI INR 2000K-4000KApache Iceberg | Apache Spark | Batch Processing | BigQuery | CI/CDCloud certification sponsorship | Flexible work arrangements | Professional development supportSenior-level Full TimeBangalore North, India22h ago
-
Software Engineer- Fullstack INR 1800K-2800K.NET | API Development | AWS | AWS S3 | AngularAnnual team offsite | Flexible hybrid work model | Internal tech talks | Knowledge sharing | MentorshipMid-level Full TimeBangalore North, India22h ago
-
Data Engineer - Dataform/BigQuery INR 1800K-2500KApache Spark | BigQuery | Cloud Storage | Cloud platform | DBTMid-level Full TimeBangalore North, India22h ago
-
Senior Data Engineer - Dataform/BigQuery INR 2000K-2400KADLS | BigQuery | DBT | Data Migration | Data WarehousingSenior-level Full TimeBangalore North, India22h ago
-
Senior-level Full TimeBangalore North, India22h ago
-
Staff AI Scienitist INR 2500K-5000KAI Agents | AWS Bedrock | AWS SageMaker | Agent systems | Agentic AISenior-level Full TimeIND19-01-Bengaluru-EPIP 122 (Phase II), India22h ago
-
Computer Scientist ( Java Backend ) INR 3000K-4725KApache Kafka | CI/CD | Distributed Systems | Docker | Event DrivenSenior-level Full TimeBangalore, India R22h ago