Azure Big Data Engineer
Bengaluru, KA, India
INR 1500K-2250K (estimate) Senior-level Full Time
Tasks
- Apply unit testing methodologies and frameworks
- Build Azure data pipelines
- Design and manage Azure storage for data processing
- Develop Spark jobs with PySpark Scala and SparkSQL
- Implement end-to-end Hadoop projects
- Perform ad-hoc analysis and present results
- Process data using Azure Databricks and HDInsight
- Use Azure Data Factory to orchestrate workflows
- Work with Hive and HBase
Perks/Benefits
- N/A
Skills/Tech-stack
Apache HBase | Apache Hadoop | Apache Hive | Apache Spark | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure HDInsight | Azure SQL | Blob Storage | Cosmos DB | Data Factory | Data Lake Storage | Microsoft Azure | NoSQL | PostgreSQL | PySpark | Scala | SparkSQL | T-SQL | Unit Testing
Related jobs
-
Senior Data Engineer INR 2520K-3380KApache Airflow | Apache Iceberg | Azure Data | Azure Data Lake | Azure DevOpsSenior-level Full TimePune, MH, IN13h ago
-
ETL Test Engineer (3-6 yrs) (Pune/Chennai) - (Must Have- ETL Testing, Python, Pyspark, Azure Databricks) INR 900K-1500KAPI Testing | Apache Airflow | Azure Databricks | Bitbucket | DockerEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai/Pune, India20h ago
-
Senior Data Engineer INR 1500K-2800KApache Spark | Data Governance | Data Pipelines | Data Privacy | Data SecurityLocal presence requiredSenior-level Full TimeOntario Centre (Queensville), India23h ago
-
Data Engineer - HR Analytics & Workday Prism INR 1500K-2000KAPI Integrations | AWS SageMaker | Agile | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
GCP Data Engineer/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Opportunities for growth | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Azure Data | Azure Data Factory | CI/CD | Data Factory | Data ReconciliationSenior-level Full TimeBangalore, India1d ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 800K-1000KAWS | Access Management | Backup and Disaster Recovery | Cloud Computing | Data ProtectionMid-level Full TimeBangalore, India1d ago
-
Senior Talend Developer / Lead Data Engineer INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full Timebengaluru, India1d ago
-
AWS Data Engineer (Senior) (Freelancer) INR 2040K-3000KAmazon Athena | Amazon EMR | Amazon Glue | Amazon Redshift | Apache AirflowSenior-level FreelanceMumbai, MH R1d ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R1d ago
-
Senior Data Engineer INR 1500K-2500KAccess Control | Azure | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeHyderabad, IN, 500 0081d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | Azure SQLSenior-level Full TimeGurugram 10 C, India1d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Senior-level Full TimeGurugram 10 C, India1d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India1d ago
-
IN_Senior Associate_Data Analytics / Data Engineering_Digital Integration_Advisory_Gurgaon INR 2000K-2600K.NET | Agile | Azure | Azure Databricks | C#Flexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeGurugram 10 C, India1d ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAI/ML | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseFlexibility programmes | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAI/ML | AI/ML data | AI/ML data preparation | Azure Data | Azure Data FactorySenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseEqual employment opportunities | Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Staff Software Engineer INR 2000K-3500KAI integration | Aerospike | Apache Kafka | Cosmos DB | ElasticsearchSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Senior-level Full TimePlant 4 - Bangalore, India1d ago
-
Data Engineer INR 2520K-3880KAutomation | C# | CI/CD | Cloud Platforms | Data ModelingHybrid work | Learning opportunities | Life and health insurance | Medical care package | Relocation assistanceMid-level Full TimeIN: Pune - Building 5, India1d ago