Azure Big Data Engineer
Bengaluru, KA, India
INR 1500K-2250K (estimate) Senior-level Full Time
Tasks
- Apply unit testing methodologies and frameworks
- Build Azure data pipelines
- Design and manage Azure storage for data processing
- Develop Spark jobs with PySpark Scala and SparkSQL
- Implement end-to-end Hadoop projects
- Perform ad-hoc analysis and present results
- Process data using Azure Databricks and HDInsight
- Use Azure Data Factory to orchestrate workflows
- Work with Hive and HBase
Perks/Benefits
- N/A
Skills/Tech-stack
Apache HBase | Apache Hadoop | Apache Hive | Apache Spark | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure HDInsight | Azure SQL | Blob Storage | Cosmos DB | Data Factory | Data Lake Storage | Microsoft Azure | NoSQL | PostgreSQL | PySpark | Scala | SparkSQL | T-SQL | Unit Testing
Related jobs
-
AWS Data Engineer- Gen AI INR 1500K-2500KAWS CDK | AWS Glue | AWS Step Functions | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai7h ago
-
AI/ML Engineer_MS INR 2500K-5000KAI Foundry | AI Search | AWS Bedrock | Amazon QuickSight | App ServiceSenior-level Full Timetelengana, India14h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia14h ago
-
Senior INR 3000K-5000KAI Foundry | Azure AI | Azure AI Foundry | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeGurgaon, Haryana, India14h ago
-
AI Engineer II INR 3799K-6000KAgentic AI | Agile methodology | Algorithms | Automated testing | Distributed SystemsSenior-level Full TimeBengaluru, KA, India15h ago
-
Senior-level Full TimeBengaluru, KA, India15h ago
-
Senior Software Engineer, Machine Learning INR 2500K-3500KA/B | A/B Testing | Amazon S3 | Apache Airflow | Apache SparkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India16h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3200K-4590KAIOps | Anomaly Detection | Apache Spark | C# | C++Career Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India20h ago
-
Databricks -Project Lead-Data Engg INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryClient communication support | Flexible to work US shiftsSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …20h ago
-
Senior Data Engineer (Data Analytics),Hyderabad INR 3000K-4000KAPI | AWS | Agile | Amazon DynamoDB | Amazon RedshiftEqual opportunity employer | Fast track growth opportunitiesSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …20h ago
-
Data Engineer - Fabric Pipelines / Orchestration INR 2040K-3000KApache Spark | Azure Synapse | Data Quality | Data Warehousing | Data integrationContract employment | Quarterly renewal | Remote workSenior-level Full TimeDelhi, DL, IN20h ago
-
Databricks - Principal Data Engineer INR 1500K-2500KApache Spark | CI/CD | Data Modeling | Data Pipeline Performance Tuning | Data WarehousingFull-time employment | Hybrid workSenior-level Full TimeBangalore, KA, IN20h ago
-
Custom Software Engineer INR 2475K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseSenior-level Full TimeBengaluru, BDC11A, India20h ago
-
Mid-level Full TimeBengaluru, BDC6F, India20h ago
-
Senior-level Full TimeBengaluru, KA, IN, 56001620h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Dataverse | Azure FunctionsSenior-level Full TimePune, India20h ago
-
Senior Software Engineer (India) INR 3000K-4500KAWS | AWS CDK | Agile | Asyncio | AuthenticationRemote work | Work from homeSenior-level Full TimeIndia - Remote R20h ago
-
Business Intelligence Senior Specialist INR 1200K-2040KData Modeling | Data integration | ELT | ETL | GitHybrid workingSenior-level Full TimeBangalore, KA, IN20h ago
-
Senior-level Full TimeHyderabad, Telangana, India20h ago
-
AWS | Apache Airflow | Apache Spark | Azure | Azure DataFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimePune, India20h ago
-
Core Data: AI Enablement Engineer - Manager INR 3799K-5500KAI Search | AI evaluation SDK | Azure AI | Azure AI Evaluation | Azure AI Evaluation SDKEmployee networks | Flexible work/life support | Paid volunteer daysSenior-level Full TimeBangalore, India20h ago
-
Senior Devops Engineer - Azure INR 2400K-3500KApache Airflow | Apache Kafka | Azure Cognitive | Azure Cognitive Services | Azure DataFlexible work environment | Internal mobility | Volunteering opportunities | Well-being focus | Work-life balanceSenior-level Full TimeKA Bangalore, India20h ago
-
Lead Engineer Data Streaming INR 1600K-3000KAmazon Redshift | Ansible | Apache Kafka | CDC | CI/CDFlexible work environment | Internal mobility | Volunteering opportunities | Well-being programs | Work-life balanceSenior-level Full TimeKA Bangalore, India20h ago
-
Senior Software Engineer (Java Full stack , AI, Python, PyTorch , TensorFlow, Hugging Face) INR 4000K-5572KAI frameworks | Automation | CI/CD | Hugging Face | Integration TestingSenior-level Full TimePune, India20h ago
-
Efs Fcrm 169474 INR 1500K-2400KApache Spark | Azure DevOps | CI/CD | Data Partitioning | Data WarehousingMid-level Full TimeHyderabad, IND-TG, India1d ago