Senior Data Engineer
Tasks
- Collaborate with business analytics and engineering teams to understand data requirements
- Design build and maintain scalable data pipelines on Azure
- Develop and optimize data processing workflows using Azure Databricks and PySpark
- Develop tune and maintain complex T-SQL queries and data models
- Ensure data quality reliability security and performance
- Follow coding standards and documentation guidelines
- Implement and manage ETL ELT solutions using Azure Data Factory
- Implement and manage data governance and access controls using Unity Catalog
- Troubleshoot and resolve issues across data pipelines and platform components
- Use SSIS and SSRS for data integration and reporting
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data Factory | Data Lake | ELT | ETL | Microsoft Azure | PySpark | SSIS | SSRS | T-SQL | Unity Catalog
Education
Roles
Related jobs
-
Python Pyspark -Support Role INR 1500K-2000KApache Airflow | BMC | Informatica | PySpark | PythonHybrid work model | Night shift workEntry-level Full TimeIN-TN-Chennai R22h ago
-
Senior AI Engineer – GIS Solutions (India) (Remote) INR 1800K-2800KAPI first | API-first design | AWS | ArcGIS Enterprise | ArcGIS JS APISenior-level Full TimeMaharashtra, Pune, India R1d ago
-
Senior Product AI Data Engineer INR 2040K-4000KAWS | Apache Airflow | Azure | BigQuery | ClickstreamFull-time role | Hybrid working environmentSenior-level Full TimeR131-Bangalore, India R1d ago
-
Senior Product AI Data Engineer INR 2040K-4000KAWS | Apache Airflow | Azure | Clickstream | DBT40 hours per week | Equal employment opportunity | Full-time employment | Hybrid working environment | Training and development opportunitiesSenior-level Full TimeR131-Bangalore, India R1d ago
-
Data Engineer INR 1500K-2525KAPI Integration | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseMid-level Full TimeIndia - Hybrid R1d ago
-
API performance | API reliability | API scalability | AWS Glue | AWS LambdaAI training | Community forums | Laptop provided | Medical insurance | MentorshipEntry-level Full TimeIndia R2d ago
-
GCP Data Engineer- Lead Consultant INR 2800K-4000KApache Airflow | BigQuery | Caching | Cause analysis | Cloud FunctionsBuddy support | Certificate training programs | Charity donation opportunities | Community webinars | Flexible working hoursSenior-level Full TimeIndia R2d ago
-
Principal Specialist- Data Science Customer Programs INR 2400K-4000KAWS | Apache Spark | Azure | Data Architecture | Data GovernanceHybrid workSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R3d ago
-
APIs | Access Control | Amazon S3 | Anomaly Detection | Apache SparkFully remote work flexibilitySenior-level Full TimeIndia R4d ago
-
AWS | Anthropic | CI/CD | Chroma | DockerDirect collaboration | Flexible work environment | Fully remote | Growth opportunity | Work on cutting edge AI automation projectsSenior-level Full TimeIndia - Remote R5d ago
-
Cloud Database Engineer INR 1500K-2300KAlwaysOn Availability | AlwaysOn availability groups | Amazon Web Services | Automation | Availability GroupsFlexible schedule | Hybrid work model | Remote work flexibilityMid-level Full TimeIndia - Pune R6d ago
-
Senior-level Full TimeIND - Remote - Bangalore Based … R6d ago
-
Azure DevOps | C Sharp | CI/CD | CI_CD | Data EngineeringCareer growth | Cross-functional collaboration | Flexible engineering culture | Fully remote work | Remote global teamMid-level Full TimeIndia R6d ago
-
GCP Data Engineer- Senior Consultant INR 2040K-3880KAirflow | BigQuery | Caching | Cloud Functions | Cloud StorageCertificate training programs | Charity donation opportunities | Community webinars | Flexible working hours | Knowledge sharing sessionsSenior-level Full TimeIndia R7d ago
-
Senior Data Engineer with Azure (ADF/Fabric/Synapse), SQL, Data modeling, ETL/ELT, Python/PySpark INR 3000K-4000KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseAgile collaboration | Hybrid work schedule | MentorshipSenior-level Full TimeIND-Pune-Smartworks, India R7d ago
-
Principal Analytics Engineer (Power BI Development) INR 3000K-4000KAgile | CI/CD | Cloud Computing | DAX | Data GovernanceEmployee programs | Local events | Medical insurance | Modern office spaces | Provident fundSenior-level Full TimeIndia Remote R7d ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R7d ago
-
Senior Analytics Engineer INR 3000K-4000KAirflow | Auditability | Compliance | DBT | Data GovernanceCasual leave | Employee referral bonuses | Employee resource groups | Group medical coverage | Life insuranceSenior-level Full TimeHyderabad R7d ago
-
Apache Spark | Data Modeling | Data Quality | Data Visualization | Data WarehousingAccessibility support | Career growth | Fully remote | Inclusive workplace | Work-life balanceSenior-level Full TimeIndia R8d ago
-
Tech Lead - Gen AI with 6+ Years(Remote) INR 2500K-5000KAWS | Chatbot | Computer Vision | Dialogue flow | Distributed ComputingRemote workSenior-level Full TimeBengaluru, KA, India R8d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon CodeDeploy | Amazon LinuxGreat place to work | Remote workSenior-level Full TimeBengaluru, KA, India R8d ago
-
Pyspark & Databricks certified Developer INR 1632K-2300KAWS | Apache Spark | Azure | Azure Databricks | Data IngestionRemote workSenior-level Full TimeMumbai, MH, India R8d ago
-
Principal Engineer (Big Data Engineer) INR 2800K-4500KAmazon Web Services | Apache HBase | Apache Spark | Cassandra | Cloud platformRemote work flexibilitySenior-level Full TimeBengaluru, KA, India R8d ago
-
Oracle + PySpark Data Engineer (Remote) INR 1500K-2500KData Modeling | Data Quality | Data Warehousing | Distributed Computing | ETLDocumentation support | Remote workMid-level Full TimeBengaluru, KA, India R8d ago
-
Lead Software Engineer (Big Data and Azure) INR 2040K-3500KAgile | Apache Kafka | Apache Spark | Apache Storm | Azure BlobCareer growth | Great Place to Work certification | Remote work | Training coursesSenior-level Full TimeBengaluru, KA, India R8d ago