Senior Data Engineer
Tasks
- Apply version control CI CD testing documentation
- Build and operate hybrid data platform solutions
- Build end-to-end data pipelines
- Collaborate with BI teams and data governance stakeholders
- Conduct code reviews and mentor junior engineers
- Design ETL/ELT pipelines
- Develop and maintain Fabric lakehouses warehouses pipelines notebooks
- Drive pipeline efficiency and developer productivity improvements
- Ensure data flow continuity during migrations
- Implement data validation reconciliation monitoring logging alerting
- Improve operational maturity and production readiness
- Maintain data integrations
- Optimize workloads for performance reliability cost
- Refactor legacy pipelines
- Support on-prem to cloud migration
- Troubleshoot production pipeline failures
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | Automated testing | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Monitoring | Data Reconciliation | Data Validation | Data logging | ELT | ETL | Git | Microsoft Fabric | PySpark | Python | SQL | Spark SQL | Synapse Analytics | Testing | Version control
Education
N/A
Roles
Related jobs
-
Data Engineer, Global Affairs INR 1500K-2500KArtificial Intelligence | Big Data | C++ | Cloud platform | Data PipelinesMid-level Full TimeHyderabad, Telangana, India5h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R5h ago
-
AI/ML Engineer INR 2500K-3885KAzure | Deep learning | DeepSpeed | Distributed Systems | DockerCar lease | Certification programs | Corporate pension scheme | Dental & vision coverage | Education reimbursementMid-level Full TimeBangalore, Karnataka, India6h ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R6h ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R6h ago
-
Data Engineer INR 3000K-4000KAWS | Data Architecture | Data Governance | Data Modeling | Data MonitoringBike to work | Career progression | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeBengaluru, KA, India6h ago
-
Senior-level Full Time Part Timebangalore, India6h ago
-
Junior Agentic AI Engineer (m/f/d) INR 300K-350KAI Foundry | AKS | API Wrappers | Azure AI | Azure AI FoundryAgile collaboration | Career development | Flexible working | International networking | Learning opportunitiesEntry-level Full TimeHyderabad, IN10h ago
-
Senior Agentic AI Engineer (M/F/D) INR 4000K-5500KAI Foundry | AKS | Asyncio | Autogen | Azure AICareer development | Flexible working hours | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN10h ago
-
Data Engineering II INR 1500K-2000KBigQuery | Cloud Composer | Cloud Storage | Data Governance | Data QualityMid-level Full TimeChennai, Tamil Nadu, India10h ago
-
Associate Consultant_SQL_Python INR 1200K-1800KAlgorithms | Automation | C# | Data Structures | GitMid-level Full TimeChennai, IN, 60003210h ago
-
Sr SW Engineer, Machine Learning INR 2500K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Financial wellness support | Flexible work schedule | Mental health support | Retirement plan matchingSenior-level Full TimeBengaluru, India12h ago
-
Senior-level Full TimeGurgaon, Haryāna, India13h ago
-
Senior-level Full TimeBangalore, Karnātaka, India13h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | High responsibilityMid-level Full TimeBangalore, Karnātaka, India13h ago
-
Senior Software QA Engineer INR 2829K-3500KAPI Testing | AWS | Azure | CI/CD | Coverage metricsGlobal offices | Psychologist on staff | Remote work option | Training budgetSenior-level Full TimeNew Delhi, India13h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | Collaborative team | International teamMid-level Full TimeGurgaon, Haryāna, India13h ago
-
Data Engineer INR 1500K-2400KAKS | API Management | Amazon Kinesis | Azure | Azure DataHybrid work environmentSenior-level Full TimeBangalore, KA, IN16h ago
-
Mid-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …16h ago
-
IN-Senior Associate_ Data Scientist (AI/ML) __ Data & Analytics _ Advisory _Bangalore INR 3000K-5000KAWS Bedrock | AWS Glue | Amazon S3 | Amazon SageMaker | Azure DataSenior-level Full TimeBengaluru Millenia, India16h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India16h ago
-
GBM - Bengaluru - Associate - Quantitative Engineering INR 1000K-1800KAngularJS | Continuous Delivery | Continuous Deployment | Continuous integration | HTMLMid-level Full TimeBengaluru, Karnataka, India1d ago
-
SDE III - Backend INR 3500K-5000KAPI Integration | AWS Lambda | Amazon EC2 | Amazon RDS | Amazon SQSCollaborative open minded culture | Learning and development programs | Multicultural experience | Professional growthSenior-level Full TimeIndia R1d ago
-
SDE III - Backend INR 3500K-5000KAWS | Amazon SQS | Docker | EC2 | EmbeddingsLearning and development programs | Professional growthSenior-level Full TimeIndia R1d ago
-
Software Engineer INR 1300K-2200KAcceptance Testing | Angular | Apache Solr | ArizeAI | Behavior-Driven DevelopmentMid-level Full TimeBangalore, Karnataka, India1d ago