Senior Data Engineer with Azure (ADF/Fabric/Synapse), SQL, Data modeling, ETL/ELT, Python/PySpark
IND-Pune-Smartworks, India
R
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Architect scalable data solutions
- Automate reconciliations and variance analysis
- Build and optimize data pipelines
- Collaborate with BI teams on dashboard standards
- Deploy predictive modeling frameworks
- Design and scale data infrastructure in Microsoft Fabric
- Design data models and schema
- Develop NLP applications for unstructured document insights
- Develop and validate predictive models
- Enable GenAI chatbots for finance shared services
- Implement ETL and ELT processes
- Implement Generative AI for reporting and summaries
- Lead data governance and data quality frameworks
- Manage CI CD pipelines for data engineering
Perks/Benefits
Skills/Tech-stack
AWS | Apache Airflow | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Factory | Data Governance | Data Modeling | Data Pipeline Performance Tuning | Data Quality | Data pipeline | Data pipeline performance | ELT | ETL | Generative AI | Git | Informatica | Language Processing | Microsoft Fabric | Natural Language | Natural Language Processing | Performance Tuning | Pipeline performance tuning | PySpark | Python | SQL | Schema Design | Snowflake | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff Engineer, .Net Core (Optimizely CMS 12, and React) INR 1500K-2400K.NET | .Net Framework | ASP.Net Core | Agile | AuthenticationSenior-level Full TimeRemote, India R13h ago
-
Associate, DataX INR 900K-1000KCI/CD | Data Preprocessing | Embeddings | Experimentation | KubernetesComprehensive healthcare | Flexible time off | Hybrid work | Retirement plan | Tuition reimbursementMid-level Full TimeM11 - Commers III, 43, 44 … R19h ago
-
Staff Software Engineer - Enterprise AI INR 2500K-5000KAWS | Apache Spark | Azure | Babel | Fine TuningCareer development | Employee resource groups | Flexible work from home | Generous PTO | Paid volunteer timeSenior-level Full TimeIndia-Bangalore-Remote R19h ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R1d ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R1d ago
-
Senior Analytics Engineer INR 3000K-4000KAirflow | Auditability | Compliance | DBT | Data GovernanceCasual leave | Employee referral bonuses | Employee resource groups | Group medical coverage | Life insuranceSenior-level Full TimeHyderabad R1d ago
-
Apache Spark | Data Modeling | Data Quality | Data Visualization | Data WarehousingAccessibility support | Career growth | Fully remote | Inclusive workplace | Work-life balanceSenior-level Full TimeIndia R1d ago
-
Actor-critic | Deep reinforcement learning | Exploration/exploitation | GRPO | Language ProcessingCareer growth opportunities | Flexible work culture | Fully remote work | Global collaborationMid-level Full TimeIndia R1d ago
-
Data Operations Engineer INR 2040K-3380KApache Airflow | Data Pipelines | Data Refresh | Data Warehousing | Data pipelineEmergency incident response support | On-call rotationSenior-level Full TimeBengaluru, INDIA, India R1d ago
-
Anomaly Detection | Data Modeling | Data Pipelines | Docker | JavaScript100 percent remote | Autonomous work environment | Career growth opportunities | Flexible work environment | International team cultureMid-level Full TimeIndia R1d ago
-
Machine Learning Engineer - 5 INR 2500K-4500KAWS | AWS SageMaker | Airflow | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R1d ago
-
Computer Scientist ( Java Backend ) INR 3000K-4725KApache Kafka | CI/CD | Distributed Systems | Docker | Event DrivenSenior-level Full TimeBangalore, India R1d ago
-
Business Technology Analyst INR 3000K-4000KAWS | AWS Athena | AWS Glue | Airflow | Amazon RedshiftHeadspace access | Hybrid work | Mental health days | Retirement savings | Tuition reimbursementSenior-level Full TimeIndia, Hyderabad, Telangana R1d ago
-
Software Engineer INR 1500K-2362KAWS | Apache Flink | Apache Spark | Linux | PythonHybrid work | Remote work | Work-life balanceMid-level Full TimeRemote (IND), India R1d ago
-
Associate Software Engineer INR 950K-2000K.Net Core | ASP.NET | Agile | Amazon Web Services | AngularMid-level Full TimeRemote Bangalore-Baroda, India R1d ago
-
SASE Engineer/ Senior SASE Engineer INR 2542K-3200KAPI Integration | Azure | BGP | Bash | Cloud interconnect24x7 operational support | Boot camp onboarding | Competitive compensation | Flexible hours | Heavy technical trainingSenior-level Full TimeNoida, India, India (Hybrid) R1d ago
-
Machine Learning Engineer 5 INR 2500K-4500K3D Reconstruction | Adapters | CLIP | Computer Vision | ControlNetSenior-level Full TimeBangalore, India R1d ago
-
Junior GenAI Developer INR 500K-600KAWS | Embeddings | Git | Hybrid search | Language ModelsCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesEntry-level Full TimeAll Cities, India R2d ago
-
Junior GenAI Developer INR 500K-600KAWS | Embeddings | Git | Hybrid search | Language ModelsHealth insurance | Language courses | Mentorship | Professional development | Relocation programEntry-level Full TimeAll Cities, India R2d ago
-
Tech Lead - Gen AI with 6+ Years(Remote) INR 2500K-5000KAWS | Chatbot | Computer Vision | Dialogue flow | Distributed ComputingRemote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Sr. Engineer - Gen AI with 4+ years(Remote) INR 2500K-5000KAWS | Audio Processing | Azure | Computer Vision | Distributed ComputingExtendable contract | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Software Development Engineer I INR 2139K-4500KCI/CD | Code review | Data Structures | Data Structures and Algorithms | ElasticsearchProfessional development | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS Lambda | Agile | Amazon CodeDeploy | Amazon LinuxGreat place to work | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Senior DevOps Engineer INR 2000K-4000KAWS | AWS CodeDeploy | AWS Lambda | AWS SDK | AgileGreat place to work | PradeepIT Academy training | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago