Senior Data Engineer
Tasks
- Architect end-to-end data solutions
- Automate data integration workflows
- Build API based and real time ingestion frameworks
- Build data pipelines for integration and consumption
- Collaborate with stakeholders to define data requirements
- Contribute to architectural roadmaps and technology evaluations
- Create semantic models and KPIs with BI tools
- Develop automated testing frameworks for data jobs
- Implement CI/CD pipelines with Git
- Implement data modeling standards in data lake
- Lead technical design reviews and mentoring
- Manage metadata and data governance
- Optimize Spark and SQL workloads
- Optimize data models for self service analytics
- Prepare curated datasets for analytics
Perks/Benefits
Skills/Tech-stack
ARM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure Fabric | Azure SQL | Bicep | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Modeling | Databricks | GDPR | Git | GxP | HIPAA | Infrastructure as Code | Integration Testing | JSON | Looker | Metadata Management | Power BI | PySpark | REST | Regression testing | SQL | Spark | Tableau | Terraform | Unit Testing | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer INR 2771K-4064KAgile | Azure Data | Azure Data Services | Azure DevOps | Cloud ConceptsLearning and career development | Management training | Modern infrastructure | Online learningSenior-level Full TimeChennai, IN, 600 0328h ago
-
Senior-level Full TimeHyderabad, India18h ago
-
Senior Agentic AI Engineer - Bangalore INR 3000K-3500KAI Workflow Orchestration | AI workflow | APIs | AWS | CI/CDMid-level Full TimeBengaluru, Karnātaka, India19h ago
-
Senior-level Full TimeHyderabad, India20h ago
-
Data Engineer, Cloud Supply Chain Data Engineering INR 1500K-2200KBigQuery | Data Governance | Data Monitoring | Data Pipelines | Data QualityCollaborative team environment | Mentoring opportunitiesMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Staff Software Engineer, Geo INR 2500K-3465KAnomaly Detection | C++ | Continuous Learning | Data Governance | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Staff Software Engineer INR 3417K-4800K.Net Core | AWS | Azure | CI/CD | Cloud NativeEnhanced medical benefits | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India21h ago
-
Mid-level Full TimePune, Maharashtra, India21h ago
-
Data Engineer INR 3000K-4000KData Ingestion | Data Pipelines | Data Quality | Data Transformation | Data ValidationSenior-level Full TimePune, Maharashtra, India22h ago
-
Senior AI/ML Engineer I INR 2771K-4500KAI vector search | Apache Spark | Autogen | Azure DevOps | CI/CDCareer advancement programs | Certification programs | Continuous learning opportunities | Dental coverage | Education reimbursement programSenior-level Full TimeBangalore, Karnataka, India22h ago
-
Mid-level Full TimeGurugram, Haryana, India23h ago
-
AWS | AWS Lambda | Amazon EMR | Amazon S3 | Apache AirflowEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off | Wellness plansSenior-level Full TimePune, MH, India23h ago
-
DE&A - AIML - Data Science - Machine Learning INR 2500K-5000KAI orchestration | AWS | Agentic AI | Azure | CI/CDSenior-level Full TimeIndia23h ago
-
AWS | Agentic Workflows | Azure | CI/CD | Cloud platformCharity matching | Corporate volunteering | Dental insurance | Medical insurance | Paid time offMid-level Full TimeBengaluru, KA, IN1d ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Cause analysis | ClusteringMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | CI/CD | Cause analysis | Clustering | Data ModellingEntry-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeBengaluru1d ago
-
Senior Java Backend Engineer with GenAI skills INR 2500K-3465KAgile | Cloud Computing | Design Patterns | Docker | Extreme programmingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Data Engineer I INR 1500K-2000KAWS | Apache Spark | Automated testing | Azure | Azure DataHybrid work | Inclusive work environment | Professional developmentMid-level Full TimeBangalore, Karnataka, IN1d ago
-
Java Fullstack Engineer with GenAI & React INR 1500K-2500KAgile | Design Patterns | Docker | Extreme programming | GitHub CopilotEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India1d ago
-
Data Engineer I INR 1500K-2000KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure DatabricksCareer development | Learning opportunitiesMid-level Full TimeBangalore, Karnataka, IN1d ago
-
AWS | AWS S3 | Amazon IAM | Amazon RDS | Amazon RDS PostgreSQLContinuous learning | Fully remote | Professional growthSenior-level Full TimeIndia R1d ago
-
Engineering-L2-Bengaluru-Associate-Software Engineering INR 1800K-3500KApache Spark | C++ | CI/CD | Continuous Delivery | Data CurationExposure to finance domain | Fast-paced environment | Global team collaborationMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Cloud Data Engineer - AI/ML INR 4000K-5000KAmazon Web Services | Apache Spark | Batch Processing | Cassandra | Cloud platformSenior-level Full TimeBengaluru; Hyderabad1d ago
-
Cloud Data Engineer - AI/ML INR 4000K-5000KAmazon Web Services | Azure | Cassandra | Cloud platform | Dimensional ModelingSenior-level Full TimeBengaluru; Hyderabad1d ago