Engineer Senior - Data Engineering
Tasks
- Build CI CD automation and deployment with Databricks Asset Bundles
- Collaborate to evolve products and internal processes
- Design layered lakehouse structures bronze silver gold
- Develop data technologies using Databricks Azure Data Factory Python and T-SQL
- Evolve data lakehouse using medallion architecture
- Implement data governance for standards security and quality
- Lead consensus building for recommended solutions
- Maintain proficiency in required data engineering skills
- Manage project lifecycle using Azure DevOps and scrum processes
- Mentor engineers and IT associates
- Orchestrate ETL workflows with Azure Data Factory
- Perform after-hours on-call support
- Provision and manage cloud resources with Terraform
- Translate requirements into data models for analytics and AI ML
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure | Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Call Support | Data Factory | Data Governance | Data Lakehouse | Data Modeling | Databricks | Delta Lake | ETL | Infrastructure as Code | Medallion Architecture | On-Call | On-call support | Python | Query Optimization | SQL | Spark SQL | Stored Procedures | T-SQL | Terraform | “as-code”
Education
N/A
Roles
Related jobs
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Hadoop | Apache SparkAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programMid-level Full TimePune - Margarpatta, India11h ago
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Spark | Cause analysisAccident and term life insurance | Childcare assistance reimbursement | Employee assistance program | Flexible leave policy | Gender neutral parental leavesMid-level Full TimePune - Margarpatta, India11h ago
-
Data Platform Engineer INR 1000K-2000KAWS | Data Modeling | Data Warehouse | Data integration | ETLMid-level Full TimeBengaluru, BDC7A, India11h ago
-
Mid-level Full TimeBengaluru, BDC14A, India11h ago
-
Mid-level Full TimeKolkata, KDC1A, India11h ago
-
Mid-level Full TimeKolkata, KDC1A, India11h ago
-
Infra Tech Support Practitioner INR 1500K-2500KAKS | API Gateway | AWS | Ansible | Application Lifecycle ManagementMid-level Full TimeKolkata, KDC1A, India11h ago
-
Infra Tech Support Practitioner INR 1000K-1820KAKS | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSMid-level Full TimePune, PDC3C, India11h ago
-
Automation Excellence Senior Specialist INR 3700K-5572K.NET | AI Document Intelligence | AI Services | API | Access ManagementSenior-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …11h ago
-
Embedded SRE INR 980K-1820KAWS | Bash | CI/CD | DNS | DockerEducation support | Lifestyle support | Paid time off | Wellness supportMid-level Full TimeBangalore, India16h ago
-
GCP Data Architect INR 1500K-3500KBigQuery | CI/CD | Cloud Build | Cloud Composer | Cloud MonitoringSenior-level Full TimeIndia - Pune19h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 500K-1500KAWS | Amazon Aurora | Amazon S3 | Backup and Recovery | CDCMid-level Full TimeMumbai, MH19h ago
-
Junior GenAI Developer INR 400K-480KAgentic Workflows | Embeddings | Git | Hybrid search | LLM integrationHealth insurance | Language courses | Mentorship | Professional development opportunities | Relocation programEntry-level Full TimeAll Cities, India R20h ago
-
Amazon Aurora | Amazon RDS | Amazon S3 | Amazon Web Services | CI/CDMid-level Full TimeDahisar West, Mumbai City, Maharashtra20h ago
-
Data and Digital Initiatives INR 3000K-4000KAI | API Integration | Cloud Computing | Credit Risk | DashboardingFlexible working | Inclusive work environment | Opportunities to grow | Professional developmentSenior-level Full TimeMumbai, Maharashtra, India21h ago
-
AI Engineer with RAG / MCP INR 1500K-3000KDocument processing | LLM | Microservices | Model Context Protocol | Prompt engineeringMid-level Full TimeIN-AP-Hyderabad22h ago
-
SDET ETL Testing INR 1500K-2500KAWS | AWS Command Line Interface | AWS Data | AWS Data Catalog | AWS GlueSenior-level Full TimeIN-HR-Gurgaon22h ago
-
AWS Data Engineer- Gen AI INR 1500K-2500KAWS CDK | AWS Glue | AWS Step Functions | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai22h ago
-
Junior GenAI Developer INR 400K-480KAgentic Workflows | Embeddings | Git | Hybrid search | LLM APIHealth insurance | Language courses | Mentorship | Professional development opportunities | Relocation programEntry-level Full TimeAll Cities, India R23h ago
-
API Integration | Azure Data | Azure Data Factory | Cloud Data | Cloud Data PlatformsFlexible remote work model | Remote workSenior-level Contract Full TimeIndia R23h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | C# | Cloud ArchitectureCollaborative team | Professional growth | Remote work | Work-life balanceSenior-level Full TimeIndia23h ago
-
Lead-ML Engineer INR 2500K-4500KComputer Vision | Data Analysis | Data Augmentation | Data Preprocessing | Data WarehousingSenior-level Full TimeHyderabad1d ago
-
MLOps Engineer INR 1200K-1680KAWS | Bedrock | CI/CD | Data Versioning | DockerEmployee Share Savings Plan | Hybrid work | Learning and mentoring | Paid volunteer day | Personal coachingMid-level Full TimeBengaluru1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago