Lead - Data Engineer
IND-Bangalore-Equifax-Analytics, India
INR 1431K-2000K (estimate) Senior-level Full Time
Tasks
- Automate CI CD deployments with Azure DevOps
- Build Delta Lake tables
- Build data marts for business domains
- Design data lakehouse architecture
- Develop ETL/ELT pipelines
- Develop PySpark transformations
- Drive data strategy roadmap
- Implement data governance with Unity Catalog
- Model star schema dimensional data
- Monitor and tune Databricks performance
- Optimize SQL queries
- Orchestrate Azure Data Factory workflows
Perks/Benefits
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Bicep | CI/CD | Change Data Capture | Column Level Masking | Data Capture | Data Factory | Data Lakehouse | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Event Hubs | Infrastructure as Code | IoT Hubs | PySpark | Row Level Security | SQL | Star Schema | Structured Streaming | Terraform | Unity Catalog | “as-code”
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Agentic AI architect INR 2500K-4800KAPIs | AWS | Agent Orchestration | Autogen | AzureEmployee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programsSenior-level Full TimeChennai, India9h ago
-
AI Developer (Python) INR 1800K-2500KCI/CD | Document parsing | ETL | FastAPI | Generative AIFlexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonusesMid-level Full TimeChennai, India9h ago
-
Sr. Data Engineer I INR 2400K-4000KAWS | AWS Glue | Amazon EMR | Apache Kafka | Cloud MigrationContinuous learning | International travel | Mentorship | Professional growthSenior-level Full TimeBangalore, India9h ago
-
Senior Manager – Data Scientist INR 2520K-3500KAWS | AWS SageMaker | Agent systems | Agentic AI | AzureCareer growth | Continuous learning opportunities | Mentorship | Mentorship and coachingSenior-level Full TimeIndia-Gurugram9h ago
-
Senior-level Full TimeIN-AP-Hyderabad9h ago
-
Python Robot QA INR 1500K-2541KAPI Testing | Agile | Azure DevOps | Backup and Recovery | Case managementFlexible work timing | Hybrid work modelSenior-level Full TimeIN-AP-Hyderabad R9h ago
-
DBT Data Engineer INR 400K-1200KAPI Development | AWS Glue | AWS S3 | Amazon Redshift | Apache AirflowSenior-level Full TimeIN-AP-Hyderabad9h ago
-
Data Engineer INR 1500K-2000KAPI Development | AWS SQS | Amazon Aurora | Amazon Redshift | Amazon S3Senior-level Full TimeIN-AP-Hyderabad9h ago
-
Database Developer INR 1200K-2200KAWS Aurora | AWS Aurora PostgreSQL | AWS Cloud | AWS Cloud Database Services | AWS DMSSenior-level Full TimeIN-KA-Bangalore9h ago
-
AI Engineer INR 300K-300KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicInternal demos | Internal training sessionsEntry-level Full TimePune, Maharashtra, India10h ago
-
Partner Engineer, Generative AI INR 2500K-4500KAWS | Azure | Bias Mitigation | C++ | Conversational AISenior-level Full TimeBangalore, India | Mumbai, India11h ago
-
Senior-level Full TimeGurgaon, Haryana, India12h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Deputy Manager-Data Engineering INR 1500K-2000KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeGurgaon, HR, India13h ago
-
AI/ML Engineer INR 2500K-3000KAWS | Anomaly Detection | Automated retraining | Azure | ChromaCollaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented cultureMid-level Full TimeGujarat, Surat, India13h ago
-
Principal Engineer, Data Analytics Engineering 9+ years (Data Engineering , GenAI , Python , SQL) INR 2500K-5000KAWS | Airflow | Amazon Bedrock | Anthropic API | CI/CDSenior-level Full TimeBengaluru, KA, India13h ago
-
GCP Cloud Engineer INR 2500K-4500KAI Pipelines | BigQuery | Blue-Green Deployment | Blue/green | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India14h ago
-
Mid-level Full TimeBengaluru, IN, 56010314h ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India15h ago
-
Senior_AI_developer INR 3000K-4500KAI pipeline | API Orchestration | ASPICE | Agent behavior | CI/CDSenior-level Full Timebangalore, India15h ago
-
Lead Data Scientist INR 2516K-2829KAzure | Bias reduction | Cloud Computing | Data Modeling | Data PreparationEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India15h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India15h ago
-
API | Agile | Apache Spark | Big Data | CI/CDHybrid workSenior-level Full TimeBengaluru, INDIA, India15h ago
-
Mid-level Full TimeGurugram, Haryana, India16h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-3300KAWS | AWS CDK | Agile | Airflow | BackfillSenior-level Full TimeHyderabad, Telangana, India16h ago