Data Engineer
IND-Bangalore-Equifax-Analytics, India
INR 2000K-3000K (estimate) Mid-level Full Time
Tasks
- Build ETL/ELT pipelines
- Develop PySpark data transformations
- Implement CI/CD using Azure DevOps
- Implement data schema enforcement
- Maintain Delta Lake tables
- Model dimensional data
- Monitor pipeline health
- Optimize SQL queries
- Perform data quality checks
- Support data governance with Unity Catalog
- Transform raw data into actionable insights
- Troubleshoot production data issues
- Write unit tests for Spark logic
Perks/Benefits
- Healthcare benefits
- Hybrid work setting
- Online learning platform with guided career tracks
- Organizational growth potential
- Paid time off
Skills/Tech-stack
Apache Kafka | Asset bundles | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Monitor | Bicep | CI/CD | Data Factory | Databricks (asset) | Databricks Asset Bundles | Databricks CLI | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Event Hubs | Infrastructure as Code | Log Analytics | Power BI | PySpark | Pytest | Python | SQL | Slowly Changing Dimensions | Star Schema | Structured Streaming | Terraform | Unity Catalog | “as-code”
Education
Roles
Related jobs
-
LEAD DATA ENGINEER - Supply Chain INR 2520K-3380KAgentic AI | Agile Scrum | DBT | Data Governance | Data ModelingCompetitive salary package | Comprehensive group insurance | Convenient location | Extensive training initiatives | Growth opportunitiesSenior-level Full TimeBangalore, KA, IN, 5600764h ago
-
SR. DATA ENGINEER - (AI & Analytics) INR 3100K-3880KAWS | Agile | CI/CD | Data Modeling | DatabricksSenior-level Full TimeBANGALORE, KA, IN, 5600484h ago
-
Senior-level Full TimeIndia - Bengaluru5h ago
-
Senior Data Engineer INR 2500K-3380KAirflow | Apache Kafka | Apache Spark | Data Governance | Data ModelingGlobal team | Remote workSenior-level Full TimeIndia R9h ago
-
Senior Analytics Engineer – Product & Customer Analytics INR 2516K-3356KDBT | Data Documentation | Data Lineage | Data Modeling | Data QualityGlobal team collaboration | Remote-first work environmentSenior-level Full TimeIndia R9h ago
-
Staff Analytics Engineer – Customer Data Platform INR 2516K-3380KDBT | Data Architecture | Data Documentation | Data Modeling | Data TestingSenior-level Full TimeIndia R10h ago
-
Senior Data Engineer - Product Delivery INR 2040K-2400KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeCareer advancement | Dental insurance | Health insurance | Professional development | Retirement planSenior-level Full TimeIND Bangalore C 601, India10h ago
-
Machine Learning Engineer INR 1500K-2800KAlerting | Computer Vision | Data Engineering | Data Pipelines | Deep learningHealthcare | Internet reimbursement | Learning and development stipend | Phone reimbursement | Travel to headquartersMid-level Full TimeBengaluru, India12h ago
-
Data Ingestion Engineer INR 1327K-2345KAzure Data | Azure Data Factory | DBT | Data Factory | Data ModelingMid-level Full TimePune, MH, India19h ago
-
Certified Junior Gen AI Developers/ Engineers INR 60K-180KAsynchronous programming | FastAPI | Flask | Generative AI | HaystackEntry-level Full TimeIndia - Bengaluru; India - Pune20h ago
-
Data Engineer (L3) INR 3200K-3880KAWS | Agile | Apache Hudi | Azure | DBTDonation support | Generous time off | Healthcare | Parental leave | Remote-first workSenior-level Full TimeRemote - India R20h ago
-
Senior-level Full TimeHyderabad, India20h ago
-
Senior-level Full TimeHyderabad, India20h ago
-
Mid-level Full TimeMaharashtra, Pune, India20h ago
-
A/B | A/B Testing | Allocation Optimization | B testing | BacktestingFlexible hours | Remote workSenior-level ContractNoida, India21h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Computing | Data Modeling | Git | MicroservicesEducation budget | Local compliance support | Local connection | Periodic meet ups | Personal growth budgetSenior-level Full TimeHyderabad, India21h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Cloud Computing | Data Modeling | GitEducation budget | Local compliance support | Periodic team meetups | Professional development budget | Remote workSenior-level Full TimeCoimbatore South, India21h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KCI/CD | Docker | GitHub | Java | KubernetesEducation budget | Local team meetups | Professional development support | Remote work | Wellness supportSenior-level Full TimeGurgaon Kty., India21h ago
-
Lead Consultant - Level 2 Storage & Backup Engineer INR 2500K-4144KAWS | Automation | Azure | Change Management | Cyber ResilienceSenior-level Full TimeIndia-Hyderabad21h ago
-
Senior Data Engineer INR 2000K-2040KAWS | Automation | Data Warehousing | Databricks | Development Life CycleSenior-level Full TimeIN-MH-Mumbai22h ago
-
Mid-level Full TimeIN-TN-Chennai22h ago
-
Enablement Manager, Associate INR 1524K-2100KAWS | Azure | CI/CD | Cloud platform | Computer VisionInclusive work environment | Learning opportunities | State-of-the-art computing resourcesMid-level Full TimeHyderabad, Telangana, India22h ago
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India22h ago
-
Software Engineer III INR 2486K-3000KAI Gateways | Alerting | Amazon Elastic Container Service | Automated rollback | CI/CDSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Mid-level Full TimeBangalore, Karnataka, India23h ago