Data Engineer (Python & SQL)
IND-Pune-Equifax Analytics-PEC, India
INR 2000K-2400K (estimate) Mid-level Full Time
Tasks
- Build fault-tolerant data pipelines
- Create data quality checks
- Create technical documentation
- Design data ingestion platform
- Design large complex datasets
- Develop batch and real time analytics pipelines
- Develop unit tests and deployment scripts
- Gather data from multiple sources
- Implement data management security and reporting improvements
- Integrate consolidate cleanse and structure data
- Maintain CI/CD workflows
- Mentor and guide junior data engineers
- Review dataset implementations
- Troubleshoot data anomalies
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Beam | Apache Spark | Batch Processing | BigQuery | CI/CD | Cloud Composer | Cloud Native | Cloud platform | Data Modeling | Data Quality | Data Warehousing | Distributed Systems | ELT | ETL | GCP Dataflow | GCP Dataproc | Git | Google Cloud | Google Cloud Platform | Java | Pub/Sub | Python | Real Time | Real-time Processing | SQL | Time processing
Education
Roles
Related jobs
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Platforms | Data Modeling | Data Warehouse | Data WarehousingMid-level Full TimeHyderabad, HDC4A, India7h ago
-
Data Engineer INR 1500K-2000KData Modeling | Data Pipelines | Data Warehousing | ETL | Schema DesignMid-level Full TimeHyderabad, HDC4A, India7h ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeBengaluru, BDC11A, India7h ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Data Compliance | Data Modeling | Data PipelinesMid-level Full TimeBengaluru, BDC11A, India7h ago
-
Mid-level Full TimeBengaluru, BDC11A, India7h ago
-
Software Engineer INR 1068K-1910KAgile | Angular | Azure | CI/CD | DatabricksCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningMid-level Full TimePune, MH, India12h ago
-
Software Engineer II, Data Engineer INR 2520K-3380KAWS | Algorithms | Apache Airflow | Apache Spark | AzureSenior-level Full TimeBangalore, India14h ago
-
Software Engineer II, Data Engineer INR 2520K-3380KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformSenior-level Full TimeBangalore, India14h ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R17h ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R17h ago
-
Data Engineer INR 1500K-2000KAWS Lambda | Amazon Redshift | Amazon S3 | Azure Data | Azure Data FactoryMid-level Full TimeAhmedabad, 380015, India17h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R17h ago
-
Senior-level Full Timehosur road bangalore, India18h ago
-
QA Engineer INR 240K-360KDBT | Data Quality | Data Warehousing | Dimensional Modeling | ETLOff hour support on rotation basisEntry-level Full TimePune City, India18h ago
-
ADO.NET | Access Control | Audit Logging | Azure | CI/CDCareer growth opportunities | Collaborative non hierarchical culture | Flexible work environment | International impact projects | Mentorship opportunitiesSenior-level Full TimeIndia18h ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-5000KComputer Vision | Deep learning | FP16 | GPU Acceleration | Human pose estimationSenior-level Full TimeMaharashtra, Pune, India18h ago
-
Azure Databricks INR 1500K-2000KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeIN-AP-Hyderabad18h ago
-
Senior-level Full TimeIN-TN-Chennai18h ago
-
Mid-level Full TimeIN-KA-Bangalore18h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAI | AWS | Airflow | Apache Spark | BazelCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …19h ago
-
Mid-level Full TimeBangalore - Karnataka, India - Kalyani …19h ago
-
Senior Analytics Engineer INR 3000K-4000KAirflow | Auditability | Compliance | DBT | Data GovernanceCasual leave | Employee referral bonuses | Employee resource groups | Group medical coverage | Life insuranceSenior-level Full TimeHyderabad R19h ago
-
Business glossary | Data Catalog | Data Contracts | Data Lineage | Data ModelingAsync first | Flexible overlap hours | RemoteSenior-level Full TimePune, Maharashtra, India20h ago
-
Senior Data Engineer INR 3000K-4000KADLS Gen2 | Audit Logging | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune, Maharashtra, India20h ago
-
Senior Data Engineer INR 2516K-3356KAirflow | Amazon Athena | Apache Hive | Artificial Intelligence | BigQuerySenior-level Full TimeBengaluru, Karnataka, India20h ago