Data Engineer (Python & SQL)
IND-Pune-Equifax Analytics-PEC, India
INR 2000K-2040K (estimate) Mid-level Full Time
Tasks
- Build data pipelines
- Contribute to unfamiliar code
- Create technical documentation
- Deploy code to development environment
- Design data ingestion platform
- Develop data quality checks
- Develop data quality models
- Implement security best practices
- Integrate consolidate cleanse and structure data
- Maintain data pipeline infrastructure
- Perform unit testing
- Process real time and batch analytics
- Provide guidance and mentorship to junior engineers
- Review dataset implementations
- Troubleshoot data anomalies
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Beam | Apache Spark | BigQuery | CI/CD | Cloud Composer | Cloud Native | Cloud platform | Data Modeling | Data Quality | Data Security | Data Warehousing | Dataflow | Dataproc | Distributed Systems | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Java | PubSub | Python | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Data Engineer (Databricks) (Remote) INR 1500K-2040KAI | API Keys | AWS Glue | AWS IAM | AWS LambdaCollaboration | Ownership culture | Remote workSenior-level Full TimeMaharashtra, Pune, India R8h ago
-
AI / ML Engineer (Remote) INR 2500K-4500KAWS | Amazon SageMaker | CI/CD | Computer Vision | Data PreprocessingRemote workSenior-level Full TimeMaharashtra, Pune, India R8h ago
-
Fullstack Data Engineer (India) INR 1500K-2300KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Remote work | UK shift hoursSenior-level Full TimeMaharashtra, Pune, India9h ago
-
Principal Consultant, Cloud Data Engineer INR 2800K-4000KApache Spark | Azure | Big Data | CI/CD | Data ModelingAI certifications | Mentorship | World-class trainingSenior-level Full TimeIndia-Bangalore9h ago
-
Data Engineer INR 1500K-2000KAgentic AI | Cloud Computing | Cost Optimization | Data Architecture | Data PipelinesMid-level Full TimeIN-MH-Pune9h ago
-
Big Data -Snowflake INR 1200K-2000KBig Data | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago
-
Machine Learning Design Engineer, Silicon INR 3400K-5000KASIC design | Area Optimization | Assertion-based Formal Verification | CHISEL | CacheSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Staff Software Engineer, Cloud Bigtable INR 1800K-3200KBigtable | C++ | Cassandra | Cloud deployment | Cloud infrastructureSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior-level Full TimePune, India11h ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN12h ago
-
Associate - Data Scientist INR 1800K-2500KAWS | Agent systems | Apache Spark | Azure | Cloud platformMid-level Full TimeNoida, Uttar Pradesh, India12h ago
-
Senior Data Engineer INR 2800K-3500KAPI Development | AWS | Algorithms | Amazon Kinesis | Amazon RedshiftCharity programs | Discounted gym memberships | Environmental initiatives | Flexible working | Life assuranceSenior-level Full TimeHyderabad, India13h ago
-
Lead Assistant Manager INR 1500K-2000KAWS | Apache Airflow | Azure | Data Governance | Data LakehouseSenior-level Full TimeIndia13h ago
-
Assistant Manager INR 800K-1500KApache Airflow | Data Modeling | Data Processing | Databricks | Distributed dataTraining and developmentSenior-level Full TimeIndia13h ago
-
MET scientist INR 2000K-4000KAPIs | AWS | Artificial Intelligence | Azure | CI/CDBonus system | Canteen | Family-friendly initiatives | Fitness room | Learning and trainingEntry-level Full TimePune, MAHĀRĀSHTRA, India13h ago
-
Data Engineer INR 1500K-2345KAWS | Amazon Kinesis | Amazon Redshift | Azure | BashDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeMid-level Full TimeHyderabad, India14h ago
-
Applied AI/ML Associate Senior - Causal ML INR 1400K-2000KA/B | A/B Testing | Apache Hive | Apache Spark | B testingMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Analytics Solution Associate INR 945K-1496KAI assisted productivity | Alteryx | Anomaly Detection | Artificial Intelligence | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India14h ago
-
Mid-level Full TimeMumbai, Maharashtra, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPI Integration | Agent Frameworks | Agile | Azure | BERTMid-level Full TimePune, Maharashtra, India15h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgentic Frameworks | Agile | Azure | BERT | DjangoMid-level Full TimeBangalore, Karnataka, India15h ago
-
Senior_AI_developer INR 3125K-4763KAPI Orchestration | CI/CD | CNN | Computer Vision | Data PreprocessingSenior-level Full Timebangalore, India15h ago