Data Engineer
IND-Bangalore-Equifax-Analytics, India
INR 2000K-3000K (estimate) Mid-level Full Time
Tasks
- Build ETL/ELT pipelines
- Develop PySpark data transformations
- Implement CI/CD using Azure DevOps
- Implement data schema enforcement
- Maintain Delta Lake tables
- Model dimensional data
- Monitor pipeline health
- Optimize SQL queries
- Perform data quality checks
- Support data governance with Unity Catalog
- Transform raw data into actionable insights
- Troubleshoot production data issues
- Write unit tests for Spark logic
Perks/Benefits
- Healthcare benefits
- Hybrid work setting
- Online learning platform with guided career tracks
- Organizational growth potential
- Paid time off
Skills/Tech-stack
Apache Kafka | Asset bundles | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Monitor | Bicep | CI/CD | Data Factory | Databricks (asset) | Databricks Asset Bundles | Databricks CLI | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Event Hubs | Infrastructure as Code | Log Analytics | Power BI | PySpark | Pytest | Python | SQL | Slowly Changing Dimensions | Star Schema | Structured Streaming | Terraform | Unity Catalog | “as-code”
Education
Roles
Related jobs
-
Agentic AI architect INR 2500K-4800KAPIs | AWS | Agent Orchestration | Autogen | AzureEmployee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programsSenior-level Full TimeChennai, India7h ago
-
AI Developer (Python) INR 1800K-2500KCI/CD | Document parsing | ETL | FastAPI | Generative AIFlexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonusesMid-level Full TimeChennai, India7h ago
-
Sr. Data Engineer I INR 2400K-4000KAWS | AWS Glue | Amazon EMR | Apache Kafka | Cloud MigrationContinuous learning | International travel | Mentorship | Professional growthSenior-level Full TimeBangalore, India7h ago
-
Senior Manager – Data Scientist INR 2520K-3500KAWS | AWS SageMaker | Agent systems | Agentic AI | AzureCareer growth | Continuous learning opportunities | Mentorship | Mentorship and coachingSenior-level Full TimeIndia-Gurugram7h ago
-
Research Engineer INR 1200K-1800KData Processing | Deep learning | Distributed Computing | LLM | Language ModelsMid-level Full TimeGurugram, India7h ago
-
Senior-level Full TimeIN-AP-Hyderabad7h ago
-
Python Robot QA INR 1500K-2541KAPI Testing | Agile | Azure DevOps | Backup and Recovery | Case managementFlexible work timing | Hybrid work modelSenior-level Full TimeIN-AP-Hyderabad R7h ago
-
DBT Data Engineer INR 400K-1200KAPI Development | AWS Glue | AWS S3 | Amazon Redshift | Apache AirflowSenior-level Full TimeIN-AP-Hyderabad7h ago
-
Data Engineer INR 1500K-2000KAPI Development | AWS SQS | Amazon Aurora | Amazon Redshift | Amazon S3Senior-level Full TimeIN-AP-Hyderabad7h ago
-
Database Developer INR 1200K-2200KAWS Aurora | AWS Aurora PostgreSQL | AWS Cloud | AWS Cloud Database Services | AWS DMSSenior-level Full TimeIN-KA-Bangalore7h ago
-
Staff Engineer, Test Development Engineering (Embedded Firmware Development Engineer) INR 1236K-2156KARM Microcontroller | C# | DMA | GDB | GitSenior-level Full TimeBengaluru, KA, India8h ago
-
AI Engineer INR 300K-300KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicInternal demos | Internal training sessionsEntry-level Full TimePune, Maharashtra, India8h ago
-
Partner Engineer, Generative AI INR 2500K-4500KAWS | Azure | Bias Mitigation | C++ | Conversational AISenior-level Full TimeBangalore, India | Mumbai, India9h ago
-
Tools and Automation Engineer INR 1000K-1400KAIOps | Active Directory | Ansible | Automation Anywhere | CopilotMid-level Full TimeAhmedabad, Gujarat, India9h ago
-
Senior-level Full TimeGurgaon, Haryana, India10h ago
-
Consultant-B2 INR 1500K-2000KAI Search | Agentic architecture | Assistants API | Autogen | Azure AIMid-level Full TimeGurugram, Haryana, India10h ago
-
Senior-level Full TimeHyderabad, India10h ago
-
Senior-level Full TimeMumbai, Maharashtra, India10h ago
-
Python , web scrapping data conversion VBA INR 1500K-2156KAPI | Alerting | BeautifulSoup | Data Automation | Data EngineeringHybrid working | UK time zoneSenior-level Full TimeGurgaon, HR, India10h ago
-
Deputy Manager-Data Engineering INR 1500K-2000KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeGurgaon, HR, India11h ago
-
AI/ML Engineer INR 2500K-3000KAWS | Anomaly Detection | Automated retraining | Azure | ChromaCollaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented cultureMid-level Full TimeGujarat, Surat, India11h ago
-
Principal Engineer, Data Analytics Engineering 9+ years (Data Engineering , GenAI , Python , SQL) INR 2500K-5000KAWS | Airflow | Amazon Bedrock | Anthropic API | CI/CDSenior-level Full TimeBengaluru, KA, India11h ago
-
GCP Cloud Engineer INR 2500K-4500KAI Pipelines | BigQuery | Blue-Green Deployment | Blue/green | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India12h ago
-
Associate Process Manager INR 2000K-2500KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systemsMid-level Full TimePune, Maharashtra, India12h ago
-
Mid-level Full TimeBengaluru, IN, 56010312h ago