Associate Data Scientist (Data Engineering)
Tasks
- Collaborate with BI and analytics teams
- Document data flows and runbooks
- Escalate issues with evidence
- Implement data validation checks
- Investigate pipeline failures using logs
- Monitor pipeline runs
- Perform duplication checks
- Perform null checks
- Perform schema checks
- Reconcile record counts
- Support data ingestion workflows
- Support data transformation workflows
- Support reusable governed data products
- Translate analytics requirements into technical specifications
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Batch Processing | Data Factory | Data Governance | Data Quality | Data Validation | Data profiling | Databricks | ELT | ETL | Incident Management | Logging | Monitoring | Pipeline Orchestration | PySpark | Python | SQL
Education
N/A
Roles
Related jobs
-
Associate Process Manager INR 1800K-2800KAgentic AI | Agile methodologies | Causal Inference | Cypher | Experimental DesignMid-level Full TimeMumbai, Maharashtra, India2h ago
-
Partner Engineer, Generative AI INR 2500K-3000KAI infrastructure | AWS | Azure | C plus plus | Cloud platformSenior-level Full TimeBangalore, India | Mumbai, India3h ago
-
Product Senior Data Scientist, Google Play INR 2516K-3250KA/B | A/B Testing | B testing | Classification | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Principal Consultant - Data & AI INR 2500K-3200KAI Services | Agile | Apache Kafka | Apache Spark | Artificial IntelligenceSenior-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN; …3h ago
-
Senior Data Scientist-Digital Banking Kotak 811-Regional Sales INR 2000K-2400KA/B | A/B Testing | B testing | Customer Segmentation | HadoopSenior-level Full TimeBangalore, Karnataka, India4h ago
-
IT Support Specialist 1 (Regional) INR 2000K-2000KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBengaluru, KA, IN5h ago
-
AI Senior Engineer INR 2520K-4500KAgent Orchestration | Amazon Web Services | Autogen | Azure | Cloud platformSenior-level Full TimePune, MH, IN7h ago
-
Senior-level Full TimePune, Maharashtra, India8h ago
-
Mid-level Full TimeBangalore, India; Hyderbad, India9h ago
-
Clustering | Credit Risk | Customer Segmentation | Data Visualization | Dimensionality ReductionCollaborative work culture | Growth opportunities | Professional developmentMid-level Full TimeBangalore, Karnataka, India9h ago
-
Software Engineer (6months to 2 Years of experience - JAVA/Python Backend, CICD, APIs, GEN AI, Microservices, Cloud) INR 1430K-2000KAgile | Apache Kafka | Automated testing | C++ | CI/CDContinued learning opportunities | MentorshipEntry-level Full TimeBengaluru, INDIA, India9h ago
-
Senior AI Engineer INR 2100K-3380KAuditability | Azure | CI/CD | Cloud Computing | Cloud platformCareer development | Collaborative workspaces | Flexible working arrangements | Learning platform accessSenior-level Full TimeMumbai, MH, India10h ago
-
Teamcenter AI Development Engineer INR 2500K-4225KActive Workspace | BMIDE | ITK | Machine Learning | Manufacturing ProcessSenior-level Full TimePune, MH, India10h ago
-
Lead - Data Platform Engineering INR 2156K-2400KAlerting | Bash | CPU performance | Capacity Planning | Concurrency ControlSenior-level Full TimeChennai, India11h ago
-
Data Engineer INR 1500K-1800KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkGlobal induction program | Talent development programs | Time off for digital disconnect days | Time off for volunteering | Wellbeing programsMid-level Full TimeBengaluru, KA, India12h ago
-
Convolutional Neural Networks | Deep learning | Generative AI | Google Gemini | LLM PromptsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India14h ago
-
API | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataSenior-level Full TimeKolkata DN 57, India14h ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | App ServiceSenior-level Full TimeKolkata DN 57, India14h ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure | Azure DevOps | CI/CDMid-level Full TimeBengaluru Millenia, India14h ago
-
API Integration | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
Amazon Web Services | Apache Airflow | Apache Databricks | Apache Hadoop | Apache SparkSenior-level Full TimeKolkata DN 57, India14h ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India14h ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive workplace culture | MentorshipSenior-level Full TimeBengaluru Millenia, India14h ago