Associate Consultant - Data Engineer(Python/Pyspark)
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build medallion architecture data lake layers
- Collaborate with cross-functional teams
- Conduct code reviews
- Design scalable data pipelines
- Develop ETL/ELT pipelines
- Develop modern data architectures
- Ensure data quality consistency reliability
- Implement data ingestion transformation integration
- Integrate data for reporting and analytics
- Participate in SDLC requirement gathering development testing deployment
- Stay current with data engineering best practices
- Troubleshoot debug data pipeline issues
- Write optimized data processing code
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage | Databricks | Delta Lake | Distributed Computing | ELT | ETL | Git | Medallion Architecture | Microsoft Fabric | OneLake | Power BI | PySpark | Python | SQL | Spark | Synapse Analytics
Education
Related jobs
-
Consultant - Python Developer with Gen AI using GCP INR 2000K-5000KAPI Development | Cloud platform | Gemini Enterprise | Google ADK | Google CloudClient site work 5 days per weekSenior-level Full TimeBangalore, Karnataka, India5h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India5h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India5h ago
-
Assistant Manager - RNA INR 1500K-2525KAWS | AgentFlow | Asynchronous programming | Autogen | AzureMid-level Full TimeBangalore, KA, India6h ago
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R7h ago
-
Senior-level Full TimeIndia7h ago
-
Senior-level Full TimeBangalore, KA, IN,8h ago
-
Mid-level Full TimeTelangana, India8h ago
-
Senior-level Full TimeIndia9h ago
-
Mid-level Full TimeBengaluru, KA, India9h ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R14h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Azure | Cloud platformFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAzure | Data masking | Python | RBAC | Row Level SecurityFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAccess Control | Airflow | Amazon Web Services | Cloud platform | DBTEqual employment opportunity | Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Cloud platform | DBTFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Azure | Cloud platformFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Cloud platform | DBTFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Apache Airflow | Azure | Cloud platform | DBTFlexibility programmes | Inclusive benefits | Mentorship | Support for wellbeingSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Azure | Cloud platformFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Airflow | Azure | Cloud platform | DBTFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing support | Work-life balance supportSenior-level Full TimeBengaluru Millenia, India15h ago
-
Software Engineer (Data Engineering & Building APIs) INR 700K-1500KAWS | Algorithms | CI/CD | Data Structures | DevOpsHybrid work flexibilityMid-level Full TimeGurgaon - Cyber Park, India17h ago
-
Senior AI & Automation Manager INR 3000K-5000KAI Agent | AI Agent Development | API | Agent Development | AutomationSenior-level Full TimeBangalore17h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India18h ago
-
AWS Infra and DevOps Consultant INR 2200K-3500KAPI Gateway | AWS Audit Manager | AWS Backup | AWS CDK | AWS CodePipelineSenior-level Full Timebangalore, India18h ago
-
Senior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India22h ago