Associate Consultant - Data Engineer(Python/Pyspark)
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build medallion architecture data lake layers
- Collaborate with cross-functional teams
- Conduct code reviews
- Design scalable data pipelines
- Develop ETL/ELT pipelines
- Develop modern data architectures
- Ensure data quality consistency reliability
- Implement data ingestion transformation integration
- Integrate data for reporting and analytics
- Participate in SDLC requirement gathering development testing deployment
- Stay current with data engineering best practices
- Troubleshoot debug data pipeline issues
- Write optimized data processing code
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | Azure Synapse Analytics | Data Factory | Data Lake Storage | Databricks | Delta Lake | Distributed Computing | ELT | ETL | Git | Medallion Architecture | Microsoft Fabric | OneLake | Power BI | PySpark | Python | SQL | Spark | Synapse Analytics
Education
Related jobs
-
Applied AI/ML Senior Associate INR 3799K-5000KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Analytics Solutions Associate INR 1400K-2800KAgile | Dashboard Development | Data Modeling | Data Normalization | Data VisualizationEntry-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior AI Engineer INR 3264K-5000KAI Services | Access Management | Anomaly Detection | Azure | Azure AISenior-level Full TimeIndia6h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2000K-5000KAPI Development | Cloud platform | Gemini Enterprise | Google ADK | Google CloudClient site work 5 days per weekSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Automated testing | Business Intelligence | CI/CD | Dashboards | Data MartMid-level Full TimeHyderabad, Telangana, India6h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India6h ago
-
DataOps Engineer INR 1600K-4000KAWS | AWS Direct Connect | AWS PrivateLink | AWS Transit Gateway | AWS VPNSenior-level Full TimeMumbai, India6h ago
-
Assistant Manager - RNA INR 1500K-2525KAWS | AgentFlow | Asynchronous programming | Autogen | AzureMid-level Full TimeBangalore, KA, India7h ago
-
Lead Data Integration Engineer INR 2000K-3000KAgile Scrum | CI/CD | Data Lake | Data Modeling | Data PipelinesHealth and life insurance | Hybrid work model | Paid time off | Pension/retirement benefits | Personal/family careSenior-level Full TimeChennai, India R8h ago
-
Senior-level Full TimeIndia8h ago
-
Associate - Analytics Solutions INR 850K-1500KBusiness Intelligence | Financial Forecasting | Financial Modeling | Microsoft Excel | Microsoft PowerPointMid-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior-level Full TimeBangalore, KA, IN,9h ago
-
Mid-level Full TimeTelangana, India9h ago
-
Senior-level Full TimeIndia10h ago
-
Mid-level Full TimeBengaluru, KA, India11h ago
-
Software Engineering Expert (AI Training) USD 200K-460KAlgorithms | C++ | Code Refactoring | Data Structures | DebuggingFast onboarding | Flexible contractor schedule | Remote workMid-level Contract Full TimeIndia - Remote R15h ago
-
Lead Analytics Consultant INR 2755K-4064KCloud Data | Dashboard administration | Data Analysis | Data Lake | Data ValidationSenior-level Full Time110741-IND-BENGALURU-INTL BLR BLK 2A ASTER, India15h ago
-
Lead Analytics Consultant INR 2763K-5000KClustering | Data Integrity | Data Modeling | Data Quality | Decision TreesSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India15h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Azure | Cloud platformFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAzure | Data masking | Python | RBAC | Row Level SecurityFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAccess Control | Airflow | Amazon Web Services | Cloud platform | DBTEqual employment opportunity | Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Cloud platform | DBTFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Azure | Cloud platformFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Access Control | Apache Airflow | Cloud platform | DBTFlexible work arrangements | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Snowflake_Data Analytics_Advisory_Bangalore INR 2000K-3000KAWS | Apache Airflow | Azure | Cloud platform | DBTFlexibility programmes | Inclusive benefits | Mentorship | Support for wellbeingSenior-level Full TimeBengaluru Millenia, India16h ago