Data Engineer
Chennai, IN, 600032
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build Lakehouse and warehouse solutions in Microsoft Fabric
- Build batch and real-time data pipelines
- Collaborate with architects BI developers and stakeholders to translate requirements
- Design data models for analytics platforms
- Design data platforms using Microsoft Fabric and Databricks
- Develop Lakehouse data models using Delta tables
- Develop and maintain ETL/ELT pipelines
- Develop data integration frameworks for enterprise sources
- Ensure data security, governance, and compliance
- Implement Databricks workflows and job orchestration
- Implement Power BI semantic models and datasets in Fabric
- Implement data ingestion from structured semi structured and streaming sources
- Implement data validation, lineage, and monitoring
- Implement dimensional models using star and snowflake schemas
- Manage Delta Lake architecture
- Optimize Spark workloads for performance and scalability
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CI/CD | Compliance | Data Governance | Data Lake | Data Lake Storage | Data Lineage | Data Monitoring | Data Processing | Data Security | Data Validation | Data Warehouse | Data Warehouse Design | Delta Lake | Dimensional Modeling | Distributed data | Distributed data processing | ELT | ETL | Git | Lakehouse | Microsoft Fabric | Power BI | PySpark | SQL | Snowflake Schema | Spark SQL | Star Schema | Warehouse design
Education
N/A
Roles
Related jobs
-
Sr. Data Engineer INR 2700K-3900KAWS Lambda | AWS S3 | AWS SageMaker | AWS Step Functions | AlertingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Flexible benefits | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600764h ago
-
Staff Data and AI Engineer, Finance INR 2500K-3900KAnomaly Detection | Apache Spark | Business Intelligence | CI/CD | DashboardsSenior-level Full TimeBengaluru, India4h ago
-
Senior Data and AI Engineer - Finance INR 2000K-3584KAnomaly Detection | Apache Spark | CI/CD | Dashboards | Data ModelingSenior-level Full TimeBengaluru, India4h ago
-
Lead Consultant_Python MachineLearning INR 1500K-2500KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureHybrid workSenior-level Full TimeBangalore, IN, 5600665h ago
-
Manager_Python Engineer L4 Expert INR 1500K-3500KAWS Glue | AWS Lambda | Agile | Amazon S3 | Apache AirflowSenior-level Full TimeThane, IN, 4006045h ago
-
Senior Consultant_ETL QA INR 1500K-2500KAgile | Case design | Data Governance | Data Migration | Data Migration TestingHybrid workSenior-level Full TimeThane, IN, 4006045h ago
-
AI Engineer INR 3264K-5876KAIOps | AWS | Alert Correlation | Azure | CI/CDAgile working opportunities | Birthday off | Flexible working hours | Flexible working optionsMid-level Full TimeGurgaon5h ago
-
Sr Software Engineer ( Python, AWS, AI) INR 2000K-3000KAI Agents | AWS Lambda | Agile | Amazon Web Services | CI/CDCross-functional team projects | Learning opportunities | Training coursesSenior-level Full TimeMumbai, India6h ago
-
APIs | AWS | Algorithms | Azure | CI/CDSenior-level Full TimeKolkata DN 57, India10h ago
-
MDG Data Engineer (SAP Master Data Governance) INR 1524K-2500KAsset Management | Business Partner | Business Rules | Change Request | DRFMid-level Full TimeRMZ Ecoworld 32, India12h ago
-
Associate, Data Analytics // Application Development INR 1000K-1800KAI Development | API Development | Airflow | Application Architecture | AutomationMid-level Full TimeGurgaon13h ago
-
Mid-level Full TimeGurgaon13h ago
-
Senior-level Full TimeGurgaon13h ago
-
Senior-level Full TimeHyderabad, IND-TG, India17h ago
-
Senior-level Full TimeHyderabad, IND-TG, India17h ago
-
Senior Engineer INR 2500K-3500KAPIs | CI/CD | Database migrations | Docker | FastAPIEmployee wellbeing support | Fertility assistance | Hybrid work model | Parental leaveSenior-level Full TimeGurugram17h ago
-
Data Engineer INR 1500K-2500KAgile | BeautifulSoup | Browse AI | CSV | Data PipelinesHybrid work | Paid time offMid-level Full TimeHyderabad, India18h ago
-
Senior Automation Specialist INR 1500K-3000KAPI Integration | Access Controls | Alerting | Data Quality | MonitoringSenior-level Full TimeHyderabad, India20h ago
-
Software Engineer (ETL TESTER - DATA WAREHOUSING, DATA PROCESSING, SQL, UAT, SNOWFLAKE) INR 1000K-1500KAirflow | Azure Data | Azure Data Factory | Batch Processing | Control-MEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India20h ago
-
Mid-level Full TimeIN-AP-Hyderabad21h ago
-
Data Engineering Manager INR 1500K-2500KADLS | Access Management | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBangalore, Karnataka, India22h ago
-
Computer Vision | Docker | Docker Swarm | Generative AI | JAXCareer growth | Continuous learning | Enterprise scale AI leadership | Global cross functional work environment | Professional developmentSenior-level Full TimeIndia22h ago
-
Apache Spark | Azure Data | Azure Data Services | CI/CD | ClickHouseCareer development | Collaborative engineering culture | Exposure to AI powered data platforms | Financial benefits | Fully remote work environmentSenior-level Full TimeIndia R22h ago
-
GCP Data Engineer - Associate Director INR 800K-2000KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CDMid-level Full TimeHyderabad, Telangana, India22h ago
-
AI Engineer INR 1500K-3000KAzure Databricks | Data Engineering | Data engineering pipelines | Embeddings | Engineering PipelinesMid-level Full TimeBengaluru, Karnataka, India23h ago