Data Engineer
Gurugram, Haryana, India
INR 1400K-2000K (estimate) Mid-level Full Time
Tasks
- Build CI CD pipelines for data workloads
- Build ETL/ELT pipelines
- Create dimensional and star schema models
- Design end-to-end data solutions
- Develop and maintain PySpark jobs
- Implement data governance and lineage
- Implement fine grained access control
- Optimize SQL queries
- Set up monitoring and alerting for data quality
- Transition legacy warehouses to lakehouse
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Key Vault | Azure Unity | Azure Unity Catalog | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Quality | Data Vault | Data quality monitoring | Databricks | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Key Vault | Lakehouse | PySpark | Python | Quality monitoring | SQL | Star Schema | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Sr. Digital Solution Engineer - Data & Analytics INR 2520K-3380KAzure | Azure Data | Azure Data Factory | Azure SQL | Azure SynapseSenior-level Full TimeBengaluru, KA, IN; Mumbai, MH, IN6h ago
-
Mid-level Full TimeGurugram, Haryana, India8h ago
-
Sr. Software Engineer (AI/ML) (PhD / Postdoc) INR 1500K-2400KCausal Inference | Deep learning | Generative AI | Language Processing | Machine LearningAccess to large clinical dataset | Collaboration with healthcare partners | Conference publication support | Research freedomSenior-level Full TimeHyderabad, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
AI | AWS | Agile | Ansible | AutosysSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Business Intelligence Engineer, Last Mile Analytics INR 1800K-2400KAmazon QuickSight | Data Analysis | Data Interpretation | Data Visualization | NoSQLMid-level Full TimeHyderabad, Telangana, IND14h ago
-
IT Data Engineer II INT INR 1800K-2500KApache Spark | Cloud Cost Optimization | Cloud platform | Cost Optimization | Data GovernanceMid-level Full TimeBangalore, India14h ago
-
Data Engineer - VOIS INR 2000K-2040KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerCollaborative environment | Flexible inclusive workplace | Learning opportunitiesMid-level Full TimePune, IN14h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon S3 | Amazon Web ServicesEqual opportunity employer | Fast track growth opportunities | Great place to workSenior-level Full TimeHyderabad, Office Level 3 & 4, …14h ago
-
TTT-SAP-Python Gen AI-Tax Senior INR 2000K-4512KAI Core | AI Launchpad | API Management | CI/CD | Cloud ALMSenior-level Full TimeBengaluru, KA, IN, 56001614h ago
-
Entry-level Full TimeBangalore, India14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Deputy Manager, Global Platform Technology INR 1500K-2000KAgile | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimeChennai IMPT, India14h ago
-
Senior-level Full TimeIndia - Chennai14h ago
-
Data engineer (Azure Databricks) INR 1500K-2500KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeChennai, Tamil Nadu, India14h ago
-
Data Engineer INR 3000K-4000KAgile | Azure | Azure IAM | Azure Networking | Azure StorageBe Well programs | Certification support | Coaching | Continuous feedback | Hybrid workMid-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India14h ago
-
Data Engineering Lead - MSC INR 2520K-3380KAbinitio | Airflow | Azure Data | Azure Data Factory | Azure Data LakeRelocation supportSenior-level Full TimeBusiness Office (Joy House 2) - …14h ago
-
Associate Data Engineer INR 1500K-2000KAWS | CCPA | Data Architecture | Data Governance | Data ModelingMid-level Full TimeIndia - Hyderabad14h ago
-
Senior AI/ML Engineer INR 2500K-5000KAI Document Intelligence | AI Services | API Design | Agent Orchestration | Agent systemsSenior-level Full TimeBangalore - RGA Tech Park, India14h ago
-
Software Engineering LMTS- ML Engineer INR 2500K-4500KEmbeddings | Fine Tuning | LLM | Machine Learning | Machine Learning PipelinesSenior-level Full TimeIndia - Bangalore14h ago
-
Senior SQL Developer + SSIS + POWER BI INR 3000K-4000KAgile Scrum | BI Desktop | Composite Models | DAX | Data ModelingSenior-level Full TimeMumbai, India14h ago
-
Associate Database Reliability Engineer INR 1200K-2500KBash | CentOS | Cloud infrastructure | DNS | DRSMid-level Full TimePune, India14h ago
-
Software Development Engineer 1 INR 2200K-4200KAI Agents | AWS | Azure | CI/CD | DockerContinuous learning | Flexible experimentation | Innovation culture | Mentorship | Open collaborationNone Full TimeAPAC - India - Bengaluru - …14h ago
-
Software Development Engineer 4 INR 2500K-4500KAWS EMR | Airflow | Apache Spark | Data Ingestion | Data LakeSenior-level Full TimeNoida, India R14h ago
-
Entry-level Full TimeBangalore, India14h ago