Data Engineer
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build CI/CD pipelines
- Build batch and streaming ingestion
- Create reusable components with Git
- Design ETL/ELT pipelines
- Develop PySpark and SQL jobs
- Document runbooks and support incidents
- Enforce data quality checks
- Implement Delta Lake best practices
- Implement data governance and security
- Model dimensional star schemas
- Monitor pipelines and alerts
- Perform root cause analysis
- Publish curated datasets for analytics and ML
- Transform data with Databricks
- Tune job performance
Perks/Benefits
Skills/Tech-stack
Access Control | Asset bundles | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Key Vault | Azure Synapse | Azure Synapse Analytics | Azure Synapse CDC | CDC | CI/CD | Caching | Data Drift | Data Drift Detection | Data Factory | Data Lake Storage Gen2 | Data Quality | Data quality monitoring | Databricks (asset) | Databricks Asset Bundles | Databricks Unity | Databricks Unity Catalog | Debezium | Delta Lake | Delta Lake ACID | Dimensional Modeling | Drift Detection | Encryption | Event Hubs | Git | GitHub Actions | Great Expectations | Jenkins | Join optimization | Kafka | Key Vault | MLflow | Medallion Architecture | Merge Upsert | Microsoft Purview | Observability | PII handling | Partitioning | Power BI | PySpark | Python | Quality monitoring | Role-Based Access | Role-Based Access Control | SQL | SQL Server | Schema evolution | Snowflake | Star Schema | Synapse Analytics | Time Travel | Unity Catalog | Z-Order
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Custom Software Engineer INR 1400K-1848KAirflow | CI/CD | Cause analysis | Change Management | Control-MRotational shifts | Stakeholder communicationMid-level Full TimeBengaluru, BDC7A, India3h ago
-
Senior-level Full TimeHyderabad, India13h ago
-
Senior-level Full TimeIN-KA-Bangalore14h ago
-
Senior Consultant INR 1900K-2600KAWS Lambda | Agile | Alerting | Amazon Web Services | Apache SparkGlobal team collaborationSenior-level Full TimeIN-KA-Bangalore14h ago
-
AI Engineer (Manager level) INR 1200K-1800KAI Search | Agile | Apache Spark | Azure AI | Azure AI SearchMid-level Full TimeHyderabad, India15h ago
-
ML Engineer (Data) INR 1500K-2000KAmazon SageMaker | Apache Spark | BERT | CI/CD | CachingCoaching | Hybrid work | Learning opportunities | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru15h ago
-
Software Engineering INR 1500K-2000KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeMicrosoft cloud background check | On-call rotationMid-level Full TimeBengaluru, KA, IN16h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 2000K-4000KAWS | Agile | Application Resiliency | Azure | CI/CDSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior Azure Data Engineer INR 2250K-3000KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure SynapseSenior-level Full TimeThane, Maharashtra, India16h ago
-
AWS | Access Control | Alerting | Audit Logging | AzureSenior-level Full TimePune, MH, India17h ago
-
Security Engineer II - Java, AWS, AI/ML Security INR 1400K-2000KAI red teaming | API Security | AWS | Access Management | AzureContinuous learning cultureMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Data Scientist- Air Quality INR 1400K-1800KAccess Control | Airflow | Ansible | Azure | CI/CDHealth safety wellbeing support | Hybrid work model | Mentoring and team collaboration | Professional development supportMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior-level Full TimeIndia20h ago
-
Senior Storage Engineer INR 2000K-4000KAIX | AIX SDDPCM | Access Management | At Rest Encryption | AutosysFlexible working hours | Growth pathway | On site collaboration with global teams | On-call rotationSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India20h ago
-
Python Pyspark with GCP INR 2400K-4000KCloud platform | Google Cloud | Google Cloud Platform | PySpark | PythonEntry-level Full TimeBangalore, Karnataka, India20h ago
-
Remote Senior Data Engineer (ETL Data Modeling) INR 2040K-3500KAPIs | AWS EMR | AWS Glue | AWS Lake Formation | Amazon RedshiftDynamic working environment | Flexible schedule | Flexible working hours | International work environment | Low hierarchySenior-level Full TimeKarnataka, Bengaluru, India R20h ago
-
Senior-level Full TimePune, Maharashtra, India20h ago
-
Software Engineer III - Data Engineer INR 2000K-3500KAWS | Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India20h ago
-
Senior Data Engineer INR 2400K-3380KAzure | Azure Data | Azure Data Engineering | Azure Fabric | Cloud servicesSenior-level Full TimeGurgaon20h ago
-
Senior-level Full TimeIndia21h ago
-
Data Engineer - Global Research Modernization INR 1050K-1600KBeautifulSoup | Data Engineering | Data Governance | Data Quality | Data ValidationMid-level Full TimeMumbai, Maharashtra, India21h ago
-
AI/ML Engineer INR 2500K-4000KAI Foundry | AI Search | AWS Bedrock | App Service | Automated retrainingSenior-level Full Timetelengana, India21h ago
-
Artificial Intelligence | Data Governance | Data Quality | Data Science | LLMMid-level Full TimeMumbai, Maharashtra, India21h ago
-
DE&A - Core - Data Engineering - Informatica INR 3000K-4000KBI Publisher | Business Suite | Cause analysis | Data Engineering | Data PipelinesSenior-level Full TimeIndia22h ago