IT Data Engineer
Tasks
- Collaborate with stakeholders on analytics solutions
- Develop ETL/ELT workflows
- Follow coding standards and change management activities
- Implement and support Lakehouse and Medallion architecture
- Implement data governance practices
- Integrate Databricks with Azure services
- Monitor and troubleshoot data pipelines
- Optimize Spark jobs
- Support CI/CD automation
Perks/Benefits
- N/A
Skills/Tech-stack
.NET | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Key Vault | C# | Cluster optimization | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Quality | Delta Lake | Distributed Systems | Git | Key Vault | Lakehouse Architecture | Performance Tuning | Power BI | PySpark | SQL | Spark | Troubleshooting distributed systems | Unity Catalog | Web API
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeHyderabad, IND-TG, India5h ago
-
Senior-level Full TimePune City, India9h ago
-
Senior-level Full TimePune, Maharashtra, India10h ago
-
Data Engineer - Python AWS Databricks INR 1200K-2000KAWS | Agentic AI | Amazon Web Services | Cost Optimization | Data ArchitectureSenior-level Full TimeIN-MH-Pune10h ago
-
Senior Data Engineer INR 2000K-2400KAWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeHyderabad, Hyderabad, IN10h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | Batch Processing | C++ | Cloud platform | DNSSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India11h ago
-
Agentic Architectures | Application Management | Artificial Intelligence | Cloud Application Management | Cloud NativeSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Practice Customer Engineer, Data Analytics INR 1200K-2000KApache Spark | C++ | DMZ | DNS | Data LakeEqual opportunity work environment | Travel as requiredSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India11h ago
-
Senior-level Full Timebengaluru, India12h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure OpenAI | CSS | DjangoMid-level Full TimeBangalore, Karnataka, India12h ago
-
AWS Data Engineer- Assistant Manager INR 1200K-2000KAWS Data | AWS Data Pipeline | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeBangalore, Karnataka, India12h ago
-
GCP & Databricks Manager INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India12h ago
-
Mid-level Full TimeBangalore, IN13h ago
-
Data Engineering Professional INR 2000K-2146KAgile methodologies | Artificial Intelligence | Cloud Computing | Data Engineering | Data ManagementSenior-level Full TimeBengaluru, IN, 56010313h ago
-
Staff Engineer, Data Analytics Engineering INR 3000K-3380KAI Engineering | AWS | Azure | Azure Data | Azure Data LakeSenior-level Full TimeBengaluru, KA, India13h ago
-
Sr Data Engineering - GCP INR 1500K-2040KAccess Control | Analytics engineering | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India13h ago
-
Senior-level Full TimeHyderabad, TS, India14h ago
-
Senior Data Engineering (GCP) INR 2000K-2040KAccess Control | Anomaly Detection | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India14h ago
-
Senior Data Engineer INR 2516K-2829KAirflow | Apache Spark | Azure | Azure Data | Azure Data LakeEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India15h ago
-
Data Engineer INR 938K-1200KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India15h ago
-
Senior Specialist, Data Analyst & BI INR 2520K-3380KAgile | CD pipelines | CI/CD | CI/CD pipelines | Data ModelingPaid leave | Paid volunteer timeSenior-level Full TimePune, MH, India16h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India16h ago
-
IT Data Analytics Analyst INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | CI/CD | ClusteringMid-level Full TimePune, India17h ago
-
Data Engineer III Mainframe DB2/IMS DBA INR 2486K-4144KAtlassian Confluence | Atlassian Jira | BMC Recovery Manager | Backup and Recovery | CA Platinum24x7 rotational supportSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Software Engineer III - Data Engineer INR 1500K-2146KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India17h ago