Data Engineering Developer - Assistant Manager
Tasks
- Apply coding testing and CI CD best practices
- Build ingestion transformation and validation frameworks
- Design scalable data pipelines
- Develop ETL and ELT frameworks
- Develop and optimize Spark jobs
- Implement data architecture and integration solutions
- Manage Databricks workflows and scheduling
- Optimize cluster utilization and Spark execution plans
- Support production environments and incident resolution
- Troubleshoot production pipeline failures
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | CI/CD | Data Factory | Data Lake Storage | Data Modeling | Data Processing | Data Quality | Data Validation | Data Warehousing | Databricks | Delta Lake | Distributed data | Distributed data processing | ELT | ETL | Git | GitHub | Kafka | Lakehouse | Microsoft Azure | Performance Tuning | PySpark | SQL | Scala | Snowflake | Spark SQL | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior-level ContractShaikpet, India11h ago
-
Senior-level Full TimeHyderabad, India12h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamCareer growth opportunities | Complimentary games | Family Leaves | Healthcare coverage | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India13h ago
-
Advanced Engineer-AI/ML INR 2500K-4680KAI orchestration | API Integration | ASR | AWS | Action modelsEmployee discounts | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …13h ago
-
CIB Business Support Management - Analytics Solutions Developer INR 2000K-3200KAlteryx | Dashboarding | Data Visualization | Python | QlikSenseSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-5000KC plus plus | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Software Engineer - Data Analytics INR 1200K-2000KAgile | Data Architecture | Data Governance | Data Modeling | Data PipelinesMid-level Full TimeHyderabad, India15h ago
-
Principal Silicon Engineer - Storage INR 1163K-3500KAmazon S3 | Azure Blob | Azure Blob Storage | Azure Files | Backup and RecoverySenior-level Full TimeIndia16h ago
-
Power BI Developer – Airtable, Snowflake & SQL INR 1000K-2000KAPI | Airtable | DAX | Data Modeling | Data WarehousingMid-level Full TimeHinjawadi, MH, India16h ago
-
Lead Software Engineer Java INR 3000K-4500KAI code assistants | AWS | Agile | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Informatica / Data warehousing Engineer INR 2700K-4000KAgile | BigQuery | Dashboard Design | Dashboard Development | Data GovernanceSenior-level Full TimeIndia16h ago
-
Informatica / Data warehousing Engineer INR 2771K-4000KAccess Controls | Agile | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeIndia16h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure | Azure Databricks | Azure DevOps | CI/CD | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India17h ago
-
Senior-level Full TimeHyderabad, Telangana, India17h ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAngular | App Service | Azure App | Azure App Service | Azure DevOpsCertification programs | Corporate pension scheme | Dental and vision coverage | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R17h ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure App | Azure App ServiceCar lease | Certification program | Corporate NPS | Education reimbursement program | Employee assistance programSenior-level Full TimeTelangana, India R17h ago
-
Java Full Stack AI Engineer- LINA GI INR 2200K-3200KAPI Security | Angular | App Service | Azure | Azure AppCertification programs | Corporate NPS | Dental insurance | Education reimbursement | Employee assistance programSenior-level Full TimeTelangana, India R17h ago
-
Senior-level Full TimeHyderabad, TS, India17h ago
-
Junior AI Specialist INR 336K-480KAWS | Airflow | Azure | DBT | Data AnalysisCertification programs | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities , India R17h ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAsynchronous programming | Authentication | Authorization | CI/CD | CachingContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R18h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India18h ago
-
SO_Cloud_Devops_Engineer_SME_2026 INR 400K-500KAzure Data | Azure Data Factory | CI/CD | Command Line | Command-line scriptingEntry-level Full Timepune, India19h ago
-
Analyst, Business Intelligence INR 3000K-5000KAWS | Azure | Azure OpenAI | CI/CD | Distributed SystemsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India19h ago
-
Data Transformation and Management Specialist INR 1500K-3000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India20h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeEntrepreneurial team | Fast-growing environment | Flexible asynchronous culture | Remote/distributed workMid-level Full TimeBangalore, India20h ago