Senior Data Engineer
IN Hyderabad, India
INR 3100K-3380K (estimate) Senior-level Full Time
Tasks
- Build and maintain dbt projects
- Collaborate with data science and product leadership
- Design and implement scalable PySpark transformation pipelines
- Develop and optimize PySpark and Databricks SQL pipelines
- Implement data quality frameworks
- Lead enterprise data platform architecture on Databricks
- Optimize data pipeline performance and refactor legacy workflows
- Translate business priorities into scalable data infrastructure
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | BusinessObjects | Cluster optimization | DBT | Data Modeling | Data Quality | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Great Expectations | HL7 FHIR | HL7v2 | Looker | Partition Optimization | Performance Tuning | Power BI | PySpark | Query Performance Tuning | Query performance | SQL | Scrum | Series analysis | Spark cluster optimization | Tableau | Test-Driven | Test-Driven Development | Time Series | Time Series Analysis | Unity Catalog | Window Functions | Z-Order
Education
Roles
Related jobs
-
Convolutional Neural Networks | Deep learning | Generative AI | Google Gemini | LLM PromptsFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India-1d ago
-
API | Amazon Web Services | Apache Airflow | Apache Hadoop | Azure DataFlexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India-1d ago
-
Apache Airflow | Apache Hadoop | Apache Spark | App Service | Azure AppFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata DN 57, India-1d ago
-
Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataSenior-level Full TimeKolkata DN 57, India-1d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | App ServiceSenior-level Full TimeKolkata DN 57, India-1d ago
-
IN_Manager_Data Analyst_Data and Analytics_Advisory_Bangalore INR 1500K-2000KApache Airflow | Apache Flink | Azure | Azure DevOps | CI/CDMid-level Full TimeBengaluru Millenia, India-1d ago
-
API Integration | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India-1d ago
-
Amazon Web Services | Apache Airflow | Apache Databricks | Apache Hadoop | Apache SparkSenior-level Full TimeKolkata DN 57, India-1d ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India-1d ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive workplace culture | MentorshipSenior-level Full TimeBengaluru Millenia, India-1d ago
-
Ab Initio | BigQuery | Cloud Composer | Cloud Storage | Cloud platformFlexible work programs | Inclusive workplace culture | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India-1d ago
-
Ab Initio | Apache Airflow | BigQuery | Cloud Storage | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India-1d ago
-
Ab Initio | Apache Dataflow | BigQuery | Cloud Composer | Cloud StorageCompetitive compensation | Flexibility programmes | Hybrid work environment | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India-1d ago
-
BI Developer - Snowflake & Salesforce Data INR 2000K-2500KAlerting | DBT | Data Quality | Data Validation | Data WarehousingChallenging projects | Great work-life balance | Professional developmentMid-level Full TimePune, MH, IN7h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India8h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRAI certifications | Ethical AI focus | Mentorship | World-class trainingSenior-level Full TimeIndia-Hyderabad9h ago
-
Manager, Tableau Developer INR 1400K-2000KAWS | Azure | CRM | Data Lakes | Data ModelingAI certifications | Mentorship | World-class trainingMid-level Full TimeIndia-Bangalore9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
ETL Test Engineer INR 1200K-1500KAgile | Amazon Redshift | Data Integrity | Data Transformation | Data ValidationMid-level Full TimeIN-TN-Chennai9h ago
-
Mid-level Full TimePune, Maharashtra, India11h ago
-
Senior-level Full TimeBangalore, Karnataka, India12h ago
-
Senior-level Full TimeBangalore, Karnataka, India12h ago
-
Mid-level Full TimeGurugram, Haryana, India12h ago