Associate Manager Data Analyst - Data Bricks
Primary location: Hyderabad, India
INR 1300K-2000K (estimate) Mid-level Full Time
Tasks
- Automate workflows with shell scripting
- Build and schedule ETL pipelines
- Build dashboards and data visualizations
- Collect, interpret, and aggregate data
- Create and document design and operating procedures
- Design analytics data models
- Design data analytics programs
- Develop Data Analytics processes
- Develop ETL/ELT pipelines
- Develop batch and incremental processing pipelines
- Handle dependency management and alerting
- Implement data transformations
- Implement logging, auditing, and monitoring
- Integrate pipelines with Snowflake
- Manage datasets governance and access controls
- Mentor junior data engineers
- Migrate SAS pipelines to Spark and Databricks
- Monitor and troubleshoot production pipelines
- Optimize data lake storage
- Optimize spark performance
- Perform root cause analysis
- Query, analyze, and interpret data
- Support CI/CD deployment processes
Perks/Benefits
- N/A
Skills/Tech-stack
ADF | AWS S3 | Apache Airflow | Apache Iceberg | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Data Lake Storage | Databricks | Databricks Notebooks | Databricks Workflows | Dataframe API | Delta Lake | Delta Sharing | Git | PySpark | Python | Relational databases | SAS | SQL | Shell Scripting | Snowflake | Spark DataFrame | Spark DataFrame API | Spark SQL | Unity Catalog | Unix/Linux
Roles
Analyst | Data Analyst | Data Engineer | Data Platform | Data Platform Engineer | Engineer | Platform Engineer
Related jobs
-
Planview Administration 169576 INR 1500K-2700KData Cleansing | Data Modeling | Data Validation | Data pipeline | Data pipeline orchestrationSenior-level Full TimeHyderabad, IND-TG, India4h ago
-
Mid-level Full TimeHyderabad, IND-TG, India5h ago
-
Senior Agentic AI Engineer ID80140 INR 2000K-5000KAnthropic API | CI/CD | Infrastructure as Code | Langchain | LanggraphFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBengaluru, India9h ago
-
Lead AI Engineer ID80141 INR 2500K-5000KAWS S3 | Amazon Web Services | Azure | CI/CD | Cloud SecurityAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeBengaluru, India9h ago
-
Senior-level Full TimeBangalore - Karnataka - India Chennai …9h ago
-
Mid-level Full TimeBangalore - Karnataka - India9h ago
-
Senior Marketing Data Analyst INR 2520K-3880KA/B | A/B Testing | AWS | Adobe Campaign | Attribution ModelingCareer growth | Certification support | Flexible collaboration opportunities | Mentorship | Recognition and rewardsSenior-level Full TimeHyderabad, TS, India10h ago
-
Staff Data Engineer INR 1500K-2500KAPIs | AWS | Agentic Workflows | Automated testing | Cloud PlatformsSenior-level Full TimeHyderabad, Telangana , India R11h ago
-
Data Engineer, YouTube Business Organization INR 1000K-2000KApache Flume | Apache Spark | Data Governance | Data Lakes | Data ModelingMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Software Engineer, Generative AI, Gaming INR 2500K-5000K3D mathematics | C++ | Computer Graphics | Computer Vision | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Sr Advanced Data Engineer INR 1500K-3000KAWS | Apache Spark | Azure | Data Cleansing | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAWS | Agile | Azure | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal events | Language courses | Legal consultationsSenior-level Full TimeIndia11h ago
-
AI Senior Software Engineer INR 2000K-4500KAI Foundry | AI Search | AI gateway | AWS Bedrock | AngularSenior-level Full TimeBengaluru, India12h ago
-
Software Engineer II - Python INR 1500K-2500KAWS | Automated testing | Cloud | Code Refactoring | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Apache Spark | CI/CD | DBTBike to work | Career mentorship | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeMumbai, MH, India R12h ago
-
Data Engineer 2 INR 1500K-2500KAgile Development | Cassandra | Cloud Computing | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India12h ago
-
Data Engineer Manager - AWS Databricks INR 1500K-2600KAWS | Apache Spark | Automation | CI/CD | Data GovernanceSenior-level Full TimeHyderabad, TS, India13h ago
-
Data Engineer INR 3000K-4000KAmazon S3 | Databricks | ELT | ETL | PythonBike to work | Educational assistance | Employee assistance program | Employee discount | Enhanced parental leaveSenior-level Full TimeBengaluru, KA, India R13h ago
-
Senior Software Engineer INR 1163K-3000KAutomated testing | Batch Processing | CI/CD | DAX | Data GovernanceFlexible work arrangement | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R14h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India14h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | Airflow | Apache Iceberg | AzureSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Sr Lead Software Engineer - Java/Python, Data Engineering INR 2500K-4300KAPI Design | AWS | Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Assistant Director,Data and Analytics INR 2337K-5199KAnomaly Detection | BigQuery | Cloud Computing | Data Visualization | Fraud analyticsExecutive-level Full TimeBangalore, Karnataka, India R15h ago