Module Lead - Data Bricks Job
Tasks
- Apply security for streaming data
- Build cloud data warehouses
- Build spark pipelines
- Collaborate in agile teams
- Develop ETL pipelines
- Develop SQL queries
- Develop data orchestration with Azure Data Factory
- Implement streaming data solutions
- Integrate with Azure Event Hubs
- Lead cloud data and analytics solutions development
- Manage data in Azure Databricks using PySpark
- Mentor junior developers and testers
- Perform data wrangling
- Set up Unity Catalog governance
Perks/Benefits
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event Hubs | Big Data | Data Factory | Data Warehousing | DevOps | ETL | Event Hubs | PySpark | SQL | Spark | Streaming | Unity Catalog
Education
N/A
Related jobs
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R8h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India8h ago
-
Senior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India10h ago
-
Manager Data Integration INR 2520K-4064KApache Airflow | BigQuery | Bigtable | Celigo | Cloud ComposerSenior-level Full TimeBengaluru, KA, India12h ago
-
Python with ADB INR 1500K-2000KAPI Testing | Agile | Azure | Azure DevOps | CI/CDCareer growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balanceMid-level Full TimeHyderabad, IN16h ago
-
Senior Data Engineer INR 3200K-4200KAWS | Airflow | Apache Spark | CI/CD | Cloud ComputingCompany-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - HYDERABAD SKYVIEW, India16h ago
-
Databricks Solution Architect INR 2000K-3000KAWS | Azure | CI/CD | CloudWatch | Data GovernanceOn-site client work | Remote work flexibilitySenior-level Full TimeIndia - Remote R16h ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R16h ago
-
Software Development Senior Analyst INR 2000K-4500KAPI Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon BedrockSenior-level Full TimeChennai, TN, IN16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India16h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India16h ago
-
Amazon Web Services | Angular | Apache Airflow | Apache Hadoop | AzureSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Apache AirflowSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-2500KAWS | AWS Database | AWS Database Migration Service | AWS Glue | AWS LambdaSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India16h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksInclusive benefits | Mentorship programs | Work Life Flexibility ProgramsSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-2500KAWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsEqual opportunity workplace | Flexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_ Snowflake Senior Data Engineer_Data and Analytics_Advisory_Bangalore INR 2000K-3500KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India16h ago