Module Lead - Azure Databricks Job
Tasks
- Build and optimize ETL/ELT workflows
- Collaborate with data and application teams
- Create and maintain data models and transformations
- Design scalable data pipelines
- Develop and manage data lakes and data warehouses
- Develop reusable data orchestration and deployment frameworks
- Implement data governance, data quality, security, and compliance
- Implement data ingestion solutions
- Integrate AI and machine learning services
- Monitor and optimize data platform performance scalability and cost
- Support CI CD with Azure DevOps
- Troubleshoot data issues and provide production support
- Use Infrastructure as Code for deployments
Perks/Benefits
Skills/Tech-stack
AI Services | Agile | Apache Spark | Azure | Azure AI | Azure AI Services | Azure Cognitive | Azure Cognitive Services | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure OpenAI | Azure Synapse | Azure Synapse Analytics | CI/CD | Cognitive Services | Compliance | Data Factory | Data Governance | Data Lake | Data Quality | Data Warehouse | ELT | ETL | Infrastructure as Code | Machine Learning | Python | SQL | Security | Synapse Analytics | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
AI Data Engineer | Azure AI Data Engineer | Data Engineer | Engineer
Related jobs
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeEntrepreneurial team | Fast-growing environment | Flexible asynchronous culture | Remote/distributed workMid-level Full TimeBangalore, India3h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Flexible remote setting | Friendly laid-back atmosphere | Opportunity for high impactMid-level Full TimeDelhi, India3h ago
-
Sr Data Engineer INR 3000K-4000KAPIs | Airflow | Apache Iceberg | CI/CD | Control-MAnnual leave | Development courses | Employee assistance program | Flexible working options | Life insuranceSenior-level Full TimeBangalore, IN4h ago
-
VP of AI Engineering, HR Technology INR 3000K-5000KAPI Integration | Agentic Workflows | Anthropic Claude | Azure | Code reviewCareer development | Collaborative workspaces | Flexible working arrangements | Inclusion and Belonging Culture | Learning opportunitiesExecutive-level Full TimeBengaluru, KA, India5h ago
-
Senior-level Full TimeBangalore, India; Chennai, India6h ago
-
Mid-level Full TimeBangalore, KA, IN R9h ago
-
Senior Data Engineer INR 1500K-3000KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeFree parking | Medical insurance | Mobile and internet reimbursement | Paid leave | Sick leaveSenior-level Full TimeNoida, UP, IN, 2013019h ago
-
Technical Specialist-Data Engg INR 2000K-3900KAgent Bricks | Agentic AI | Apache Spark | Databricks | Databricks Agent BricksSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN9h ago
-
Senior Robotics Engineer (Universal Robots, India) INR 2000K-3465K3D Geometry | API Design | AWS | Azure | BulletAdditional benefits | Global team local impact | Growth and development | Health insurance | On-site collaborationSenior-level Full TimeBangalore, IN9h ago
-
Robotics Engineer (Universal Robots, India) INR 2475K-3500K3D Geometry | APIs | AWS | Agent systems | Automated testingGrowth and development | Health insurance | Local impact | No visa sponsorship | On-site collaborationSenior-level Full TimeBangalore, IN9h ago
-
AI Engineering Lead - Agentic Engineering INR 2500K-5000KAPI Design | APIs | Agent Orchestration | Agent systems | AutogenSenior-level Full TimeHyderabad, TS, India18h ago
-
Data Engineer INR 1000K-1800KAWS | Apache Spark | Data Modeling | Data Pipelines | DatabricksHealth insurance | Hybrid work | Paid time off | Transport allowance | Wellness programsMid-level Full TimeBangalore (Hybrid) R1d ago
-
Senior-level Full TimeIndia - Bengaluru; India - Pune1d ago
-
Manager – Forward Deployed Engineer, Agentic AI INR 2000K-5000KAPIs | Agent memory | Asynchronous processing | Authentication | AuthorizationSenior-level Full TimeHyderabad, TS, India1d ago
-
Manager - Senior AI/ML Engineer INR 3000K-5000KAPI Design | AWS | Agent Orchestration | Agent systems | Asynchronous Workflows401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimePune, IN R1d ago
-
Senior Associate – AI ML Engineer INR 1860K-4000KAWS | Agentic Workflows | Azure | CI/CD | Data Pipelines401k match | Dental insurance | Medical insurance | Paid time off | Vision insuranceMid-level Full TimePune, IN R1d ago
-
Senior Software Engineer (Infra) INR 2400K-3500KC++ | Distributed Systems | Java | Networking | PythonSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer - Search INR 2500K-4200KInformation Retrieval | Language Models | Language Processing | Large Language Models | Machine LearningSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer - Data Platform INR 2500K-3584KAWS | Agentic AI | Apache Airflow | Apache Druid | Apache FlinkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India R2d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior BI & AI Engineer INR 3000K-4000KDAX | LLM | Langchain | Llamaindex | PandasAccess to Headspace app | Flexible vacation | Hybrid work model | Mental health days | Paid volunteer days offSenior-level Full TimeIndia, Hyderabad, Telangana R2d ago
-
Senior-level Full TimeBengaluru - GTP, India2d ago
-
AI / Generative AI Sr. Associate INR 2000K-4500KAI Governance | AI guardrails | AWS Bedrock | Agentic AI | Azure OpenAIFlexible workplace arrangements | Internal mobility | Learning and development programs | MentoringSenior-level Full TimeBengaluru - GTP, India R2d ago
-
Senior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India2d ago