Tech Lead - Data Bricks Job
Tasks
- Build cloud data warehouses
- Build streaming data pipelines
- Collaborate in agile teams
- Communicate with client technical teams
- Design data as a service solutions
- Develop ETL pipelines
- Develop SQL queries
- Develop and deploy data pipelines using Azure Data Factory
- Develop and manage Unity Catalog
- Develop spark jobs
- Implement data security models
- Lead cloud data and analytics solutions development
- Mentor junior developers and testers
- Process data with Azure Databricks
- Use Azure Event Hubs for streaming ingestion
- Use PySpark for data processing
Perks/Benefits
Skills/Tech-stack
Agile | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event Hubs | Big Data | Data Factory | ETL | Event Hubs | PubSub | PySpark | Python | SQL | Scala | Spark | Streaming | Unity Catalog
Education
N/A
Related jobs
-
AI/ML Engineer INR 2500K-4000KAI Foundry | AI Search | AWS Bedrock | Amazon QuickSight | App ServiceSenior-level Full Timetelengana, India3h ago
-
Senior Software Engineer, AI and Infrastructure, CMCS INR 2500K-5000KAPIs | As-a-Service | C++ | CPU | Data ProcessingSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Applied Artificial Intelligence & Machine Learning- Markets Operations - Vice President INR 3000K-3000KAWS | Agile | Azure | Containerization | Data PreprocessingExecutive-level Full TimeBengaluru, Karnataka, India6h ago
-
Lead Software Engineer - Java, Streaming, AWS INR 2000K-3500KAWS | Agile | Amazon EKS | Amazon EMR | Amazon KinesisSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2050K-3300KAWS | AWS EMR | Agile | Apache Spark | CI/CDSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600769h ago
-
Value Reporting Data Engineer INR 1431K-2000KData Governance | Data Lakehouse | Data pipeline | Databricks | DataverseMid-level Full TimeKochi, Kerala, India9h ago
-
Lead Developer- AI/ML INR 2500K-4500KArtificial Intelligence | Cloud Run | Cloud platform | Debugging | DeploymentSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Python , web scrapping data conversion VBA INR 1500K-2156KAPI Integration | Alerting | BeautifulSoup | Data Automation | Data EngineeringHybrid working | UK time zone collaborationSenior-level Full TimeGurgaon, HR, India9h ago
-
Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Data Engineer INR 2520K-3500KAI Platform | Apache Airflow | Apache Spark | CI/CD | Cloud StorageBackground checks during recruitment | Creche allowance | Cultural events | Flexible work model | Lab daysSenior-level Full TimeBangalore10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Sr. Manager, AI FDE INR 2755K-3900KAI transformation | AWS | Azure | Cloud Computing | Cloud platformMonthly travel | Remote work option | Travel Once a MonthSenior-level Full TimeRemote - India R11h ago
-
IN_Senior Associate_Agentic AI Developer_One cloud_Advisory_Pune INR 2755K-4225KAWS Bedrock | CI/CD | Deep learning | Faiss | FastAPIFlexible work arrangements | Mentorship | Wellbeing supportSenior-level Full TimePune, India15h ago
-
Data Moduler Sr Technical Lead-Data Engg INR 1200K-2000KAccess Control | Cloud ERP | Conformed Dimensions | Data Lake | Data MartSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …15h ago
-
PySpark Data Engineer with Cloudera and Cloud Expertise INR 2400K-3500KAWS EMR | Apache Airflow | Apache Atlas | Apache Oozie | Apache SparkFlexible workplace arrangements | Learning and development programs | MentoringSenior-level Full TimeBengaluru - BCIT, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Senior AI Engineer INR 2500K-4800KAI auditability | AI guardrails | Accelerate | Access Controls | AdaptersSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Associate Data Engineer INR 1000K-1200KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageAnnual performance related salary increase | Competitive starting salary | Flexible working hours | Paid parental leave | Remote or mobile workingMid-level Full TimeBangalore RMZ-ECO WORLD, India15h ago