Lead Software Engineer - 260317-2
Tasks
- Architect data ingestion frameworks
- Build and maintain Medallion Architecture layers
- Build and maintain high-performance data pipelines
- Conduct architecture reviews and code reviews
- Define Snowflake data engineering standards
- Design dimensional and analytical data models
- Design scalable data platforms using Snowflake
- Develop Gold layer data marts for BI and analytics
- Develop and optimize ELT pipelines in Snowflake
- Drive cost governance and performance optimization in Snowflake
- Enable self service analytics through curated datasets
- Ensure compliance with data governance policies
- Establish coding standards for data pipelines and design guidelines
- Lead and mentor data engineers
- Maintain data documentation lineage tracking and impact analysis
- Optimize query performance storage and compute costs
- Translate business requirements into scalable data engineering solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Azure | CI/CD | Data Governance | Data Ingestion | Data Lineage | Data Modeling | Data Pipelines | Dimensional Modeling | ELT | Git | Google Cloud | Machine Learning | Python | SQL | Snowflake
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer, AI and Infrastructure, CMCS INR 2500K-5000KAPIs | As-a-Service | C++ | CPU | Data ProcessingSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Staff Software Engineer, Search Intelligence INR 2040K-4500KArtificial Intelligence | Code review | Deployment | Distributed Systems | DocumentationSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Applied Artificial Intelligence & Machine Learning- Markets Operations - Vice President INR 3000K-3000KAWS | Agile | Azure | Containerization | Data PreprocessingExecutive-level Full TimeBengaluru, Karnataka, India6h ago
-
Lead Software Engineer - Java, Streaming, AWS INR 2000K-3500KAWS | Agile | Amazon EKS | Amazon EMR | Amazon KinesisSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2050K-3300KAWS | AWS EMR | Agile | Apache Spark | CI/CDSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600769h ago
-
Value Reporting Data Engineer INR 1431K-2000KData Governance | Data Lakehouse | Data pipeline | Databricks | DataverseMid-level Full TimeKochi, Kerala, India9h ago
-
Python , web scrapping data conversion VBA INR 1500K-2156KAPI Integration | Alerting | BeautifulSoup | Data Automation | Data EngineeringHybrid working | UK time zone collaborationSenior-level Full TimeGurgaon, HR, India9h ago
-
Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior - Azure Data Engineering INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Senior Data Engineer INR 2520K-3500KAI Platform | Apache Airflow | Apache Spark | CI/CD | Cloud StorageBackground checks during recruitment | Creche allowance | Cultural events | Flexible work model | Lab daysSenior-level Full TimeBangalore10h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-1700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India10h ago
-
Sr. Manager, AI FDE INR 2755K-3900KAI transformation | AWS | Azure | Cloud Computing | Cloud platformMonthly travel | Remote work option | Travel Once a MonthSenior-level Full TimeRemote - India R11h ago
-
IN_Senior Associate_Agentic AI Developer_One cloud_Advisory_Pune INR 2755K-4225KAWS Bedrock | CI/CD | Deep learning | Faiss | FastAPIFlexible work arrangements | Mentorship | Wellbeing supportSenior-level Full TimePune, India15h ago
-
Technical Lead-Data Engg INR 1500K-2400KAcceptance criteria | BRD | Business Requirements | Change Management | DashboardingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …15h ago
-
PySpark Data Engineer with Cloudera and Cloud Expertise INR 2400K-3500KAWS EMR | Apache Airflow | Apache Atlas | Apache Oozie | Apache SparkFlexible workplace arrangements | Learning and development programs | MentoringSenior-level Full TimeBengaluru - BCIT, India15h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
Tech Lead - Data Bricks Job INR 2040K-3500KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksContinuous learning | Flexible work arrangementsSenior-level Full TimeHyderabad, TG, IN15h ago
-
Senior AI Engineer INR 2500K-4800KAI auditability | AI guardrails | Accelerate | Access Controls | AdaptersSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Associate Data Engineer INR 1000K-1200KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageAnnual performance related salary increase | Competitive starting salary | Flexible working hours | Paid parental leave | Remote or mobile workingMid-level Full TimeBangalore RMZ-ECO WORLD, India15h ago