Data Lake SME

INR 1500K-2000K (estimate) Senior-level Full Time Found 10d ago

Tasks

• Automate ETL/ELT workflows
• Collaborate with data teams and support pipelines
• Design data ingestion pipelines
• Develop and manage ETL/ELT processes
• Ensure data governance and security
• Implement encryption and role-based access
• Implement real-time and batch processing
• Integrate data from multiple sources
• Mentor junior engineers
• Optimize storage and retrieval strategies
• Support metadata management and data lineage
• Tune queries and pipelines

Perks/Benefits

• Health benefits
• Inclusive work environment
• Professional development
• Wellbeing programs

Skills/Tech-stack

AWS Glue | Airflow | Azure Synapse | Data Engineering | Data Modeling | Data Streaming | Delta Lake | Dimensional Modeling | Docker | ETL Tools | GCP BigQuery | Hadoop | Hive | Iceberg | Inmon | Kafka | Kimball | Kinesis | Kubernetes | Oozie | Presto | Pulsar | Python | Redshift | SQL | Scala | Spark | Star Schema | Temporal