Data Lake SME
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Senior-level Full Time Found 10d ago
Tasks
- Automate workflows
- Collaborate with data teams
- Design data ingestion pipelines
- Develop and manage ETL/ELT processes
- Ensure data security and compliance
- Implement real-time and batch processing
- Integrate data from multiple sources
- Optimize storage and retrieval
- Provide support and mentorship
- Support metadata management and data governance
- Tune queries and pipelines
Perks/Benefits
Skills/Tech-stack
AWS Glue | Airflow | Apache Spark | Azure Synapse | Containerization | Data Modeling | Delta Lake | Docker | ETL Tools | Flink | GCP BigQuery | Hadoop | Hive | Iceberg | Kafka | Kubernetes | Oozie | Presto | Python | Redshift | SQL | Scala | Temporal
Education
Bachelor's | IT | Information Technology | Master's in Computer Science
Roles
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Sr Software Engineer INR 2500K-3100KAgile methodology | Cloud services | Code review | Communication | Data FormatsSenior-level Full TimePune, India21h ago
-
Sr Software Engineer INR 2500K-3100KAgile methodology | Cloud services | Data Modeling | Database Management | Design PatternsSenior-level Full TimePune, India21h ago
-
Software Engineer INR 1500K-2500KAgile | Cloud services | Code review | Communication | Data ModelingMid-level Full TimePune, India21h ago
-
Mid-level Full TimeIN-TN-Chennai1d ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-4500KComputer Vision | Deep learning | Edge Devices | Edge Hardware | GPU AccelerationSenior-level Full TimeMaharashtra, Pune, India1d ago
-
Mid-level Full TimeMaharashtra, Pune, India1d ago
-
Data Engineer INR 1500K-2500KAWS | Agile | Automation | Azure | Cloud ArchitectureCompetitive salaries | Health insurance | Office amenities | Scholarship opportunities | Volunteer programsMid-level Full TimeBengaluru, KA, India1d ago
-
Staff Software Engineer -ML/AI INR 2500K-4600KAPI Development | Algorithms | Embeddings | Hugging Face | Knowledge graphsSenior-level Full TimeBengaluru, India1d ago
-
Principal Consultant, Data Engineer ETL INR 2500K-3380KAWS | Airflow | Azure | Big Data | Cloud ComputingContinuous learning | Impact-driven environment | Innovation culture | MentorshipSenior-level Full TimeIndia-Bangalore2d ago
-
Senior Principal Consultant, RAG Engineer INR 2535K-4225KAI Tooling | AI/ML | AI/ML Tools | AWS | AirflowHands-on experience | Inclusive culture | Learning opportunities | MentorshipSenior-level Full TimeIndia-Bangalore2d ago
-
Lead Consultant-Data Engineer INR 2486K-3380KAWS | Apache Hadoop | Apache Kafka | Apache Spark | AzureAI certifications | Career growth | Hands-on experience | Innovative environment | MentorshipSenior-level Full TimeIndia-Bangalore2d ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkAI certifications | Career growth | Inclusive culture | MentorshipSenior-level Full TimeIndia-Bangalore2d ago
-
Senior-level Full TimeIN-AP-Hyderabad2d ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SQLMid-level Full TimeIN-AP-Hyderabad2d ago
-
AWS Data Engineer INR 2000K-2125KAWS | Best practices | CI/CD | Cloud Architecture | Cloud platformSenior-level Full TimeIN-TN-Chennai2d ago
-
Senior-level Full TimeIN-TN-Chennai2d ago
-
AI Engineer INR 2000K-4725KAWS | Algorithms | Azure | Cloud Architecture | CommunicationCareer progression | Diversity and inclusion initiatives | Education assistance | Employee discounts | Financial adviceSenior-level Full TimeBengaluru, KA, India2d ago
-
Software Engineer INR 1600K-2400KAgile tools | Agile tools (JIRA, Rally) | Agile tools (Jira | Angular | BigQueryMid-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior Software Engineer , Enterprise Advanced INR 2486K-4144KAlgorithms | Asynchronous systems | Cloud infrastructure | Computer Science | Computer science fundamentalsComprehensive benefits | Flexible working | Industry conferences | Professional growth | Supportive teamSenior-level Full TimeGurugram2d ago
-
DevOps Engineer III - Kubernetes, AWS, Terraform INR 2200K-3065KAWS | Aurora | Automation | CI/CD | CNI pluginsSenior-level Full TimeHyderabad, Telangana, India2d ago
-
Group BI Engineer I INR 2000K-2040KAgile | Azure Analysis | Azure Analysis Service | Azure Data | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India2d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeGurugram, Haryana, India2d ago
-
GCP Data Engineer - Associate Director INR 1500K-2541KBigQuery | Cloud Composer | Cloud Functions | DBT | DataflowMid-level Full TimeHyderabad, Telangana, India2d ago