Sr Data Engineer
Bengaluru, INDIA, India
INR 2250K-2600K (estimate) Senior-level Full Time
Tasks
- Build data lakes and data products
- Collaborate with stakeholders to deliver data solutions
- Debug data load operations and support production issues
- Define data load testing and quality rules
- Design data pipelines and platforms
- Develop and maintain data integration scripts
- Implement CI/CD pipelines for data solutions
- Implement data engineering best practices
- Implement data modeling strategies
- Lead and mentor data engineers
- Leverage AI for day to day engineering tasks
- Manage project requirements and estimates
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Apache Hive | Apache Spark | Azure | Bash | CI/CD | Cassandra | Data Lake | Data Modeling | Data integration | Hadoop | Kafka | Linux | Medallion Architecture | PostgreSQL | PySpark | Python | SQL | Scala | Spark Streaming
Education
Roles
Related jobs
-
Sr Data Engineers - AI/ML - Chennai INR 2500K-4500KAPI Security | Agent systems | Asynchronous programming | CI/CD | Docker401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia3h ago
-
Software Engineering INR 1500K-2000KAI Driven | AI-driven development | Apache Spark | C# | C++On-call support rotationMid-level Full TimeBengaluru, KA, IN4h ago
-
AI ML Data Engineer for ADAS Sr Backend Developer INR 2535K-4225KAWS | Apache Kafka | Azure | CI/CD | Cloud platformSenior-level Full Timebangalore, India7h ago
-
AWS | Azure | Business Rules | Data Catalog | Data CleansingAgile work culture | Learning opportunities | Team collaborationEntry-level Full Timepune, India7h ago
-
Sr.Staff Software Engineer- Networking INR 3100K-3380KC++ | Cloud Networking | CloudFormation | Distributed Systems | Infrastructure automationSenior-level Full TimeBengaluru, India8h ago
-
Lead Assistant Manager INR 300K-370KAgentforce | Ampscript | Automation Studio | Calculated Insights | Data ExtensionsSenior-level Full TimeGurugram, Haryana, India8h ago
-
Senior-level Full TimeHyderabad, Telangana, India8h ago
-
SW Engineer (6 months - 2 yrs Experience - Java/Python, UNIX, J2EE, REST & SOAP, Automation, Gen AI) INR 700K-700KAgile | Automation | CI/CD | Deep learning | GenAICareer development | Continued learning | Hybrid work model | MentorshipEntry-level Full TimeBengaluru, INDIA, India8h ago
-
Azure Lead Data Engineer INR 1200K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Agile | CI/CD | Containers | Distributed Systems | GitHybrid workSenior-level Full TimeBengaluru, INDIA, India9h ago
-
AI - Sr Group Manager INR 2500K-4500KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | Agentic developmentSenior-level Full TimePune, Maharashtra, India9h ago
-
Sr Devops Engineer Platform Engineering INR 2500K-3065KAPI Gateway | AWS | AWS CodePipeline | Ansible | BackupReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India9h ago
-
AWS Data Engineer INR 2000K-3000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
AWS | ChromaDB | Cloud platform | Convolutional Neural Networks | Evaluation metricsEntry-level InternshipBangalore, India9h ago
-
Senior Software Engineer (Python/SQL/Data Engineering) (m/f/x) INR 3200K-3880KAWS | Apache Spark | Azure | Backend systems | ClickHouseSenior-level Full TimeBangalore10h ago
-
Software Engineer II INR 3375K-4590KAWS | Apache Maven | CI/CD | Eclipse | GitLab CICross-functional team projects | Learning and training opportunitiesSenior-level Full TimeMumbai, India11h ago
-
Software Engineer II INR 2486K-4144KAWS | Agile | CSS | CloudFront | Code reviewMentoring | Mentorship opportunities | Professional growthEntry-level Full TimeBengaluru, KA, India11h ago
-
Software Development Engineer, Transportation Financial Systems INR 1317K-2000KAlgorithms | Big Data | Design Patterns | Distributed Systems | High AvailabilityMid-level Full TimeBengaluru, Karnataka, IND15h ago
-
ARM | App Service | Application Insights | Azure | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India15h ago
-
Apache Airflow | Apache Hadoop | Azure | Azure Data | Azure Data FactorySenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 1628K-2040KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-2146KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-2146KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Work-life balanceSenior-level Full TimeGurugram 10 C, India15h ago
-
IN_Senior Associate_Azure DE_Data & Analytics_Advisory_PAN India INR 2000K-2146KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India15h ago
-
App Service | Application Insights | Azure App | Azure App Service | Azure DevOpsSenior-level Full TimeBengaluru Millenia, India15h ago