Senior Data Engineer - Manager
Tasks
- Analyze logs and resolve incidents
- Automate data operations with shell scripting
- Build and optimize large scale data processing workflows
- Conduct code reviews
- Create technical documentation
- Define requirements with cross-functional teams
- Design and maintain CI/CD pipelines
- Design data pipelines
- Develop ETL/ELT processes
- Develop containerized applications and jobs
- Implement continuous integration and deployment with Jenkins
- Implement data modeling for storage and retrieval
- Lead projects and deliverables
- Maintain functional documentation
- Manage relational databases
- Recommend process improvements
- Troubleshoot production data pipeline issues
- Write unit tests
Perks/Benefits
- Employee networks
- Flexible work/life support
- Inclusive development opportunities
- Paid volunteer days
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | AWS IAM | AWS Iceberg | AWS Lambda | AWS S3 | Amazon ECS | Amazon EKS | Apache Iceberg | Artifactory | Bitbucket | CI/CD | Data Modeling | Data Processing | Databricks | Delta Lake | Distributed data | Distributed data processing | Docker | ELT | ETL | GitHub | Jenkins | PySpark | Python | Relational databases | SQL | Shell Scripting | Snowflake
Education
Related jobs
-
Senior-level Full TimePune, Maharashtra, India3h ago
-
Machine Learning Design Engineer, Silicon INR 3400K-5000KASIC design | Area Optimization | Assertion-based Formal Verification | CHISEL | CacheSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Senior-level Full TimePune, India4h ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India5h ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN5h ago
-
Applied AI/ML Associate Senior - Causal ML INR 1400K-2000KA/B | A/B Testing | Apache Hive | Apache Spark | B testingMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Analytics Solution Associate INR 945K-1496KAI assisted productivity | Alteryx | Anomaly Detection | Artificial Intelligence | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior-level Full TimeBangalore, KA, IN8h ago
-
Senior Manager - Product Analytics (Individual Contributor) INR 2400K-2829KA/B | A/B Testing | B testing | Causal Inference | Cohort AnalysisSenior-level Full TimeBengaluru, India8h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAPI Integration | Agent Frameworks | Agile | Azure | BERTMid-level Full TimePune, Maharashtra, India8h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgentic Frameworks | Agile | Azure | BERT | DjangoMid-level Full TimeBangalore, Karnataka, India8h ago
-
Senior_AI_developer INR 3125K-4763KAPI Orchestration | CI/CD | CNN | Computer Vision | Data PreprocessingSenior-level Full Timebangalore, India8h ago
-
Senior Data Engineer INR 2520K-3880KAWS CodePipeline | AWS DMS | AWS Glue | AWS Lambda | Amazon KinesisReward and recognition | Volunteering opportunities | Wellness program | Work-life balanceSenior-level Full TimeHyderabad, India9h ago
-
AI Services | Agentic Workflows | Anthropic | App Service | Azure AICareer growth | Direct product impact | Fully remote work | Startup environment | Technical autonomySenior-level Full TimeIndia R9h ago
-
Lead Software Engineer – Python, Terraform, Snowflake, AWS INR 2000K-4000KAWS | Agile | Amazon Web Services | Application Resiliency | By DesignSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Sr. Staff Software Engineer, Machine Learning INR 2500K-4500KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Deep learningHealth and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India10h ago
-
Software Engineer II - Java Full Stack Developer + AI/ML INR 1400K-2200KAWS | AppDynamics | CI/CD | Curl | DynatraceMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior Lead Software Engineer – Agentic SDLC & AI Engineer INR 2500K-4000KAgentic development | Anthropic Claude | Anthropic Claude Code | Artificial Intelligence | Automated testingSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Data Engineer for AZURE cloud Platform INR 1500K-2000KAPIs | Airflow | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBengaluru, KA, India10h ago
-
Senior - GEN AI INR 2755K-4000KAPI Development | AWS | Azure OpenAI | Azure OpenAI API | Cloud platformSenior-level Full TimePune, Maharashtra, India10h ago
-
Agile | Application Resiliency | Artificial Intelligence | CI/CD | Cloud technologiesSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Applied AI/ML Senior Associate INR 2500K-4000KApache Hive | Apache Spark | Data Analysis | Data Wrangling | KerasSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Generative AI Systems Engineer – Vision-Language Models INR 2500K-4500KAPI Development | Batching | Caching | Containerization | DockerSenior-level Full Timebangalore, India11h ago
-
AI Engineering Lead INR 2500K-5000KAgent systems | Agentic behavior | Amazon Web Services | Azure | CI/CDCollaborative culture | Five-day work week | Flexible working hours | Supportive work environmentSenior-level Full TimeGurugram, Haryana, India12h ago
-
Lead AI Engineer INR 2500K-4500KAI Search | AI Studio | Agent Orchestration | Agent systems | Application InsightsSenior-level Full TimeIND-Bangalore, India15h ago