Senior Consultant - Tech Consulting - National - CNS - TC - Data Engineer- Mumbai and Ahmedabad
New Delhi, National Capital Territory, IN, 110037
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Apply code quality testing and CI CD
- Build ETL pipelines for batch and streaming
- Design and deploy AWS EMR data pipelines
- Design scalable data pipelines
- Develop Python microservices for ingestion
- Develop distributed processing with Apache Spark
- Ensure data quality, reliability, performance, scalability
- Implement real time streaming ingestion
- Monitor pipelines and perform root cause analysis
- Orchestrate workflows with Apache Airflow
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | Agile | Apache Airflow | Apache Spark | Azure | CI/CD | Data Lake | Data Modeling | Docker | ETL | GCP | Kafka | Kubernetes | Logging | Monitoring | PostgreSQL | PySpark | Python | Scala | Schema evolution | Scrum | Streaming Data
Education
N/A
Roles
Related jobs
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India6h ago
-
Software Engineer II - UI + Python Developer + AI / ML INR 2500K-4000KAWS | Agile | CI/CD | CSS | HTMLMid-level Full TimeMumbai, Maharashtra, India9h ago
-
AI Engineer INR 2475K-4200KAgentic Systems | Azure OpenAI | Azure OpenAI APIs | Azure OpenAI SDK | Cloud IntegrationEntry-level Full TimeBengaluru, KA, IN10h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN10h ago
-
AI/ML Expert INR 2500K-5000KAgent systems | Edge Computing | Embedded Systems | Entity Extraction | Fine TuningSenior-level Full Timepune, India10h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India10h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R11h ago
-
Data Scientist INR 3000K-4000K3D Perception | Active Learning | Computer Vision | Container Orchestration | Data AnnotationSenior-level Full TimeBengaluru, KA, India11h ago
-
Data and AI/ML Design engineer at NE-VM INR 2000K-3300KAgile | Apache Kafka | C# | CSS | Computer VisionSenior-level Full Timebangalore, India11h ago
-
Senior-level Full Timecoimbatore, India11h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2700KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India11h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2500KAPIs | Alerting | Data Augmentation | Data Lineage | Data ModelingSenior-level Full Timebangalore, India11h ago
-
Senior-level Full Timebangalore, India11h ago
-
AI/ML Developer INR 1500K-2500KAzure | Cloud platform | Data Pipelines | Data Preprocessing | Deep learningMid-level Full Timebangalore, India11h ago
-
Senior-level Full TimeMumbai, Maharashtra, India11h ago
-
MLOps Engineer III INR 2500K-3465KAWS Bedrock | AWS SageMaker | CI/CD | Docker | KubernetesComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Data Modeling | Exception Handling | FastAPI | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India12h ago
-
Data Scientist Lead - AI Solutions INR 3500K-5000KAWS | Azure | Computer Vision | Data Mining | Data WarehousingSenior-level Full TimeIndia13h ago
-
ML & AI Engineer II INR 1860K-4000KAgentic AI | Amazon Web Services | Azure | Cloud Computing | Cloud platformCross-functional team projects | Online learning courses | Professional development trainingMid-level Full TimeMumbai, India13h ago
-
Senior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …17h ago
-
Data Modeler INR 2520K-4000KAWS | Access Control | Azure | Cloud Data | Cloud data platformFlexible work arrangementsMid-level Full TimeNoida / Gurgaon, DL, IN17h ago
-
Mid-level Full TimeBengaluru, KA, IN17h ago
-
Senior AI/Data Science Engineer INR 3520K-5400KA/B | A/B Testing | APIs | Agentic Workflows | Artificial IntelligenceFlexible benefits | Short-term incentive planSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India17h ago
-
Senior-level Full TimeBangalore, KA, IN17h ago