Senior Big Data Engineer -Assistant Vice President
TOWER B, EON FREE ZONE II, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Advise coach and support analysts and stakeholders
- Analyze large datasets for trends patterns and anomalies
- Automate job scheduling and manage workload dependencies
- Build event driven streaming architectures
- Define data mapping specifications and ingestion requirements
- Design and implement scalable batch and streaming data pipelines
- Develop backend services and automation scripts for data processing
- Develop interfaces and data visualization components
- Escalate manage and report control issues
- Liaise with business stakeholders to define data requirements
- Monitor and mitigate data quality and governance risks
- Optimize Oracle queries and database objects
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | AWS | Apache Hadoop | Apache Kafka | Apache Spark | Autosys | Azure | Batch Processing | CI/CD | Containerization | Couchbase | Data Governance | Data Mapping | Data Quality | Data Warehousing | Data pipeline | Docker | Event Driven | Event-driven architecture | Google Cloud | JPA | Java | JavaScript | Kubernetes | Microservices | MongoDB | Oracle | PySpark | Python | REST API | REST API design | Redis | SDLC | SQL | Shell Scripting | Spark Streaming | Spring Boot | Streaming processing
Education
N/A
Related jobs
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Platforms | Data Modeling | Data Warehouse | Data WarehousingMid-level Full TimeHyderabad, HDC4A, India3h ago
-
Data Engineer INR 1500K-2000KData Modeling | Data Pipelines | Data Warehousing | ETL | Schema DesignMid-level Full TimeHyderabad, HDC4A, India3h ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeBengaluru, BDC11A, India3h ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Data Compliance | Data Modeling | Data PipelinesMid-level Full TimeBengaluru, BDC11A, India3h ago
-
Mid-level Full TimeBengaluru, BDC11A, India3h ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R13h ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R13h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R13h ago
-
QA Engineer INR 240K-360KDBT | Data Quality | Data Warehousing | Dimensional Modeling | ETLOff hour support on rotation basisEntry-level Full TimePune City, India14h ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-5000KComputer Vision | Deep learning | FP16 | GPU Acceleration | Human pose estimationSenior-level Full TimeMaharashtra, Pune, India14h ago
-
Azure Databricks INR 1500K-2000KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeIN-AP-Hyderabad14h ago
-
Senior-level Full TimeIN-TN-Chennai14h ago
-
Mid-level Full TimeIN-KA-Bangalore14h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAI | AWS | Airflow | Apache Spark | BazelCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …14h ago
-
Mid-level Full TimeBangalore - Karnataka, India - Kalyani …14h ago
-
Business glossary | Data Catalog | Data Contracts | Data Lineage | Data ModelingAsync first | Flexible overlap hours | RemoteSenior-level Full TimePune, Maharashtra, India15h ago
-
Teams Telephony – Operations Automation & AI Engineer INR 2000K-3500KAI orchestration | Azure Functions | Azure Key Vault | Azure Relay | Azure StorageMid-level Full Timebangalore, India15h ago
-
Senior Data Engineer INR 3000K-4000KADLS Gen2 | Audit Logging | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimePune, Maharashtra, India15h ago
-
Engineering Analyst II, Gemini and Labs INR 1000K-1500KAdversarial techniques | Automation | Classifier | Data Analysis | Fine TuningHoliday coverage | Rotating on call coverage | Weekend coverageMid-level Full TimeBengaluru, Karnataka, India16h ago
-
Senior Database Engineer INR 2520K-3380KAerospike | Azure | Azure Cosmos | Azure Cosmos DB | Azure DataOn-call support | Relocation assistance | Rotational shifts 24x7Senior-level Full TimeBengaluru, KA, IN17h ago
-
Lead Software Engineer - Data Engineer INR 1500K-2400KABAC | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Senior Architect, ML Engineering INR 2500K-4500KAWS | Agentic Workflows | Async Programming | Azure | Circuit BreakersSenior-level Full TimePune, Maharashtra, India17h ago
-
Entry-level Full TimePune, Maharashtra, India18h ago
-
Entry-level Full TimePune, Maharashtra, India18h ago
-
Data Engineer - Senior INR 3000K-3500KAnomaly Detection | Application Insights | Azure | Azure Application Insights | Azure SQLSenior-level Full TimePune, Maharashtra, India18h ago