Big Data Engineer
Tasks
- Conduct proof of concepts
- Conduct requirements design code and security reviews
- Coordinate offshore development activities
- Create system design and technical artifacts
- Define requirements and use cases
- Define standards processes and best practices
- Develop test strategy and test design
- Ensure test coverage for unit system integration and performance
- Identify root causes and drive remediation
- Lead system development and maintenance
- Maintain technology roadmaps
- Manage day to day team execution and delivery
- Manage production incidents and maintenance
- Own full software development life cycle
- Perform performance benchmarking
- Plan design and develop big data solutions
- Plan release and deployment
- Promote quality assurance and quality control
- Provide knowledge transfer and mentoring
- Provide on-call support
- Provide product support collaboration
- Research and evaluate emerging technologies
- Run knowledge sharing sessions
- Select technical frameworks and delivery methodologies
- Support vendor and technology evaluation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache NiFi | Apache Ozone | Apache Spark | Cloud Computing | Development Life Cycle | Financial Services | Hadoop | Integration Testing | Oracle | Performance Testing | Python | Secure Coding | Software Development Life Cycle | Software development | System Integration | System Integration Testing | Unit Testing | Unix
Education
Bachelor of Computer Engineering | Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Big Data Developer | Big Data Engineer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
D&T Lead - Data Engineer INR 2000K-2800KAmazon Web Services | Azure | Batch Processing | Cloud Data | Cloud Data WarehouseSenior-level Full TimePune, IN1h ago
-
Sr. Machine learning /Data Scientist INR 3000K-4500KAWS Bedrock | AWS SageMaker | Apache Spark | Classification | ClusteringAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discount schemeSenior-level Full TimeMumbai, MH, India2h ago
-
Applied AI Engineer INR 1800K-2500KAPI Integration | Access Control | Agent Orchestration | Anthropic API | CrewAIMid-level Full TimeHybrid in Bangalore, India R3h ago
-
Sr. Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Services | CI/CD | Data IngestionSenior-level Full TimePune, Maharashtra, India3h ago
-
Data Engineer -Azure Modern Data Platform INR 3000K-3500KAnalysis Services | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseSenior-level Full TimePune, MH, India4h ago
-
AI/ML Developer INR 1800K-2500KAzure | Cloud Computing | Cloud platform | Data Pipelines | Data PreprocessingMid-level Full Timebangalore, India4h ago
-
Senior AI Developer INR 2500K-4800KAI Search | AI Services | AKS | Agentic Workflows | App ServiceContinuous learning | Mentorship | Remote workSenior-level Full TimeIndia (Remote) R4h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India6h ago
-
Senior Software Engineer, Machine Learning INR 2516K-3465KA/B | A/B Testing | AIOps | B testing | CPPFinancial wellness support | Healthcare | Mental health support | Remote work flexibility | Retirement plansSenior-level Full TimeBengaluru, India9h ago
-
Mid-level Full TimePune, IN9h ago
-
GenAI Contractor INR 360K-420KAPI Development | Data Pipelines | Evaluation | Language Models | Large Language ModelsEntry-level ContractBengaluru, India16h ago
-
Mid-level Full TimeGreater Noida, India18h ago
-
Engineer - Embedded Software (System Engineer) INR 1000K-1000KAgile | C# | C++ | IoT | LinuxOn-site work model | Work flexibilityMid-level Full TimeBangalore20h ago
-
Entry-level Full TimePune City, India20h ago
-
Software Test Engineer (Python, Pyspark, SQL) INR 1000K-1500KAPI Testing | Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India20h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago
-
Mid-level Full TimeIndia-Bangalore21h ago
-
Senior AI & Data Engineer INR 2000K-3500KAPI Integration | Apache Spark | Data Ingestion | Data Modeling | Data PartitioningFast-paced environment | Hybrid work | Independent delivery ownershipSenior-level Full TimeIndia21h ago
-
Validation/Verification (UVM, Coverage, Agentic), Staff Engineer INR 2000K-2372KAI Assisted Verification | Code Coverage | Coverage analysis | Debugging | Functional CoverageSenior-level Full TimeHyderabad, India21h ago
-
B3.1 Data INR 1500K-3000KArtificial Intelligence | CI/CD | Data Governance | Data Modeling | Data QualityMid-level Full TimeIndia21h ago
-
Senior Data Engineer (Python + Oracle db) INR 2829K-3500KApache Hive | CI/CD | Databricks | Microsoft Azure | Oracle DatabaseEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India21h ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101321h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2000K-4500KAWS | Autogen | Azure | CI/CD | ChromaDBSenior-level Full TimeBangalore, India22h ago
-
Assistant Director,Collections Analytics Lead INR 1800K-2205KAWS | Alteryx | Apache Spark | Azure | Cloud DataprocDiversity programsSenior-level Full TimeKolkata, West Bengal, India R22h ago
-
AI/ML Infrastructure Software Engineer INR 2500K-4800KC++ | Hyperparameter Optimization | JAX | Keras | ML ExplainabilitySenior-level Full TimeBengaluru, Karnataka, India22h ago