Big Data Engineer
Tasks
- Conduct proof of concepts
- Conduct requirements design code and security reviews
- Coordinate offshore development activities
- Create system design and technical artifacts
- Define requirements and use cases
- Define standards processes and best practices
- Develop test strategy and test design
- Ensure test coverage for unit system integration and performance
- Identify root causes and drive remediation
- Lead system development and maintenance
- Maintain technology roadmaps
- Manage day to day team execution and delivery
- Manage production incidents and maintenance
- Own full software development life cycle
- Perform performance benchmarking
- Plan design and develop big data solutions
- Plan release and deployment
- Promote quality assurance and quality control
- Provide knowledge transfer and mentoring
- Provide on-call support
- Provide product support collaboration
- Research and evaluate emerging technologies
- Run knowledge sharing sessions
- Select technical frameworks and delivery methodologies
- Support vendor and technology evaluation
Perks/Benefits
- N/A
Skills/Tech-stack
Apache NiFi | Apache Ozone | Apache Spark | Cloud Computing | Development Life Cycle | Financial Services | Hadoop | Integration Testing | Oracle | Performance Testing | Python | Secure Coding | Software Development Life Cycle | Software development | System Integration | System Integration Testing | Unit Testing | Unix
Education
Bachelor of Computer Engineering | Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Big Data Developer | Big Data Engineer | Data Developer | Data Engineer | Developer | Engineer
Related jobs
-
Senior AI Developer INR 2500K-4800KAI Search | AI Services | AKS | Agentic Workflows | App ServiceContinuous learning | Mentorship | Remote workSenior-level Full TimeIndia (Remote) R4h ago
-
Staff Data Engineer INR 2755K-4000KAWS | Apache Kafka | Apache Spark | Azure | CI/CDCell phone reimbursement | Healthcare | Internet reimbursement | Learning and development stipend | Travel opportunitiesSenior-level Full TimeBengaluru, India5h ago
-
Senior Software Engineer, Machine Learning INR 2516K-3465KA/B | A/B Testing | AIOps | B testing | CPPFinancial wellness support | Healthcare | Mental health support | Remote work flexibility | Retirement plansSenior-level Full TimeBengaluru, India9h ago
-
GenAI Contractor INR 360K-420KAPI Development | Data Pipelines | Evaluation | Language Models | Large Language ModelsEntry-level ContractBengaluru, India16h ago
-
Mid-level Full TimeGreater Noida, India17h ago
-
Engineer - Embedded Software (System Engineer) INR 1000K-1000KAgile | C# | C++ | IoT | LinuxOn-site work model | Work flexibilityMid-level Full TimeBangalore19h ago
-
Entry-level Full TimePune City, India19h ago
-
Software Test Engineer (Python, Pyspark, SQL) INR 1000K-1500KAPI Testing | Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India19h ago
-
Senior-level Full TimeIN-AP-Hyderabad20h ago
-
Mid-level Full TimeIndia-Bangalore20h ago
-
Validation/Verification (UVM, Coverage, Agentic), Staff Engineer INR 2000K-2372KAI Assisted Verification | Code Coverage | Coverage analysis | Debugging | Functional CoverageSenior-level Full TimeHyderabad, India20h ago
-
B3.1 Data INR 1500K-3000KArtificial Intelligence | CI/CD | Data Governance | Data Modeling | Data QualityMid-level Full TimeIndia20h ago
-
Senior Data Engineer (Python + Oracle db) INR 2829K-3500KApache Hive | CI/CD | Databricks | Microsoft Azure | Oracle DatabaseEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India20h ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101321h ago
-
Assistant Director,Collections Analytics Lead INR 1800K-2205KAWS | Alteryx | Apache Spark | Azure | Cloud DataprocDiversity programsSenior-level Full TimeKolkata, West Bengal, India R21h ago
-
AI/ML Infrastructure Software Engineer INR 2500K-4800KC++ | Hyperparameter Optimization | JAX | Keras | ML ExplainabilitySenior-level Full TimeBengaluru, Karnataka, India21h ago
-
AI and Data Engineer, Google Cloud INR 1500K-2500KAccess Management | Apache Hive | Apache Pig | Apache Spark | Data ComplianceMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Data Engineer - Azure INR 1500K-2700KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBengaluru East, Karnataka, India R22h ago
-
Ai/Ml Testing-Ai, Ml, Deep Learning, Data Mining, Analytics INR 1000K-2100KAPI Testing | Accuracy testing | Data Validation | ETL | EmbeddingsMid-level Full TimeChennai, Tamil Nadu, India22h ago
-
Senior AI Engineer INR 2475K-4500KADLS | AI Services | Active Directory | Anomaly Detection | Azure AISenior-level Full TimeIndia22h ago
-
Senior - Data and App Modernization INR 2800K-4000KAWS | AWS Glue | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeMumbai, Maharashtra, India22h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India22h ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageExecutive-level Full TimeBangalore, Karnataka, India23h ago
-
Lead Assistant Manager INR 2125K-3500KAI Foundry | Access Control | Active Directory | Application Insights | Azure Active DirectorySenior-level Full TimeGurugram, Haryana, India23h ago
-
Senior AI Developer INR 2500K-3000KAWS | Anthropic Claude | Confidence scoring | Data Validation | Data extractionSecurity and privacy trainingSenior-level Full TimeBengaluru23h ago