Senior Big Data Engineer
Tasks
- Decompose complex problems into solutions
- Design data pipelines
- Develop distributed SaaS security risk systems
- Document technical requirements
- Drive technology explorations and roadmaps
- Ensure architecture and design quality
- Lead delivery of large scale infrastructure systems
- Mentor engineering team members and community
- Prototype data platform components
- Provide technical leadership for data platform design
- Research and benchmark cloud technologies
- Support scalable data processing systems
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Airflow | Apache Flink | Apache Hadoop | Apache Solr | Apache Spark | Automation | Caching | Cassandra | Cloud Computing | Compliance | Data Lake | Data pipeline | Database Administration | Distributed Systems | Elasticsearch | Enterprise Architecture | Enterprise System | Enterprise System Design | Flink | Kafka | Kappa Architecture | Lambda Architecture | Machine Learning | Microservices | Middleware | Model Deployment | NoSQL | OO modeling | Oracle | Performance Engineering | Presto | Queueing | RDBMS | RUP | Redis | Relational databases | Scalability | Scripting | Scrum | Security | System design | Troubleshooting | Unix | XP
Education
N/A
Roles
Related jobs
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Platforms | Data Modeling | Data Warehouse | Data WarehousingMid-level Full TimeHyderabad, HDC4A, India-1d ago
-
Mid-level Full TimeBengaluru, BDC11A, India-1d ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R8h ago
-
Azure Databricks INR 1500K-2000KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeIN-AP-Hyderabad9h ago
-
Software Engineer - AI/ML with Python INR 2500K-3500KAI | AWS | Airflow | Apache Spark | BazelCollaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Mid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Engineering Analyst II, Gemini and Labs INR 1000K-1500KAdversarial techniques | Automation | Classifier | Data Analysis | Fine TuningHoliday coverage | Rotating on call coverage | Weekend coverageMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Database Engineer INR 2520K-3380KAerospike | Azure | Azure Cosmos | Azure Cosmos DB | Azure DataOn-call support | Relocation assistance | Rotational shifts 24x7Senior-level Full TimeBengaluru, KA, IN12h ago
-
Senior Architect, ML Engineering INR 2500K-4500KAWS | Agentic Workflows | Async Programming | Azure | Circuit BreakersSenior-level Full TimePune, Maharashtra, India13h ago
-
Entry-level Full TimePune, Maharashtra, India14h ago
-
Entry-level Full TimePune, Maharashtra, India14h ago
-
Data Engineer - Senior INR 3000K-3500KAnomaly Detection | Application Insights | Azure | Azure Application Insights | Azure SQLSenior-level Full TimePune, Maharashtra, India14h ago
-
Staff Machine Learning Manager INR 2160K-2800KAnomaly Detection | Attribution Modeling | Auction theory | Audience Segmentation | Bid optimizationBring children to work | Bring pets to work | Food provided | Gym | Training opportunitiesSenior-level Full TimeBangalore15h ago
-
Germany (FS- D&A)- Executive-BLR INR 500K-500KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid workExecutive-level Full TimeBangalore, Karnataka, India16h ago
-
Cloud Support Engineer – Backup & Disaster Recovery INR 938K-1500KAWS | Backup and Disaster Recovery | Cloud Computing | Cloud Storage | DatabasesMid-level Full TimeBangalore, India16h ago
-
Embedded Linux Engineer - Platform Software INR 980K-1200KALSA | ARM | Asynchronous programming | BLE | BluetoothMid-level Full TimeGurugram, Haryana, India16h ago
-
Data Operations Engineer INR 2040K-3380KApache Airflow | Data Pipelines | Data Refresh | Data Warehousing | Data pipelineEmergency incident response support | On-call rotationSenior-level Full TimeBengaluru, INDIA, India R16h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India16h ago
-
Software Engineer INR 1000K-2700KAWS Cloud | Amazon Aurora | Amazon ECS | Amazon EMR | Amazon S3Reward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India16h ago
-
Software Engineer - Associate INR 1170K-2000KAWS S3 | Agentic AI | Amazon ECS | Amazon EMR | Amazon SNSDevelopment opportunities | Reward and recognition | Volunteering opportunities | Wellness | Work-life balanceMid-level Full TimeHyderabad, India16h ago
-
Senior-level Full TimeIndia17h ago
-
Lead Data Scientist INR 2475K-4500KAzure | Computer Architecture | DPO | DeepSpeed | Distributed SystemsSenior-level Full TimeTelangana, India17h ago
-
Sr Python / GCP / Functional Testing INR 3000K-4000KAgile | Alerting | BigQuery | Business Rules | CI/CDSenior-level Full TimeGurgaon, Haryana, India17h ago
-
AI | API Testing | Airflow | Automation frameworks | AzureEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India17h ago
-
Research Engineer - Applied AI/ML INR 1500K-2500KConcurrency systems | Deep learning | Distributed Computing | High concurrency | High-concurrency systemsMid-level Full TimeGurugram, India17h ago