Lead, Big Data Analytics & Engineering
Tasks
- Apply metrics and benchmarking to evaluate solution effectiveness
- Deliver proofs of concept prototypes and pilots
- Design, build, and maintain scalable data pipelines
- Enable advanced analytics using big data frameworks
- Implement CI CD for data engineering workflows
- Integrate structured and semi structured sources for data unification
- Lead ingestion aggregation transformation and processing of large scale data sets
- Mentor data engineers and analysts and set engineering standards
- Partner with product and data science teams to deliver data solutions
- Promote best practices in data modeling and data governance
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache NiFi | Azure | Azure Data | Azure Data Factory | CI/CD | Data Factory | Data Lakes | Data Mining | Data Modeling | Data Visualization | DevOps | ELT | ETL | Google Cloud | Graph Databases | Hadoop | Impala | Machine Learning | NumPy | Pandas | Pentaho | PySpark | Python | SQL | Talend
Education
N/A
Roles
Big Data Engineer | Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Pyspark Data Engineer INR 1200K-2000KAgile | Apache Spark | Data Governance | Data Lake | Data ModelingSenior-level Full TimeIN-KA-Bangalore2h ago
-
Azure Data Engineer - AM- MFT KGS CH INR 2000K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India3h ago
-
Azure Data Engineer - Senior- MFT KGS CH INR 2000K-2000KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeBangalore, Karnataka, India3h ago
-
Azure Data Engineer - AM - MFT KGS CH INR 2000K-2000KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India3h ago
-
AWS Data Engineering - Consultant INR 1200K-1500KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeBangalore, Karnataka, India3h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India3h ago
-
Assistant Manager - Azure Data Engineering INR 1500K-3000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsMid-level Full TimeBangalore, Karnataka, India3h ago
-
AWS Data Engineering - Consultant INR 1200K-1500KAWS CloudFormation | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimeBangalore, Karnataka, India4h ago
-
Senior Software Engineer, Google Cloud Storage INR 2500K-3500KBenchmarking | C++ | Connectors | Debugging | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India4h ago
-
Senior AI/ML Engineer I INR 2500K-4500KAzure | C++ | Dataset Processing | Deep learning | Generative AICareer advancement programs | Corporate National Pension Scheme | Dental insurance | Education reimbursement programs | Employee assistance programSenior-level Full TimeBangalore, Karnataka, India6h ago
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India8h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India8h ago
-
Principal Staff Software Engineer, AI Infrastructure INR 1800K-5800KApache Kafka | C++ | Compliance | Data Modeling | Distributed SystemsHealth and wellness programs | Hybrid work option | Time away from workExecutive-level Full TimeBengaluru, KA, India8h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India8h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600669h ago
-
Lead Software Engineer - Big Data, Spark, Python, AWS INR 2000K-2400KAWS Lambda | Agile | Amazon ECS | Amazon EKS | Amazon EMRSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Technical Anchor INR 2500K-3000KASR | AWS | Adobe Experience | Adobe Experience Manager | Amazon LexAgile team collaboration | Off-hours support | On-call rotational support | Weekend support rotational basisSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Applied AI ML Associate Senior INR 630K-1039KAzure OpenAI | Azure OpenAI Service | CI/CD | Cloud Computing | Deep learningMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Applied AI ML Associate INR 520K-539KAgile | Application Resiliency | Application development | Artificial Intelligence | CI/CDMid-level Full TimeHyderabad, Telangana, India10h ago
-
Senior-level Full TimePune, India11h ago
-
Senior-level Full TimeBangalore, INDIA R15h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R15h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R15h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India15h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India15h ago