Lead Data Engineer (Contract, Full-Time) [HR208]
Tasks
- Architect data architecture
- Build machine learning data pipelines
- Build scalable data pipelines
- Build vector search and retrieval systems
- Collaborate with AI and backend teams
- Define data standards and hiring bar
- Design data ingestion transformation and storage
- Develop batch and real time pipelines
- Ensure data reliability security and governance
- Implement monitoring observability and data quality
- Optimize performance of large datasets and queries
- Translate data capabilities into product decisions
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Spark | Batch data | Batch data pipelines | Cloud infrastructure | Data Governance | Data Modeling | Data Pipelines | Data Processing | Data Quality | Distributed Systems | Elasticsearch | Kafka | Machine Learning | Machine learning data | Machine learning data pipelines | Milvus | MongoDB | MySQL | Observability | OpenSearch | PGVector | Pandas | Polars | PostgreSQL | Python | Qdrant | Real Time | Real-time Data | Real-time data pipelines | Vector Databases | Vector Search
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Software Engineer - Full Stack & GenAI INR 3242K-4680KAPI Security | AWS | Amazon RDS | Amazon S3 | AngularHybrid work | Professional developmentSenior-level Full TimeBengaluru, KA, India R17h ago
-
Senior Software Engineer, Machine Learning INR 3600K-5400KA/B | A/B Testing | Amazon S3 | Apache Airflow | B testingDental insurance | Financial wellness support | Health insurance | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R19h ago
-
AI Agents | AWS Bedrock | AWS Lambda | Agent Orchestration | Agent systemsContinuous learning | Fixed working hours | Fully remote | Knowledge sharing | Laptop providedMid-level Full TimeIndia R21h ago
-
ABAP | BDC | Business Intelligence | Data Modeling | Data PipelinesCareer development | Employee communities | Global onboarding | Health insurance | Hybrid workSenior-level Full TimeIndia R21h ago
-
API Versioning | Asynchronous processing | Authentication | CI/CD | CeleryCollaborate with backend and frontend teams | Full-time employment | Fully remote | Hands on experience with production LLM and VLM systems | Work on AI infrastructure model routing and microservicesMid-level Full TimeIndia R22h ago
-
Data Science AI Engineer INR 2000K-4500KAPI Development | AWS | Azure | CMS | Cloud ComputingFully remote | Work-life balanceEntry-level Full TimeBangalore, KA, IN, 560100 R1d ago
-
Lead Data Science AI Engineer INR 2000K-5000KAPI Development | AWS | Agent workflows | Agentic AI | AzureFully remote | Minimal travelSenior-level Full TimeBangalore, KA, IN, 560100 R1d ago
-
Senior Technical Lead - Agentic AI / Generative AI INR 2000K-5000KAPIs | AWS | Agent systems | Autogen | AzureRemote workSenior-level Full TimeIndia - Remote R1d ago
-
Senior Data Engineer INR 2771K-4064KArtificial Intelligence | BigQuery | Cloud platform | Data Engineering | Data VisualizationGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Bangalore-Equifax Credit Information Services, India R1d ago
-
Senior Data Engineer INR 2771K-4064KAI machine learning | BigQuery | Cloud platform | Data Visualization | Entity ResolutionGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Organizational growth potentialSenior-level Full TimeIND-Bangalore-Equifax Credit Information Services, India R1d ago
-
Lead Full Stack Data Engineer INR 3242K-4500KCI/CD | DAX | Data Factory | Data Governance | Data ModelingSenior-level Full TimeIndia - Remote R1d ago
-
Senior Data Engineer INR 3000K-4000KAWS CloudFormation | Airflow DAGs | Alerting | Amazon Kinesis | Amazon S3Remote workSenior-level Full TimeIND - Greater Noida - HeritEdge, … R1d ago
-
Data Governance Engineer INR 1000K-1820KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLAgile career culture | Inclusive workplace | Remote work up to 20% timeMid-level Full TimeIN - Hyderabad, India R1d ago
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Batch Processing | Cost Optimization | Distributed Systems | EmbeddingsBonuses | Disability insurance | Health insurance | Life insurance | Paid parental leaveSenior-level Full TimePune, India R1d ago
-
Staff Software Engineer, Knowledge Catalog, Core Data INR 2500K-5000KDistributed Databases | Distributed Systems | High Throughput | High-Throughput Systems | Indexing pipelinesSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
AI Agents | AWS Bedrock | Context engineering | Cost Optimization | Evaluation PipelinesCommunity forums | Full medical insurance | Laptop provided | Mentorship | No weekend workMid-level Full TimeIndia R1d ago
-
Senior-level Full TimeIndia, Remote R1d ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1000K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | DockerFlexible working | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
AI Engineer - Quality INR 3264K-5876KAPI Testing | Apex | Automation | CI/CD | Data ValidationHybrid work model | Learning platform access | Mental health counseling | Mentorship programs | Paid parental leaveSenior-level Full TimeBangalore, India R1d ago
-
Data Engineer -- Regulatory Reporting & Portfolio Intelligence INR 1000K-1500KAWS | Amazon Redshift | Apache Airflow | Data Quality | GCSEmployee assistance program | Flexible-hybrid work | Generous vacation program | Internal workshops | Learning stipendMid-level Full TimeBangalore R1d ago
-
AWS | Amazon Kinesis | Apache Airflow | Apache Spark | Cloud platformFully remoteMid-level Full TimeIndia R1d ago
-
AWS S3 | AWS storage | AWS storage services | Active Directory | Ansible100 percent remote work | Flexible time off | Holiday allowance | Medical insurance | Shift allowanceMid-level Full TimeIndia R1d ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R2d ago
-
Lead Data Scientist MSAT INR 2475K-4000KArtificial Intelligence | Cause analysis | Data Quality | Data quality control | Deep learningSenior-level Full TimeBengaluru Luxor North Tower, India R2d ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2600KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R2d ago