DA Lead Data Engineer
IND - Bengaluru - Brigade Twin Tower, Tower ‘Apex’, 7th and 8th Floor-unit 2 - Ward No. 38, No. 11/1-4 Pipeline Road HMT, Yeswanthpura, India
INR 2400K-4000K (estimate) Senior-level Full Time
Tasks
- Analyze requirements and propose solutions
- Design data ingestion pipelines
- Develop reusable data ingestion frameworks
- Evaluate tools for performance and applicability
- Implement proofs of concept
- Ingest and process event based data
- Integrate end-to-end data pipeline
- Validate data quality and consistency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EC2 | AWS Lambda | Airflow | Amazon S3 | Amazon SNS | Amazon SQS | Amazon Web Services | Big Data | CI/CD | Data Integrity | Data Quality | Data Validation | Data Warehousing | Databricks | Dimension tables | Docker | ETL | Fact tables | Hadoop | Indexes | Jenkins | Kafka | Kubernetes | Materialized views | Matillion | PL/SQL | Power BI | PySpark | Python | Scala | Snowflake | Spark | Stored Procedures | Tableau | Terraform | Triggers | Views | Web Services
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Specialist - Gen AI Development INR 3000K-4800KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerMid-level Full TimeSun Life Global Solutions Private Limited, …10h ago
-
Entry-level Full TimeBengaluru, Karnataka, India11h ago
-
Technical Lead - AI Specialist / Automation Engineer INR 2000K-4800KAdobe | Anthropic | Figma | Fine Tuning | GitHubFull time employment authorized to work without visa sponsorship | Global career opportunities | Robust benefits packageSenior-level Full TimeNoida Office, India11h ago
-
Assistant Manager- AI Engineer with Claude INR 1200K-2500KAWS | Autogen | Azure | Containerization | CrewAIMid-level Full TimeBangalore, Karnataka, India13h ago
-
Principal Data Engineer / Architect - Individual Contributor INR 3200K-4580KAI Agent framework | AWS | Agent Framework | Airbyte | AlertingSenior-level Full TimeBangalore, INDIA R13h ago
-
Senior AI Engineer INR 3715K-5000KAWS | Agentic AI | Angular | Autogen | AzureFlexible work options | Life leave days | Professional development days | Remote-first work model | Vacation time increased with tenureSenior-level Full TimePune, MH, India14h ago
-
Senior-level Full TimeBengaluru, KA, India15h ago
-
API Integration | AWS | Azure | Claude | Cloud platformFounding Team Access | Mentorship opportunities | Technical leadership growthSenior-level ContractHyderabad, India16h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore18h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad18h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad18h ago
-
Senior-level Full TimeHyderabad, TS, India18h ago
-
AI Engineer - MDM INR 3000K-4720KAPI Integration | Access Control | Automation | Cybersecurity | Data AnalysisSenior-level Full TimePune, Maharashtra, IND, 41101318h ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1400K-2000KApache Airflow | Apache Beam | Auditability | Batch Processing | CI/CDMid-level Full TimeHyderabad, Telangana, India R18h ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R18h ago
-
Senior-level Full TimeKolkata,West Bengal,India19h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India19h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India19h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India19h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1500K-2800KAI Model Deployment | AI model | APIs | Agent Frameworks | AzureMid-level Full TimeBangalore, Karnataka, India19h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India19h ago
-
Senior-level Full TimePune, Maharashtra, India20h ago
-
Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryMid-level Full TimePune, Maharashtra, India20h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India20h ago