DA Lead Data Engineer
IND - Bengaluru - Brigade Twin Tower, Tower ‘Apex’, 7th and 8th Floor-unit 2 - Ward No. 38, No. 11/1-4 Pipeline Road HMT, Yeswanthpura, India
INR 2400K-4000K (estimate) Senior-level Full Time
Tasks
- Analyze requirements and propose solutions
- Design data ingestion pipelines
- Develop reusable data ingestion frameworks
- Evaluate tools for performance and applicability
- Implement proofs of concept
- Ingest and process event based data
- Integrate end-to-end data pipeline
- Validate data quality and consistency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EC2 | AWS Lambda | Airflow | Amazon S3 | Amazon SNS | Amazon SQS | Amazon Web Services | Big Data | CI/CD | Data Integrity | Data Quality | Data Validation | Data Warehousing | Databricks | Dimension tables | Docker | ETL | Fact tables | Hadoop | Indexes | Jenkins | Kafka | Kubernetes | Materialized views | Matillion | PL/SQL | Power BI | PySpark | Python | Scala | Snowflake | Spark | Stored Procedures | Tableau | Terraform | Triggers | Views | Web Services
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Mid-level Full TimeHyderabad, India1h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2000K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Senior Software Engineer INR 3264K-5000KAPI Testing | AWS | Amazon Web Services | Ansible | Artificial IntelligenceFamily wellbeing benefits | Health and wellbeing benefits | Paid time offSenior-level Full TimeHyderabad, India7h ago
-
Senior Software Engineer INR 3264K-4720KAI Engineering | Best practices | Business Intelligence | Cloud Computing | Data ArchitectureFamily support benefits | Flexible working options | Health benefits | Paid time off | Retirement benefitsSenior-level Full TimeIndia8h ago
-
Staff Software Engineer - Database Engineering INR 2771K-4064KAmazon Aurora | Ansible | Cassandra | Citus | Configuration ManagementSenior-level Full TimeBangalore, India R8h ago
-
Snowflake & DBT Expert INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CDSenior-level Full TimeNoida, UTTAR PRADESH, India8h ago
-
APIs | Agent workflows | C++ | Caching | CancellationSenior-level Full TimeBengaluru, India9h ago
-
Senior-level Full TimeBangalore9h ago
-
Lead - Data Scientist INR 4000K-5449KCalculus | Constraint Optimization | Cross-validation | Database Schema | Database Schema DesignSenior-level Full TimeBengaluru, India9h ago
-
GCP Data Engineer Lead INR 2000K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, //TS, India9h ago
-
Senior-level Full TimeBengaluru, KA, India10h ago
-
Consultant - Cloud AI Developer INR 1400K-2500KAWS | Azure | Azure OpenAI | CI/CD | Cloud platformClient advisory experience | Consulting experienceMid-level Full TimePune, Maharashtra, India10h ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R10h ago
-
Alerting | Batch Processing | Big Table | Data Modeling | Data ObservabilityFully remote | Inclusion and collaboration culture | Professional growth opportunities | Well-being support | Work-life balance initiativesMid-level Full TimeIndia R11h ago
-
AI Engineer/Scientist INR 1800K-3000KAWS | Agentic Workflows | C++ | Data Structures | Data Structures and AlgorithmsHybrid work schedule | Mentorship | Onsite days 3 days per weekMid-level Full TimeBengaluru R12h ago
-
Senior Engineer - Platform & Data Infrastructure INR 3000K-5000KAWS IoT | AWS IoT Core | ClickHouse | ECS | GoSenior-level Full TimeHyderbad15h ago
-
Sr Technical Lead-Data Engg INR 1500K-2500KAzure | Crystal Reports | DAX | Data Governance | Microsoft FabricSenior-level Full TimeINDIA - BENGALURU - BIRLASOFT OFFICE, …15h ago
-
Lead Database Developer-PostgresSQL INR 1500K-2500KAWS | AWS RDS | Azure | Backup and Recovery | Capacity PlanningSenior-level Full TimeR271- Noida, India15h ago
-
Analyst - Data Engineering INR 700K-1500KData Analysis | Financial Data | Financial Data Analysis | Git | JiraCareer development | Performance rewards | Supportive work cultureMid-level Full TimeBangalore, KA, IN, 56010315h ago
-
Lead Software Engineer, ITC INR 3000K-5000KAPI Design | AWS | Alerting | Apache Airflow | Apache SparkSenior-level Full TimeINDIA TECHNOLOGY CENTER, India15h ago
-
Lead Analyst, Data Operations INR 3000K-4000KAWS | Code review | Dashboard Development | Data Governance | Data PipelinesCollaborative culture | Leadership Training Program | Learning and development programs | Multicultural experienceSenior-level Full TimeIndia R18h ago
-
Lead Analyst, Data Operations INR 3000K-4000KAWS | LookML | Looker | Metabase | Power BICollaborative multicultural environment | Leadership training | Learning and development programsSenior-level Full TimeIndia R18h ago
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …19h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …19h ago
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra22h ago