Data Engineer
Bangalore, India
R
INR 2500K-3584K (estimate) Senior-level Full Time
Tasks
- Apply merge patterns and partitioning
- Collaborate with cross functional stakeholders to deliver self serve analytics
- Design build and maintain data pipelines on Azure Databricks
- Develop analytics ready data models for dashboards and reporting
- Implement data quality checks validation and monitoring
- Implement incremental and idempotent data processing
- Integrate structured and unstructured data for analytics
- Tune Spark jobs and Delta Lake tables for performance and cost efficiency
- Use version control and documentation for data engineering best practices
- Write and optimize SQL transformations and aggregations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Spark | Azure | Azure Databricks | CI/CD | Cloud Security | Columnar Databases | Data Modeling | Data Quality | Data Warehousing | Delta Lake | Docker | Documentation | Grafana | Idempotent Processing | Incremental processing | Kafka | Kubernetes | Merge | Node.js | Observability | Partitioning | Prometheus | Python | REST APIs | Relational databases | SQL | Splunk | Version control
Education
Roles
Related jobs
-
Associate AI-ML Engineer INR 3200K-4500KCI/CD | CrewAI | Databases | Docker | Generative AILearning and growth | Mentorship | Mentorship from technology leadersMid-level Full TimeBengaluru East, Karnataka, India R6h ago
-
Data Warehouse, ETL, Cloud / Consultant Specialist INR 3000K-4000KAWS | Agile | Ansible | Cloud platform | Confluent KafkaFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimePune, Maharashtra, India R9h ago
-
Associate AI-ML Engineer INR 3200K-4500KCI/CD | CrewAI | Data Preparation | Databases | DockerCareer growth opportunities | MentorshipMid-level Full TimeBengaluru South, Karnataka, India R11h ago
-
GCP, Digital Analytics, Bigquery/Senior Consultant Specialist INR 2500K-3900KAttribution Modeling | Batch Processing | BigQuery | Cloud platform | Customer AnalyticsCareer growth | Flexible working | Inclusive workplace | Opportunities for professional developmentSenior-level Full TimeHyderabad, Telangana, India R12h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R18h ago
-
Agile | C# | C++ | CI/CD | Case designDisability programs | Flexible working hours | Life insurance | Private medical care | Remote workSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India R23h ago
-
Sr. Computer Scientist (Data Platform Engineer) INR 3264K-4200KAerospike | Algorithms | Amazon Web Services | Apache Spark | CassandraSenior-level Full TimeBangalore, India R23h ago
-
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800KANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data IngestionMid-level Full TimeIndia (remote) R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R1d ago
-
Data Engineer -6 Years-Remote INR 1500K-2500KA/B | A/B Testing | B testing | Data Analysis | PythonRemote workMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
Mid-level Full TimeBangalore, Karnataka, India R1d ago
-
Alerting | Amazon Redshift | Anomaly Detection | Aurora PostgreSQL | CI/CDFully remoteSenior-level Full TimeIndia R1d ago
-
Senior Specialist - AI Strategy (Mobility) INR 3000K-5000KAgentic AI | Agile delivery | Anomaly Detection | Artificial Intelligence | Cloud ArchitectureSenior-level Full TimePune, Maharashtra, IND, 411013 R1d ago
-
AI-enabled | AI-enabled development | API Integration | Architecture | Data ModelingLaptop provided | Medical insurance | Mentorship | No weekend work | Remote workSenior-level Contract Full TimeDelhi R1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
AWS Glue | AWS Glue Data Catalog | Amazon Athena | Amazon QuickSight | Amazon RedshiftContract-based engagement | Cross-functional team collaboration | Fully remote work | Professional growthSenior-level Contract Full TimeIndia R1d ago
-
AWS | Authentication | Autovacuum | Backup and Restore | Client LibrariesAnnual offsites | Coworking allowance | Employee equity | Flexible schedule | Fully remoteSenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Mid-level Full TimeNoida, India R1d ago
-
Computer Scientist 2 INR 3470K-4580KAWS | Asynchronous Event Driven | Asynchronous Event Driven Systems | Automated testing | AzureSenior-level Full TimeBangalore, India R1d ago
-
Senior AI/ ML Engineer INR 2000K-6000KArtificial Intelligence | CI/CD | Cloud Computing | Computer Vision | ContainersSenior-level Full TimeIndia - Remote R1d ago