Data Engineer
IND-KA-Bengaluru, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build distributed low latency data pipelines
- Collaborate with cross-functional teams
- Communicate with technical and non technical leadership
- Create data engineering documentation
- Design and develop data pipelines
- Design data security access controls
- Develop real-time data ingestion pipelines
- Ensure data quality and consistency
- Implement end to end automation for data validation
- Improve dimensional models for analytics
- Mentor junior engineers
- Monitor production data quality
- Optimize batch and streaming data workloads
- Perform unit and integration testing
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Access Control | Advanced SQL | Amazon DynamoDB | Amazon EC2 | Amazon EMR | Amazon Glue | Amazon Glue Catalog | Amazon Kinesis | Amazon RDS | Amazon Redshift | Apache Airflow | Apache Flink | Apache Hadoop | Apache Kafka | Apache Spark | Astronomer | CI/CD | DBT | Data Lakehouse | Databricks | Dimensional Modeling | Encryption | Fivetran | Git | GitHub Actions | Glue Catalog | Jenkins | Key Management | Performance Tuning | PySpark | Python | SQL Performance | SQL Performance Tuning | Snowflake | Spark Structured Streaming | Structured Streaming
Education
N/A
Roles
Related jobs
-
Embedded Hardware Development INR 2500K-4460KCAN-FD | Codebeamer | DSO | EMMC | Engineering Test ManagementSenior-level Full Timebengaluru, India5h ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R5h ago
-
ML Engineer INR 2000K-3500KAutomated Pipelines | C# | C++ | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform | Flexible benefits | Flexible workingSenior-level Full TimeBangalore, IN6h ago
-
Staff Engineer - Data Path INR 1500K-3000KC# | C++ | Cache Management | Concurrency | Data transferSenior-level Full TimePune Office7h ago
-
Control Path Engineer INR 2000K-3000KAPI Design | Automation | C++ | CI/CD | Configuration ManagementSenior-level Full TimePune Office7h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R9h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R12h ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R12h ago
-
Tech S And T-Cloud AI Platform Engineer-ISR-Senior-GDSF02 INR 3000K-5000KAI Pipelines | ARM Templates | AWS | AWS CloudFormation | Amazon BedrockSenior-level Full TimeNoida, UP, IN, 20130112h ago
-
Sr Analytics Engineer INR 2400K-3000KAPI Integration | AWS | Amazon Redshift | Data Analysis | Data GovernanceRelocation assistanceSenior-level Full TimeBengaluru, India12h ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R12h ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R12h ago
-
ARM | ASIC | Arc | Bitbucket | C#Entry-level Full TimeBengaluru, KA, India23h ago
-
AI Foundry | API Design | Agent Framework | Agents | AzureAI-native team | Enterprise product impact | Onsite work | Ownership of production systemsMid-level Full TimeNOIDA, Uttar Pradesh, India1d ago
-
Senior Software Engineer (App-Framework) INR 2475K-3465KClass Loading | Concurrency | Distributed Systems | Garbage Collection | Input OutputSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer - Networking Infra INR 2475K-3500KC++ | Distributed Systems | Java | Multi-cloud | NetworkingSenior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer (Data Platform) INR 2000K-3000KAirflow | CI/CD | DBT | Data Governance | Data QualitySenior-level Full TimeBengaluru, India1d ago
-
Anonymization | Artificial Intelligence | Data Deidentification | Data Drift | Data Drift DetectionMid-level Full TimeNew Delhi, DL, India1d ago
-
Senior-level Full TimeHyderabad, India2d ago
-
Staff Software Engineer, Looker, Cloud Data Analytics INR 2500K-4200KAI platforms | Artificial Intelligence | Data Storage | Distributed Computing | Enterprise SoftwareSenior-level Full TimeHyderabad, Telangana, India2d ago
-
Embedded Developer - IOT Connectivity INR 1000K-1800KAWS IoT | AWS IoT Core | Automated testing | Azure IoT | Azure IoT HubFlexible hours | Health insurance | On-demand training | Paid volunteering leave | Parental supportMid-level Full TimeChennai, TN, IN, 6000972d ago
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN2d ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India2d ago
-
AI Model Training | AI model | Bash | Cloud platform | Data IngestionAsynchronous culture | Entrepreneurial team | Flexible management approach | Remote-friendlyMid-level Full TimeBangalore, India2d ago