Data Engineer
Tasks
- Build real-time data pipelines with Kafka
- Build scalable data ingestion pipelines
- Design Lakehouse architectures
- Develop Spark batch and streaming jobs
- Enable data quality dashboards for reporting
- Establish monitoring, logging, and alerting
- Implement automated data quality checks
- Implement versioning time travel incremental processing
- Optimize Iceberg tables
- Orchestrate workflows with DBT and Airflow
- Use AWS services to process and optimize cost
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EMR | Amazon S3 | Apache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | DBT | Kafka Streams | Python | SQL | Snowflake | Step Functions
Education
Roles
Related jobs
-
Data Engineer, Play Data Science and Analytics INR 1500K-2000KAI | Automation | C++ | Data Analysis | Data ModelingMid-level Full TimeBengaluru, Karnataka, India3h ago
-
Mid-level Full TimeGurugram, Haryana, India3h ago
-
Software Engineer II - Java Fullstack + React + Python(AI/ML) INR 1000K-2200KAWS | AWS CodeDeploy | Agile | CI/CD | CucumberMid-level Full TimeHyderabad, Telangana, India4h ago
-
Analytics & BI Consultant – Metabase INR 800K-1200KAgile | Business Intelligence | Common table expressions | Dashboards | Data ReconciliationSenior-level Full TimeGurugram, Haryana, India5h ago
-
Data Quality Engineer-Azure Data Platform Testing INR 1200K-1500KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimePune, Maharashtra, India6h ago
-
Data Engineer INR 1500K-2000KADLS | AWS | Airflow | Azure | DBTBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceMid-level Full TimeIndia - Remote R7h ago
-
AI Engineer INR 950K-1050KAWS | Airflow | Algorithms | Apache Spark | Data StructuresGlobal team collaboration | Hybrid workMid-level Full TimeBengaluru, INDIA, India8h ago
-
Associate Data Engineer INR 1000K-1250KApache Airflow | Apache Flink | Apache Spark | Autogen | DagsterEducation reimbursement | Health plans | Hybrid work | In-office perks | Parental leaveMid-level Full TimeBangalore, IND; Mohali, IND; Pune, IND8h ago
-
Data Engineer III - Scala , Spark , Databricks INR 2000K-2300KAWS | Agile | Apache Spark | Big Data | CI/CDSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Applied AI ML Associate Senior INR 950K-1200KAWS | Agentic AI | Agile methodologies | Application Resiliency | CI/CDMid-level Full TimeBengaluru, Karnataka, India8h ago
-
AWS | Apache Airflow | Azure | Azure DevOps | CI/CDSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Mid-level Full TimeRemote, India R10h ago
-
Sr ML & AI Engineer INR 2940K-4500KAPIs | Amazon Web Services | Data Preprocessing | Deep learning | Distributed ComputingContinuous learning and professional growth | Flexible working arrangementsSenior-level Full TimeMumbai, India10h ago
-
Sr Software Engineer INR 3050K-4350KAWS | Amazon Web Services | Best practices | Cloud Computing | DebuggingCross-functional team projects | Learning and development | Online learning campus | Training coursesSenior-level Full TimeMumbai, India10h ago
-
Applied AI ML Lead - Global Banking INR 2500K-3500KAPI Design | AWS | Authentication | Authorization | CI/CDSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Applied AI ML Lead INR 2500K-4000KAWS Lambda | AWS S3 | AWS Step Functions | Agentic AI | Amazon AthenaSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Engineer II, Quality Engineering INR 1340K-1890KAPI Testing | AWS | Amazon Redshift | BigQuery | CI/CDContinuous learning | Family-friendly perks | Financial wellness programs | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …14h ago
-
Data Engineer INR 400K-700KAI | API Integration | Alteryx | Automated testing | CI/CDCareer development | ESG initiatives | Employee incentive programs | Employee wellbeing resources | Flexible vacationEntry-level Full TimeIndia, Bengaluru, Karnataka R14h ago
-
Software Engineer, Data Platform INR 800K-1200KAPI | API Gateway | AWS | Agile | CI/CDCareer development | Headspace access | Hybrid work model | Mental health days | Paid volunteer daysMid-level Full TimeIndia, Bengaluru, Karnataka R14h ago
-
Advanced Data Scientist INR 2040K-2600KBayesian Inference | CI/CD | Causal Inference | Computer Vision | Data QualitySenior-level Full TimeBangalore, KA, IN, 56006614h ago
-
Senior Application Developer, AI INR 2500K-3500KAI Foundry | AI Studio | AWS | Authentication | AzureSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Lead Data Scientist- Content Creation INR 2516K-3356KApache Spark | CI/CD | Computer Vision | Deep learning | Diffusion ModelsSenior-level Full TimeBangalore,India14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Applied AI/Automation DevOps Engineer INR 1100K-1400KAPI Integration | AWS | Agile | Automation | CI/CDEvening shiftMid-level Full TimeIndia - Hyderabad14h ago
-
Applied AI/Automation Engineer INR 950K-1400KAWS | Agile | CI/CD | Capacity Planning | Cause analysisEvening shift schedule | Night shift scheduleMid-level Full TimeIndia - Hyderabad14h ago