Senior Data Engineer
Bengaluru, Karnataka, India
INR 2520K-3880K (estimate) Senior-level Full Time
Tasks
- Apply security and governance for PII handling
- Build batch and streaming data pipelines
- Create data aggregates and marts
- Define data schemas and data contracts
- Implement data quality validation and anomaly detection
- Instrument pipelines with metrics logs lineage and alerting
- Optimize compute storage and processing cost
- Orchestrate and automate data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Anomaly Detection | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Pinot | Apache Spark | CI/CD | Cassandra | ClickHouse | Dagster | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Quality Testing | Delta Lake | Dimensional Modeling | Distributed Computing | Druid | Event modeling | Go | Java | Kafka | Lakehouse | MySQL | NoSQL | Orchestration | Parquet | PostgreSQL | Python | Quality testing | Redis | SQL | Scala | Snowflake Schema | Star Schema | Step Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Machine Learning Engineer (Job Location: Mahadevapura) INR 3384K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentoring | Remote work optionsSenior-level Full TimeBangalore, India R4h ago
-
Data Engineer Ii INR 1200K-2000KAWS | Agile | Batch Processing | DBT | Data LakesExtensive training initiatives | Group insurance | Growth opportunities | Hospitalization insurance | Meal vouchersMid-level Full TimeBangalore, KA, IN, 5600764h ago
-
Data Solutions Engineer - MI Solutions INR 1200K-1600KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data FactoryMid-level Full TimeGurgaon, India4h ago
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R10h ago
-
Staff Software Engineer INR 3200K-4200KAWS EMR | AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3Hybrid work | Learning opportunities | Onsite collaboration | Remote flexibilitySenior-level Full TimeIndia - Pune - Office10h ago
-
Data Engineer INR 2520K-3380KAzure Data | Azure Data Services | Azure DevOps | DAX | Data GovernanceLearning and career developmentSenior-level Full TimeChennai, IN, 600 03210h ago
-
Senior-level Full TimeBangalore, KA, IN10h ago
-
Data Quality Engineer - SAP HANA, SAP Information Steward INR 1317K-2000KCode review | Data Modeling | Data Quality | Data Quality Rules | Data ServicesContinuous learning | Flexible working model | Health and wellbeing | Skill growthMid-level Full TimeBangalore, IN, 56006610h ago
-
Systems Integration Specialist INR 2486K-3380KCI/CD | Docker | Docker containers | Event Driven | Event-driven architectureMid-level Full TimeBangalore/Hyderabad/Chennai/Gu, KA, IN10h ago
-
Senior-level Full TimeBengaluru, Karnataka, India12h ago
-
Platform Operations Engineer INR 1294K-2157KAnsible | Application Server | CentOS | Configuration Management | Configuration management tools24 7 on call coverage | Rotational shiftMid-level Full TimeHyderabad, Telangana, India12h ago
-
CDP ETL & Database Engineer INR 1000K-1680KAWS | AWS Parameter Store | AWS Systems Manager | AWS systems | AgileMid-level Full TimeHyderabad, Telangana, India12h ago
-
Lead Software Engineer INR 2516K-3380KAWS | Agile | Apache Airflow | Apache Hive | Apache LuigiOn call availability supportSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior-level Full TimeBengaluru12h ago
-
Principal Software Engineer INR 2500K-3900KAWS | Apache Flink | Apache Spark | Automated retraining | Cloud platformSenior-level Full TimeBengaluru12h ago
-
AI Solutions Engineer II INR 1600K-2400KAWS | Apache Spark | Artificial Intelligence | Big Data | DatadogAccident insurance | Daily catered meals | Health insurance | Insurance coverage | Life insuranceMid-level Full TimePune, India14h ago
-
Senior Data Engineer INR 2520K-3100KCDC | DBT | Data Lineage | Data Modeling | Data PipelinesOn-call rotationSenior-level Full TimePune, MH, India17h ago
-
Mid-level Full TimePune, MH, India17h ago
-
Software Engineer INR 2500K-3200KAPI Integration | Amazon Bedrock | Anthropic API | Asynchronous programming | Azure OpenAI401k matching | Community service initiatives | Employee engagement activities | Flexible spending account | Free coffeeSenior-level Full TimeBengaluru, KA, India17h ago
-
GTM Strategy Lead Data Analyst INR 2700K-3900KConversational AI | DBT | Data Governance | Data Modeling | Data Quality401k match | Catered lunches | Collaborative office environment | Flexible vacation | HSA contributionsSenior-level Full TimeIndia | Pune19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KCI/CD | Docker | GitHub | Incident Management | JavaEducation budget | Local team meetups | Professional growth budget | Remote work | Structured secure work environmentSenior-level Full TimeNoida, India19h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestLocal legal compliance | Periodic team meetups | Remote workSenior-level Full TimeTrivandrum, India19h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Data Modeling | Git | MicroservicesEducation support | Innovative projects | Legal compliance in India | Local team meetups | Professional development budgetSenior-level Full TimeChennai, India19h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KAI Agents | AI Assisted Development | CI/CD | Docker | GitHub ActionsEducation budget | Innovative projects | Legal Compliance Support | Local team meetups | Personal growth budgetSenior-level Full TimeKochi, India19h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Native | Cloud native design | Data Modeling | Engineering PracticesEducation budget | Local compliance | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeKochi, India19h ago