Senior Data Engineer
Bengaluru, Karnataka, India
INR 2520K-3880K (estimate) Senior-level Full Time
Tasks
- Apply security and governance for PII handling
- Build batch and streaming data pipelines
- Create data aggregates and marts
- Define data schemas and data contracts
- Implement data quality validation and anomaly detection
- Instrument pipelines with metrics logs lineage and alerting
- Optimize compute storage and processing cost
- Orchestrate and automate data workflows
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Anomaly Detection | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Pinot | Apache Spark | CI/CD | Cassandra | ClickHouse | Dagster | Data Lineage | Data Modeling | Data Observability | Data Quality | Data Quality Testing | Delta Lake | Dimensional Modeling | Distributed Computing | Druid | Event modeling | Go | Java | Kafka | Lakehouse | MySQL | NoSQL | Orchestration | Parquet | PostgreSQL | Python | Quality testing | Redis | SQL | Scala | Snowflake Schema | Star Schema | Step Functions
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer Ii INR 1200K-2000KAWS | Agile | Batch Processing | DBT | Data LakesExtensive training initiatives | Group insurance | Growth opportunities | Hospitalization insurance | Meal vouchersMid-level Full TimeBangalore, KA, IN, 5600762h ago
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R8h ago
-
Staff Software Engineer INR 3200K-4200KAWS EMR | AWS Glue | AWS Step Functions | Amazon Athena | Amazon S3Hybrid work | Learning opportunities | Onsite collaboration | Remote flexibilitySenior-level Full TimeIndia - Pune - Office8h ago
-
Data Engineer INR 2520K-3380KAzure Data | Azure Data Services | Azure DevOps | DAX | Data GovernanceLearning and career developmentSenior-level Full TimeChennai, IN, 600 0328h ago
-
Senior-level Full TimeBengaluru, Karnataka, India10h ago
-
Platform Operations Engineer INR 1294K-2157KAnsible | Application Server | CentOS | Configuration Management | Configuration management tools24 7 on call coverage | Rotational shiftMid-level Full TimeHyderabad, Telangana, India10h ago
-
CDP ETL & Database Engineer INR 1000K-1680KAWS | AWS Parameter Store | AWS Systems Manager | AWS systems | AgileMid-level Full TimeHyderabad, Telangana, India10h ago
-
Lead Software Engineer INR 2516K-3380KAWS | Agile | Apache Airflow | Apache Hive | Apache LuigiOn call availability supportSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior-level Full TimeBengaluru10h ago
-
Principal Software Engineer INR 2500K-3900KAWS | Apache Flink | Apache Spark | Automated retraining | Cloud platformSenior-level Full TimeBengaluru11h ago
-
AI Solutions Engineer II INR 1600K-2400KAWS | Apache Spark | Artificial Intelligence | Big Data | DatadogAccident insurance | Daily catered meals | Health insurance | Insurance coverage | Life insuranceMid-level Full TimePune, India12h ago
-
Senior Data Engineer INR 2520K-3100KCDC | DBT | Data Lineage | Data Modeling | Data PipelinesOn-call rotationSenior-level Full TimePune, MH, India15h ago
-
Mid-level Full TimePune, MH, India15h ago
-
GTM Strategy Lead Data Analyst INR 2700K-3900KConversational AI | DBT | Data Governance | Data Modeling | Data Quality401k match | Catered lunches | Collaborative office environment | Flexible vacation | HSA contributionsSenior-level Full TimeIndia | Pune17h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KCI/CD | Docker | GitHub | Incident Management | JavaEducation budget | Local team meetups | Professional growth budget | Remote work | Structured secure work environmentSenior-level Full TimeNoida, India18h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Data Modeling | Git | Microservices | PytestLocal legal compliance | Periodic team meetups | Remote workSenior-level Full TimeTrivandrum, India18h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Clean Code | Data Modeling | Git | MicroservicesEducation support | Innovative projects | Legal compliance in India | Local team meetups | Professional development budgetSenior-level Full TimeChennai, India18h ago
-
Software Engineer (AI/DevOps) ID53179 INR 2829K-3500KAI Agents | AI Assisted Development | CI/CD | Docker | GitHub ActionsEducation budget | Innovative projects | Legal Compliance Support | Local team meetups | Personal growth budgetSenior-level Full TimeKochi, India18h ago
-
Software Engineer (Python, AI/ML) ID47296 INR 2535K-4225KCI/CD | Cloud Native | Cloud native design | Data Modeling | Engineering PracticesEducation budget | Local compliance | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeKochi, India18h ago
-
Cloud deployment | FastAPI | GenAI | PostgreSQL | Power BIMid-level Full TimeHyderabad, India18h ago
-
Lead Consultant-SSIS Developer! INR 2500K-3380KData Warehousing | Data integration | Design Patterns | Dimensional Modeling | ETLAI certifications | Mentorship | TrainingSenior-level Full TimeIndia-Bangalore19h ago
-
Lead Consultant - Site Reliability Engineers/L2 INR 2535K-4225KAWS | Angular | Azure | C# | Chaos EngineeringSenior-level Full TimeIndia-Bangalore19h ago
-
Pyspark Data Engineer INR 1200K-2000KAgile | Apache Spark | Data Governance | Data Lake | Data ModelingSenior-level Full TimeIN-KA-Bangalore19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
002AZM - Data Integration Engineer INR 2000K-2040KAWS | AWS Glue | Amazon Redshift | Amazon S3 | Apache AirflowContract work | Remote workSenior-level ContractTamil Nadu, Coimbatore, India20h ago