Senior Data Engineering
Tasks
- Build data models and data marts
- Build datasets for AI and machine learning initiatives
- Create technical documentation and runbooks
- Design batch streaming and near real time data pipelines
- Develop enterprise data platforms
- Ensure PCI-DSS and privacy compliance
- Evaluate emerging technologies and improve data strategy
- Implement ETL/ELT frameworks
- Implement data governance and lineage tracking
- Implement encryption tokenization masking and secure handling
- Integrate and govern data sources
- Mentor junior data engineers
- Monitor and tune pipeline and platform performance
- Monitor reliability with Splunk and Dynatrace
- Orchestrate workflows with scheduling and automation
- Perform incident management and root cause analysis
- Process large scale datasets with Spark
- Provide disaster recovery and operational support
- Support secure file transfer and integrations
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache NiFi | Apache Spark | Azure Cloud | Azure Cloud Services | Azure Data | Azure Data Factory | CI/CD | Cause analysis | Cloud services | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Data masking | Databricks | DevOps | Dimensional Modeling | Disaster Recovery | Disaster Recovery Planning | Dynatrace | ELT | ETL | Encryption | File Transfer | Incident Management | Infrastructure as Code | Key Management | Managed File Transfer | Metadata Management | PCI DSS | PII | Python | Recovery Planning | Root Cause Analysis | Root cause | SFTP | SQL | Snowflake | Splunk | Terraform | Tokenization | “as-code”
Education
Roles
Related jobs
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAPI Integration | AWS SageMaker | Agent systems | Azure ML | CCPACompany paid medical insurance | Company-paid certifications | Financial and legal consultations | Internal workshops and meetups | Language coursesSenior-level Full TimeIndia2h ago
-
Senior AI Engineer INR 3242K-4680KAWS EC2 | AWS ECS | AWS Lambda | AWS RDS | Amazon S3Financial consultation | Legal consultation | Medical insurance | Mental health support | Paid certificationsSenior-level Full TimeIndia2h ago
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Bitbucket | CI/CD | CSS | CeleryCollaborative work environment | Onsite work 5 days a week | Training and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …3h ago
-
Data Scientist – AI & Cybersecurity INR 2500K-4500KAPIs | AWS | Adversarial Testing | Amazon SageMaker | Anomaly DetectionGrowth opportunities | Mentorship programs | Training opportunitiesSenior-level Full TimeBangalore - Karnataka - India3h ago
-
Senior Java Kafka Architect INR 2000K-2700KAmazon Web Services | Apache Kafka | CI/CD | Code Refactoring | Code reviewSenior-level Full TimeIN-AP-Hyderabad3h ago
-
Data Engineer INR 2000K-3000KAPI Design | Asynchronous programming | Caching | Celery | Clean architectureSenior-level Full TimeIN-KA-Bangalore3h ago
-
Azure Data Engineer INR 1500K-2500KApache Spark | Azure Data | Azure Data Lake | Azure Databricks | Data GovernanceMid-level Full TimeIN-KA-Bangalore3h ago
-
Mid-level Full TimeIN-KA-Bangalore3h ago
-
Software Engineer III, ML Infrastructure, Google Cloud INR 2500K-5000KBack-end | Back-end development | C++ | Cloud APIs | Data StorageSenior-level Full TimePune, Maharashtra, India5h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad; India, Karnataka, Bangalore; …5h ago
-
Algorithms | Amazon S3 | Apache Iceberg | Concurrency | Data ModelingInnovation culture | Mentorship | Remote work flexibilitySenior-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimeBengaluru, KA, IN7h ago
-
Sr. Data Engineer INR 3000K-4000KApache Kafka | Apache Spark | Data Modeling | Data Pipelines | Data integrationSenior-level Full TimeBangalore, Karnataka, IN7h ago
-
Senior-level Full TimeHyderabad, TS, India8h ago
-
Software Engineer III - Java, Springboot, Cloud INR 2200K-3500KAPI Gateway | Agile | Artificial Intelligence | CI/CD | CassandraSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Engineer III - ETL Testing ,Pyspark, AWS INR 2000K-3100KAWS CloudFormation | AWS Glue | AWS Glue Data Catalog | AWS Lambda | AWS MSKAgile team environment | Automated testing validation | Peer reviewSenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Software Engineer II- ETL Testing ,Pyspark, AWS INR 2000K-3000KAWS | Agile | Apache Spark | Application Resiliency | CI/CDEntry-level Full TimeMumbai, Maharashtra, India9h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 2400K-3900KAWS | Agent systems | Apache Spark | Azure | Deep learningConference participation | Remote work | Travel as neededSenior-level Full TimeRemote - India R10h ago
-
Senior Software Engineer – Java, Cloud & APIs INR 2500K-3500KAPI Integration | Best practices | CI/CD | Cloud Native | Cloud platformSenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Mid-level Full TimeGurugram, HR, India10h ago
-
AWS | AWS Kinesis | Agile | Apache Kafka | Cloud platformCloud certification support | Collaborative innovation environment | Inclusive diverse workplace | Mentoring and thought leadership opportunities | Professional developmentSenior-level Full TimeIndia11h ago
-
Senior Storage Engineer INR 2000K-3500KAnsible | CMDB | Cloud Insight | Firewalls | ITILLimited travel | Mentoring opportunitySenior-level Full TimeHyderabad, India12h ago
-
Applied AI ML Associate Senior -AI Engineer INR 2000K-3000KAgentic AI | CI/CD | Cloud deployment | Code review | ContainersMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Applied AI ML Lead- AI Research Engineer INR 3000K-5500KBenchmarking | Efficient Inference | Evaluation | Fine Tuning | Hugging FaceSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
ML & AI Engineer II INR 1860K-3000KAPIs | Classification | Cloud Platforms | Computer Vision | Data PipelinesCareer growth opportunities | Continuous learning and development | Flexible work arrangements | Hybrid work arrangements | Inclusive work environmentMid-level Full TimeNavi Mumbai, India12h ago