Data Engineer | Python, PySpark, Cloud Data Platforms & Migration Expertise
Tasks
- Automate deployments with CI/CD
- Build data pipelines
- Design ETL/ELT workflows
- Develop and manage Informatica IDMC workflows
- Document data architecture and workflows
- Ensure data security and encryption
- Implement data governance and access controls
- Monitor and troubleshoot pipeline failures
- Optimize pipeline performance
- Provision infrastructure with Terraform and CloudFormation
- Support data migration and schema validation
- Validate and reconcile data
Perks/Benefits
- N/A
Skills/Tech-stack
API Management | AWS | Access Control | Agile | Azure | Azure DevOps | CI/CD | Cloud platform | CloudFormation | Data Governance | Data Lineage | Data Management Cloud | Data Modeling | Data Quality | Data Security | Data Warehousing | Dataflow | Delta Lake | Encryption | GDPR | Git | GitLab | Google Cloud | Google Cloud Platform | HIPAA | Informatica Intelligent Data Management Cloud | Intelligent Data Management Cloud | Jenkins | Metadata Management | MySQL | Oracle | PostgreSQL | PySpark | Python | REST APIs | Role-Based Access | Role-Based Access Control | SQL | SQL Server | Scrum | Spark SQL | Terraform | Web Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Software Engineer, Server AI Foundations, Core INR 2000K-4500KAgentic Frameworks | Agents | Agile Development | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Assistant Manager - Cloud & AI Architect INR 2000K-3500KAI Foundry | Access Management | Active Directory | Agent Builder | Agent OrchestrationC level presentations | Client advisory | Mentoring junior resources | Professional developmentSenior-level Full TimeBangalore, Karnataka, India4h ago
-
AWS Data Engineer INR 1500K-2000KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeIndia4h ago
-
Senior-level Full TimePune, Maharashtra, India4h ago
-
Azure Data Engineer - Assistant Manager INR 1500K-2000KAnalysis Services | Apache Spark | Azure Analysis | Azure Analysis Services | Azure CosmosMid-level Full TimeBangalore, Karnataka, India4h ago
-
SAP Gen AI Developer ACON US Inv INR 1317K-2000KAI Core | AI Launchpad | Business Technology Platform | DevOps | DockerMid-level Full TimeBangalore, Karnataka, India4h ago
-
Mid-level Full TimeBangalore, Karnataka, India4h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS Athena | AWS Data | AWS Data Pipeline | AWS Glue | AWS LambdaCorporate social responsibility programs | Maternity leave | Networking opportunities | Paternity leave | Product and service discountsMid-level Full TimeBangalore, Karnataka, India7h ago
-
AI Engineer INR 1800K-3000KAPI Integration | Azure | Azure OpenAI | Chroma | DockerFast-learning culture | Flexible locationMid-level Full TimeNavi Mumbai, Maharashtra, India7h ago
-
Genetics Data Engineer INR 1500K-2500KAWS | Azure | BGEN | Bcftools | Biobank trusted research environmentsMid-level Full TimeBangalore, Karnataka, IN, 5600377h ago
-
Azure Data Engineer_Consultant INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeHyderabad, HYDERABAD, India7h ago
-
Java Spark Engineer INR 2000K-3500KAWS | Apache Spark | Azure | CI/CD | Cloud platformAgile team culture | Career growth opportunitiesSenior-level Full TimeIndia - Bengaluru8h ago
-
AI Engineer - Tieto Tech Consulting (m/f/d) INR 2200K-4200KAI Builder | AI Search | AI Solution | AI solution testing | Agent OrchestrationHybrid work model | Open culture | Professional growth | Work-life balanceMid-level Full TimeBangalore, India8h ago
-
Consultant INR 1500K-3000KAmazon Web Services | Data Lake | DevOps | ETL | Generative AIHybrid work environment | Onsite client location flexibility | Shift workMid-level Full TimeBangalore, IN, 5600668h ago
-
Lead Consultant INR 1500K-3500KAmazon Web Services | Artifactory | Docker | GitHub | JenkinsClient site travel flexibility | Hybrid work environment | Office work requirement | Shift work 10 30 AM to 8 30 PMSenior-level Full TimeBangalore, IN, 5600668h ago
-
AWS | Agile | Apache Airflow | Apache Beam | Apache Druid401k match | Career development support | Dental insurance | Education support | Flexible work optionsEntry-level Full TimePune, India9h ago
-
Senior Data Engineer – Microsoft Fabric INR 1500K-2800KAudit Logging | Azure Data | Azure Data Factory | Data Factory | Data LakehouseSenior-level Full TimeChennai, TN, India10h ago
-
Sr Software Engineer(Java/Python , Spark and AWS) INR 3000K-4600KAWS | Apache Spark | Automated testing | CI/CD | Cause analysisCross-functional team projects | Learning Campus | Training coursesSenior-level Full TimeMumbai, India10h ago
-
Senior-level Full Timetelengana, India11h ago
-
Data Engineering and Analytics INR 1500K-2500KAPIs | Alteryx | Azure Data | Azure Data Factory | Azure Data LakeEntry-level Full TimeNoida, UP, IN, 20130112h ago
-
AI Engineer INR 2000K-5000KAWS | Azure | CI/CD | Cloud platform | DockerRelocation to Mumbai | Work from OfficeSenior-level Full TimeMumbai - Worli, Mumbai - Worli, …14h ago
-
Creative AI Engineer INR 500K-1600KAI Observability | Anthropic Claude | Asynchronous processing | Azure OpenAI | CachingSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Engineer – Marketing Data & AI INR 2200K-3000KAgile | Cloud Native | JavaScript | Microservices | Node.jsFamily-friendly benefits | Flexible career path | Flexible work hours | Hybrid work environment | Learning opportunitiesMid-level Full TimeIN-REM-002|IN-GGN-001, India14h ago
-
Senior-level Full TimeHyderabad, Telangana, India14h ago
-
Senior-level Full TimeIND - Bengaluru, India14h ago