Software Engineer [Data Engineer - Python, SQL, Snowflake, Cloud, Devops (CI/CD pipeline) AI (Co-pilot usage and prompt engineering/ Gen AI), Docker, Kubernetes]
Tasks
- Administer data warehouse security
- Automate deployments with CI/CD
- Build data models and transformations
- Collaborate in agile ceremonies
- Create infrastructure configurations
- Design ETL/ELT pipelines
- Develop SQL stored procedures views and tasks
- Develop data ingestion frameworks
- Document technical designs processes and runbooks
- Implement Snowflake streams tasks and Snowpipe
- Integrate AI powered features into data platforms
- Manage Azure Key Vault secrets
- Monitor troubleshoot data pipeline failures
- Optimize data warehouse queries
- Participate in proof of concepts with generative AI
- Perform query performance tuning and cost optimization
- Support release management
- Use AI-assisted development tools
- Work with Azure Data Factory and Azure Storage
Perks/Benefits
- Career development opportunities
- Employee Assistance Program (EAP)
- Flexible working environment
- LinkedIn Learning
- Volunteer time off
- Wellness plans
Skills/Tech-stack
Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure Key Vault | Azure OpenAI | Azure Storage | Azure Synapse | CI/CD | Data Factory | Data Modeling | Databricks | Docker | ELT | ETL | Generative AI | Git | GitHub Actions | Key Vault | Kubernetes | Power BI | Python | REST APIs | SQL | Snowflake | Snowpipe | Streams | Tasks | Terraform | Virtual Warehouses
Roles
Related jobs
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India3h ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India4h ago
-
Computational Software Specialist (Turbomachinery R&D Team) INR 1753K-2700K.NET | Application Architecture | C# | Debugging | GitInternational and multidisciplinary working environment | Long-term career development opportunities | Supportive team culture focused on quality innovation and continuous improvementSenior-level Full TimeGurugram - Haryana - India4h ago
-
Senior-level Full TimePune, Maharashtra, India5h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India5h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R7h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India7h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R7h ago
-
Applied AI/ML Engineer INR 2000K-3000KAgentic Systems | Bias Mitigation | Decision Trees | Evaluation Frameworks | Fallback mechanismsMid-level Full TimeBengaluru, Karnataka, India7h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R7h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeBengaluru, Karnataka, India R7h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | APIs | Agile | ArgoCD | CI/CDOn site work 4 days per week | Relocation N/AMid-level Full TimeHyderabad, India8h ago
-
Software Engineer III-Java, Kafka/Streams INR 2000K-3000KAgile | Application Resiliency | CI/CD | Data Visualization | JavaSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Software Engineer II - AI & Agentic Automation INR 1200K-2500KAI Search | AWS | AWS CDK | AWS CloudFormation | AWS environmentsMid-level Full TimeBangalore, Karnataka, India8h ago
-
Mid-level Full TimeHyderabad, India8h ago
-
Software Engineer INR 1200K-2500KAlgorithms | Artifactory | Azure DevOps | Bitbucket | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
Sr. Data Engineer INR 1500K-2700KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Azure DataHybrid workSenior-level Full TimeChennai, IND-TN, India9h ago
-
Data Engineer INR 1500K-2600KAWS DataZone | AWS Lake | AWS Lake Formation | AWS Lambda | Amazon AthenaContinuous improvement | Hybrid work environment | Stakeholder collaborationSenior-level Full TimeChennai, IND-TN, India9h ago
-
IN|KDN KRC|Digital Audit|Assistant Manager – Tech - BLR INR 1200K-2000KAlteryx | Automation | Data Governance | Data Quality | Data SecurityMid-level Full TimeBangalore, Karnataka, India9h ago
-
Azure Lead Data Engineer INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Google Data Engineer INR 1500K-2500KAgile | BigQuery | CI/CD | Cloud Data | Cloud Data FusionAccidental life insurance | Certifications sponsored | Group insurance | Group life insurance | Health insuranceSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Assistant Manager-Business Analytics INR 1300K-2200KAI Agents | API Integration | BigQuery | Cloud platform | Data LakeMid-level Full TimeAhmedabad, Gujarat, India9h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
Lead Assistant Manager INR 1500K-2500KAWS Redshift | Advanced SQL | Airflow | Apache Spark | Azure DataSenior-level Full TimeGurugram, Haryana, India9h ago