ETL Tester
Tasks
- Build ELT workflows with streams tasks and materialized views
- Build PySpark data transformations
- Design data pipelines
- Develop Databricks notebooks workflows and jobs
- Develop optimize Snowflake SQL
- Document pipelines workflows and data models
- Ensure data governance, security, and compliance
- Implement Snowflake pipelines using stages file formats copy and Snowpipe
- Integrate data sources into Databricks and Snowflake
- Manage Delta Lake tables
- Optimize pipeline scalability performance and cost
- Perform root cause analysis and prevention
- Troubleshoot Databricks and Spark job failures
- Troubleshoot Snowflake ingestion and warehouse performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS | Azure Data | Azure Data Factory | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | CTE | Data Factory | Data masking | Databricks | Delta Lake | Git | Materialized views | PySpark | RBAC | Snowflake | Snowflake SQL | Snowflake Streams | Snowflake Tasks | Snowpipe | Spark SQL | Synapse Analytics | Virtual Warehouse | Window Functions
Education
Roles
Related jobs
-
Data Bricks Engineer INR 1500K-2400KDatabricks | Databricks SQL | Delta Lake | JSON-RPC | MLflowWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India3h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India4h ago
-
Senior AI Engineer INR 3000K-5000KAPI deployment | Adversarial Testing | Auto Retraining | Azure ML | CI/CDSenior-level Full TimeBangalore10h ago
-
Azure Data | Azure Data Factory | CI/CD | Data Factory | Data ReconciliationSenior-level Full TimeBangalore, India10h ago
-
Senior Talend Developer / Lead Data Engineer INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full Timebengaluru, India11h ago
-
Solutions Architect INR 2400K-3500KADLS | AWS | Airflow | Azure | CassandraBootcamp training | Broadband reimbursement | Continuous learning opportunities | Medical insurance | Paid certificationsSenior-level Full TimeIndia - Remote R12h ago
-
Sr. SW Engineer, Machine Learning INR 2475K-3465KA/B | A/B Testing | Agent systems | B testing | CI/CDFinancial wellness support | Hybrid work | Mental health support | Time offSenior-level Full TimeBengaluru, India12h ago
-
Mid-level Full TimeIT Centre Bengaluru GDTC, India16h ago
-
Senior Data Engineer INR 1500K-2500KAccess Control | Azure | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeHyderabad, IN, 500 00816h ago
-
Java Technical Lead- Career INR 2000K-3000KAWS | Airflow | Apache Beam | Atlassian | AzureHealthcare package | Hybrid work | Learning platform with guided career tracks | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India16h ago
-
Mid-level Full TimeCapital Cyberscape, 2nd Floor, Ullahwas, Sector …16h ago
-
Mid-level Full TimeCapital Cyberscape, 2nd Floor, Ullahwas, Sector …16h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAI/ML | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseFlexibility programmes | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAI/ML | AI/ML data | AI/ML data preparation | Azure Data | Azure Data FactorySenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Senior Associate_Azure Data Engineer_GCC_Advisory_Bangalore INR 2000K-2800KAzure Data | Azure Data Factory | Azure Databricks | Azure SQL | Azure SQL DatabaseEqual employment opportunities | Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
Mid-level Full TimeHyderabad, Telangana, India16h ago
-
EY - GDS Consulting - AIA -Generative AI - Senior INR 1960K-3300KAWS CloudFormation | Amazon Web Services | Apache Spark | Azure | Azure DevOpsCoaching and Mentorship | Continuous learning | Diverse and inclusive culture | Tools and flexibilitySenior-level Full TimeKolkata, WB, IN, 70009116h ago
-
Senior-level Full TimeIndia - Bangalore - 5th floor, …16h ago
-
Senior-level Full TimeIndia - Bangalore - Export Promotion …16h ago
-
Senior AI and Machine Learning Engineer INR 3000K-4590KConvolutional Neural Networks | Data Mining | Data Preprocessing | Data Visualization | Decision TreesSenior-level Full TimeBengaluru, Karnātaka, India16h ago
-
Senior AI and Machine Learning Engineer INR 3000K-4590KCalculus | Convolutional Neural Networks | Data Mining | Data Preprocessing | Data VisualizationFlexible work arrangements | Health and wellbeing benefits | Personal and professional development programsSenior-level Full TimeBengaluru, Karnātaka, India16h ago
-
Senior-level Full TimePlant 4 - Bangalore, India16h ago
-
Data Engineer INR 2520K-3880KAutomation | C# | CI/CD | Cloud Platforms | Data ModelingHybrid work | Learning opportunities | Life and health insurance | Medical care package | Relocation assistanceMid-level Full TimeIN: Pune - Building 5, India16h ago
-
Sr. Associate Software Engineer INR 1500K-2500KAgile | Apache Spark | CI/CD | Data Governance | Data ManagementMid-level Full TimeIndia - Hyderabad16h ago