ETL Tester
Tasks
- Build ETL and ELT flows with Spark SQL and ADF
- Build PySpark data transformations
- Build Snowflake pipelines with COPY and stages
- Design Databricks and Snowflake data pipelines
- Develop Databricks notebooks
- Develop Snowflake SQL queries
- Document data pipelines and data models
- Ensure data governance, security, and compliance
- Implement Snowflake streams tasks and materialized views
- Integrate data from relational databases file systems and APIs
- Manage Delta Lake tables and schema evolution
- Optimize Databricks workflows and jobs
- Perform root cause analysis
- Troubleshoot Databricks and Spark job errors
- Troubleshoot Snowflake ingestion and execution errors
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage | Data masking | Databricks | Delta Lake | ELT | ETL | Git | GitHub Actions | Materialized views | PySpark | RBAC | Snowflake | Snowflake SQL | Snowpipe | Spark SQL | Streams | Synapse Analytics | Tasks
Roles
Related jobs
-
Senior-level Full TimeBangalore, Karnataka, India4h ago
-
Mid-level Full TimeBengaluru, Karnataka, India7h ago
-
Snowflake Lead - Manager INR 1500K-2500KAirflow | Anthropic Claude | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Senior Data Engineer INR 3000K-4000KAWS Lambda | Amazon Web Services | Apache Spark | Aurora PostgreSQL | Batch ProcessingBike to work | Educational assistance | Employee assistance programme | Employee discount | Fitness classesSenior-level Full TimeMumbai, MH, India9h ago
-
Data Governance Engineer - Senior INR 1500K-2500KAgile | Amazon Web Services | Apache Hadoop | Apache Kafka | AzureSenior-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full TimeBengaluru, India12h ago
-
Senior-level Full TimeBangalore, KA, IN15h ago
-
POD Engineers (Int) INR 700K-1000KADLS | AWS | AWS Data | AWS Data Migration | AWS Data Migration ServicesTravel opportunitiesMid-level Full Timetbd, AN, IN15h ago
-
Senior Data Engineer I INR 3000K-4000KAWS Lambda | AWS S3 | AWS Step Functions | CI/CD | Control-MComprehensive benefits package | Development opportunities | Flexible working | Wellbeing supportSenior-level Full TimeFIL Bengaluru Office, India15h ago
-
Data Engineer - II INR 2000K-3000KAWS S3 | CI/CD | ControlM | Data Modeling | Data QualityDevelopment opportunities | Flexible working hours | Wellbeing supportSenior-level Full TimeFIL Bengaluru Office, India15h ago
-
Archiving Squad Data Engineer-Senior INR 3000K-4000KAWS S3 | Appian | Azure Blob | Azure Blob Storage | Blob StorageSenior-level Full TimeNoida, UP, IN, 20130115h ago
-
A/B | A/B Testing | AWS | Azure | B testingSenior-level Full TimeBengaluru Millenia, India15h ago
-
IN_Senior Manager_SAP SLT_ Data and Analytics_Advisory_Kolkata INR 1200K-2500KAnalytics Cloud | BOBJ | Business Intelligence | Business Intelligence Development Studio | Business intelligence developmentFlexible work programs | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India15h ago
-
Agile | Angular | Bash | CI/CD | Continuous integrationFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeMumbai Goregaon, India15h ago
-
AWS | Azure | Azure DevOps | DevOpsMid-level Full TimeBengaluru Millenia, India15h ago
-
IN-Senior Associate_ Snowflake Senior Data Engineer _Data and Analytics_Advisory_Bangalore INR 1500K-2500KAWS Glue | AWS Lambda | AWS Step Functions | Apache Airflow | CI/CDSenior-level Full TimeBengaluru Millenia, India15h ago
-
Associate Data Engineer INR 1500K-2000KAWS Redshift | Agile | BigQuery | ETL | GCPFlexible work arrangement | Inclusion and diversity focusMid-level Full TimeBangalore (Ulsoor)IN, India15h ago
-
Azure Data | Azure Data Factory | DAX | Data Factory | Data GatewaySenior-level Full TimeGurugram 10 C, India15h ago
-
Senior Fullstack Developer (Python+AI+React) (IR-528) INR 2000K-4800KAuthentication | Authorization | Background Jobs | Chunking | DockerAccident insurance | Flexible hours | Health insurance | Life insurance | Paid time offSenior-level Full TimeIndia - Remote R15h ago
-
Senior-level Full TimeIND - Bangalore - Ecoworld 6B …15h ago
-
Senior-level Full TimeAPAC - India - Bengaluru - …15h ago
-
Senior Enterprise Engineer (Storage) INR 2000K-3500KAnsible | Automation | Azure | Backup and Recovery | CI/CDHybrid work | On-call rotationSenior-level Full TimeBengaluru, KA, India21h ago
-
Associate Staff Engineer (Python + Agentic Workflows) INR 1800K-2500KAI Agents | Best practices | CI/CD | Cloud Platforms | DockerMid-level Full TimeMumbai, India21h ago
-
Senior Staff Engineer (AI Developer SOC Automation) INR 2500K-4500KAI Search | Analytics rules | Azure AI | Azure AI Search | Azure EventSenior-level Full TimeMumbai, India21h ago
-
Senior Staff Engineer (AI Developer InfraSec Automation) INR 2500K-4500KAI Search | AI vector search | AWS | Access Control | AnthropicSenior-level Full TimeMumbai, India21h ago